Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why does unigrams and bigrams give the same result? #19

Open
mukhal opened this issue Feb 18, 2021 · 1 comment
Open

Why does unigrams and bigrams give the same result? #19

mukhal opened this issue Feb 18, 2021 · 1 comment

Comments

@mukhal
Copy link

mukhal commented Feb 18, 2021

Hello,

I am running MOVERScore on summarization outputs, with both n_gram=1 and n_gram=2. Surprisingly, I am getting the exactly same score in both cases. Shouldn't there be a difference, even if small?

@andyweizhao
Copy link
Collaborator

@Mohammadkhalifa Thanks a lot for your interest! I believe this is because the word_mover_score function is imported from moverscore_v2 instead of moverscore. For simplicity, the features of power-mean and n-gram are disregarded in the moverscore_v2.py to accelerate the speed, while moverscore.py with full features is reserved for the reproducibility.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants