Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The results can not be reproduced #7

Open
LemonQC opened this issue Sep 23, 2021 · 4 comments
Open

The results can not be reproduced #7

LemonQC opened this issue Sep 23, 2021 · 4 comments

Comments

@LemonQC
Copy link

LemonQC commented Sep 23, 2021

The results in your paper about WEBNLG on bleu-4 is 61,while I re-run your code, I only get 46. Can you provide a pretrained model or release your evaluation code.

Thanks

@turboLJY
Copy link
Owner

We have uploaded the evaluation code.

@LemonQC
Copy link
Author

LemonQC commented Sep 27, 2021

Thank you, however,as I used your evaluation code. The results are as follows
image

Is there any error in dataset?

@turboLJY
Copy link
Owner

We have fixed the error.

@LemonQC
Copy link
Author

LemonQC commented Sep 29, 2021

We have fixed the error.

However, the results still can not be reproduced. Is there any pretrained model?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants