Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question for share_matched_indices #509

Open
vvvvvair opened this issue Dec 11, 2024 · 2 comments
Open

question for share_matched_indices #509

vvvvvair opened this issue Dec 11, 2024 · 2 comments
Assignees

Comments

@vvvvvair
Copy link

感谢您出色的工作。
有个疑问关于计算损失过程中的share_matched_indices变量。
源代码给出的默认是False,表示辅助解码层不与最后一层共用匈牙利匹配的索引,因此辅助解码层都需要重新计算匈牙利匹配的索引。
但是从直觉上来说,这样应该会导致匈牙利匹配不稳定?因为每一层的query都匹配了不同的结果。
想请问下这个参数的配置对结果会有影响嘛?

@lyuwenyu
Copy link
Owner

share_matched_indices是一个实验性功能;

初步的实验结论:可以提升训练效率和前期的收敛速度,但是的模型效果并没有提升,故默认没有开启

@vvvvvair
Copy link
Author

share_matched_indices是一个实验性功能;

初步的实验结论:可以提升训练效率和前期的收敛速度,但是的模型效果并没有提升,故默认没有开启

好的,谢谢您!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants