Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to find the exact hyperparameters (arguments passed to the script) to reproduce the results of transformers in Table 9 or 2 #109

Open
Saleh-Gholam-Zadeh opened this issue Jan 26, 2024 · 0 comments

Comments

@Saleh-Gholam-Zadeh
Copy link

Dear all.
Thanks for publishing and sharing such a nice and clean code and congrats for your nice paper.

I want to reproduce the results of e.g Table 9 or Table 2 (any of them would be sufficient for me).

using the scripts inside the .scripts/EXP-LongForecasting/Linear/univariate I could only reproduce the results of NLinear which is of course the best one (has the lowest error) as reported in the table.
however I can't reproduce the rest. E.g if I just change the model_name to Linear or DLinear the results are not the same as the table.
especially with the transformer I don't know which script can re-produce this results. e.g what should be the number of epochs? or what should be the learning rate? should I use the default ones?

can you please upload the script with the exact input parameters so that I can reproduce one of these tables 2 or 9?
Best regards,
Saleh

p.s.
background: For my own research, I need to do some further studies and therefore I need to save the input, prediction and groundtruth associated with the reported results.

@Saleh-Gholam-Zadeh Saleh-Gholam-Zadeh changed the title How to find the exact hyperparameters (arguments passed to the script) to reproduce the results of transformer. How to find the exact hyperparameters (arguments passed to the script) to reproduce the results of transformers in Table 9 or 2 Jan 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant