Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rolling 7 day average #59

Open
2 of 3 tasks
isaacmg opened this issue Jul 1, 2020 · 2 comments
Open
2 of 3 tasks

Rolling 7 day average #59

isaacmg opened this issue Jul 1, 2020 · 2 comments
Assignees

Comments

@isaacmg
Copy link
Member

isaacmg commented Jul 1, 2020

Based on @wwymak comments we would like to try forecasting cases on a rolling weekly average. While this removes a degree of granularity it may ease problems with reporting issues.

Acceptance criteria:

  • Experiments logged on primary counties list.
  • Pre-processing code for merged into the task-ts repo
  • Report detailing finding of using the seven day average.
@isaacmg
Copy link
Member Author

isaacmg commented Aug 9, 2020

So we have done a number of experiments with this setting. The end result has shown that are models are not generalizing well to out of distribution events. Due to this we will continue to run future experiments with enhanced models in order to explore this further.

@isaacmg
Copy link
Member Author

isaacmg commented Aug 13, 2020

Update I have now analyzed a couple of the models using rolling 7 day average:

  • DA-RNN so far performs a bit better than the transformer on LA County but doesn't do too good on cook county (at least not with our current hyper parameter searches).
  • Generic transformer doesn't seem to work well at all in this context. However, we haven't tried extensive transfer and more than basic hyperparam tuning.
    To-do:
  • Continue testing DA-RNN with hyper parameters (dropout, different decoder sizes) and transfer learning (need to add the embedding layer into repo for that).
  • @kritim13 is also working on probabilistic models we hope to merge soon and test.
  • Neural ODE's

@isaacmg isaacmg self-assigned this Aug 28, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant