Skip to content
This repository has been archived by the owner on Dec 18, 2024. It is now read-only.

Backfill historical data through new analysis pipeline #26

Closed
rviscomi opened this issue Feb 1, 2022 · 0 comments · Fixed by HTTPArchive/dataform#10
Closed

Backfill historical data through new analysis pipeline #26

rviscomi opened this issue Feb 1, 2022 · 0 comments · Fixed by HTTPArchive/dataform#10
Assignees

Comments

@rviscomi
Copy link
Member

rviscomi commented Feb 1, 2022

After #19, the pipeline should be able to automatically process new monthly datasets. To make sure that the trends on the HA website are useful, we would need to backfill historical data through the pipeline.

By default, the analysis pipeline should automatically run on the latest monthly dataset. We should also be able to manually run the pipeline on historical datasets to generate new metrics from old data.

Once that functionality is set up, we should run all applicable historical datasets through the pipeline to generate the historical trends for each metric in the HA reports.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants