Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize how App Engine generates reports and metrics #973

Open
rviscomi opened this issue Feb 1, 2022 · 1 comment
Open

Optimize how App Engine generates reports and metrics #973

rviscomi opened this issue Feb 1, 2022 · 1 comment
Assignees

Comments

@rviscomi
Copy link
Member

rviscomi commented Feb 1, 2022

Related to HTTPArchive/data-pipeline#19 and #939, the HA website currently generates the reports from a reports.json config file that we manually maintain.

The way queries are organized in the analysis pipeline should be identical to the way metrics are organized in the HA reports. So instead of maintaining the config file manually, the HA website should automatically be kept in sync. We could do this by auto-generating the config file or dynamically discovering which reports/metrics are available. Either way, the App Engine config and server should handle the more optimized approach.

@rviscomi
Copy link
Member Author

rviscomi commented Feb 1, 2022

The ideal workflow I'm going for is to make it as easy as possible to add new metrics. So for example, if the 2022 JavaScript chapter team comes up with an idea for a new metric, the minimal amount of information needed to start tracking it should be the SQL and a bit of metadata. They can submit that to the analysis pipeline and the JS report would automatically pick it up and include the metric without having to manually update the config.

@max-ostapenko max-ostapenko transferred this issue from HTTPArchive/data-pipeline Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants