Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update pathogen-repo-ci to better support CI [#63] #86

Closed
wants to merge 1 commit into from

Conversation

genehack
Copy link
Contributor

This adds the following features to the pathogen-repo-ci workflow:

  • defines a build-target argument that will get passed to nextstrain build as a target directory — this allows the targeting of sub-dir based workflows, which was the main original issue in ENH: Allow pathogen-repo-ci to invoke workflow in subfolder #63
  • defines arguments (download-previous-artifact, previous-artifact-name) and a conditional step (Dowload previous step artifact) to support the downloading of the build artifact from a previous step to allow testing of later steps in a complete pathogen repo build

This combination of features was all that was needed to support a CI workflow for
seasonal-cov
that:

  1. runs an ingest workflow for a subset of the regular build data
  2. uploads an artifact with the ingest output
  3. downloads that artifact into a phylogenetic workflow
  4. runs the phylogenetic workflow for the same subset of data

Description of proposed changes

This is an attempt to address the issues in #63 , which I also ended up running in to while trying to add CI to the seasonal-cov repo. I made a copy of this workflow into the seasonal-cov repo, and made the minimum viable set of changes needed to support the CI work I wanted to add.

Related issue(s)

seasonal-cov/#8

Checklist

  • Checks pass

This adds the following features to the `pathogen-repo-ci` workflow:

* defines a `build-target` argument that will get passed to
  `nextstrain build` as a target directory — this allows the targeting
  of sub-dir based workflows, which was the main original issue in #63
* defines arguments (`download-previous-artifact`,
  `previous-artifact-name`) and a conditional step (`Dowload previous
  step artifact`) to support the downloading of the build artifact from
  a previous step to allow testing of later steps in a complete
  pathogen repo build

This combination of features was all that was needed to support [a CI
workflow for
`seasonal-cov`](nextstrain/seasonal-cov#11)
that:

1. runs an ingest workflow for a subset of the regular build data
2. uploads an artifact with the ingest output
3. downloads that artifact into a phylogenetic workflow
4. runs the phylogenetic workflow for the same subset of data
@genehack genehack requested review from corneliusroemer, tsibley and a team May 22, 2024 18:29
@joverlee521
Copy link
Contributor

I think it would be good to talk through if CI should be flexible (using the work in this PR) or follow more rigid requirements described in #84.

@tsibley
Copy link
Member

tsibley commented May 22, 2024

c.f. #62 and #57

@genehack
Copy link
Contributor Author

This will need to be further extended, and will be re-oriented to the still-to-be-written ticket summarizing today's meeting.

@genehack
Copy link
Contributor Author

Supplanted by #89 ; closing this issue in favor of that one.

@genehack genehack closed this May 30, 2024
@genehack genehack deleted the update-pathogen-repo-ci-63 branch June 7, 2024 23:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants