Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MM-56193: migrate dags to airflow 2 #1406

Merged
merged 42 commits into from
Dec 15, 2023
Merged

MM-56193: migrate dags to airflow 2 #1406

merged 42 commits into from
Dec 15, 2023

Conversation

ifoukarakis
Copy link
Contributor

@ifoukarakis ifoukarakis commented Dec 14, 2023

Summary

Migrate dags and plugins to Airflow 2

  • Move all airflow-related code under airflow/.
  • Add DAG-related code in mattermost_dags package under dags/. Do the same for plugins, placing them in mattermost package under plugins/. This is required due to the way DAGs and plugins are loaded by bitnami's airflow.
  • Fix breaking API changes.
  • Fix and improve tests.
  • Convert airflow/ to poetry project in order to have a standard way for dependency management.
  • Address warnings due to deprecations or change in API behavior.

Ticket Link

https://mattermost.atlassian.net/browse/MM-56193

@ifoukarakis ifoukarakis changed the title Airflow2 MM-56193: migrate dags to airflow 2 Dec 14, 2023
@ifoukarakis ifoukarakis added the Work In Progress Not yet ready for review label Dec 14, 2023
@ifoukarakis ifoukarakis added 2: Dev Review Requires review by a core committer and removed Work In Progress Not yet ready for review labels Dec 14, 2023
@ifoukarakis ifoukarakis added the 3: Reviews Complete All reviewers have approved the pull request label Dec 15, 2023
@ifoukarakis ifoukarakis merged commit 5ec71b9 into master Dec 15, 2023
6 checks passed
@ifoukarakis ifoukarakis deleted the airflow2 branch December 15, 2023 09:33
@ifoukarakis ifoukarakis removed the 2: Dev Review Requires review by a core committer label Apr 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3: Reviews Complete All reviewers have approved the pull request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants