Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure skipping data change for domains #95

Merged
merged 1 commit into from
Dec 20, 2024

Conversation

mkangia
Copy link
Contributor

@mkangia mkangia commented Dec 19, 2024

A way to configure any domains to be skipped during data source processing.

This would come in handy and I currently need it to skip changes queued for a project I would manually refresh making the changes redundant.

@mkangia mkangia force-pushed the mk/4136-allow-skipping-domains-changes branch from 4e03602 to b322aab Compare December 19, 2024 22:38
@@ -41,6 +51,10 @@ def update_dataset(self):
raise TableMissing(f'{self.data_source_id} table not found.')
table = sqla_table.get_sqla_table_object()

if table.schema and table.schema in SKIP_DATASET_CHANGE_FOR_SCHEMAS:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will this then only ignore future dataset changes, or will it also ignore ones that are currently queued?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had an offline sync with Manish.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Offlined that the change will apply to any domains added to config and celery restarted.

@mkangia mkangia merged commit 4efbf31 into master Dec 20, 2024
3 checks passed
@mkangia mkangia deleted the mk/4136-allow-skipping-domains-changes branch December 20, 2024 11:41
@mkangia mkangia mentioned this pull request Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants