Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: have a way to apply a patch of changes #897

Open
keevan opened this issue Sep 24, 2024 · 1 comment
Open

Enhancement: have a way to apply a patch of changes #897

keevan opened this issue Sep 24, 2024 · 1 comment

Comments

@keevan
Copy link
Contributor

keevan commented Sep 24, 2024

Use case:

  • Dataflow created
  • Imported to a particular environment (e.g. production / test)
  • Tweaks done locally
  • Dataflow updated in the aforementioned environment.

This works fine, but if the dataflow has been modified moderately (e.g. adding more than 3 steps), perhaps tweaking paths for other steps, this can become error prone.

Ideally, there would be:

  • a way to "patch" in the changes, probably after some confirmation,
  • and/or selectively apply any changes for steps that were affected (e.g. if the local env have different config for connections).. but this is bells and whistles

In theory, even the most changed dataflow might have a process like:

  • create datafloww
  • import dataflow into some env
  • tweak locally
  • export local and apply patch to dataflow in env, selectively applying relevant changes

For now, the process would need to be something like:

  • .... perform tweaks
  • export both env and local dataflows
  • compare diff
  • apply changes manually (add steps, edit steps, remove steps, etc.)
@brendanheywood
Copy link
Contributor

Isn't this more or less export as yaml, apply diffs there, import?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants