python_package_workflow

Getting started with python module workflow

• Deploy flowmium on local by following these steps

• Build python flow and push it to the registry (NOTE: It is recommended to change version with each build instead of latest)

  docker build . -t python-package-workflow-test
  docker tag python-package-workflow-test localhost:5180/python-package-workflow-test:latest
  docker push localhost:5180/python-package-workflow-test:latest
  

• Install flowmium

  python3 -m pip install flowmium
  

• Submit flow to executor (NOTE: Add --dry-run to see YAML definition without submitting the flow)

  python3 -m my_flow --image registry:5000/python-package-workflow-test:latest --cmd 'python3 -m my_flow' --flowmium-server http://localhost:8080
  

• Download output artefact

  flowctl download <flow-id> concat-output.txt .