Skip to content

vishakha-ramani/multi-cluster-app-dispatcher

 
 

Repository files navigation

Multi-Cluster App Dispatcher

The multi-cluster-app-dispatcher is a Kubernetes controller providing mechanisms for applications to manage batch jobs in a single or multi-cluster environment.

The multi-cluster-app-dispatcher (MCAD) controller is capable of (i) providing an abstraction for wrapping all resources of the job/application and treating them holistically, (ii) queuing job/application creation requests and applying different queuing policies, e.g., First In First Out, Priority, (iii) dispatching the job to one of multiple clusters, where a MCAD queuing agent runs, using configurable dispatch policies, and (iv) auto-scaling pod sets, balancing job demands and cluster availability (future work).

Build Information

Follow the build instructions here to build the Multi-Cluster-App-Dispatcher controller.

Deployment Information

Refer to deployment instructions here on how to deploy the multi-cluster-app-dispatcher as a controller in Kubernetes.

Release Process

  1. Run the mcad-release.yml action under Actions by entering the new release version in the Release tag input field and click Run workflow. mcad-release

  2. Verify that mcad-release.yml action passed successfully. This workflow will create GitHub release tag.

  3. The release tag then trigger the image build/push pipeline and push the image to mcad-controller quay repository with specified release version tag.

  4. Verify a new release is created on the Releases page .

  5. The latest release changes should also reflect in the mcad go package module.

Tutorial

Refer to the tutorial on how to use multi-cluster-app-dispatcher to run batch job in Kubernetes

Overall Architecture

xqueuejob-controler

About

Holistic job manager on Kubernetes

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 80.9%
  • Shell 14.6%
  • Python 3.1%
  • Makefile 1.1%
  • Other 0.3%