Experiment with dagger SDK/Mage for running registry and test tasks

[sheldonhull]

Overview

Dagger runs containerized. Runs equally well on a windows machine, macOS, or Linux, and would allow Go based test and configuration runs without any environment impact.

Why is the proposal needed?

I noticed the cmdx tool is used which is pretty cool (reminds me of Task).
Consider using Mage as an alternative to experiment with which would let you eliminate any core reliance on shell scripts for automation.

Note

I'm not asking you to go do it, rather if you'd be open a to demo magefile contribution that could include automating some of the tasks that use containers and a few supporting tasks as a start.

It's not high priority, but if interested I'd be glad to demo something.
I've used for over 2 years and found it great for automation in nearly 100% Go, while being low friction. The Dagger SDK provides another level of amazing automation capabilities that isolate the system from being impacted by the environment, perhaps improving long term maintenance.

[suzuki-shunsuke]

Thank you for your proposal.
Let me confirm if my understanding is correct.

We use cmdx, shell scripts, registry-tool, and Docker to build aqua-registry's local development workflow.

• https://github.com/suzuki-shunsuke/cmdx
• https://github.com/aquaproj/aqua-registry/blob/main/cmdx.yaml
• https://github.com/aquaproj/aqua-registry/tree/main/scripts
• https://github.com/aquaproj/registry-tool

So in my understanding, your proposal is to replace them with Dagger or Mage. Is this correct?

Indeed, current cmdx tasks and shell scripts depend on bash and environment so I wanted to migrate parts of them to registry-tool.
I'm not familiar with Dagger and Mage, but I'm interested in how they improve our experience.

BTW, we ever used Earthly but stopped using it as Earthly was a little slow and the current implementation with cmdx and Docker was faster and better experience than Earthly. aquaproj/aqua-registry#16597

[suzuki-shunsuke]

I tried Dagger, though this is still work in progress.

• chore: use Dagger aqua-registry#22777

Dagger is interesting but have an overhead so I'm not sure if we should replace existing scripts with Dagger.

[gedw99]

interested

I tried cmdx. Its ok, but because its is bash based I cant use it. I like how aqua is cross platform and works on Windows, Mac and Linux automagically.

I tried task, mage and others also with aqua, and they can work well together.

There is also Task-ui, which is pretty cool

then there is runner with is a ProcFile runner that helps with running many things at once. It's been a god send and works on All Desktops too.
https://github.com/cirello-io/runner

runner is very powerful. you can run multiples or a server, where you need to have 3 of everything clustered.
The .env is then able to cope with these multiples. It's very very impressive, and all from a ProcFile and .env file. It helped me a lot and I also run it on Production Servers with aqua and wasm runners

Runner also has a Web GUI, so you can monitor many many services remotely.

I use Task and Task-Ui with Runner and its is enough for 100% of what I do. Task UI is a real time GUI for Task. I had to modify it to work with docker and runner ( non docker ).

https://github.com/titpetric/task-ui