Docker container for whisper-gui

[3x3cut0r]

Hey!
First of all i want to thank you for this great project.
I have created a docker container of it.
It's a CPU only version of this project.
What do you think?

[Pikurrot]

Hi, it's great! I've tested it myself and works fine and smoothly.
However, I'm not very experienced on docker, and I'm having trouble trying to use a custom model I have saved locally. Have you been successful on that? How would you do it?

[Pikurrot]

Ok my bad, I had some weird errors but after updating docker desktop and restart the container it worked.
If you don't mind, I will link your dockerhub project in the Readme.
Now I was wondering, could we allow the container to use the host GPU to run whisper?

[3x3cut0r]

the problem is i have only a mac mini and no cuda compatible gpu to test with. this problem i have also in other projects like privategpt ... and cuda needs another base image to run.
what i can do or test is to move the container to a cuda base image and after that i can test if its still working.

[Pikurrot]

ok try that. I myself have a computer with nvidia gpu, so I will try in the next days to allow gpu for the container.
My aim with this project is that it's compatible for any device, so this is important.

[3x3cut0r]

So i want to build an image with the nvidia:cuda as base. Unfortunately my M2 Mac wont build it for some rosetta error: rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2
Seems like the image is not compatible with MacOS. So i cannot continue with building an cuda image :/

Do you know maybe where i can find a free platform with nvidia gpus to test with? I tried google colab, but there it is not possible to install vanilla docker ...

[Pikurrot]

AWS has several free tier offers, maybe some of them allow you a VM with gpu access, take a look but I don't know I've never used AWS.

I myself have not been able to successfully use gpu in a docker container. I can build the image but then when running the container I get some errors, mainly this one I've not been able to fix: RuntimeError: CUDA failed with error CUDA driver version is insufficient for CUDA runtime version.
Here is the dockerfile I'm using: https://github.com/Pikurrot/docker/blob/main/whisper-gui/Dockerfile