Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

need a published docker image with latest huggingface-hub and huggingface-cli #2708

Open
lianhao opened this issue Dec 13, 2024 · 2 comments

Comments

@lianhao
Copy link

lianhao commented Dec 13, 2024

Is your feature request related to a problem? Please describe.

We need a docker image with latest huggingface-hub and huggingface-cli in it, so we can easily pre-downloaded the model in a k8s and/or docker environment. Currently, the only image we've found is https://hub.docker.com/r/huggingface/downloader, which only contains a pretty old version of huggingface-hub that doesn't support downloading some specific models, e.g. meta-llama/Meta-Llama-3.1-70B-Instruct.

Describe the solution you'd like

A simple published docker image with latest huggingface-hub and huggingface-cli.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

@lianhao lianhao changed the title need a published docker image with huggingface-hub and huggingface-cli need a published docker image with latest huggingface-hub and huggingface-cli Dec 13, 2024
@hanouticelina
Copy link
Contributor

hanouticelina commented Dec 16, 2024

Hi @lianhao,
thanks for your request and sorry for the inconvenience! The huggingface/downloader image is meant for internal testing only and isn't actively maintained.
Regarding having a Docker image with huggingface-hub and huggingface-cli pre-installed, we don't plan to maintain this image for now. Of course, we'll prioritize this based on community interest and contributions. Meanwhile, the simplest alternative I can suggest is to create a simple Dockerfile with these packages for your use case, and build and push the image to your own registry.
We'll keep this issue open in case someone from the community wants to step up and maintain such image (that would be awesome!)

@XciD
Copy link
Member

XciD commented Dec 18, 2024

It's basically:

FROM python:3
RUN pip install huggingface_hub

@XciD XciD closed this as completed Dec 18, 2024
@XciD XciD reopened this Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants