Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: New o1 model not supported by litellm? #7375

Open
cpath-ukk opened this issue Dec 23, 2024 · 2 comments
Open

[Bug]: New o1 model not supported by litellm? #7375

cpath-ukk opened this issue Dec 23, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@cpath-ukk
Copy link

What happened?

A bug happened!

I use litellm from crewai. Everything works well with using model openai/o1-preview, but does not work
with o1 or o1-2024-12-17.
They seems to be now officially available via API from OpenAI.

I updated litellm to the last version via pip before trying and I am Tier 5 user supposed to have no restrictions for OpenAI API.

litellm.exceptions.NotFoundError: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model o1-2024-12-17 does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

Relevant log output

litellm.exceptions.NotFoundError: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model `o1-2024-12-17` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v.1.55.9

Twitter / LinkedIn details

No response

@cpath-ukk cpath-ukk added the bug Something isn't working label Dec 23, 2024
@lawliet19189
Copy link

Can you access the new O1 model directly through the OpenAI sdk? If not, you likely don't have access to the newer models.

I can confirm that newer O1 models on litellm works (fyi, it also doesn't require upgrading litellm). Hope this helps!

@cpath-ukk
Copy link
Author

Thank you. I tried over openAI sdk - it seems that I don't have the access there as well. Obviously the roll out is in several waves for Tier 5 users. I am not there yet. Thank you for helping with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants