You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Title: Inconsistent Model Specification Behavior in Open Interpreter
Describe the bug
When attempting to specify a model using the --model flag in Open Interpreter, the system incorrectly handles the 'groq/' prefix by appending 'openai/' by default, which is confusing. There should be a clearer handling of prefixes.
To Reproduce
Steps to reproduce the behavior:
Open the terminal.
Run the command interpreter --api_base "https://api.groq.com/openai/v1" --model "groq/Mixtral-8x7b-32768".
Observe that the system appends 'openai/' to the model path instead of recognizing 'groq/'.
Expected behavior
Correct handling of the provider. Groq should be supported without having to specify its api_base.
# This doesnt work, and is desired
interpreter --model "groq/llama3-8b-8192" --api_key "key_here"
# This doesnt work either
interpreter --api_base "https://api.groq.com/openai/v1" --model "groq/llama3-8b-8192" --api_key "key_here"
# This works
interpreter --api_base "https://api.groq.com/openai/v1" --model "llama3-8b-8192" --api_key "key_here"
Screenshots
Desktop (please complete the following information):
OS: w11
Python Version 3.12
Additional context
The text was updated successfully, but these errors were encountered:
Title: Inconsistent Model Specification Behavior in Open Interpreter
Describe the bug
When attempting to specify a model using the
--model
flag in Open Interpreter, the system incorrectly handles the 'groq/' prefix by appending 'openai/' by default, which is confusing. There should be a clearer handling of prefixes.To Reproduce
Steps to reproduce the behavior:
interpreter --api_base "https://api.groq.com/openai/v1" --model "groq/Mixtral-8x7b-32768"
.Expected behavior
Correct handling of the provider. Groq should be supported without having to specify its api_base.
Screenshots
Desktop (please complete the following information):
Additional context
The text was updated successfully, but these errors were encountered: