Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unclear which inference providers and models are supported with bee-python-sdk #5

Open
mmurad2 opened this issue Oct 28, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@mmurad2
Copy link
Member

mmurad2 commented Oct 28, 2024

Description
A number of users believe the python SDK can only be used with OpenAI credentials.

Proposed solution

  • Update docs with list of supported inference providers and recommended models for use
  • Update .env template with supported inference providers.
@mmurad2 mmurad2 added the enhancement New feature or request label Oct 28, 2024
@jezekra1
Copy link
Collaborator

jezekra1 commented Nov 12, 2024

There is no model configuration in .env in bee-python SDK, it runs against the API, the credentials are the API credentials and runs on whatever provider was set in the API. If you run it locally, you need to run the stack, where you configure the backend and if you run it against dev/prod, the backend are always internal vLLM services.

If you plug in OpenAI credentials, you're using OpenAI API not Bee 🙈

I think it's clear from the first few lines of readme, but let me know if there is a way how to make this better

@psschwei
Copy link
Contributor

I think adding a note for external users that the bee-stack needs to be running locally would be useful (I didn't know that the first time I ran the sdk 😄 )

If you agree, I opened #8 to add that note

@mmurad2
Copy link
Member Author

mmurad2 commented Nov 19, 2024

@psschwei that would be helpful!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants