-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Cerebras Integration #3585
Add Cerebras Integration #3585
Conversation
Anyone know why these files that I didn't touch are failing the linter? https://github.com/microsoft/autogen/actions/runs/11111974198/job/30874062565?pr=3585#step:6:193 The first few seem legit, but I didn't touch any HTML stuff |
3ea6961
to
9a25348
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes look great, and consistent with how other client providers are implemented. I do not have means to test the changes end-to-end, but what I see looks good. I believe there is some small format fixed that are needed to pass the test, but on substance this looks good.
Ah the HTML thing is a line ending issue in main I am pretty sure, I'll open a PR for it |
Is there something I can do to fix it locally? It's actually breaking my git right now 😢 |
Yeah I had the same thing happen to me... I'm not sure. I'll have what I think is the fix merged in a few mins (just waiting on an approval) |
9a25348
to
6bc31ad
Compare
Cool, looks like the HTML file issue is gone, just some other formatting issues to be resolved then we can merge this |
@jackgerrits can you approve the workflow please? I ran |
Why are these changes needed?
Add integration for Cerebras, which provides super low-latency, high speed LLM inference. Currently Llama 3.1-8B/70B are supported.
Tool calling examples have been provided in this PR, which also function with streaming. Additionally, token cost calculations have been implemented.
This PR mirrors the changes from: autogenhub#48
Checks