Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Groq Llama 3.1 #1817

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

murillocamargo
Copy link
Contributor

Added new Llama 3.1 model via Groq.

But getting this error message when trying to chat. Does this mean it's not yet available via API or something?

image

@haydenkong
Copy link

Early API access to Llama 3.1 405B is currently only available to paying customers - stay tuned for general availability. During preview launch, we are limiting all 3.1 models to max_tokens of 8k and 405b to 16k input tokens: https://console.groq.com/docs/models

image

let adaptedParts = []

let rawParts = []
if(!Array.isArray(message.content)) {
rawParts.push({type: 'text', text: message.content})
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do you touch Google Gemini code sections with a PR that addresses Groq Llama 3.1 ?

) {
let geminiMessages = []
for (let i = 0; i < messages.length; i++) {
let adaptedMessage = adaptSingleMessageForGoogleGemini(messages[i])
geminiMessages.push(adaptedMessage)
}

if(payload.chatSettings.model === "gemini-pro-vision") {
if (payload.chatSettings.model === "gemini-pro-vision") {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These look like automatic formatting changes with disturbs the focus of the PR here.

@@ -6,7 +6,7 @@ export type Json =
| { [key: string]: Json | undefined }
| Json[]

export type Database = {
export interface Database {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's best not to touch supabase related sections needlessly.

Copy link
Contributor

@faraday faraday left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd leave out the parts unrelated to Groq Llama 3.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants