Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Not all Qwen models support the "enable_search" parameter #5296

Open
PatriciaLee3 opened this issue Jan 4, 2025 · 2 comments · May be fixed by #5297
Open

[Bug] Not all Qwen models support the "enable_search" parameter #5296

PatriciaLee3 opened this issue Jan 4, 2025 · 2 comments · May be fixed by #5297
Labels
🐛 Bug Something isn't working | 缺陷

Comments

@PatriciaLee3
Copy link

📦 Environment

Docker

📌 Version

v1.43.1

💻 Operating System

Other Linux

🌐 Browser

Chrome

🐛 Bug Description

In #5039, we added the enable_search parameter to Qwen model requests according to the documentation. However, not all Qwen models support this parameter. e.g. qwen2.5-3b-instruct.

...(model.startsWith('qwen-vl') ? {
top_p: (top_p !== undefined && top_p > 0 && top_p <= 1) ? top_p : undefined,
} : {
enable_search: true,
top_p: (top_p !== undefined && top_p > 0 && top_p < 1) ? top_p : undefined,
}),

image

📷 Recurrence Steps

No response

🚦 Expected Behavior

No response

📝 Additional Information

No response

@PatriciaLee3 PatriciaLee3 added the 🐛 Bug Something isn't working | 缺陷 label Jan 4, 2025
@github-project-automation github-project-automation bot moved this to Roadmap - Chat 1.x in Lobe Chat Routine Jan 4, 2025
@lobehubbot
Copy link
Member

👀 @PatriciaLee3

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

Copy link

dosubot bot commented Jan 4, 2025

Hey @PatriciaLee3, I'm here to help you with any bugs, questions, or contributions! Let me know how I can assist you.

The issue you're encountering is due to the fact that not all Qwen models support the enable_search parameter. According to the codebase, models that start with 'qwen-vl' do not have the enable_search parameter set to true, which might be causing the invalid parameter error you're seeing with the qwen2.5-3b-instruct model [1].

To resolve this, you may need to adjust the logic in the handlePayload function to ensure that enable_search is only set for models that support it. This involves checking the model name and applying the parameter conditionally based on the model's capabilities.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Something isn't working | 缺陷
Projects
Status: Roadmap - Chat 1.x
Development

Successfully merging a pull request may close this issue.

2 participants