Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add router model in pne.chat #838

Open
Undertone0809 opened this issue Aug 3, 2024 · 2 comments
Open

Add router model in pne.chat #838

Undertone0809 opened this issue Aug 3, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@Undertone0809
Copy link
Owner

Undertone0809 commented Aug 3, 2024

🚀 Feature Request

在一些场景里,我们需要用合适的模型去应用在不同的场景里,比如在简单问答的场景下,可以直接的使用 gpt-3.5,在需要复杂逻辑推理的场景下,用 gpt-4-turbo。

这意味着,对于一个问题来说,需要一种路由模型,来选择出一个合适的推理模型,下面还一种可能的示例代码。

import pne

pne.chat(messages="hello", model=["gpt-4o", "deepseek/deepseek-chat"])

ref: https://x.com/tuturetom/status/1819400584799441162

Question

  • 对于 https://x.com/tuturetom/status/1819400584799441162 中的代码演示,或许我们还需要判断一下,或许这种调用方式并不是最合适的调用方式,待讨论。
  • 在很多场景下,用一些简单的逻辑判断就可以构建出 model router 的功能,model router 这个比较强场景相关。

image

@Undertone0809 Undertone0809 added the enhancement New feature or request label Aug 3, 2024
@Undertone0809
Copy link
Owner Author

@ruanrongman 讨论过了,不合适做 builtn,但是可以作为一个 use case

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Discussed with @ruanrongman, it is not suitable to be builtn, but it can be used as a use case

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Backlog
Development

No branches or pull requests

2 participants