-
Notifications
You must be signed in to change notification settings - Fork 449
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Add params config for api server web_ui #735
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi, @amulil Sorry for the late reply. Would you mind making the same change to turbomind backend and triton server backend for the WebUI?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Hope we can use same ui for gradio as the backend or as pure frontend. |
OK, I will do it this weekend. @AllentDan I finish it. And run |
…ckend for the WebUI
…ckend for the WebUI
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Motivation
the current api server web demo is simple, I want to change some params on the web.
Modification
Just add three new params
top_p
、temperature
、Maximum new tokens
(request_output_len
in the code)Checklist