New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature request] Support for Korean-Chinese sakura model #106

Open

YuiTH opened this issue Aug 25, 2024 · 0 comments

YuiTH commented Aug 25, 2024

I've tried SakuraLLM/LN-Korean-14B-v0.2 with Q8 quantization. There are two major problem preventing me using it with auto-novel:

There is no Korean original text support, especially website hardcoded prompt as "你是一个轻小说翻译模型，可以流畅通顺地以日本轻小说的风格将日文翻译成简体中文"
Korean Model often generate past paragraph as part of output. I'm not sure if it's a model bug or website bug. But I will put it here.
For example:

Set past_text as zero will prevent this issue.
Let me know if you need more information or test case here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment