Skip to content

Issues: ModelCloud/GPTQModel

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

8 Open 82 Closed
8 Open 82 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Usage] When quantizing Qwen2.5-7B-Instruct, the loss is very high and generate many !
#1042 opened Jan 7, 2025 by JeremyGe07
2
[BUG] Quantized and model is generating repeating response bug Something isn't working
#991 opened Jan 2, 2025 by BodhiHu
8
[BUG][IPEX/XPU] init_ipex_linear taking very long time, >10 minutes, with a small 1B model on XPU bug Something isn't working
#977 opened Dec 28, 2024 by notsyncing
7
Fix Qwen docs about gptq quantization quality + sharding + bad quants + autogptq
#817 opened Dec 11, 2024 by Qubitium
2
[INTEGRATION] Add GPTQModel support into transformers + optimum + peft bug Something isn't working
#729 opened Dec 3, 2024 by jiqing-feng
6 tasks done
12
[INTEGRATION] Expose stable kernel/packing/repacking apis bug Something isn't working
#726 opened Dec 3, 2024 by wenhuach21
11
[FEATURE] lm-head/embedding quantization
#469 opened Oct 25, 2024 by Qubitium
[FEATURE] Add dynamic suppor for AutoRound quantiztion bug Something isn't working
#329 opened Aug 2, 2024 by Qubitium
3
ProTip! Find all open issues with in progress development work with linked:pr.