We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
增加下列模型的内置支持 tclf90/deepseek-r1-distill-qwen-32b-gptq-int8 tclf90/deepseek-r1-distill-qwen-14b-gptq-int4
或增加一个功能,可以配置内置模型的model_specs,这样就可以自己添加新的量化版本了。
增加某个内置模型的量化版本太麻烦了
无
The text was updated successfully, but these errors were encountered:
inference/xinference/model/llm/llm_family_modelscope.json
Lines 6592 to 6600 in ac97a13
可以在这个文件添加,欢迎提交 PR。
Sorry, something went wrong.
No branches or pull requests
Feature request / 功能建议
增加下列模型的内置支持
tclf90/deepseek-r1-distill-qwen-32b-gptq-int8
tclf90/deepseek-r1-distill-qwen-14b-gptq-int4
或增加一个功能,可以配置内置模型的model_specs,这样就可以自己添加新的量化版本了。
Motivation / 动机
增加某个内置模型的量化版本太麻烦了
Your contribution / 您的贡献
无
The text was updated successfully, but these errors were encountered: