New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ollama 实现分享 #66

Open

yangxiaoshuai2333 opened this issue Aug 28, 2024 · 1 comment

yangxiaoshuai2333 commented Aug 28, 2024 •

edited

Loading

近期打包了下[lawyer-llama-13b-v2]的q4量化并上传到了ollama，提示词采用的qwen提示词，性能相较案例有所下降，不过基本满足问题需求。ollama测试可用版本为0.1.32，0.1.48以上版本不可用GPU模式。

推荐使用ollama镜像方式部署，不妨碍其他版本ollama使用。镜像要求同样为0.1.32
ollama 库地址为 xiaoshuai111/lawyer-llama-13b-v2
使用方法：ollama run xiaoshuai111/lawyer-llama-13b-v2

Collaborator

luciusssss commented Aug 28, 2024

感谢分享！已将此内容加入README的“社区贡献”部分。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment