Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

添加开源模型api的使用方式 #1095

Open
626394316 opened this issue Jan 9, 2025 · 2 comments
Open

添加开源模型api的使用方式 #1095

626394316 opened this issue Jan 9, 2025 · 2 comments

Comments

@626394316
Copy link

能否提供支持调用开源模型api的方式
@Harsha-Nori
Copy link
Collaborator

Hi @626394316

我们确实支持许多开源模型 API，包括 transformers 和 llama.cpp！您是否考虑过特定​​的提供商？

对于任何语言问题，我深表歉意，我正在使用翻译器

@626394316
Copy link
Author

@Harsha-Nori 感谢您的回答 我想要了解一些开源模型它们的调用方式除了需要提供api_key以外，还要提供base_url，这种方式的开源模型API应该如何调用呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Harsha-Nori @626394316