docs(fireworks): adding fireworks HTTP Api example (#3676)

* docs(fireworks): add documentation for Fireworks API models and usage * docs(fireworks): update description for Fireworks API to clarify model inference and deployment services * Update website/docs/references/models-http-api/fireworks.md Co-authored-by: Meng Zhang <[email protected]> * Update website/docs/references/models-http-api/fireworks.md * docs(fireworks): update embeddings model description to clarify API support * docs(fireworks): clarify Tabby's support for Fireworks embedding model APIs * doc(models): add deepseek v3 and coder to fireworks --------- Co-authored-by: Meng Zhang <[email protected]> Co-authored-by: Wei Zhang <[email protected]>
TabbyML · Jan 15, 2025 · 3ec356b · 3ec356b
1 parent cbdc98d
commit 3ec356b
Showing 1 changed file with 27 additions and 0 deletions.
diff --git a/website/docs/references/models-http-api/fireworks.md b/website/docs/references/models-http-api/fireworks.md
@@ -0,0 +1,27 @@
+# Fireworks
+
+[Fireworks](https://app.fireworks.ai/) is a cloud platform that offers efficient model inference and deployment services,
+providing cost-effective access to a variety of AI models through their API service,
+including [Llama 2](https://fireworks.ai/models/fireworks/llama-v2-70b-chat),
+[DeepSeek V3](https://fireworks.ai/models/fireworks/deepseek-v3),
+[DeepSeek Coder](https://fireworks.ai/models/fireworks/deepseek-coder-v2-instruct) and other open-source models.
+
+## Chat model
+
+Fireworks provides an OpenAI-compatible chat API interface.
+
+```toml title="~/.tabby/config.toml"
+[model.chat.http]
+kind = "openai/chat"
+model_name = "accounts/fireworks/models/deepseek-v3"
+api_endpoint = "https://api.fireworks.ai/inference/v1"
+api_key = "your-api-key"
+```
+
+## Completion model
+
+Fireworks does not offer completion models (FIM) through their API.
+
+## Embeddings model
+
+While Fireworks provides embedding model APIs, Tabby has not yet implemented a compatible client to interface with these APIs. Therefore, embedding functionality is currently not available through Tabby's integration with Fireworks.