Support LMStudio? #2110
-
|
LMStudio is another popular tool for running LLMs locally (at least for Apple Silicon MacBooks, because it supports MLX), compared to Ollama. Does SpringAI currently support integration with LMStudio? Or is there a plan to introduce a |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
@ilxqx LMStudio exposes an OpenAI-compatible API (https://lmstudio.ai/docs/api/endpoints/openai), so you can use Spring AI OpenAI to use models from LMStudio. |
Beta Was this translation helpful? Give feedback.
-
|
Okay, thank you for your reply. |
Beta Was this translation helpful? Give feedback.
@ilxqx LMStudio exposes an OpenAI-compatible API (https://lmstudio.ai/docs/api/endpoints/openai), so you can use Spring AI OpenAI to use models from LMStudio.