Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable Langserve chat server and playground #17

Merged
merged 4 commits into from
Jun 11, 2024
Merged

Enable Langserve chat server and playground #17

merged 4 commits into from
Jun 11, 2024

Conversation

virajmalia
Copy link
Owner

@virajmalia virajmalia commented Jun 11, 2024

The new architecture looks something like this:

(1) Ollama instance hosted locally (localhost:8080) --> (2) add tools and agents with langchain \
--> (3) host LLM chain locally using langserve(localhost:8000)

This architecture allows development and testing of (2) (3), while making sure the output is consistent or better than the native output from the LLM chat model from Ollama.
(1) also hides a lot of configuration required to host a chat model. This may change in the future.

@virajmalia virajmalia self-assigned this Jun 11, 2024
@virajmalia virajmalia added the enhancement New feature or request label Jun 11, 2024
@virajmalia virajmalia merged commit 6e1325c into main Jun 11, 2024
3 checks passed
@virajmalia virajmalia deleted the langserve branch June 11, 2024 23:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Development

Successfully merging this pull request may close these issues.

1 participant