Add nest_asyncio to fix ollama embed 'event loop closed' error

[tsmdt]

Title

Use nest_asyncio to fix litellm.APIConnectionError: Event loop is closed using Ollama embeddings.

Relevant issues

• Fixes [Bug]: Ollama as custom provider does not default to sync by default #7332
• See also: Proper Configuration and Use of Ollama's Vector Model in RAGLite, and Fixing the Event loop is closed Error superlinear-ai/raglite#85

Type

🐛 Bug Fix

Changes

Added nest_asyncio library to run asynchronous code inside environments that already have an active event loop, thus fixing the litellm.APIConnectionError: Event loop is closed.

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

After the fix this code works:

import litellm

test_strings = ['Research Data Charta', 'Research', 'Research Data']

for t in test_strings:
    response = litellm.embedding(input=t, model='ollama/nomic-embed-text:latest')
    print(response)

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 8, 2025 7:53am

[shanbady]

👍 this resolved the issue I was seeing when using ollama