RAG using external database

[NinjaKullan]

Hi,Has anybody successfully connected to an external vector database such as pgvector or weviate or qdrant for performing RAG using the pipelines feature? any direction or documentation would be helpful.

[pfedasullivan]

Yes, it is possible to write a pipeline to connect to elasticsearch's vector database for example. Just so you know to get citations to work you'll need to set body["messages"][-1]["sources"] = sources, where sources is an array of dictionaries with the right format that open-webui is expecting. This should be done in the outlet method.