Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: multi-query retrieval #311

Open
mhordynski opened this issue Jan 27, 2025 · 1 comment
Open

feat: multi-query retrieval #311

mhordynski opened this issue Jan 27, 2025 · 1 comment
Assignees
Labels
feature New feature or request

Comments

@mhordynski
Copy link
Member

Feature description

Ragbits' DocumentSearch should provide a way to perform multi-query retrieval.

Proposed approach:

  • Create new QueryRephraser which uses LLM to generate multiple queries from one question.
  • Create new Reranker which gathers results from different queries and reranks them based on that how often given Element repeates in query results.

Motivation

Multi-querying is popular method of improving retrieval performance.

Additional context

No response

@mhordynski mhordynski added the feature New feature or request label Jan 27, 2025
@mhordynski mhordynski moved this to Backlog in ragbits Jan 27, 2025
@mhordynski mhordynski added this to the 9 / Advanced RAG milestone Jan 27, 2025
@mhordynski mhordynski self-assigned this Jan 27, 2025
@mhordynski mhordynski moved this from Backlog to Ready in ragbits Jan 27, 2025
@ludwiktrammer
Copy link
Collaborator

For the reranker we should probably use something similar to Reciprocal Rank Fusion (as Qdrant do), so that we boost the one that appear multiple times, without discarding the information about positions within the individual result list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
Status: Ready
Development

No branches or pull requests

2 participants