Code

Implement RAG#92

Code

Open

RHeckerIntel wants to merge 84 commits intomainopenvinotoolkit/openvino_testdrive:mainfrom rhecker/fluent-ui-ragopenvinotoolkit/openvino_testdrive:rhecker/fluent-ui-ragCopy head branch name to clipboard

+3,802-391

Commits

Commits on Nov 23, 2024

• Implement Sentence Transformer pipeline

  Show description for 120f9c3
  RHeckerIntel

  committed
  120f9c3

  Copy full SHA for 120f9c3

Commits on Nov 24, 2024

• Start work on dart implementation of knowledge base

  RHeckerIntel

  committed
  69f7e0b

  Copy full SHA for 69f7e0b

• Merge branch 'fluent-ui-migration' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  7614008

  Copy full SHA for 7614008

• Run sentence transformer from flutter ui

  RHeckerIntel

  committed
  9124504

  Copy full SHA for 9124504

Commits on Nov 25, 2024

• Implement basic langchain adapters for openvino

  Show description for a410ab4
  RHeckerIntel

  committed
  a410ab4

  Copy full SHA for a410ab4

• Add ObjectBox to store embeddings

  Show description for dd6a2d1
  RHeckerIntel

  committed
  dd6a2d1

  Copy full SHA for dd6a2d1

Commits on Nov 26, 2024

• clean up knowledge base to start working on a UI

  Show description for 38ce503
  RHeckerIntel

  committed
  38ce503

  Copy full SHA for 38ce503

• Add crud for Knowledge Base groups

  RHeckerIntel

  committed
  15038c8

  Copy full SHA for 15038c8

• Try to extract tree.

  Show description for d563f7e
  RHeckerIntel

  committed
  d563f7e

  Copy full SHA for d563f7e

Commits on Nov 27, 2024

• Switch to provider to keep tree data

  RHeckerIntel

  committed
  2f8d7b8

  Copy full SHA for 2f8d7b8

• Somewhat working selection mode for the groups

  RHeckerIntel

  committed
  0bd2c7e

  Copy full SHA for 0bd2c7e

• Clean up old code with embeddings

  RHeckerIntel

  committed
  10d0269

  Copy full SHA for 10d0269

• Start doucment list stuff

  RHeckerIntel

  committed
  b1a21f8

  Copy full SHA for b1a21f8

Commits on Nov 28, 2024

• Working RAG demo.

  Show description for 46fdccf
  RHeckerIntel

  committed
  46fdccf

  Copy full SHA for 46fdccf

• Implement streamer for OpenVINOLLM langchain and clean up

  RHeckerIntel

  committed
  a89eadf

  Copy full SHA for a89eadf

Commits on Nov 29, 2024

• Filter the embeddings based on a group when using ObjectBoxStore

  RHeckerIntel

  committed
  3e66bcf

  Copy full SHA for 3e66bcf

Commits on Dec 2, 2024

• Add working document import dialog

  RHeckerIntel

  committed
  65c9334

  Copy full SHA for 65c9334

Commits on Dec 3, 2024

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  69d2450

  Copy full SHA for 69d2450

Commits on Dec 4, 2024

• Badly working knowledge base selector in llm

  Show description for fce62b3
  RHeckerIntel

  committed
  fce62b3

  Copy full SHA for fce62b3

Commits on Jan 14, 2025

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  43f62b6

  Copy full SHA for 43f62b6

Commits on Jan 15, 2025

• Fix streaming response with rag never finishing in ui

  RHeckerIntel

  committed
  8989b56

  Copy full SHA for 8989b56

• Allow simple rag using in memory store

  Show description for 92ddc44
  RHeckerIntel

  committed
  92ddc44

  Copy full SHA for 92ddc44

• Allow deletion of documents from in memory vector

  RHeckerIntel

  committed
  cae4055

  Copy full SHA for cae4055

• Add loader

  RHeckerIntel

  committed
  dcf089e

  Copy full SHA for dcf089e

• Render tooltip and error on userFile error

  RHeckerIntel

  committed
  3c3ad26

  Copy full SHA for 3c3ad26

• Align files to left

  RHeckerIntel

  committed
  4bd1053

  Copy full SHA for 4bd1053

• Fix issue with shifting issue with loader

  RHeckerIntel

  committed
  9a5bd01

  Copy full SHA for 9a5bd01

Commits on Jan 16, 2025

• Improve document list for knowledge base

  Show description for 43f03c0
  RHeckerIntel

  committed
  43f03c0

  Copy full SHA for 43f03c0

• Add sources to show the sources used for the LLM in RAG

  RHeckerIntel

  committed
  a7a9206

  Copy full SHA for a7a9206

Commits on Jan 20, 2025

• Implement JinjaTemplate for chat formatting in langchain

  RHeckerIntel

  committed
  3a6b064

  Copy full SHA for 3a6b064

• Fix database and improve snipping on document loaders

  RHeckerIntel

  committed
  c2005c8

  Copy full SHA for c2005c8

Commits on Jan 21, 2025

• Remove own textSnipper and use langchain CharacterTextSplitter

  RHeckerIntel

  committed
  55edfb5

  Copy full SHA for 55edfb5

• Limit documents found in stores

  Show description for 0b9db66
  RHeckerIntel

  committed
  0b9db66

  Copy full SHA for 0b9db66

• Implement simple RAG UX design

  Show description for 2d3d723
  RHeckerIntel

  committed
  2d3d723

  Copy full SHA for 2d3d723

• Enable performance metrics again

  RHeckerIntel

  committed
  cc65064

  Copy full SHA for cc65064

• Sort knowledge base button above flow

  RHeckerIntel

  committed
  406a7cd

  Copy full SHA for 406a7cd

• Change new knowledge base group button

  RHeckerIntel

  committed
  fca432d

  Copy full SHA for fca432d

Commits on Jan 23, 2025

• Rework download provider so it's global and can be background

  Show description for 76f0d5a
  RHeckerIntel

  committed
  76f0d5a

  Copy full SHA for 76f0d5a

• Add download to knowledge base for the rag model

  RHeckerIntel

  committed
  f8f4075

  Copy full SHA for f8f4075

• Add MiniLM-L6-H384-uncased openvino converted tokenizer to repo

  RHeckerIntel

  committed
  c9d8eb4

  Copy full SHA for c9d8eb4

• Official converted version of all-MiniLM-L6-v2 uses token_type_ids

  RHeckerIntel

  committed
  7471bfb

  Copy full SHA for 7471bfb

• Use All Mini LM V6 tokenizer from assets

  RHeckerIntel

  committed
  1892f1b

  Copy full SHA for 1892f1b

• Remove unused experiment widget for rag

  RHeckerIntel

  committed
  66e1df9

  Copy full SHA for 66e1df9

• Load or download embeddings model in text generation provider

  Show description for 56d7099
  RHeckerIntel

  committed
  56d7099

  Copy full SHA for 56d7099

• Rename ensureEmbeddingsmodel to make more sense

  RHeckerIntel

  committed
  535d2f2

  Copy full SHA for 535d2f2

• Remove scratch

  RHeckerIntel

  committed
  5495900

  Copy full SHA for 5495900

• Disable knowledge base again for test build

  RHeckerIntel

  committed
  3416936

  Copy full SHA for 3416936

• Fix the missing copyright headers

  RHeckerIntel

  committed
  fb0c0b9

  Copy full SHA for fb0c0b9

• Get tokenizerConfig instead and process that for hardcoded params in the chain builder

  RHeckerIntel

  committed
  ab5ea2d

  Copy full SHA for ab5ea2d

• Working RAG on windows. Added podofo, but its not working due to dependency issues

  RHeckerIntel

  committed
  88efe49

  Copy full SHA for 88efe49

Commits on Jan 26, 2025

• Working podofo for reading pdfs on windows

  Show description for a95fe5e
  RHeckerIntel

  committed
  a95fe5e

  Copy full SHA for a95fe5e

Commits on Jan 27, 2025

• Add docx file loader

  RHeckerIntel

  committed
  ce1cdd3

  Copy full SHA for ce1cdd3

• Add supportedExtensions for RAG

  RHeckerIntel

  committed
  4d99589

  Copy full SHA for 4d99589

• Start working on knowledge base UX

  RHeckerIntel

  committed
  6ee98e9

  Copy full SHA for 6ee98e9

• Move knowledge group rename to document list and use dialog

  RHeckerIntel

  committed
  47c605f

  Copy full SHA for 47c605f

• Implement pretty table for document list

  Show description for 910de5e
  RHeckerIntel

  committed
  910de5e

  Copy full SHA for 910de5e

• Use stream in knowledge group tree

  Show description for 7c7bf85
  RHeckerIntel

  committed
  7c7bf85

  Copy full SHA for 7c7bf85

• Add confirm on delete button for knowledge base

  RHeckerIntel

  committed
  23efe14

  Copy full SHA for 23efe14

• Enable advanced RAG

  RHeckerIntel

  committed
  f4e8f4d

  Copy full SHA for f4e8f4d

• Add copyright to new dialog

  RHeckerIntel

  committed
  7f5353f

  Copy full SHA for 7f5353f

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  f2b1010

  Copy full SHA for f2b1010

• Remove wrap of center in DropArea

  Show description for 18ad71c
  RHeckerIntel

  committed
  18ad71c

  Copy full SHA for 18ad71c

• Remove json from required files for license header

  RHeckerIntel

  committed
  8be0bb8

  Copy full SHA for 8be0bb8

• Blind attempt at adding podofo for linux

  RHeckerIntel

  committed
  a88f665

  Copy full SHA for a88f665

• Fix user_message test

  RHeckerIntel

  committed
  8e2cdc4

  Copy full SHA for 8e2cdc4

Commits on Jan 28, 2025

• Implement pure dart solution for reading pdfs

  RHeckerIntel

  committed
  c22998f

  Copy full SHA for c22998f

• Remove podofo dependency

  RHeckerIntel

  committed
  690769d

  Copy full SHA for 690769d

• Add header to pdf parser

  RHeckerIntel

  committed
  3787f6b

  Copy full SHA for 3787f6b

• Fix drop area in knowledge base

  RHeckerIntel

  committed
  1e0b039

  Copy full SHA for 1e0b039

• Fix wrong import for pdf loader

  RHeckerIntel

  committed
  7fbef2a

  Copy full SHA for 7fbef2a

• Improve ux in knowledge base

  Show description for d5f55fb
  RHeckerIntel

  committed
  d5f55fb

  Copy full SHA for d5f55fb

• Revert code back in to get extension

  Show description for d9762b5
  RHeckerIntel

  committed
  d9762b5

  Copy full SHA for d9762b5

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  fb0049a

  Copy full SHA for fb0049a

Commits on Jan 29, 2025

• Use podofo again

  Show description for f31b172
  RHeckerIntel

  committed
  f31b172

  Copy full SHA for f31b172

• Remove pdf parser code

  RHeckerIntel

  committed
  476d977

  Copy full SHA for 476d977

• Add test for UserFileWidget

  RHeckerIntel

  committed
  69e850c

  Copy full SHA for 69e850c

• Fix issues found by flutter analyze

  RHeckerIntel

  committed
  e4edb5e

  Copy full SHA for e4edb5e

Commits on Jan 31, 2025

• Add custom jinja template for text generation

  RHeckerIntel

  committed
  42d0f82

  Copy full SHA for 42d0f82

Commits on Feb 2, 2025

• Fix broken test when using flutter test

  RHeckerIntel

  committed
  62e8881

  Copy full SHA for 62e8881

Commits on Feb 4, 2025

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  7f064d3

  Copy full SHA for 7f064d3

Commits on Feb 5, 2025

• Attempt to fix issue with building model api on macos workflow

  RHeckerIntel

  committed
  2fd9257

  Copy full SHA for 2fd9257

Commits on Feb 11, 2025

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  3f05072

  Copy full SHA for 3f05072

• Merge branch 'rhecker/fluent-ui-rag' of https://github.com/openvinotoolkit/openvino_testdrive into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  f1a783f

  Copy full SHA for f1a783f

• Merge branch 'main' into rhecker/fluent-ui-rag

  RHeckerIntel

  committed
  f11799e

  Copy full SHA for f11799e