Code

Support for Nvidia TensorRT#1665

Code

Open

imartinez wants to merge 16 commits intomainzylon-ai/private-gpt:mainfrom feature/tensorrt-supportzylon-ai/private-gpt:feature/tensorrt-supportCopy head branch name to clipboard

+1,602-1,362

Commits

Commits on Feb 28, 2024

• Working refactor. Dependency clean-up pending.

  imartinez

  committed
  d0a7d99

  Copy full SHA for d0a7d99

• Extract optional dependencies

  imartinez

  committed
  3373e80

  Copy full SHA for 3373e80

Commits on Feb 29, 2024

• Documentation updates and default settings reviewed

  imartinez

  committed
  8c39081

  Copy full SHA for 8c39081

• Format fixes

  imartinez

  committed
  34d48d7

  Copy full SHA for 34d48d7

• Fix mypy

  imartinez

  committed
  63d3b9f

  Copy full SHA for 63d3b9f

• Fix actions and dockerfiles

  imartinez

  committed
  8527689

  Copy full SHA for 8527689

• Separate local mode into llms-llama-cpp and embeddings-huggingface for clarity

  imartinez

  committed
  c3fe36e

  Copy full SHA for c3fe36e

• Support for Nvidia TensorRT

  imartinez

  committed
  a7b1805

  Copy full SHA for a7b1805

• Fix mypy

  imartinez

  committed
  70ca241

  Copy full SHA for 70ca241

Commits on Mar 1, 2024

• Update setup script to point to the new settings

  imartinez

  committed
  8fad196

  Copy full SHA for 8fad196

• Windows note for setting env vars

  imartinez

  committed
  e1456c1

  Copy full SHA for e1456c1

• Fix error comment for openailike

  imartinez

  committed
  274c386

  Copy full SHA for 274c386

• Merge branch 'feature/upgrade-llamaindex' into feature/tensorrt-support

  imartinez

  committed
  3aaf4d6

  Copy full SHA for 3aaf4d6

Commits on Mar 7, 2024

• Lower min python version to 3.10

  imartinez

  committed
  937c523

  Copy full SHA for 937c523

• Stop using the fake tensorrt-llm package. Update documentation.

  imartinez

  committed
  a93db28

  Copy full SHA for a93db28

• Update installation doc

  imartinez

  committed
  77d43ef

  Copy full SHA for 77d43ef