Skip to content

v7.3.0 - G.K.H.A.

Compare
Choose a tag to compare
@BBC-Esq BBC-Esq released this 10 Feb 17:59
· 6 commits to main since this release
446d41c

Goodbye Kobold, Hello Again

image

Ask Jeeves!

  • Ask Jeeves! has been revamped to no longer rely on Kobold, which was too difficult to work with and, at any rate, is not meant to be run in "headless" mode. The reliable Ctranslate2 library is now used instead.
  • Jeeves' knowledge base has also been updated.

Added Chat Model Backends

  • Kobold is added as a new backend when querying the vector database. Please note that you must be familiar with Kobold and how to use it, especially how to control the prompt formatting since this program does not handle that aspect.
  • LM Studio backend has been revamped to be compatible with newer versions. This change was a long time coming since LM Studio has undergone numerous changes that, effectively, rendered it un-usable, until now. To effectively use it you should familiarize yourself with the "server mode" of LM Studio.
  • Added ChatGPT as a new backend when querying the vector database.

Removals

  • Support for the longstanding Instructor embedding models has been removed pursuant to the prior deprecation notice.

Installation

  • Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

  • In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
  • Delete the pyvenv.cfg file. (pertains to your virtual environment)
  • At this point, any and all files pertaining to your virtual environment are gone.
  • Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
  • Extract all the files from the .zip file for this release v7.3.0 and go into the src folder.
  • Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
  • EXCEPT THE CONFIG.YAML FILE!
  • EXCEPT THE CONFIG.YAML FILE!
  • last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page, namely:

python -m venv .
.\Scripts\activate
python setup_windows.py

Upgraded Dependencies

  • The CUDA, torch, and other important dependencies have been updated.