v6.8.0 - coding models!
Breaking Changes
Within the Manage Databases
tab, what's displayed is no longer derived from parsing multiple JSON files. Rather, sqlite3
is used for much much faster response/latency.
As such, databases created prior to this release will not function properly. To migrate old databases rather than creating them anew, use the create_sqlite3.py
attached to this release as follows:
- Run the script and select the folder containing the old JSON files. The script will folder location is as follows:
- Go into the
Vector_DB
folder. - Each folder within
Vector_DB
constitute a database. - Within each folder constituting a database there is a folder named
json
. - You need to run the
create_sqlite3.py
script selecting eachjson
folder for each of your database folders. - A new file named
metadata.db
should be created in each database folder. - It's now safe to remove the
json
folder altogether.
- Update the backup folder.
- The
Vector_DB_Backup
folder contains a mirror image of theVector_DB
- this is the "backup" folder. - Delete all the contents within the
Vector_DB_Backup
folder and copy all the contents of theVector_DB
folder into it.
- Start the program and it should run as usual.
These steps are unnecessary if you're creating a vector database for first time using Release v6.8.0, obviously.
New Chat Models for Coding Questions
- Deepseek-Coder-V2 - 16b (best)
- Yi-Coder - 9b (second best)
- CodeQwen1.5 - 7b (third, but still good)
Benchmarks will be forthcoming, but their metrics are comparable to similarly-sized models.
Misc.
- Now using a
distil-whisper
model for the voice recorder for an approximate 2x speedup. - Added buttons to backup all databases at once or restored all backups at once (Tools Tab).