Zenbase requires Python ≥3.10. You can install it using your favorite package manager:
pip install zenbase
poetry add zenbase
rye add zenbase
Zenbase is designed to require minimal changes to your existing codebase and integrate seamlessly with your existing eval/observability platforms. It works with any AI SDK (OpenAI, Anthropic, Cohere, Langchain, etc.).
LabeledFewShot will be useful for tasks that are just one layer of prompts.
Cookbook | Run in Colab |
---|---|
without_integration.ipynb | |
langsmith.ipynb | |
arize.ipynb | |
langfuse.ipynb | |
parea.ipynb | |
lunary.ipynb |
BootstrapFewShot will be useful for tasks that are multiple layers of prompts.
Cookbook | Run in Colab |
---|---|
langsmith.ipynb | |
arize.ipynb | |
langfuse.ipynb | |
parea.ipynb | |
lunary.ipynb |
Cookbook | Description | Run in Colab |
---|---|---|
Single Class Classifier | Basic implementation of a single class classifier | |
Synthetic Data Generation | Generate synthetic data for single class classification | |
Classifier with Synthetic Data | Train and test a single class classifier using synthetic data |
This repo uses Python 3.10 and rye to manage dependencies. Once you've gotten rye installed, you can install dependencies by running:
rye sync
And activate the virtualenv with:
. .venv/bin/activate
You can run tests with:
rye test # pytest -sv to see prints and verbose output
rye test -- -m helpers # integration tests with helpers