Light-weight from scratch pytorch implementations of open-weights LLMs.
This project uses uv for fast, reliable Python package management.
# Install uv
curl -LsSf https://astral.sh/uv/install.sh | sh
# Create virtual environment and install the dependencies
uv venv
source .venv/bin/activate
uv pip install .| Model | Dataset Preparation | Training |
|---|---|---|
| BERT | Data Preprocessing Pipeline | Coming soon |
Apache 2.0