README.md

Lite LLaMA

Light-weight from scratch pytorch implementations of open-weights LLMs.

Installation

This project uses uv for fast, reliable Python package management.

# Install uv
curl -LsSf https://astral.sh/uv/install.sh | sh

# Create virtual environment and install the dependencies
uv venv
source .venv/bin/activate
uv pip install .

Models

Model	Dataset Preparation	Training
BERT	Data Preprocessing Pipeline	Coming soon

License

Apache 2.0