Skip to content

Latest commit

 

History

History
19 lines (14 loc) · 346 Bytes

README.md

File metadata and controls

19 lines (14 loc) · 346 Bytes

bitsandbytes_ops_cpu

Python implementation of bisandbytes ops for CPU

Run tests

python test_ops.py

Run benchmarks

Eager vs. inductor (torch.compile)

# Latency
numactl -m <node id> -C <core list> python benchmarks.py --all
# Profiling
numactl -m <node id> -C <core list> python benchmarks.py --all --profile