bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
- Stars
- 8.5k
- Forks
- 936
- Open issues
- 48
- Last push
- 3d ago
About bitsandbytes
bitsandbytes is a free, open-source machine learning tool by bitsandbytes-foundation, written mainly in Python. Accessible large language models via k-bit quantization for PyTorch. It has 8.5k GitHub stars and 936 forks, and was last updated 3d ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 8,529
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
pytorch-image-models37k stars · The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT)
ludwig12k stars · Low-code framework for building custom LLMs, neural networks, and other AI models
imbalanced-learn7.1k stars · A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
MetaClaw3.5k stars · 🦞 Just talk to your agent — it learns and EVOLVES 🧬.
SwanLab4.3k stars · ⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultr
neural-compressor2.7k stars · SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
bitsandbytes FAQ
Is bitsandbytes free?
Yes. bitsandbytes is open source and free to use. It's released under the MIT license, a standard open-source license.
Does bitsandbytes run on a Mac?
Its README doesn't say. Check the installation guide on GitHub before you start.
Does bitsandbytes need a GPU?
Its README doesn't state hardware needs. AI models generally run much faster with a GPU.
Is bitsandbytes still maintained?
Yes. It was last updated 3d ago and has 48 open issues on GitHub.
What are alternatives to bitsandbytes?
Similar free, open-source tools include pytorch-image-models, ludwig, imbalanced-learn, MetaClaw.