FujitsuResearch/OneCompression
Python package for LLM compression
- Stars
- 443
- Forks
- 22
- Open issues
- 4
- Last push
- today
About OneCompression
OneCompression is a free, open-source machine learning tool by FujitsuResearch, written mainly in Python. Python package for LLM compression. It has 443 GitHub stars and 22 forks, and was last updated today. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 443
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
neural-compressor2.7k stars · SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
Jackrong-llm-finetuning-guide1.7k stars · An educational, end-to-end open-source knowledge base for LLM fine-tuning, dataset distillation, reinforcement learning, and local deployment.
bitsandbytes8.5k stars · Accessible large language models via k-bit quantization for PyTorch.
pmetal330 stars · PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
oat674 stars · 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
base-llm1.1k stars · 从 NLP 到 LLM 的算法全栈教程,在线阅读地址:https://datawhalechina.github.io/base-llm/
OneCompression FAQ
Is OneCompression free?
Yes. OneCompression is open source and free to use. It's released under the MIT license, a standard open-source license.
Does OneCompression run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does OneCompression need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is OneCompression still maintained?
Yes. It was last updated today and has 4 open issues on GitHub.
What are alternatives to OneCompression?
Similar free, open-source tools include neural-compressor, Jackrong-llm-finetuning-guide, bitsandbytes, pmetal.