arizqi/cpubrrr
Frontier-class LLM inference on a laptop CPU — gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME kernels in Rust.
- Stars
- 56
- Forks
- 6
- Open issues
- 3
- Last push
- 2mo ago
cpubrrr star history
+0 this week
About cpubrrr
cpubrrr is a free, open-source AI inference tool by arizqi, written mainly in Rust. Frontier-class LLM inference on a laptop CPU — gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME kernels in Rust. It has 56 GitHub stars and 6 forks, and was last updated 2mo ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it runs on a regular CPU without a GPU and works on macOS.
- License
- Apache-2.0
- Commercial use
- Commercial OK
- Language
- Rust
- Stars
- 56
- Last update
- 2mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not needed (runs on CPU)
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
llm-action25k stars · 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
vllm95k stars · High-throughput inference engine for LLMs.
ai-infra-book7.0k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
BitNet41k stars · Optimized inference framework for 1-bit LLMs on CPU and GPU.
cactus6.2k stars · Edge AI inference engine for mobile devices and wearables.
kimi-k3-in-c9.2k stars · Runs a 2.78-trillion-parameter model on a single CPU with 8 GB of RAM.
cpubrrr FAQ
Can I use cpubrrr commercially?
Yes. Apache-2.0 is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is cpubrrr free?
Yes. cpubrrr is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does cpubrrr run on a Mac?
Yes. According to the project, cpubrrr works on macOS.
Does cpubrrr need a GPU?
No. According to the project, cpubrrr runs on a regular CPU.
Is cpubrrr still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to cpubrrr?
Similar free, open-source tools include llm-action, vllm, ai-infra-book, BitNet.
Maintain cpubrrr?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/arizqi/cpubrrr)