Picovoice/picollm
On-device LLM Inference Powered by X-Bit Quantization
- Stars
- 318
- Forks
- 27
- Open issues
- 0
- Last push
- 1d ago
About picollm
picollm is a free, open-source LLM chat app by Picovoice, written mainly in Python. On-device LLM Inference Powered by X-Bit Quantization. It has 318 GitHub stars and 27 forks, and was last updated 1d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it runs on a regular CPU without a GPU and works on macOS.
- License
- Apache-2.0
- Language
- Python
- Stars
- 318
- Last update
- 1d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not needed (runs on CPU)
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
ollama184k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
unsloth78k stars · Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
Chinese-LLaMA-Alpaca19k stars · 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
picollm FAQ
Is picollm free?
Yes. picollm is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does picollm run on a Mac?
Yes. According to the project, picollm works on macOS.
Does picollm need a GPU?
No. According to the project, picollm runs on a regular CPU.
Is picollm still maintained?
Yes. It was last updated 1d ago and has 0 open issues on GitHub.
What are alternatives to picollm?
Similar free, open-source tools include ollama, open-webui, Hands-On-Large-Language-Models, unsloth.