KolosalAI/kolosal-cli
Super lightweight Ollama + Qwen Code alternative to run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
- Stars
- 466
- Forks
- 15
- Open issues
- 10
- Last push
- 10mo ago
About kolosal-cli
kolosal-cli is a free, open-source LLM chat app by KolosalAI, written mainly in TypeScript. Super lightweight Ollama + Qwen Code alternative to run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models. It has 466 GitHub stars and 15 forks, and was last updated 10mo ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- TypeScript
- Stars
- 466
- Last update
- 10mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
ollama184k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
unsloth78k stars · Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
rtk84k stars · CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
kolosal-cli FAQ
Is kolosal-cli free?
kolosal-cli is open source, but it needs a paid third-party API key to work. It's released under the Apache-2.0 license, a standard open-source license.
Does kolosal-cli run on a Mac?
Yes. According to the project, kolosal-cli works on macOS.
Does kolosal-cli need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is kolosal-cli still maintained?
It was last updated 10mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to kolosal-cli?
Similar free, open-source tools include ollama, unsloth, open-webui, rtk.