MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- Stars
- 9.5k
- Forks
- 1.6k
- Open issues
- 127
- Last push
- today
About Soup
Soup is a free, open-source LLM chat app by MakazhanAlpamys, written mainly in Python. Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. It has 9.5k GitHub stars and 1.6k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 9,540
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
llamafile26k stars · Distribute and run LLMs with a single file.
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
ml-engineering20k stars · Machine Learning Engineering Open Book
unsloth78k stars · Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
Soup FAQ
Is Soup free?
Yes. Soup is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does Soup run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Soup need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Soup still maintained?
Yes. It was last updated today and has 127 open issues on GitHub.
What are alternatives to Soup?
Similar free, open-source tools include open-webui, llamafile, khoj, Open-LLM-VTuber.