carloslfu/slotstream
Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to
- Stars
- 481
- Forks
- 39
- Open issues
- 1
- Last push
- today
About slotstream
slotstream is a free, open-source LLM chat app by carloslfu, written mainly in Swift. Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to. It has 481 GitHub stars and 39 forks, and was last updated today. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Swift
- Stars
- 481
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
one-api37k stars · LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key
ollama184k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
omlx23k stars · LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
rtk84k stars · CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
gpt4free67k stars · The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3
slotstream FAQ
Is slotstream free?
Yes. slotstream is open source and free to use. It's released under the MIT license, a standard open-source license.
Does slotstream run on a Mac?
Yes. According to the project, slotstream works on macOS.
Does slotstream need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is slotstream still maintained?
Yes. It was last updated today and has 1 open issues on GitHub.
What are alternatives to slotstream?
Similar free, open-source tools include open-webui, one-api, ollama, omlx.