quantumnic/ssd-llm
Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac
- Stars
- 57
- Forks
- 5
- Open issues
- 0
- Last push
- 2d ago
ssd-llm star history
+2 this week
About ssd-llm
ssd-llm is a free, open-source LLM chat app by quantumnic, written mainly in Rust. Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac. It has 57 GitHub stars and 5 forks, and was last updated 2d ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- Rust
- Stars
- 57
- Last update
- 2d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
ollama185k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
web-llm19k stars · Runs language models in web browsers for AI chatbots and assistants.
omlx23k stars · Local LLM inference server for macOS with menu bar control.
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
llm_interview_note15k stars · 主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题
Chinese-LLaMA-Alpaca-32.0k stars · 中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3
ssd-llm FAQ
Can I use ssd-llm commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is ssd-llm free?
Yes. ssd-llm is open source and free to use. It's released under the MIT license, a standard open-source license.
Does ssd-llm run on a Mac?
Yes. According to the project, ssd-llm works on macOS.
Does ssd-llm need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ssd-llm still maintained?
Yes. It was last updated 2d ago and has 0 open issues on GitHub.
What are alternatives to ssd-llm?
Similar free, open-source tools include ollama, web-llm, omlx, self-llm.
Maintain ssd-llm?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/quantumnic/ssd-llm)