leonickson1/Swiftlet
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM,
- Stars
- 662
- Forks
- 40
- Open issues
- 1
- Last push
- 25d ago
About Swiftlet
Swiftlet is a free, open-source LLM chat app by leonickson1, written mainly in Swift. Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM,. It has 662 GitHub stars and 40 forks, and was last updated 25d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Swift
- Stars
- 662
- Last update
- 25d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
llamafile26k stars · Distribute and run LLMs with a single file.
meetily32k stars · Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
Swiftlet FAQ
Is Swiftlet free?
Yes. Swiftlet is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does Swiftlet run on a Mac?
Yes. According to the project, Swiftlet works on macOS.
Does Swiftlet need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Swiftlet still maintained?
Yes. It was last updated 25d ago and has 1 open issues on GitHub.
What are alternatives to Swiftlet?
Similar free, open-source tools include open-webui, khoj, Open-LLM-VTuber, llamafile.