jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- Stars
- 23k
- Forks
- 2.0k
- Open issues
- 375
- Last push
- today
About omlx
omlx is a free, open-source LLM chat app by jundot, written mainly in Python. LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. It has 23k GitHub stars and 2.0k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Python
- Stars
- 22,987
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
one-api37k stars · LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
gpt4free67k stars · The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3
gorilla13k stars · Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
apfel6.5k stars · The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
GPT_API_free45k stars · 免费大模型API，支持免费调用GPT、DeepSeek等主流模型，免费额度10000点，每日刷新！另付费价格最低官方1-2折！
omlx FAQ
Is omlx free?
Yes. omlx is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does omlx run on a Mac?
Yes. According to the project, omlx works on macOS.
Does omlx need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is omlx still maintained?
Yes. It was last updated today and has 375 open issues on GitHub.
What are alternatives to omlx?
Similar free, open-source tools include one-api, open-webui, gpt4free, gorilla.