madroidmaq/mlx-omni-server
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless
- Stars
- 745
- Forks
- 88
- Open issues
- 22
- Last push
- 5mo ago
About mlx-omni-server
mlx-omni-server is a free, open-source AI developer tool by madroidmaq, written mainly in Python. MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless. It has 745 GitHub stars and 88 forks, and was last updated 5mo ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Language
- Python
- Stars
- 745
- Last update
- 5mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
openai-cookbook77k stars · Examples and guides for using the OpenAI API
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
new-api50k stars · A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for pers
evolution-api9.9k stars · Evolution API is an open-source WhatsApp integration API
mlx-omni-server FAQ
Is mlx-omni-server free?
Yes. mlx-omni-server is open source and free to use. It's released under the MIT license, a standard open-source license.
Does mlx-omni-server run on a Mac?
Yes. According to the project, mlx-omni-server works on macOS.
Does mlx-omni-server need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is mlx-omni-server still maintained?
It was last updated 5mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to mlx-omni-server?
Similar free, open-source tools include openai-cookbook, litellm, openai-python, new-api.