cubist38/mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friend

Really freeMITRuns on MacPython

Open on GitHub

Stars: 363
Forks: 70
Open issues: 27
Last push: 3d ago

About mlx-openai-server

mlx-openai-server is a free, open-source AI image tool by cubist38, written mainly in Python. A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friend. It has 363 GitHub stars and 70 forks, and was last updated 3d ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.

License: MIT
Language: Python
Stars: 363
Last update: 3d ago
Runs on Mac: Yes (as stated by the project)
GPU: Not stated
Paid API key: Not required
Self-hostable: Yes