mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation
- Stars
- 23k
- Forks
- 2.2k
- Open issues
- 302
- Last push
- 16d ago
About mlc-llm
mlc-llm is a free, open-source LLM chat app by mlc-ai, written mainly in Python. Universal LLM Deployment Engine with ML Compilation. It has 23k GitHub stars and 2.2k forks, and was last updated 16d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Language
- Python
- Stars
- 23,266
- Last update
- 16d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
Hands-On-Large-Language-Models30k stars · Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
FinGPT21k stars · FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
web-llm19k stars · High-performance In-browser LLM Inference Engine
ml-engineering20k stars · Machine Learning Engineering Open Book
Qwen22k stars · The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
OpenRLHF10k stars · An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
mlc-llm FAQ
Is mlc-llm free?
Yes. mlc-llm is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does mlc-llm run on a Mac?
Yes. According to the project, mlc-llm works on macOS.
Does mlc-llm need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is mlc-llm still maintained?
Yes. It was last updated 16d ago and has 302 open issues on GitHub.
What are alternatives to mlc-llm?
Similar free, open-source tools include Hands-On-Large-Language-Models, FinGPT, web-llm, ml-engineering.