alibaba/MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- Stars
- 16k
- Forks
- 2.5k
- Open issues
- 36
- Last push
- today
About MNN
MNN is a free, open-source LLM chat app by alibaba, written mainly in C++. MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI. It has 16k GitHub stars and 2.5k forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- C++
- Stars
- 16,271
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
ml-engineering20k stars · Machine Learning Engineering Open Book
LLM-RL-Visualized5.0k stars · 🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）
mlc-llm23k stars · Universal LLM Deployment Engine with ML Compilation
learning7.0k stars · A log of things I'm learning
transformer-explainer9.0k stars · Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
RWKV-LM15k stars · RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a
MNN FAQ
Is MNN free?
Yes. MNN is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does MNN run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does MNN need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is MNN still maintained?
Yes. It was last updated today and has 36 open issues on GitHub.
What are alternatives to MNN?
Similar free, open-source tools include ml-engineering, LLM-RL-Visualized, mlc-llm, learning.