microsoft/Tutel
Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4
- Stars
- 1.0k
- Forks
- 111
- Open issues
- 55
- Last push
- 1d ago
About Tutel
Tutel is a free, open-source LLM chat app by microsoft, written mainly in C. Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4. It has 1.0k GitHub stars and 111 forks, and was last updated 1d ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- C
- Stars
- 1,028
- Last update
- 1d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
project-maya1.4k stars · Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenA
chinese-llm-benchmark6.5k stars · 非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.
llm_interview_note15k stars · 主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题
Tutel FAQ
Is Tutel free?
Yes. Tutel is open source and free to use. It's released under the MIT license, a standard open-source license.
Does Tutel run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Tutel need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Tutel still maintained?
Yes. It was last updated 1d ago and has 55 open issues on GitHub.
What are alternatives to Tutel?
Similar free, open-source tools include self-llm, Open-LLM-VTuber, open-webui, project-maya.