humanrouter/ddtree-mlx
Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port with custom Metal kernels for hybrid model support.
- Stars
- 145
- Forks
- 13
- Open issues
- 0
- Last push
- 6mo ago
ddtree-mlx star history
+0 this week
About ddtree-mlx
ddtree-mlx is a free, open-source LLM chat app by humanrouter, written mainly in Python. Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port with custom Metal kernels for hybrid model support. It has 145 GitHub stars and 13 forks, and was last updated 6mo ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it works on macOS.
- License
- Not detected
- Commercial use
- No license
- Language
- Python
- Stars
- 145
- Last update
- 6mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
vllm-mlx1.6k stars · High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
mlx-dspark727 stars · Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, tern
omlx23k stars · Local LLM inference server for macOS with menu bar control.
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
llm_interview_note15k stars · 主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题
web-llm19k stars · Runs language models in web browsers for AI chatbots and assistants.
ddtree-mlx FAQ
Can I use ddtree-mlx commercially?
Unclear. No license was detected, which legally means all rights are reserved. Ask the author before using it commercially. This is a plain-English summary, not legal advice.
Is ddtree-mlx free?
Yes. ddtree-mlx is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does ddtree-mlx run on a Mac?
Yes. According to the project, ddtree-mlx works on macOS.
Does ddtree-mlx need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ddtree-mlx still maintained?
It was last updated 6mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to ddtree-mlx?
Similar free, open-source tools include vllm-mlx, mlx-dspark, omlx, self-llm.
Maintain ddtree-mlx?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/humanrouter/ddtree-mlx)