prayangshuuu/hummingbird
hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM, and VRAM into a single intelligent memory hierarchy, enabli
- Stars
- 61
- Forks
- 14
- Open issues
- 0
- Last push
- 2mo ago
About hummingbird
hummingbird is a free, open-source AI inference tool by prayangshuuu, written mainly in C. hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM, and VRAM into a single intelligent memory hierarchy, enabli. It has 61 GitHub stars and 14 forks, and was last updated 2mo ago. GitHub doesn't detect a standard license, so check the repository before using it commercially. According to the project, it runs on a regular CPU without a GPU and works on macOS.
- License
- Not detected
- Commercial use
- No license
- Language
- C
- Stars
- 61
- Last update
- 2mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not needed (runs on CPU)
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
mlc-llm23k stars · Compile and deploy large language models on various platforms.
airllm41k stars · Runs large language models on low VRAM GPUs.
vllm95k stars · High-throughput inference engine for LLMs.
sglang38k stars · Serves large language and multimodal models for inference and RL.
ai-infra-book7.0k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
PowerInfer9.8k stars · High-speed Large Language Model Serving for Local Deployment
hummingbird FAQ
Can I use hummingbird commercially?
Unclear. No license was detected, which legally means all rights are reserved. Ask the author before using it commercially. This is a plain-English summary, not legal advice.
Is hummingbird free?
Yes. hummingbird is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does hummingbird run on a Mac?
Yes. According to the project, hummingbird works on macOS.
Does hummingbird need a GPU?
No. According to the project, hummingbird runs on a regular CPU.
Is hummingbird still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to hummingbird?
Similar free, open-source tools include mlc-llm, airllm, vllm, sglang.