nobodywho-ooo/nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
- Stars
- 1.6k
- Forks
- 97
- Open issues
- 8
- Last push
- today
About nobodywho
nobodywho is a free, open-source AI inference tool by nobodywho-ooo, written mainly in Rust. NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device. It has 1.6k GitHub stars and 97 forks, and was last updated today. It uses the EUPL-1.2 license; check its terms before commercial use. According to the project, it works on macOS.
- License
- EUPL-1.2
- Language
- Rust
- Stars
- 1,609
- Last update
- today
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
turbo-fieldfare7.0k stars · Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
vllm95k stars · A high-throughput and memory-efficient inference and serving engine for LLMs
shimmy6.0k stars · ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
nobodywho FAQ
Is nobodywho free?
Yes. nobodywho is open source and free to use. It uses the EUPL-1.2 license; check its terms before commercial use.
Does nobodywho run on a Mac?
Yes. According to the project, nobodywho works on macOS.
Does nobodywho need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is nobodywho still maintained?
Yes. It was last updated today and has 8 open issues on GitHub.
What are alternatives to nobodywho?
Similar free, open-source tools include BentoML, turbo-fieldfare, TensorRT-LLM, ai-infra-book.