Andyyyy64/whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
- Stars
- 6.8k
- Forks
- 373
- Open issues
- 4
- Last push
- 3d ago
About whichllm
whichllm is a free, open-source LLM chat app by Andyyyy64, written mainly in Python. Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. It has 6.8k GitHub stars and 373 forks, and was last updated 3d ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- Python
- Stars
- 6,780
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
local-deep-research9.4k stars · ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encryp
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
llamafile26k stars · Distribute and run LLMs with a single file.
self-llm33k stars · 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
obsidian-llm-wiki-local840 stars · Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.
whichllm FAQ
Is whichllm free?
Yes. whichllm is open source and free to use. It's released under the MIT license, a standard open-source license.
Does whichllm run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does whichllm need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is whichllm still maintained?
Yes. It was last updated 3d ago and has 4 open issues on GitHub.
What are alternatives to whichllm?
Similar free, open-source tools include local-deep-research, Open-LLM-VTuber, llamafile, self-llm.