peva3/SmarterRouter
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
- Stars
- 154
- Forks
- 19
- Open issues
- 2
- Last push
- 5mo ago
SmarterRouter star history
+0 this week
About SmarterRouter
SmarterRouter is a free, open-source LLM chat app by peva3, written mainly in Python. SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs. It has 154 GitHub stars and 19 forks, and was last updated 5mo ago. It's released under the MIT license, a standard open-source license. According to the project, it works on macOS.
- License
- MIT
- Commercial use
- Commercial OK
- Language
- Python
- Stars
- 154
- Last update
- 5mo ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Yes
Similar free tools
open-webui157k stars · Self-hosted AI platform for managing and integrating various language models.
unsloth79k stars · Run and train various AI models and agents locally.
Vane38k stars · Privacy-focused AI-powered answering engine with local and cloud LLM support.
ollama185k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
one-api37k stars · 统一管理多个大语言模型API，提供二次分发服务。
openclaw393k stars · Runs AI assistants on your devices for personal or team use.
SmarterRouter FAQ
Can I use SmarterRouter commercially?
Yes. MIT is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is SmarterRouter free?
Yes. SmarterRouter is open source and free to use. It's released under the MIT license, a standard open-source license.
Does SmarterRouter run on a Mac?
Yes. According to the project, SmarterRouter works on macOS.
Does SmarterRouter need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is SmarterRouter still maintained?
It was last updated 5mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to SmarterRouter?
Similar free, open-source tools include open-webui, unsloth, Vane, ollama.
Maintain SmarterRouter?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/peva3/SmarterRouter)