theagentrouter/agent-router
Manages Unified Access to Generative AI Services built on Envoy Gateway
- Stars
- 2.3k
- Forks
- 425
- Open issues
- 179
- Last push
- today
About agent-router
agent-router is a free, open-source AI inference tool by theagentrouter, written mainly in Go. Manages Unified Access to Generative AI Services built on Envoy Gateway. It has 2.3k GitHub stars and 425 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Go
- Stars
- 2,262
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Required
- Self-hostable
- Yes
Similar free tools
kong44k stars · 🦍 The API and AI Gateway
tyk11k stars · Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
BentoML8.9k stars · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
plano7.1k stars · Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
agent-router FAQ
Is agent-router free?
agent-router is open source, but it needs a paid third-party API key to work. It's released under the Apache-2.0 license, a standard open-source license.
Does agent-router run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does agent-router need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is agent-router still maintained?
Yes. It was last updated today and has 179 open issues on GitHub.
What are alternatives to agent-router?
Similar free, open-source tools include kong, tyk, BentoML, plano.