Helicone/ai-gateway
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
- Stars
- 639
- Forks
- 58
- Open issues
- 7
- Last push
- 11mo ago
About ai-gateway
ai-gateway is a free, open-source LLM chat app by Helicone, written mainly in Rust. The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced. It has 639 GitHub stars and 58 forks, and was last updated 11mo ago. It's released under the GPL-3.0 license, a standard open-source license.
- License
- GPL-3.0
- Language
- Rust
- Stars
- 639
- Last update
- 11mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
open-webui156k stars · User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
Open-LLM-VTuber14k stars · Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
ai27k stars · The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
coai9.3k stars · 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, C
ai-gateway FAQ
Is ai-gateway free?
Yes. ai-gateway is open source and free to use. It's released under the GPL-3.0 license, a standard open-source license.
Does ai-gateway run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does ai-gateway need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ai-gateway still maintained?
It was last updated 11mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to ai-gateway?
Similar free, open-source tools include open-webui, khoj, Open-LLM-VTuber, QwenPaw.