openziti/llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A
- Stars
- 101
- Forks
- 11
- Open issues
- 6
- Last push
- 12d ago
llm-gateway star history
+1 this week
About llm-gateway
llm-gateway is a free, open-source LLM chat app by openziti, written mainly in Go. Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A. It has 101 GitHub stars and 11 forks, and was last updated 12d ago. It's released under the Apache-2.0 license, a standard open-source license. According to the project, it works on macOS.
- License
- Apache-2.0
- Commercial use
- Commercial OK
- Language
- Go
- Stars
- 101
- Last update
- 12d ago
- Runs on Mac
- Yes (as stated by the project)
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
open-webui157k stars · Self-hosted AI platform for managing and integrating various language models.
khoj38k stars · Self-hostable AI app for personal and enterprise use, integrating LLMs and automating research.
Vane38k stars · Privacy-focused AI-powered answering engine with local and cloud LLM support.
gateway13k stars · Route to 250+ LLMs with a single API for AI apps.
ollama185k stars · Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
QwenPaw36k stars · AI assistant for automation, coding, and document processing.
llm-gateway FAQ
Can I use llm-gateway commercially?
Yes. Apache-2.0 is a permissive license: commercial use is allowed as long as you keep the license notice. This is a plain-English summary, not legal advice.
Is llm-gateway free?
Yes. llm-gateway is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does llm-gateway run on a Mac?
Yes. According to the project, llm-gateway works on macOS.
Does llm-gateway need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llm-gateway still maintained?
Yes. It was last updated 12d ago and has 6 open issues on GitHub.
What are alternatives to llm-gateway?
Similar free, open-source tools include open-webui, khoj, Vane, gateway.
Maintain llm-gateway?
Add this badge to your README to show it's featured on FreeAIRepo.
[](https://www.freeairepo.com/repo/openziti/llm-gateway)