mnfst/llm-gateway
Open Source LLM Gateway 🦚
MITTypeScript
- Stars
- 7.6k
- Forks
- 522
- Open issues
- 19
- Last push
- 1d ago
About llm-gateway
llm-gateway is a free, open-source AI developer tool by mnfst, written mainly in TypeScript. Open Source LLM Gateway 🦚. It has 7.6k GitHub stars and 522 forks, and was last updated 1d ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- TypeScript
- Stars
- 7,595
- Last update
- 1d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
langchain148k stars · The agent engineering platform.
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
openai-cookbook77k stars · Examples and guides for using the OpenAI API
new-api50k stars · A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for pers
dsh-our-free-model35k stars · 在 dsh 里装上这个插件即可，无需登录、注册或填 API Key，就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费，不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there,
llm-gateway FAQ
Is llm-gateway free?
Yes. llm-gateway is open source and free to use. It's released under the MIT license, a standard open-source license.
Does llm-gateway run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does llm-gateway need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is llm-gateway still maintained?
Yes. It was last updated 1d ago and has 19 open issues on GitHub.
What are alternatives to llm-gateway?
Similar free, open-source tools include langchain, litellm, RagaAI-Catalyst, openai-cookbook.