FreeAIRepo
Inference & serving

katanemo/plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Apache-2.0Rust
Open on GitHub Website
Stars
7.1k
Forks
489
Open issues
113
Last push
14d ago

About plano

plano is a free, open-source AI inference tool by katanemo, written mainly in Rust. Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. It has 7.1k GitHub stars and 489 forks, and was last updated 14d ago. It's released under the Apache-2.0 license, a standard open-source license.

License
Apache-2.0
Language
Rust
Stars
7,097
Last update
14d ago
Runs on Mac
Not stated
GPU
Not stated
Paid API key
Not stated
Self-hostable
Yes

Similar free tools

All Inference & serving tools →

plano FAQ

Is plano free?

Yes. plano is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.

Does plano run on a Mac?

Its README doesn't say. Check the installation guide on GitHub before you start.

Does plano need a GPU?

Its README doesn't state hardware needs. AI models generally run much faster with a GPU.

Is plano still maintained?

Yes. It was last updated 14d ago and has 113 open issues on GitHub.

What are alternatives to plano?

Similar free, open-source tools include kong, BentoML, OpenLLM, TensorRT-LLM.

Related topics

gatewaygenerative-aillm-inferencellmspromptproxyproxy-serverllmops