FreeAIRepo
Dev tools & SDKs

yym68686/uni-api

This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancin

Apache-2.0Rust
Stars
1.3k
Forks
159
Open issues
10
Last push
today

About uni-api

uni-api is a free, open-source AI developer tool by yym68686, written mainly in Rust. This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancin. It has 1.3k GitHub stars and 159 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.

License
Apache-2.0
Language
Rust
Stars
1,267
Last update
today
Runs on Mac
Not stated
GPU
Not stated
Paid API key
Not stated
Self-hostable
Yes

Similar free tools

All Dev tools & SDKs tools →

uni-api FAQ

Is uni-api free?

Yes. uni-api is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.

Does uni-api run on a Mac?

The project doesn't say. Check its installation guide before you start.

Does uni-api need a GPU?

The project doesn't state hardware needs. AI models generally run much faster with a GPU.

Is uni-api still maintained?

Yes. It was last updated today and has 10 open issues on GitHub.

What are alternatives to uni-api?

Similar free, open-source tools include openai-cookbook, litellm, new-api, openai-python.

Related topics