fluxninja/aperture
Rate limiting, caching, and request prioritization for modern workloads
- Stars
- 732
- Forks
- 37
- Open issues
- 50
- Last push
- 10mo ago
About aperture
aperture is a free, open-source AI inference tool by fluxninja, written mainly in Go. Rate limiting, caching, and request prioritization for modern workloads. It has 732 GitHub stars and 37 forks, and was last updated 10mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Go
- Stars
- 732
- Last update
- 10mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
kong44k stars · 🦍 The API and AI Gateway
kubesphere17k stars · The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️
OpenLLM13k stars · Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
TensorRT-LLM15k stars · TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT
kubewall1.9k stars · kubewall - Kubernetes Dashboard for Multi-Cluster Management Real-Time, Self-Hosted, Single Binary, AI-powered. Manage, monitor & debug K8s clusters in your browser, no cloud, no agents.
ai-infra-book6.9k stars · 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
aperture FAQ
Is aperture free?
Yes. aperture is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does aperture run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does aperture need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is aperture still maintained?
It was last updated 10mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to aperture?
Similar free, open-source tools include kong, kubesphere, OpenLLM, TensorRT-LLM.