jjiantong/Awesome-KV-Cache-Optimization
[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
- Stars
- 422
- Forks
- 27
- Open issues
- 0
- Last push
- 12d ago
About Awesome-KV-Cache-Optimization
Awesome-KV-Cache-Optimization is a free, open-source AI resource list by jjiantong, written mainly in Python. [ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization. It has 422 GitHub stars and 27 forks, and was last updated 12d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially.
- License
- Not detected
- Language
- Python
- Stars
- 422
- Last update
- 12d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code37k stars · 500 AI Machine learning Deep learning Computer vision NLP Projects with code
Prompt-Engineering-Guide79k stars · 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
tiny-llm4.8k stars · learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
anomaly-detection-resources9.4k stars · Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!
free-ai-resources-x943 stars · 🌟 A curated collection of free, high quality AI tools 🤖, APIs 🔗, datasets 📊, and learning resources 📚 covering machine learning 🧠, deep learning 🧩, generative AI 🎨, NLP 💬, and data science 📈
CVPR2026-Papers-with-Code23k stars · CVPR 2026 论文和开源项目合集
Awesome-KV-Cache-Optimization FAQ
Is Awesome-KV-Cache-Optimization free?
Yes. Awesome-KV-Cache-Optimization is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does Awesome-KV-Cache-Optimization run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Awesome-KV-Cache-Optimization need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Awesome-KV-Cache-Optimization still maintained?
Yes. It was last updated 12d ago and has 0 open issues on GitHub.
What are alternatives to Awesome-KV-Cache-Optimization?
Similar free, open-source tools include 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code, Prompt-Engineering-Guide, tiny-llm, anomaly-detection-resources.