xlite-dev/Awesome-LLM-Inference
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
- Stars
- 5.5k
- Forks
- 440
- Open issues
- 1
- Last push
- 3d ago
About Awesome-LLM-Inference
Awesome-LLM-Inference is a free, open-source AI resource list by xlite-dev, written mainly in Python. ๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐. It has 5.5k GitHub stars and 440 forks, and was last updated 3d ago. It's released under the GPL-3.0 license, a standard open-source license.
- License
- GPL-3.0
- Language
- Python
- Stars
- 5,537
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
tiny-llm4.8k stars ยท learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
KG-LLM-Papers2.2k stars ยท [Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
anomaly-detection-resources9.4k stars ยท Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!
best-of-Agent-Harnesses1.3k stars ยท ๐ Ranked list of 167 AI agent harnesses, plus templates, playbooks, MCP, and learning resources. Rescored weekly.
llm-paper-daily1.3k stars ยท Daily updated LLM papers. ๆฏๆฅๆดๆฐ LLM ็ธๅ ณ็่ฎบๆ๏ผๆฌข่ฟ่ฎข้ ๐ ๅๆฌข็่ฏๅจๅจไฝ ็ๅฐๆ ๐ ไธไธช
LLM-eval-survey1.6k stars ยท The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
Awesome-LLM-Inference FAQ
Is Awesome-LLM-Inference free?
Yes. Awesome-LLM-Inference is open source and free to use. It's released under the GPL-3.0 license, a standard open-source license.
Does Awesome-LLM-Inference run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Awesome-LLM-Inference need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Awesome-LLM-Inference still maintained?
Yes. It was last updated 3d ago and has 1 open issues on GitHub.
What are alternatives to Awesome-LLM-Inference?
Similar free, open-source tools include tiny-llm, KG-LLM-Papers, anomaly-detection-resources, best-of-Agent-Harnesses.