onejune2018/Awesome-LLM-Eval
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.
- Stars
- 659
- Forks
- 108
- Open issues
- 10
- Last push
- 11mo ago
About Awesome-LLM-Eval
Awesome-LLM-Eval is a free, open-source AI resource list by onejune2018. Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界. It has 659 GitHub stars and 108 forks, and was last updated 11mo ago. It's released under the MIT license, a standard open-source license.
- License
- MIT
- Language
- –
- Stars
- 659
- Last update
- 11mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code37k stars · 500 AI Machine learning Deep learning Computer vision NLP Projects with code
Prompt-Engineering-Guide79k stars · 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
anomaly-detection-resources9.4k stars · Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!
tiny-llm4.8k stars · learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
KG-LLM-Papers2.2k stars · [Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
LLMAgentPapers3.1k stars · Must-read Papers on LLM Agents.
Awesome-LLM-Eval FAQ
Is Awesome-LLM-Eval free?
Yes. Awesome-LLM-Eval is open source and free to use. It's released under the MIT license, a standard open-source license.
Does Awesome-LLM-Eval run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does Awesome-LLM-Eval need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is Awesome-LLM-Eval still maintained?
It was last updated 11mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to Awesome-LLM-Eval?
Similar free, open-source tools include 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code, Prompt-Engineering-Guide, anomaly-detection-resources, tiny-llm.