benchflow-ai/awesome-evals
A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.
- Stars
- 996
- Forks
- 134
- Open issues
- 1
- Last push
- 2d ago
About awesome-evals
awesome-evals is a free, open-source AI resource list by benchflow-ai. A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow. It has 996 GitHub stars and 134 forks, and was last updated 2d ago. GitHub doesn't detect a standard license, so check the repository before using it commercially.
- License
- Not detected
- Language
- –
- Stars
- 996
- Last update
- 2d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not required
- Self-hostable
- Not stated
Similar free tools
Prompt-Engineering-Guide79k stars · 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
best-of-Agent-Harnesses1.3k stars · 🏆 Ranked list of 167 AI agent harnesses, plus templates, playbooks, MCP, and learning resources. Rescored weekly.
agentUniverse2.4k stars · agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications.
Autonomous-Agents1.4k stars · Autonomous Agents (LLMs) research papers. Updated Daily.
h4cker30k stars · This repository is maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), AI security, vu
Supervisor-Skills10k stars · 将博导十年科研经验炼化为可直接调用的 AI 技能。从 Idea 构思到论文投稿，你的 AI 科研副导师。
awesome-evals FAQ
Is awesome-evals free?
Yes. awesome-evals is open source and free to use. GitHub doesn't detect a standard license, so check the repository before using it commercially.
Does awesome-evals run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does awesome-evals need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is awesome-evals still maintained?
Yes. It was last updated 2d ago and has 1 open issues on GitHub.
What are alternatives to awesome-evals?
Similar free, open-source tools include Prompt-Engineering-Guide, best-of-Agent-Harnesses, agentUniverse, Autonomous-Agents.