THUDM/AgentBench
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
- Stars
- 3.8k
- Forks
- 291
- Open issues
- 65
- Last push
- 8mo ago
About AgentBench
AgentBench is a free, open-source LLM chat app by THUDM, written mainly in Python. A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24). It has 3.8k GitHub stars and 291 forks, and was last updated 8mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 3,786
- Last update
- 8mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
gpt4free67k stars · The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3
GPT_API_free45k stars · 免费大模型API，支持免费调用GPT、DeepSeek等主流模型，免费额度10000点，每日刷新！另付费价格最低官方1-2折！
gpt_academic72k stars · 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss
QwenPaw36k stars · Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.
khoj38k stars · Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI
chinese-llm-benchmark6.5k stars · 非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.
AgentBench FAQ
Is AgentBench free?
Yes. AgentBench is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does AgentBench run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does AgentBench need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is AgentBench still maintained?
It was last updated 8mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to AgentBench?
Similar free, open-source tools include gpt4free, GPT_API_free, gpt_academic, QwenPaw.