NVIDIA/SkillEvaluator
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect a
- Stars
- 592
- Forks
- 74
- Open issues
- 9
- Last push
- today
About SkillEvaluator
SkillEvaluator is a free, open-source AI developer tool by NVIDIA, written mainly in Python. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect a. It has 592 GitHub stars and 74 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 592
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
langchain148k stars · The agent engineering platform.
DeepSeek-Reasonix36k stars · A reliable coding agent for complex software engineering tasks.
coze-studio22k stars · An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coze your way to AI Agent creation.
skill8.6k stars · 收录最全、更新最快的技能Skills商店：精选原创技能包（涵盖文档处理、内容创作、编程开发、机器学习、自动化工作流），全部打包好可直接安装使用！同时自动抓取GitHub上万个Skills项目，按分类、更新时间、Star数量整理。The most comprehensive and frequently updated AI Agent skill library, featuring curate
codex-security11k stars · OpenAI's Codex Security CLI and TypeScript SDK for finding, validating, and fixing security vulnerabilities. npm: https://www.npmjs.com/package/@openai/codex-security
SkillEvaluator FAQ
Is SkillEvaluator free?
Yes. SkillEvaluator is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does SkillEvaluator run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does SkillEvaluator need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is SkillEvaluator still maintained?
Yes. It was last updated today and has 9 open issues on GitHub.
What are alternatives to SkillEvaluator?
Similar free, open-source tools include RagaAI-Catalyst, langchain, DeepSeek-Reasonix, coze-studio.