JudgmentLabs/judgeval
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
- Stars
- 1.1k
- Forks
- 103
- Open issues
- 17
- Last push
- today
About judgeval
judgeval is a free, open-source AI developer tool by JudgmentLabs, written mainly in Python. The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring. It has 1.1k GitHub stars and 103 forks, and was last updated today. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 1,069
- Last update
- today
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
langchain148k stars · The agent engineering platform.
prompt-optimizer39k stars · An AI prompt optimizer for writing better prompts and getting better AI results.
litellm62k stars · The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
DeepSeek-Reasonix36k stars · A reliable coding agent for complex software engineering tasks.
deepeval19k stars · The LLM Evaluation Framework
judgeval FAQ
Is judgeval free?
Yes. judgeval is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does judgeval run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does judgeval need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is judgeval still maintained?
Yes. It was last updated today and has 17 open issues on GitHub.
What are alternatives to judgeval?
Similar free, open-source tools include langchain, prompt-optimizer, litellm, RagaAI-Catalyst.