confident-ai/deepeval
The LLM Evaluation Framework
Apache-2.0Python
- Stars
- 19k
- Forks
- 2.1k
- Open issues
- 330
- Last push
- 3d ago
About deepeval
deepeval is a free, open-source AI developer tool by confident-ai, written mainly in Python. The LLM Evaluation Framework. It has 19k GitHub stars and 2.1k forks, and was last updated 3d ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 19,033
- Last update
- 3d ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Not stated
Similar free tools
lm-evaluation-harness14k stars · A framework for few-shot evaluation of language models.
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
helicone6.2k stars · 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
giskard-oss5.9k stars · 🐢 Open-Source Evaluation & Testing library for LLM Agents
openai-python32k stars · The official Python library for the OpenAI API
langchain148k stars · The agent engineering platform.
deepeval FAQ
Is deepeval free?
Yes. deepeval is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does deepeval run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does deepeval need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is deepeval still maintained?
Yes. It was last updated 3d ago and has 330 open issues on GitHub.
What are alternatives to deepeval?
Similar free, open-source tools include lm-evaluation-harness, RagaAI-Catalyst, helicone, giskard-oss.