relari-ai/continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
- Stars
- 519
- Forks
- 39
- Open issues
- 12
- Last push
- 2mo ago
About continuous-eval
continuous-eval is a free, open-source AI developer tool by relari-ai, written mainly in Python. Data-Driven Evaluation for LLM-Powered Applications. It has 519 GitHub stars and 39 forks, and was last updated 2mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 519
- Last update
- 2mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
deepeval19k stars · The LLM Evaluation Framework
lm-evaluation-harness14k stars · A framework for few-shot evaluation of language models.
RagaAI-Catalyst16k stars · Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
giskard-oss5.9k stars · 🐢 Open-Source Evaluation & Testing library for LLM Agents
helicone6.2k stars · 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
langchain148k stars · The agent engineering platform.
continuous-eval FAQ
Is continuous-eval free?
Yes. continuous-eval is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does continuous-eval run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does continuous-eval need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is continuous-eval still maintained?
It was last updated 2mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to continuous-eval?
Similar free, open-source tools include deepeval, lm-evaluation-harness, RagaAI-Catalyst, giskard-oss.