vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations ๐
- Stars
- 16k
- Forks
- 1.8k
- Open issues
- 384
- Last push
- 8mo ago
About ragas
ragas is a free, open-source AI developer tool by vibrantlabsai, written mainly in Python. Supercharge Your LLM Application Evaluations ๐. It has 16k GitHub stars and 1.8k forks, and was last updated 8mo ago. It's released under the Apache-2.0 license, a standard open-source license.
- License
- Apache-2.0
- Language
- Python
- Stars
- 16,114
- Last update
- 8mo ago
- Runs on Mac
- Not stated
- GPU
- Not stated
- Paid API key
- Not stated
- Self-hostable
- Yes
Similar free tools
deepeval19k stars ยท The LLM Evaluation Framework
RagaAI-Catalyst16k stars ยท Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal
helicone6.2k stars ยท ๐ง Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ๐
giskard-oss5.9k stars ยท ๐ข Open-Source Evaluation & Testing library for LLM Agents
litellm62k stars ยท The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi
lm-evaluation-harness14k stars ยท A framework for few-shot evaluation of language models.
ragas FAQ
Is ragas free?
Yes. ragas is open source and free to use. It's released under the Apache-2.0 license, a standard open-source license.
Does ragas run on a Mac?
The project doesn't say. Check its installation guide before you start.
Does ragas need a GPU?
The project doesn't state hardware needs. AI models generally run much faster with a GPU.
Is ragas still maintained?
It was last updated 8mo ago. Check recent issues on GitHub to judge how active it is.
What are alternatives to ragas?
Similar free, open-source tools include deepeval, RagaAI-Catalyst, helicone, giskard-oss.