# Ragas

Framework · https://godooo.ai/en/framework/ragas

> Ragas is an open-source AI framework, launched in 2023, made for developers.

A framework for evaluating LLM apps and RAG pipelines and generating test sets for them.

Main jobs: Evaluate and trace LLM apps. It is open source and free to use. You can use it offline on your own machine and on your own server.

## At a glance

- **Type:** [Framework](https://godooo.ai/en/browse#framework)
- **Launched:** 2023
- **Galaxy:** [Models & APIs](https://godooo.ai/en/galaxy/builders)
- **Open source:** Yes · Apache-2.0
- **Source code:** [github.com/vibrantlabsai/ragas](https://github.com/vibrantlabsai/ragas)
- **GitHub stars:** 15,838
- **How you run it:** Runs offline · Self-host
- **Made for:** Developers
- **Website:** [docs.ragas.io](https://docs.ragas.io)

## What it can do

- **[Evaluate and trace LLM apps](https://godooo.ai/en/capability/llm-evaluation)** — main job, _proposed by a machine, awaiting calibration_.

## Alternatives

- **[DeepEval](https://godooo.ai/en/framework/deepeval)** (Open source, free): Also does: Evaluate and trace LLM apps
- **[Langfuse](https://godooo.ai/en/product/langfuse)** (Open source, free): Also does: Evaluate and trace LLM apps
- **[Phoenix](https://godooo.ai/en/framework/phoenix)** (Open source, free): Also does: Evaluate and trace LLM apps
- **[promptfoo](https://godooo.ai/en/cli/promptfoo)** (Open source, free): Also does: Evaluate and trace LLM apps
- **[Pydantic AI](https://godooo.ai/en/framework/pydantic-ai)** (Open source, free): Also does: Evaluate and trace LLM apps

## Questions

### What is Ragas?

Ragas is an open-source AI framework, launched in 2023, made for developers. A framework for evaluating LLM apps and RAG pipelines and generating test sets for them.

### Is Ragas free?

Yes. Ragas is open source (Apache-2.0) and free to use.

### Is Ragas open source?

Yes, under the Apache-2.0 license. The source code is at https://github.com/vibrantlabsai/ragas.

### Can Ragas run locally?

Yes. Ragas can run offline on your own machine. It can also be self-hosted on your own server.

### What can Ragas do?

Main jobs: Evaluate and trace LLM apps.

### What are open-source alternatives to Ragas?

Open-source ones: DeepEval, Langfuse, Phoenix, promptfoo and Pydantic AI.

## Sources

- [docs.ragas.io](https://docs.ragas.io)
- [github.com](https://github.com/vibrantlabsai/ragas)

---

Last updated 2026-09-24 · Markdown version of https://godooo.ai/en/framework/ragas. Every page on this site has one: add .md to its address.