Framework
Ragas
Ragas is an open-source AI framework, launched in 2023, made for developers.
A framework for evaluating LLM apps and RAG pipelines and generating test sets for them.
Main jobs: Evaluate and trace LLM apps. It is open source and free to use. You can use it offline on your own machine and on your own server.
Markdown version of https://godooo.ai/en/framework/ragas. Every page on this site has one: add .md to its address.
At a glance
- Type
- Framework
- Launched
- 2023
- Galaxy
- Models & APIs
- Open source
- Yes · Apache-2.0
- Source code
- github.com/vibrantlabsai/ragas
- GitHub stars
- 15,838
- How you run it
- Runs offline · Self-host
- Made for
- Developers
- Website
- docs.ragas.io
What it can do
Evaluate and trace LLM appsmain jobunconfirmed
unconfirmedproposed by a machine, awaiting calibration
Alternatives
- DeepEvalOpen source, freeAlso does: Evaluate and trace LLM apps
- LangfuseOpen source, freeAlso does: Evaluate and trace LLM apps
- PhoenixOpen source, freeAlso does: Evaluate and trace LLM apps
- promptfooOpen source, freeAlso does: Evaluate and trace LLM apps
- Pydantic AIOpen source, freeAlso does: Evaluate and trace LLM apps
Questions
What is Ragas?
Ragas is an open-source AI framework, launched in 2023, made for developers. A framework for evaluating LLM apps and RAG pipelines and generating test sets for them.
Is Ragas free?
Yes. Ragas is open source (Apache-2.0) and free to use.
Is Ragas open source?
Yes, under the Apache-2.0 license. The source code is at https://github.com/vibrantlabsai/ragas.
Can Ragas run locally?
Yes. Ragas can run offline on your own machine. It can also be self-hosted on your own server.
What can Ragas do?
Main jobs: Evaluate and trace LLM apps.
What are open-source alternatives to Ragas?
Open-source ones: DeepEval, Langfuse, Phoenix, promptfoo and Pydantic AI.