Building the ⁠Opensource
standard for evaluating
LLM application

Processing 5,000,000 evaluations monthly

Microsoft

AWS

DataBricks

Adobe

Baidu

IBM

Accenture

Cisco

Microsoft

AWS

DataBricks

Adobe

Baidu

IBM

Accenture

Cisco

Features

Ragas Metrics

Intuitive and explainable metrics to quantify performance of your LLM app

Synthetic Test Data

Reduce developer time to evaluate by 90% generating synthetic test datasets

Online monitoring

Custom smaller models for monitor the quality of LLM application in production

Where does ragas fit in your stack?

Workflow

Testimonials

Webinar on evaluating RAG systems going live in 5 minutes! Excited to be joined by the RAGAS team crowdcast.io/c/bnx91nz59cqq

Harrison Chase
Harrison Chase
@hwchase17

💪RAGAS is an awesome open-source framework for evaluating RAG systems 🤝We recently integrated LangSmith <> RAGAS for optimal ease of evaluation 🎥We're also doing a webinar on RAG evaluation with them in 5 minutes!!! Link to webinar and blog 👇

13
Reply

Congrats to @shahules786 for creating the only RAG framework directly recommended by openai at devday Thought leadership is the art of nailing the highest order bit

Image
Harrison Chase
Harrison Chase
@hwchase17

Great overview of RAGAS! We also did a webinar with them 2 weeks ago - check it out for more insights of how to evaluate RAG systems! youtube.com/watch?v=fWC4Vx…

143
Reply

RAGAS 🤝 Weaviate! New podcast tomorrow, some awesome background info below! 👇

Erika Cardenas
Erika Cardenas
@ecardenas300

RAG evaluation is the next step once your pipeline is set ☝️ There are four new metrics based on LLM evaluation that are setting the standard: 1. Faithfulness, 2. Answer relevancy, 3. Context precision, and 4. Context recall (Ragas score) The visual below illustrates prompting…

Image
47
Reply

💪RAGAS is an awesome open-source framework for evaluating RAG systems 🤝We recently integrated LangSmith <> RAGAS for optimal ease of evaluation 🎥We're also doing a webinar on RAG evaluation with them in 5 minutes!!! Link to webinar and blog 👇

86
Reply

I am blown away by RAGAS With 10 lines of code, I created a question + answer dataset of Airbnb's latest annual report (10-K). The dataset has 3 parts: • questions • contexts • ground truth answers Next step: Evaluate how well various LLMs perform RAG on financial…

Image
430
Reply

Webinar on evaluating RAG systems going live in 5 minutes! Excited to be joined by the RAGAS team crowdcast.io/c/bnx91nz59cqq

Harrison Chase
Harrison Chase
@hwchase17

💪RAGAS is an awesome open-source framework for evaluating RAG systems 🤝We recently integrated LangSmith <> RAGAS for optimal ease of evaluation 🎥We're also doing a webinar on RAG evaluation with them in 5 minutes!!! Link to webinar and blog 👇

13
Reply

Congrats to @shahules786 for creating the only RAG framework directly recommended by openai at devday Thought leadership is the art of nailing the highest order bit

Image
Harrison Chase
Harrison Chase
@hwchase17

Great overview of RAGAS! We also did a webinar with them 2 weeks ago - check it out for more insights of how to evaluate RAG systems! youtube.com/watch?v=fWC4Vx…

143
Reply

RAGAS 🤝 Weaviate! New podcast tomorrow, some awesome background info below! 👇

Erika Cardenas
Erika Cardenas
@ecardenas300

RAG evaluation is the next step once your pipeline is set ☝️ There are four new metrics based on LLM evaluation that are setting the standard: 1. Faithfulness, 2. Answer relevancy, 3. Context precision, and 4. Context recall (Ragas score) The visual below illustrates prompting…

Image
47
Reply

💪RAGAS is an awesome open-source framework for evaluating RAG systems 🤝We recently integrated LangSmith <> RAGAS for optimal ease of evaluation 🎥We're also doing a webinar on RAG evaluation with them in 5 minutes!!! Link to webinar and blog 👇

86
Reply

I am blown away by RAGAS With 10 lines of code, I created a question + answer dataset of Airbnb's latest annual report (10-K). The dataset has 3 parts: • questions • contexts • ground truth answers Next step: Evaluate how well various LLMs perform RAG on financial…

Image
430
Reply

We are building Ragas openly

Feel free to contribute to our project