podcasts / Gaurav Sen / episode / question
Question

What is the RAGAS framework for evaluating RAG pipelines?

Answered from Research Paper Walkthrough: RAGAS Evals · Gaurav Sen · 2026-08-18

RAGAS, short for Retrieval Augmented Generation Assessment, is a research paper and library that proposes metrics for judging a RAG system without ground-truth human annotations or reference answers. In Gaurav Sen's walkthrough it is a five-page paper, first released in 2023 or 2024 and updated in April 2025, with roughly 2,000 to 2,100 citations, and its metrics are computed by an LLM through the OpenAI API.

Source: our own transcription of the episode. The full conversation is on Gaurav Sen (2026-08-18). Read the whole episode summary →

▸More from this episode

Q2What is faithfulness in RAGAS evals?Q3What is the difference between answer relevance and context relevance in RAGAS?Q4Should an LLM-as-a-judge give a yes-or-no verdict or a score for RAG evals?Q5How do you set up LLM judges for the three RAGAS metrics?Q6Why does Tanishq say reference-free RAG metrics can be misleading in production?Q7Which RAGAS metric should you check when a RAG answer looks wrong?
Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →