podcasts / Gaurav Sen / episode / question
Question

What is faithfulness in RAGAS evals?

Answered from Research Paper Walkthrough: RAGAS Evals · Gaurav Sen · 2026-08-18

Faithfulness in RAGAS measures whether a generated answer is grounded in the context the system retrieved. Gaurav Sen's example is a refund query: if the retrieved policy says refunds in India are processed within the first seven days and the answer ignores it, faithfulness is low. The paper scores it by having an LLM split the answer into short statements and dividing the supported statements by all extracted statements.

Source: our own transcription of the episode. The full conversation is on Gaurav Sen (2026-08-18). Read the whole episode summary →

▸More from this episode

Q1What is the RAGAS framework for evaluating RAG pipelines?Q3What is the difference between answer relevance and context relevance in RAGAS?Q4Should an LLM-as-a-judge give a yes-or-no verdict or a score for RAG evals?Q5How do you set up LLM judges for the three RAGAS metrics?Q6Why does Tanishq say reference-free RAG metrics can be misleading in production?Q7Which RAGAS metric should you check when a RAG answer looks wrong?
Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →