Which RAGAS metric should you check when a RAG answer looks wrong?

The rule of thumb offered in Gaurav Sen's RAGAS walkthrough maps symptoms to metrics. An answer that seems wrong points to faithfulness, since the context it relied on may be wrong. An answer about something other than what the user asked points to answer relevance. An answer missing information points to context relevance, meaning retrieval did not bring back what was needed.

• Each metric pairs two of the three RAG components: question and context, answer and context, or question and answer.

Source: our own transcription of the episode. The full conversation is on Gaurav Sen (2026-08-18). Read the whole episode summary →

▸More from this episode