Gaurav Sen cover art

Questions

Questions answered on Gaurav Sen

50 questions from 10 episodes of Gaurav Sen, each answered in our own words from our transcript of the episode.

▸AI Interview #9 - Why is the Agent so slow?

2026-10-16 · 5 questions

Q1Why is an AI agent slow, according to Gaurav Sen's AI interview #9?Q2Should AI agent tool calls be synchronous or asynchronous?Q3Does filtering MCP server tools reduce agent latency?Q4How do you speed up a slow tool in an LLM agent?Q5Is a multi-agent system needed for a performance-review AI agent?

▸AI Interview #8 - Why is the chatbot so slow?

2026-10-05 · 4 questions

Q1Why is an LLM chatbot slow, according to Gaurav Sen?Q2How does Gaurav Sen speed up vector database search for a RAG chatbot?Q3Why does Gaurav Sen say semantic chunking is slow at scale?Q4What slows down document upload in a RAG system, according to Gaurav Sen?

▸AI Interview #7 - Why is this chatbot failing?

2026-09-28 · 5 questions

Q1Why is a RAG chatbot giving inaccurate answers, according to Gaurav Sen's AI interview #7?Q2How many chunks should a RAG pipeline retrieve per query?Q3What does a cross-encoder re-ranker do in a RAG pipeline?Q4Why do vector embeddings miss negation and numeric ranges in search?Q5Is a re-ranker worth the extra latency in RAG?

▸Is system design still relevant in 2026?

2026-09-26 · 6 questions

Q1Is system design still relevant in 2026 according to Gaurav Sen and Arvind?Q2What AI concepts does Arvind say software engineers should learn first?Q3How does Gaurav Sen explain vector databases and context engineering simply?Q4Why does Arvind say experienced engineers benefit most from AI coding tools?Q5What did Gaurav Sen notice about AI-built entries at the India AI hackathon?Q6Why does Arvind recommend software engineers build in public in the AI era?

▸AI Interview #6 - 1M context window in LLM?

2026-09-22 · 5 questions

Q1How does RAG work, according to Gaurav Sen's AI interview #6?Q2Why use a vector database instead of Postgres for RAG embeddings?Q3How many chunks should a RAG pipeline retrieve per query?Q4Does RAG reduce LLM hallucination?Q5How do you handle PDF tables and scanned images in a RAG pipeline?

▸AI Interview Questions #5 - Choose RAG or Agents?

2026-08-21 · 4 questions

Q1Should a flight and hotel booking app use RAG or an AI agent, according to Gaurav Sen?Q2What is the difference between RAG and agents, as Gaurav Sen explains it?Q3Why does Gaurav Sen say adding a retrieval loop to RAG does not make it an agent?Q4What does Gaurav Sen think of agentic RAG?

▸Research Paper Walkthrough: RAGAS Evals

2026-08-18 · 7 questions

Q1What is the RAGAS framework for evaluating RAG pipelines?Q2What is faithfulness in RAGAS evals?Q3What is the difference between answer relevance and context relevance in RAGAS?Q4Should an LLM-as-a-judge give a yes-or-no verdict or a score for RAG evals?Q5How do you set up LLM judges for the three RAGAS metrics?Q6Why does Tanishq say reference-free RAG metrics can be misleading in production?Q7Which RAGAS metric should you check when a RAG answer looks wrong?

▸AI Interview Questions #4 - Evals in AI

2026-08-12 · 5 questions

Q1How do you make an LLM application reliable, according to Gaurav Sen's AI interview #4?Q2What are agent traces in AI observability?Q3What are evals for AI agents, and how are they different from unit tests?Q4Which eval metrics does Tanishq recommend for an AI agent on Gaurav Sen's channel?Q5How do you measure groundedness for a RAG system or an AI agent?

▸AI Interview Questions #3 - Prompt Caching with LLMs

2026-08-03 · 5 questions

Q1How does prompt caching work in LLMs, according to Gaurav Sen?Q2How do you stop an LLM prompt cache from serving stale answers?Q3What is a semantic cache for LLM prompts, as Gaurav Sen explains it?Q4What are the trade-offs of a semantic cache for LLMs, according to Gaurav Sen?Q5Is a semantic cache cheaper than calling the LLM directly?

▸AI Interview #2 - Context in LLMs with @aloo_explains

2026-07-26 · 4 questions

Q1What is context in LLMs, according to Gaurav Sen's AI interview #2?Q2What should an AI agent do when its context grows to millions of tokens?Q3What is the difference between context and memory in LLM agents?Q4Is LLM agent memory just a tool call to a database?

Questions from every show →

Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →