podcasts / Gaurav Sen / episode / question
Question

How do you speed up a slow tool in an LLM agent?

Answered from AI Interview #9 - Why is the Agent so slow? · Gaurav Sen · 2026-10-16

Tanishk's fix in Gaurav Sen's mock interview is to avoid the call when the data rarely changes. Employee facts such as the number of leaves can be stored in the backend ahead of time and passed straight into the system prompt as an extra instruction. The same review applies to every tool: some do mundane work whose output could simply sit in the model's context.

Source: our own transcription of the episode. The full conversation is on Gaurav Sen (2026-10-16). Read the whole episode summary →

▸More from this episode

Q1Why is an AI agent slow, according to Gaurav Sen's AI interview #9?Q2Should AI agent tool calls be synchronous or asynchronous?Q3Does filtering MCP server tools reduce agent latency?Q5Is a multi-agent system needed for a performance-review AI agent?
Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →