podcasts / Gaurav Sen / episode / question
Question

What is the difference between context and memory in LLM agents?

Answered from AI Interview #2 - Context in LLMs with @aloo_explains · Gaurav Sen · 2026-07-26

Tanishq tells Gaurav Sen that context is what goes into the LLM to answer one particular query, a kind of runtime memory, while memory is data stored outside the model. When a query needs it, such as a healthcare bot asked about medicines prescribed at the last visit, the relevant memory is extracted and loaded into the context.

▸In their words

“So memory is the stored thing.” Tanishq · at 5:55 — open in the transcript →

Source: our own transcription of the episode. The full conversation is on Gaurav Sen (2026-07-26). Read the whole episode summary →

▸More from this episode

Q1What is context in LLMs, according to Gaurav Sen's AI interview #2?Q2What should an AI agent do when its context grows to millions of tokens?Q4Is LLM agent memory just a tool call to a database?
Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →