podcasts / The attention family / episode / question
Question

Do you need to know transformers before starting Vizuara's attention family lectures?

Answered from The Attention Family: Every Attention Mechanism, Explained | New Series Launch | Lecture 1 · The attention family · 2026-09-01

No. The Vizuara instructor expects two groups: learners who know neural networks, backpropagation, multilayer perceptrons, embeddings and softmax but not transformers, who should start from the next lecture, and those already fluent in the softmax(QK^T/sqrt(d))V formula, who can skip early lectures by title. He still recommends watching in order because self-taught learners often have gaps they have not noticed.

Source: our own transcription of the episode. The full conversation is on The attention family (2026-09-01). Read the whole episode summary →

▸More from this episode

Q1What are the seven buckets of attention mechanisms in Vizuara's attention family series?Q2How many types of attention mechanisms are there, according to the Vizuara attention lectures?Q3How does Vizuara's attention family series compare attention in Llama 3, DeepSeek V3 and Kimi Linear?Q4Why is attention quadratic in the number of tokens, according to the Vizuara attention lectures?Q5Is flash attention a new attention architecture or an implementation trick, per Vizuara's lectures?Q6What does Vizuara's attention family lecture series cover, and in what order?
Transcribe your links. Paste a YouTube, Google Drive or podcast link and WhipScribe gives you the transcript. Transcribe a link →