What is Attention?

A mechanism where every token computes a weighted sum of all other tokens' values, with weights determined by how relevant they are (via dot product of query and key vectors)

What people say

How the AI focuses on important parts

Why it's called that

The 2017 paper "Attention Is All You Need" named it by analogy to human selective attention