What is Transformer?

A neural network architecture that processes sequences using self-attention (letting every position attend to every other position) instead of recurrence, enabling massive parallelization

What people say

The architecture behind modern AI

Why it's called that

It transforms input representations into output representations through attention layers