← Glossary
Glossary
What is Perplexity?
The exponential of the average cross-entropy loss. Lower is better. A perplexity of 10 means the model is as uncertain as if it were choosing uniformly among 10 tokens at each step.
What people say
How confused the model is