← Glossary
Glossary
What is Learning Rate?
A scalar that controls step size during gradient descent. Too high: overshoots the minimum and diverges. Too low: converges too slowly or gets stuck. The single most important hyperparameter.
What people say
How fast the AI learns