← Glossary
Glossary
What is Optimizer?
An algorithm that uses gradients to update model parameters. SGD is the simplest. Adam is the most common. Each optimizer has different properties: convergence speed, memory usage, sensitivity to hyperparameters.
What people say
The thing that updates weights