What is Normalization?

Adjusting values to a standard range. Batch normalization normalizes across a batch. Layer normalization normalizes across features. Both stabilize training and allow higher learning rates.

What people say

Scaling the data

Why it's called that