Too big, it explodes. Too small, it crawls.

The learning rate, step by step: why one number decides whether training works at all