Estimating an Optimal Learning Rate For a Deep Neural Network
The learning rate is one of the most important hyper-parameters to tune for training deep neural networks.