Parameters Update in Deep Learning

Comparison of three different techniques for updating parameters.