What’s up with Deep Learning optimizers since Adam?
A chronological highlight of interesting ideas that try to optimize the optimization process since the advent of Adam:
medium.com