Luolc/AdaBound

An optimizer that trains as fast as Adam and as good as SGD. - Luolc/AdaBound