Computer scienceData scienceMachine learningIntroduction to deep learningOptimizers

Adagrad and RMSProp

The convergence speed

Report a typo

What causes Adagrad to have a (relatively) slow convergence?

Select one option from the list

The learning rate not decreasing exponentially

The squared gradient sum always grows, diminishing the learning rate

Inability to adapt the learning rate per parameter

___

Create a free account to access the full topic