Computer scienceData scienceMachine learningIntroduction to deep learningOptimizers

Adagrad and RMSProp

Decay

Report a typo

What is the purpose of the decay rate in RMSProp?

Select one option from the list

The decay rate controls how much the past gradients impact the current update

The decay rate controls the momentum of the gradient updates

The decay rate controls the rate at which the learning rate increases over time

The decay rate determines the weight given to the current gradient when updating the parameters

___

Create a free account to access the full topic