Computer scienceData scienceMachine learningIntroduction to deep learningOptimizers

Adagrad and RMSProp

The RMSProp update

Report a typo

How does RMSProp update the learning rate?

Select one option from the list

The learning rate is updated by dividing it by the square root of the accumulated gradients

The learning rate is updated by multiplying it with an exponentially decaying average of squared gradients

The learning rate is updated by dividing it by the square root of the moving average of the squared gradients

___

Create a free account to access the full topic