MathComputational mathOptimization

Gradient Descent

Mind your step

Report a typo

Match each of the following step sizes to the expected effect it has on the Gradient Descent method for a given function $f(x,y)=\sqrt{x^2+y^2}$ and starting point $\bold{x}_0=(2,3)$ . Consider the first 10 iterations.

Match the items from left and right columns

0.8

-1

0.1

Descends but it gets stuck after a while

Overshoots from the start

Converges

Diverges from the start

___

Create a free account to access the full topic