Gradient Descent - What is the idea of gradient descent?

Since the direction of steepest descent is perpendicular to the function's gradient (or approximation gradient) at the present point, the aim is to repeatedly step in the opposite direction of this gradient.