Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Gradient Descent - What is the idea of gradient descent?

Answer

Since the direction of steepest descent is perpendicular to the function's gradient (or approximation gradient) at the present point, the aim is to repeatedly step in the opposite direction of this gradient.