It iteratively adjusts model parameters in the direction of the steepest descent.
How It Works
The cost function measures the difference between predicted and actual outcomes.
Cost Function
The learning rate controls the size of each step taken towards the minimum.
Learning Rate
Common types include Batch, Stochastic, and Mini-Batch Gradient Descent.
Types of Gradient Descent
Batch Gradient Descent updates parameters after evaluating the entire dataset.
Batch Gradient Descent
Used in training neural networks, regression models, and various AI applications.
Applications of Gradient Descent