• (Vanilla/Batch) Gradient Descent
• Stochastic Gradient Descent / Mini-Batch Gradient Descent
• Momentum (Velocity Gradient Descent)
• Nesterov Accelerated Gradient Descent (NAG)