Gradient Descent 6
- Momentum: Second-Order Gradient Flow ODE and a Multi-Step Method
- Speedrun of Common Gradient-Based ML Optimizers
- Gradient Descent and Gradient Flow
- Adaptive Methods and Preconditioning: Reshaping the Landscape
- Crash Course Cheat Sheet: Numerical Analysis for Optimization
- Convex Analysis Part 6: Introduction to Convex Optimization Algorithms