Adam 4

• Momentum: Second-Order Gradient Flow ODE and a Multi-Step Method May 18, 2025
• Speedrun of Common Gradient-Based ML Optimizers May 20, 2025
• Adam Through the Lens of Information Geometry: A Diagonal Fisher Approximation May 22, 2025
• Adaptive Methods and Preconditioning: Reshaping the Landscape Jun 1, 2025