Read original ↗
paperarXivTrust 82 · PrimaryPublished 10d agoLive · 9d ago

Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

Generalization remains a pivotal challenge in deep learning, where traditional optimizers like Stochastic Gradient Descent (SGD) often converge to sharp minima, leading to overfitting and reduced performance on unseen data. Building on Sharpness-Aware Minimization (SAM), for seeking flat minima associated with improved generalization, we propose the Extragradient-Inspired Sharpness-Aware Minimization (EISAM), a novel optimizer that enhances generalization via the extragradient technique. EISAM uses a two-step update process: a prediction step investigating the geometry of the loss landscape an

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • LinkedLinked via arxiv author · 85%Yao Fu

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

  • LinkedLinked via arxiv author · 85%Chunxia Zhang

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

  • LinkedLinked via arxiv author · 85%Junmin Liu

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

  • LinkedLinked via arxiv author · 85%Yihang Jin

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

  • LinkedLinked via arxiv author · 85%Haishan Ye

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

  • LinkedLinked via arxiv author · 85%Yuanao Yang

    Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning

Covers

authored (incoming)

Related across the graph

Topics