Read original ↗
paperarXivTrust 82 · PrimaryPublished 2d agoLive · 13m ago

Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures

Choosing a learning rate scheduling strategy is critical to neural network training, but manual selection is costly and rarely exhaustive. While classical AutoML approaches often treat the scheduler as a secondary hyperparameter, we systematically investigate its impact on classification accuracy across a diverse pool of architectures. We evaluated 30 representative architectures from convolutional and transformer families within the LEMUR neural network dataset. Through automated source-code injection, we applied 25 scheduler configurations across nine PyTorch families, evaluating a total of

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

  • Linked via arxiv authorHafsa Mateen

    Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures

  • Linked via arxiv authorRadu Timofte

    Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures

  • Linked via arxiv authorDmitry Ignatov

    Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures

Covers

Implements

authored (incoming)

Related across the graph

Topics