Read original ↗
paperarXivTrust 82 · PrimaryPublished 1mo agoLive · 1mo ago

Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

Speculative decoding accelerates autoregressive generation by drafting a block of tokens that the target model verifies left-to-right, committing only the longest accepted prefix. Block (DLM-style) drafters predict the whole block in parallel, which is fast but trained with a full-block cross-entropy that supervises every position against the gold continuation -- even though inference discards every token after the first rejection. Recent acceptance-aware objectives patch this by reweighting the full-block loss; we instead use teacher-forced learning as a motivation for how supervision should

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • LinkedLinked via arxiv author · 85%Tianjian Yang

    Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

  • LinkedLinked via arxiv author · 85%Meng Li

    Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

  • PossiblePossibly related (embedding) · 53%lightseekorg/TorchSpec

authored (incoming)

Implements (incoming)

Related across the graph

Topics