repoGitHubTrust 82 · PrimaryPublished 2mo agoLive · 2mo ago

minimal-diffusion-lm

A tiny, readable diffusion language model.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

LinkedLinked via unknownDiffusion language models, revisited →
LinkedLinked via unknownTransformer →
LinkedLinked via unknownUnderstand diffusion in 20 minutes →
LinkedLinked via unknownWhat if context compression is a diffusion noise function? Proposal + honest results from untrained-model experiments [R] →
LinkedLinked via unknownHow Surprising Is Historical Italian to Language Models? Tokenization Tax, Comprehension Tax, and a Simple Mitigation →
LinkedLinked via unknownIdentifying Interactions at Scale for LLMs →
LinkedLinked via unknownDiffusionGemma: 4x faster text generation →
LinkedLinked via unknownDiffusion →

Implements

paperDiffusion language models, revisited

Covers (incoming)

newsWhat if context compression is a diffusion noise function? Proposal + honest results from untrained-model experiments [R]newsIdentifying Interactions at Scale for LLMs newsDiffusionGemma: 4x faster text generation newsBook Review: Domain-Specific Small Language Models by Guglielmo Iozzia newsKnowledge Distillation of Black-Box Large Language Models newsLearning Unmasking Policies for Diffusion Language Models - Apple Machine Learning Research news[Paper] Multi-Block Diffusion Language Models newsScaling Properties of Continuous Diffusion Spoken Language Models - Apple Machine Learning Research newsSmall language models in medicine - Nature

Implements (incoming)

paperHow Surprising Is Historical Italian to Language Models? Tokenization Tax, Comprehension Tax, and a Simple Mitigation paperScaling limit of the Random Language Model paperAdaptive Block Diffusion: Resolving Training-Inference Mismatch in Diffusion Language Models paperMasked Diffusion Decoding as $x$-Prediction Flow paperMulti-Block Diffusion Language Models paperUnderstanding Evaluation Illusion in Diffusion Large Language Models paperInformation Dynamics of Language Communication paperWhen Is a Draft Accepted? A Theory of Acceptance in Speculative Decoding paperThe Grammar Does the Work: Functional vs. Lexical Dependency Length Minimization Across Universal Dependencies paperWhat Does a Discrete Diffusion Model Learn?paperPrompting Complexity: Shortest Prompts for Texts and Behaviors in LLMs paperNeural Collapse Is Forbidden: Information Floors in Language Models paperFrom Global to Factor-Wise Expert Composition in Discrete Diffusion Models paperAccelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques paperAudio-Native Speech Recognition with a Frozen Discrete-Diffusion Language Model

Related to (incoming)

glossary_termDiffusion modelDiffuse-XL

Related across the graph

paperAccelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques newsDiffusionGemma: 4x faster text generation newsKnowledge Distillation of Black-Box Large Language Models news[Paper] Multi-Block Diffusion Language Models paperWhen Is a Draft Accepted? A Theory of Acceptance in Speculative Decoding paperMulti-Block Diffusion Language Models glossary_termTransformer paperUnderstanding Evaluation Illusion in Diffusion Large Language Models paperFrom Global to Factor-Wise Expert Composition in Discrete Diffusion Models newsLearning Unmasking Policies for Diffusion Language Models - Apple Machine Learning Research paperMasked Diffusion Decoding as $x$-Prediction Flow paperDiffusion language models, revisited paperWhat Does a Discrete Diffusion Model Learn?paperNeural Collapse Is Forbidden: Information Floors in Language Models paperPrompting Complexity: Shortest Prompts for Texts and Behaviors in LLMs newsWhat if context compression is a diffusion noise function? Proposal + honest results from untrained-model experiments [R]newsScaling Properties of Continuous Diffusion Spoken Language Models - Apple Machine Learning Research tutorialUnderstand diffusion in 20 minutes paperThe Grammar Does the Work: Functional vs. Lexical Dependency Length Minimization Across Universal Dependencies newsSmall language models in medicine - Nature paperAudio-Native Speech Recognition with a Frozen Discrete-Diffusion Language Model paperHow Surprising Is Historical Italian to Language Models? Tokenization Tax, Comprehension Tax, and a Simple Mitigation newsBook Review: Domain-Specific Small Language Models by Guglielmo Iozzia glossary_termDiffusion paperAdaptive Block Diffusion: Resolving Training-Inference Mismatch in Diffusion Language Models modelDiffuse-XL paperInformation Dynamics of Language Communication paperScaling limit of the Random Language Model newsIdentifying Interactions at Scale for LLMs

Topics

llm diffusion