Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling
Language models encode substantial factual knowledge in their parameters, which can lead to unreliable behavior when this knowledge is outdated, incomplete, or misaligned with the provided context. In this work, we study whether modifying the pretraining signal can systematically shift models away from parametric recall and toward evidence-grounded reasoning. We introduce Knowledge--''Less'' Language Models (KLLMs), a fundamentally different epistemic training paradigm for LLMs, which are pretrained on corpora in which named entities are anonymized, thereby removing a primary channel for entit
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 56%chrisliu298/awesome-llm-unlearning →
- PossiblePossibly related (embedding) · 50%amitshekhariitbhu/llm-internals →
- PossiblePossibly related (embedding) · 49%sileod/llm-theory-of-mind →
- LinkedLinked via arxiv author · 85%Roi Cohen →
“Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling”
- LinkedLinked via arxiv author · 85%Yvan Carré →
“Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling”
- LinkedLinked via arxiv author · 85%Nick Lechtenbörger →
“Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling”
- LinkedLinked via arxiv author · 85%Hendrik Droste →
“Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling”
- LinkedLinked via arxiv author · 85%Lucas Kerschke →
“Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling”