repoGitHubTrust 82 · PrimaryPublished 9d agoLive · 9d ago
amitshekhariitbhu/llm-internals
Learn LLM internals step by step - from tokenization to attention to inference optimization.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Related to
Implements
Covers
Covers (incoming)
Implements (incoming)
paperEstimating Uncertainty from Reasoning: A Large-Scale Study of Multi- and Crosslingual MCQA Performance in LLMspaperTowards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model FinetuningpaperThink Through a Bottleneck: Hourglass Reasoning for Rigorous InductionpaperInvariant Learning Dynamics of Transformers in Inductive Reasoning Tasks
Related across the graph
paperDemoPSD: Disagreement-Modulated Policy Self-DistillationpaperEstimating Uncertainty from Reasoning: A Large-Scale Study of Multi- and Crosslingual MCQA Performance in LLMspaperTowards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model FinetuningpaperInvariant Learning Dynamics of Transformers in Inductive Reasoning TaskspaperThink Through a Bottleneck: Hourglass Reasoning for Rigorous InductionpaperUnderstanding Large Language Modelsglossary_termInferencenewsDeepSeek open-sources inference optimizations with 60–85% faster generation [pdf]newsI wrote a GGUF inferencer from scratch, AMApaperTOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference