Skip to main content
Angestrom home
SearchPapersModelsLive AIIntelligence
Search⌕⌘K
EnterprisePricingSign in

Stay Ahead in the AI Revolution

Weekly digest — EPI pulse, top intelligence, fresh lineage. Free, no account.

Follow Angestrom
Global source network
Synced every 5 minutes

Continuous sync from primary AI sources — indexed, enriched, and queryable in real time.

arXivHugging FaceGitHubOpenAIAnthropicDeepMindReutersBBC TechHacker NewsReddit MLVerified feedsFunding
Angestrom

Angestrom connects every piece of the AI ecosystem — data, models, research, companies, tools, and people.

info@angestrom.comwww.angestrom.comLucknow, Uttar Pradesh, India

Product

  • AI Search
  • AI Models
  • Research Papers
  • Companies
  • News & Events
  • GitHub Explorer
  • APIs & Tools
  • Datasets
  • Benchmarks
  • Model lifecycle
  • Funding graph
  • Contributors
  • AI Agents

Resources

  • Weekly digest
  • Documentation
  • Tutorials
  • Guides
  • News
  • Help / Start
  • Community

Company

  • About
  • Contact
  • Privacy Policy
  • Terms of Service
  • Acceptable Use

Enterprise

  • Pricing
  • Workspace
  • Contact Sales

Developer

  • Developer Hub
  • API docs
  • GitHub

Learn

  • Learning Academy
  • Roadmaps
  • Glossary
  • AI for Beginners

Popular Topics

Loading topics…
View All Topics →
© 2026 Angestrom. All rights reserved.
English
Theme
Angestrom home
SearchPapersModelsLive AIIntelligence
Search⌕⌘K
EnterprisePricingSign in
  1. Home
  2. /Repositories
  3. /kyegomez/SparseAttention
Read original ↗
repoGitHubTrust 82 · PrimaryPublished 18h agoLive · 14h ago

kyegomez/SparseAttention

Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • PossiblePossibly related (embedding) · 53%H64LM: A 249M-parameter Mixture-of-Experts Transformer built from scratch in PyTorch [P] →
  • PossiblePossibly related (embedding) · 51%How can we solve long-range recall in linear attention? [D] →

Covers

newsH64LM: A 249M-parameter Mixture-of-Experts Transformer built from scratch in PyTorch [P]newsHow can we solve long-range recall in linear attention? [D]

Related across the graph

newsH64LM: A 249M-parameter Mixture-of-Experts Transformer built from scratch in PyTorch [P]newsHow can we solve long-range recall in linear attention? [D]
Knowledge path·NH64LM: A 249M-parameter Mixture-of-Experts Transformer built from scratch in PyTorch [P]→NHow can we solve long-range recall in linear attention? [D]→Rkyegomez/SparseAttention

Topics

artificial-intelligenceattention-is-all-you-needattention-mechanismattention-mechanismsmachine-learningsparse-attnsparse-matrix

Explore

Search similar →Knowledge graph →All repos →Full intelligence feed →
Graph trust82Primary
Graph score100