Angestrom
Search
Papers
Models
Live AI
Intelligence
Search
⌕
Go
⌘K
More
▾
Enterprise
Pricing
Sign in
≡
Home
/
Papers
/
Sparse attention at million-token context
paper · arXiv
Sparse attention at million-token context
A linear-cost attention variant that holds quality past a million tokens.
✦
Explain this simply
Want the primary source?
View original →
Related to
glossary_term
Attention
Implements (incoming)
repo
lucidrains/poly-attention
repo
attention-zoo
Related to (incoming)
glossary_term
Token
Covers (incoming)
news
Breakthrough in long-context efficiency announced
⌥ PATH
·
R
lucidrains/poly-attention
→
G
Token
→
N
Breakthrough in long-context efficiency announced
→
P
Sparse attention at million-token context
⧉
↗ share
Related across the graph
repo
lucidrains/poly-attention
glossary_term
Token
news
Breakthrough in long-context efficiency announced
glossary_term
Attention
repo
attention-zoo
Topics
llm
attention
✦