repoGitHubTrust 82 · PrimaryPublished 1mo agoLive · 11d ago
alibaba/tair-kvcache
Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 54%I mapped which local LLMs actually fit each RAM tier, 8 to 128GB (open dataset) →
- PossiblePossibly related (embedding) · 51%OpenAI and Broadcom announce chip designed for LLM inference at scale →
- PossiblePossibly related (embedding) · 50%Hardware startup unveils inference accelerator →
- PossiblePossibly related (embedding) · 50%Monitor and debug generative AI inference with SageMaker detailed metrics and Insights dashboard on CloudWatch →
- PossiblePossibly related (embedding) · 50%We'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D] →
- PossiblePossibly related (embedding) · 50%Cloud-vLLM Benchmark Differences [R] →
- PossiblePossibly related (embedding) · 48%Byte exact KV cache grafting on frozen Gemma 4 →
- PossiblePossibly related (embedding) · 63%DKV: Open-source KV-cache compression framework for local LLM inference (CLI + technical report) →
Covers
newsI mapped which local LLMs actually fit each RAM tier, 8 to 128GB (open dataset)newsOpenAI and Broadcom announce chip designed for LLM inference at scalenewsHardware startup unveils inference acceleratornewsMonitor and debug generative AI inference with SageMaker detailed metrics and Insights dashboard on CloudWatchnewsWe'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]
Covers (incoming)
newsCloud-vLLM Benchmark Differences [R]newsByte exact KV cache grafting on frozen Gemma 4newsDKV: Open-source KV-cache compression framework for local LLM inference (CLI + technical report)newsFAIRChem v2 UMA for Multidomain Atomistic Simulation across Molecules, Catalysts, Materials, Vibrations, and Molecular Dynamics - MarkTechPost
Related across the graph
newsFAIRChem v2 UMA for Multidomain Atomistic Simulation across Molecules, Catalysts, Materials, Vibrations, and Molecular Dynamics - MarkTechPostnewsOpenAI and Broadcom announce chip designed for LLM inference at scalenewsCloud-vLLM Benchmark Differences [R]newsI mapped which local LLMs actually fit each RAM tier, 8 to 128GB (open dataset)newsMonitor and debug generative AI inference with SageMaker detailed metrics and Insights dashboard on CloudWatchnewsWe'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]newsByte exact KV cache grafting on frozen Gemma 4newsDKV: Open-source KV-cache compression framework for local LLM inference (CLI + technical report)newsHardware startup unveils inference accelerator