repoGitHubTrust 82 · PrimaryPublished 11d agoLive · 11d ago
b4rtaz/distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 59%OpenAI and Broadcom announce chip designed for LLM inference at scale →
- PossiblePossibly related (embedding) · 56%OpenAI and Broadcom unveil LLM-optimized inference chip →
- PossiblePossibly related (embedding) · 50%I quantized a local LLM on my home server and ditched cloud AI for smart home control entirely - MSN →
- PossiblePossibly related (embedding) · 49%Implementing resilience patterns with Amazon Bedrock and LLM gateway →
- PossiblePossibly related (embedding) · 46%12 Ways to Reduce LLM Latency and Inference Costs in Production - KDnuggets →
Covers
newsOpenAI and Broadcom announce chip designed for LLM inference at scalenewsOpenAI and Broadcom unveil LLM-optimized inference chipnewsI quantized a local LLM on my home server and ditched cloud AI for smart home control entirely - MSNnewsImplementing resilience patterns with Amazon Bedrock and LLM gateway
Covers (incoming)
Related across the graph
newsOpenAI and Broadcom announce chip designed for LLM inference at scalenewsOpenAI and Broadcom unveil LLM-optimized inference chipnewsImplementing resilience patterns with Amazon Bedrock and LLM gatewaynews12 Ways to Reduce LLM Latency and Inference Costs in Production - KDnuggetsnewsI quantized a local LLM on my home server and ditched cloud AI for smart home control entirely - MSN