repoGitHubTrust 82 · PrimaryPublished 10d agoLive · 7d ago
EricLBuehler/mistral.rs
Fast, flexible LLM inference
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Related to
Covers
Implements
Covers (incoming)
Implements (incoming)
Related across the graph
newsOpenAI and Broadcom announce chip designed for LLM inference at scalepaperDominoTree: Conditional Tree-Structured Drafting with Domino for Speculative DecodingpaperGrounding LLM Reasoning under Incomplete Graph EvidencenewsDSpark: Speculative decoding accelerates LLM inference [pdf]newsNASA testing local LLM inference for future space missionsnewsDisaggregated prefill and decode for LLM inference on SageMaker HyperPodtutorialEvaluate a model properlynewsI wrote a GGUF inferencer from scratch, AMA