newsReddit r/LocalLLaMATrust 52 · CommunityPublished 1mo agoLive · 1mo ago
I wrote a GGUF inferencer from scratch, AMA
*for a specific model, in the R language. veeery impractical. 60 seconds per token, yum 😋 not vibecoded, I just wanted to learn how the architecture works on our end lmao (and all of karpathy's guides are outdated 😢) writeup here , though it's kinda old news if you're already familiar with the math I'd really like to make a useful inferencer next (you know, with an actual GP
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 51%alez007/modelship →
- PossiblePossibly related (embedding) · 50%alibaba/rtp-llm →
- PossiblePossibly related (embedding) · 49%EricLBuehler/mistral.rs →
- PossiblePossibly related (embedding) · 48%amitshekhariitbhu/llm-internals →
- PossiblePossibly related (embedding) · 48%dphnAI/aphrodite-engine →
- PossiblePossibly related (embedding) · 48%Cambridge-ICCS/FTorch →
- PossiblePossibly related (embedding) · 52%vixhal-baraiya/microgpt-c →
- PossiblePossibly related (embedding) · 53%rasbt/reasoning-from-scratch →