I wrote a GGUF inferencer from scratch, AMA

*for a specific model, in the R language. veeery impractical. 60 seconds per token, yum 😋 not vibecoded, I just wanted to learn how the architecture works on our end lmao (and all of karpathy's guides are outdated 😢) writeup here , though it's kinda old news if you're already familiar with the math I'd really like to make a useful inferencer next (you know, with an actual GP