Read original ↗
newsReddit r/LocalLLaMATrust 52 · CommunityPublished 14d agoLive · 13d ago

Petition to add a rule for people to add their DAMN quant levels to their posts

Every time I see a post about a newly released model, whether it be a comparison or shitting on it, I have to dig through the endless comments to see what quants they used and what their specs were. Its quite a common occurrence here in this sub to ask someone that's saying a model is underperforming, and when you ask what quantization they are running they say something like "oh im running q0.1bpw from nobodyknowswhothisguyis". Worst off

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

Covers

Related across the graph