Read original ↗
newsReddit r/LocalLLaMATrust 52 · CommunityPublished 13h agoLive · 56m ago

Anyone else completely tuning out these massive "open weight" drops?

Tbh the benchmarks on stuff like GLM-5.2 look insane. 753B params, 1M context, MIT license... everyone is throwing a party on the front page right now. But like... what is actually "local" about this anymore? A 700B+ MoE isn't fitting on anyone's home rig. Even if you absolutely crush it down to a q1 or q2 GGUF, you're still not running it. I've got a dual-GPU setup running on a solid x8/x8 bifurcation board, and even heavily optimized under AMD ROCm,

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

Covers

Related across the graph