Read original ↗
newsReddit r/LocalLLaMATrust 58 · CommunityPublished 1mo agoLive · 1mo ago

Ubuntu, CUDA, llama.cpp , nvcc versioning

The CUDA tool kit in apt is waaaaaaaay too old. I’ve been struggling with compute issues after all the other tweaking. Ubuntu latest is 12.0 newest is 13.3, I have a Blackwell and was dumbing it way down, 5060 ti 16gb, doubled the compute once fixed Had to specify the path on the llama.cpp though. Such a gem to find, thanks for keeping CUDA up to date there!!! Off. Maybe this has been spoken of but was not initially found when I went though the specifying

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

Covers (incoming)

Related across the graph