newsReddit r/LocalLLaMATrust 58 · CommunityPublished 4d agoLive · 4d ago
Ubuntu, CUDA, llama.cpp , nvcc versioning
The CUDA tool kit in apt is waaaaaaaay too old. I’ve been struggling with compute issues after all the other tweaking. Ubuntu latest is 12.0 newest is 13.3, I have a Blackwell and was dumbing it way down, 5060 ti 16gb, doubled the compute once fixed Had to specify the path on the llama.cpp though. Such a gem to find, thanks for keeping CUDA up to date there!!! Off. Maybe this has been spoken of but was not initially found when I went though the specifying
