newsReddit r/LocalLLaMATrust 58 · CommunityPublished 1mo agoLive · 1mo ago
Ubuntu, CUDA, llama.cpp , nvcc versioning
The CUDA tool kit in apt is waaaaaaaay too old. I’ve been struggling with compute issues after all the other tweaking. Ubuntu latest is 12.0 newest is 13.3, I have a Blackwell and was dumbing it way down, 5060 ti 16gb, doubled the compute once fixed Had to specify the path on the llama.cpp though. Such a gem to find, thanks for keeping CUDA up to date there!!! Off. Maybe this has been spoken of but was not initially found when I went though the specifying
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 48%NVIDIA/cuvs →
- PossiblePossibly related (embedding) · 49%BBuf/how-to-optim-algorithm-in-cuda →
- PossiblePossibly related (embedding) · 52%cip-playground/cip-llm-gateway →
