newsReddit r/MachineLearningTrust 52 · CommunityPublished 7d agoLive · 7d ago

We'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]

We run HexGrid Cloud, a platform for deploying open-source models on GPUs, and we're heads-down optimizing our serving/deployment layer. To pressure-test it we're benchmarking real models under real concurrency — and instead of guessing, we'd rather run what you actually want to see. --- Models available for benchmarking : Nemotron-3 Super 120B-A12B (only NVFP4) Nemotron-3 Nano 30B A3B Qwen-3.6

Covers

reponotwitcheer/llm-bench-rig reporaketenkater/ggrun repojmaczan/tiny-vllm repoFastFlowLM/FastFlowLM paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

Covers (incoming)

repoErwan923/gpu-infra-lab repoopenlake-project/openlake

Related across the graph

reporaketenkater/ggrun reponotwitcheer/llm-bench-rig repoopenlake-project/openlake paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs repojmaczan/tiny-vllm repoErwan923/gpu-infra-lab repoFastFlowLM/FastFlowLM