repoGitHubTrust 82 · PrimaryPublished 2d agoLive · 19h ago

giannisanni/pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs. Zero-config multi-GPU: measures PCIe bandwidth, places attention and hot experts where they fit.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

PossiblePossibly related (embedding) · 57%WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs →
PossiblePossibly related (embedding) · 56%Alternative(s) to run CUDA on non-Nvidia hardware →
PossiblePossibly related (embedding) · 55%We'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D] →
PossiblePossibly related (embedding) · 55%Top Cost-Effective Enterprise GPU Cloud Platforms for AI Workloads with H100–GB200, Elastic Scaling and Pay-as-You-Go Compute - Scott Coop →
PossiblePossibly related (embedding) · 53%Run NVIDIA Nemotron and OpenAI GPT OSS models on Amazon Bedrock in AWS GovCloud (US) →
PossiblePossibly related (embedding) · 50%Accelerating Block Low-Rank Foundation Model Inference on MemoryConstrained GPUs →

Implements

paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

Covers

newsAlternative(s) to run CUDA on non-Nvidia hardware newsWe'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]newsTop Cost-Effective Enterprise GPU Cloud Platforms for AI Workloads with H100–GB200, Elastic Scaling and Pay-as-You-Go Compute - Scott Coop newsRun NVIDIA Nemotron and OpenAI GPT OSS models on Amazon Bedrock in AWS GovCloud (US)

Covers (incoming)

newsAccelerating Block Low-Rank Foundation Model Inference on MemoryConstrained GPUs

Related across the graph

newsRun NVIDIA Nemotron and OpenAI GPT OSS models on Amazon Bedrock in AWS GovCloud (US)newsAccelerating Block Low-Rank Foundation Model Inference on MemoryConstrained GPUs paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs newsWe'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]newsAlternative(s) to run CUDA on non-Nvidia hardware newsTop Cost-Effective Enterprise GPU Cloud Platforms for AI Workloads with H100–GB200, Elastic Scaling and Pay-as-You-Go Compute - Scott Coop

Topics