Read original ↗

repoGitHubTrust 82 · PrimaryPublished yesterdayLive · 6h ago

mosecorg/mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Covers

newsHardware startup unveils inference accelerator newsNVIDIA Unlocks AI Compute at Scale, Inviting Partners to Power the AI Infrastructure Buildout newsAccelerate protein design with BoltzGen on Amazon SageMaker AI

Implements

paperOne-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining

Related to

companyLattice Labs

Implements (incoming)

paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

Related across the graph

newsAccelerate protein design with BoltzGen on Amazon SageMaker AI paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs companyLattice Labs newsNVIDIA Unlocks AI Compute at Scale, Inviting Partners to Power the AI Infrastructure Buildout newsHardware startup unveils inference accelerator paperOne-Step Gradient Delay is Not a Barrier for Large-Scale Asynchronous Pipeline Parallel LLM Pretraining

Topics

cv deep-learning gpu hacktoberfest jax llm llm-serving machine-learning machine-learning-platform mlops