repoGitHubTrust 82 · PrimaryPublished 3h agoLive · 3h ago

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Covers

newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsSelf-hosted GitHub Actions runners on Lambda MicroVMs

Related across the graph

newsSelf-hosted GitHub Actions runners on Lambda MicroVMs newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]

Topics