Load Balancer
3 items across the graph — tagged with Load Balancer.
From the graph · 3
repo
intentee/paddler
→repoOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, e…
Shaf2665/Hermes-router
→repoOpenAI/Anthropic-compatible AI router that keeps apps online with provider failover, key rotation, caching, analytics, and local-model fallback.
soapbucket/sbproxy
→Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or s…