Topic

Gateway

36 items across the graph — tagged with Gateway.

From the graph · 36

repo
BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, A…

repo
Kong/kong

🦍 The API and AI Gateway

repo
decolua/9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% t…

repo
maximhq/bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support &

repo
vllm-project/semantic-router

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

repo
looplj/axonhub

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

repo
algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

repo
IBM/mcp-context-forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and…

repo
agentgateway/agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

repo
nextlevelbuilder/goclaw

GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compro…

repo
envoyproxy/ai-gateway

Manages Unified Access to Generative AI Services built on Envoy Gateway

repo
theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

repo
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Gu…

repo
microsoft/mcp-gateway

MCP Gateway is a reverse proxy and management layer for MCP servers, enabling scalable, session-aware stateful routing and lifecycle management of MCP servers i…

repo
lightseekorg/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first g…

repo
tingly-dev/tingly-box

Your Intelligence, Orchestrated. Every builder. Every team. Every agent. For Everyone.

repo
schmitech/orbit

Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents.

repo
llm-d/llm-d-router

llm-d Router: The intelligent entry point for inference requests

repo
ferro-labs/ai-gateway

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gate…

repo
gebruder/wirken

The switchboard for the agent era. Per-channel isolation, encrypted credential vault, per-session hash-chained audit log. Single static Rust binary.

repo
voidmind-io/voidllm

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge…

repo
majiayu000/litellm-rs

A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format

repo
greynewell/infermux

Route inference across providers.

repo
doublewordai/control-layer

The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single auth…

repo
adrianliechti/wingman

Inference Hub for AI at Scale

repo
mozilla-ai/otari

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

repo
voocel/litellm

LiteLLM for Go, the easiest way to write LLM-based programs in Go

repo
tsouth89/toolport

Local-first MCP gateway. One port for every tool and every AI client: lazy discovery (~90% token savings), tool integrity + quarantine, secrets in the OS keycha…

repo
api7/aisix

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, cachi…

repo
MikkoParkkola/mcp-gateway

Universal MCP Gateway - Single-port multiplexing with Meta-MCP for ~95% context token savings

repo
cuihuan/awesome-ai-gateway

⚡ Awesome AI Gateway — curated comparison of 100+ AI gateways & LLM proxies (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security, c…

repo
wink-run/local-llm-proxy

Token Bank — the local LLM gateway that sits between your AI agents and every provider. Know where tokens go · Spend less with smart routing to Ollama, Groq, Gi…

repo
r9s-ai/open-next-router

A lightweight, DSL-driven LLM gateway for routing, patching provider quirks, and normalizing APIs across channels

repo
wyolet/relay

High-throughput, self-hostable LLM router in Go. BYO provider keys, k8s-native, key pooling + batch + usage observability.

repo
hecatehq/hecate

Local AI operations console for supervised agent work.

repo
andreimerfu/pllm

High-performance LLM Gateway built in Go - OpenAI compatible proxy with multi-provider support, adaptive routing, and enterprise features

Related topics