repoGitHubTrust 82 · PrimaryPublished 1mo agoLive · 2d ago

inference-gateway/inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

PossiblePossibly related (embedding) · 58%OpenAI and Broadcom announce chip designed for LLM inference at scale →
PossiblePossibly related (embedding) · 58%OpenAI and Broadcom unveil LLM-optimized inference chip →
PossiblePossibly related (embedding) · 53%Implementing resilience patterns with Amazon Bedrock and LLM gateway →
PossiblePossibly related (embedding) · 46%Off Grid AI Runs Full LLM Inference With No Internet Required - Carroll County Mirror-Democrat →
PossiblePossibly related (embedding) · 46%Adaptive Inference Batching using Policy Gradients →

Covers

newsOpenAI and Broadcom announce chip designed for LLM inference at scale newsOpenAI and Broadcom unveil LLM-optimized inference chip newsImplementing resilience patterns with Amazon Bedrock and LLM gateway

Covers (incoming)

newsOff Grid AI Runs Full LLM Inference With No Internet Required - Carroll County Mirror-Democrat

Implements (incoming)

paperAdaptive Inference Batching using Policy Gradients

Related across the graph

newsOpenAI and Broadcom announce chip designed for LLM inference at scale newsOpenAI and Broadcom unveil LLM-optimized inference chip paperAdaptive Inference Batching using Policy Gradients newsOff Grid AI Runs Full LLM Inference With No Internet Required - Carroll County Mirror-Democrat newsImplementing resilience patterns with Amazon Bedrock and LLM gateway

Topics