Topic

Routing

18 items across the graph — tagged with Routing.

From the graph · 18

repo
mnfst/awesome-free-llm-apis

List of Permanent Free LLM API (API Keys)

repo
llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

repo
ratel-ai/ratel

Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 and semantic retrieval. Progressive Disclosure.…

repo
AstraNetLab/CacheRoute

CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system effici…

repo
usedotai/dot-loom

Provider-pluggable orchestration runtime for multi-model AI inference. ( Sakana Fugu style )

repo
BJTU-ANT/CacheRoute

CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system effici…

repo
regolo-ai/brick-SR1

brick is a smart AI Models router, based on complexity & capabilities extraction from the query to the models via proprietary spatial embedding algorythm

repo
RouteWorks/RouterArena

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

repo
greynewell/infermux

Route inference across providers.

repo
xiayu1987/noobot

Self-hosted AI agent workspace with tool calling, MCP, multi-model routing, sandboxed execution, multi-agent workflows, and LLM-authored 3D character animation…

repo
heyxiaoc/not-fade-away

在自己的 Mac 上搭一套常驻、自愈、走订阅、墙内也能用的自托管 AI 伴侣 · 人看版讲思路,机看版给完整规格 · 文 / 小C & Grace

repo
ypollak2/llm-router

Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain cuts costs 35-80%.

repo
Izzetee/PiPiMink

Route every prompt to the best LLM — for you specifically.

repo
soapbucket/sbproxy

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or s…

repo
just-llms/justllms

Production-ready Python library for multi-provider LLM orchestration

repo
xorbitsai/xrouter-llm

A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and +1.9 pts completion…

repo
shrdgn/openfusion

Combine the results from a panel of models into an enhanced response

repo
Dqz00116/opencode-solo

OpenCode agent configuration — a read-only orchestrator delegates to 6 specialized subagents. Expert model plans, fast models execute. Isolated contexts, minima…

Related topics