Openai Api
6 items across the graph — tagged with Openai Api.
From the graph · 6
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and w…
Multi-Provider AI Gateway - Model Autodiscovery, Failover Groups and more. No personal logs by design. "Because we have LiteLLM at home"
LLM-powered conversation summarisation service for OCTO — turns group chats and threads into structured briefs with key decisions, open questions, and follow-up…
OpenAI & Anthropic Compatible API Gateway for AWS Bedrock and AI Services