repoGitHubTrust 82 · PrimaryPublished 1mo agoLive · yesterday

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

PossiblePossibly related (embedding) · 48%OpenAI and Broadcom unveil LLM-optimized inference chip →
PossiblePossibly related (embedding) · 47%OpenAI and Broadcom announce chip designed for LLM inference at scale →
PossiblePossibly related (embedding) · 47%Hands Free, AIs Forward: NVIDIA XR AI Brings Agents to AR Glasses →
FuzzySimilar title/name (fuzzy) · 84%Behavior Uncloning: Distilling Mode Redirection into Policy Weights without Inference-Time Steering →
“Fuzzy title match (0.92): “Behavior Uncloning: Distilling Mode Redirection into Policy ” ≈ “xorbitsai/inference””
FuzzySimilar title/name (fuzzy) · 84%Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques →
“Fuzzy title match (0.92): “Accelerating Masked Diffusion Large Language Models: A Surve” ≈ “xorbitsai/inference””
FuzzySimilar title/name (fuzzy) · 84%An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation →
“Fuzzy title match (0.92): “An Efficient vLLM-Based Inference Pipeline for Unified Audio” ≈ “xorbitsai/inference””
FuzzySimilar title/name (fuzzy) · 84%Biologically Informed Deep Neural Networks for Multi-Omic Integration, Pathway Activity Inference and Risk Stratification in Cancer →
“Fuzzy title match (0.92): “Biologically Informed Deep Neural Networks for Multi-Omic In” ≈ “xorbitsai/inference””
FuzzySimilar title/name (fuzzy) · 84%Adaptive Inference Batching using Policy Gradients →
“Fuzzy title match (0.92): “Adaptive Inference Batching using Policy Gradients” ≈ “xorbitsai/inference””

Covers

newsOpenAI and Broadcom unveil LLM-optimized inference chip newsOpenAI and Broadcom announce chip designed for LLM inference at scale newsHands Free, AIs Forward: NVIDIA XR AI Brings Agents to AR Glasses

Implements

paperBehavior Uncloning: Distilling Mode Redirection into Policy Weights without Inference-Time Steering paperAccelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques paperAn Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation paperBiologically Informed Deep Neural Networks for Multi-Omic Integration, Pathway Activity Inference and Risk Stratification in Cancer paperAdaptive Inference Batching using Policy Gradients paperDynamic Neural Graph Encoding of Inference Processes in Deep Weight Space paperCausalMix: Data Mixture as Causal Inference for Language Model Training paperNIFA: Nonlinear IMC enhanced FPGA for efficient ML inference paperCausal Inference for Sequential Settings under Interference and Latent Confounding paperUI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation paperW4A4 Quantization for Inference on Wan2.2-I2V-A14B paperSimulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC paperDeep and Probabilistic Models for Gene Regulatory Network Inference paperReading Order Inference for Complex Document Layouts paperVector Search As Nearest Neighbor Matching: RAG-based Policy Learning in Causal Inference paperEmpowering On-Device Model Adaptation with an Edge AI Inference Accelerator paperInference-Time Steering for Cross-Lingual Factual Consistency in LLMs paperSeeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference paperActive Inference as a Convex Markov Decision Process paperPyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference paperEvolving Cache Schedules for Fast Diffusion Policy Inference paperStatistical Inference for Rank Allocation in Low-Rank Adaptation paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs paperInference-Time Scaling of Diffusion Models via Progressive Seed Pruning paperReduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference paperOnline Inference in Distributional Temporal-Difference Learning

Covers (incoming)

newsWeekly recap: GPT-5.6 public launch, Grok 4.5, Gemini 3.5 Pro delayed, Microsoft Copilot conversion data, DeepSeek API retirement on July 24

Related across the graph

paperBehavior Uncloning: Distilling Mode Redirection into Policy Weights without Inference-Time Steering paperStatistical Inference for Rank Allocation in Low-Rank Adaptation newsHands Free, AIs Forward: NVIDIA XR AI Brings Agents to AR Glasses paperAccelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques paperInference-Time Steering for Cross-Lingual Factual Consistency in LLMs paperBiologically Informed Deep Neural Networks for Multi-Omic Integration, Pathway Activity Inference and Risk Stratification in Cancer paperEvolving Cache Schedules for Fast Diffusion Policy Inference newsOpenAI and Broadcom announce chip designed for LLM inference at scale paperAn Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation paperOnline Inference in Distributional Temporal-Difference Learning newsOpenAI and Broadcom unveil LLM-optimized inference chip paperPyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference paperAdaptive Inference Batching using Policy Gradients paperDynamic Neural Graph Encoding of Inference Processes in Deep Weight Space paperVector Search As Nearest Neighbor Matching: RAG-based Policy Learning in Causal Inference newsWeekly recap: GPT-5.6 public launch, Grok 4.5, Gemini 3.5 Pro delayed, Microsoft Copilot conversion data, DeepSeek API retirement on July 24 paperCausal Inference for Sequential Settings under Interference and Latent Confounding paperCausalMix: Data Mixture as Causal Inference for Language Model Training paperReduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference paperSeeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference paperUI2App: Benchmarking Visual Interaction Inference in Executable Web Application Generation paperEmpowering On-Device Model Adaptation with an Edge AI Inference Accelerator paperWattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs paperActive Inference as a Convex Markov Decision Process paperReading Order Inference for Complex Document Layouts paperSimulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC paperW4A4 Quantization for Inference on Wan2.2-I2V-A14B paperInference-Time Scaling of Diffusion Models via Progressive Seed Pruning paperNIFA: Nonlinear IMC enhanced FPGA for efficient ML inference paperDeep and Probabilistic Models for Gene Regulatory Network Inference

Topics