Topic

Model Server

1 items across the graph — tagged with Model Server.

From the graph · 1

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

Related topics

cncf 1 inference 1 intelligent-routing 1 llm 1 gpu 1 kubernetes 1 model-server 1 distributed-inference 1 ai 1

Search Model Server →All topics →