Sglang
6 items across the graph — tagged with Sglang.
From the graph · 6
repo
kvcache-ai/Mooncake
→repoMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
sgl-project/SpecForge
→repoTrain speculative decoding models effortlessly and port them smoothly to SGLang serving.
sgl-project/rbg
→repoA workload for deploying LLM inference services on Kubernetes
matrixhub-ai/matrixhub
→repoAn Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
lightseekorg/TorchSpec
→repoA PyTorch native library for training speculative decoding models
OpenDCAI/One-Eval
→Automated system for LLM evaluation via agents. Doc as below: