Ascend

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Community maintained hardware plugin for vLLM on Ascend

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大…

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

Persist and reuse KV Cache to speedup your LLM.