Fsdp

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

A PyTorch native library for training speculative decoding models

A lightweight runtime health check for PyTorch training runs.

Research platform for model training, evaluation, and experimentation across architectures, benchmarks, and recipes.