Eagle

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

A PyTorch native library for training speculative decoding models

a typed programming language that emits to multiple backends