Topic

Speculative Decoding

2 items across the graph — tagged with Speculative Decoding.

From the graph · 2

repo
dphnAI/aphrodite-engine

Large-scale LLM inference engine

→repo
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-DFlash

Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.io/aeon-7/aeon-vllm-ulti…

→

Related topics

speculative-decoding 2quantization 1llm 1rocm 1inference-engine 1intel 1abliteration 1dgx-spark 1tpu 1lora 1inferentia 1machine-learning 1
Search Speculative Decoding →All topics →