DFlash
Block Diffusion for Flash Speculative Decoding
DFlash is an open-source speculative-decoding tool and draft-model framework for accelerating autoregressive LLM inference. It uses lightweight block-diffusion drafters to propose a block of tokens in parallel, then verifies them with the target LLM, with integrations or usage paths for SGLang, vLLM, Transformers, and MLX.

Recent stories
0 linked stories
No linked stories yet.