#AI acceleration
github.com · ⭐️ 9/10 · 2026-06-28
DeepSeek and Peking University released DSpark, a speculative decoding framework that accelerates LLM inference by 60% to 85% without compromising output quality. The corresponding models are already available on Hugging Face. This open research approach contrasts with the secretive practices of major US AI labs, highlighting DeepSeek's commitment to transparency and innovation. It enables faster, cheaper LLM inference for a wide range of applications. DSpark introduces semi-autoregressive candidate generation and confidence-scheduled verification to dynamically optimize speculation length and acceptance rate. The framework has been deployed in DeepSeek-V4-Flash and V4-Pro preview, with the full DeepSpec codebase open-sourced on GitHub.