So, drafters pretty much give (almost) free token generation output, in exchange for a little bit of VRAM (and some very minor prompt processing speed).
There's 3 'popular' architectures for drafters ATM:
MTP, the most used by far, usually comes with the weights if the model supports it, lowest VRAM usage.
DSpark, deepseek's current format, performs better but uses more VRAM.
DFlash2, by far the best option, outstanding performance.
Rough baseline numbers:
[image: image.jpeg]
