<![CDATA[Drafters are important]]>So, drafters pretty much give (almost) free token generation output, in exchange for a little bit of VRAM (and some very minor prompt processing speed).

There's 3 'popular' architectures for drafters ATM:

  1. MTP, the most used by far, usually comes with the weights if the model supports it, lowest VRAM usage.
  2. DSpark, deepseek's current format, performs better but uses more VRAM.
  3. DFlash2, by far the best option, outstanding performance.

Rough baseline numbers:
image.jpeg

No AI used
]]>https://airigs.net/topic/40/drafters-are-importantRSS for NodeMon, 02 Nov 2026 05:40:54 GMTSat, 31 Oct 2026 23:56:56 GMT60