<![CDATA[EXL3]]>Seems to be objectively one of the BEST quantization formats as of now, with the added benefit that the inference engines run much better than llama.cpp (GGUF) for CPU offload.

For example, numbers on Qwen3.8-Flash-Next-exl3:

image.jpeg

image.jpeg

image.jpeg

No AI used
]]>https://airigs.net/topic/8/exl3RSS for NodeMon, 02 Nov 2026 07:04:02 GMTMon, 28 Sep 2026 16:42:34 GMT60