Qwen3.7 Plus vs Qwen3.8 Flash

Qwen3.8-Flash is a multimodal mixture-of-experts model from the Qwen team at Alibaba, and the production counterpart of the open-weight Qwen3.8-Flash-Next preview that introduces the architecture intended for the Qwen4 family. The main model carries 125 billion parameters alongside a separate 51 billion parameter N-gram embedding table, while activating roughly 6 billion parameters per token. It accepts interleaved image and text input and returns text, handling 262,144 tokens of context natively with extension to 1,000,000 tokens using YaRN. The production configuration runs with the 1M context window by default and adds built-in tool support.

Four architectural changes separate it from earlier Qwen releases: hybrid attention that pairs Gated DeltaNet for history compression with Qwen Sparse Attention, which uses a lightweight indexer to select micro-blocks of context; a Gated Residual scheme; N-gram embeddings; and training with the Muon optimizer, refined around orthogonalization accuracy and the division of parameters between Muon and AdamW. Qwen reports training cost around one ninth that of Qwen3.7-Plus, with QSA attention kernels measured up to 7.6 times faster in prefill and 4.9 times faster in decode at 1M-token context. Reported scores include 58.7 on DeepSWE 1.1, 62.5 on SWE-bench Pro, 84.5 on AndroidWorld and 95.7 on MathVision.