Qwen3.8 27B vs Qwen3.8 Flash

Qwen3.8-27B is a dense vision-language model of roughly 27.78 billion parameters from Alibaba's Qwen team, built on the architectural foundation established by the Qwen3.5 generation. It takes interleaved text, image, and video input through an integrated vision encoder and produces text, covering document and chart understanding, visual question answering, front-end code generation from visual references, and agentic computer-use workflows. The decoder is a hybrid stack of 64 layers that repeats a pattern of three Gated DeltaNet linear-attention blocks, each followed by a feed-forward block, then one grouped-query full-attention block, so only a quarter of the layers maintain a conventional key-value cache. Native context length is 262,144 tokens.

Post-training targets long-horizon agentic work, and the model exposes per-request thinking control that lets callers switch reasoning traces on or off and choose a reasoning effort level. Multi-token prediction weights are trained alongside the main network for speculative decoding. Qwen reports improvements over Qwen3.6-27B on agentic and multimodal evaluations including Terminal-Bench 2.1, OSWorld-Verified, and SWE-bench Multimodal, with additional results on MathVision, CharXiv, and an internal Vision2Web suite.

Qwen3.8-Flash is a multimodal mixture-of-experts model from the Qwen team at Alibaba, and the production counterpart of the open-weight Qwen3.8-Flash-Next preview that introduces the architecture intended for the Qwen4 family. The main model carries 125 billion parameters alongside a separate 51 billion parameter N-gram embedding table, while activating roughly 6 billion parameters per token. It accepts interleaved image and text input and returns text, handling 262,144 tokens of context natively with extension to 1,000,000 tokens using YaRN. The production configuration runs with the 1M context window by default and adds built-in tool support.

Four architectural changes separate it from earlier Qwen releases: hybrid attention that pairs Gated DeltaNet for history compression with Qwen Sparse Attention, which uses a lightweight indexer to select micro-blocks of context; a Gated Residual scheme; N-gram embeddings; and training with the Muon optimizer, refined around orthogonalization accuracy and the division of parameters between Muon and AdamW. Qwen reports training cost around one ninth that of Qwen3.7-Plus, with QSA attention kernels measured up to 7.6 times faster in prefill and 4.9 times faster in decode at 1M-token context. Reported scores include 58.7 on DeepSWE 1.1, 62.5 on SWE-bench Pro, 84.5 on AndroidWorld and 95.7 on MathVision.