MiMo V2.6 Flash vs Qwen3.8 27B

MiMo-V2.6-Flash is the efficiency-oriented checkpoint of Xiaomi's MiMo-V2.6 series, a natively omnimodal foundation model that accepts text, image, video, and audio in a single model and supports a one million token context window. The language backbone is a sparse mixture-of-experts transformer with roughly 309 billion total parameters and 15 billion activated per token, organized as 48 layers with 256 routed experts and top-8 routing. It uses a hybrid attention scheme that interleaves sliding window attention with global attention layers to cut key-value cache cost on long sequences, and pairs the backbone with a vision encoder, an audio encoder, and an audio tokenizer, plus a multi-token prediction module and a draft model for faster decoding.

Training emphasizes large scale reinforcement learning on verifiable, long-horizon tasks, with RL compute, environment diversity, and grader compute scaled together in a single mixed run. Xiaomi reports gains during RL on SWE-bench Verified, Terminal Bench, a cybersecurity benchmark, and an internal visual coding benchmark, reflecting a focus on agentic coding, computer use, and multimodal document and screen understanding rather than single turn chat.

Qwen3.8-27B is a dense vision-language model of roughly 27.78 billion parameters from Alibaba's Qwen team, built on the architectural foundation established by the Qwen3.5 generation. It takes interleaved text, image, and video input through an integrated vision encoder and produces text, covering document and chart understanding, visual question answering, front-end code generation from visual references, and agentic computer-use workflows. The decoder is a hybrid stack of 64 layers that repeats a pattern of three Gated DeltaNet linear-attention blocks, each followed by a feed-forward block, then one grouped-query full-attention block, so only a quarter of the layers maintain a conventional key-value cache. Native context length is 262,144 tokens.

Post-training targets long-horizon agentic work, and the model exposes per-request thinking control that lets callers switch reasoning traces on or off and choose a reasoning effort level. Multi-token prediction weights are trained alongside the main network for speculative decoding. Qwen reports improvements over Qwen3.6-27B on agentic and multimodal evaluations including Terminal-Bench 2.1, OSWorld-Verified, and SWE-bench Multimodal, with additional results on MathVision, CharXiv, and an internal Vision2Web suite.