GLM 5.3 Flash vs MiMo V2.6 Flash

GLM-5.3-Flash is the first natively multimodal model in Z.ai's GLM-5 series, a mixture-of-experts transformer with roughly 320 billion total parameters and 18 billion activated per token. It routes each token through 8 of 288 experts across 45 language layers that interleave KDA linear attention with sparse multi-head latent attention, and pairs them with a 24-layer vision encoder that handles image and video input. The checkpoint declares a maximum context length of 1,048,576 tokens, ships in native FP8, and includes a multi-token prediction draft layer for speculative decoding. Z.ai reports that the hybrid attention design reduces attention computation by 3.01x and KV cache size by 4.44x relative to GLM-5.3.

The model starts from a newly trained base built on a 30 trillion token multimodal pre-training corpus and adopts Manifold-Constrained Hyper-Connections to improve scaling efficiency. Vision is integrated into the coding and agent loop, so the model can inspect interfaces, rendered output, and images while operating across code, browsers, and graphical user interfaces.

MiMo-V2.6-Flash is the efficiency-oriented checkpoint of Xiaomi's MiMo-V2.6 series, a natively omnimodal foundation model that accepts text, image, video, and audio in a single model and supports a one million token context window. The language backbone is a sparse mixture-of-experts transformer with roughly 309 billion total parameters and 15 billion activated per token, organized as 48 layers with 256 routed experts and top-8 routing. It uses a hybrid attention scheme that interleaves sliding window attention with global attention layers to cut key-value cache cost on long sequences, and pairs the backbone with a vision encoder, an audio encoder, and an audio tokenizer, plus a multi-token prediction module and a draft model for faster decoding.

Training emphasizes large scale reinforcement learning on verifiable, long-horizon tasks, with RL compute, environment diversity, and grader compute scaled together in a single mixed run.