Qwen3.6 27B vs Qwen3.6 35B A3B

Qwen3.6-27B is a dense 27-billion-parameter multimodal language model developed by Alibaba's Qwen team and released on April 22, 2026. It combines a causal language model with an integrated vision encoder, supporting text, image, and video inputs natively. The architecture employs a hybrid attention design that interleaves Gated DeltaNet linear attention blocks with standard Gated Attention layers across 64 transformer layers with a hidden dimension of 5,120. Unlike Mixture-of-Experts variants in the Qwen3.6 family, all 27 billion parameters are active on every inference pass, simplifying deployment and quantization. The model supports a native context window of 262,144 tokens, extensible to approximately 1,010,000 tokens via YaRN scaling. It is released under the Apache 2.0 license with open weights available on Hugging Face and ModelScope.

The model introduces two notable capabilities relative to prior Qwen releases: enhanced agentic coding support covering frontend workflows and repository-level reasoning, and a Thinking Preservation mechanism that retains chain-of-thought reasoning context across multi-turn conversation history to reduce redundant token generation in iterative agent sessions. It supports both a thinking mode for multi-step reasoning and a non-thinking mode for faster responses within a single model. Vision capabilities include chart understanding (CharXiv RQ: 78.4), OCR (CC-OCR: 81.2), and video understanding (VideoMME with subtitles: 87.7).

Qwen3.6-35B-A3B is a sparse Mixture-of-Experts (MoE) multimodal language model developed by the Qwen team at Alibaba Group. It carries 35 billion total parameters but activates only approximately 3 billion per forward pass via a learned routing mechanism, giving it the representational capacity of a large dense model at a fraction of the inference compute. The model is natively multimodal, processing images, documents, and video alongside text as a core architectural capability rather than an add-on. It supports a native context window of 262,144 tokens, extensible up to 1,010,000 tokens via YaRN. A key design feature is the unified thinking/non-thinking mode framework: users can switch between deliberate chain-of-thought reasoning and fast direct responses within a single model, and a "thinking preservation" option retains reasoning context across multi-turn agentic workflows to reduce redundant computation.

The model is specifically optimized for agentic coding tasks, including repository-level reasoning, frontend workflow generation, multi-step tool use, and MCP (Model Context Protocol) integration. For vision-language tasks it achieves 92.0 on RefCOCO, 89.9 on OmniDocBench 1.5, and 83.7 on VideoMMMU. The model also supports Multi-Token Prediction (MTP) for speculative decoding. All Qwen3.6 open-weight models are released under the Apache 2.0 license.