Kimi K3 vs Muse Spark 1.1

Kimi K3 is a sparse Mixture-of-Experts large language model developed by Moonshot AI, with 2.8 trillion total parameters and a 1-million-token context window. The model activates 16 out of 896 experts per token using the Stable LatentMoE framework, and is built on two architectural innovations: Kimi Delta Attention (KDA), a hybrid linear attention mechanism that enables up to 6.3x faster decoding in long-context settings, and Attention Residuals (AttnRes), which selectively retrieves representations across model depth and delivers roughly 25% higher training efficiency. Together with refined training and data recipes, these structural advances yield approximately 2.5x better overall scaling efficiency compared to its predecessor Kimi K2. The model applies quantization-aware training from the supervised fine-tuning stage onward, using MXFP4 weights with MXFP8 activations for hardware compatibility. Thinking mode is always enabled at launch, with reasoning effort configurable via the reasoning_effort field.

Kimi K3 supports native visual understanding alongside text, accepting image inputs for tasks that combine software engineering and visual reasoning. It targets long-horizon coding, knowledge work, and agentic workflows, and ships in two variants: K3 Max for general chat and agent tasks, and K3 Swarm Max for large-scale parallel processing across many coordinated sub-agents. The model is compatible with the OpenAI SDK via an OpenAI-compatible API. Full model weights are scheduled for release by July 27, 2026 under a Modified MIT license, following the open-weight pattern established by the Kimi K2 model family. A technical report with full architecture, training, and evaluation details is expected to accompany the weights release.

Muse Spark 1.1 is a natively multimodal reasoning model from Meta Superintelligence Labs, released on July 9, 2026, as a significant upgrade to the original Muse Spark. The model accepts text, image, video, PDF, and audio as input and produces text output. It operates with a 1-million-token context window (1,048,576 tokens per the Meta Model API documentation) and is designed specifically for agentic tasks that require planning, tool use, computer use, and multi-agent orchestration. The model runs in a "Thinking" mode, where adjustable reasoning effort is applied before generating a response. It can function both as a main agent gathering context, forming plans, and delegating to parallel subagents and as a subagent that adheres to assigned tasks and escalates when needed. It is trained to decide autonomously when to write automation scripts versus interact directly with a user interface.

Muse Spark 1.1 supports a range of multimodal capabilities including visual perception, image and video captioning, visual-to-code generation, and document analysis. The model was evaluated under Meta's Advanced AI Scaling Framework across frontier risk categories including chemical and biological threats, cybersecurity, and loss-of-control scenarios. Parameter count, architecture details, and training data composition are not publicly disclosed. The model is proprietary and closed-weight, accessible to consumers through the Meta AI app and to developers via the Meta Model API, which launched in public preview alongside this release.