Gemma 3 27B vs Muse Spark 1.1

Gemma 3 27B, announced on March 12, 2025, is the largest open-weight model in Google DeepMind’s Gemma 3 family. With around 27 billion parameters, it is multimodal—accepting both text and images as input and producing text outputs. It supports a 128,000-token context window and typically generates up to ~8,192 tokens, enabling it to process multi-page documents, extended conversations, or large batches of images in a single prompt.

The model is instruction-tuned in its “-it” variants for chat, reasoning, and summarization use cases, and it supports structured outputs and function calling. It is multilingual, covering over 140 languages. Deployment is flexible: the full BF16 model requires ~46 GB of VRAM, but quantization-aware training (QAT) versions in 8-bit or 4-bit reduce the footprint significantly, allowing more accessible use outside large-scale clusters. While it delivers stronger reasoning and multimodal performance than smaller Gemma models, it remains lighter and more open than proprietary systems, making it well-suited for research, development, and fine-tuned applications.

Muse Spark 1.1 is a natively multimodal reasoning model from Meta Superintelligence Labs, released on July 9, 2026, as a significant upgrade to the original Muse Spark. The model accepts text, image, video, PDF, and audio as input and produces text output. It operates with a 1-million-token context window (1,048,576 tokens per the Meta Model API documentation) and is designed specifically for agentic tasks that require planning, tool use, computer use, and multi-agent orchestration. The model runs in a "Thinking" mode, where adjustable reasoning effort is applied before generating a response. It can function both as a main agent gathering context, forming plans, and delegating to parallel subagents and as a subagent that adheres to assigned tasks and escalates when needed. It is trained to decide autonomously when to write automation scripts versus interact directly with a user interface.

Muse Spark 1.1 supports a range of multimodal capabilities including visual perception, image and video captioning, visual-to-code generation, and document analysis. The model was evaluated under Meta's Advanced AI Scaling Framework across frontier risk categories including chemical and biological threats, cybersecurity, and loss-of-control scenarios. Parameter count, architecture details, and training data composition are not publicly disclosed. The model is proprietary and closed-weight, accessible to consumers through the Meta AI app and to developers via the Meta Model API, which launched in public preview alongside this release.