Roboflow
Google

Google: Gemma 4 31B

Gemma 4 31B Overview

Gemma 4 31B is the largest dense model in Google's Gemma 4 family, built from the same research as Gemini 3 and released as open weights under the Apache 2.0 license. It supports a 256K token context window with text and image input, configurable thinking mode for step-by-step reasoning, and multilingual support across 140+ languages. The unquantized model fits on a single 80GB GPU.

For vision tasks, Gemma 4 31B supports image understanding with variable aspect ratios and resolutions, and can output structured bounding boxes for UI element detection, making it useful for document parsing and UI understanding. Compared to Gemma 3, it delivers stronger reasoning and multimodal performance. It is part of a four-size family alongside the 26B A4B MoE variant and two on-device models (E2B, E4B), with the 31B dense variant optimized for output quality and fine-tuning over inference speed.

Gemma 4 31B Interactive Demo

Gemma 4 31B Details & Performance

Details

Resources

Vision Tasks

CaptioningChart Question AnsweringClassificationDocument Question AnsweringImage TaggingMulti-Label ClassificationOCRObject DetectionVision LanguageVisual Question Answering

Features

Foundation VisionLLMs with Vision CapabilitiesMultimodal Vision

Usage

Past 30 Days

Performance

Avg. Latency

Arena Rankings

Gemma 4 31B Vision Evals

Gemma 4 31B has not yet been evaluated on the current benchmark. The results below are from the legacy version of Vision Evals, our previous benchmark. See the current Vision Evals

Visual Understanding

77 models · 67 tasks
HighestLowest
This model#30 of 7767.16% pass rate · better than 55%
Score67.16%pass rate across 67 tasks
Speed34.59savg response per task
Cost$0.0001 / task$0.100 in · $0.340 out / 1M
Tokens467 / task294 in · 169 out
Score key:≥75%40–74%<40%
CategoryPassedScore
Document Understanding8 / 9
88.9%
Defect Detection12 / 15
80%
Spatial Understanding14 / 19
73.7%
Object Understanding10 / 14
71.4%
Object Counting1 / 10
10%
HighestLowest
This model#13 of 5884.72% pass rate · better than 78%
Score84.72%pass rate across 229 tasks
Speed11.82savg response per task
Cost$0.0001 / task$0.100 in · $0.340 out / 1M
Tokens423 / task290 in · 131 out
Score key:≥75%40–74%<40%
CategoryPassedScore
License Plate Recognition28 / 30
93.3%
Focused Scene OCR86 / 99
86.9%
VQA & Extraction51 / 60
85%
Text Recognition24 / 30
80%
Handwritten Math5 / 10
50%

Scores based on a single evaluation run · Methodology

View all legacy Vision Evals results →

Gemma 4 31B Pricing

Gemma 4 31B costs $0.100 per 1M input tokens and $0.340 per 1M output tokens.

Input$0.100 / 1M tokens
Output$0.340 / 1M tokens
Cached input$0.100 / 1M tokens

Pricing updated Aug 23, 2026

Price vs. performance

Estimated cost per task vs. Visual Understanding score, for this model and others ranked near it. Upper-left is the sweet spot (high quality, low cost). Based on Vision Evals (legacy) results.

11 of 11 models plotted

ModelScoreMedian tokensEst. cost / taskCompare
GoogleGemini 3.1 Flash-Lite68.7%1.1K$0.0003Compare
GoogleGemma 4 26B A4B68.7%531$0.0001Compare
QwenQwen3.6 Plus68.7%1.6K$0.0005Compare
AnthropicClaude Opus 4.867.2%2.2K$0.012Compare
AnthropicClaude Opus 4.767.2%2.6K$0.015Compare
GoogleGemma 4 31B(this model)67.2%467$0.0001
AnthropicClaude Opus 4.6 64.2%2.3K$0.014Compare
OpenAIGPT-5.4 Nano62.7%1.8K$0.0004Compare
MetaLlama 4 Maverick59.7%2.4K$0.0005Compare
AnthropicClaude Sonnet 4.559.7%2.3K$0.0092Compare
AnthropicClaude Opus 4.159.7%2.1K$0.040Compare

Alternatives to Gemma 4 31B

Other models worth comparing for similar use cases.

Google
Gemma 4 26B A4B
Gemma 4 26B A4B is the Mixture-of-Experts variant in Google's Gemma 4 family, with 25.2B total parameters but only 3.8B active per token. Built from the same Gemini 3 research as the 31B dense sibling and released as open weights under the Apache 2.0 license, it supports a 256K token context window with text and image input and configurable thinking mode. The "A4B" in the name refers to its approximately 4B active parameters. The MoE design makes it significantly faster at inference than the dense 31B, running nearly as fast as a 4B-parameter model while delivering roughly 97% of the dense model's quality.For vision tasks, the 26B A4B shares the same multimodal capabilities as the 31B image understanding with variable aspect ratios and resolutions, and structured bounding box output for UI element detection. The tradeoff versus the 31B dense model is a small quality reduction in exchange for much faster inference and lower hardware requirements, fitting in 18GB of VRAM at 4-bit quantization. It ranked #6 among open models on the Arena AI text leaderboard at launch.
Google
Gemma 4 12B
Gemma 4 12B is an open-weight multimodal model from Google in the Gemma 4 family. It is intended for text and image understanding tasks such as visual question answering, OCR, captioning, and document understanding, with a smaller parameter footprint than the larger Gemma 4 variants.This entry is connected to Roboflow Playground vision evals for comparison. No runnable Playground workflow is configured yet, so the model page is used for discovery and benchmark context rather than direct hosted inference.
Qwen
Qwen3.6 35B A3B
Qwen3.6-35B-A3B is a sparse Mixture-of-Experts (MoE) multimodal language model developed by the Qwen team at Alibaba Group. It carries 35 billion total parameters but activates only approximately 3 billion per forward pass via a learned routing mechanism, giving it the representational capacity of a large dense model at a fraction of the inference compute. The model is natively multimodal, processing images, documents, and video alongside text as a core architectural capability rather than an add-on. It supports a native context window of 262,144 tokens, extensible up to 1,010,000 tokens via YaRN. A key design feature is the unified thinking/non-thinking mode framework: users can switch between deliberate chain-of-thought reasoning and fast direct responses within a single model, and a "thinking preservation" option retains reasoning context across multi-turn agentic workflows to reduce redundant computation.The model is specifically optimized for agentic coding tasks, including repository-level reasoning, frontend workflow generation, multi-step tool use, and MCP (Model Context Protocol) integration. On SWE-bench Verified it scores 73.4%, on Terminal-Bench 2.0 it scores 51.5%, and on MCPMark it scores 37.0%. For vision-language tasks it achieves 92.0 on RefCOCO, 89.9 on OmniDocBench 1.5, and 83.7 on VideoMMMU. The model also supports Multi-Token Prediction (MTP) for speculative decoding. All Qwen3.6 open-weight models are released under the Apache 2.0 license.
Qwen
Qwen3.5 27B
Qwen3.5-27B is a multimodal dense hybrid model developed by Alibaba Cloud’s Qwen team and released in February 2026 as a high-precision entry in the Qwen3.5 "Medium" series. Unlike its Mixture-of-Experts (MoE) siblings, the 27B model utilizes a dense architecture combining Gated Delta Networks with a feed-forward structure, activating its full parameter suite for every inference to maximize reliability. This design provides the highest instruction-following and coding accuracy in its class, with a notable IFEval score of 95.0. The model features a native 262K-token context window, extensible to 1M tokens via YaRN (RoPE scaling), and is released under the Apache-2.0 license.Optimized for agentic workflows, Qwen3.5-27B employs an early-fusion architecture that treats visual and textual data as a unified stream for deep cross-modal reasoning. This unified approach allows the model to excel in technical analysis and software engineering, matching GPT-5-mini with a 72.4% score on SWE-bench Verified. While the larger MoE variants in the family lead in raw knowledge benchmarks, the 27B model offers a stable and high-density alternative for structured data extraction and spatial perception, contributing to the Qwen3.5 family’s generational leap in OCR accuracy over the previous Qwen3-VL series.
Mistral
Mistral Small 3.1 24B
Mistral Small 3.1 24B, released on March 17, 2025, is an open-weight multimodal model from Mistral AI, distributed under the Apache-2.0 license. With around 24B parameters and a 128K token context window, it is available in both base and instruction-tuned (“Instruct”) variants. The model introduces vision support alongside text, enabling tasks like multimodal reasoning, captioning, and image-based Q&A.It is multilingual, supporting many languages, and is optimized for fast responses, function calling, structured dialogue, and long-context reasoning. Despite its size, the model can be run locally in quantized formats, fitting on machines with ~32GB RAM, making it accessible to developers outside large cloud setups. However, the output length is smaller than the 128K input window, meaning long generations may require chaining. In addition, using full vision features or the maximum context window significantly increases compute costs, and performance on highly complex reasoning or enterprise-scale tasks still trails larger proprietary frontier models.

Deploy Gemma 4 31B with an API

Gemma 4 31B runs as a hosted REST endpoint through Roboflow Workflows. Pick a task, then hand the prompt to your coding agent or copy the code. Deploying the workflow into a free Roboflow workspace replaces the your-workspace and YOUR_API_KEY placeholders with your own.

Connect your agent to Roboflow (once)

Add the Roboflow MCP server

claude mcp add --transport http roboflow https://mcp.roboflow.com/mcp

Run /mcp and authorize Roboflow in your browser when the OAuth flow opens.

Start a new Claude Code session so the MCP loads, then paste the prompt below (it works the same in any agent).

Deploy this workflow to your Roboflow workspace to use it.

Integrate the Roboflow "Gemma 4 31B" workflow into my app.

- Endpoint: POST https://serverless.roboflow.com/<your-workspace>/workflows/gemma-4-31b-captioning
- Auth: send my Roboflow API key as `api_key` in the request body, read from the ROBOFLOW_API_KEY env var (never hardcode).
- Body: { "api_key": ..., "inputs": { `image`: { type: "url" | "base64", value } } }.
- Billing: this workflow needs no provider API key — inference runs on my Roboflow credits. A BYO provider key can be added to the model step in the Roboflow workflow editor later.

With the Roboflow MCP connected, call `workflows_get` on "gemma-4-31b-captioning" to read the exact input schema (the source of truth), then `workflows_run` on a sample image to confirm the output shape before writing code (the MCP is authenticated, so this needs no key). Without the MCP, use the contract above.

Before running the app, set up these keys so it does not error at runtime:
- `ROBOFLOW_API_KEY` (sent as `api_key`) from https://app.roboflow.com/settings/api
Create a .gitignore'd .env with these variables, using placeholder values for any I haven't given you. Then pause and tell me directly, in your reply: the full path to the .env file, exactly which keys I need to paste in, and the link to get each one. Wait for me to confirm I've added them before you run anything. Do not run the app until I confirm.

Then add the integration to my codebase: match my project's language, framework, and conventions; read every key from environment variables (never hardcode); add basic error handling; and include a small runnable example. If you can't tell what language my project uses, ask me.
Installpip install inference-sdk

Deploy this workflow to your Roboflow workspace to use it.

# Inference runs on your Roboflow credits — no provider API key needed. To bill your own provider account instead, add an api_key to the model step in the Roboflow workflow editor.
# 1. Import the library
from inference_sdk import InferenceHTTPClient

# 2. Connect to your workflow
client = InferenceHTTPClient(
  api_url="https://serverless.roboflow.com",
  api_key="YOUR_API_KEY"
)

# 3. Run your workflow on an image
result = client.run_workflow(
  workspace_name="your-workspace",
  workflow_id="gemma-4-31b-captioning",
  images={
    "image": "YOUR_IMAGE.jpg"  # Path to your image file
  },
  use_cache=True  # cache workflow definition for 15 minutes
)

# 4. Get your results
print(result)

Deploy this workflow to your Roboflow workspace to use it.

// Inference runs on your Roboflow credits — no provider API key needed. To bill your own provider account instead, add an api_key to the model step in the Roboflow workflow editor.
const response = await fetch('https://serverless.roboflow.com/your-workspace/workflows/gemma-4-31b-captioning', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({
    api_key: 'YOUR_API_KEY',
    inputs: {
      "image": {"type": "url", "value": "IMAGE_URL"}
    }
  })
});

const result = await response.json();
console.log(result);

Deploy this workflow to your Roboflow workspace to use it.

# Inference runs on your Roboflow credits — no provider API key needed. To bill your own provider account instead, add an api_key to the model step in the Roboflow workflow editor.
curl --location 'https://serverless.roboflow.com/your-workspace/workflows/gemma-4-31b-captioning' \
--header 'Content-Type: application/json' \
--data '{
  "api_key": "YOUR_API_KEY",
  "inputs": {
    "image": {"type": "url", "value": "IMAGE_URL"}
  }
}'

Gemma 4 31B License

Apache-2.0 · Permissive license

Gemma 4 31B is released under Apache-2.0, a permissive license. The Gemma 4 31B license lets you run, fine-tune, and redistribute the model in commercial products with no obligation to open-source related code changes, so no separate commercial license is required.

Commercial use
Permitted. Because Apache-2.0 is permissive, Gemma 4 31B can ship inside paid products and internal systems with no commercial license and no revenue threshold.
Modification
Permitted. Fine-tuning, quantizing, and distilling are all allowed, and your code changes can stay closed. Files you change must be marked as changed.
Redistribution
Permitted with attribution. Ship the Apache-2.0 license text and any NOTICE file alongside the weights or derived code.

Apache-2.0 grants an express patent license that terminates if you bring a patent claim over the work, and it disclaims warranties. Validate Gemma 4 31B on your own data before you depend on it in production.

Read the full Apache 2.0 license ↗

Do I need a commercial license for Gemma 4 31B?

This is the straightforward case: a permissive license is the best technical solution and you are free to deploy Gemma 4 31B commercially without open-sourcing your own code.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under the Apache License 2.0, a permissive open-source license that allows commercial use, modification, distribution, and patent use.

Yes. Under the terms of the Apache 2.0 license, you can freely use this model for commercial purposes, including in proprietary products. You must retain the copyright notice and disclaimers when redistributing.

License information is provided as a guide and is not legal advice.

Frequently Asked Questions About Gemma 4 31B Vision

Yes. Gemma 4 31B accepts image input, and on Roboflow's previous vision benchmark it passed 67.2% of visual understanding tasks (#30 of 77) and scored 84.7% on OCR. You can test it on your own image in the demo above.

Gemma 4 31B has not yet been evaluated on Roboflow's current Vision Evals. The results on this page are from the previous benchmark.

Yes. The demo on this page runs Gemma 4 31B in the free Roboflow Playground: upload an image and see results in seconds. A free account unlocks unlimited runs.