Roboflow

Gemini 2.5 Pro vs Mistral Large 4

Gemini 2.5 Pro and Mistral Large 4 score 57.6% vs 56.8% averaged across five Vision Evals tasks (#50 and #51 of 73 models), so they are effectively tied.

  • Gemini 2.5 Pro wins 3 of the 5 tasks, but the widest gap is object detection, where Mistral Large 4 leads 59.3% vs 33.7%.
  • Mistral Large 4 is about half the cost: $0.0033 vs $0.0051 overall average cost per sample.
  • Gemini 2.5 Pro is faster: 6.8s vs 31.2s per sample.

Compare Gemini 2.5 Pro vs Mistral Large 4 live

Run the same image across every model that supports a task and compare their outputs side-by-side.

Detect and compare bounding boxes across models on the same image.

Open Object Detection in the full playground
GoogleGemini 2.5 Pro
Run to compare this model.
MistralMistral Large 4
Run to compare this model.

Gemini 2.5 Pro vs Mistral Large 4 on Vision Evals

Score by taskGemini 2.5 ProMistral Large 4
Object Detection
33.7
59.3
OCR
65.2
46.1
Identification
93.8
85.4
Reasoning
42.4
38.9
Counting
52.7
54.5

Roboflow Vision Evals. Full breakdown below.

Gemini 2.5 Pro vs Mistral Large 4 Comparison Table

Evals updated November 19, 2026Pricing updated November 20, 2026

PropertyGemini 2.5 ProMistral Large 4
OrganizationGoogleMistral
Categoryclosedopen
Modalitymultimodalmultimodal
Release DateJun 2025Oct 2026
Context Window1.0M1.0M
ParametersUnknown1.05T total, 49B active
LicenseProprietaryCustom
Commercial usecommercial use per vendor termsSee license terms
Pricing per 1M tokens
Input $/1M$1.25$0.700
Output $/1M$10.00$2.10
Vision Tasks
Phrase GroundingNot listedSupported
Both support 10 more tasks
Model Features
Both support 3 more features
Vision Evalsground-truth scores across 5 vision tasks, pooled at low effort
Overall
57.6%
56.8%
Avg cost / sample$0.0051$0.0033
Avg speed / sample6.83s31.23s
By task
Object Detection (low)
33.7%
$0.010
59.3%
±0.7, Mean of 3 runs, range 58.5 to 60.0
$0.0028
Object Detection (high)–
50.2%
±2.5, Mean of 3 runs, range 48.0 to 53.0
$0.023
Counting (low)
52.7%
$0.0012
54.5%
±0.7, Mean of 3 runs, range 54.0 to 55.4
$0.0011
Counting (high)–
63.1%
±2.0, Mean of 3 runs, range 60.8 to 64.9
$0.0095
Identification (low)
93.8%
$0.0012
85.4%
±3.1, Mean of 3 runs, range 81.3 to 87.5
$0.0009
Identification (high)–
85.4%
±1.6, Mean of 3 runs, range 84.4 to 87.5
$0.0044
OCR (low)
65.2%
$0.0046
46.1%
$0.0044
by category
Single value
60.9%
Transcription
86.8%
Structured JSON
76.3%
Text localization
35.9%
Single value
33.5%
Transcription
68.9%
Structured JSON
71.7%
Text localization
0.0%
OCR (high)
64.6%
$0.025
54.5%
$0.021
by category
Single value
63.0%
Transcription
87.3%
Structured JSON
78.3%
Text localization
20.6%
Single value
38.3%
Transcription
75.3%
Structured JSON
76.4%
Text localization
28.8%
Reasoning (low)
42.4%
$0.0013
38.9%
±0.3, Mean of 3 runs, range 38.4 to 39.1
$0.0013
Reasoning (high)
62.3%
$0.011
57.6%
±2.0, Mean of 3 runs, range 55.6 to 59.6
$0.013

Gemini 2.5 Pro vs Mistral Large 4: Overview

Gemini 2.5 Pro

Gemini 2.5 Pro, released on June 17, 2025, is Google DeepMind’s most capable model in the Gemini 2.5 family, optimized for deep reasoning, coding, and complex multimodal tasks. It accepts text, images, audio, video, and PDFs as input and outputs text. The model supports 1 million input tokens with an output capacity of up to 65K tokens, enabling large-scale comprehension of datasets, codebases, and technical documents. Its training knowledge extends to January 2025.

It supports structured outputs, function calling, code execution, search grounding, and URL context, making it well-suited for enterprise, STEM, and developer workflows. However, it does not currently support image or audio generation in its stable release, and its higher computational cost and latency make it less efficient than Flash or Flash-Lite. It is available via the Gemini API, Google AI Studio, and Vertex AI.

Mistral Large 4

Mistral Large 4, nicknamed Le Chonk, is a natively multimodal mixture-of-experts model from Mistral that accepts interleaved text and image input and produces text output. It uses a granular MoE design with roughly 1.05 trillion total parameters and 49 billion active per token, reported as 52 billion when embeddings and output layers are counted, paired with a 1.6 billion parameter vision encoder and a context window of one million tokens. The model is trained from scratch on about 3,800 NVIDIA Grace Blackwell GPUs in Mistral's European data centers and supports more than 160 languages. It behaves as a hybrid instruct and reasoning system, with a reasoning effort setting that selects between direct answers and longer deliberation, alongside function calling and structured output for agentic workflows.

Image understanding is a focus of this generation, covering documents, charts, technical drawings and natural scenes, and the model emits bounding box coordinates for visual grounding queries. Reported grounding results include 42 percent on Dense200 and 73 percent on the DIOR-RSVG remote sensing benchmark. Mistral describes agentic vision workflows in which the model zooms into gigapixel satellite imagery or engineering drawings to verify details, and reports coding results such as 62 percent on DeepSWE. Figures published at preview time are preliminary because the reinforcement learning phase is still in progress.

Frequently Asked Questions

On Roboflow's Vision Evals, Gemini 2.5 Pro performed better. It scores higher on 3 of the five vision tasks and averages 57.6% (#50 of 73) against 56.8% (#51 of 73) for Mistral Large 4. These scores measure vision capabilities only; either model may perform differently on work outside this benchmark's tasks.

No. On the Vision Evals Object Detection benchmark at low effort, Mistral Large 4 leads with 59.3% against 33.7%. This is the widest gap between the two models across the benchmark's tasks.

Mistral Large 4 is cheaper to run. Across Roboflow's Vision Evals task mix it averaged $0.0033 per sample against $0.0051. Gemini 2.5 Pro is priced at $1.25 per 1M input tokens and $10.00 per 1M output; Mistral Large 4 is priced at $0.70 per 1M input tokens and $2.10 per 1M output. Actual costs depend on your image sizes, prompts, and output length.

Gemini 2.5 Pro is faster. Across Roboflow's Vision Evals it averaged 6.8s per inference against 31.2s. Latency varies with image size, prompt length, and provider load, so treat these as relative rather than guaranteed figures.

Yes. The comparison demo on this page runs both models on the same image side by side for object detection and open prompts in the free Roboflow Playground. You can try it instantly, and a free account gives you more runs with free Roboflow credits.