Roboflow

Gemini 2.5 Pro vs Mistral Large 4

Compare Gemini 2.5 Pro and Mistral Large 4 side-by-side. See how these vision models stack up in Object Detection, Open Prompt, Classification, OCR, and Image Captioning.

Compare Gemini 2.5 Pro vs Mistral Large 4 live

Run the same image across every model that supports a task and compare their outputs side-by-side.

Detect and compare bounding boxes across models on the same image.

Open Object Detection in the full playground
GoogleGemini 2.5 Pro
Run to compare this model.
MistralMistral Large 4
Run to compare this model.

Models in this comparison

Gemini 2.5 Pro vs Mistral Large 4 on Vision Evals

Gemini 2.5 Pro scores higher on 3 of the six Vision Evals tasks.

The widest gap is Object Detection, where Mistral Large 4 leads 59.3% to 33.7%.

Overall, Gemini 2.5 Pro averages 66.0% (#42 of 61) against 68.5% (#36 of 61) for Mistral Large 4.

Mistral Large 4 is cheaper ($0.0018 vs $0.0050 per sample), while Gemini 2.5 Pro is faster (6.1s vs 8.8s per sample).

Gemini 2.5 ProMistral Large 4

Gemini 2.5 Pro vs Mistral Large 4 Comparison Table

Evals updated October 8, 2026Pricing updated October 8, 2026

PropertyGemini 2.5 ProMistral Large 4
OrganizationGoogleMistral
Categoryclosedopen
Modalitymultimodalmultimodal
Release DateJun 2025Oct 2026
Context Window1.0M1.0M
ParametersUnknown1.05T total, 49B active
LicenseProprietaryCustom
Pricing per 1M tokens
Input $/1M$1.25$0.680
Output $/1M$10.00$2.09
Vision Tasks
CaptioningDemoDemo
Chart Question AnsweringSupportedSupported
ClassificationDemoDemo
Document Question AnsweringSupportedSupported
Image TaggingSupportedSupported
Multi-Label ClassificationSupportedSupported
Object DetectionDemoDemo
OCRDemoDemo
Vision LanguageSupportedSupported
Visual Question AnsweringDemoDemo
Phrase GroundingNot listedSupported
Model Features
Foundation VisionSupportedSupported
LLMs with Vision CapabilitiesSupportedSupported
Multimodal VisionSupportedSupported
Vision Evalsground-truth scores across 6 vision tasks, pooled at low effort
Overall
66.0%
68.5%
Avg cost / sample$0.0050$0.0018
Avg speed / sample6.11s8.78s
By task
Object Detection (low)
33.7%
$0.010
59.3%
±0.7, Mean of 3 runs, range 58.5 to 60.0
$0.0028
Object Detection (high)–
50.2%
±2.5, Mean of 3 runs, range 48.0 to 53.0
$0.023
Counting (low)
52.7%
$0.0012
54.5%
±0.7, Mean of 3 runs, range 54.0 to 55.4
$0.0010
Counting (high)–
63.1%
±2.0, Mean of 3 runs, range 60.8 to 64.9
$0.0094
Identification (low)
93.8%
$0.0012
85.4%
±3.1, Mean of 3 runs, range 81.3 to 87.5
$0.0009
Identification (high)–
85.4%
±1.6, Mean of 3 runs, range 84.4 to 87.5
$0.0044
OCR (low)
88.8%
$0.0047
92.7%
±0.8, Mean of 3 runs, range 91.8 to 93.3
$0.0016
OCR (high)–
87.1%
±4.4, Mean of 3 runs, range 81.6 to 90.4
$0.025
Data Extraction (low)
84.5%
$0.0013
80.1%
±1.0, Mean of 3 runs, range 79.4 to 81.4
$0.0010
Data Extraction (high)–
82.5%
±1.0, Mean of 3 runs, range 81.4 to 83.5
$0.0033
Reasoning (low)
42.4%
$0.0013
38.9%
±0.3, Mean of 3 runs, range 38.4 to 39.1
$0.0013
Reasoning (high)
62.3%
$0.011
57.6%
±2.0, Mean of 3 runs, range 55.6 to 59.6
$0.013

Gemini 2.5 Pro vs Mistral Large 4: Overview

Gemini 2.5 Pro

Gemini 2.5 Pro, released on June 17, 2025, is Google DeepMind’s most capable model in the Gemini 2.5 family, optimized for deep reasoning, coding, and complex multimodal tasks. It accepts text, images, audio, video, and PDFs as input and outputs text. The model supports 1 million input tokens with an output capacity of up to 65K tokens, enabling large-scale comprehension of datasets, codebases, and technical documents. Its training knowledge extends to January 2025.

Pro outperforms earlier Gemini 2.0 models across benchmarks, including agentic coding tasks where it achieved ~63.8% on SWE-Bench Verified. It supports structured outputs, function calling, code execution, search grounding, and URL context, making it well-suited for enterprise, STEM, and developer workflows. However, it does not currently support image or audio generation in its stable release, and its higher computational cost and latency make it less efficient than Flash or Flash-Lite. It is available via the Gemini API, Google AI Studio, and Vertex AI.

Mistral Large 4

Mistral Large 4, nicknamed Le Chonk, is a natively multimodal mixture-of-experts model from Mistral that accepts interleaved text and image input and produces text output. It uses a granular MoE design with roughly 1.05 trillion total parameters and 49 billion active per token, reported as 52 billion when embeddings and output layers are counted, paired with a 1.6 billion parameter vision encoder and a context window of one million tokens. The model is trained from scratch on about 3,800 NVIDIA Grace Blackwell GPUs in Mistral's European data centers and supports more than 160 languages. It behaves as a hybrid instruct and reasoning system, with a reasoning effort setting that selects between direct answers and longer deliberation, alongside function calling and structured output for agentic workflows.

Image understanding is a focus of this generation, covering documents, charts, technical drawings and natural scenes, and the model emits bounding box coordinates for visual grounding queries. Reported grounding results include 42 percent on Dense200 and 73 percent on the DIOR-RSVG remote sensing benchmark. Mistral describes agentic vision workflows in which the model zooms into gigapixel satellite imagery or engineering drawings to verify details, and reports coding results such as 62 percent on DeepSWE. Figures published at preview time are preliminary because the reinforcement learning phase is still in progress.

Frequently Asked Questions

On Roboflow's Vision Evals, Mistral Large 4 performed slightly better overall. The two split the six vision tasks 3 to 3, but Mistral Large 4 averages 68.5% (#36 of 61) against 66.0% (#42 of 61) for Gemini 2.5 Pro. These scores measure vision capabilities only; either model may perform differently on work outside this benchmark's tasks.

No. On the Vision Evals Object Detection benchmark at low effort, Mistral Large 4 leads with 59.3% against 33.7%. This is the widest gap between the two models across the benchmark's tasks.

Mistral Large 4 is cheaper to run. Across Roboflow's Vision Evals task mix it averaged $0.0018 per sample against $0.0050. Gemini 2.5 Pro is priced at $1.25 per 1M input tokens and $10.00 per 1M output; Mistral Large 4 is priced at $0.68 per 1M input tokens and $2.09 per 1M output. Actual costs depend on your image sizes, prompts, and output length.

Gemini 2.5 Pro is faster. Across Roboflow's Vision Evals it averaged 6.1s per inference against 8.8s. Latency varies with image size, prompt length, and provider load, so treat these as relative rather than guaranteed figures.

Yes. The comparison demo on this page runs both models on the same image side by side for object detection and open prompts in the free Roboflow Playground. You can try it instantly, and a free account unlocks unlimited runs.