Gemini 2.5 Pro vs Mistral Large 4
Gemini 2.5 Pro and Mistral Large 4 score 57.6% vs 56.8% averaged across five Vision Evals tasks (#50 and #51 of 73 models), so they are effectively tied.
- Gemini 2.5 Pro wins 3 of the 5 tasks, but the widest gap is object detection, where Mistral Large 4 leads 59.3% vs 33.7%.
- Mistral Large 4 is about half the cost: $0.0033 vs $0.0051 overall average cost per sample.
- Gemini 2.5 Pro is faster: 6.8s vs 31.2s per sample.
Roboflow Vision Evals. Full breakdown below.
Compare Gemini 2.5 Pro vs Mistral Large 4 live
Run the same image across every model that supports a task and compare their outputs side-by-side.
Detect and compare bounding boxes across models on the same image.
Upload an image
Drag and drop an image here, or click to browse
Gemini 2.5 Pro vs Mistral Large 4 on Vision Evals
Roboflow Vision Evals. Full breakdown below.
Gemini 2.5 Pro vs Mistral Large 4 Comparison Table
Evals updated November 19, 2026Pricing updated November 20, 2026
| Property | Gemini 2.5 Pro | Mistral Large 4 |
|---|---|---|
| Organization | Mistral | |
| Category | closed | open |
| Modality | multimodal | multimodal |
| Release Date | Jun 2025 | Oct 2026 |
| Context Window | 1.0M | 1.0M |
| Parameters | Unknown | 1.05T total, 49B active |
| License | Proprietary | Custom |
| Commercial use | commercial use per vendor terms | See license terms |
| Pricing per 1M tokens | ||
| Input $/1M | $1.25 | $0.700 |
| Output $/1M | $10.00 | $2.10 |
| Vision Tasks | ||
| Phrase Grounding | Not listed | Supported |
| Model Features | ||
Both support 3 more features | ||
Vision Evalsground-truth scores across 5 vision tasks, pooled at low effort | ||
| Overall | 57.6% | 56.8% |
| Avg cost / sample | $0.0051 | $0.0033 |
| Avg speed / sample | 6.83s | 31.23s |
| By task | ||
| Object Detection (low) | 33.7% | 59.3% ±0.7, Mean of 3 runs, range 58.5 to 60.0 |
| Object Detection (high) | – | 50.2% ±2.5, Mean of 3 runs, range 48.0 to 53.0 |
| Counting (low) | 52.7% | 54.5% ±0.7, Mean of 3 runs, range 54.0 to 55.4 |
| Counting (high) | – | 63.1% ±2.0, Mean of 3 runs, range 60.8 to 64.9 |
| Identification (low) | 93.8% | 85.4% ±3.1, Mean of 3 runs, range 81.3 to 87.5 |
| Identification (high) | – | 85.4% ±1.6, Mean of 3 runs, range 84.4 to 87.5 |
| OCR (low) | 65.2% | 46.1% |
| by category |
|
|
| OCR (high) | 64.6% | 54.5% |
| by category |
|
|
| Reasoning (low) | 42.4% | 38.9% ±0.3, Mean of 3 runs, range 38.4 to 39.1 |
| Reasoning (high) | 62.3% | 57.6% ±2.0, Mean of 3 runs, range 55.6 to 59.6 |
Gemini 2.5 Pro vs Mistral Large 4: Overview
Gemini 2.5 Pro, released on June 17, 2025, is Google DeepMind’s most capable model in the Gemini 2.5 family, optimized for deep reasoning, coding, and complex multimodal tasks. It accepts text, images, audio, video, and PDFs as input and outputs text. The model supports 1 million input tokens with an output capacity of up to 65K tokens, enabling large-scale comprehension of datasets, codebases, and technical documents. Its training knowledge extends to January 2025.
It supports structured outputs, function calling, code execution, search grounding, and URL context, making it well-suited for enterprise, STEM, and developer workflows. However, it does not currently support image or audio generation in its stable release, and its higher computational cost and latency make it less efficient than Flash or Flash-Lite. It is available via the Gemini API, Google AI Studio, and Vertex AI.
Mistral Large 4, nicknamed Le Chonk, is a natively multimodal mixture-of-experts model from Mistral that accepts interleaved text and image input and produces text output. It uses a granular MoE design with roughly 1.05 trillion total parameters and 49 billion active per token, reported as 52 billion when embeddings and output layers are counted, paired with a 1.6 billion parameter vision encoder and a context window of one million tokens. The model is trained from scratch on about 3,800 NVIDIA Grace Blackwell GPUs in Mistral's European data centers and supports more than 160 languages. It behaves as a hybrid instruct and reasoning system, with a reasoning effort setting that selects between direct answers and longer deliberation, alongside function calling and structured output for agentic workflows.
Image understanding is a focus of this generation, covering documents, charts, technical drawings and natural scenes, and the model emits bounding box coordinates for visual grounding queries. Reported grounding results include 42 percent on Dense200 and 73 percent on the DIOR-RSVG remote sensing benchmark. Mistral describes agentic vision workflows in which the model zooms into gigapixel satellite imagery or engineering drawings to verify details, and reports coding results such as 62 percent on DeepSWE. Figures published at preview time are preliminary because the reinforcement learning phase is still in progress.
Frequently Asked Questions
On Roboflow's Vision Evals, Gemini 2.5 Pro performed better. It scores higher on 3 of the five vision tasks and averages 57.6% (#50 of 73) against 56.8% (#51 of 73) for Mistral Large 4. These scores measure vision capabilities only; either model may perform differently on work outside this benchmark's tasks.
No. On the Vision Evals Object Detection benchmark at low effort, Mistral Large 4 leads with 59.3% against 33.7%. This is the widest gap between the two models across the benchmark's tasks.
Mistral Large 4 is cheaper to run. Across Roboflow's Vision Evals task mix it averaged $0.0033 per sample against $0.0051. Gemini 2.5 Pro is priced at $1.25 per 1M input tokens and $10.00 per 1M output; Mistral Large 4 is priced at $0.70 per 1M input tokens and $2.10 per 1M output. Actual costs depend on your image sizes, prompts, and output length.
Gemini 2.5 Pro is faster. Across Roboflow's Vision Evals it averaged 6.8s per inference against 31.2s. Latency varies with image size, prompt length, and provider load, so treat these as relative rather than guaranteed figures.
Yes. The comparison demo on this page runs both models on the same image side by side for object detection and open prompts in the free Roboflow Playground. You can try it instantly, and a free account gives you more runs with free Roboflow credits.