AnthropicReleased Oct 2024Proprietary
Claude 3.5 Haiku
Claude 3.5 Haiku is deprecated and can't be run here; try Claude Haiku 5.5 (69.6% on Vision Evals) instead.
Claude 3.5 Haiku has no score on the current Vision Evals. On the earlier Vision Evals board (last updated July 9, 2026) it passed 62.7% of visual understanding tasks (#40 of 77). It is a proprietary model from Anthropic, so commercial use follows Anthropic's terms.
This model is deprecated
Claude 3.5 Haiku and can no longer be run here. Its evaluation results and details remain available for reference. Try Claude Haiku 5.5 instead.
Claude 3.5 Haiku Vision Evals
Claude 3.5 Haiku has been deprecated by its provider and can no longer be evaluated on the current benchmark. The legacy Vision Evals results below are preserved for reference. See the current Vision Evals
Visual Understanding
77 models · 67 tasks| Category | Passed | Score |
|---|---|---|
| Document Understanding | 7 / 9 | 77.8% |
| Object Understanding | 10 / 14 | 71.4% |
| Defect Detection | 10 / 15 | 66.7% |
| Spatial Understanding | 10 / 19 | 52.6% |
| Object Counting | 5 / 10 | 50% |
Scores based on a single evaluation run · Methodology
View all legacy Vision Evals results →Claude 3.5 Haiku Overview
Claude 3.5 Haiku, released by Anthropic in October 2024, is the fastest member of the Claude 3.5 family, optimized for low-latency, high-throughput applications. It is a multimodal model that handles both text and image inputs and supports a large ~200,000-token context window. Haiku is designed to balance efficiency with intelligence, outperforming even Claude 3 Opus on several reasoning benchmarks while maintaining its hallmark speed.
Claude 3.5 Haiku License
ProprietaryClaude 3.5 Haiku is proprietary: the weights are not distributed, and the Claude 3.5 Haiku license is the vendor's commercial terms of service that you accept when you call the API.
- Commercial use
- Permitted under the vendor terms, typically metered per token or per request, with the vendor usage policy applying to your inputs and outputs.
- Modification
- Not available. Claude 3.5 Haiku weights are closed, so you can configure prompts and use vendor-hosted fine-tuning where it is offered, but you cannot modify the model itself.
- Redistribution
- Not permitted. You cannot self-host or resell the model; you build on the hosted API instead.
Vendor terms govern data retention, whether your inputs can be trained on, rate limits, and regional availability, and they can change with notice. Review them if you handle regulated or customer data.
Do I need a commercial license for Claude 3.5 Haiku?
Proprietary terms are set by the vendor rather than negotiated per project, and no open-source obligation attaches to your code. If you would rather deploy an open model instead of Claude 3.5 Haiku, Roboflow's licensing page lists the models whose commercial license is included when you deploy on Roboflow.
Do not hesitate to reach out with questions for your commercial project. Our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.
Talk to salesLicense information is provided as a guide and is not legal advice.
Claude 3.5 Haiku Details
Details
Vision Tasks
Price vs. performance
Estimated cost per task vs. Visual Understanding score, for this model and others ranked near it. Upper-left is the sweet spot (high quality, low cost). Based on Vision Evals (legacy) results.
10 of 11 models plotted · 1 not yet evaluated
| Model | Score | Median tokens | Est. cost / task | Compare |
|---|---|---|---|---|
| Claude Opus 4.8 | 67.2% | 2.2K | $0.012 | Compare |
| Claude Opus 4.7 | 67.2% | 2.6K | $0.015 | Compare |
| Gemma 4 31B | 67.2% | 467 | $0.0001 | Compare |
| Claude Opus 4.6 | 64.2% | 2.3K | $0.014 | Compare |
| GPT-5.4 Nano | 62.7% | 1.8K | $0.0004 | Compare |
| Claude 3.5 Haiku(this model) | 62.7% | — | — | — |
| Llama 4 Maverick | 59.7% | 2.4K | $0.0004 | Compare |
| Claude Sonnet 4.5 | 59.7% | 2.3K | $0.0092 | Compare |
| Claude Opus 4.1 | 59.7% | 2.1K | $0.040 | Compare |
| Claude Haiku 4.5 | 58.2% | 2.3K | $0.0030 | Compare |
| GPT-5 Nano | 58.2% | 2.7K | $0.0003 | Compare |
Alternatives to Claude 3.5 Haiku
Other models worth comparing for similar use cases.
Other Anthropic Haiku models
Other versions in the same family as Claude 3.5 Haiku.
Frequently Asked Questions About Claude 3.5 Haiku Vision
Yes. Claude 3.5 Haiku accepts image input, and on Roboflow's previous vision benchmark it passed 62.7% of visual understanding tasks (#40 of 77).
No. Claude 3.5 Haiku has been deprecated by its provider and can no longer be run, so it is not part of Roboflow's current Vision Evals. Its results from the previous benchmark are preserved on this page for reference.