This model is deprecated
Claude 3.5 Haiku and can no longer be run here. Its evaluation results and details remain available for reference. Try Claude Haiku 4.5 instead.
Claude 3.5 Haiku, released by Anthropic in October 2024, is the fastest member of the Claude 3.5 family, optimized for low-latency, high-throughput applications. It is a multimodal model that handles both text and image inputs and supports a large ~200,000-token context window. Haiku is designed to balance efficiency with intelligence, outperforming even Claude 3 Opus on several reasoning benchmarks while maintaining its hallmark speed.
Typical applications include real-time chatbots, code completion, large-scale data extraction, and content moderation—scenarios where rapid response and scalability are essential.
—
Usage
Past 30 DaysNot available
Not in Playground
Claude 3.5 Haiku has been deprecated by its provider and can no longer be evaluated on the current benchmark. The legacy Vision Evals results below are preserved for reference. See the current Vision Evals
| Category | Passed | Score |
|---|---|---|
| Document Understanding | 7 / 9 | 77.8% |
| Object Understanding | 10 / 14 | 71.4% |
| Defect Detection | 10 / 15 | 66.7% |
| Spatial Understanding | 10 / 19 | 52.6% |
| Object Counting | 5 / 10 | 50% |
Scores based on a single evaluation run · Methodology
View all legacy Vision Evals results →Estimated cost per task vs. Visual Understanding score, for this model and others ranked near it. Upper-left is the sweet spot (high quality, low cost). Based on Vision Evals (legacy) results.
10 of 11 models plotted · 1 not yet evaluated
| Model | Score | Median tokens | Est. cost / task | Compare |
|---|---|---|---|---|
| Claude Opus 4.8 | 67.2% | 2.2K | $0.012 | Compare |
| Claude Opus 4.7 | 67.2% | 2.6K | $0.015 | Compare |
| Gemma 4 31B | 67.2% | 467 | $0.0001 | Compare |
| Claude Opus 4.6 | 64.2% | 2.3K | $0.014 | Compare |
| GPT-5.4 Nano | 62.7% | 1.8K | $0.0004 | Compare |
| Claude 3.5 Haiku(this model) | 62.7% | — | — | — |
| Llama 4 Maverick | 59.7% | 2.4K | $0.0005 | Compare |
| Claude Sonnet 4.5 | 59.7% | 2.3K | $0.0092 | Compare |
| Claude Opus 4.1 | 59.7% | 2.1K | $0.040 | Compare |
| Claude Haiku 4.5 | 58.2% | 2.3K | $0.0030 | Compare |
| GPT-5 Nano | 58.2% | 2.7K | $0.0003 | Compare |
Other models worth comparing for similar use cases.
Other versions in the same family as Claude 3.5 Haiku.
License terms and commercial-use guidance for Claude 3.5 Haiku.
This model is proprietary. The author retains all rights, and use of the model is governed by their specific terms of service or license agreement.
Commercial use depends on the terms set by the model author. Most proprietary commercial models require a paid subscription, API key, or per-call billing. Check the provider’s pricing and terms-of-service for details.
License information is provided as a guide and is not legal advice.
Yes. Claude 3.5 Haiku accepts image input, and on Roboflow's previous vision benchmark it passed 62.7% of visual understanding tasks (#40 of 77).
Claude 3.5 Haiku has been deprecated by its provider and can no longer be run, so it is not part of Roboflow's current Vision Evals. Its results from the previous benchmark are preserved on this page for reference.