This model is deprecated
Claude 3.5 Haiku and can no longer be run here. Its evaluation results and details remain available for reference. Try Claude Haiku 4.5 instead.
Claude 3.5 Haiku, released by Anthropic in October 2024, is the fastest member of the Claude 3.5 family, optimized for low-latency, high-throughput applications. It is a multimodal model that handles both text and image inputs and supports a large ~200,000-token context window. Haiku is designed to balance efficiency with intelligence, outperforming even Claude 3 Opus on several reasoning benchmarks while maintaining its hallmark speed.
Typical applications include real-time chatbots, code completion, large-scale data extraction, and content moderation—scenarios where rapid response and scalability are essential.
—
Usage
Past 30 DaysNot available
Not in Playground
Claude 3.5 Haiku has been deprecated by its provider and can no longer be evaluated on the current benchmark. The legacy Vision Evals results below are preserved for reference. See the current Vision Evals
| Category | Passed | Score |
|---|---|---|
| Document Understanding | 7 / 9 | 77.8% |
| Object Understanding | 10 / 14 | 71.4% |
| Defect Detection | 10 / 15 | 66.7% |
| Spatial Understanding | 10 / 19 | 52.6% |
| Object Counting | 5 / 10 | 50% |
Scores based on a single evaluation run · Methodology
View all legacy Vision Evals results →Estimated cost per task vs. Visual Understanding score, for this model and others ranked near it. Upper-left is the sweet spot (high quality, low cost). Based on Vision Evals (legacy) results.
10 of 11 models plotted · 1 not yet evaluated
| Model | Score | Median tokens | Est. cost / task | Compare |
|---|---|---|---|---|
| Claude Opus 4.8 | 67.2% | 2.2K | $0.012 | Compare |
| Claude Opus 4.7 | 67.2% | 2.6K | $0.015 | Compare |
| Gemma 4 31B | 67.2% | 467 | $0.0001 | Compare |
| Claude Opus 4.6 | 64.2% | 2.3K | $0.014 | Compare |
| GPT-5.4 Nano | 62.7% | 1.8K | $0.0004 | Compare |
| Claude 3.5 Haiku(this model) | 62.7% | — | — | — |
| Llama 4 Maverick | 59.7% | 2.4K | $0.0004 | Compare |
| Claude Sonnet 4.5 | 59.7% | 2.3K | $0.0092 | Compare |
| Claude Opus 4.1 | 59.7% | 2.1K | $0.040 | Compare |
| Claude Haiku 4.5 | 58.2% | 2.3K | $0.0030 | Compare |
| GPT-5 Nano | 58.2% | 2.7K | $0.0003 | Compare |
Other models worth comparing for similar use cases.
Other versions in the same family as Claude 3.5 Haiku.
Claude 3.5 Haiku is proprietary: the weights are not distributed, and the Claude 3.5 Haiku license is the vendor's commercial terms of service that you accept when you call the API.
Vendor terms govern data retention, whether your inputs can be trained on, rate limits, and regional availability, and they can change with notice. Review them if you handle regulated or customer data.
Proprietary terms are set by the vendor rather than negotiated per project, and no open-source obligation attaches to your code. If you would rather deploy a model whose commercial license is included in your plan — on Roboflow Managed Cloud or a Self-Hosted Inference Server — Roboflow's licensing page lists the supported alternatives to Claude 3.5 Haiku.
Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.
Talk to salesThis model is proprietary. The author retains all rights, and use of the model is governed by their specific terms of service or license agreement.
Commercial use depends on the terms set by the model author. Most proprietary commercial models require a paid subscription, API key, or per-call billing. Check the provider’s pricing and terms-of-service for details.
License information is provided as a guide and is not legal advice.
Yes. Claude 3.5 Haiku accepts image input, and on Roboflow's previous vision benchmark it passed 62.7% of visual understanding tasks (#40 of 77).
Claude 3.5 Haiku has been deprecated by its provider and can no longer be run, so it is not part of Roboflow's current Vision Evals. Its results from the previous benchmark are preserved on this page for reference.