Roboflow
Anthropic

Anthropic: Claude 3.5 Haiku

This model is deprecated

Claude 3.5 Haiku and can no longer be run here. Its evaluation results and details remain available for reference. Try Claude Haiku 4.5 instead.

Claude 3.5 Haiku Overview

Claude 3.5 Haiku, released by Anthropic in October 2024, is the fastest member of the Claude 3.5 family, optimized for low-latency, high-throughput applications. It is a multimodal model that handles both text and image inputs and supports a large ~200,000-token context window. Haiku is designed to balance efficiency with intelligence, outperforming even Claude 3 Opus on several reasoning benchmarks while maintaining its hallmark speed.

Typical applications include real-time chatbots, code completion, large-scale data extraction, and content moderation—scenarios where rapid response and scalability are essential.

Claude 3.5 Haiku Details & Performance

Details

Resources

Vision Tasks

CaptioningChart Question AnsweringClassificationDocument Question AnsweringImage TaggingMulti-Label ClassificationOCRObject DetectionVision LanguageVisual Question Answering

Features

Foundation VisionLLMs with Vision CapabilitiesMultimodal Vision

Usage

Past 30 Days

Not available

Not in Playground

Performance

Avg. Latency

Arena Rankings

Claude 3.5 Haiku Vision Evals

Claude 3.5 Haiku has been deprecated by its provider and can no longer be evaluated on the current benchmark. The legacy Vision Evals results below are preserved for reference. See the current Vision Evals

Visual Understanding

77 models · 67 tasks
HighestLowest
This model#40 of 7762.69% pass rate · better than 45%
Score62.69%pass rate across 67 tasks
Speed18.36savg response per task
Costpricing unavailable
Tokenstokens unavailable
Score key:≥75%40–74%<40%
CategoryPassedScore
Document Understanding7 / 9
77.8%
Object Understanding10 / 14
71.4%
Defect Detection10 / 15
66.7%
Spatial Understanding10 / 19
52.6%
Object Counting5 / 10
50%

Scores based on a single evaluation run · Methodology

View all legacy Vision Evals results →

Price vs. performance

Estimated cost per task vs. Visual Understanding score, for this model and others ranked near it. Upper-left is the sweet spot (high quality, low cost). Based on Vision Evals (legacy) results.

10 of 11 models plotted · 1 not yet evaluated

Alternatives to Claude 3.5 Haiku

Other models worth comparing for similar use cases.

OpenAI
GPT-5 Nano
GPT-5 Nano, released by OpenAI on August 7, 2025, is the smallest and most cost-efficient model in the GPT-5 family. Like its larger counterparts, it is multimodal—accepting text and images, supporting tool use, structured outputs, and reasoning—but it is optimized for speed, low latency, and affordability. It features input and output token limits of roughly 272K and 128K tokens respectively, enabling large-context processing even at its compact scale. Its knowledge cutoff is around May 2024, slightly earlier than the full GPT-5 model.GPT-5 Nano is well-suited for high-volume or cost-sensitive deployments such as mobile apps, embedded AI systems, or rapid-response APIs. While it offers less depth on complex reasoning and coding tasks compared to GPT-5 Mini or Pro, it retains core multimodal and agentic capabilities, making it an attractive option where efficiency and scale matter more than maximum performance.
Google
Gemini 2.5 Flash-Lite
Gemini 2.5 Flash-Lite, released for general availability on July 22, 2025, is the most cost-efficient model in the Gemini 2.5 family, designed for high-volume and latency-sensitive tasks. It is multimodal, supporting text, images, video, audio, and PDFs as inputs, with text as its primary output. The model handles up to 1 million input tokens and generates outputs up to 64K tokens, making it suitable for large-scale document or media processing at low cost. It is built on a Sparse Mixture-of-Experts architecture with native multimodal support, though exact parameter counts are undisclosed.Flash-Lite offers the lowest usage cost among Gemini 2.5 models. It introduces developer controls for “thinking mode,” allowing fine-tuning of reasoning depth vs. efficiency. It also integrates native tools such as code execution, search grounding, and URL context. While strong on translation, classification, coding, and general multimodal reasoning, it lacks support for image or audio generation in its stable release and is less capable than Gemini 2.5 Flash or Pro on complex reasoning-heavy workflows.
Qwen
Qwen3 VL 8B Instruct
Qwen3 VL 8B Instruct is an open-weight multimodal vision-language model developed by Qwen / Alibaba Cloud as part of the Qwen3-VL series, designed for instruction-following tasks that combine text with visual inputs such as images and video. Released around October 2025 under the Apache-2.0 license, it targets developers who need capable multimodal reasoning without the scale or cost of very large models.The model contains roughly 8.8 billion dense parameters and supports text, image, and video understanding with strong spatial perception, visual reasoning, and emerging visual agent abilities such as GUI interaction. A standout feature is its native ~256K token context window, extendable to around 1M tokens, enabling long-document reading and extended video comprehension. In today’s landscape, it balances openness, long-context capacity, and solid multimodal performance against heavier proprietary models. Typical applications include multimodal assistants, document and video analysis, visual question answering, and research or product prototyping where transparency and deployability matter.
Google
Gemini 3.1 Flash-Lite
Gemini 3.1 Flash-Lite is a natively multimodal reasoning model from Google DeepMind in the Gemini 3 series, based on the Gemini 3 Pro architecture. It processes text, image, video, audio, and PDF inputs within a 1 million token context window and produces text output up to 64K tokens. The model targets high-volume, latency-sensitive workloads and supports visual question answering, image and document data extraction, content moderation, classification, translation, automated speech recognition, and agentic data pipelines. It exposes configurable thinking levels of minimal, low, medium, and high, which set the depth of internal reasoning applied per request and let developers balance response quality against cost and latency.On benchmarks reported at launch, Gemini 3.1 Flash-Lite scores 86.9% on GPQA Diamond and 76.8% on the MMMU Pro multimodal benchmark, and reaches an Elo score of 1432 on the Arena.ai leaderboard. According to Artificial Analysis benchmarks, it produces a 2.5 times faster time to first answer token and a 45% increase in output speed relative to Gemini 2.5 Flash. It also shows improved instruction following, higher audio input quality for automated speech recognition tasks, and support for structured JSON output used in data extraction pipelines.
Moondream 2
Moondream 2 is a small open-source vision-language model from Moondream, the company founded by Vikhyat Korrapati. It was first released in early 2024 and updated through mid-2025. At approximately 1.9 billion parameters, it is designed to run efficiently on consumer hardware such as laptops and edge devices while supporting a practical range of multimodal tasks. Moondream 2 combines a vision encoder based on SigLIP with a compact language backbone, trained for image understanding tasks rather than as a general chat model.The model accepts an image paired with a natural language prompt and produces text responses, supporting visual question answering, image captioning, and image-conditioned dialogue. Later Moondream 2 releases added object localization through a point API that returns coordinates for queried objects, along with improvements to OCR, counting, and document understanding. Moondream 2 is distributed under the Apache 2.0 license and is available through Hugging Face and the maintainer's distribution. Because the model is updated frequently, production deployments should pin to a specific revision rather than tracking the latest release. A successor model, Moondream 3 (Preview), was released in September 2025 with a 9B mixture-of-experts architecture and 2B active parameters, offering substantially stronger visual reasoning than Moondream 2 while retaining the efficiency-focused design. A referring expression segmentation extension to Moondream 3 was released in March 2026.

Other Anthropic Haiku models

Other versions in the same family as Claude 3.5 Haiku.

Claude 3.5 Haiku License

Proprietary

License terms and commercial-use guidance for Claude 3.5 Haiku.

This model is proprietary. The author retains all rights, and use of the model is governed by their specific terms of service or license agreement.

Commercial use depends on the terms set by the model author. Most proprietary commercial models require a paid subscription, API key, or per-call billing. Check the provider’s pricing and terms-of-service for details.

License information is provided as a guide and is not legal advice.

Frequently Asked Questions About Claude 3.5 Haiku Vision

Yes. Claude 3.5 Haiku accepts image input, and on Roboflow's previous vision benchmark it passed 62.7% of visual understanding tasks (#40 of 77).

Claude 3.5 Haiku has been deprecated by its provider and can no longer be run, so it is not part of Roboflow's current Vision Evals. Its results from the previous benchmark are preserved on this page for reference.