Roboflow

SAM 3 Overview

Released on November 19th, 2025, Segment Anything 3 (SAM 3) is a zero-shot image segmentation model that “detects, segments, and tracks objects in images and videos based on concept prompts.” This model was developed by Meta as the third model in the Segment Anything series.

Unlike its previous SAM models (Segment Anything and Segment Anything 2), you can provide SAM 3 with the prompt “shipping container” and it will generate precise segmentation masks for all shipping containers in an image. SAM 3 generates segmentation masks that correspond to the location of the objects found with a text prompt.

SAM 3 Interactive Demo

SAM 3 Details & Performance

Details

Vision Tasks

Instance SegmentationObject DetectionPromptable Concept SegmentationVideo Object TrackingZero Shot SegmentationOpen Vocabulary Object Detection

Features

Foundation VisionMultimodal VisionZero-shot Detection

Usage

Past 30 Days

Performance

Avg. Latency

Arena Rankings

SAM 3 Vision Evals

SAM 3 has not yet been evaluated on the current benchmark. The results below are from the legacy version of Vision Evals, our previous benchmark. See the current Vision Evals

HighestLowest
This model#1 of 560.34% pmF1 · better than 80%
Score60.34%pmF1 across 250 queries
Speed0.52savg response per query
Costpricing unavailable
Tokenstokens unavailable
Score key:≥75%40–74%<40%
DatasetScore
SaCo-Gold
68.5%
COCO-100
54.9%
HighestLowest
This model#1 of 256.24% pmF1 · better than 50%
Score56.24%pmF1 across 250 queries
Speed0.52savg response per query
Costpricing unavailable
Tokenstokens unavailable
Score key:≥75%40–74%<40%
DatasetScore
SaCo-Gold
68.6%
COCO-100
48%

Scores based on a single evaluation run · Methodology

View all legacy Vision Evals results →

Alternatives to SAM 3

Other models worth comparing for similar use cases.

Meta
Segment Anything Model 2 (SAM 2)
SAM 2 is a real-time image and video segmentation model developed by Meta AI, released in July 2024 under the Apache 2.0 license. It extends the original Segment Anything Model to support video inputs by introducing a streaming memory architecture that maintains object state across frames, enabling consistent segmentation of objects through occlusion, motion, and scene changes. For image inputs, SAM 2 operates similarly to its predecessor with improved mask quality and speed.SAM 2 accepts point, box, and mask prompts and produces object masks interactively or in a fully automated mode. Its memory architecture enables video segmentation at real-time speeds. SAM 2 is used in annotation pipelines, video analysis, robotic perception, and any application requiring high-quality promptable segmentation across both images and video.
IDEA Research
Grounded SAM
Grounded SAM is an open-vocabulary image segmentation model developed by IDEA Research, released in January 2024 under the Apache 2.0 license. It combines Grounding DINO, a zero-shot open-vocabulary object detector, with the Segment Anything Model to produce precise segmentation masks for objects identified through free-form text prompts. The two models are used sequentially: Grounding DINO localizes objects from a text query, and SAM generates the corresponding segmentation masks.Grounded SAM enables zero-shot instance segmentation without task-specific training data, making it applicable to domains where labeled segmentation data is scarce. It supports arbitrary text queries and can segment objects not represented in standard training sets. The model is commonly used in automated labeling pipelines, robotic perception, and domain-specific vision applications requiring open-vocabulary segmentation.
Azure
Florence-2
Florence-2, introduced by Microsoft Research at CVPR 2024, is an open-source vision-language foundation model designed to unify diverse computer vision tasks within a single sequence-to-sequence framework. Unlike traditional models that specialize in specific tasks, Florence-2 accepts both images and text prompts and outputs text for tasks such as captioning, object detection, segmentation, OCR, and region-based grounding. It comes in two sizes—Florence-2-base (~230M parameters) and Florence-2-large (~770M parameters)—and is trained on FLD-5B, a large dataset of ~126M images with ~5.4B annotations.The model demonstrates strong zero-shot and fine-tuned performance, often rivaling larger vision-language systems while remaining lightweight and efficient. Released under the MIT license, all weights are publicly available, making it accessible for fine-tuning and deployment in applications like VQA, content tagging, accessibility, and research. Florence-2’s compact design, versatility, and openness position it as a practical alternative to larger proprietary multimodal models.
YOLOE
YOLOE (YOLO with Everything) is an open-vocabulary object detection and segmentation model developed by THU-MIG at Tsinghua University, released in March 2025 under the AGPL-3.0 license. It extends the YOLO architecture to support open-vocabulary detection through text and visual prompts, enabling the model to detect arbitrary object categories beyond a fixed training set without retraining. The design integrates prompt encoding directly into the YOLO framework while preserving real-time inference speed.YOLOE is evaluated on COCO and LVIS benchmarks and supports both closed-set and open-vocabulary detection modes. It is built on the Ultralytics codebase and maintains compatibility with standard YOLO training and export workflows. YOLOE is suited for applications requiring flexible, prompt-driven object detection where the target object vocabulary may change at inference time.
IDEA Research
Grounding DINO
Grounding DINO is an open-vocabulary object detection model developed by IDEA Research, released in March 2023 under the Apache 2.0 license. It extends the DINO transformer-based detector with grounded pre-training, enabling it to detect arbitrary objects described by free-form text queries rather than a fixed set of predefined categories. The model integrates a text encoder with a visual backbone through a feature fusion module that aligns language and visual representations at multiple scales.Grounding DINO achieves strong zero-shot detection performance on COCO, LVIS, and ODinW benchmarks, and supports referring expression comprehension tasks. It is widely used as a foundation for open-vocabulary detection pipelines and as the detection backbone in systems such as Grounded-SAM. The model is particularly suited for applications requiring flexible, text-driven object localization across diverse domains.
Meta
Segment Anything Model (SAM)
The Segment Anything Model is a promptable image segmentation foundation model developed by Meta AI, released in April 2023 under the Apache 2.0 license. It introduces a general-purpose segmentation architecture trained on SA-1B, a dataset of over 1 billion masks across 11 million images collected using a data engine that leveraged the model itself. SAM accepts point, bounding box, and mask prompts and generates high-quality segmentation masks for any object in an image, including objects not seen during training.SAM achieves strong zero-shot performance across a wide range of segmentation tasks and domains. Its promptable interface makes it suitable as a building block for automated annotation, interactive segmentation tools, and integration with detection models such as Grounding DINO. SAM has been extended by subsequent works including SAM 2, SAM 3, and Grounded-SAM.

Deploy SAM 3 with an API

SAM 3 runs as a hosted REST endpoint through Roboflow Workflows. Pick a task, then hand the prompt to your coding agent or copy the code. Deploying the workflow into a free Roboflow workspace replaces the your-workspace and YOUR_API_KEY placeholders with your own.

Connect your agent to Roboflow (once)

Add the Roboflow MCP server

claude mcp add --transport http roboflow https://mcp.roboflow.com/mcp

Run /mcp and authorize Roboflow in your browser when the OAuth flow opens.

Start a new Claude Code session so the MCP loads, then paste the prompt below (it works the same in any agent).

Deploy this workflow to your Roboflow workspace to use it.

Integrate the Roboflow "SAM 3" workflow into my app.

- Endpoint: POST https://serverless.roboflow.com/<your-workspace>/workflows/sam-3-object-detection
- Auth: send my Roboflow API key as `api_key` in the request body, read from the ROBOFLOW_API_KEY env var (never hardcode).
- Body: { "api_key": ..., "inputs": { `image`: { type: "url" | "base64", value }, `classes`: string array } }.

With the Roboflow MCP connected, call `workflows_get` on "sam-3-object-detection" to read the exact input schema (the source of truth), then `workflows_run` on a sample image to confirm the output shape before writing code (the MCP is authenticated, so this needs no key). Without the MCP, use the contract above.

Before running the app, set up these keys so it does not error at runtime:
- `ROBOFLOW_API_KEY` (sent as `api_key`) from https://app.roboflow.com/settings/api
Create a .gitignore'd .env with these variables, using placeholder values for any I haven't given you. Then pause and tell me directly, in your reply: the full path to the .env file, exactly which keys I need to paste in, and the link to get each one. Wait for me to confirm I've added them before you run anything. Do not run the app until I confirm.

Then add the integration to my codebase: match my project's language, framework, and conventions; read every key from environment variables (never hardcode); add basic error handling; and include a small runnable example. If you can't tell what language my project uses, ask me.
Installpip install inference-sdk

Deploy this workflow to your Roboflow workspace to use it.

# 1. Import the library
from inference_sdk import InferenceHTTPClient

# 2. Connect to your workflow
client = InferenceHTTPClient(
  api_url="https://serverless.roboflow.com",
  api_key="YOUR_API_KEY"
)

# 3. Run your workflow on an image
result = client.run_workflow(
  workspace_name="your-workspace",
  workflow_id="sam-3-object-detection",
  images={
    "image": "YOUR_IMAGE.jpg"  # Path to your image file
  },
  parameters={
    "classes": ["class1", "class2", "class3"]
  },
  use_cache=True  # cache workflow definition for 15 minutes
)

# 4. Get your results
print(result)

Deploy this workflow to your Roboflow workspace to use it.

const response = await fetch('https://serverless.roboflow.com/your-workspace/workflows/sam-3-object-detection', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({
    api_key: 'YOUR_API_KEY',
    inputs: {
      "image": {"type": "url", "value": "IMAGE_URL"},
      "classes": ["class1", "class2", "class3"]
    }
  })
});

const result = await response.json();
console.log(result);

Deploy this workflow to your Roboflow workspace to use it.

curl --location 'https://serverless.roboflow.com/your-workspace/workflows/sam-3-object-detection' \
--header 'Content-Type: application/json' \
--data '{
  "api_key": "YOUR_API_KEY",
  "inputs": {
    "image": {"type": "url", "value": "IMAGE_URL"},
    "classes": ["class1", "class2", "class3"]
  }
}'

SAM 3 License

Custom License · Model-specific license

SAM 3 ships under a custom, model-specific license rather than a standard permissive or restrictive one, so the SAM 3 license has to be read directly. Custom model licenses range from effectively permissive to research-only.

Commercial use
Varies. Custom model licenses commonly restrict commercial use, cap monthly active users, or carve out specific industries — check the SAM 3 terms before you build on it.
Modification
Usually permitted for fine-tuning, but check whether derivative weights inherit the same license and naming requirements.
Redistribution
Often restricted. Look for attribution, naming, and acceptable-use requirements that apply to any copy you share.

Uncertainty around licensing can delay or stop a project, and acceptable-use policies attached to custom licenses are binding terms rather than guidance. Review them alongside the SAM 3 license before production deployment.

Do I need a commercial license for SAM 3?

If the custom terms rule out your use case, a commercial license from the rights holder is the way through. Roboflow's licensing page lists the supported models whose commercial license is included in a Roboflow plan, so it is worth checking whether SAM 3 — or a permissively licensed alternative — fits your deployment.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under a custom license that does not match a standard open-source identifier. Read the full license text linked from the model documentation.

Custom licenses vary widely in what they permit. Many model-specific custom licenses include commercial-use restrictions (e.g., non-commercial weights, named-user limits, or jurisdiction restrictions). Read the full license before deploying commercially.

Custom licenses are model-specific. Always check the per-model License Notes section above and the linked official license text.

License information is provided as a guide and is not legal advice.

Frequently Asked Questions About SAM 3 Vision

SAM 3 has not yet been evaluated on Roboflow's current Vision Evals. The results on this page are from the previous benchmark.

Yes. The demo on this page runs SAM 3 in the free Roboflow Playground: upload an image and see results in seconds. A free account unlocks unlimited runs.