Roboflow

Roboflow: RF-DETR Segmentation

RF-DETR Segmentation Overview

RF-DETR Segmentation is a real-time instance segmentation model developed by Roboflow, with a preview base model released in October 2025 under the Apache 2.0 license and the full variant family — Nano through 2XL — released in January 2026. It extends the RF-DETR object detection architecture with a segmentation head inspired by MaskDINO, enabling pixel-level object delineation while maintaining the real-time performance characteristics of the base model. It is deployable through Roboflow Inference and the open-source rfdetr Python package.

RF-DETR Segmentation supports fine-tuning on custom COCO- or YOLO-format instance segmentation datasets and is benchmarked on Microsoft COCO. It is suited for applications requiring both precise object masks and real-time inference, such as robotic manipulation, quality control, and augmented reality overlays.

RF-DETR Segmentation Interactive Demo

RF-DETR Segmentation Details & Performance

Details

Vision Tasks

Instance Segmentation

Features

Real-Time Vision

Usage

Past 30 Days

Performance

Avg. Latency

Alternatives to RF-DETR Segmentation

Other models worth comparing for similar use cases.

Meta
Mask R-CNN
Mask R-CNN is an instance segmentation model developed by Facebook AI Research (Meta), released in October 2017. It extends Faster R-CNN by adding a parallel branch that predicts binary segmentation masks for each detected object, independent of the classification and bounding box regression branches. A key contribution is RoIAlign, which replaces RoIPool with bilinear interpolation to preserve spatial correspondence between features and input pixels, significantly improving mask quality.Mask R-CNN achieves strong performance on the COCO instance segmentation benchmark and supports keypoint detection as an additional output head. It remains a foundational architecture in instance segmentation and is available through Meta's Detectron2 framework. The model is most appropriate for tasks requiring pixel-level object delineation, such as medical imaging, autonomous driving, and industrial inspection.
Meta
Segment Anything Model 2 (SAM 2)
SAM 2 is a real-time image and video segmentation model developed by Meta AI, released in July 2024 under the Apache 2.0 license. It extends the original Segment Anything Model to support video inputs by introducing a streaming memory architecture that maintains object state across frames, enabling consistent segmentation of objects through occlusion, motion, and scene changes. For image inputs, SAM 2 operates similarly to its predecessor with improved mask quality and speed.SAM 2 accepts point, box, and mask prompts and produces object masks interactively or in a fully automated mode. Its memory architecture enables video segmentation at real-time speeds. SAM 2 is used in annotation pipelines, video analysis, robotic perception, and any application requiring high-quality promptable segmentation across both images and video.
RF-DETR
RF-DETR is a real-time transformer-based object detection model developed by Roboflow, with code and weights first released in March 2025 under the Apache 2.0 license. It is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark, built on a DINOv2 vision transformer backbone with weight-sharing neural architecture search used to identify accuracy-latency trade-offs. The full family spans six sizes from Nano (30.5M parameters, 384×384 input) to 2XL (126.9M parameters, 880×880 input), with the accompanying research paper accepted to ICLR 2026.RF-DETR is designed for strong domain adaptability, achieving state-of-the-art performance on RF100-VL, a benchmark measuring generalization to real-world object detection tasks across diverse domains. It is deployable through Roboflow Inference and supports fine-tuning on custom datasets, making it well suited for domain-specific applications with limited training data.

Deploy RF-DETR Segmentation with an API

RF-DETR Segmentation runs as a hosted REST endpoint through Roboflow Workflows. Pick a task, then hand the prompt to your coding agent or copy the code. Deploying the workflow into a free Roboflow workspace replaces the your-workspace and YOUR_API_KEY placeholders with your own.

Connect your agent to Roboflow (once)

Add the Roboflow MCP server

claude mcp add --transport http roboflow https://mcp.roboflow.com/mcp

Run /mcp and authorize Roboflow in your browser when the OAuth flow opens.

Start a new Claude Code session so the MCP loads, then paste the prompt below (it works the same in any agent).

Deploy this workflow to your Roboflow workspace to use it.

Integrate the Roboflow "RF-DETR Segmentation" workflow into my app.

- Endpoint: POST https://serverless.roboflow.com/<your-workspace>/workflows/rf-detr-segmentation-instance-segmentation-coco-medium
- Auth: send my Roboflow API key as `api_key` in the request body, read from the ROBOFLOW_API_KEY env var (never hardcode).
- Body: { "api_key": ..., "inputs": { `image`: { type: "url" | "base64", value } } }.

With the Roboflow MCP connected, call `workflows_get` on "rf-detr-segmentation-instance-segmentation-coco-medium" to read the exact input schema (the source of truth), then `workflows_run` on a sample image to confirm the output shape before writing code (the MCP is authenticated, so this needs no key). Without the MCP, use the contract above.

Before running the app, set up these keys so it does not error at runtime:
- `ROBOFLOW_API_KEY` (sent as `api_key`) from https://app.roboflow.com/settings/api
Create a .gitignore'd .env with these variables, using placeholder values for any I haven't given you. Then pause and tell me directly, in your reply: the full path to the .env file, exactly which keys I need to paste in, and the link to get each one. Wait for me to confirm I've added them before you run anything. Do not run the app until I confirm.

Then add the integration to my codebase: match my project's language, framework, and conventions; read every key from environment variables (never hardcode); add basic error handling; and include a small runnable example. If you can't tell what language my project uses, ask me.
Installpip install inference-sdk

Deploy this workflow to your Roboflow workspace to use it.

# 1. Import the library
from inference_sdk import InferenceHTTPClient

# 2. Connect to your workflow
client = InferenceHTTPClient(
  api_url="https://serverless.roboflow.com",
  api_key="YOUR_API_KEY"
)

# 3. Run your workflow on an image
result = client.run_workflow(
  workspace_name="your-workspace",
  workflow_id="rf-detr-segmentation-instance-segmentation-coco-medium",
  images={
    "image": "YOUR_IMAGE.jpg"  # Path to your image file
  },
  use_cache=True  # cache workflow definition for 15 minutes
)

# 4. Get your results
print(result)

Deploy this workflow to your Roboflow workspace to use it.

const response = await fetch('https://serverless.roboflow.com/your-workspace/workflows/rf-detr-segmentation-instance-segmentation-coco-medium', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({
    api_key: 'YOUR_API_KEY',
    inputs: {
      "image": {"type": "url", "value": "IMAGE_URL"}
    }
  })
});

const result = await response.json();
console.log(result);

Deploy this workflow to your Roboflow workspace to use it.

curl --location 'https://serverless.roboflow.com/your-workspace/workflows/rf-detr-segmentation-instance-segmentation-coco-medium' \
--header 'Content-Type: application/json' \
--data '{
  "api_key": "YOUR_API_KEY",
  "inputs": {
    "image": {"type": "url", "value": "IMAGE_URL"}
  }
}'

RF-DETR Segmentation License

Apache-2.0 · Permissive license

RF-DETR Segmentation is released under Apache-2.0, a permissive license. The RF-DETR Segmentation license lets you run, fine-tune, and redistribute the model in commercial products with no obligation to open-source related code changes, so no separate commercial license is required.

Commercial use
Permitted. Because Apache-2.0 is permissive, RF-DETR Segmentation can ship inside paid products and internal systems with no commercial license and no revenue threshold.
Modification
Permitted. Fine-tuning, quantizing, and distilling are all allowed, and your code changes can stay closed. Files you change must be marked as changed.
Redistribution
Permitted with attribution. Ship the Apache-2.0 license text and any NOTICE file alongside the weights or derived code.

Apache-2.0 grants an express patent license that terminates if you bring a patent claim over the work, and it disclaims warranties. Validate RF-DETR Segmentation on your own data before you depend on it in production.

Read the full Apache 2.0 license ↗

Do I need a commercial license for RF-DETR Segmentation?

This is the straightforward case: a permissive license is the best technical solution and you are free to deploy RF-DETR Segmentation commercially without open-sourcing your own code.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under the Apache License 2.0, a permissive open-source license that allows commercial use, modification, distribution, and patent use.

Yes. Under the terms of the Apache 2.0 license, you can freely use this model for commercial purposes, including in proprietary products. You must retain the copyright notice and disclaimers when redistributing.

RF-DETR Segmentation Nano, Small, Medium, and Large are released under the Apache 2.0 license. RF-DETR Segmentation XL and 2XL are released under Roboflow's PML 1.0 license. See the Roboflow Licensing guide for commercial-use terms across variants.

License information is provided as a guide and is not legal advice.

Frequently Asked Questions About RF-DETR Segmentation

RF-DETR Segmentation is a pretrained computer vision model for instance segmentation. Unlike a general vision language model, it returns structured predictions for its task rather than free text.

RF-DETR Segmentation comes in 6 sizes: Nano (312×312), Small (384×384), Medium (432×432), Large (504×504), XL (624×624), 2XL (768×768). Smaller variants run faster on constrained hardware; larger ones trade speed for accuracy. You can switch sizes in the demo to compare them on the same image.

Yes. The demo on this page runs RF-DETR Segmentation in the free Roboflow Playground: upload an image and see results in seconds. A free account unlocks unlimited runs.