Roboflow

Co-DETR Overview

Co-DETR (Co-Deformable-DETR) is an object detection model developed by researchers at Sense-X and OpenMMLab, released in November 2022. It improves upon standard DETR-based detectors by introducing a collaborative hybrid assignment training scheme that enables the encoder to learn from multiple auxiliary heads simultaneously, alongside the primary one-to-one assignment used during inference. This auxiliary supervision significantly accelerates convergence and improves overall detection accuracy without adding inference cost.

Co-DETR is evaluated on the COCO benchmark, where it achieves 59.5% AP when applied to DINO-Deformable-DETR with a Swin-L backbone. With a ViT-L backbone it reaches 66.0% AP on COCO test-dev, outperforming prior methods at comparable model scales. It is suitable for high-accuracy object detection tasks where training efficiency and peak performance on standard benchmarks are priorities.

Co-DETR Details & Performance

Details

Resources

Vision Tasks

Object Detection

Features

Usage

Past 30 Days

Not available

Not in Playground

Performance

Avg. Latency

Alternatives to Co-DETR

Other models worth comparing for similar use cases.

Meta
Detectron2
Detectron2 is a computer vision model library developed by Facebook AI Research (Meta), released in September 2019. It serves as a comprehensive platform for object detection, instance segmentation, panoptic segmentation, keypoint detection, and DensePose, implemented in PyTorch. It is the successor to the original Detectron framework, which was written in Caffe2, and offers a more modular and extensible codebase designed for both research and production use.Detectron2 includes implementations of Faster R-CNN, Mask R-CNN, RetinaNet, Cascade R-CNN, Panoptic FPN, and several other architectures. Its modular design allows components such as backbones, necks, and heads to be swapped independently, making it widely used as a baseline framework in academic research. It supports training on COCO-format datasets and integrates with standard distributed training setups.
Deci AI
YOLO-NAS
YOLO-NAS is an object detection model developed by Deci AI, released in May 2023 as part of the super-gradients open-source training library. The architecture was generated using Deci's proprietary Neural Architecture Search technology, AutoNAC, which searches for network structures that balance accuracy and inference latency on target hardware. This produced three model sizes (small, medium, and large) featuring quantization-friendly blocks that reduce accuracy loss when converting weights to INT8 precision for deployment on edge devices and mobile hardware.YOLO-NAS achieves competitive accuracy-latency tradeoffs against YOLOv5, YOLOv6, YOLOv7, and YOLOv8 on the Microsoft COCO benchmark at release, and ships with pretraining on Objects365 in addition to COCO. Note that YOLO-NAS uses a custom license: the surrounding super-gradients framework code is Apache-2.0, but the YOLO-NAS model weights are released under a separate non-commercial license that restricts production and commercial use. Teams evaluating YOLO-NAS for commercial applications should review the LICENSE.YOLONAS.md terms directly. Deci AI was acquired by NVIDIA in April 2024, and the super-gradients repository is no longer actively maintained by the original team. Users can still download and use the released weights, but no further updates or new variants are expected.
HuggingFace
YOLOS
YOLOS (You Only Look at One Sequence) is a transformer-based object detection model widely distributed through Hugging Face Transformers, released in June 2021 under the MIT license. It applies a minimally adapted Vision Transformer to object detection by representing both the image and detection tokens as a flat sequence processed by standard multi-head self-attention, without convolutional components or feature pyramid networks. The architecture demonstrates that detection can be performed without region proposals or multi-scale feature fusion.YOLOS achieves moderate performance on COCO relative to purpose-built detectors, with its primary contribution being a demonstration of the transferability of ViT pre-training to detection tasks. It is most appropriate for research contexts exploring transformer-based detection architectures and for scenarios where architectural simplicity is preferred over peak accuracy.
IDEA Research
Grounding DINO
Grounding DINO is an open-vocabulary object detection model developed by IDEA Research, released in March 2023 under the Apache 2.0 license. It extends the DINO transformer-based detector with grounded pre-training, enabling it to detect arbitrary objects described by free-form text queries rather than a fixed set of predefined categories. The model integrates a text encoder with a visual backbone through a feature fusion module that aligns language and visual representations at multiple scales.Grounding DINO achieves strong zero-shot detection performance on COCO, LVIS, and ODinW benchmarks, and supports referring expression comprehension tasks. It is widely used as a foundation for open-vocabulary detection pipelines and as the detection backbone in systems such as Grounded-SAM. The model is particularly suited for applications requiring flexible, text-driven object localization across diverse domains.
Academia Sinica
YOLOv4
YOLOv4 is an object detection model developed by Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao at Academia Sinica, released in April 2020 via the Darknet framework. It combines a CSPDarknet53 backbone, PANet neck, and YOLOv3 detection head with a large set of training improvements — Bag of Freebies and Bag of Specials — that improve accuracy with minimal inference cost increase.YOLOv4 achieves 43.5% AP on COCO at 65 FPS on a Tesla V100 GPU. The Darknet implementation is the original version, distinguishing it from subsequent PyTorch-based reimplementations. It remains a widely referenced detection architecture and a supported training target in Roboflow Inference.

Co-DETR License

MIT · Permissive license

Co-DETR is released under MIT, a permissive license. The Co-DETR license lets you use, modify, and sell work built on the model, with the copyright notice as the only real obligation and no requirement to open-source related code changes.

Commercial use
Permitted with no separate commercial license. No usage caps, revenue thresholds, or field-of-use limits apply to Co-DETR.
Modification
Permitted. You can fine-tune or rewrite Co-DETR and keep the result closed-source.
Redistribution
Permitted. Include the original copyright and permission notice in copies or substantial portions of the work.

MIT grants no explicit patent license and disclaims all warranties. If patent exposure is a concern for your deployment, review it with counsel before launch.

Read the full MIT license ↗

Do I need a commercial license for Co-DETR?

No commercial license is needed for Co-DETR: permissive terms let you keep related code private while deploying commercially.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under the MIT License, a short and permissive open-source license that allows commercial use, modification, and redistribution.

Yes. Under the terms of the MIT license, you can freely use this model for commercial purposes. You must retain the copyright notice and license text when redistributing.

License information is provided as a guide and is not legal advice.