Top Real-Time Vision Models

RF-DETR Segmentation is a real-time instance segmentation model developed by Roboflow, with a preview base model released in October 2025 under the Apache 2.0 license and the full variant family — Nano through 2XL — released in January 2026. It extends the RF-DETR object detection architecture with a segmentation head inspired by MaskDINO, enabling pixel-level object delineation while maintaining the real-time performance characteristics of the base model. It is deployable through Roboflow Inference and the open-source rfdetr Python package.RF-DETR Segmentation supports fine-tuning on custom COCO- or YOLO-format instance segmentation datasets and is benchmarked on Microsoft COCO. It is suited for applications requiring both precise object masks and real-time inference, such as robotic manipulation, quality control, and augmented reality overlays.

RF-DETR is a real-time transformer-based object detection model developed by Roboflow, with code and weights first released in March 2025 under the Apache 2.0 license. It is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark, built on a DINOv2 vision transformer backbone with weight-sharing neural architecture search used to identify accuracy-latency trade-offs. The full family spans six sizes from Nano (30.5M parameters, 384×384 input) to 2XL (126.9M parameters, 880×880 input), with the accompanying research paper accepted to ICLR 2026.RF-DETR is designed for strong domain adaptability, achieving state-of-the-art performance on RF100-VL, a benchmark measuring generalization to real-world object detection tasks across diverse domains. It is deployable through Roboflow Inference and supports fine-tuning on custom datasets, making it well suited for domain-specific applications with limited training data.

YOLOE (YOLO with Everything) is an open-vocabulary object detection and segmentation model developed by THU-MIG at Tsinghua University, released in March 2025 under the AGPL-3.0 license. It extends the YOLO architecture to support open-vocabulary detection through text and visual prompts, enabling the model to detect arbitrary object categories beyond a fixed training set without retraining. The design integrates prompt encoding directly into the YOLO framework while preserving real-time inference speed.YOLOE is evaluated on COCO and LVIS benchmarks and supports both closed-set and open-vocabulary detection modes. It is built on the Ultralytics codebase and maintains compatibility with standard YOLO training and export workflows. YOLOE is suited for applications requiring flexible, prompt-driven object detection where the target object vocabulary may change at inference time.

YOLOv12 is an attention-centric real-time object detection model developed by researchers at Tsinghua University, with the arXiv paper published in February 2025 under the AGPL-3.0 license. It introduces an Area Attention module that partitions feature maps into regions and applies self-attention within each region, reducing the quadratic complexity of full self-attention while capturing long-range dependencies. It also incorporates R-ELAN for improved feature aggregation and scaled residual connections for training stability.YOLOv12-L achieves 54.0% AP on COCO, while the YOLOv12-N variant achieves 40.5% mAP at 1.62ms latency on an NVIDIA T4 GPU. The model is built on the Ultralytics codebase, supporting detection, segmentation, and other standard YOLO tasks at competitive real-time speeds.

DEIM is a training framework for DETR-based object detection models released in December 2024 by researchers at Intellindust AI Lab, City University of Hong Kong, Great Bay University, and Hefei Normal University. It enhances existing real-time DETR architectures by improving the matcher used during training, enabling faster convergence and higher accuracy without modifying the inference architecture or adding computational overhead at deployment time. DEIM introduces two core techniques: Dense One-to-One (O2O) matching, which increases the number of positive matches per target, and Matchability-Aware Loss (MAL), which down-weights low-quality matches generated by the dense strategy. The paper was accepted at CVPR 2025.When integrated with RT-DETR and D-FINE, DEIM consistently improves performance while reducing training time by up to 50%. Applied to RT-DETRv2, it achieves 53.2% AP with a single day of training on an NVIDIA 4090 GPU. DEIM-enhanced models including DEIM-D-FINE-L and DEIM-D-FINE-X achieve 54.7% and 56.5% AP at 124 and 78 FPS respectively on an NVIDIA T4 GPU. DEIM is released under the Apache 2.0 license. A successor, DEIMv2, was released in September 2025, adding DINOv3-based backbones and introducing ultra-lightweight variants (Pico, Femto, and Atto) for edge deployment.

D-FINE is a real-time object detection model introduced in October 2024 by researchers at the University of Science and Technology of China. It builds on the DETR family of transformer-based detectors by reformulating bounding box regression as a Fine-grained Distribution Refinement task. Rather than predicting box coordinates directly, D-FINE iteratively refines probability distributions over coordinate offsets across decoder layers, which provides finer localization granularity without adding inference cost. The architecture also replaces the encoder's CSP blocks with GELAN modules and inserts a Target Gating Layer after the decoder's cross-attention to reduce representational entanglement across queries. A second contribution, Global Optimal Localization Self-Distillation, transfers localization knowledge from refined deeper-layer predictions back to earlier decoder layers through internal self-distillation.D-FINE is released in five model sizes (Nano, Small, Medium, Large, and X), with D-FINE-L achieving 54.0% AP on the Microsoft COCO benchmark at 124 FPS on an NVIDIA T4 GPU, and D-FINE-X reaching 55.8% AP at 78 FPS. Pretraining on the Objects365 dataset further improves accuracy to 57.1% AP for the L variant and 59.3% AP for the X variant. The paper was accepted at ICLR 2025 as a Spotlight. Code and pretrained weights are released under the Apache 2.0 license, making the model suitable for commercial use.

YOLO11 is an object detection and multi-task vision model developed by Ultralytics, released in September 2024 under the AGPL-3.0 license. It is the latest generation in the Ultralytics YOLO series and supports object detection, instance segmentation, image classification, pose estimation, and oriented bounding box detection within a single unified framework. YOLO11 introduces architectural refinements that improve accuracy while reducing parameter count compared to YOLOv8 at equivalent model sizes.YOLO11 is available in five model sizes from Nano to Extra Large and is deployable through the Ultralytics Python package, Roboflow Inference, and export formats including ONNX, TensorRT, and CoreML. It supports fine-tuning on custom datasets through the standard Ultralytics training API.

YOLO-World v2 Small (YOLO-World-S-v2) is the smallest variant of Tencent AI Lab’s YOLO-World v2 family, released around February 2024 under GPL-v3. With ~13 million parameters, it adopts a prompt-then-detect paradigm using offline vocabularies and is pretrained on large-scale datasets such as Objects365 and GoldG. The model processes image inputs at 640×640 or 1280×1280 resolutions and supports zero-shot open-vocabulary object detection, enabling recognition of novel categories from text prompts without retraining.Evaluations show competitive results across benchmarks like LVIS and COCO, while maintaining real-time efficiency. On an NVIDIA V100, the small variant reaches ~74 FPS at standard resolutions. Together with larger YOLO-World v2 models, it provides a scalable framework for efficient, open-vocabulary detection across diverse deployment settings.

YOLOv9 is a real-time object detection model developed by Chien-Yao Wang and Hong-Yuan Mark Liao at Academia Sinica, released in February 2024 under the GPL-3.0 license. It introduces Programmable Gradient Information (PGI), a mechanism that preserves complete input information through auxiliary reversible branches during training to address information loss in deep network layers. It also introduces the Generalized Efficient Layer Aggregation Network (GELAN), which achieves better parameter utilization compared to prior CSP-based designs.YOLOv9-C achieves 53.0% AP on COCO with 42% fewer parameters and 21% less computation than YOLOv8-C at comparable accuracy. YOLOv9-E achieves 55.6% AP. The model is deployable through Roboflow Inference and supports fine-tuning via the standard training pipeline in the official repository.

Surya is an OCR and document layout analysis toolkit developed by Vikram Paruchuri and distributed via Mindee, first released in January 2024 under the GPL-3.0 license. It supports text recognition across more than 90 languages, document layout detection, reading order prediction, table recognition, and equation detection, providing a comprehensive set of tools for extracting structured information from document images.Surya is designed to operate without cloud API dependencies, running fully on local hardware with support for CPU and GPU inference. It is commonly used for digitizing scanned documents, extracting text from PDFs with complex layouts, and building automated document processing pipelines.

YOLO-NAS is an object detection model developed by Deci AI, released in May 2023 as part of the super-gradients open-source training library. The architecture was generated using Deci's proprietary Neural Architecture Search technology, AutoNAC, which searches for network structures that balance accuracy and inference latency on target hardware. This produced three model sizes (small, medium, and large) featuring quantization-friendly blocks that reduce accuracy loss when converting weights to INT8 precision for deployment on edge devices and mobile hardware.YOLO-NAS achieves competitive accuracy-latency tradeoffs against YOLOv5, YOLOv6, YOLOv7, and YOLOv8 on the Microsoft COCO benchmark at release, and ships with pretraining on Objects365 in addition to COCO. Note that YOLO-NAS uses a custom license: the surrounding super-gradients framework code is Apache-2.0, but the YOLO-NAS model weights are released under a separate non-commercial license that restricts production and commercial use. Teams evaluating YOLO-NAS for commercial applications should review the LICENSE.YOLONAS.md terms directly. Deci AI was acquired by NVIDIA in April 2024, and the super-gradients repository is no longer actively maintained by the original team. Users can still download and use the released weights, but no further updates or new variants are expected.

RT-DETR (Real-Time Detection Transformer) is an object detection model developed by Baidu, released in April 2023 under the Apache 2.0 license. It is the first transformer-based real-time object detector, addressing the inference speed limitations of earlier DETR models through an efficient hybrid encoder that decouples intra-scale interaction and cross-scale fusion, enabling the model to process multi-scale features without the high computational overhead of standard transformer encoders.RT-DETR achieves 53.1% AP on COCO at 108 FPS on an NVIDIA T4 GPU for the RT-DETR-L variant, outperforming comparably sized YOLO detectors at similar speeds. It maintains end-to-end inference without non-maximum suppression, simplifying deployment pipelines. RT-DETR established the baseline for real-time transformer detection and has been extended by subsequent works including RF-DETR and RT-DETRv2.

YOLOv8 Pose Estimation is the keypoint detection variant of the YOLOv8 model developed by Ultralytics, released in April 2023 under the AGPL-3.0 license. It extends the YOLOv8 detection head to predict keypoint locations and visibility scores alongside bounding boxes, using a decoupled head for joint localization and keypoint regression. By default it targets the 17-keypoint COCO human pose skeleton, but can be configured for custom keypoint sets.YOLOv8 Pose shares the same architecture and size variants as the base detection model and achieves competitive performance on the COCO keypoints benchmark at real-time inference speeds. The model is deployable through Roboflow Inference and is suited for applications including sports analytics, ergonomics monitoring, gesture recognition, and human activity detection.

YOLOv8 is an object detection and multi-task vision model developed by Ultralytics, released in January 2023 under the AGPL-3.0 license. It succeeds YOLOv5 and introduces an anchor-free detection head, a new C2f module for improved gradient flow, and a decoupled head that separates classification and regression tasks. These changes improve both accuracy and training efficiency compared to earlier Ultralytics models.YOLOv8 supports object detection, instance segmentation, image classification, pose estimation, and oriented bounding box detection within a unified codebase. It is available in five sizes from Nano to Extra Large and exports to ONNX, TensorRT, CoreML, and other formats. YOLOv8 is one of the most widely adopted detection models in production and is directly supported by Roboflow Inference for custom model training and deployment.

YOLOv8 Classification is the image classification variant of the YOLOv8 model family from Ultralytics, released in January 2023. Unlike the primary YOLOv8 detection and segmentation models, which predict bounding boxes or pixel masks, YOLOv8 Classification predicts a single class label for a full input image, supporting standard single-label image classification tasks. It shares the YOLOv8 backbone architecture, including the C2f (Cross-Stage Partial with 2 convolutions) module, with the detection variants, making it straightforward to use within the same Ultralytics training and inference workflow as other YOLOv8 tasks.YOLOv8 Classification is released at five sizes: YOLOv8n-cls (nano, 2.7M parameters), YOLOv8s-cls (small, 6.4M), YOLOv8m-cls (medium, 17.0M), YOLOv8l-cls (large, 37.5M), and YOLOv8x-cls (extra-large, 57.4M). These variants allow users to trade off accuracy against inference speed and memory footprint. Pretrained checkpoints are provided for ImageNet classification at 224 pixel resolution, and the model can be fine-tuned on custom datasets using the Ultralytics Python API or command-line tools. The model supports export to common deployment formats including ONNX, TensorRT, CoreML, and TensorFlow Lite. YOLOv8 Classification is distributed under the AGPL-3.0 license, with an Enterprise License available from Ultralytics for proprietary deployments. The YOLOv8 family has since been succeeded by YOLO11 (September 2024) and YOLO26 (January 2026), each of which includes equivalent classification variants.

YOLOv8 Instance Segmentation is the segmentation variant of the YOLOv8 model developed by Ultralytics, released in January 2023 under the AGPL-3.0 license. It extends the standard YOLOv8 detection head with a mask prediction branch that generates pixel-level segmentation masks for each detected object using a prototype mask approach. This enables real-time instance segmentation within a single forward pass.YOLOv8 Instance Segmentation shares the same backbone and neck architecture as the base detection model and is available in the same size range. It is deployable through Roboflow Inference and supports fine-tuning on custom COCO-format segmentation datasets. It is suited for applications requiring both object localization and precise mask prediction at real-time speeds.

RTMDet is a real-time object detection model developed by OpenMMLab, released in December 2022 under the GPL-3.0 license. It adopts a single-stage detection architecture with large-kernel depthwise convolution in both the backbone and neck, enabling it to capture long-range spatial dependencies without the computational cost of full self-attention. The model family spans from RTMDet-tiny to RTMDet-x, covering a wide range of speed-accuracy operating points.RTMDet-x achieves 52.6% AP on COCO at 114 FPS on an NVIDIA 3090 GPU. The architecture supports instance segmentation and rotated object detection variants. RTMDet is included in the OpenMMLab ecosystem and is well suited for applications requiring fast, accurate detection with flexible model sizing.

YOLOv7 is a real-time object detection model developed by Chien-Yao Wang and Hong-Yuan Mark Liao at Academia Sinica, released in July 2022 under the GPL-3.0 license. It introduces Extended Efficient Layer Aggregation Networks (E-ELAN) for improved gradient flow in the backbone, and trainable bag-of-freebies techniques including coarse-to-fine lead guided label assignment and auxiliary heads that improve accuracy without adding inference cost.YOLOv7 achieves 56.8% AP on COCO at 30 FPS on a V100 GPU at the time of release, establishing a strong accuracy-speed tradeoff among real-time detectors. It supports detection, instance segmentation, and pose estimation variants. YOLOv7 is deployable through Roboflow Inference and the standard training pipeline in the official repository.

ByteTrack is a multi-object tracking algorithm developed by ByteDance, released in October 2021. It addresses a core limitation of earlier tracking methods by associating every detection box — not just high-confidence ones — with tracklets using a two-stage matching process. Low-score detection boxes, which typically correspond to occluded or blurry objects, are retained in a secondary matching step against unmatched tracklets, significantly reducing the number of lost tracks.ByteTrack achieves strong performance on the MOT17 and MOT20 benchmarks at the time of release, operating in real time on standard GPU hardware. It is architecture-agnostic and can be paired with any object detector, making it straightforward to integrate into existing detection pipelines for video analytics, surveillance, and sports tracking applications.

YOLOS (You Only Look at One Sequence) is a transformer-based object detection model widely distributed through Hugging Face Transformers, released in June 2021 under the MIT license. It applies a minimally adapted Vision Transformer to object detection by representing both the image and detection tokens as a flat sequence processed by standard multi-head self-attention, without convolutional components or feature pyramid networks. The architecture demonstrates that detection can be performed without region proposals or multi-scale feature fusion.YOLOS achieves moderate performance on COCO relative to purpose-built detectors, with its primary contribution being a demonstration of the transferability of ViT pre-training to detection tasks. It is most appropriate for research contexts exploring transformer-based detection architectures and for scenarios where architectural simplicity is preferred over peak accuracy.

YOLOv5 is an object detection model developed by Ultralytics, released in June 2020 under the AGPL-3.0 license. It is implemented in PyTorch and introduced a more accessible and well-documented YOLO implementation compared to earlier Darknet-based versions, with an integrated training and export pipeline supporting a wide range of deployment targets. YOLOv5 uses a CSP backbone, PANet neck, and a single-stage detection head with anchor-based regression.YOLOv5 is available in five sizes from Nano to Extra Large and supports export to ONNX, TensorRT, CoreML, and other formats. It is one of the most widely deployed object detection models in production environments and remains a common starting point for custom detection model training due to its documentation, community support, and compatibility with Roboflow Inference.

MediaPipe is an open-source framework developed by Google for building real-time machine learning pipelines across mobile, web, desktop, and edge platforms. First released in 2019, the framework uses a graph-based architecture where pre-built components called Calculators process streaming data such as images, video, and audio through configurable computation graphs. This design allows developers to compose perception pipelines from reusable building blocks without writing custom glue code between models. The current MediaPipe Tasks API replaces the earlier Solutions API and provides a unified cross-platform interface for vision, text, and audio.Rather than providing a single model, MediaPipe ships a suite of ready-to-use Tasks that wrap trained models for specific problems. These include MediaPipe Pose Landmarker for 33-point body landmark detection, Hand Landmarker for 21-point hand tracking, Face Landmarker which extends the earlier 468-point Face Mesh with blendshape outputs for facial expression, Selfie Segmentation for person-background separation, and Holistic Landmarker for combined body, hand, and face tracking. The Tasks prioritize on-device inference with low latency and support GPU acceleration where available, making the framework a common choice for mobile augmented reality, fitness and wellness applications, gesture-based interfaces, and accessibility features such as sign language recognition.

MobileNet SSD v2 is a lightweight object detection model developed by Google Research, released in January 2018. It combines the MobileNetV2 backbone with the Single Shot MultiBox Detector (SSD) framework to produce a model optimized for inference on mobile and edge devices. MobileNetV2 introduces inverted residuals and linear bottlenecks to reduce computation while maintaining representational capacity compared to its predecessor.MobileNet SSD v2 is designed for real-time on-device detection, making it suitable for mobile apps, embedded systems, and IoT devices. It performs object detection across a fixed set of categories and can be fine-tuned on custom datasets. It trades peak accuracy for reduced inference cost and model size relative to larger two-stage detectors.