RT-DETR vs YOLOv4-tiny

RT-DETR (Real-Time Detection Transformer) is an object detection model developed by Baidu, released in April 2023 under the Apache 2.0 license. It is the first transformer-based real-time object detector, addressing the inference speed limitations of earlier DETR models through an efficient hybrid encoder that decouples intra-scale interaction and cross-scale fusion, enabling the model to process multi-scale features without the high computational overhead of standard transformer encoders.

RT-DETR achieves 53.1% AP on COCO at 108 FPS on an NVIDIA T4 GPU for the RT-DETR-L variant, outperforming comparably sized YOLO detectors at similar speeds. It maintains end-to-end inference without non-maximum suppression, simplifying deployment pipelines. RT-DETR established the baseline for real-time transformer detection and has been extended by subsequent works including RF-DETR and RT-DETRv2.

YOLOv4-tiny is a lightweight variant of YOLOv4 developed by Academia Sinica, released in November 2020. It retains the core YOLOv4 design principles while significantly reducing the number of convolutional layers and feature map channels to produce a model suitable for inference on devices with limited compute, including embedded hardware and mobile CPUs. It uses a simplified CSP backbone with fewer layers and two detection scales rather than three.

YOLOv4-tiny is optimized for scenarios where inference speed is prioritized over peak accuracy, achieving substantially higher FPS than full YOLOv4 at the cost of reduced AP on standard benchmarks. It is commonly used in robotics, embedded vision systems, and applications where real-time detection is required without GPU acceleration.