OWL-ViT vs YOLOv4

OWL-ViT (Open-World Localization with Vision Transformers) is an open-vocabulary object detection model released in May 2022 by Google Research. It adapts a pretrained CLIP-style image-text model by removing the final pooling layer and attaching lightweight classification and box prediction heads to each Transformer output token, producing a detector capable of localizing arbitrary objects described by free-form text at inference time. Rather than being restricted to a fixed taxonomy such as the 80 categories in Microsoft COCO, OWL-ViT can detect object classes specified by a user's text query, including categories the model was never explicitly trained on.

OWL-ViT accepts an image and a list of text queries as input, and produces bounding boxes with class assignments drawn from the supplied queries. It also supports one-shot image-conditioned detection, where a cropped image region is used as the query instead of text, allowing the model to find visually similar instances within a target scene. The model is released in multiple Vision Transformer sizes (ViT-B/32, ViT-B/16, ViT-L/14) and CLIP-pretrained variants, distributed through the Google Research scenic repository and Hugging Face under the Apache 2.0 license. A successor model, OWLv2, was released in June 2023, introducing the OWL-ST self-training recipe that scales training to over one billion pseudo-annotated examples and substantially improves detection performance on rare and long-tail categories while preserving the open-vocabulary interface.

YOLOv4 is an object detection model developed by Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao at Academia Sinica, released in April 2020 via the Darknet framework. It combines a CSPDarknet53 backbone, PANet neck, and YOLOv3 detection head with a large set of training improvements — Bag of Freebies and Bag of Specials — that improve accuracy with minimal inference cost increase.

YOLOv4 achieves 43.5% AP on COCO at 65 FPS on a Tesla V100 GPU. The Darknet implementation is the original version, distinguishing it from subsequent PyTorch-based reimplementations. It remains a widely referenced detection architecture and a supported training target in Roboflow Inference.