OWL-ViT vs YOLOv4-tiny

OWL-ViT (Open-World Localization with Vision Transformers) is an open-vocabulary object detection model released in May 2022 by Google Research. It adapts a pretrained CLIP-style image-text model by removing the final pooling layer and attaching lightweight classification and box prediction heads to each Transformer output token, producing a detector capable of localizing arbitrary objects described by free-form text at inference time. Rather than being restricted to a fixed taxonomy such as the 80 categories in Microsoft COCO, OWL-ViT can detect object classes specified by a user's text query, including categories the model was never explicitly trained on.

OWL-ViT accepts an image and a list of text queries as input, and produces bounding boxes with class assignments drawn from the supplied queries. It also supports one-shot image-conditioned detection, where a cropped image region is used as the query instead of text, allowing the model to find visually similar instances within a target scene. The model is released in multiple Vision Transformer sizes (ViT-B/32, ViT-B/16, ViT-L/14) and CLIP-pretrained variants, distributed through the Google Research scenic repository and Hugging Face under the Apache 2.0 license. A successor model, OWLv2, was released in June 2023, introducing the OWL-ST self-training recipe that scales training to over one billion pseudo-annotated examples and substantially improves detection performance on rare and long-tail categories while preserving the open-vocabulary interface.

YOLOv4-tiny is a lightweight variant of YOLOv4 developed by Academia Sinica, released in November 2020. It retains the core YOLOv4 design principles while significantly reducing the number of convolutional layers and feature map channels to produce a model suitable for inference on devices with limited compute, including embedded hardware and mobile CPUs. It uses a simplified CSP backbone with fewer layers and two detection scales rather than three.

YOLOv4-tiny is optimized for scenarios where inference speed is prioritized over peak accuracy, achieving substantially higher FPS than full YOLOv4 at the cost of reduced AP on standard benchmarks. It is commonly used in robotics, embedded vision systems, and applications where real-time detection is required without GPU acceleration.