MobileNetV2 vs CLIP

MobileNetV2 is a lightweight image classification model developed by Google Research, released in January 2018 under the Apache 2.0 license. It introduces two key architectural innovations: inverted residuals, which expand the channel dimension within each bottleneck block before applying depthwise convolution, and linear bottlenecks, which remove the non-linearity before the projection step to preserve information in low-dimensional spaces.

MobileNetV2 achieves competitive top-1 accuracy on ImageNet relative to its computational cost, making it practical for deployment on mobile devices and resource-constrained hardware. It is commonly used as a backbone for classification tasks and as a feature extractor in downstream detection and segmentation models through transfer learning. The architecture scales across a range of width and resolution multipliers, allowing developers to trade accuracy for latency based on deployment requirements.

OpenAI CLIP (Contrastive Language-Image Pretraining) is a vision-language model released in January 2021 by OpenAI. It jointly trains an image encoder and a text encoder to produce matching embeddings for image-caption pairs, using a contrastive objective over WebImageText (WIT), a dataset of 400 million image-text pairs collected from the public web. By learning to associate images with free-form text rather than a fixed set of class labels, CLIP produces a shared embedding space that enables zero-shot classification with arbitrary vocabularies at inference time.

CLIP supports zero-shot image classification by embedding candidate class labels as text and selecting the label whose embedding is closest to a given image's embedding. It is also widely used for image-text retrieval, as a frozen backbone in downstream vision-language models, and as a building block for content moderation, similarity search, and generative model guidance — notably as the text conditioning mechanism in early versions of Stable Diffusion. OpenAI released several CLIP variants built on different vision encoders, including ResNet and Vision Transformer backbones at multiple sizes and input resolutions, with ViT-L/14 at 336 pixels being the largest and most widely adopted. CLIP is distributed under the MIT license. The model has been widely influential as the basis for subsequent vision-language work — including SigLIP, OpenCLIP, and MetaCLIP — and remains a common reference baseline despite being released in 2021 and surpassed on many benchmarks by later models.