Roboflow
Google

Google: Vision Transformer (ViT)

Vision Transformer (ViT) Overview

Vision Transformer is an image classification model developed by Google Research, first published in October 2020. It applies the transformer architecture directly to sequences of image patches without convolutional layers. Each image is divided into fixed-size patches, linearly projected into embeddings, and processed by a standard transformer encoder with multi-head self-attention. A classification token prepended to the patch sequence aggregates global image information for the final prediction.

When pre-trained on large datasets such as JFT-300M and fine-tuned on ImageNet, ViT achieves competitive accuracy with state-of-the-art CNNs of the period. It performs best when pre-training data is abundant, as the lack of convolutional inductive biases makes it less data-efficient than CNN-based classifiers on smaller datasets. ViT established the foundation for transformer-based vision architectures and has influenced a broad range of subsequent models.

Vision Transformer (ViT) Details & Performance

Details

Resources

Vision Tasks

Classification

Features

Usage

Past 30 Days

Not available

Not in Playground

Performance

Avg. Latency

Alternatives to Vision Transformer (ViT)

Other models worth comparing for similar use cases.

YOLOv8 Classification
YOLOv8 Classification is the image classification variant of the YOLOv8 model family from Ultralytics, released in January 2023. Unlike the primary YOLOv8 detection and segmentation models, which predict bounding boxes or pixel masks, YOLOv8 Classification predicts a single class label for a full input image, supporting standard single-label image classification tasks. It shares the YOLOv8 backbone architecture, including the C2f (Cross-Stage Partial with 2 convolutions) module, with the detection variants, making it straightforward to use within the same Ultralytics training and inference workflow as other YOLOv8 tasks.YOLOv8 Classification is released at five sizes: YOLOv8n-cls (nano, 2.7M parameters), YOLOv8s-cls (small, 6.4M), YOLOv8m-cls (medium, 17.0M), YOLOv8l-cls (large, 37.5M), and YOLOv8x-cls (extra-large, 57.4M). These variants allow users to trade off accuracy against inference speed and memory footprint. Pretrained checkpoints are provided for ImageNet classification at 224 pixel resolution, and the model can be fine-tuned on custom datasets using the Ultralytics Python API or command-line tools. The model supports export to common deployment formats including ONNX, TensorRT, CoreML, and TensorFlow Lite. YOLOv8 Classification is distributed under the AGPL-3.0 license, with an Enterprise License available from Ultralytics for proprietary deployments. The YOLOv8 family has since been succeeded by YOLO11 (September 2024) and YOLO26 (January 2026), each of which includes equivalent classification variants.
OpenAI
CLIP
OpenAI CLIP (Contrastive Language-Image Pretraining) is a vision-language model released in January 2021 by OpenAI. It jointly trains an image encoder and a text encoder to produce matching embeddings for image-caption pairs, using a contrastive objective over WebImageText (WIT), a dataset of 400 million image-text pairs collected from the public web. By learning to associate images with free-form text rather than a fixed set of class labels, CLIP produces a shared embedding space that enables zero-shot classification with arbitrary vocabularies at inference time.CLIP supports zero-shot image classification by embedding candidate class labels as text and selecting the label whose embedding is closest to a given image's embedding. It is also widely used for image-text retrieval, as a frozen backbone in downstream vision-language models, and as a building block for content moderation, similarity search, and generative model guidance — notably as the text conditioning mechanism in early versions of Stable Diffusion. OpenAI released several CLIP variants built on different vision encoders, including ResNet and Vision Transformer backbones at multiple sizes and input resolutions, with ViT-L/14 at 336 pixels being the largest and most widely adopted. CLIP is distributed under the MIT license. The model has been widely influential as the basis for subsequent vision-language work — including SigLIP, OpenCLIP, and MetaCLIP — and remains a common reference baseline despite being released in 2021 and surpassed on many benchmarks by later models.
SAM-CLIP
SAM-CLIP is a unified vision foundation model introduced by researchers at Apple and the University of Illinois Urbana-Champaign in October 2023. It merges two popular vision foundation models — Meta's Segment Anything Model (SAM) and OpenAI's CLIP — into a single shared Vision Transformer backbone through a combination of multi-task learning, continual learning, and teacher-student distillation. The method requires only a small fraction of the original pretraining datasets and demonstrates that complementary capabilities from distinct foundation models can be consolidated without retraining from scratch, reducing the storage and compute cost of running both models in inference.The resulting model retains SAM's zero-shot segmentation ability and CLIP's zero-shot classification and image-text retrieval, while introducing new capabilities the individual models lacked. SAM-CLIP establishes state-of-the-art results on zero-shot semantic segmentation across five benchmarks, improving mean IoU by 6.8 points on Pascal VOC and 5.9 points on COCO-Stuff over prior specialized models. The paper was accepted at the UniReps Workshop at NeurIPS 2023 and the eLVM Workshop at CVPR 2024. Apple has published the research but has not released model weights or inference code publicly.
Google
Gemini 3.5 Flash-Lite
Gemini 3.5 Flash-Lite is a natively multimodal reasoning model developed by Google DeepMind, released on July 21, 2026 as part of the Gemini 3.5 model family. It is the fastest model in the 3.5 series, designed for both low-latency tasks and high-throughput production workloads such as agentic search, document processing, receipt translation, and large-scale data extraction. The model accepts text, images, audio, and video as inputs, with a context window of up to 1 million tokens, and produces text output. It supports configurable thinking levels, allowing developers to tune the balance between response quality, cost, and latency depending on workload requirements.On agentic and coding benchmarks, Gemini 3.5 Flash-Lite significantly outperforms its predecessor, Gemini 3.1 Flash-Lite, including on Terminal-Bench 2.1 (54% vs. 31%), GDM-MRCR v2 long-context (72.2% vs. 60.1%), and real-world task execution as measured by GDPval-AA v2 (1140 vs. 642). It also surpasses Gemini 3 Flash on SWE-Bench Pro (54.2% vs. 49.6%) and OSWorld-Verified (74.0% vs. 65.1%). According to the Artificial Analysis Index, the model generates output at approximately 350 tokens per second. It is built on the Gemini 3.5 Flash foundation and is evaluated across reasoning, coding, multimodal understanding, multilingual performance, and long-context tasks. The model is developed under Google's Frontier Safety Framework.

Vision Transformer (ViT) License

Apache-2.0 · Permissive license

Vision Transformer (ViT) is released under Apache-2.0, a permissive license. The Vision Transformer (ViT) license lets you run, fine-tune, and redistribute the model in commercial products with no obligation to open-source related code changes, so no separate commercial license is required.

Commercial use
Permitted. Because Apache-2.0 is permissive, Vision Transformer (ViT) can ship inside paid products and internal systems with no commercial license and no revenue threshold.
Modification
Permitted. Fine-tuning, quantizing, and distilling are all allowed, and your code changes can stay closed. Files you change must be marked as changed.
Redistribution
Permitted with attribution. Ship the Apache-2.0 license text and any NOTICE file alongside the weights or derived code.

Apache-2.0 grants an express patent license that terminates if you bring a patent claim over the work, and it disclaims warranties. Validate Vision Transformer (ViT) on your own data before you depend on it in production.

Read the full Apache 2.0 license ↗

Do I need a commercial license for Vision Transformer (ViT)?

This is the straightforward case: a permissive license is the best technical solution and you are free to deploy Vision Transformer (ViT) commercially without open-sourcing your own code.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under the Apache License 2.0, a permissive open-source license that allows commercial use, modification, distribution, and patent use.

Yes. Under the terms of the Apache 2.0 license, you can freely use this model for commercial purposes, including in proprietary products. You must retain the copyright notice and disclaimers when redistributing.

License information is provided as a guide and is not legal advice.