Vision Transformer (ViT) vs YOLOv8 Classification

Vision Transformer is an image classification model developed by Google Research, first published in October 2020. It applies the transformer architecture directly to sequences of image patches without convolutional layers. Each image is divided into fixed-size patches, linearly projected into embeddings, and processed by a standard transformer encoder with multi-head self-attention. A classification token prepended to the patch sequence aggregates global image information for the final prediction.

When pre-trained on large datasets such as JFT-300M and fine-tuned on ImageNet, ViT achieves competitive accuracy with state-of-the-art CNNs of the period. It performs best when pre-training data is abundant, as the lack of convolutional inductive biases makes it less data-efficient than CNN-based classifiers on smaller datasets. ViT established the foundation for transformer-based vision architectures and has influenced a broad range of subsequent models.

YOLOv8 Classification is the image classification variant of the YOLOv8 model family from Ultralytics, released in January 2023. Unlike the primary YOLOv8 detection and segmentation models, which predict bounding boxes or pixel masks, YOLOv8 Classification predicts a single class label for a full input image, supporting standard single-label image classification tasks. It shares the YOLOv8 backbone architecture, including the C2f (Cross-Stage Partial with 2 convolutions) module, with the detection variants, making it straightforward to use within the same Ultralytics training and inference workflow as other YOLOv8 tasks.

YOLOv8 Classification is released at five sizes: YOLOv8n-cls (nano, 2.7M parameters), YOLOv8s-cls (small, 6.4M), YOLOv8m-cls (medium, 17.0M), YOLOv8l-cls (large, 37.5M), and YOLOv8x-cls (extra-large, 57.4M). These variants allow users to trade off accuracy against inference speed and memory footprint. Pretrained checkpoints are provided for ImageNet classification at 224 pixel resolution, and the model can be fine-tuned on custom datasets using the Ultralytics Python API or command-line tools. The model supports export to common deployment formats including ONNX, TensorRT, CoreML, and TensorFlow Lite. YOLOv8 Classification is distributed under the AGPL-3.0 license, with an Enterprise License available from Ultralytics for proprietary deployments. The YOLOv8 family has since been succeeded by YOLO11 (September 2024) and YOLO26 (January 2026), each of which includes equivalent classification variants.