Roboflow
Google

Google: PaliGemma 2

PaliGemma 2 Overview

PaliGemma 2 is a vision-language model released in December 2024 by Google DeepMind. It pairs the SigLIP-So400m vision encoder with the Gemma 2 language model family, extending the original PaliGemma architecture with stronger language capabilities and a wider set of transfer benchmarks. The model is designed primarily as a fine-tuning base rather than a chat-optimized assistant. Google releases pretrained "PT" checkpoints intended for task-specific adaptation rather than direct out-of-the-box use.

PaliGemma 2 accepts an image paired with a text prompt and generates natural language output, supporting image captioning, visual question answering, optical character recognition, document understanding, object detection and segmentation (with appropriate fine-tuning), and a range of specialized vision-language tasks. The model is released at three parameter sizes (3B, 10B, and 28B), built on the Gemma 2 2B, 9B, and 27B language backbones. Each size is available at three input resolutions: 224, 448, and 896 pixels. Alongside the base PT checkpoints, Google released PaliGemma 2 Mix variants that have been tuned on a mixture of downstream tasks to provide stronger out-of-the-box performance for common applications such as OCR and document parsing. PaliGemma 2 is distributed under the Gemma license, a custom license from Google that permits commercial use subject to the terms of the Gemma Prohibited Use Policy.

PaliGemma 2 Details & Performance

Details

Vision Tasks

Vision LanguageOCRCaptioningVisual Question Answering

Features

Multimodal VisionLLMs with Vision Capabilities

Usage

Past 30 Days

Not available

Not in Playground

Performance

Avg. Latency

Alternatives to PaliGemma 2

Other models worth comparing for similar use cases.

Google
Gemma 3 4B
Gemma 3 4B, released on March 12, 2025, is the mid-sized member of Google DeepMind’s open-weight Gemma 3 family. With about 4 billion parameters, it is multimodal—supporting text and image inputs and generating text outputs. Like the larger Gemma 3 models, it features a 128,000-token input context window with an output capacity of ~8,192 tokens, enabling it to handle long documents and mixed text–image reasoning tasks.The 4B variant is designed as a balance between efficiency and capability: it offers multilingual support across 140+ languages, strong summarization and reasoning performance, and compatibility with moderate hardware. Inference can run with ~6.4 GB VRAM in BF16, or significantly less in quantized 8-bit (~4.4 GB) or 4-bit (~3.4 GB) modes, making it accessible to developers outside large-scale infrastructure. While it lags behind the 12B and 27B versions on the most complex reasoning and multimodal benchmarks, its lower compute footprint makes it ideal for research, prototyping, and practical deployment where efficiency matters.
Qwen
Qwen3 VL 8B Instruct
Qwen3 VL 8B Instruct is an open-weight multimodal vision-language model developed by Qwen / Alibaba Cloud as part of the Qwen3-VL series, designed for instruction-following tasks that combine text with visual inputs such as images and video. Released around October 2025 under the Apache-2.0 license, it targets developers who need capable multimodal reasoning without the scale or cost of very large models.The model contains roughly 8.8 billion dense parameters and supports text, image, and video understanding with strong spatial perception, visual reasoning, and emerging visual agent abilities such as GUI interaction. A standout feature is its native ~256K token context window, extendable to around 1M tokens, enabling long-document reading and extended video comprehension. In today’s landscape, it balances openness, long-context capacity, and solid multimodal performance against heavier proprietary models. Typical applications include multimodal assistants, document and video analysis, visual question answering, and research or product prototyping where transparency and deployability matter.
HuggingFace
SmolVLM2
SmolVLM2 is a compact multimodal vision-language model developed by the Hugging Face TB Research team, released in February 2025 under the Apache 2.0 license. It is designed for efficient image and video understanding on resource-constrained hardware, with model variants ranging from 256M to 2.2B parameters. SmolVLM2 processes images, multi-image inputs, and video alongside text queries to generate text outputs for tasks including visual question answering, image captioning, and OCR.SmolVLM2 is designed for on-device and edge deployment, requiring substantially less GPU memory than comparable multimodal models. It supports standard fine-tuning pipelines via the Hugging Face transformers library and quantization through bitsandbytes. SmolVLM2 is suited for applications where a capable vision-language model is needed without full server-scale infrastructure.
Moondream
Moondream 2
Moondream 2 is a small open-source vision-language model from Moondream, the company founded by Vikhyat Korrapati. It was first released in early 2024 and updated through mid-2025. At approximately 1.9 billion parameters, it is designed to run efficiently on consumer hardware such as laptops and edge devices while supporting a practical range of multimodal tasks. Moondream 2 combines a vision encoder based on SigLIP with a compact language backbone, trained for image understanding tasks rather than as a general chat model.The model accepts an image paired with a natural language prompt and produces text responses, supporting visual question answering, image captioning, and image-conditioned dialogue. Later Moondream 2 releases added object localization through a point API that returns coordinates for queried objects, along with improvements to OCR, counting, and document understanding. Moondream 2 is distributed under the Apache 2.0 license and is available through Hugging Face and the maintainer's distribution. Because the model is updated frequently, production deployments should pin to a specific revision rather than tracking the latest release. A successor model, Moondream 3 (Preview), was released in September 2025 with a 9B mixture-of-experts architecture and 2B active parameters, offering substantially stronger visual reasoning than Moondream 2 while retaining the efficiency-focused design. A referring expression segmentation extension to Moondream 3 was released in March 2026.
Azure
Florence-2
Florence-2, introduced by Microsoft Research at CVPR 2024, is an open-source vision-language foundation model designed to unify diverse computer vision tasks within a single sequence-to-sequence framework. Unlike traditional models that specialize in specific tasks, Florence-2 accepts both images and text prompts and outputs text for tasks such as captioning, object detection, segmentation, OCR, and region-based grounding. It comes in two sizes—Florence-2-base (~230M parameters) and Florence-2-large (~770M parameters)—and is trained on FLD-5B, a large dataset of ~126M images with ~5.4B annotations.The model demonstrates strong zero-shot and fine-tuned performance, often rivaling larger vision-language systems while remaining lightweight and efficient. Released under the MIT license, all weights are publicly available, making it accessible for fine-tuning and deployment in applications like VQA, content tagging, accessibility, and research. Florence-2’s compact design, versatility, and openness position it as a practical alternative to larger proprietary multimodal models.
Google
Gemini 3.5 Flash-Lite
Gemini 3.5 Flash-Lite is a natively multimodal reasoning model developed by Google DeepMind, released on July 21, 2026 as part of the Gemini 3.5 model family. It is the fastest model in the 3.5 series, designed for both low-latency tasks and high-throughput production workloads such as agentic search, document processing, receipt translation, and large-scale data extraction. The model accepts text, images, audio, and video as inputs, with a context window of up to 1 million tokens, and produces text output. It supports configurable thinking levels, allowing developers to tune the balance between response quality, cost, and latency depending on workload requirements.On agentic and coding benchmarks, Gemini 3.5 Flash-Lite significantly outperforms its predecessor, Gemini 3.1 Flash-Lite, including on Terminal-Bench 2.1 (54% vs. 31%), GDM-MRCR v2 long-context (72.2% vs. 60.1%), and real-world task execution as measured by GDPval-AA v2 (1140 vs. 642). It also surpasses Gemini 3 Flash on SWE-Bench Pro (54.2% vs. 49.6%) and OSWorld-Verified (74.0% vs. 65.1%). According to the Artificial Analysis Index, the model generates output at approximately 350 tokens per second. It is built on the Gemini 3.5 Flash foundation and is evaluated across reasoning, coding, multimodal understanding, multilingual performance, and long-context tasks. The model is developed under Google's Frontier Safety Framework.

PaliGemma 2 License

Custom License · Model-specific license

PaliGemma 2 ships under a custom, model-specific license rather than a standard permissive or restrictive one, so the PaliGemma 2 license has to be read directly. Custom model licenses range from effectively permissive to research-only.

Commercial use
Varies. Custom model licenses commonly restrict commercial use, cap monthly active users, or carve out specific industries — check the PaliGemma 2 terms before you build on it.
Modification
Usually permitted for fine-tuning, but check whether derivative weights inherit the same license and naming requirements.
Redistribution
Often restricted. Look for attribution, naming, and acceptable-use requirements that apply to any copy you share.

Uncertainty around licensing can delay or stop a project, and acceptable-use policies attached to custom licenses are binding terms rather than guidance. Review them alongside the PaliGemma 2 license before production deployment.

Do I need a commercial license for PaliGemma 2?

If the custom terms rule out your use case, a commercial license from the rights holder is the way through. Roboflow's licensing page lists the supported models whose commercial license is included in a Roboflow plan, so it is worth checking whether PaliGemma 2 — or a permissively licensed alternative — fits your deployment.

Do not hesitate to reach out with questions for your commercial project — our team will help you start solving business problems on the first call. See Roboflow commercial licensing for the models included in each plan.

Talk to sales

This model is released under a custom license that does not match a standard open-source identifier. Read the full license text linked from the model documentation.

Custom licenses vary widely in what they permit. Many model-specific custom licenses include commercial-use restrictions (e.g., non-commercial weights, named-user limits, or jurisdiction restrictions). Read the full license before deploying commercially.

Custom licenses are model-specific. Always check the per-model License Notes section above and the linked official license text.

PaliGemma 2 is released under Google's Gemma license. Review the Gemma Terms of Use before commercial deployment.

License information is provided as a guide and is not legal advice.