Google: PaliGemma 2

PaliGemma is a vision-language model released in May 2024 by Google, built by pairing the SigLIP-So400m vision encoder with the Gemma 2B language model. It is designed primarily as a compact, transfer-friendly base model for fine-tuning to downstream vision-language tasks, rather than as a chat-optimized assistant. PaliGemma draws architectural inspiration from the PaLI-3 model at Google Research, applying a similar encoder-decoder approach at a smaller and more accessible parameter scale.PaliGemma accepts an image together with a text prompt and generates text output, supporting image captioning, visual question answering, optical character recognition, object detection, referring expression segmentation, and a range of related vision-language tasks when fine-tuned on task-specific data. The model is released at three input resolutions (224, 448, and 896 pixels), with higher resolutions providing stronger performance on tasks requiring fine visual detail such as OCR and document understanding. Google released pretrained (PT) checkpoints intended as fine-tuning bases, along with Mix variants that have been fine-tuned on a mixture of downstream tasks for direct use without additional training. PaliGemma is distributed under the Gemma license, a custom license from Google that permits commercial use subject to the terms of the Gemma Prohibited Use Policy. It was succeeded by PaliGemma 2 in December 2024, which extends the architecture to larger Gemma 2 language backbones at 3B, 10B, and 28B parameter sizes.

Gemma 3 4B, released on March 12, 2025, is the mid-sized member of Google DeepMind’s open-weight Gemma 3 family. With about 4 billion parameters, it is multimodal—supporting text and image inputs and generating text outputs. Like the larger Gemma 3 models, it features a 128,000-token input context window with an output capacity of ~8,192 tokens, enabling it to handle long documents and mixed text–image reasoning tasks.The 4B variant is designed as a balance between efficiency and capability: it offers multilingual support across 140+ languages, strong summarization and reasoning performance, and compatibility with moderate hardware. Inference can run with ~6.4 GB VRAM in BF16, or significantly less in quantized 8-bit (~4.4 GB) or 4-bit (~3.4 GB) modes, making it accessible to developers outside large-scale infrastructure. While it lags behind the 12B and 27B versions on the most complex reasoning and multimodal benchmarks, its lower compute footprint makes it ideal for research, prototyping, and practical deployment where efficiency matters.

Qwen2.5-VL-7B-Instruct is a 7-billion parameter vision-language model from Alibaba’s QwenLM team, released on January 26, 2025 under the Apache 2.0 license. It is the instruction-tuned variant of the 7B scale in the Qwen2.5-VL family, designed to process multimodal inputs such as text, images, charts, documents, and video. The model enables structured outputs—including JSON for structured content and bounding boxes for visual localization. Weights are publicly available on Hugging Face and GitHub, making it suitable for both research and applied multimodal use.