docTR vs TrOCR

docTR (Document Text Recognition) is an open-source OCR toolkit developed by Mindee, with its initial public release in March 2021 under the Apache 2.0 license. It provides end-to-end document text recognition through a two-stage pipeline consisting of text detection and text recognition, both implemented as deep learning models. docTR supports multiple detection architectures including DBNet and LinkNet, and recognition architectures including CRNN and SAR, with both TensorFlow and PyTorch backends available.

docTR is designed for reading text in document images including scanned PDFs, photographs of printed documents, and forms. It handles multilingual text recognition across standard Latin-script languages and is deployable through Roboflow Inference. It is suited for document digitization pipelines, automated form processing, and applications requiring accurate structured text extraction from document images.

TrOCR (Transformer-based Optical Character Recognition) is an end-to-end OCR model released in September 2021 by Microsoft Research. It departs from the traditional two-stage OCR pipeline — which typically combines a CNN-based feature extractor with an RNN-based sequence decoder — by using a pure Transformer architecture composed of a pretrained image Transformer encoder and a pretrained text Transformer decoder, an approach that later became standardized as the VisionEncoderDecoder pattern in Hugging Face Transformers.

TrOCR takes a cropped text line image as input and produces a sequence of output tokens, supporting printed, handwritten, and scene text recognition. The model is designed for use downstream of a separate text detection stage — TrOCR recognizes text in pre-cropped regions rather than detecting text locations in a full page. Microsoft released three size variants: TrOCR-small (62M parameters, DeiT-small encoder + MiniLM decoder), TrOCR-base (334M parameters, BEiT-base encoder + RoBERTa-large decoder), and TrOCR-large (558M parameters, BEiT-large encoder + RoBERTa-large decoder). Pretrained and fine-tuned checkpoints are available for printed text (on SROIE), handwritten text (on IAM), and scene text (on the standard scene text benchmarks) under the MIT license, distributed through the Microsoft unilm repository and Hugging Face. At release, TrOCR achieved state-of-the-art results across all three benchmark categories, and the model continues to be used as a baseline for handwritten text recognition.