OCR Benchmark
The OCR task asks each model to read and transcribe every piece of text in an image, exactly as it appears. The test set spans printed documents, handwriting, code, receipts, forms, math, and hard-to-read strings such as serial numbers and license plates. Capitalization, punctuation, symbols, and layout must be preserved, and nothing may be summarized, corrected, or skipped.
Evals updated July 10, 2026Pricing updated July 17, 2026
| 1 | 94.0% | 1.9K | $0.039 | 10.9s | ||
| 2 | 93.8% | 1.9K | $0.020 | 8.3s | ||
| 3 | 92.6% | 1.5K | $0.0066 | 6.0s | ||
| 4 | 91.7% | 1.9K | $0.0078 | 7.2s | ||
| 5 | 91.2% | 1.8K | $0.023 | 9.5s | ||
| 6 | 91.1% | 2.7K | $0.016 | 7.4s | ||
| 7 | 90.7% | 2.1K | $0.032 | 13.4s | ||
| 8 | GLM 5V Turbo | 89.3% | 1.7K | $0.0030 | 12.5s | |
| 9 | 88.8% | 748 | $0.0047 | 5.2s | ||
| 10 | 88.8% | 2.1K | $0.016 | 9.7s | ||
| 11 | Kimi K2.6 | 88.5% | 1.7K | $0.0021 | 16.2s | |
| 12 | 88.4% | 2.0K | $0.0058 | 5.1s | ||
| 13 | 88.1% | 1.5K | $0.0010 | 10.5s | ||
| 14 | 88.1% | 2.0K | $0.0042 | 6.2s | ||
| 15 | 87.6% | 1.8K | $0.0024 | 4.2s | ||
| 16 | Qwen 3.7 Plus | 86.5% | 1.5K | $0.0009 | 10.4s |
Score vs. cost
OCR score (Mean Similarity) against estimated cost per sample. Upper-left is the sweet spot: high quality at low cost.
16 models on the current benchmark · OCR task only
Example OCR benchmark tasks
Real samples from the benchmark: the image each model sees, the question it is asked, and the ground-truth answer it is scored against.
The models are asked
Transcribe all handwritten and printed text exactly as written, reading top to bottom and left to right, and omit nothing; mark only genuinely unreadable words as [illegible]. Output plain text only, with no Markdown or HTML, and use a single space wherever text is indented or aligned.
Ground truth
100 Good Cookies 1 cup white sugar 1 teaspoon baking soda 1 cup brown sugar 1 cup quick oatmeal 1 cup margarine 1 cup coconut 1 cup cooking oil 1 cup Rice Krispies 1 egg 1 cup chopped walnuts 1 teaspoon vanilla 3½ cups flour 1 teaspoon cream of tartar 1-12oz. package mini chocolate chips Mix in order given. Drop by teaspoonful onto cookie sheet. Bake at 350° for 8-10 minutes. (over)
The models are asked
Transcribe all text exactly as written, reading top to bottom and left to right, and omit nothing. Output plain text only, with no Markdown or HTML, and use a single space wherever text is indented or aligned.
Ground truth
COST OF LIVING The following figures are a general guide to essential monthly expenses for an expatriate executive living in Azerbaijan. Married Single couple with person two children (US$) (US$) Rent 800 3,000 Food 300 1,200 Transport 150 300 Utilities 100 150 Education n. a. 1,000 Miscellaneous 500 1,000 Total 1,850 6,650
The models are asked
Transcribe all text in this document exactly and completely, in reading order, preserving casing, punctuation, currency symbols, and codes. Use an HTML table only for genuinely tabular content, mirroring its rows, columns, and merged cells; write the HTML on single lines with no indentation or blank lines between tags, and collapse horizontal alignment to a single space.
Ground truth
TOM GREEN HANDYMAN 5 Any Street, Any City, That Area Code Telephone: 0800 XXX XXX Date : 6/5/2016 Invoice No : 0003521 Tax Registered No 123456 Mr and Mrs Fielding This Address This City This Area Code TAX INVOICE <table><tr><th>Quantity</th><th>Description</th><th>Unit Price</th><th>Cost</th></tr><tr><td></td><td>Upgrade to Bathroom</td><td></td><td></td></tr><tr><td>23.75</td><td>Labour</td><td>40.00</td><td>950.00</td></tr><tr><td>50</td><td>Nails and screws</td><td>0.80</td><td>40.00</td></tr><tr><td>1</td><td>Paint and Plywood</td><td>1000.00</td><td>1000.00</td></tr><tr><td>40</td><td>Imported wall tiles</td><td>14.00</td><td>560.00</td></tr><tr><td>1</td><td>Freight</td><td>150.00</td><td>150.00</td></tr><tr><td>1</td><td>Sub-contractor : Tile-It</td><td></td><td>228.00</td></tr><tr><td></td><td></td><td>Subtotal</td><td>2928.00</td></tr><tr><td></td><td></td><td>Tax</td><td>439.20</td></tr><tr><td></td><td></td><td>Total Due</td><td>$3,367.20</td></tr></table> Payment due by the 10th of the month following the date of invoice. Please make payment into Bank Account No. 12 3456 789112 012 Interest of 10% per year will be charged on late payments. Cut here Remittance Mr and Mrs Fielding TOM GREEN HANDYMAN 5 Any Street Any City That Area Code Amount Due $3,367.20 Amount Paid ______
The models are asked
Transcribe every piece of text in this image exactly as written, in reading order, preserving question and option numbering, and omit nothing. Write mathematical expressions in LaTeX and format the result as Markdown that mirrors the layout.
Ground truth
Q.5 Let $L_1$ be the line of intersection of the planes given by the equations $$2x + 3y + z = 4 \quad \text{and} \quad x + 2y + z = 5.$$ Let $L_2$ be the line passing through the point $P(2, -1, 3)$ and parallel to $L_1$. Let $M$ denote the plane given by the equation $$2x + y - 2z = 6.$$ Suppose that the line $L_2$ meets the plane $M$ at the point $Q$. Let $R$ be the foot of the perpendicular drawn from $P$ to the plane $M$ . Then which of the following statements is (are) TRUE? | | | |---|---| | (A) | The length of the line segment $PQ$ is $9\sqrt{3}$ | | (B) | The length of the line segment $QR$ is $15$ | | (C) | The area of $\triangle PQR$ is $\dfrac{3}{2}\sqrt{234}$ | | (D) | The acute angle between the line segments $PQ$ and $PR$ is $\cos^{-1}\left(\dfrac{1}{2\sqrt{3}}\right)$ | Answer: A, C 3/9
The models are asked
Transcribe all text exactly as written, reading top to bottom, keeping each author's handle with their message, and omit nothing. Output plain text only, with no Markdown or HTML, and use a single space wherever text is indented or aligned. Transcribe only the first tweet by kache (@yacineMTB).
Ground truth
I'm losing so much money every single second I dont spend in the states. Every day I wake up, I'm hyperventilating about the fact that I am irresponsibly putting my young family's future at great risk because I can't but help listen to my gut. I am filled with doubt every day
How OCR is scored
Each transcription is scored by its similarity to the ground-truth text, so partial credit is possible. The leaderboard score is the mean similarity across all samples, expressed as a percentage.
Every model runs the same 37 samples in a single evaluation pass. Token usage is measured from each provider’s API response, and cost per sample is that usage multiplied by the model’s published pricing. See the full methodology.
Frequently Asked Questions
Each model transcribes the same set of images. Every transcription is compared to the ground-truth text and scored by similarity, so a near-perfect answer earns most of the credit rather than failing outright. The leaderboard shows the mean similarity across all samples.
Printed documents, handwriting, code, receipts, forms, tables, math notation, and short high-stakes strings like serial numbers and license plates. Prompts require exact transcription with layout, casing, and punctuation preserved.
Most models in this leaderboard link to their Playground page. Click the model name to open it, then upload your own image and run it. A few models are benchmarked for comparison only and do not have a Playground page yet.