CC-BY-4.0 Open Benchmark Client-Side File Inspector

Open Benchmark Masters, File Inspector & Verified Badges

Inspect our measurement methods and recorded artifacts: download our exact test inputs and Ground-Truth reference masters across all 6 online utility & AI categories, drop any visual tool's output into our client-side inspector below for preview metrics, or query our JSON/CSV dataset (224 reports across 86 platforms).

Download JSON (/api/benchmarks.json) Download CSV (/api/benchmarks.csv) LLM Full Corpus (/llms-full.txt) 224-Row Dataset Explorer (/data)
Total Verified Reports
224
Tested Tool Platforms
86
≥4-Tool Full Suites
32
Dataset License
CC-BY-4.0
100% Client-Side Canvas & OpenXML Engine Files stay local · 1024px image preview metrics and .docx OpenXML inspection

Browser File Inspector & Published Report Matching

Run our canonical test input on any online utility or AI website, then drop the exported image or .docx file here to inspect file metrics. Exact matches link to published report scores; other files receive no inferred score or ranking:

Tip: Don't have an output image ready? Click "Load Built-in Demo Sample" above to inspect its metrics and original report.
Local Artifact Inspection
Waiting for a file...
Published Report Capability
—
Output Resolution
—
Primary GT Metric
—
Secondary GT Metric
—
Historical report position
—
Drop a file to inspect its metrics. Image errors use a 1024px preview; formal evaluation also requires full-resolution analysis, anchor alignment and server timing.

1. Canonical Test Inputs & Ground-Truth Masters (All 6 Categories)

Download the exact test input files (images / PDF) and Ground-Truth reference masters used across all RealTest evaluations:

Mode A · anchor_bgremove_v1 2048×2048 RGBA Alpha GT

AI Background Remover: Chroma-Key Curly Hair Alpha Master

Constructed by extracting sub-pixel Ground-Truth alpha (alpha_gt.png) from studio chroma-key subject photography and compositing over a cluttered warm bookstore-café plate to measure mad_band, SAD(k), fg_recall, and bg_leak.

Composite Input
bgremove input
Ground-Truth Alpha
bgremove alpha gt
GT Crop (Green)
bgremove gt crop
⬇ Download Test Input (2048px) ⬇ Download Alpha GT Compare 38 Sites
Mode B · anchor_t2i_v1 5 Hard Constraints Prompt

AI Image Generator: 5-Point Hard Constraint Prompt

Simultaneously tests: (1) Exact text rendering "REALTEST 2026" (25 pts); (2) Count & color attribute binding: 3 red apples + 2 blue ceramic mugs (20 pts); (3) 5-finger right-hand anatomy (20 pts).

Canonical Test Prompt:
A close-up studio photo of a vintage brass robot holding a wooden sign with the exact text "REALTEST 2026", with 3 red apples and 2 blue ceramic mugs on a dark oak table, showing the robot's right hand with 5 distinct fingers, 1:1 square
Canonical Reference
t2i reference
Sign & 5-Finger Crop
t2i sign crop
3 Apples + 2 Mugs
t2i objects crop
⬇ Download Reference Image Compare 23 Sites
Mode A · anchor_upscale_v1 512px Input → 2048px GT

AI Image Upscaler: 512px Degraded → 2048px Ground-Truth Master

Derived from a 2048×2048 Ground-Truth master with an embedded resolution calibration plate, degraded via 4× downsampling + σ=0.65 Gaussian blur + JPEG Q=82 into a 512×512 test input to measure PSNR, SSIM, edge_corr, and hf_ratio.

512×512 Test Input
upscale 512 input
2048×2048 GT Master
upscale 2048 gt
GT Calibration Plate
upscale plate gt
⬇ Download 512px Test Input ⬇ Download 2048px GT Master Compare 31 Sites
Mode A · anchor_inpaint_v1 3-Zone Synthetic Occlusion GT

AI Object Remover: 3-Zone Synthetic Occlusion → 2048px Clean GT

Synthetically occludes a clean 2048×2048 bookstore-café Ground-Truth plate with 3 high-contrast signs (RESERVED, SALE 50%, FREE WIFI; baseline PSNR=6.15 dB) to measure masked restoration PSNR/SSIM and unmasked preservation PSNR.

Occluded Test Input
inpaint occluded input
Binary Occlusion Mask
inpaint mask
Unoccluded Clean GT
inpaint clean gt
⬇ Download Occluded Input ⬇ Download Clean GT Compare 26 Sites
Mode A · anchor_compress_v1 2048×2048 · 4,137.9 KB Lossless PNG

Image Compressor: 4.14 MB High-Entropy Lossless PNG Master

Uses a 2048×2048 (4,237,168 bytes = 4,137.9 KB) lossless 24-bit PNG containing warm lighting gradients, fine book-spine typography, and dark shadow textures to measure file size reduction %, PSNR (dB), SSIM, and silent dimension downscaling.

⬇ Download 4.14MB PNG Master Compare 24 Sites
Mode A · anchor_pdf2word_v1 2-Page PDF · 4×4 Table + Dual-Column

PDF to Word: 2-Page Complex Table & Dual-Column PDF Master

A 2-page vector PDF master (document.pdf) featuring 4 headings, a 16-cell 4×4 financial/metrics table, two-column prose, and a Page-2 truncation token (REALTEST-PAGE2-VERIFIED-2026). Evaluated by parsing word/document.xml inside the exported .docx.

⬇ Download 2-Page Test PDF View Ground-Truth JSON Compare 23 Sites
Mode A · anchor_pdfcompress_v1 2-Page PDF · 1,659.0 KB Vector + Image Streams

PDF Compressor: 1.66 MB 2-Page Vector Text & Image Stream Master

A 2-page 1,659.0 KB (1,698,823 bytes) PDF master containing 27 selectable vector text blocks, a 12-cell financial table, a Page-2 verification token, and high-res image streams. Stream inspection separates lossless vector-preserving image recompression from destructive full-page bitmap flattening.

⬇ Download 1.66MB Test PDF View Ground-Truth JSON Compare 20 Sites
Mode A · anchor_pdfocr_v1 2-Page Scanned PDF · 644.4 KB (0 Embedded Fonts)

Scanned PDF OCR: 644 KB 2-Page Raster Scan & Confusable Table Master

A 2-page raster-only scanned PDF master (659,826 bytes = 644.4 KB, zero embedded fonts and zero BT/ET operators, with 0.45° deskew tilt and scanner grain) containing white-on-navy header banners, a 12-cell confusable invoice table (B8-105S vs O0-I1l8), prose, and a Page-2 verification token.

⬇ Download 644KB Scanned PDF View Ground-Truth JSON Compare 10 Sites
Mode A · anchor_pdfmerge_v1 2 PDFs → 3-Page Merged Vector + Image Stream

PDF Merge & Split: 2-Document 3-Page Sequence, Table & Vector Stream Master

Consists of a 2-page primary PDF (part1_main.pdf, 268.0 KB) and a 1-page audit appendix (part2_appendix.pdf, 48.9 KB) totaling 3 pages (316.8 KB) with 3 page-sequence tokens (DOC1-P1 → DOC1-P2 → DOC2-P3), 12 cross-document table cells, and embedded image streams to verify page completeness, sequence fidelity, and vector text retention.

⬇ Download Doc A (2p) ⬇ Download Doc B (1p) View Ground-Truth JSON Compare 20 Sites
Mode A · anchor_restore_v1 1024×1024 Degraded Portrait → Clean GT

Photo Restoration: 1024px Controlled Blur, Crease Scratch & Film Grain Portrait Master

Constructed by degrading a clean 1024×1024 studio portrait Ground-Truth master (gt_1024.png) with optical defocus (σ=1.65), 2× down/upsampling, film grain, 5 synthetic vintage creases/scratches (scratch_mask.png, baseline scratch PSNR=6.02 dB), and JPEG Q=72 artifacts to measure global PSNR/SSIM, scratch-region repair PSNR, and facial ROI fidelity.

⬇ Download Degraded Input (JPG) ⬇ Download 1024px GT Master View Scratch Mask Compare 9 Sites

2. Embeddable assessment coverage badges (86 Platforms)

Product badges show the number of released task assessments, without a cross-task average or product certification. Choose task score badges on the public data page.

PDF24 Tools (pdf24.org) 4/7
PDF24 Tools RealTest Badge
Squoosh (Google Chrome Labs) (squoosh.app) 1/7
Squoosh (Google Chrome Labs) RealTest Badge
CloudConvert Compress PNG (cloudconvert.com) 4/7
CloudConvert Compress PNG RealTest Badge
iLovePDF (ilovepdf.com) 4/7
iLovePDF RealTest Badge
JPEG-Optimizer (Browser-Local PNG/JPEG/GIF Compressor) (jpeg-optimizer.com) 1/7
JPEG-Optimizer (Browser-Local PNG/JPEG/GIF Compressor) RealTest Badge
WeCompress (Neuxpower NXPowerLite Online Compressor) (wecompress.com) 2/7
WeCompress (Neuxpower NXPowerLite Online Compressor) RealTest Badge
TinyPNG (tinypng.com) 1/7
TinyPNG RealTest Badge
PDFgear (pdfgear.com) 3/7
PDFgear RealTest Badge
Xodo PDF to Word Converter (by Apryse) (xodo.com) 4/7
Xodo PDF to Word Converter (by Apryse) RealTest Badge
Images-Upscale.com (images-upscale.com) 1/7
Images-Upscale.com RealTest Badge
XConvert Compress PNG (xconvert.com) 4/7
XConvert Compress PNG RealTest Badge
QuickImageKit Image Compressor (quickimagekit.com) 1/7
QuickImageKit Image Compressor RealTest Badge
FreePDFConvert (Baltsoft / ConvertAPI) (freepdfconvert.com) 3/7
FreePDFConvert (Baltsoft / ConvertAPI) RealTest Badge
RedKetchup Image Compressor (redketchup.io) 1/7
RedKetchup Image Compressor RealTest Badge
Nitro PDF to Word (PDFtoWord.com) (pdftoword.com) 1/7
Nitro PDF to Word (PDFtoWord.com) RealTest Badge
PDF Candy (Icecream Apps PDF to Word) (pdfcandy.com) 4/7
PDF Candy (Icecream Apps PDF to Word) RealTest Badge
iLoveIMG (Remove Background) (iloveimg.com) 3/7
iLoveIMG (Remove Background) RealTest Badge
PDF2Go (pdf2go.com) 4/7
PDF2Go RealTest Badge
Sejda PDF to Word (sejda.com) 4/7
Sejda PDF to Word RealTest Badge
AvePDF PDF to Word (by Nutrient / Orpalis) (avepdf.com) 4/7
AvePDF PDF to Word (by Nutrient / Orpalis) RealTest Badge
Smallpdf (smallpdf.com) 4/7
Smallpdf RealTest Badge
DupliChecker Image Compressor (duplichecker.com) 1/7
DupliChecker Image Compressor RealTest Badge
Zamzar PDF to DOCX Converter (zamzar.com) 1/7
Zamzar PDF to DOCX Converter RealTest Badge
FreeConvert Image Compressor (freeconvert.com) 3/7
FreeConvert Image Compressor RealTest Badge
remove.bg (remove.bg) 1/7
remove.bg RealTest Badge
Unlimited:Waifu2x (WebGPU In-Browser SR) (unlimited.waifu2x.net) 1/7
Unlimited:Waifu2x (WebGPU In-Browser SR) RealTest Badge
Upscale.media (by PixelBin) (upscale.media) 1/7
Upscale.media (by PixelBin) RealTest Badge
Bigjpg (AI Super-Resolution Image Enlarger) (bigjpg.com) 1/7
Bigjpg (AI Super-Resolution Image Enlarger) RealTest Badge
Pixelcut (pixelcut.ai) 4/7
Pixelcut RealTest Badge
Soda PDF Online (sodapdf.com) 2/7
Soda PDF Online RealTest Badge
Optimizilla (ImageCompressor.com) (imagecompressor.com) 1/7
Optimizilla (ImageCompressor.com) RealTest Badge
WorkinTool PDF to Word Converter Online (workintool.com) 2/7
WorkinTool PDF to Word Converter Online RealTest Badge
Clipdrop (by Jasper) (clipdrop.co) 3/7
Clipdrop (by Jasper) RealTest Badge
Ideogram AI (Ideogram 4.0) (ideogram.ai) 1/7
Ideogram AI (Ideogram 4.0) RealTest Badge
Recraft AI (Infinite Canvas) (recraft.ai) 4/7
Recraft AI (Infinite Canvas) RealTest Badge
Foxit Online PDF to Word Converter (foxit.com) 3/7
Foxit Online PDF to Word Converter RealTest Badge
Photoroom (photoroom.com) 4/7
Photoroom RealTest Badge
MagicEraser.org (AI Background Eraser) (magiceraser.org) 4/7
MagicEraser.org (AI Background Eraser) RealTest Badge
Compressor.io (compressor.io) 1/7
Compressor.io RealTest Badge
Adobe Firefly (Express) BG Remover (adobe.com) 4/7
Adobe Firefly (Express) BG Remover RealTest Badge
ShortPixel Online Image Compressor (shortpixel.com) 1/7
ShortPixel Online Image Compressor RealTest Badge
Img2Go AI (img2go.com) 5/7
Img2Go AI RealTest Badge
ResizePixel Image Compressor (resizepixel.com) 1/7
ResizePixel Image Compressor RealTest Badge
Krea AI Edit (Background Removal) (krea.ai) 4/7
Krea AI Edit (Background Removal) RealTest Badge
Leonardo.Ai (Remove Background) (leonardo.ai) 4/7
Leonardo.Ai (Remove Background) RealTest Badge
ImgUpscaler (imgupscaler.com) 1/7
ImgUpscaler RealTest Badge
CleverPDF (cleverpdf.com) 3/7
CleverPDF RealTest Badge
LightPDF (lightpdf.com) 4/7
LightPDF RealTest Badge
Vheer (vheer.com) 2/7
Vheer RealTest Badge
ObjectRemover (Free AI Object Eraser) (objectremover.com) 1/7
ObjectRemover (Free AI Object Eraser) RealTest Badge
BgEraser (bgeraser.com) 1/7
BgEraser RealTest Badge
Nero AI (ai.nero.com) 6/7
Nero AI RealTest Badge
CompressNow (compressnow.com) 1/7
CompressNow RealTest Badge
VanceAI (BGremover) (vanceai.com) 3/7
VanceAI (BGremover) RealTest Badge
Inpaint-web (Open-Source Browser WebGPU Inpainting) (inpaintweb.lxfater.com) 1/7
Inpaint-web (Open-Source Browser WebGPU Inpainting) RealTest Badge
Removal.AI (removal.ai) 1/7
Removal.AI RealTest Badge
Slazzer (slazzer.com) 1/7
Slazzer RealTest Badge
Freepik / Magnific AI (freepik.com) 3/7
Freepik / Magnific AI RealTest Badge
Pixlr (pixlr.com) 5/7
Pixlr RealTest Badge
Aiseesoft Free Online (aiseesoft.com) 4/7
Aiseesoft Free Online RealTest Badge
Picsart (picsart.com) 3/7
Picsart RealTest Badge
TinyWow Image (tinywow.com) 5/7
TinyWow Image RealTest Badge
11zon Image Compressor (11zon.com) 4/7
11zon Image Compressor RealTest Badge
Wondershare HiPDF (hipdf.com) 4/7
Wondershare HiPDF RealTest Badge
Cleanup.pictures (Clipdrop / Jasper) (cleanup.pictures) 1/7
Cleanup.pictures (Clipdrop / Jasper) RealTest Badge
Cutout.Pro (cutout.pro) 5/7
Cutout.Pro RealTest Badge
Let's Enhance (Prime 4x Upscaler) (letsenhance.io) 2/7
Let's Enhance (Prime 4x Upscaler) RealTest Badge
WatermarkRemover.io (Pixelbin AI Eraser) (watermarkremover.io) 1/7
WatermarkRemover.io (Pixelbin AI Eraser) RealTest Badge
DeWatermark (dewatermark.ai) 3/7
DeWatermark RealTest Badge
PicWish (AI) (picwish.com) 6/7
PicWish (AI) RealTest Badge
Clipping Magic (Canva) (clippingmagic.com) 1/7
Clipping Magic (Canva) RealTest Badge
SnapEdit (Remove Background) (snapedit.app) 4/7
SnapEdit (Remove Background) RealTest Badge
DepositPhotos (depositphotos.com) 2/7
DepositPhotos RealTest Badge
LightX AI (lightxeditor.com) 4/7
LightX AI RealTest Badge
BgSub (In-Browser AI) (bgsub.com) 1/7
BgSub (In-Browser AI) RealTest Badge
Raphael AI (raphael.app) 1/7
Raphael AI RealTest Badge
Hama (AI Object & People Eraser) (hama.app) 1/7
Hama (AI Object & People Eraser) RealTest Badge
Fotor (fotor.com) 4/7
Fotor RealTest Badge
Wondershare Media.io AI (media.io) 4/7
Wondershare Media.io AI RealTest Badge
inPixio Remove Background (inpixio.com) 3/7
inPixio Remove Background RealTest Badge
Icons8 (icons8.com) 2/7
Icons8 RealTest Badge
Retoucher Online (retoucher.online) 1/7
Retoucher Online RealTest Badge
CyberLink MyEdit (myedit.online) 5/7
CyberLink MyEdit RealTest Badge
Magic Studio (magicstudio.com) 3/7
Magic Studio RealTest Badge
Erase.bg (erase.bg) 1/7
Erase.bg RealTest Badge
Kraken.io Web Interface (kraken.io) 1/7
Kraken.io Web Interface RealTest Badge

3. Public JSON API Schema & Citation Guide

GET https://realtest.org/api/benchmarks.json returns the full CC-BY-4.0 structured dataset updated on every build (no API key required):

{
  "schema_version": "3.0",
  "license": "CC-BY-4.0",
  "citation_url": "https://realtest.org/methodology",
  "total_platforms": 86,
  "total_benchmarks": 224,
  "benchmarks": [
    {
      "category": "image-compressor",
      "rank": 1,
      "domain": "squoosh.app",
      "total_score": 96.6,
      "honesty_score": 99,
      "capability_score": 95.6,
      "report_url": "https://realtest.org/report/squoosh.app",
      "badge_svg_url": "https://realtest.org/badges/image-compressor/squoosh.app.svg"
    }
  ]
}
Benchmark evidence preview

Open original ↗