isGenAI · Research · 8 November 2026
Free AI image detectors tested on 24 images
We took 12 AI images (Midjourney, DALL·E 3, ChatGPT image, Adobe Firefly, Stable Diffusion) and 12 camera photos from Wikimedia Commons and uploaded each one, unchanged, to five free AI image detectors and to isGenAI. isGenAI got 23 of 24 right with no real photo called AI; the best free classifier, DeepAI, got 22 of 24. Two tools flagged the same real Canon photo as AI, two stopped after a handful of free checks, and one never loaded. Six of the twelve AI images carry a C2PA manifest that names the generator, which only isGenAI reads; the one image every scanner missed or doubted is a Midjourney scene with no record.
Disclosure: isGenAI publishes this page and is one of the tools tested. Every verdict is recorded exactly as the tool showed it; the files, hashes, sources and per-image results are published below and in the results JSON (CC0).
Scoreboard
| Tool | Scanned | Right | Real photos called AI | AI images called real | Free limit we hit |
|---|---|---|---|---|---|
| isGenAI | 24 of 24 | 23 (96%) | 0 | 1 | 3 free AI scans, then a $5 plan; record checks unlimited. |
| DeepAI (powered by TruthScan) | 24 of 24 | 22 (92%) | 1 | 1 | All 24 images scanned in one session without hitting a limit. |
| isgen.ai | 10 of 24 | 9 (90%) | 1 | 0 | Paywall after 10 scans in one browser session ("You have run out of free scans"); the page says "no limitation on the number of scans". |
| Decopy AI | 5 of 24 | 4 (80%) | 1 | 0 | 5 checks without an account; images 1, 2, 3, 4 and 9 were tested. |
| Was It AI | 2 of 24 | 2 (100%) | 0 | 0 | Guest use stopped after 2 checks ("Guest credits used"); images 1 and 2 were tested. |
| Illuminarty | 0 of 24 | – | – | – | Not tested: the web app never reached an idle state in our browser session, so uploads did not complete (two attempts). |
Percentages are over the images each tool actually scanned, so a tool that stopped after two checks is not comparable with one that scanned all 24. We publish the counts rather than an accuracy claim.
What stood out
- The same real photo fooled two tools. Image 4, a Canon EOS 2000D photo of a car with full EXIF, was called 100% AI by isgen.ai and 97% AI by Decopy. DeepAI gave it 4%.
- Records beat pixels when they exist. 6 of the 12 AI images still carried a C2PA manifest from the generator (DALL·E 3, ChatGPT image and Adobe Firefly sign their outputs). isGenAI reports the manifest and who signed it; none of the other four tools reads it, and the AI images without a manifest (Midjourney and Stable Diffusion) are where classifiers do the work.
- “Free” varies. DeepAI scanned all 24. isgen.ai stopped at 10 and asked for a plan, although its page says there is no limit on scans. Decopy allows 5 and Was It AI 2 before an account. Illuminarty’s web app never finished loading for us.
- One AI image got past everyone that scanned it: image 19, a Midjourney scene with no record, scored 42% at DeepAI and 35% at isGenAI, both below the line. Images without records are where every classifier, ours included, can miss.
Every image, every verdict
| # | Image | Truth | isGenAI | DeepAI | isgen.ai | Decopy AI | Was It AI |
|---|---|---|---|---|---|---|---|
| 1 | Image generator-A stop sign is flying in blue skies-Dall-e3-01 DALL·E 3 · 1024×1024 · CC BY-SA 4.0 · Yug | AI | ✓ AI (score 99%) | ✓ AI (97%) | ✓ AI (100%) | ✓ AI (99%) | ✓ AI |
| 2 | White Wagtail in Baruipur November 2025 by Tisha Mukherjee 08 Canon EOS R8 · 2422×1615 · CC BY-SA 4.0 · Tisha Mukherjee | camera photo | ✓ real (score 0%) | ✓ real (3%) | ✓ real (100%) | ✓ real (4%) | ✓ real |
| 3 | Changeable Hawk-Eagle in Sanjay Dubri Tiger Reserve December 2024 by Tisha Mukherjee 09 Canon EOS R10 · 2692×3365 · CC BY-SA 4.0 · Tisha Mukherjee | camera photo | ✓ real (score 0%) | ✗ AI (82%) | ✓ real (100%) | ✓ real (5%) | not scanned |
| 4 | Cupra Raval VZ IMG 8811 Canon EOS 2000D · 4617×2726 · CC BY-SA 4.0 · Alexander Migl | camera photo | ✓ real (score 0%) | ✓ real (4%) | ✗ AI (100%) | ✗ AI (97%) | not scanned |
| 5 | SD - Anthropomorphic rhinoceros standing on two feet, wearing shirt with Checkered pattern Stable Diffusion · 1024×1024 · Public domain · Fooocus WebUI | AI | ✓ AI (score 99%) | ✓ AI (97%) | ✓ AI (100%) | not scanned | not scanned |
| 6 | Brownish-flanked Bush Warbler in Darjeeling May 2025 by Tisha Mukherjee 10 Canon EOS R8 · 3427×2285 · CC BY-SA 4.0 · Tisha Mukherjee | camera photo | ✓ real (score 0%) | ✓ real (3%) | ✓ real (100%) | not scanned | not scanned |
| 7 | Gold teeth sculpture, Auf d. Insel, Munich OnePlus 13 · 1924×1696 · CC BY-SA 4.0 · Anastasiya Lvova | camera photo | ✓ real (score 0%) | ✓ real (8%) | ✓ real (100%) | not scanned | not scanned |
| 8 | Changeable Hawk-Eagle in Sanjay Dubri Tiger Reserve December 2024 by Tisha Mukherjee 06 Canon EOS R10 · 2924×3655 · CC BY-SA 4.0 · Tisha Mukherjee | camera photo | ✓ real (score 0%) | ✓ real (34%) | ✓ real (100%) | not scanned | not scanned |
| 9 | SD- Female superstar model without a moustache Stable Diffusion · 1024×1024 · Public domain · Stable Diffusion | AI | ✓ AI (C2PA record) | ✓ AI (99%) | ✓ AI (100%) | ✓ AI (99%) | not scanned |
| 10 | 2026 Kościół św. Anny w Ząbkowicach Śląskich (7) DJI FC9184 (drone) · 3047×2868 · CC BY-SA 4.0 · Jacek Halicki | camera photo | ✓ real (score 0%) | ✓ real (3%) | ✓ real (100%) | not scanned | not scanned |
| 11 | Brownish-flanked Bush Warbler in Darjeeling May 2025 by Tisha Mukherjee 07 Canon EOS R10 · 3479×2319 · CC BY-SA 4.0 · Tisha Mukherjee | camera photo | ✓ real (score 0%) | ✓ real (16%) | not scanned | not scanned | not scanned |
| 12 | Lamborghini Gallardo LP570-4 Superleggera at the 2026 Adelaide Rally Street Party on King William Road (028A4069) Canon EOS R7 · 4428×2952 · CC BY-SA 4.0 · Yu Chu Chin | camera photo | ✓ real (score 0%) | ✓ real (3%) | not scanned | not scanned | not scanned |
| 13 | ChatGPT Image Aug 14, 2025, 01 01 35 PM ChatGPT image (GPT-4o / gpt-image-1) · 1536×1024 · CC BY-SA 4.0 · U3226616 | AI | ✓ AI (C2PA record) | ✓ AI (99%) | not scanned | not scanned | not scanned |
| 14 | A mechanical dove 8274822e-52fe-40fa-ac4d-f3cde5a332ae Midjourney · 2048×2048 · Public domain · Deviationsz1 | AI | ✓ AI (score 99%) | ✓ AI (97%) | not scanned | not scanned | not scanned |
| 15 | ChatGPT Image Aug 14, 2025, 01 47 12 PM ChatGPT image (GPT-4o / gpt-image-1) · 1024×1024 · CC BY-SA 4.0 · U3226616 | AI | ✓ AI (C2PA record) | ✓ AI (99%) | not scanned | not scanned | not scanned |
| 16 | Regret facial expression Adobe Firefly · 2688×1536 · Public domain · Adobe Firefly | AI | ✓ AI (C2PA record) | ✓ AI (99%) | not scanned | not scanned | not scanned |
| 17 | DE3 P2-1 DALL·E 3 · 1024×1024 · Public domain · Bing DALL-E3 | AI | ✓ AI (C2PA record) | ✓ AI (99%) | not scanned | not scanned | not scanned |
| 18 | State Library of South Australia, October 2026 (028A5169) Canon EOS R7 · 4664×3109 · CC BY-SA 4.0 · Yu Chu Chin | camera photo | ✓ real (score 0%) | ✓ real (3%) | not scanned | not scanned | not scanned |
| 19 | Palace during a reign of terror Midjourney Midjourney · 1024×1024 · Public domain · Mhatopzz | AI | ✗ real (score 35%) | ✗ real (42%) | not scanned | not scanned | not scanned |
| 20 | Rupert Breheny mechanical dove eca144e7-476d-4976-821d-a49c408e4f36 Midjourney · 1024×1024 · Public domain · Rupert Breheny | AI | ✓ AI (score 99%) | ✓ AI (97%) | not scanned | not scanned | not scanned |
| 21 | AC SO Gen Z Demo GEGEN NAZIS E-Brunnen 31.10.2026 Fujifilm X-Pro3 · 5624×3749 · CC BY-SA 4.0 · Grunpfnul | camera photo | ✓ real (score 1%) | ✓ real (9%) | not scanned | not scanned | not scanned |
| 22 | A yellow-bellied marmot peers over the foliage in Yosemite National Park. California, USA Nikon D7100 · 3459×2306 · CC BY-SA 4.0 · Paxson Woelber | camera photo | ✓ real (score 0%) | ✓ real (2%) | not scanned | not scanned | not scanned |
| 23 | DE3 P3-1 DALL·E 3 · 1024×1024 · Public domain · DALL-E3 | AI | ✓ AI (score 99%) | ✓ AI (97%) | not scanned | not scanned | not scanned |
| 24 | Adobe Firefly generated landscape photography Adobe Firefly · 2048×2048 · Public domain · Adobe Firefly Image 3, prompted by Jiří Vedral | AI | ✓ AI (C2PA record) | ✓ AI (99%) | not scanned | not scanned | not scanned |
Method and limits
24 images downloaded as served by Wikimedia Commons on 8 November 2026: 12 AI images whose Commons file pages credit the generator, and 12 recent Quality Images with camera EXIF. Each file was uploaded by hand, unchanged, to each tool's free web checker in one browser session, in id order, until the tool stopped accepting free checks. The verdict shown by the tool was recorded as displayed. isGenAI was run through its public API (POST /v1/check).
- The set is small (24 images) and comes from Wikimedia Commons, so it leans towards illustrative AI images and well-exposed hobbyist photographs. It says nothing about screenshots, social-media re-encodes or deepfake faces.
- Truth labels rest on the Commons file pages: the uploader credited a generator for each AI image, and each photo carries camera EXIF (make, model, capture time), listed above.
- Each tool was used through its public web page as an anonymous visitor, one upload at a time. Verdict wording and thresholds are each tool’s own.
- isGenAI reads the file’s records first (C2PA Content Credentials, IPTC labels, saved prompts) and adds an AI-likelihood score from its image detector. Where the score column says pending, the free scan allowance ran out during the run; the records column is complete.
- To repeat the test: download each file from its Commons page, check the SHA-256 against the JSON, and upload it to each tool. Send corrections to /corrections.
The six AI set images with a C2PA manifest: 9, 13, 15, 16, 17, 24. Dataset and verdicts: results.json, CC0-1.0.