SmartBin

AI evaluation

Can you fool our AI with a fake bin?

Every bin on SmartBin must pass an AI photo check before it reaches the map. Below is our labelled test set, real dustbins and look-alikes picked to trick the model, with the verdict and the model's own reason for each. Nothing here is hand-picked after the fact: an admin can re-run the whole set live.

Try to fool it yourself
Point your camera at a bucket, a bin, a post box, anything, and see what the AI decides and why. Your photo is deleted right after the check, and no bin is added to the map.
Sign in to try it

Signing in keeps the AI costs in check. It's free and takes a few seconds.

Your photo and the verdict appear here

Nine layers between a fake bin and the map

The AI is one layer. The API enforces all of them, so skipping the app doesn't skip the checks.

  1. 1

    Sign-in required (Amazon Cognito)

    Stops: Anonymous spam

  2. 2

    Live camera only in the app

    Stops: Gallery uploads, old or downloaded photos

  3. 3

    Upload links only for JPEG, PNG or WebP, into your own folder, for 5 minutes

    Stops: Other file types, writing into someone else's folder

  4. 4

    The photo must be yours

    Stops: Reusing another person's upload

  5. 5

    The file must really be an image, checked from its bytes

    Stops: A text file renamed .jpg (deleted on the spot)

  6. 6

    AI check: only a purpose-made bin in a public place passes

    Stops: Buckets, post boxes, hydrants, barrels, garbage piles, drawings (photo deleted)

  7. 7

    No other bin within 15 m

    Stops: Registering the same bin twice

  8. 8

    Monthly limit per user, set by admins

    Stops: Bulk registration from one account

  9. 9

    Missing reports only from within 20 m

    Stops: Removing real bins from home

Anti-fake test: 15 of 15 passed
A script that tries every way to sneak a fake bin in through the real API, with real sign-ins, storage and AI. Run it with npm run test:anti-fake.
  • No login → refused (401)
  • Upload link for HTML, PDF or GIF → refused (400)
  • Someone else's uploaded photo → refused (403)
  • Photo that was never uploaded → refused (404)
  • Text file disguised as a JPEG → refused and deleted (400)
  • Photo of a plastic bucket → rejected by the AI and deleted (422)
  • Real dustbin photo → accepted (201)
  • Second bin 5 m away → refused as a duplicate (409)
  • Impossible coordinates → refused (400)
  • Missing report from 1 km away → refused (403)
  • Only accepted bins count toward the monthly limit

How we test, and what it can't catch