Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they’re a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues’ new research, available as a pre-print paper, focuses on Google’s ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an “invisible” reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low “human” confidence rating.

You are viewing a single thread.
View all comments
35 points

When it’s asking for motorcycles but it’s clearly a scooter

permalink
report
reply
26 points

Or, like, “there’s the bottom 10% of a traffic light in this one. Do I click that box? Ia that supposed to count?”

permalink
report
parent
reply
8 points

What they are doing is comparing your answer and seeing if it is consistent with how it has been answered previously. They realize that not everyone is going to give the exact same answer, so as long as you answer it in a way that enough other people have answered it, it should let you in.

I’ll usually go with the minimum number of clicks that I think will get me through, since I’m lazy and it’ll also at times slow down how fast you can click which is annoying.

I’ll also answer them wrong if I think it’s a mistake that enough other people will make. “Yes… that RV over there is a bus…”

permalink
report
parent
reply
4 points

They are also overly US centric.

One of the questions asks you to click on only the school buses. I had to Google how you tell the difference between a school bus and not a school bus.

Also is it a crosswalk if it’s at an intersection or is it only a crosswalk if it’s in the middle of a road somewhere?

The questions either need to be not cultural or they need to be adapted for where they detect the user is coming from, the first option seems easier.

permalink
report
parent
reply
6 points

Does the backside of a traffic light even count? What about these strange traffic lights that have more boarder than light?

permalink
report
parent
reply
7 points

How about “do they want just the bulbs or the pole holding it up?”

permalink
report
parent
reply
18 points

That tip of a handle bar that makes you wonder if that square counts or not.

permalink
report
parent
reply
4 points

Or the square with the driver in it: does it classify the driver as part of the motorcycle?

permalink
report
parent
reply
3 points

Does it count when the AI driving the car clips it?

permalink
report
parent
reply
13 points

I had one with one of those Motorcycles with the long handles, apparently they aren’t part of the bike, but the dudes foot holding it up is.

permalink
report
parent
reply
2 points

I think the reason AI are better than humans is that the AI is just as stupid as the image classifier.

permalink
report
parent
reply
2 points

Worse is when its asking for crosswalks and its clearly a rumblestrip.

permalink
report
parent
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 17K

    Monthly active users

  • 5.9K

    Posts

  • 126K

    Comments