Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they’re a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues’ new research, available as a pre-print paper, focuses on Google’s ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an “invisible” reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low “human” confidence rating.

  • Destide
    link
    fedilink
    English
    arrow-up
    35
    ·
    2 months ago

    When it’s asking for motorcycles but it’s clearly a scooter

    • ripcord@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      ·
      2 months ago

      Or, like, “there’s the bottom 10% of a traffic light in this one. Do I click that box? Ia that supposed to count?”

      • toddestan@lemm.ee
        link
        fedilink
        English
        arrow-up
        8
        ·
        2 months ago

        What they are doing is comparing your answer and seeing if it is consistent with how it has been answered previously. They realize that not everyone is going to give the exact same answer, so as long as you answer it in a way that enough other people have answered it, it should let you in.

        I’ll usually go with the minimum number of clicks that I think will get me through, since I’m lazy and it’ll also at times slow down how fast you can click which is annoying.

        I’ll also answer them wrong if I think it’s a mistake that enough other people will make. “Yes… that RV over there is a bus…”

        • Echo Dot
          link
          fedilink
          English
          arrow-up
          4
          ·
          2 months ago

          They are also overly US centric.

          One of the questions asks you to click on only the school buses. I had to Google how you tell the difference between a school bus and not a school bus.

          Also is it a crosswalk if it’s at an intersection or is it only a crosswalk if it’s in the middle of a road somewhere?

          The questions either need to be not cultural or they need to be adapted for where they detect the user is coming from, the first option seems easier.

          • AA5B@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            2 months ago

            Interesting. Do you not have school buses, or are school buses not distinctly marked? How do kids get to school when it’s beyond walking distance?

            • Echo Dot
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              2 months ago

              They are just buses.

              I guess the British government just assume that school children are smart enough to get on the right bus without them being individually distinct.

              I knew school buses are yellow but I did not realize that they are always yellow. I did not realize that the yellow color meant school. I just assumed that the yellow color was a color busses could be.

              • AA5B@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 months ago

                Maybe it’s lack of transit in the us, I don’t know. Almost every public school district I’m familiar with, uses standard yellow school buses to bring kids to and from school. However Boston city schools give the kids an MBTA pass - I don’t know if that differed by age - and I imagine that’s true of other downtown schools where there’s transit

              • TachyonTele@lemm.ee
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                edit-2
                2 months ago

                The size of the UK verses the exponentially larger size of the US probably has a lot to do with it.

                And if you knew school busses where yellow… Where’s the problem?

          • TachyonTele@lemm.ee
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            2 months ago

            School busses and regular busses look completely different. What do those look like in your country?

            • Echo Dot
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              2 months ago

              Well here in, not the United States of America land, we just have busses. I was not aware that busses required a special magic paint job.

              I suppose the paint job prevents school shooters wasting their time.

              • TachyonTele@lemm.ee
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 months ago

                So if your regular bus is shown next to a bus that’s not “just a bus”, and you’re asked which one is a school bus… What would you answer?

              • TachyonTele@lemm.ee
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 months ago

                So if you see a picture that obviously a regular bus, alongside a different bus, what would you infer from that when asked which bus is not the same as “any bus”?

                • Kusimulkku@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  2 months ago

                  How would you know what is a regular bus and what is not a regular bus for a given country?

      • thisNotMyName@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        2 months ago

        Does the backside of a traffic light even count? What about these strange traffic lights that have more boarder than light?

      • AA5B@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 months ago

        Or the square with the driver in it: does it classify the driver as part of the motorcycle?

      • Blackmist
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 months ago

        Does it count when the AI driving the car clips it?

    • dumbass@leminal.space
      link
      fedilink
      English
      arrow-up
      13
      ·
      2 months ago

      I had one with one of those Motorcycles with the long handles, apparently they aren’t part of the bike, but the dudes foot holding it up is.

      • Echo Dot
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 months ago

        I think the reason AI are better than humans is that the AI is just as stupid as the image classifier.