Facial Recognition's Latest Failure Is Keeping People From Accessing Their Unemployment Benefits

from the would-be-fixed-instantly-if-the-CEO-had-to-use-the-system-to-get-paid dept

Is there anything facial recognition tech can't do?

The answer appears to be "yes." Or maybe it's "no." The list of things it can't do well flows from the only thing it's asked to do and can't: recognize faces.

It can't allow you to board a plane at certain airports if it decides you're not the person you actually are. It can't keep you from being arrested if it decides you're someone you're not. And it can't let you on the property if it's deployed by any number of cameras watching any number of private establishments.

The latest thing it can't do is keep unemployed people connected with their unemployment assistance. A private contractor acting as a fraud-fighting middleman is apparently fighting fraud by keeping legitimate recipients of assistance from receiving any assistance. Todd Feathers has more information at Motherboard.

Unemployment recipients have been complaining for months about the identity verification service ID.me, which uses a combination of biometric information and official documents to confirm that applicants are who they claim to be. The complaints reached another crescendo this week after Axios published a “deep dive” article about the threat of unemployment fraud based on statistics provided to the outlet by ID.me.

Some unemployment applicants have said that ID.me’s facial recognition models fail to properly identify them (generally speaking, facial recognition technology is notoriously less accurate for women and people of color). And after their applications were put on hold because their identity couldn’t be verified, many should-be beneficiaries have had to wait days or weeks to reach an ID.me “trusted referee” who could confirm what the technology couldn’t.

Months-worth of complaints can easily be found on Twitter. A steady stream of angry tweets in ID.me's direction undercuts the company's assurances that everything is working fine or, in the event that it isn't, it's all the end users' fault.

In his statement to Motherboard, [IDme CEO Blake] Hall said that facial recognition failures are not a problem with the technology but with the people using it to verify their identity. “For example, if someone uploads a selfie that only shows half their face.”

“We are unaware of eligible individuals who have not been able to verify their identity with ID.me,” he said, and “the wait time for a live video chat session right now is less than five minutes and it has been consistently under 30 minutes all week.”

Hmm. Perhaps Hall should take a scroll through Twitter and try to square his statement with actual users' experiences. Multiple complainants have noted the supposed 24/7 chat is anything but 24/7 and trying to reach someone by phone is even more futile than trying to utilize the seemingly all-but-abandoned online chat service.

While the backend goes neglected, CEO Blake Hall is pushing for more states to utilize ID.me to combat unemployment fraud. The service is currently used by 21 states but ID.me would obviously like that number to be higher. To push that number higher, Hall appears to be pushing other numbers higher. As Feathers points out in his report, Hall's estimate of money lost to unemployment fraud leapt from $200 million in February to $400 million by the time he was approached by Axios earlier this month as it compiled its "deep dive" into the company. While this kind of growth is to be expected over time, the best source for fraud estimates isn't a company that has a financial interest in portraying fraud as a bigger problem than it may actually be.

This is the latest frontier of facial recognition failure. And it will get worse before… well, there's no way of telling if it will ever get better. More automation of services is inevitable. And efforts put in place to prevent abuse of those services will inevitably involve verification processes like these. But if the government is going to rely on third-party tech with this many known problems, it needs to make sure it contractors and its agencies have the people and processes in place to backstop AI decisions and head off more of the (also inevitable) failures.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: facial recognition, unemployment benefits


Reader Comments

Subscribe: RSS

View by: Thread


  • identicon
    Anonymous Coward, 29 Jun 2021 @ 3:03pm

    Hall's estimate of money lost to unemployment fraud leapt from $200 million in February to $400 million by the time he was approached by Axios earlier this month

    Big citation needed there, bub.

    Also, how much is ID.me costing states vs how much it's "saving" them?

    reply to this | link to this | view in chronology ]

  • icon
    ECA (profile), 29 Jun 2021 @ 4:07pm

    how bad was the fraud before?

    Wow, fire all your customer service to depend on UN-PROVEN TECH.
    Sorry, it has been proven many times over the years. IT DONT WORK VERY WELL.

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 29 Jun 2021 @ 4:12pm

    How can one say it's not a tech failure, when it's well known for years that it suffers high failure rate for non-white.

    reply to this | link to this | view in chronology ]

  • icon
    That Anonymous Coward (profile), 29 Jun 2021 @ 4:34pm

    "In his statement to Motherboard, [IDme CEO Blake] Hall said that facial recognition failures are not a problem with the technology but with the people using it to verify their identity. “For example, if someone uploads a selfie that only shows half their face.”"

    Ahh the ever popular, "You're doing it wrong!" defense.
    Our product is perfect, we never make mistakes, anyone who complains is doing it wrong or a bad actor trying to defraud the system.

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 30 Jun 2021 @ 4:25am

    Isnt it high time to just ban using face recognition tech as ID, period?

    Let the kids use it to lock their phones like the toy that it is, but require something that actually works for important things.

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 30 Jun 2021 @ 8:29am

    it's about time people realised that, in the majority of cases, facial recognition is of absolutely no use whatsoever! the only peoiple who want this in being are those in government and those in security forces. now what does that tell you? wake up and smell the coffee for fucks sake!!

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 30 Jun 2021 @ 10:22am

    it's not just unemployment, my state DMV also uses ID.me. had an issue last Nov, went online (since walkin offices were closed due to covid). gotta have an account...how to get an account? take your photo, system will compare it to photo in data base to verify it's you. result? i still don't have an account, system couldn't verify me. and i still have the issue...

    reply to this | link to this | view in chronology ]

  • identicon
    bullshit periscope, 23 Jul 2021 @ 8:23am

    "facial recognition technology is notoriously less accurate for women and people of color"

    Apparently, it is working as intended.

    reply to this | link to this | view in chronology ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Close

Add A Reply

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Special Affiliate Offer

Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Chat
Recent Stories
.

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.