Facial Recognition's Latest Failure Is Keeping People From Accessing Their Unemployment Benefits

from the would-be-fixed-instantly-if-the-CEO-had-to-use-the-system-to-get-paid dept

Is there anything facial recognition tech can’t do?

The answer appears to be “yes.” Or maybe it’s “no.” The list of things it can’t do well flows from the only thing it’s asked to do and can’t: recognize faces.

It can’t allow you to board a plane at certain airports if it decides you’re not the person you actually are. It can’t keep you from being arrested if it decides you’re someone you’re not. And it can’t let you on the property if it’s deployed by any number of cameras watching any number of private establishments.

The latest thing it can’t do is keep unemployed people connected with their unemployment assistance. A private contractor acting as a fraud-fighting middleman is apparently fighting fraud by keeping legitimate recipients of assistance from receiving any assistance. Todd Feathers has more information at Motherboard.

Unemployment recipients have been complaining for months about the identity verification service ID.me, which uses a combination of biometric information and official documents to confirm that applicants are who they claim to be. The complaints reached another crescendo this week after Axios published a “deep dive” article about the threat of unemployment fraud based on statistics provided to the outlet by ID.me.

Some unemployment applicants have said that ID.me’s facial recognition models fail to properly identify them (generally speaking, facial recognition technology is notoriously less accurate for women and people of color). And after their applications were put on hold because their identity couldn’t be verified, many should-be beneficiaries have had to wait days or weeks to reach an ID.me “trusted referee” who could confirm what the technology couldn’t.

Months-worth of complaints can easily be found on Twitter. A steady stream of angry tweets in ID.me’s direction undercuts the company’s assurances that everything is working fine or, in the event that it isn’t, it’s all the end users’ fault.

In his statement to Motherboard, [IDme CEO Blake] Hall said that facial recognition failures are not a problem with the technology but with the people using it to verify their identity. “For example, if someone uploads a selfie that only shows half their face.”

“We are unaware of eligible individuals who have not been able to verify their identity with ID.me,” he said, and “the wait time for a live video chat session right now is less than five minutes and it has been consistently under 30 minutes all week.”

Hmm. Perhaps Hall should take a scroll through Twitter and try to square his statement with actual users’ experiences. Multiple complainants have noted the supposed 24/7 chat is anything but 24/7 and trying to reach someone by phone is even more futile than trying to utilize the seemingly all-but-abandoned online chat service.

While the backend goes neglected, CEO Blake Hall is pushing for more states to utilize ID.me to combat unemployment fraud. The service is currently used by 21 states but ID.me would obviously like that number to be higher. To push that number higher, Hall appears to be pushing other numbers higher. As Feathers points out in his report, Hall’s estimate of money lost to unemployment fraud leapt from $200 million in February to $400 million by the time he was approached by Axios earlier this month as it compiled its “deep dive” into the company. While this kind of growth is to be expected over time, the best source for fraud estimates isn’t a company that has a financial interest in portraying fraud as a bigger problem than it may actually be.

This is the latest frontier of facial recognition failure. And it will get worse before… well, there’s no way of telling if it will ever get better. More automation of services is inevitable. And efforts put in place to prevent abuse of those services will inevitably involve verification processes like these. But if the government is going to rely on third-party tech with this many known problems, it needs to make sure it contractors and its agencies have the people and processes in place to backstop AI decisions and head off more of the (also inevitable) failures.

Filed Under: ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Facial Recognition's Latest Failure Is Keeping People From Accessing Their Unemployment Benefits”

Subscribe: RSS Leave a comment
8 Comments
That Anonymous Cowardsays:

"In his statement to Motherboard, [IDme CEO Blake] Hall said that facial recognition failures are not a problem with the technology but with the people using it to verify their identity. ?For example, if someone uploads a selfie that only shows half their face.?"

Ahh the ever popular, "You’re doing it wrong!" defense.
Our product is perfect, we never make mistakes, anyone who complains is doing it wrong or a bad actor trying to defraud the system.

Anonymoussays:

it’s not just unemployment, my state DMV also uses ID.me. had an issue last Nov, went online (since walkin offices were closed due to covid). gotta have an account…how to get an account? take your photo, system will compare it to photo in data base to verify it’s you. result? i still don’t have an account, system couldn’t verify me. and i still have the issue…

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Report this ad??|??Hide Techdirt ads
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...
Older Stuff
12:25 Australian Privacy Commissioner Says 7-Eleven Broke Privacy Laws By Scanning Customers' Faces At Survey Kiosks (6)
10:50 Missouri Governor Doubles Down On 'View Source' Hacking Claim; PAC Now Fundraising Over This Bizarrely Stupid Claim (45)
10:45 Daily Deal: The All-in-One Microsoft, Cybersecurity, And Python Exam Prep Training Bundle (0)
09:43 Want To Understand Why U.S. Broadband Sucks? Look At Frontier Communications In Wisconsin, West Virginia (8)
05:36 Massachusetts College Decides Criticizing The Chinese Government Is Hate Speech, Suspends Conservative Student Group (71)
19:57 Le Tigre Sues Barry Mann To Stop Copyright Threats Over Song, Lights Barry Mann On Fire As Well (21)
16:07 Court Says City Of Baltimore's 'Heckler's Veto' Of An Anti-Catholic Rally Violates The First Amendment (15)
13:37 Two Years Later, Judge Finally Realizes That A CDN Provider Is Not Liable For Copyright Infringement On Websites (21)
12:19 Chicago Court Gets Its Prior Restraint On, Tells Police Union Head To STFU About City's Vaccine Mandate (158)
10:55 Verizon 'Visible' Wireless Accounts Hacked, Exploited To Buy New iPhones (8)
10:50 Daily Deal: The MacOS 11 Course (0)
07:55 Suing Social Media Sites Over Acts Of Terrorism Continues To Be A Losing Bet, As 11th Circuit Dumps Another Flawed Lawsuit (11)
02:51 Trump Announces His Own Social Network, 'Truth Social,' Which Says It Can Kick Off Users For Any Reason (And Already Is) (100)
19:51 Facebook AI Moderation Continues To Suck Because Moderation At Scale Is Impossible (26)
16:12 Content Moderation Case Studies: Snapchat Disables GIPHY Integration After Racist 'Sticker' Is Discovered (2018) (11)
13:54 Arlo Makes Live Customer Service A Luxury Option (8)
12:05 Delta Proudly Announces Its Participation In The DHS's Expanded Biometric Collection Program (5)
11:03 LinkedIn (Mostly) Exits China, Citing Escalating Demands For Censorship (14)
10:57 Daily Deal: The Python, Git, And YAML Bundle (0)
09:37 British Telecom Wants Netflix To Pay A Tax Simply Because Squid Game Is Popular (32)
06:41 Report: Client-Side Scanning Is An Insecure Nightmare Just Waiting To Be Exploited By Governments (35)
20:38 MLB In Talks To Offer Streaming For All Teams' Home Games In-Market Even Without A Cable Subscription (10)
15:55 Appeals Court Says Couple's Lawsuit Over Bogus Vehicle Forfeiture Can Continue (15)
13:30 Techdirt Podcast Episode 301: Scarcity, Abundance & NFTs (0)
12:03 Hollywood Is Betting On Filtering Mandates, But Working Copyright Algorithms Simply Don't Exist (66)
10:45 Introducing The Techdirt Insider Discord (4)
10:40 Daily Deal: The Dynamic 2021 DevOps Training Bundle (0)
09:29 Criminalizing Teens' Google Searches Is Just How The UK's Anti-Cybercrime Programs Roll (19)
06:29 Canon Sued For Disabling Printer Scanners When Devices Run Out Of Ink (41)
20:51 Copyright Law Discriminating Against The Blind Finally Struck Down By Court In South Africa (7)
More arrow