Fragility of Facial Recognition

Author: John Honovich, Published on Dec 22, 2009

The December 2009 uproar over 'racist' facial recognition from HP demonstrates an important risk for real world video analytic deployments. For background, watch the viral video with almost 3 million views below:

It's fairly clear that neither facial recognition nor HP are purposefully racist. As HP and most commentators note, this is almost certainly a lighting issue.

Here's the key practical problem: If users can see the face, they expect computers to see the face. This is almost a law in real world video analytics performance: Anything a user can detect, they expect a computer to be able to do. This may be unfair and certainly technically incorrect but it's a basically a sociological 'fact.'

Video analytics are much more fragile to real world conditions (lighting, weather, etc.) than the human eye. It's why video analytics can demo very well in the lab and the office but struggles so frequently in the field.

If you want proof of this tragicomedy, watch the video below of Consumer Report showing how to make facial recognition work with black people. They fail at first and struggle to do so.

Most people do not care about the technical limitations nor do they want to have to optimize their lighting or scenes to accomplish such recognition (contra to the demanding requirements we examined for facial recognition in October 2009).

While facial recognition in professional video surveillance is certainly far more sophisticated than HP's consumer face tracking, as SSN points out, this is yet another black eye for video analytics.

Video analytics tend to be fragile to a wide variety of real world conditions. The free flow of information on the Internet only makes these problems more visible and broadly understood.

Comments : PRO Members only. Login. or Join.

Related Reports

Video Analytics Integration Guide on Aug 16, 2018
Video analytics is hot again (at least conceptually) but integrating video analytics with VMSes can be challenging. This is especially significant...
ISS VMS / Video Analytics Company Profile on Aug 16, 2018
Who is ISS? In the past few months, they had one of the craziest ISC West promo items in years. Then, they hired industry veteran and ex-Dahua...
RealNetworks Free School Facial Recognition on Aug 03, 2018
The company that created RealPlayer is moving beyond media delivery and into the security space with a new facial recognition platform they have...
IP Camera Analytics Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview on Jul 30, 2018
Video analytics are hot again. But whose analytics really work? IPVM bought and tested Avigilon, Axis, Bosch, Dahua, Hanwha and Hikvision cameras,...
99.9997% Accurate Amazon Facial Rekognition Falsely Matches 28 on Jul 27, 2018
A new facial recognition controversy has arisen, with the ACLU cleverly using Amazon's Rekognition service to falsely match 28 Congresspeople to...
Eagle Eye Networks Cloud VMS Tested on Jul 26, 2018
Eagle Eye has become one of the most significant players in the industry in the past few years: Eagle Eye's Owner Acquired Brivo Eagle Eye...
Avigilon "Self-Learning" Analytics And VMD Tested on Jul 23, 2018
Avigilon is a popular choice for video analytics, offering "self-learning" analytics built into their cameras as well as appliances. We tested...
AI Startup Anyvision Raises $28 Million Led By Bosch on Jul 20, 2018
Anyvision is the most ambitious heavy-spending video surveillance startup in many years. And, now, the startup has raised $28 million led by...
Fail: Dahua "Didn't Check The Lux Levels but It Was Dark" on Jul 20, 2018
Dahua UK has been promoting their camera quality on LinkedIn: I, and others, asked what the lux level of the scene was. (background: Lux Rating...
Directory of Video Surveillance Startups on Jul 18, 2018
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known entity...

Most Recent Industry Reports

Backup Power For Maglocks Guide on Aug 20, 2018
When the main power fails, many believe maglocks must leave doors unlocked. However, battery backed up maglocks are allowed according to IBC /...
Axis Strong Q2 2018 Results on Aug 20, 2018
Axis reported strong Q2 2018 financial results and, for the first time in many years, Axis grew faster than Hikvision. However, the company's...
2Gig Gun Lock / Motion Detector Tested on Aug 17, 2018
Safer guns for families and an opportunity for security dealers to sell more services? That is the aim of Nortek's 2GIG 'Gun Motion Detector'...
Video Analytics Integration Guide on Aug 16, 2018
Video analytics is hot again (at least conceptually) but integrating video analytics with VMSes can be challenging. This is especially significant...
Hikvision IP Camera Critical Vulnerability 2018 Disclosed on Aug 16, 2018
The same day that the US government passed a prohibition on Hikvision cameras, Hikvision disclosed a critical vulnerability for its IP...
ISS VMS / Video Analytics Company Profile on Aug 16, 2018
Who is ISS? In the past few months, they had one of the craziest ISC West promo items in years. Then, they hired industry veteran and ex-Dahua...
Chinese OEM Avycon Gets ADI Push on Aug 15, 2018
Who is Avycon? An American company? A Korean company? A couple of guys relabelling Chinese products? The latter is the best explanation. While...
Backboxes for Video Surveillance Tutorial on Aug 15, 2018
Backboxes are a necessity in surveillance, whether for managing cable whips, recessing cameras, adding wireless radios. But it can be confusing to...
Genetec Stratocast / Comcast 'Motion Insights' Examined on Aug 15, 2018
Comcast recently announced "SmartOffice Motion Insights", an extension to their Genetec OEMed cloud video service (covered by IPVM here). This...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact