Future of Facial Recognition

By: John Honovich, Published on May 04, 2013

The Boston Bombings reaffirmed how far facial recognition needs to develop to be an effective surveillance tool. Despite the PR spin jobs, facial recognition failed to make any difference. Proponents, of course, are quick to talk about how fast improvements are coming and how all this will change in the future (ironically, just like they said 5 years ago). However, one Carnegie Mellon professor had insightful comments about the issues and needs for facial recognition. In this note, we break them down and analyze their likelihood of development.

People Look A Like

That people look a like is underestimated in every day life as most regularly interact with few people. However, a facial recognition system is 'looking at' lots and lots of people. Think of a supermarket. They easily have hundreds of visitors a day, tens of thousands a month. With that many people, quite a number are going to look similar. For a good visual example, see a series of portraits of people who look alike but are not related.

As the professor notes:

"You still have the problem of false positives. When you start working with databases that contain millions of faces, you start to realize that many people look similar to each other."

This problem is complicated further when comparing photos of people with slightly different poses, different lighting conditions, that might be a little fuzzy, etc. Because of this, even when you have just thousands of faces, you can still have problems. Having more pixels does help but it does not overcome the pose and lighting conditions problems.

The Solution?

The professor has an interesting concept to solve this problem, noting what "makes people so good at distinguishing similar faces is that we humans don’t simply do facial recognition when we recognize other people. We do a holistic recognition of the entirety of the person, based on how they are dressed, how they are walking, and on where they are geographically and physically."

The solution he recommends then is:

"Facial recognition will start to put images together with metadata such as how tall you are, what is your favorite way of dressing, where were you most likely to be in the last 24 hours. From a social network, for example, I can see the IP address on which you connected three hours ago, and I can see, because there are so many photos of you, how tall you are, whether you have gained weight or not, your dressing style."

Those who worry about Big Brother will be extremely worried but those who want to better matching will embrace this.

Ultimately, though, while this could help, implementing this will still be difficult. Measuring someone's height from cameras is not possible without manual calibration. Real criminals are unlikely to be posting up to date photos on facebook with showing their new hair style or how much weight they gained. Dress can be easily changed to camouflage appearance, etc.

The Future

The most powerful improvement for facial recognition will likely be high definition cameras, which finally delivers enough detail to capture quality faces across non trivial field of view widths. This, at least, makes it feasible to index faces. Unfortunately, no silver bullet exists for matching, from the unresolved issues in correcting pose to the similarities of people looking like each other. 

Comments (5) : Members only. Login. or Join.

Related Reports

The US Fight Over Facial Recognition Explained on Jul 08, 2020
The controversy around facial recognition has grown significantly in 2020,...
FDA "Does Not Intend to Object" To Unapproved Fever Detection Cameras If No 'Undue Risk' on Apr 17, 2020
The US FDA has declared it will not go after the many companies marketing...
Facial Recognition 101 on Mar 18, 2020
Facial recognition interest, use and fear is increasing. This guide aims to...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Integrated IR Camera Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Jan 30, 2020
The best and worst cameras tested in this IPVM shootout showed major...
Spectron IR Thermal Fever Screening System Examined on Apr 14, 2020
Most are quick to avoid "fever screening" and "medical" labels, but...
Sunell Panda Cam Body Temperature Measurement Camera Tested on May 14, 2020
Sunell is far less well known than its gargantuan domestic competitors Dahua...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...
Faked Coronavirus Fever Detection, Athena Used Hikvision; Responds - Selling NDAA Compliant Cameras, Pledging 50% Of Profits to Victims on Mar 24, 2020
US company, Athena Security, faked its coronavirus fever detection marketing,...
Monitoreal "Completely Autonomous" Home AI Tested on Feb 12, 2020
Monitoreal claims to allow users to "see the things you want (people,...
Anixter Runs Fake Coronavirus Marketing Using Shutterstock Watermarked Images on Jul 24, 2020
Coronavirus faked marketing is regrettably commonplace right now but Anixter...
Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter...
Meditherm Medical Thermal Cameras Examined on May 07, 2020
US-based Meditherm emphasized to IPVM its 20+ year development history and...
Clinton Public View Monitor (PVM) Mask Detection Tested on Jul 09, 2020
Face mask detection, or more specifically not wearing one, is expanding...
Detecting Coronavirus Fevers With Thermal Cameras on Mar 15, 2020
MAY 2020 Update: This post was our early examination of these systems being...

Recent Reports

Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
"Grand Slam" For Pelco's PE Firm, A Risk For Motorola on Aug 07, 2020
The word "Pelco" and "grand slam" have not been said together for many years....
FLIR Stock Falls, Admits 'Decelerating' Demand For Temperature Screening on Aug 07, 2020
Is the boom going to bust for temperature screening? FLIR disappointed...
VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...
Dogs For Coronavirus Screening Examined on Aug 06, 2020
While thermal temperature screening is the surveillance industry's most...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
AHJ / Authority Having Jurisdiction Tutorial on Aug 06, 2020
One of the most powerful yet often underappreciated characters in all of the...
SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...
ADI Returns To Growth, Back To 'Pre-COVID Levels' on Aug 05, 2020
While ADI was hit hard in April, with revenue declining 21%, the company's...
Exposing Fever Tablet Suppliers and 40+ Relabelers on Aug 05, 2020
IPVM has found 40+ USA and EU companies relabeling fever tablets designed,...
Directory of 201 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Dahua Loses Australian Medical Device Approval on Aug 04, 2020
Dahua has cancelled its medical device registration after "discussions" with...
Google Invests in ADT, ADT Stock Soars on Aug 03, 2020
Google has announced a $450 million investment in the Florida-based security...