Future of Facial Recognition

By John Honovich, Published on May 04, 2013

The Boston Bombings reaffirmed how far facial recognition needs to develop to be an effective surveillance tool. Despite the PR spin jobs, facial recognition failed to make any difference. Proponents, of course, are quick to talk about how fast improvements are coming and how all this will change in the future (ironically, just like they said 5 years ago). However, one Carnegie Mellon professor had insightful comments about the issues and needs for facial recognition. In this note, we break them down and analyze their likelihood of development.

People Look A Like

That people look a like is underestimated in every day life as most regularly interact with few people. However, a facial recognition system is 'looking at' lots and lots of people. Think of a supermarket. They easily have hundreds of visitors a day, tens of thousands a month. With that many people, quite a number are going to look similar. For a good visual example, see a series of portraits of people who look alike but are not related.

As the professor notes:

"You still have the problem of false positives. When you start working with databases that contain millions of faces, you start to realize that many people look similar to each other."

This problem is complicated further when comparing photos of people with slightly different poses, different lighting conditions, that might be a little fuzzy, etc. Because of this, even when you have just thousands of faces, you can still have problems. Having more pixels does help but it does not overcome the pose and lighting conditions problems.

The Solution?

The professor has an interesting concept to solve this problem, noting what "makes people so good at distinguishing similar faces is that we humans don’t simply do facial recognition when we recognize other people. We do a holistic recognition of the entirety of the person, based on how they are dressed, how they are walking, and on where they are geographically and physically."

The solution he recommends then is:

"Facial recognition will start to put images together with metadata such as how tall you are, what is your favorite way of dressing, where were you most likely to be in the last 24 hours. From a social network, for example, I can see the IP address on which you connected three hours ago, and I can see, because there are so many photos of you, how tall you are, whether you have gained weight or not, your dressing style."

Those who worry about Big Brother will be extremely worried but those who want to better matching will embrace this.

Ultimately, though, while this could help, implementing this will still be difficult. Measuring someone's height from cameras is not possible without manual calibration. Real criminals are unlikely to be posting up to date photos on facebook with showing their new hair style or how much weight they gained. Dress can be easily changed to camouflage appearance, etc.

The Future

The most powerful improvement for facial recognition will likely be high definition cameras, which finally delivers enough detail to capture quality faces across non trivial field of view widths. This, at least, makes it feasible to index faces. Unfortunately, no silver bullet exists for matching, from the unresolved issues in correcting pose to the similarities of people looking like each other. 

Comments (5) : Members only. Login. or Join.

Related Reports

Facial Recognition 101 on Mar 18, 2020
Facial recognition interest, use and fear is increasing. This guide aims to...
The US Fight Over Facial Recognition Explained on Jul 08, 2020
The controversy around facial recognition has grown significantly in 2020,...
Exacq "Facial Matching" Facial Recognition Tested on Sep 03, 2020
Exacq is claiming "Accurate Recall of Every Noteworthy Person of Interest"...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...
TVT / InVid Facial Recognition Tested on Mar 25, 2020
Facial recognition is frequently sold for thousands of dollars per channel...
Masks Cause Major Facial Recognition Problems on Feb 24, 2020
Coronavirus is spurring an increase in the use of medical masks, which new...
Latest London Police Facial Recognition Suffers Serious Issues on Feb 24, 2020
On February 20, IPVM visited another live face rec deployment by London...
Gait Recognition Examined on Sep 14, 2020
Facial recognition faces increasing ethical and political criticisms while...
Avigilon Facial Recognition 'Appearance Alerts' Tested on Dec 18, 2019
Avigilon has released 'Appearance Alerts' in ACC 7.4, which adds real-time...
The Future of H.266 For Video Surveillance Examined on Aug 17, 2020
First H.264, now H.265, is H.266 next? H.266 was recently announced amid...
FDA "Does Not Intend to Object" To Unapproved Fever Detection Cameras If No 'Undue Risk' on Apr 17, 2020
The US FDA has declared it will not go after the many companies marketing...
Ear Recognition Examined on Oct 12, 2020
Will ear recognition become a viable biometric? Facial, fingerprint, and iris...
Anyvision Presents AI Facial Recognition and Mask Detection on Jun 08, 2020
AnyVision presented its AI facial recognition and mask detection at the May...
Hikvision Dual Lens Face Recognition Camera Tested on Nov 19, 2019
Hikvision's Dual Lens Facial Recognition camera, claims that it "adopts...

Recent Reports

Panasonic Presents i-PRO Cameras and Video Analytics on Oct 19, 2020
Panasonic presented its i-PRO X-Series cameras and AI video analytics at the...
Augmented Reality (AR) Cameras From Hikvision and Dahua Examined on Oct 19, 2020
Hikvision, Dahua, and other China companies are marketing augmented reality...
18 TB Video Surveillance Drives (WD and Seagate) on Oct 19, 2020
Both Seagate and Western Digital recently announced 18TB hard drives...
Watrix Gait Recognition Profile on Oct 16, 2020
Watrix is the world's only gait recognition surveillance provider IPVM has...
Intel Presents Edge-to-Cloud Ecosystem for Video Analytics on Oct 16, 2020
Intel presented its processors and software toolkit for computer vision at...
Best Manufacturer Technical Support 2020 on Oct 16, 2020
5 manufacturers stood out as providing the best technical support to ~200...
Microsoft Azure Presents Live Video Analytics on Oct 15, 2020
Microsoft Azure presented its Live Video Analytics offering at the September...
Worst Manufacturer Technical Support 2020 on Oct 15, 2020
4 manufacturers stood out as providing the worst technical support to ~200...
Clorox Announces, Then Pulls, Fever Camera on Oct 15, 2020
For almost one week, Clorox was marketing fever cameras. The booming...
Faulty Hikvision Fever Cam Setup at Mexico City Basilica and Cathedral on Oct 14, 2020
Donated Hikvision fever cameras (claiming screening of 1,800 people/min. with...
Directory of 209 "Fever" Camera Suppliers on Oct 14, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Avigilon UMD / UAD Tested on Oct 14, 2020
Avigilon's Unusual Activity Detection and Unusual Motion Detection claim to...
Longse Promoting Hikvision Partner Fullhan Chip Based Cameras on Oct 14, 2020
With Huawei HiSilicon production being shut down at TSMC, camera...
Meridian & Goodview (BEMS Relabeller) Temperature Screening Tested on Oct 13, 2020
A lot of temperature tablets look exactly alike and that is because they use...
Monitoring Alarm Systems From Home - Innovation or Danger? on Oct 13, 2020
Remote monitoring by alarm companies since COVID-19 is bringing cost savings...