Future of Facial Recognition

By: John Honovich, Published on May 04, 2013

The Boston Bombings reaffirmed how far facial recognition needs to develop to be an effective surveillance tool. Despite the PR spin jobs, facial recognition failed to make any difference. Proponents, of course, are quick to talk about how fast improvements are coming and how all this will change in the future (ironically, just like they said 5 years ago). However, one Carnegie Mellon professor had insightful comments about the issues and needs for facial recognition. In this note, we break them down and analyze their likelihood of development.

People Look A Like

That people look a like is underestimated in every day life as most regularly interact with few people. However, a facial recognition system is 'looking at' lots and lots of people. Think of a supermarket. They easily have hundreds of visitors a day, tens of thousands a month. With that many people, quite a number are going to look similar. For a good visual example, see a series of portraits of people who look alike but are not related.

As the professor notes:

"You still have the problem of false positives. When you start working with databases that contain millions of faces, you start to realize that many people look similar to each other."

This problem is complicated further when comparing photos of people with slightly different poses, different lighting conditions, that might be a little fuzzy, etc. Because of this, even when you have just thousands of faces, you can still have problems. Having more pixels does help but it does not overcome the pose and lighting conditions problems.

The Solution?

The professor has an interesting concept to solve this problem, noting what "makes people so good at distinguishing similar faces is that we humans don’t simply do facial recognition when we recognize other people. We do a holistic recognition of the entirety of the person, based on how they are dressed, how they are walking, and on where they are geographically and physically."

The solution he recommends then is:

"Facial recognition will start to put images together with metadata such as how tall you are, what is your favorite way of dressing, where were you most likely to be in the last 24 hours. From a social network, for example, I can see the IP address on which you connected three hours ago, and I can see, because there are so many photos of you, how tall you are, whether you have gained weight or not, your dressing style."

Those who worry about Big Brother will be extremely worried but those who want to better matching will embrace this.

Ultimately, though, while this could help, implementing this will still be difficult. Measuring someone's height from cameras is not possible without manual calibration. Real criminals are unlikely to be posting up to date photos on facebook with showing their new hair style or how much weight they gained. Dress can be easily changed to camouflage appearance, etc.

The Future

The most powerful improvement for facial recognition will likely be high definition cameras, which finally delivers enough detail to capture quality faces across non trivial field of view widths. This, at least, makes it feasible to index faces. Unfortunately, no silver bullet exists for matching, from the unresolved issues in correcting pose to the similarities of people looking like each other. 

Comments (5) : Members only. Login. or Join.

Related Reports

Detecting Coronavirus Fevers With Thermal Cameras on Mar 15, 2020
MAY 2020 Update: This post was our early examination of these systems being used in the pandemic. For more up to date coverage, see The Booming...
Clearview AI Alarm - NY Times Report Says "Might End Privacy" on Jan 20, 2020
Over the weekend, the NY Times released a report titled "The Secretive Company That Might End Privacy as We Know It" about a company named...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance testing facility that will allow us to significantly expand our...
XNOR.ai Terminates Wyze on Nov 27, 2019
Wyze has shocked the industry again - this time with a major setback. Just months ago, Wyze triumphantly added AI analytics to their ~$20 cameras,...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
UK Facial Recognition Essex Errors Report on Jul 05, 2019
Facial recognition trials in the UK have generated significant controversy and debate over the past few years. This week, it flared again when Sky...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
IBM Shuts Down "Intelligent Video Analytics" [Update: New Video Analytics Offered] on May 02, 2019
Abruptly, IBM has discontinued its Intelligent Video Analytics solution, it confirmed to IPVM. IBM's video analytics have faced recent media...
AI Video Tester Released on Apr 02, 2019
IPVM has released the world's first AI video tester that lets you see how various AI models (including from Amazon, Google, Microsoft and YOLO)...

Most Recent Industry Reports

LIVE NOW "Fever Camera" Show on Jun 02, 2020
IPVM is excited for the world's first "Fever Camera" show, to be held today Tuesday, June 2nd and Wednesday the 3rd from 11am to 4pm EDT, giving...
Smart Entry Systems Presents Cloud Multi-Tenant Access Control on Jun 02, 2020
Smart Entry Systems presented Cloud Multi-Tenant Access Control at the May 2020 IPVM Startups show. Inside this report: A 30-minute video...
Genetec Drops Support for Dahua and Hikvision on Jun 01, 2020
Genetec has dropped support for Dahua and Hikvision, citing US blacklisting and ONVIF conformance blockage, the company informed partners in an...
Dotty "Hot Or Not" Elevated Body Temperature App Tested on Jun 01, 2020
What if you could take an existing phone or tablet and transform it into "fever camera"? That is what DottyAR is doing with their strangely named...
Optris "Fever Screening Systems" Examined on Jun 01, 2020
German manufacturer Optris has been building temperature measuring instruments for industrial manufacturing for over 15 years, and thermal cameras...
Fever Camera Sales From Integrators Surveyed on Jun 01, 2020
Fever cameras are the hottest trend in video surveillance currently but how much are integrators selling them? 220 integrators answered the...
Proxy Presents Mobile Credentials For BLE Devices and Access on May 29, 2020
Proxy presented Mobile Credentials For BLE Devices and Access at the May 2020 IPVM Startups show. Inside this report: A 30-minute video...
ISC West 2020 Moves To The Basement on May 29, 2020
The twice cancelled/postponed show will now not only be held in a different month (October) but on a different floor, moving down to the...
Integrators Avoiding Coronavirus Air Travel on May 29, 2020
IPVM asked integrators if air travel is part of their 2020 plans to see how significantly Coronavirus will impact future...
Viakoo Presents Cyber Hygiene for Cameras on May 28, 2020
Viakoo presented its 'Cyber Hygiene' and 'Service Assurance' products at the April 2020 IPVM New Products show. Inside this report: A...