FAILED: Facial Recognition & Boston Bombing

Author: John Honovich, Published on Apr 20, 2013

Facial recognition vendors have been tripping over themselves to take credit, insert or claim the wonders of their offerings to identify the Boston bombers. However, an excellent Washington Post investigative report cites Boston's Police Commissioner, confirming that:

"Facial-recognition software did not identify the men in the ball caps. The technology came up empty even though both Tsarnaevs’ images exist in official databases."

So what solved the case? A lot of:

"Work [that] was painstaking and mind-numbing: One agent watched the same segment of video 400 times."

Plus, a critical tip from a victim who had seen the bomber face to face:

"FBI agents quickly came to Bauman’s bedside. A man in sunglasses and black baseball cap had walked right up to him, placed a black backpack on the ground and stepped away, Bauman remembered.

His tip became a critical lead, according to law enforcement officials."

A story that should be about the around the clock work of human investigators and the resolve of a man whose legs were torn off has been turned into a promotional campaign for technology vendors.

Technical Barriers to Facial Recognition

The images captured on the street, both from surveillance cameras and smartphones, were not good enough to deliver high accuracy matching. Recall the video from the Lord & Taylor's surveillance cameras, excerpt below:

There's too much downtilt plus the subjects are tending to look the other way, plus the pixel density is too low (standard definition camera with a ~15 foot wide FoV). And obviously the other suspect (#1) was wearing a forward facing cap and sunglasses, causing even more problems.

Note, this does not mean the cameras deployed were necessarily 'bad'. They are sufficient for general monitoring but not for the radically more demanding needs of facial recognition.

Only 'Hollywood' make believe facial recognition could use this.

Ironically, the images from smartphones were of better suitability for facial recognition than surveillance cameras. Here's an excerpt from one of the best ones:

This is obviously from a much wider FoV and the resulting pixel density is too low to deliver accurate facial matching. A fuzzy image of a face may be 'easy' for a human to verify against a specific person/photo but ask a computer to do this against millions of images and it becomes an exercise in futility.

Comments (19): PRO Members only. Login. or Join.

Related Reports on Facial Recognition

Face Recognition Camera Tested (Netatmo) on Jan 29, 2016
Can face recognition make home security "better"? That is the bold claim from startup Netatmo with their Welcome camera. But with face...
Simplicam Facial Recognition Tested on Jan 23, 2015
Facial recognition, available for $150? That's the offer from a startup, Simplicam, who has not only cloned Dropcam setup and user interface but...
Japanese Stores Facial Recognition Sharing on Apr 21, 2014
A controversy is brewing in Japan after a newspaper was tipped off about a practice stores use to combat shoplifting. A network of stores uses...
Debunking Start-Up's FST21 Case Study on Oct 07, 2013
This company won ISC West Best in Show 2 years ago, recently received $5 million in funding and is being talked about as the next big thing in...
The Laziest RFP Ever on Aug 13, 2013
Bad RFPs - out of date, vague or just plain confusing - are common. But this RFP is on a whole other level. It is as if no one even looked at...
3VR Significant Layoffs on Jun 28, 2013
3VR has laid off 15 employees, five of which are from its sales team, IPVM has learned. This leaves the company with a skeleton crew of three sales...
Multi-Camera Tracking Works? on Jun 27, 2013
Being able to track people across cameras and buildings simply by using cameras and analytics is something of a 'holy grail' for the surveillance...
Future of Facial Recognition on May 04, 2013
The Boston Bombings reaffirmed how far facial recognition needs to develop to be an effective surveillance tool. Despite the PR spin jobs, facial...
Successful Facial Surveillance Case on Jan 07, 2013
Real time facial surveillance is hard to do - accuracy issues, false alerts, cost and deployment complexity all conspire against it. This is why,...

Most Recent Industry Reports

Sony IP Camera Backdoor Uncovered on Dec 06, 2016
A backdoor has been uncovered in ~80 Sony IP camera models, attackers can remotely enable telnet on the camera, and then potentially login as root,...
Milestone Favorability Results on Dec 06, 2016
In our second installment of manufacturer favorability results (first was Pelco), we turn to Milestone. 100+ integrators rated and explained what...
XiongMai Master Password List Emailed By Chinese Spammer on Dec 05, 2016
XiongMai created an international uproar as their devices drove massive botnet attacks of major Internet sites. After pledging to recall cameras...
Hikvision Cloud Security Vulnerability Uncovered on Dec 05, 2016
A security researcher uncovered a critical vulnerability in Hikvision's global cloud servers. This vulnerability allowed an attacker to remotely...
Door Operators Access Control Tutorial on Dec 05, 2016
Doors equipped with door operators, specialty devices that automate opening and closing, tend to be quite complex. The mechanisms needed to...
Pelco Favorability Results on Dec 02, 2016
This is the first in a series of studies of manufacturer favorability. 100+ integrators rated and explained their views of each manufacturer. We...
Hikvision CEO Declares 'We Do Not Cut Rates" on Dec 02, 2016
Hikvision has led another press trip to China, and this time Hikvision's CEO is sharing insights into their competitive strategy, including...
Network Security Audit App (March Networks) Examined on Dec 01, 2016
Verifying one's video surveillance devices are locked down against common cybersecurity vulnerabilities is increasing important, as hacks using...
FLIR Acquires Drone Manufacturer For $134M on Dec 01, 2016
FLIR has acquired Prox Dynamics, a Norwegian maker of small military-grade drones, for $134M.  FLIR president Andy Teich provided additional...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact