The Key Challenge for Video Analytics

By: John Honovich, Published on May 06, 2008

It's all about false positives. Catching the bad guy is pretty easy for today's perimeter violation and abandoned object detection. Not catching anything else -- the sun, the moon, the wind, the birds, the rain, the trees -- that's the challenge.

This should not be that much of a secret. A little bit of experience with any of the dozens of video analytics vendors in today's market demonstrates this.

So it shocked me that Bosch has decided to turn the easy part into the 'challenge'. Here's Dr. Bob explaining what Bosch did at ISC West [link no longer available]:

"For the IVA (Intelligent Video Analysis) challenge we had people lining up from 10am when the doors opened till the end – over 2,300 people took the challenge, which was to steal a Bosch power drill from under the nose of our IP camera without the alarm going off.

Dr. Bob exults: "Yes, I think we can safely say we got our message across – our products are smarter than the average bear, and bringing intelligent video analytics to the masses is a good example." 

This is cunning marketing but, at best, it is wildly misleading and, at worst, it is a scam.

Now, I am not judging the quality of Bosch's product nor is Bosch the first or last company who will frame the issue as such.

That being said, this challenge is worthless in judging the quality of an analytic because:

  1. Any decent prototype can accurately generate correct matches in a controlled environment.
  2. Economically, minimizing false alerts is critical to establishing the business case.

Reducing False Positives

Making sure you only trigger when someone is violating is hard because there are so many factors that might set off the analytic besides a valid adversary. To a computer, rain, dust and snow can all generate a similar form to a human being. Quick changes in light or the movement of water (waves) can also generate such forms. A camera that shakes because of the wind or issues with the mounting or installation also can trigger such alerts.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

The hard part in such analytics is to make sure that these alerts can be eliminated. This is a key metric in testing and differentiating between analytics.

The Economics of False Positives

False positives drive up the cost of systems. Many (most?) organizations do not have a centralized monitoring system in place to respond and assess video analytic alerts. This places the burden on individual security managers to respond to alerts. Over the last 5 years, getting dozens (hundreds) of false alerts per day (especially if you deploy numerous cameras with video analytics) has been common. This can become an emotional and operational dealbreaker (even if it passed the Bosch challenge).

While it is better operationally to centrally manage alerts, if the system generates dozens or hundreds of false alerts per day, the costs can become prohibitive. Let's say an 'intelligent' camera generates 5 false alerts a day at the cost of $1 per alert (the unit cost to pay a monitor to assess). That's $5 per day, over $1,800 per year and about $10,000 for a projected 5 year lifecycle. If you have dozens or hundreds of cameras, this hidden operational cost can be in the millions.

And this is not theoretical. This is the feedback you will hear time and again from real world deployments. It's widely accepted that this is improving but it is still the major factor in assessing the quality of analytics.

Bosch may think that these tricks are making people more excited and more accepting of analytics. Most security managers have been excited about analytics for a long time. They see the obvious potential to mitigate risks and reduce losses.

2 reports cite this report:

Is Bosch Over-Selling Video Analytics? on Mar 25, 2009
Analysts and pundits agree that video analytics has been significantly...
Do Video Analytics Work? on Sep 01, 2008
Manufacturers say video analytics work.  Customers and integrators often say...

Related Reports

Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
Verkada Coronavirus Response: Free Temp Systems For Government and Health Care on Apr 07, 2020
Verkada has built a reputation on giving away things for free - free Yeti...
Sunell Panda Cam Body Temperature Measurement Camera Tested on May 14, 2020
Sunell is far less well known than its gargantuan domestic competitors Dahua...
Colombia's President Promotes Bad Hikvision Fever Camera Setup on Jun 17, 2020
Colombia's President Iván Duque has promoted a haphazard Hikvision fever...
Hikvision Salespeople: We Don't Need A Blackbody on May 13, 2020
Dahua jumped out on its cross-town rival selling fever cameras but Hikvision...
Anixter Runs Fake Coronavirus Marketing Using Shutterstock Watermarked Images on Jul 24, 2020
Coronavirus faked marketing is regrettably commonplace right now but Anixter...
Dangerous Hikvision Fever Screening Marketing In Africa on Sep 15, 2020
A multi-national African Hikvision distributor is marketing dangerously...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they...
BriefCam Video Analytics Tested on Jan 06, 2020
BriefCam, acquired by Canon in 2018, is one of the most commonly used video...
IronYun AI Analytics Tested on Feb 17, 2020
Taiwan / US startup IronYun has raised tens of millions for its "mission to...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are...
Bezos-Funded Deep Sentinel Tested on Mar 28, 2019
Backed by Jeff Bezos, the Silicon Valley startup, Deep Sentinel, has...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
PSIM CNL Acquired By Everbridge on Mar 09, 2020
The end has finally come for CNL. Despite for years saying they would...
Video Analytics 101 on Mar 16, 2020
This guide teaches the fundamentals of video surveillance...

Recent Reports

OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...
China Bems Temperature Measurement Terminal Tested on Sep 22, 2020
Guangzhou Bems (brand Benshi) is the manufacturer behind temperature...
Axis Exports To China Police Criticized By Amnesty International on Sep 21, 2020
Axis Communications and other EU surveillance providers are under fire from...
Milestone XProtect on AWS Tested on Sep 21, 2020
Milestone finally launched multiple cloud solutions in 2020, taking a...