The Key Challenge for Video Analytics

Author: John Honovich, Published on May 06, 2008

It's all about false positives. Catching the bad guy is pretty easy for today's perimeter violation and abandoned object detection. Not catching anything else -- the sun, the moon, the wind, the birds, the rain, the trees -- that's the challenge.

This should not be that much of a secret. A little bit of experience with any of the dozens of video analytics vendors in today's market demonstrates this.

So it shocked me that Bosch has decided to turn the easy part into the 'challenge'. Here's Dr. Bob explaining what Bosch did at ISC West:

"For the IVA (Intelligent Video Analysis) challenge we had people lining up from 10am when the doors opened till the end – over 2,300 people took the challenge, which was to steal a Bosch power drill from under the nose of our IP camera without the alarm going off.

Dr. Bob exults: "Yes, I think we can safely say we got our message across – our products are smarter than the average bear, and bringing intelligent video analytics to the masses is a good example." 

This is cunning marketing but, at best, it is wildly misleading and, at worst, it is a scam.

Now, I am not judging the quality of Bosch's product nor is Bosch the first or last company who will frame the issue as such.

That being said, this challenge is worthless in judging the quality of an analytic because:

  1. Any decent prototype can accurately generate correct matches in a controlled environment.
  2. Economically, minimizing false alerts is critical to establishing the business case.

Reducing False Positives

Making sure you only trigger when someone is violating is hard because there are so many factors that might set off the analytic besides a valid adversary. To a computer, rain, dust and snow can all generate a similar form to a human being. Quick changes in light or the movement of water (waves) can also generate such forms. A camera that shakes because of the wind or issues with the mounting or installation also can trigger such alerts.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

The hard part in such analytics is to make sure that these alerts can be eliminated. This is a key metric in testing and differentiating between analytics.

The Economics of False Positives

False positives drive up the cost of systems. Many (most?) organizations do not have a centralized monitoring system in place to respond and assess video analytic alerts. This places the burden on individual security managers to respond to alerts. Over the last 5 years, getting dozens (hundreds) of false alerts per day (especially if you deploy numerous cameras with video analytics) has been common. This can become an emotional and operational dealbreaker (even if it passed the Bosch challenge).

While it is better operationally to centrally manage alerts, if the system generates dozens or hundreds of false alerts per day, the costs can become prohibitive. Let's say an 'intelligent' camera generates 5 false alerts a day at the cost of $1 per alert (the unit cost to pay a monitor to assess). That's $5 per day, over $1,800 per year and about $10,000 for a projected 5 year lifecycle. If you have dozens or hundreds of cameras, this hidden operational cost can be in the millions.

And this is not theoretical. This is the feedback you will hear time and again from real world deployments. It's widely accepted that this is improving but it is still the major factor in assessing the quality of analytics.

Bosch may think that these tricks are making people more excited and more accepting of analytics. Most security managers have been excited about analytics for a long time. They see the obvious potential to mitigate risks and reduce losses.

Security managers are justifiably not as accepting because they are afraid of the cost and performance of analytics. Bosch is not helping this key consideration. It's baiting integrators and security managers into dangerous territory. We need more clarity and honesty about what analytics can do and how well they can do it. Start with testing false positives under the real conditions of your security operations.

2 reports cite this report:

Is Bosch Over-Selling Video Analytics? on Mar 25, 2009
Analysts and pundits agree that video analytics has been significantly over-sold in the last few years. Bosch certainly did its part with its IVA...
Do Video Analytics Work? on Sep 01, 2008
Manufacturers say video analytics work.  Customers and integrators often say they do not.  Are manufacturers simply lying? Are customers simply...

Related Reports on Video Analytics

Deep Learning Tutorial For Video Surveillance on Oct 17, 2017
Deep learning is a growing buzzword within physical security and video surveillance. But what is 'deep learning'? In this tutorial, we explain...
Startup Turing Video Segway-Based Security Robot Profile on Sep 13, 2017
If security robots can not replace guards, perhaps the next best thing is a robot the guard can actually ride.  Turing Video has raised $5...
BBC Featured Deep Learning Face Recognition Analyzed (Digital Barriers) on Aug 30, 2017
The UK's largest broadcaster, BBC, recently featured Digital Barriers (also based in the UK) on a segment highlighting face recognition technology....
Nvidia For Video Surveillance Examined on Aug 23, 2017
Nvidia is making a big push into the security market, claiming more than 50 partners, investing heavily in industry events, positioning their GPUs...
Healthy Skepticism for Deep Learning Is Prudent on Jul 26, 2017
The hype for deep learning in video surveillance is accelerating. Between the race to the bottom and dearth of a 'next big thing', certainly pent...
Hikvision Launching Deep Learning Recorders on Jul 20, 2017
Hikvision has become a common choice for super low cost NVRs. Now, Hikvision is aiming to move up market, with deep learning NVRs that claim far...
Microsoft Video AI Cloud Services Examined on Jul 18, 2017
Microsoft has released one of the most amazing video analytics marketing videos ever. In it, they detect oil spills, track individual people giving...
Deep Learning Surveillance Startups Deep Problem on Jun 23, 2017
The undeniably good news for the video surveillance market is that we are seeing the rise of more startups than in many years. The cause of this...
Avigilon Announces RADAR-Based Presence Detector on Jun 22, 2017
RADAR is gaining momentum within physical security. Two months after Axis announced a network radar detector, Avigilon has announced a RADAR-Based...
PureTech Video Analytics Examined on Apr 21, 2017
PureTech's analytics were chosen for a US border protection system (see related post), which the company claims no other analytics vendor was able...

Most Recent Industry Reports

Cisco Falling - Favorite Network Switches 2017 on Oct 20, 2017
1 major manufacturer fell and 1 outsider manufacturer gained as integrator favorites for network switches from more than 140 votes / explanations...
Uniview Recorder Backdoor Examined on Oct 20, 2017
A Chinese research group has identified a vulnerability in Uniview recorders that allows backdoor access in a method similar to the Dahua...
Hikvision Access Control Tested on Oct 19, 2017
Hikvision aggressive pricing and marketing combined with generally reliable hardware and free software has made them a major player in video...
Verkada, Silicon Valley VSaaS Startup, Targets Enterprise on Oct 19, 2017
Verkada says they are building an enterprise-class VSaaS offering, calling it "The new platform for video security". This is a departure from the...
Exacq Unbreaks Avigilon Integration on Oct 18, 2017
For nearly 4 years, Exacq had broken and effectively blocked use with Avigilon cameras, as IPVM reported in January 2014. Now, Exacq has...
Search More Important Than Live Monitoring - Statistics on Oct 18, 2017
Search is overall more important than live monitoring to integrators, according to new IPVM statistics.  The key themes found in integrator...
Axis 'Sold Out' P3707-PVE Multi-Imager Tested on Oct 18, 2017
Axis faced significant product shortages over the summer. Perhaps the most notorious and significantly sold out model was the Axis P3707-PE 8MP...
Dahua Removes Auto Rebooting on Oct 17, 2017
For years, Dahua has automatically programmed its IP cameras to reboot weekly, a highly atypical and questionable practice. Following IPVM...
Deep Learning Tutorial For Video Surveillance on Oct 17, 2017
Deep learning is a growing buzzword within physical security and video surveillance. But what is 'deep learning'? In this tutorial, we explain...
Multipoint Lock Access Control Tutorial on Oct 17, 2017
Doors are notoriously weak at stopping entry, and money can be misspent on wrong locks that leave doors quite vulnerable. While closed and locked...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact