The Key Challenge for Video Analytics

Author: John Honovich, Published on May 06, 2008

It's all about false positives. Catching the bad guy is pretty easy for today's perimeter violation and abandoned object detection. Not catching anything else -- the sun, the moon, the wind, the birds, the rain, the trees -- that's the challenge.

This should not be that much of a secret. A little bit of experience with any of the dozens of video analytics vendors in today's market demonstrates this.

So it shocked me that Bosch has decided to turn the easy part into the 'challenge'. Here's Dr. Bob explaining what Bosch did at ISC West:

"For the IVA (Intelligent Video Analysis) challenge we had people lining up from 10am when the doors opened till the end – over 2,300 people took the challenge, which was to steal a Bosch power drill from under the nose of our IP camera without the alarm going off.

Dr. Bob exults: "Yes, I think we can safely say we got our message across – our products are smarter than the average bear, and bringing intelligent video analytics to the masses is a good example." 

This is cunning marketing but, at best, it is wildly misleading and, at worst, it is a scam.

Now, I am not judging the quality of Bosch's product nor is Bosch the first or last company who will frame the issue as such.

That being said, this challenge is worthless in judging the quality of an analytic because:

  1. Any decent prototype can accurately generate correct matches in a controlled environment.
  2. Economically, minimizing false alerts is critical to establishing the business case.

Reducing False Positives

Making sure you only trigger when someone is violating is hard because there are so many factors that might set off the analytic besides a valid adversary. To a computer, rain, dust and snow can all generate a similar form to a human being. Quick changes in light or the movement of water (waves) can also generate such forms. A camera that shakes because of the wind or issues with the mounting or installation also can trigger such alerts.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

The hard part in such analytics is to make sure that these alerts can be eliminated. This is a key metric in testing and differentiating between analytics.

The Economics of False Positives

False positives drive up the cost of systems. Many (most?) organizations do not have a centralized monitoring system in place to respond and assess video analytic alerts. This places the burden on individual security managers to respond to alerts. Over the last 5 years, getting dozens (hundreds) of false alerts per day (especially if you deploy numerous cameras with video analytics) has been common. This can become an emotional and operational dealbreaker (even if it passed the Bosch challenge).

While it is better operationally to centrally manage alerts, if the system generates dozens or hundreds of false alerts per day, the costs can become prohibitive. Let's say an 'intelligent' camera generates 5 false alerts a day at the cost of $1 per alert (the unit cost to pay a monitor to assess). That's $5 per day, over $1,800 per year and about $10,000 for a projected 5 year lifecycle. If you have dozens or hundreds of cameras, this hidden operational cost can be in the millions.

And this is not theoretical. This is the feedback you will hear time and again from real world deployments. It's widely accepted that this is improving but it is still the major factor in assessing the quality of analytics.

Bosch may think that these tricks are making people more excited and more accepting of analytics. Most security managers have been excited about analytics for a long time. They see the obvious potential to mitigate risks and reduce losses.

Security managers are justifiably not as accepting because they are afraid of the cost and performance of analytics. Bosch is not helping this key consideration. It's baiting integrators and security managers into dangerous territory. We need more clarity and honesty about what analytics can do and how well they can do it. Start with testing false positives under the real conditions of your security operations.

2 reports cite this report:

Is Bosch Over-Selling Video Analytics? on Mar 25, 2009
Analysts and pundits agree that video analytics has been significantly over-sold in the last few years. Bosch certainly did its part with its IVA...
Do Video Analytics Work? on Sep 01, 2008
Manufacturers say video analytics work.  Customers and integrators often say they do not.  Are manufacturers simply lying? Are customers simply...

Related Reports on Video Analytics

Best and Worst ISC West 2018 on Apr 16, 2018
ISC West 2018 had strong attendance, modest overall new products, and a surge in Artificial Intelligence marketing. First, here are 20+...
Eocortex / Macroscop VMS Company Profile on Apr 09, 2018
Eocortex is the international brand of Russian VMS manufacturer Macroscop. Macroscop was founded in 2008, and the Eocortex name created in 2013. We...
VMS New Developments Spring 2018 (Avigilon, Exacqvision, Genetec, Hikvision, Milestone, Network Optix) on Apr 04, 2018
What's new with VMS software? In this report, we examine new features and releases for Spring 2018 to track different areas of potential...
Favorite Video Analytic Manufacturers 2018 on Apr 02, 2018
Video analytics is one of the biggest trends in 2018, driven by marketing for Artificial Intelligence and Deep Learning. But what do integrators...
Destructive Video Analytics Hype Returns on Mar 27, 2018
It is not just Hikvision's false advertising campaign. With marketing money being pumped into deep learning, we are returning to the bad old...
Startup Image Intelligence 10X Accuracy Guarantee on Mar 26, 2018
An Australian startup, Image Intelligence, is targeting the biggest problem of video analytics, poor accuracy, with quite a claim: Is this...
Axis Z-Wave IP Camera Tested Poorly on Mar 20, 2018
Z-Wave is drawing notable interest for video surveillance use. In IPVM's initial coverage, 84% expressed interest in it, with nearly half being...
Video Analytics Usage Statistics 2018 on Mar 09, 2018
Video analytics is hot again (one of the top 2 trends going into this year), this time driven by deep learning and artificial intelligence. But,...
Directory of 50+ LPR / ANPR Providers on Feb 21, 2018
License Plate Recognition / Automatic Number Plate Recognition are a type of video analytics software that can identify and match license / number...
Hikvision DeepInMind Tested Terribly on Feb 15, 2018
While Hikvision is heavily marketing deep learning and 'AI' as their next big thing, new IPVM test results of their DeepInMind NVR shows their deep...

Most Recent Industry Reports

Global Real-Time Video Surveillance - EarthNow on Apr 20, 2018
A new company, EarthNow, with backing from Bill Gates, Airbus and more, is claiming that: Users will be able to see places on Earth with a delay...
Dedicated Vs Converged Access Control Networks (Statistics) on Apr 20, 2018
Running one's access control system on a converged network, with one's computers and phones, can save money. On the other hand, hand, doing so can...
April 2018 IP Networking Course on Apr 19, 2018
This is the last chance to register for our IP Networking course. Register now. NEW - 2 sessions per class, 'day' and 'night' to give you double...
Rare Video Surveillance Fundraising - Verkada $15 Million on Apr 19, 2018
Fundraising in video surveillance (and the broader physical security market) has been poor recently. Highlights are few and far in between...
'Best In Show' Fails on Apr 19, 2018
ISC West's "Best In Show" has failed. For more than a decade, it has become increasingly irrelevant as the selections exhibit a cartoon level...
Security Camera Cleaning Frequency Statistics on Apr 18, 2018
150+ integrators told IPVM how often they clean cameras on customer's sites and why.  Inside we examine their answers and break down feedback...
Worst Access Control 2018 on Apr 18, 2018
Three access control providers stood out as providing the most problems for integrators. In this report, we analyze the answers to: "In the...
Axis VMD4 Analytics Tested on Apr 17, 2018
Axis is now on its 4th generation of video motion detection (VMD), which Axis calls "a free video analytics application." In this generation, Axis...
Arecont CEO And President Resign on Apr 17, 2018
This is good news for Arecont. Arecont's problems have been well known for years (e.g., most recently Worst Camera Manufacturers 2018 and starting...
Strong ISC West 2018, Says Manufacturers, GSX / ASIS Expected Weaker on Apr 17, 2018
Manufacturers say ISC West 2018 was strong, continuing the trend we have seen in 2017 results and 2016 results. However, those same 100...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact