The Key Challenge for Video Analytics

By: John Honovich, Published on May 06, 2008

It's all about false positives. Catching the bad guy is pretty easy for today's perimeter violation and abandoned object detection. Not catching anything else -- the sun, the moon, the wind, the birds, the rain, the trees -- that's the challenge.

This should not be that much of a secret. A little bit of experience with any of the dozens of video analytics vendors in today's market demonstrates this.

So it shocked me that Bosch has decided to turn the easy part into the 'challenge'. Here's Dr. Bob explaining what Bosch did at ISC West [link no longer available]:

"For the IVA (Intelligent Video Analysis) challenge we had people lining up from 10am when the doors opened till the end – over 2,300 people took the challenge, which was to steal a Bosch power drill from under the nose of our IP camera without the alarm going off.

Dr. Bob exults: "Yes, I think we can safely say we got our message across – our products are smarter than the average bear, and bringing intelligent video analytics to the masses is a good example." 

This is cunning marketing but, at best, it is wildly misleading and, at worst, it is a scam.

Now, I am not judging the quality of Bosch's product nor is Bosch the first or last company who will frame the issue as such.

That being said, this challenge is worthless in judging the quality of an analytic because:

  1. Any decent prototype can accurately generate correct matches in a controlled environment.
  2. Economically, minimizing false alerts is critical to establishing the business case.

Reducing False Positives

Making sure you only trigger when someone is violating is hard because there are so many factors that might set off the analytic besides a valid adversary. To a computer, rain, dust and snow can all generate a similar form to a human being. Quick changes in light or the movement of water (waves) can also generate such forms. A camera that shakes because of the wind or issues with the mounting or installation also can trigger such alerts.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

The hard part in such analytics is to make sure that these alerts can be eliminated. This is a key metric in testing and differentiating between analytics.

The Economics of False Positives

False positives drive up the cost of systems. Many (most?) organizations do not have a centralized monitoring system in place to respond and assess video analytic alerts. This places the burden on individual security managers to respond to alerts. Over the last 5 years, getting dozens (hundreds) of false alerts per day (especially if you deploy numerous cameras with video analytics) has been common. This can become an emotional and operational dealbreaker (even if it passed the Bosch challenge).

While it is better operationally to centrally manage alerts, if the system generates dozens or hundreds of false alerts per day, the costs can become prohibitive. Let's say an 'intelligent' camera generates 5 false alerts a day at the cost of $1 per alert (the unit cost to pay a monitor to assess). That's $5 per day, over $1,800 per year and about $10,000 for a projected 5 year lifecycle. If you have dozens or hundreds of cameras, this hidden operational cost can be in the millions.

And this is not theoretical. This is the feedback you will hear time and again from real world deployments. It's widely accepted that this is improving but it is still the major factor in assessing the quality of analytics.

Bosch may think that these tricks are making people more excited and more accepting of analytics. Most security managers have been excited about analytics for a long time. They see the obvious potential to mitigate risks and reduce losses.

2 reports cite this report:

Is Bosch Over-Selling Video Analytics? on Mar 25, 2009
Analysts and pundits agree that video analytics has been significantly over-sold in the last few years. Bosch certainly did its part with its IVA...
Do Video Analytics Work? on Sep 01, 2008
Manufacturers say video analytics work.  Customers and integrators often say they do not.  Are manufacturers simply lying? Are customers simply...

Related Reports

2020 Camera Book Released on Jan 10, 2020
This is the best, most comprehensive security camera training in the world, based on our unprecedented testing. Now, all IPVM PRO Members can get...
2020 IP Networking Book Released on Jan 06, 2020
The new IP Networking Book 2020 is a 280 page in-depth guide that teaches you how IT and telecom technologies impact modern security systems,...
Bezos-Funded Deep Sentinel Tested on Mar 28, 2019
Backed by Jeff Bezos, the Silicon Valley startup, Deep Sentinel, has declared: No One Does Home Security Like We Do Our Surveillance Team has...
Closed Cloud Cameras Trashed on May 13, 2019
When you buy a camera, do you own it? Not anymore. In the world of closed cloud cameras, you may think you are buying a camera but all you are...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
False Verkada 'Unrivaled' Low Light Performance Claim Removed on Jun 12, 2019
Verkada falsely claimed that it delivered 'UNRIVALED LOW LIGHT PERFORMANCE' until IPVM questioned. In fact, Verkada's low light performance is...
ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
XNOR.ai Terminates Wyze on Nov 27, 2019
Wyze has shocked the industry again - this time with a major setback. Just months ago, Wyze triumphantly added AI analytics to their ~$20 cameras,...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance testing facility that will allow us to significantly expand our...

Most Recent Industry Reports

Axis and Genetec Drop IFSEC 2020 on Jan 23, 2020
Two of the best-known video surveillance manufacturers are dropping IFSEC International 2020, joining Milestone who dropped IFSEC in 2019. The...
Multipoint Door Lock Tutorial on Jan 23, 2020
Despite widespread use, locked doors are notoriously weak at stopping entry, and thousands can be misspent on locks that leave doors quite...
Avigilon Shifts Cloud Strategy - Merges Blue and ACC on Jan 23, 2020
Avigilon is shifting its cloud strategy, phasing out its Blue web-managed surveillance platform as a stand-alone brand and merging it with its ACC...
Verkada Paying $100 For Referrals Just To Demo on Jan 22, 2020
Some companies pay for referrals when the referral becomes a customer. Verkada is taking it to the next level - paying $100 referrals fees simply...
Camera Analytics Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jan 22, 2020
Analytics are hot again, thanks to a slew of AI-powered cameras, but whose analytics really work? And how do these new smart cameras compare to top...
Intersec 2020 Final Show Report on Jan 21, 2020
IPVM spent all 3 days at the Intersec 2020 show interviewing various companies and finding key trends. We cover: Middle East Enterprise...
Vehicle & Long Range Access Reader Tutorial on Jan 21, 2020
One of the classic challenges for access control are parking lots and garages, where the user's credential is far from the reader. With modern...
Clearview AI Alarm - NY Times Report Says "Might End Privacy" on Jan 20, 2020
Over the weekend, the NY Times released a report titled "The Secretive Company That Might End Privacy as We Know It" about a company named...
Favorite Camera Manufacturers 2020 on Jan 20, 2020
The past 2 years of US bans and sanctions have shaken the video surveillance industry but what impact would this have on integrators' favorite...