US Government Agency Highlights Analytics Failure

Author: Brian Karas, Published on Jul 15, 2016

Count the US government among those not satisfied with video analytics.

A US government agency held a workshop on video analytics for public safety. We spoke with Conference Chair John Garofolo to understand what was discussed at the event and what government and public safety officials are looking for in video analytics.

In this report, we share their concerns, what they are looking for and how commercial analytics providers are still far from truly meeting that.

***** *** ** ********** ***** ***** *** ********* **** ***** analytics.

* ** ********** ****** **** ********* ** ***** ********* *** ****** ******. ** ***** **** ********** ***** **** ******** ** ********** **** *** ********* ** *** ***** *** **** government *** ****** ****** ********* *** ******* *** ** ***** analytics.

** **** ******, ** ***** ***** ********, **** **** *** looking *** *** *** ********** ********* ********* *** ***** *** from ***** ******* ****.

[***************]

What *** ** **********/****** ****** *****

***** ********* ** ****** ****** ********** ***** **** **** *** ******* for ****-**** ****** ******:

  • ************* ******** ********* - ********, ****** ******* ** *****, ****** falling ** *****/****** ******
  • ***-*****/******* ***** ********* - ********* ***** **** ****** ** **** blockages
  • ********** ****** - ********* **** * ******* ****** ** ****** ** ******* ** a ******** ****** ** ******

**** **** ********** **** ****** ******** ***** ******** ** *** security ********, **** *********, ** ********* *** *** ************ ****** *** their *****.

 

 

Security ************* *** **** ** *******

**** ***** ***** ********* **** **** ** ********** ******* ** public ****** *********, *** ********** ***** ********* ** *** *** ************. This *** **** ********** ** *****, *** *** ******* ************ of ********* "************* ******" ** ****** ******, ******* ********** **** of ******* ****** ******** **** *** ******** ****** "**** ********".  

*** ******* ** **** *********** ******** ********* ********* *** *** focused ** ****** ***** *********, *** *** ******* ** ***** understanding *** ****** ***** *** *** ******* *** ****** ** interacting ** **** *****. 

How ***** ********* *** **** *****

******** ********* ** * ****** ******* ***** ** ********* ******* *****. ********* ********* ***** ** ****** ** * ***** ******* *****, with ************ **** ********* *** ****** *******, ******** ********* ** reduce *** ****** ** **-**** ******, ** *** ****** ****** more ***********.

*** ******** ********* ******* ** ******** ** ****** ******, *** the ********** ***** ********* **** *** ******* ****** ****** ************ enough ** ** ** *****. 

Limited ******* ****** ** ** ****

***** ***** *** * *** ******** ***** ******** ********** ********** to ** **** **** ** ******* ***, *** ** **** have **** ******** / ******** *****:

  • ***** ****- ****** ***** **** $*** ******* ** *******, ******** ****** of *******, ****** **** ******** ** ***-******** *** **** **** to *******, *** ******* ********** **** *** ***** *** **** of ********* *** *********** **** * ********* ************ ***** ******
  • *******- ******* ****** **** ***** *********, ******* ****** ********* *** *** tested ****** ****** ***********
  • ***- ******* ***********, ******* ********* ****** ****** *** *******, ** clear ***** ** *********

Big *** ***** ******

**** *** ** ********** ****** ***** *** **** ********** ********* *** delivering ***** *** * *** ***.  *** ****** ***** *** been ** ***** ** *********** ******, ***** *** ******* ***** for ****** ****** ************.  ********* ********* ***** ******** ** ******* systems **** *** ****** ***** ****** ******* **** ******* ******** events ******** ** ******* **********.

 

 

 

 

 

Comments (8)

Undisclosed Manufacturer #1

07/15/16 10:33am

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research, large companies like Google, Microsoft perhaps... and hopefully they'll make their solutions available to the rest of us. Nvidia has some great new GPU hardware that would be ideal for incorporating modern machine learning solutions into VMSs, but I think they may need to come down in price a bit. Another thing that needs to happen is for the US government not to hamper the industry with their patent system, but the chances of getting the US government to understand their incompetence in this area zero, zip, zilch...

Thumbnail brk1

Brian Karas

IPVM | In reply to Undisclosed Manufacturer #1 | 07/15/16 11:49am

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research

Yes, I completely agree. One thing I have said multiple times over the years is that "video analytics" is too generic of a terms to apply to as many things as we do.

I think it would be beneficial for the security industry to start defining video analytics sub-functions with words or terms that better describe how the system works or what it does. Similar to how we can describe cameras in terms of resolution or physical interface, etc.

Undisclosed Manufacturer #1

In reply to Brian Karas | 07/15/16 03:49pm

The other thing I note, is that just by "asking" for these features, sort of implies that they have an expectation that the industry can deliver, or will be able to the not-too-distant future. That is they are aware of the significant breakthroughs that have happened in machine learning recently. If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

John Honovich

IPVM | In reply to Undisclosed Manufacturer #1 | 07/15/16 04:20pm

If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

10 years ago at 3VR, I talked with a number of government / public safety people who wanted these types of things and even more wild.

For example, I had an intelligence agency person ask if we could alert if a guy boards a train with a package at one station and exits at another station without the package. He was seriously unimpressed when I said no.

That is they are aware of the significant breakthroughs that have happened in machine learning recently.

I think the simpler explanation is that those are simply their needs.

Undisclosed Integrator #2

In reply to Brian Karas | 07/15/16 03:53pm

It sounds like there are a few tiers structured thusly:

  • VMD - VMS or camera side motion detection. Used to be considered analytics but should really be stricken from the list.
  • Basic Analytics - Crossed line detection, dropped object, PTZ tracking, etc.
  • Moderate Analytics - Avigilon/AgentVI/Bosch IVA/etc which can be run camera side and classify objects. Basic LPR (e.g. OCR) would likely fall here.
  • Advanced Analytics - Advanced LPR, retail analytics, facial recognition, etc.
  • Mythological Analytics - All the analytics that have been mentioned as of late which seem far-fetched. Examples include: Age/gender classification, predictive behavior recognition, noise analytics, etc.
  • Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Is that accurate?

Thumbnail brk1

Brian Karas

IPVM | In reply to Undisclosed Integrator #2 | 07/15/16 04:07pm

I think it is a thoughtful segmentation, but I do not think it is accurate.

For example, in "Basic Analytics", there is no way "dropped object" should fall in that category. In fact, non-human/vehicle object detection should be a unique category (IMO).

I was thinking something more like:

Perimeter Protection - Classify a human, and ignore non-human objects, in a "sterile zone" style application. This implies something that is reasonably good at picking up people, and ignoring other objects, but is not concerned with things like crowd detection, or accurately classifying a group of people.

Business Intelligence - Analytics that focus on counting and path tracking. Should be able to reasonably count a large group accurately, but less concerned with object rejection (for their standard applications you would be unlikely to have to deal with animals or other common false-alarm objects).

Behavior and Gesture Recognition - Can accurately track multiple persons in a scene, and identify basic gestures like waving arms, pushing, or actions like falling down, fighting/aggressive interaction, etc.

OCR - Anything that can read text or symbols in an image. This would include LPR functions, but also things like recognizing logo's or glyphs to alert on, or ignore.

This is just a short list, not meant to be comprehensive. Where the analytics run (camera, server, cloud) is a secondary classification, and while some functions might limit them to running only in a server or cloud environment today, they may be able to run within a camera in X years, so I would not make that part of the analytics definition.

Undisclosed Manufacturer #1

In reply to Undisclosed Integrator #2 | 07/15/16 04:25pm

Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Deep learning, i.e.neural networks, was in its infancy 20, 30 years ago, but seems to have come of age in recent years.

Jose Gerardo Rosiles

IPVMU Certified | In reply to Undisclosed Manufacturer #1 | 08/01/16 12:41pm

Deep Learning is the state of the art in object recognition/classification, but it is far from being the solution to *all* AI problems. It has become another bandwagon for researchers who are now proposing incremental work only.

Deep learning is still doing the lower level brain-like operations, but progress in higher level machine reasoning is just a bunch of heuristics and very little theory. I can see "200" different approaches for tracking and recognizing object on a video, but none of them have a formal theoretical framework.

BTW, my background is on signal/image processing and I remember stories from professors were army people will come to them seriously asking for mind reading technology.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Axis Perimeter Defender Video Analytics Tested on Jul 12, 2018
Axis 'high security' video analytics offering is Perimeter Defender, OEMed / developed with Digital Barriers. But how good is Perimeter Defender?...
Axis Guard Suite Video Analytics Tested on Jun 25, 2018
In 2015, we declared Axis' Guard Suite analytics "weak", with missed detections and false alerts common. But after nearly 3 years and a 2.0 version...
Huawei Software Defined Cameras on Jun 25, 2018
Huawei is aiming to break the reputation of Chinese companies not being good at software. The company is now leading their video surveillance...
IFSEC 2018 Final Show Report on Jun 20, 2018
IPVM attended the IFSEC show for the first time this year. The Chinese took over the show, centered on Hikvision, flanked by Dahua, Huawei and a...
Four Major Outdoor Camera Install Problems on Jun 14, 2018
Over 140 integrators told us the top four camera installation mistakes that lead to unexpected problems and failures. Their comments often...
ReconaSense - The AI / Access Control / Analytics / IoT / Video Company Profile on Jun 12, 2018
One company's ISC West booth stood out for displaying a light-up tower of buzzwords. The company, ReconaSense, pledged to be 'making sense of it...
Bosch IVA Video Analytics And Motion+ VMD Tested on Jun 06, 2018
Bosch's video analytics now ship on nearly every model, from indoor domes to high-end 5MP starlight cameras.  In this test, we evaluate Bosch's...
Stats: IP Camera Dead On Arrival (DOA) Decline, Near Zero on Jun 01, 2018
New IPVM integrator statistics show that IP camera DoA rates have declined with zero dead on arrival units for many integrators and effectively...
Stats: Upgrading Cameras Far More Common Than Replacing Failed Cameras on May 30, 2018
The old saying "If It Ain't Broke, Don't Fix It" does not apply here. New IPVM statistics show that 60% of cameras that are replaced still work but...
Hanwha Wisenet X Analytics and VMD Test on May 24, 2018
Continuing our updated testing of camera analytics, we tested Hanwha's Wisenet X analytics for over two weeks in multiple scenes, indoors and out,...

Most Recent Industry Reports

Security Sales Course Summer 2018 on Jul 13, 2018
Based on member's interest, IPVM is offering a security sales course this summer. Register Now - IPVM Security Sales Course Summer 2018 This...
US Tariffs Hit China Video Surveillance on Jul 13, 2018
Chinese video surveillance products avoided tariffs for the first two rounds. Now, in the third round, many video surveillance products will be...
Last Chance - July 2018 IP Networking Course on Jul 12, 2018
Registration ends today, Thursday. Register now. This is the only networking course designed specifically for video surveillance...
4 Most Difficult Camera Installs (Statistics) on Jul 12, 2018
Heavy housings, cumbersome brackets, heavy ladders required, and tricky field of view requirements will cause difficulties no matter the camera...
Axis Perimeter Defender Video Analytics Tested on Jul 12, 2018
Axis 'high security' video analytics offering is Perimeter Defender, OEMed / developed with Digital Barriers. But how good is Perimeter Defender?...
Hikvision Fights Ban - Claims 'Red Scare', Hires 14 Term Ex-Congressman on Jul 11, 2018
Hikvision is fighting back against the House Bill Ban of their products. Hikvision has hired one of the biggest lobbying firms, led by a 14 term...
Arecont Acquisition By Costar on Jul 11, 2018
Arecont Vision acquisition by Costar Technologies has been approved by the court, concluding the bankruptcy process triggered by Arecont's...
Amazon Ring Partners With Rapid Response For $10 Monitoring on Jul 10, 2018
Amazon's Ring alarm system is using Rapid Response for monitoring, IPVM has confirmed in our testing. Amazon is arguably the most feared new...
SIA Lobbyists Working On House Bill Ban of Dahua and Hikvision on Jul 10, 2018
While SIA is most known for ISC West, SIA maintains the industry's most significant lobbying organization to influence US government action. Last...
Eastern and SavvyTech Merge, Form ENS, Targets ADI on Jul 09, 2018
ADI, ENS is coming for you. Or, at least, they hope. Two US distributors, NY based EasternCCTV and California based SavvyTech have merged, to...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact