US Government Agency Highlights Analytics Failure

Author: Brian Karas, Published on Jul 15, 2016

Count the US government among those not satisfied with video analytics.

A US government agency held a workshop on video analytics for public safety. We spoke with Conference Chair John Garofolo to understand what was discussed at the event and what government and public safety officials are looking for in video analytics.

In this report, we share their concerns, what they are looking for and how commercial analytics providers are still far from truly meeting that.

***** *** ** ********** ***** ***** *** ********* **** ***** analytics.

* ** ********** ****** **** ********* ** ***** ********* *** ****** ******. ** ***** **** ********** ********* ********** ********** **** *** ********* ** *** ***** *** **** government *** ****** ****** ********* *** ******* *** ** ***** analytics.

** **** ******, ** ***** ***** ********, **** **** *** looking *** *** *** ********** ********* ********* *** ***** *** from ***** ******* ****.

[***************]

What *** ** **********/****** ****** *****

***** ********* ** ****** ****** ********** ***** **** **** *** looking *** ****-**** ****** ******:

  • ************* ******** ********* - ********, ****** ******* ** *****, ****** falling ** *****/****** ******
  • ***-*****/******* ***** ********* - ********* ***** **** ****** ** **** blockages
  • ********** ****** -********* **** * ******* ****** ** ****** ** ******* ** a ******** ****** ** ******

**** **** ********** **** ****** ******** ***** ******** ** *** security ********, **** *********, ** ********* *** *** ************ ****** for ***** *****.

Security ************* *** **** ** *******

**** ***** ***** ********* **** **** ** ********** ******* ** public ****** *********, *** ********** ***** ********* ** *** *** specifically. **** *** **** ********** ** *****, *** *** ******* requirements ** ********* "************* ******" ** ****** ******, ******* ********** lots ** ******* ****** ******** **** *** ******** ****** "**** Thinking".

*** ******* ** **** *********** ******** ********* ********* *** *** focused ** ****** ***** *********, *** *** ******* ** ***** understanding *** ****** ***** *** *** ******* *** ****** ** interacting ** **** *****.

How ***** ********* *** **** *****

******** ********* ** * ****** ******* ***** ** ********* ******* today.********* ********* ***** ** ****** ** * ***** ******* *****, with ************ **** ********* *** ****** *******, ******** ********* ** reduce *** ****** ** **-**** ******, ** *** ****** ****** more ***********.

*** ******** ********* ******* ** ******** ** ****** ******, *** the ********** ***** ********* **** *** ******* ****** ****** ************ enough ** ** ** *****.

Limited ******* ****** ** ** ****

***** ***** *** * *** ******** ***** ******** ********** ********** to ** **** **** ** ******* ***, *** ** **** have **** ******** / ******** *****:

  • ***** ****- ****** ***** **** $*** ******* ** *******, ******** ****** of *******, ****** **** ******** ** ***-******** *** **** **** to *******, *** ******* ********** **** *** ***** *** **** of ********* *** *********** **** * ********* ************ ***** ******
  • *******- ******* ****** **** ***** *********, ******* ****** ********* *** and ****** ****** ****** ***********
  • ***- ******* ***********, ******* ********* ****** ****** *** *******, ** clear ***** ** *********

Big *** ***** ******

**** *** ** ********** ****** ***** *** **** ********** ********* are ********** ***** *** * *** ***. *** ****** ***** has **** ** ***** ** *********** ******, ***** *** ******* value *** ****** ****** ************. ********* ********* ***** ******** ** deliver ******* **** *** ****** ***** ****** ******* **** ******* critical ****** ******** ** ******* **********.

Comments (8)

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research, large companies like Google, Microsoft perhaps... and hopefully they'll make their solutions available to the rest of us. Nvidia has some great new GPU hardware that would be ideal for incorporating modern machine learning solutions into VMSs, but I think they may need to come down in price a bit. Another thing that needs to happen is for the US government not to hamper the industry with their patent system, but the chances of getting the US government to understand their incompetence in this area zero, zip, zilch...

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research

Yes, I completely agree. One thing I have said multiple times over the years is that "video analytics" is too generic of a terms to apply to as many things as we do.

I think it would be beneficial for the security industry to start defining video analytics sub-functions with words or terms that better describe how the system works or what it does. Similar to how we can describe cameras in terms of resolution or physical interface, etc.

The other thing I note, is that just by "asking" for these features, sort of implies that they have an expectation that the industry can deliver, or will be able to the not-too-distant future. That is they are aware of the significant breakthroughs that have happened in machine learning recently. If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

10 years ago at 3VR, I talked with a number of government / public safety people who wanted these types of things and even more wild.

For example, I had an intelligence agency person ask if we could alert if a guy boards a train with a package at one station and exits at another station without the package. He was seriously unimpressed when I said no.

That is they are aware of the significant breakthroughs that have happened in machine learning recently.

I think the simpler explanation is that those are simply their needs.

It sounds like there are a few tiers structured thusly:

  • VMD - VMS or camera side motion detection. Used to be considered analytics but should really be stricken from the list.
  • Basic Analytics - Crossed line detection, dropped object, PTZ tracking, etc.
  • Moderate Analytics - Avigilon/AgentVI/Bosch IVA/etc which can be run camera side and classify objects. Basic LPR (e.g. OCR) would likely fall here.
  • Advanced Analytics - Advanced LPR, retail analytics, facial recognition, etc.
  • Mythological Analytics - All the analytics that have been mentioned as of late which seem far-fetched. Examples include: Age/gender classification, predictive behavior recognition, noise analytics, etc.
  • Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Is that accurate?

I think it is a thoughtful segmentation, but I do not think it is accurate.

For example, in "Basic Analytics", there is no way "dropped object" should fall in that category. In fact, non-human/vehicle object detection should be a unique category (IMO).

I was thinking something more like:

Perimeter Protection - Classify a human, and ignore non-human objects, in a "sterile zone" style application. This implies something that is reasonably good at picking up people, and ignoring other objects, but is not concerned with things like crowd detection, or accurately classifying a group of people.

Business Intelligence - Analytics that focus on counting and path tracking. Should be able to reasonably count a large group accurately, but less concerned with object rejection (for their standard applications you would be unlikely to have to deal with animals or other common false-alarm objects).

Behavior and Gesture Recognition - Can accurately track multiple persons in a scene, and identify basic gestures like waving arms, pushing, or actions like falling down, fighting/aggressive interaction, etc.

OCR - Anything that can read text or symbols in an image. This would include LPR functions, but also things like recognizing logo's or glyphs to alert on, or ignore.

This is just a short list, not meant to be comprehensive. Where the analytics run (camera, server, cloud) is a secondary classification, and while some functions might limit them to running only in a server or cloud environment today, they may be able to run within a camera in X years, so I would not make that part of the analytics definition.

Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Deep learning, i.e.neural networks, was in its infancy 20, 30 years ago, but seems to have come of age in recent years.

Deep Learning is the state of the art in object recognition/classification, but it is far from being the solution to *all* AI problems. It has become another bandwagon for researchers who are now proposing incremental work only.

Deep learning is still doing the lower level brain-like operations, but progress in higher level machine reasoning is just a bunch of heuristics and very little theory. I can see "200" different approaches for tracking and recognizing object on a video, but none of them have a formal theoretical framework.

BTW, my background is on signal/image processing and I remember stories from professors were army people will come to them seriously asking for mind reading technology.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Avigilon Favorability Results 2019 on Jan 15, 2019
Since IPVM's 2017 Avigilon favorability results, the company was acquired by Motorola and has shifted from being an aggressive startup to a more...
Gorilla Technology AI Provider, Raises $15 Million, Profiled on Jan 15, 2019
Gorilla Technology is a Taiwanese video analytics manufacturer that recently announced a $15 million investment from SBI Group, saying this...
Managed Video Services UL 827B Examined on Jan 09, 2019
Historically, UL listings for central stations have been important, with UL 827 having widespread support. However, few central stations have...
IPVM Best New Products 2019 Opened - 70+ Entrants on Jan 07, 2019
The inaugural IPVM Best New Product Awards has been opened - the industry's first and only program where the awards are not pay-to-play and the...
Axis Tailgate Detection Tested on Jan 04, 2019
Axis is aiming to tackle tailgating, one of access control's biggest issues, with the Tailgating Detector ACAP application. This camera app claims...
The Battle For The VSaaS Market Begins 2019 - Alarm.com, Arcules, Eagle Eye, OpenEye, Qumulex, Verkada, More on Jan 02, 2019
2019 will be the year that VSaaS finally becomes a real factor for professional video surveillance. While Video Surveillance as a Service (VSaaS)...
Cisco Meraki New Cameras and AI Analytics on Dec 14, 2018
Meraki has released their second generation of video surveillance with 3 new cameras, AI-based video analytics, and 2 cloud-based storage...
Foolish Strategy: OEMing Facial Recognition on Dec 13, 2018
Almost as 'hot' as face recognition marketing right now is OEMing facial recognition. Last year, they were a who's who of company's with...
Top 2019 Trend - AI Video Analytics on Dec 10, 2018
160+ Integrators answered: What do you think the top industry trend will be in 2019? Why? AI / video analytics was the run-away winner with...
Alarm.com "AI" Video Analytics Tested on Nov 30, 2018
Alarm.com has announced what it calls an "artificial intelligence (AI) architecture and video analytics service", touting that  Alarm.com's...

Most Recent Industry Reports

Mobile Surveillance Trailers Guide on Jan 17, 2019
Putting cameras in a place for temporary surveillance where power and communications are not readily available can be complicated and expensive....
Exacq Favorability Results 2019 on Jan 17, 2019
Exacq favorability amongst integrators has declined sharply, in new IPVM statistics, compared to 2017 IPVM statistics for Exacq. Now, over 5 since...
Testing Bandwidth Vs. Low Light on Jan 16, 2019
Nighttime bandwidth spikes are a major concern in video surveillance. Many calculate bandwidth as a single 24/7 number, but bit rates vary...
Access Control Records Maintenance Guide on Jan 16, 2019
Weeding out old entries, turning off unused credentials, and updating who carries which credentials is as important as to maintaining security as...
UK Fines Security Firms For Illegal Direct Marketing on Jan 16, 2019
Two UK security firms have paid over $200,000 in fines for illegally making hundreds of thousands of calls to people registered on a government...
Access Control Cabling Tutorial on Jan 15, 2019
Access Control is only as reliable as its cables. While this aspect lacks the sexiness of other components, it remains a vital part of every...
Avigilon Favorability Results 2019 on Jan 15, 2019
Since IPVM's 2017 Avigilon favorability results, the company was acquired by Motorola and has shifted from being an aggressive startup to a more...
Gorilla Technology AI Provider, Raises $15 Million, Profiled on Jan 15, 2019
Gorilla Technology is a Taiwanese video analytics manufacturer that recently announced a $15 million investment from SBI Group, saying this...
2019 IP Networking Book Released on Jan 14, 2019
The new IP Networking Book 2019 is a 285 page in-depth guide that teaches you how IT and telecom technologies impact modern security...
Arecont Costar Layoffs on Jan 14, 2019
Arecont Vision, a Costar Company, has laid off more than 10% of their workforce in a move the company described to IPVM as a result of "important...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact