US Government Agency Highlights Analytics Failure

By: Brian Karas, Published on Jul 15, 2016

Count the US government among those not satisfied with video analytics.

A US government agency held a workshop on video analytics for public safety. We spoke with Conference Chair John Garofolo [link no longer available] to understand what was discussed at the event and what government and public safety officials are looking for in video analytics.

In this report, we share their concerns, what they are looking for and how commercial analytics providers are still far from truly meeting that.

***** *** ** ********** among ***** *** ********* with ***** *********.

* ** ********** ****** held ********* ** ***** ********* for ****** ******. ** ***** **** ********** Chair John ******** [**** ** longer *********] ** ********** **** was ********* ** *** event *** **** ********** and ****** ****** ********* are ******* *** ** video *********.

** **** ******, ** share ***** ********, **** they *** ******* *** and *** ********** ********* providers *** ***** *** from ***** ******* ****.

[***************]

What *** ** **********/****** ****** *****

***** ********* ** ****** Safety Conference ***** **** **** are ******* *** ****-**** alerts ******:

  • ************* ******** ********* - fighting, ****** ******* ** water, ****** ******* ** train/subway ******
  • ***-*****/******* ***** ********* - detecting ***** **** ****** or **** *********
  • ********** ****** - ********* **** * ******* series ** ****** ** similar ** * ******** series ** ******

**** **** ********** **** common ******** ***** ******** by *** ******** ********, like *********, ** ********* *** not ************ ****** *** their *****.

 

 

Security ************* *** **** ** *******

**** ***** ***** ********* were **** ** ********** leaders ** ****** ****** analytics, *** ********** ***** ********* GE *** *** ************. This *** **** ********** at *****, *** *** complex ************ ** ********* "sophisticated ******" ** ****** safety, ******* ********** **** of ******* ****** ******** what *** ******** ****** "Deep ********".  

*** ******* ** **** traditional ******** ********* ********* are *** ******* ** simple ***** *********, *** not ******* ** ***** understanding *** ****** ***** and *** ******* *** moving ** *********** ** that *****. 

How ***** ********* *** **** *****

******** ********* ** * common selling ***** ** ********* systems *****. ********* ********* ***** ** acting ** * ***** burglar *****, **** ************ like ********* *** ****** regions, ******** ********* ** reduce *** ****** ** on-site ******, ** *** remote ****** **** ***********.

*** ******** ********* ******* is ******** ** ****** safety, *** *** ********** event ********* **** *** address ****** ****** ************ enough ** ** ** value. 

Limited ******* ****** ** ** ****

***** ***** *** * few ******** ***** ******** developers ********** ** ** what **** ** ******* for, *** ** **** have **** ******** / question *****:

  • ***** ****- ****** ***** **** $100 ******* ** *******, multiple ****** ** *******, pivots **** ******** ** non-security *** **** **** to *******, *** ******* rebranding **** *** ***** the **** ** ********* and *********** **** * standards ************ ***** ******
  • *******- ******* ****** **** child *********, ******* ****** widescale *** *** ****** ****** safety ***********
  • ***- ******* ***********, ******* stability ****** ****** *** company, ** ***** ***** on *********

Big *** ***** ******

**** *** ** ********** really ***** *** **** ********** providers *** ********** ***** has * *** ***.  The ****** ***** *** been ** ***** ** intelligent ******, ***** *** limited ***** *** ****** safety ************.  ********* ********* still ******** ** ******* systems **** *** ****** false ****** ******* **** missing ******** ****** ******** in ******* **********.

 

 

 

 

 

Comments (8)

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research, large companies like Google, Microsoft perhaps... and hopefully they'll make their solutions available to the rest of us. Nvidia has some great new GPU hardware that would be ideal for incorporating modern machine learning solutions into VMSs, but I think they may need to come down in price a bit. Another thing that needs to happen is for the US government not to hamper the industry with their patent system, but the chances of getting the US government to understand their incompetence in this area zero, zip, zilch...

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research

Yes, I completely agree. One thing I have said multiple times over the years is that "video analytics" is too generic of a terms to apply to as many things as we do.

I think it would be beneficial for the security industry to start defining video analytics sub-functions with words or terms that better describe how the system works or what it does. Similar to how we can describe cameras in terms of resolution or physical interface, etc.

The other thing I note, is that just by "asking" for these features, sort of implies that they have an expectation that the industry can deliver, or will be able to the not-too-distant future. That is they are aware of the significant breakthroughs that have happened in machine learning recently. If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

10 years ago at 3VR, I talked with a number of government / public safety people who wanted these types of things and even more wild.

For example, I had an intelligence agency person ask if we could alert if a guy boards a train with a package at one station and exits at another station without the package. He was seriously unimpressed when I said no.

That is they are aware of the significant breakthroughs that have happened in machine learning recently.

I think the simpler explanation is that those are simply their needs.

It sounds like there are a few tiers structured thusly:

  • VMD - VMS or camera side motion detection. Used to be considered analytics but should really be stricken from the list.
  • Basic Analytics - Crossed line detection, dropped object, PTZ tracking, etc.
  • Moderate Analytics - Avigilon/AgentVI/Bosch IVA/etc which can be run camera side and classify objects. Basic LPR (e.g. OCR) would likely fall here.
  • Advanced Analytics - Advanced LPR, retail analytics, facial recognition, etc.
  • Mythological Analytics - All the analytics that have been mentioned as of late which seem far-fetched. Examples include: Age/gender classification, predictive behavior recognition, noise analytics, etc.
  • Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Is that accurate?

I think it is a thoughtful segmentation, but I do not think it is accurate.

For example, in "Basic Analytics", there is no way "dropped object" should fall in that category. In fact, non-human/vehicle object detection should be a unique category (IMO).

I was thinking something more like:

Perimeter Protection - Classify a human, and ignore non-human objects, in a "sterile zone" style application. This implies something that is reasonably good at picking up people, and ignoring other objects, but is not concerned with things like crowd detection, or accurately classifying a group of people.

Business Intelligence - Analytics that focus on counting and path tracking. Should be able to reasonably count a large group accurately, but less concerned with object rejection (for their standard applications you would be unlikely to have to deal with animals or other common false-alarm objects).

Behavior and Gesture Recognition - Can accurately track multiple persons in a scene, and identify basic gestures like waving arms, pushing, or actions like falling down, fighting/aggressive interaction, etc.

OCR - Anything that can read text or symbols in an image. This would include LPR functions, but also things like recognizing logo's or glyphs to alert on, or ignore.

This is just a short list, not meant to be comprehensive. Where the analytics run (camera, server, cloud) is a secondary classification, and while some functions might limit them to running only in a server or cloud environment today, they may be able to run within a camera in X years, so I would not make that part of the analytics definition.

Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Deep learning, i.e.neural networks, was in its infancy 20, 30 years ago, but seems to have come of age in recent years.

Deep Learning is the state of the art in object recognition/classification, but it is far from being the solution to *all* AI problems. It has become another bandwagon for researchers who are now proposing incremental work only.

Deep learning is still doing the lower level brain-like operations, but progress in higher level machine reasoning is just a bunch of heuristics and very little theory. I can see "200" different approaches for tracking and recognizing object on a video, but none of them have a formal theoretical framework.

BTW, my background is on signal/image processing and I remember stories from professors were army people will come to them seriously asking for mind reading technology.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Viisights Raises $10 Million, Behavior Analytics Company Profile on Dec 09, 2019
Viisights, an Israeli AI analytics startup marketing "Behavioral Understanding Systems", announced $10 million Series A funding. We spoke to...
XNOR.ai Terminates Wyze on Nov 27, 2019
Wyze has shocked the industry again - this time with a major setback. Just months ago, Wyze triumphantly added AI analytics to their ~$20 cameras,...
nFlux AI Startup Profile on Oct 28, 2019
nFlux, an Amazon, Google, and Microsoft funded AI startup told IPVM their mission is to build the most intelligent video analytics platform in the...
Startup XNOR.ai, Inventors of YOLO, Video Surveillance Plans Examined on Sep 24, 2019
YOLO is arguably the most discussed and hyped computer vision model today. The inventors of YOLO have a startup named XNOR.ai that aims to bring...
How Cobalt Robotics May Disrupt Security on Sep 13, 2019
While security robots have largely become a joke over the last few years, one organization, Cobalt Robotics, has raised $50+ million from top US...
Anyvision Aims For 2022 Revenue of $1 Billion on Jul 17, 2019
Only 3 video surveillance manufacturers do a billion dollars or more in annual revenue - Hikvision, Dahua, and Axis. Now, Anyvision plans to join...
China Subway Facial Recognition System Examined on Jun 24, 2019
A China city of 6+ million people has installed facial recognition-enabled gates in subways, allowing commuters to enter stations by simply showing...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Actuate (formerly Aegis AI) Gun Detection Video Analytics Startup on May 07, 2019
Gun detection analytic startups are increasing as the promise of AI and the threats of active shooters grow. One company, Actuate (formerly Aegis...
IBM Shuts Down "Intelligent Video Analytics" [Update: New Video Analytics Offered] on May 02, 2019
Abruptly, IBM has discontinued its Intelligent Video Analytics solution, it confirmed to IPVM. IBM's video analytics have faced recent media...

Most Recent Industry Reports

GeoVision Presents AI and Facial Recognition on May 22, 2020
GeoVision presented its AI analytics and facial recognition at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
Density Presents Occupancy Monitoring For Coronavirus Protection on May 22, 2020
Density presented its cloud-based occupancy sensor to deal with Coronavirus at the May 2020 IPVM Startups show. Inside this report: A...
Openpath Presents Two Door PoE Controller on May 21, 2020
Openpath presented its new PoE controller at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from Openpath including...
Bosch Presents MIC 7100 Extreme PTZs on May 21, 2020
Bosch presented its MIC 7100 Extreme PTZs at the April 2020 IPVM New Products show. Inside this report: A 30-minute video from Bosch...
Hikvision Chairman Targeted For Sanctions As Federal Watchdog Calls Out Hikvision "Serious Religious Freedom Violations" on May 21, 2020
The US government's religious freedom watchdog has criticized Hikvision for being "credibly implicated in serious religious freedom violations"....
Hikvision Temperature Screening Tested on May 20, 2020
Hikvision has ramped up the promotion of its 'temperature screening' system, including their salespeople arguing for no blackbody needed. But how...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
Indoor Robotics Presents Tando Aerial Drones on May 20, 2020
Indoor Robotics presented Tando indoor autonomous drones at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from...
Directory of 89 Video Surveillance Startups on May 20, 2020
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly...
FLIR Cancelling Contract With X.Labs / Feevr on May 20, 2020
While X.Labs announced the signing of a new agreement with FLIR on May 12, 2020, FLIR said, in response, on May 18, 2020, that they had cancelled a...