US Government Agency Highlights Analytics Failure

By Brian Karas, Published on Jul 15, 2016

Count the US government among those not satisfied with video analytics.

A US government agency held a workshop on video analytics for public safety. We spoke with Conference Chair John Garofolo [link no longer available] to understand what was discussed at the event and what government and public safety officials are looking for in video analytics.

In this report, we share their concerns, what they are looking for and how commercial analytics providers are still far from truly meeting that.

What *** ** **********/****** ****** *****

***** ********* ** ****** Safety Conference ***** **** **** are ******* *** ****-**** alerts ******:

  • ************* ******** ********* - fighting, ****** ******* ** water, ****** ******* ** train/subway ******
  • ***-*****/******* ***** ********* - detecting ***** **** ****** or **** *********
  • ********** ****** - ********* **** * ******* series ** ****** ** similar ** * ******** series ** ******

**** **** ********** **** common ******** ***** ******** by *** ******** ********, like *********, ** ********* *** not ************ ****** *** their *****.

 

 

Security ************* *** **** ** *******

**** ***** ***** ********* were **** ** ********** leaders ** ****** ****** analytics, *** ********** ***** ********* GE *** *** ************. This *** **** ********** at *****, *** *** complex ************ ** ********* "sophisticated ******" ** ****** safety, ******* ********** **** of ******* ****** ******** what *** ******** ****** "Deep ********".  

*** ******* ** **** traditional ******** ********* ********* are *** ******* ** simple ***** *********, *** not ******* ** ***** understanding *** ****** ***** and *** ******* *** moving ** *********** ** that *****. 

How ***** ********* *** **** *****

******** ********* ** * common selling ***** ** ********* systems *****. ********* ********* ***** ** acting ** * ***** burglar *****, **** ************ like ********* *** ****** regions, ******** ********* ** reduce *** ****** ** on-site ******, ** *** remote ****** **** ***********.

*** ******** ********* ******* is ******** ** ****** safety, *** *** ********** event ********* **** *** address ****** ****** ************ enough ** ** ** value. 

Limited ******* ****** ** ** ****

***** ***** *** * few ******** ***** ******** developers ********** ** ** what **** ** ******* for, *** ** **** have **** ******** / question *****:

  • ***** ****- ****** ***** **** $100 ******* ** *******, multiple ****** ** *******, pivots **** ******** ** non-security *** **** **** to *******, *** ******* rebranding **** *** ***** the **** ** ********* and *********** **** * standards ************ ***** ******
  • *******- ******* ****** **** child *********, ******* ****** widescale *** *** ****** ****** safety ***********
  • ***- ******* ***********, ******* stability ****** ****** *** company, ** ***** ***** on *********

Big *** ***** ******

**** *** ** ********** really ***** *** **** ********** providers *** ********** ***** has * *** ***.  The ****** ***** *** been ** ***** ** intelligent ******, ***** *** limited ***** *** ****** safety ************.  ********* ********* still ******** ** ******* systems **** *** ****** false ****** ******* **** missing ******** ****** ******** in ******* **********.

 

 

 

 

 

Comments (8)

Undisclosed Manufacturer #1

07/15/16 02:33pm

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research, large companies like Google, Microsoft perhaps... and hopefully they'll make their solutions available to the rest of us. Nvidia has some great new GPU hardware that would be ideal for incorporating modern machine learning solutions into VMSs, but I think they may need to come down in price a bit. Another thing that needs to happen is for the US government not to hamper the industry with their patent system, but the chances of getting the US government to understand their incompetence in this area zero, zip, zilch...

Avatar

Brian Karas

IPVM | In reply to Undisclosed Manufacturer #1 | 07/15/16 03:49pm

What they are asking for sounds like the sort of solutions that are most likely to be provided by those who lead in deep learning research

Yes, I completely agree. One thing I have said multiple times over the years is that "video analytics" is too generic of a terms to apply to as many things as we do.

I think it would be beneficial for the security industry to start defining video analytics sub-functions with words or terms that better describe how the system works or what it does. Similar to how we can describe cameras in terms of resolution or physical interface, etc.

Undisclosed Manufacturer #1

In reply to Brian Karas | 07/15/16 07:49pm

The other thing I note, is that just by "asking" for these features, sort of implies that they have an expectation that the industry can deliver, or will be able to the not-too-distant future. That is they are aware of the significant breakthroughs that have happened in machine learning recently. If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

John Honovich

IPVM | In reply to Undisclosed Manufacturer #1 | 07/15/16 08:20pm

If they had asked for the same solutions 15 years ago, they may have made them selves look silly.

10 years ago at 3VR, I talked with a number of government / public safety people who wanted these types of things and even more wild.

For example, I had an intelligence agency person ask if we could alert if a guy boards a train with a package at one station and exits at another station without the package. He was seriously unimpressed when I said no.

That is they are aware of the significant breakthroughs that have happened in machine learning recently.

I think the simpler explanation is that those are simply their needs.

Undisclosed #2

In reply to Brian Karas | 07/15/16 07:53pm

It sounds like there are a few tiers structured thusly:

  • VMD - VMS or camera side motion detection. Used to be considered analytics but should really be stricken from the list.
  • Basic Analytics - Crossed line detection, dropped object, PTZ tracking, etc.
  • Moderate Analytics - Avigilon/AgentVI/Bosch IVA/etc which can be run camera side and classify objects. Basic LPR (e.g. OCR) would likely fall here.
  • Advanced Analytics - Advanced LPR, retail analytics, facial recognition, etc.
  • Mythological Analytics - All the analytics that have been mentioned as of late which seem far-fetched. Examples include: Age/gender classification, predictive behavior recognition, noise analytics, etc.
  • Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Is that accurate?

Avatar

Brian Karas

IPVM | In reply to Undisclosed #2 | 07/15/16 08:07pm

I think it is a thoughtful segmentation, but I do not think it is accurate.

For example, in "Basic Analytics", there is no way "dropped object" should fall in that category. In fact, non-human/vehicle object detection should be a unique category (IMO).

I was thinking something more like:

Perimeter Protection - Classify a human, and ignore non-human objects, in a "sterile zone" style application. This implies something that is reasonably good at picking up people, and ignoring other objects, but is not concerned with things like crowd detection, or accurately classifying a group of people.

Business Intelligence - Analytics that focus on counting and path tracking. Should be able to reasonably count a large group accurately, but less concerned with object rejection (for their standard applications you would be unlikely to have to deal with animals or other common false-alarm objects).

Behavior and Gesture Recognition - Can accurately track multiple persons in a scene, and identify basic gestures like waving arms, pushing, or actions like falling down, fighting/aggressive interaction, etc.

OCR - Anything that can read text or symbols in an image. This would include LPR functions, but also things like recognizing logo's or glyphs to alert on, or ignore.

This is just a short list, not meant to be comprehensive. Where the analytics run (camera, server, cloud) is a secondary classification, and while some functions might limit them to running only in a server or cloud environment today, they may be able to run within a camera in X years, so I would not make that part of the analytics definition.

Undisclosed Manufacturer #1

In reply to Undisclosed #2 | 07/15/16 08:25pm

Deep learning/cloud analytics - the particularly complex, processing heavy analytics which are still in their infancy.

Deep learning, i.e.neural networks, was in its infancy 20, 30 years ago, but seems to have come of age in recent years.

Jose Gerardo Rosiles

IPVMU Certified | In reply to Undisclosed Manufacturer #1 | 08/01/16 04:41pm

Deep Learning is the state of the art in object recognition/classification, but it is far from being the solution to *all* AI problems. It has become another bandwagon for researchers who are now proposing incremental work only.

Deep learning is still doing the lower level brain-like operations, but progress in higher level machine reasoning is just a bunch of heuristics and very little theory. I can see "200" different approaches for tracking and recognizing object on a video, but none of them have a formal theoretical framework.

BTW, my background is on signal/image processing and I remember stories from professors were army people will come to them seriously asking for mind reading technology.

Read this IPVM report for free.

This article is part of IPVM's 6,594 reports, 889 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

The US Fight Over Facial Recognition Explained on Jul 08, 2020
The controversy around facial recognition has grown significantly in 2020,...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
YOLOv5 Released Amidst Controversy on Jul 27, 2020
YOLO has gained significant attention within video surveillance for its...
Mexico Video Surveillance Market Overview 2020 on Oct 20, 2020
Despite being neighbors, there are key differences between the U.S. and...
China's SMIC Hit By US Trade Restrictions, Impact On Video Surveillance on Oct 13, 2020
US trade restrictions have hit Semiconductor Manufacturing International...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...
Briefcam Responsible Use Examined on Aug 24, 2020
While mega-companies Amazon, IBM, and Microsoft have been criticized for...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Verkada: "IPVM Should Never Be Your Source of News" on Jul 02, 2020
Verkada was unhappy with IPVM's recent coverage declaring that reading IPVM...
Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020
As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...
Comparing 2020 Reality To 2010 Expectations on Sep 11, 2020
What can we learn from where the industry was in 2010 and what was believed...
Chilean Official Investigated for Motorola And Hikvision Contracts on Sep 17, 2020
A corruption investigation is underway in Chile after a crime prevention...
Infinova, March Networks and Swann H1 2020 Financials Examined on Sep 02, 2020
While Dahua and Hikvision, helped by fever camera sales, are recovering from...

Recent Reports

VICE Investigates Verkada's Harassing "RawVerkadawgz" on Oct 26, 2020
This month, IPVM investigated Verkada's sexism, discrimination, and cultural...
Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020
As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...
ISC Brasil Digital Experience 2020 Report on Oct 23, 2020
ISC Brasil 2020 rebranded itself to ISC Digital Experience and, like its...
Top Video Surveillance Service Call Problems 2020 on Oct 23, 2020
3 primary and 4 secondary issues stood out as causing the most problems when...
GDPR Impact On Temperature / Fever Screening Explained on Oct 22, 2020
What impact does GDPR have on temperature screening? Do you risk a GDPR fine...
Security And Safety Things (S&ST) Tested on Oct 22, 2020
S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...
Nokia Fever Screening Claims To "Advance Fight Against COVID-19" on Oct 22, 2020
First IBM, then briefly Clorox, and now Nokia becomes the latest Fortune 500...
Deceptive Meridian Temperature Tablets Endanger Public Safety on Oct 21, 2020
IPVM's testing of and investigation into Meridian Kiosk's temperature...
Honeywell 30 Series and Vivotek NVRs Tested on Oct 21, 2020
The NDAA ban has driven many users to look for low-cost NVRs not made by...
Ubiquiti Access Control Tested on Oct 21, 2020
Ubiquiti has become one of the most widely used wireless and switch providers...
Avigilon Aggressive Trade-In Program Takes Aim At Competitors on Oct 20, 2020
Avigilon has launched one of the most aggressive trade-in programs the video...
Mexico Video Surveillance Market Overview 2020 on Oct 20, 2020
Despite being neighbors, there are key differences between the U.S. and...
Dahua Revenue Grows But Profits Down, Cause Unclear on Oct 20, 2020
While Dahua's overall revenue was up more than 12% in Q3 2020, a significant...
Illegal Hikvision Fever Screening Touted In Australia, Government Investigating, Temperature References Deleted on Oct 20, 2020
The Australian government told IPVM that they are investigating a Hikvision...
Panasonic Presents i-PRO Cameras and Video Analytics on Oct 19, 2020
Panasonic i-PRO presented its X-Series cameras and AI video analytics at the...