Video Analytics 101

By: IPVM Team, Published on Mar 16, 2020

This guide teaches the fundamentals of video surveillance analytics.

IPVM Image

****** ** *****:

  • *** *** ***** *********
  • ***** ********* *******
  • ***** *** ********* *********? Camera? ******? *****?
  • ******** ***-***** *********
  • *** ** *********? ********* and **************
  • ****** ** ** *********
  • ***** ** *******
  • ***** ** ******
  • ***** *********
  • ** ****** ******** *********
  • ** ************** ******
  • **** ******** ** *** Ongoing ** *******
  • ******** *********** ** *******
  • *** ******** ********* ** Servers *** *********
  • **** ******** / ** Mainstream ** ****
  • ****** ****** **. **** Systems
  • ***** ******** ******** ********

Why *** ***** *********

************, ************ ****** ** a ****** ** ******* multiple ******* ************** *** visually ******* **** *** occurring ** **** ** order ** ****** ******. However, **** ** *********** and ***** ** ****** because ****** *** **** monitor ** **** ***** at * ****, ******* to ****** ******.

***** ********* ******* ****** streams ** ****** ******** events, **** ** ****** or ******** ******, ******* faces, ** ******* ******. These ****** *** **** be **** ** ******* recording ** ****** ** operator ** **** *** effectively ******* **** ******* at *** ****.

Video ********* *******

****** ****** ** **** specific *******, ** **** to **** *** ******* clear: ***** ********* *********** varies***********, ******* **** **** strong ** ********. ***** should *** ***** ************ marketing ** *********, ** it *** ************ **** many *************** ****** *** overstated ***********.

***** *** **** ********** analytics *********, **** **** new ******** *** ************ in *** **** *** years ***** **** ******* drive ***********, *** ***** are **********, *** *** rule.

Historic ******: *** (***** ****** *********)

***** ****** ********* (***) is *** ******** ***** used ** ******* ** try ** ****** ********. It ** *** ** nor '*****' *** **** may ****** ** ** such.

*** ******* ** ********* rather ********** ******* ** pixels **** *** ***** to *** ****. ** enough ****** ****** ** enough ** * *****, the ****** ******** ****** detected.

*** ***** ***** ***** how *** ***** '***' a *** ****** *** correctly ********* ******:

VMD ***** ** ***** ******

*******, *** ** *** intelligent ****** ** **** whether ****** *** ***** movement ** ***, **** that **** *** ******. Because ** ****, ** makes **** ******** *** things **** *******, ******, branches, *******, *** ****** may ******* **. *** example, *** ***** ***** shows *** ****** * mistake ******* ** **** not '****' ******* *** changing ****** *** * person ** * ******:

\

Basic ********* **** *******

** *** ** ****** false ******, ************* ********* filters ***** ********* ** remove ***** ****** ******, leading ** ***** ***** analytics. ***** ******* *** include ****** **** ******/***** ratios, ****** ******, ********** motion, ***. **** ******** performance ******** ** ****** VMD, *** ***** ****** were/are ***** **** ******, with *******, ******, ****, animals, *** ***** ****** triggering **** ********* (*** our****** ********* ********).

Why ** *********

******* ** *** *********** to ******** ***-***** ********* and *** **** ***** alerts *** ***, ** analytics **** ********* *** video ************ ** ******** detection ******** *** ***** significantly **** ************** ************.

*** **** *********** ********* of ** ********* ** the ****** ** ******** effectively ****** *** **** detected ******: '** **** a ******?', '** **** a ***?', '** **** a *******?', '** **** a ***?' ***.

Basics ** ** *********

** ********* ******* **** accurate *********** ** ******** 'training' ** ***** **********. Simply ***, ***** ******* of ***** ******* *** analyzed ** ***** **********, which ******* ***** ******** determine ******* *** ****** is **** ** ** labeled **.

** **** * ****** learn ** ****** *****, many **** ****** *** fed **** *** ** system ** ** *** analyze *** ***** **** a **** ***** ****:

IPVM Image

**** ******** ** ********* automatically, ******* ** ******** defining *** ** ***** aspects ** *******. *** algorithm '******' ** *** own, ******** ** ****** ********.

AI ****** *********

*** **** ***** ***** of ** ** *********** if *** ****** ** looking ** * **** object ** ***** (****, dust, ******, *********). ***** more ******** **** ****** VMD, ** ** ***** challenged ** ************* ******* (rain, ****) *** ******** changes:

*** **** ***** ** AI ** *********** ** the ******** ****** ** a ****** ** ***. Detecting ******** ******* (******/*******/*******) is **** *********** **** simple *********, *** ******** higher-level *******.

**** **** *********** ** determining ** *** ****** is * ******, *******, or ***** ****** ** not.

IPVM Image

*******, ****** *** ******** are *** **** ****** while ***** ******* **** to **** ** ********* in **** ******** *** expensive *******.

AI ****** **************

***** ********* *** ** trained ** ****** ******** types ** *******:

  • ****** - ***, ******, ethnicity, ******** *****
  • ******** - ****, **** (car ** *****), *****, direction ** ******
  • ******* - **** (*** vs ***), *****
  • ********* ******* (****, ****) - ****, ****** (****-******), type (****** ** *****)

Person **************

******* * ******'* ******** attributes *** ******** *** finding * ******** ****** during ** ***** ** incident, ** ** ******* to ******** ******, ***, clothing **** *** *****, glasses, ****** ****, ***:

IPVM Image

*******, **** ** ***** classifications *** ********* ***********, and ** **** ******* of ******** *****, **** person ************** ********* *** not ****** ********.

Vehicle **************

* *******'* ******** ********** are *** **** ****** sources ** ***** *********** about ** ********, ** when ******* *** * person. ** *** ** trained ** ******** *** vehicle ****, *****, ****, model *** ********* ** travel:

IPVM Image

*******, ** ****, **** and ***** *** ********* challenging, ****, *** ********* marketed ** *********** ***/**** manufacturers.

Animal **************

**** **** ****** **** person ** ******* *********, AI *** ** ******* to ******** *** **** (dog, ***), *** *****.

IPVM Image

Inanimate ****** **************

********* ********** ******* *** help ******** ******** **** to *********** ********* **********. AI *** ** ******* to ******** *********, *****, briefcases, ****, *** ******** specific *************** ** ****:

IPVM Image

*******, ** ****, ****** detection *** ************** *** guns *** ********* ******* from *********** *********, ***** can ** ********* *** come **** *********** **********. Classification ** ********* *** other ********* ******* (**********, packages, ***.) *** ** very *********** ** ****, based ** ********, ****** and ********.

Color *********

***** *** ** ** important ****** *** *********** an ****** **** ********* for * ******** ****** or *******. ***** ********* can ** ******* ** themselves ** ** *********** with ***** ******* (********, vehicle *****):

IPVM Image

*******, ***** ********* *** perform ************ ** *** light ** *&* ** night *****, ********* ****** as ****** ** ***** and ****:

IPVM Image

******

********* *** ** ******* to ****** ******** ***** of *********. *** **** common ******** ********** ***:

  • ******** / **** ******** and *********
  • *********
  • ****** ********
  • ****** **** ****** / Removed

Tripwire / **** ******** *** *********

********* **** * ****** enters ** ********** * restricted **** *** ** critical ** ****-******** *********, or *** ****** *** safety ********.

**** ** *** **** basic ******** ******** *** is ******* ** **** cameras:

********* ** **** *** the **** ******* ** a ******** ********, *** the ***** ** ********* by * ****** ******** an ****, ****** **** just ******** * ****.

*********

******* * ****** ******** or *********** ** **** is *** ****** ****** to ******* ** *****, if **** *** ***** detected **** ******* ****** an ********** *****, ********* alerts *** *******.

******* ********* ********* ********** is **** **** *********** than ********, ***** *** analytic ****** **** ***** or ********* ** *** person *** *** ******* time *****.

People ********

************* *** ****** ** people *** ***** *** leave ** **** ******* a **** *** ** important ** ******** ********** for ****** ********, *** valuable *** ********* ** retail *** *********** *********.

****** ******** ********* **** increment ** ********* ** people **** ******* * defined **** ** ****:

**** ** ******* ** tripwire ********* *** **** not ******* ** ***** for ***** ****** ********.

Object **** ****** / *****

****** **** ****** *** taken ********* **** ********* because ********** ******* (****, boxes, *********) **** *** left ****** *** ** dangerous ** ***** ********* and ********* ************* **** closures ** ****-******** ********* (airports, *******, ********):

IPVM Image

*******, ******* ******-****-****** *** taken ********* *** **** challenging ** ******* **********, you **** ** ** careful ** ****** **** scene, *** ****** ***** will **** **** *** analytic.

Beware: **** ** ********* **********

********* ***** **** ******** object ***** **** ****** for *** ************** ** human ********' ******, ***, clothing *****, ***. *******, in *** *******, **** the **** ********** ********* often *********** ******** **** demographic ***********, **** *** classified ** *****, ******** classified ** ******, ***.

IPVM Image

Where ********* *** *********

********* *** ** ********* by *******, *********, *******, or *** *****.

*** ********* ** ***** 4 ********* ***:

  • ******:******-***** ********* *** ** more ******** ******* **** can ** ********* ** low ***********, ****-******* *****, before ********. *******, ******** processors ******** *** ******** analytics **** ********* **** limited ** ********* ******* and/or *********** ************ (*.*. LPR/ANPR).
  • ********:********* ***** ** * recorder ********* ****** *** a **** ******** ********* than * ****** ****** could *****, ***** ** used *** *** ******* connected ** *** ********. Also, *** ********* *** immediately ********** **** *** viewing ********. *******, ******** manufacturers ** *** **** to ****-******* *** ******** to **** *** ********'* price ***, *** ***** the ********* *** *******.
  • ******:********* ********* ********** *** built ** **** ********* analytics ********** **** *********, and ********* ******* ******-**** components. *******, ******-***** ********* add *********** **** *** can ** ***** *** power-intensive.
  • *****: ********* ***** ** the ***** ****** ********* the ******** *********** ** recorders ** *******, *** provide **** ******** *********. However, ***** **********, ************ public ***** ******* (******, Google), *** ** **** expensive. *****-***** ********* ******** typically **** ******* $**-$** per ****** *** *****. Moreover, ******** ****** *** will ******** *** *** limit *** ****** ** cameras **** *** ** analyzed.

Deep ******** ** *** *******

*** ****** ************* ** that **** ******** ********* to ***** ***** ************.

**** ********* *** * pre-trained ***** **** **** not ****** ***** ******** over **** ***** ** the *****. *******, * small ****** ** ******* and *******, **** ** Avigilon's ****-******** *** ******, attempt ** ***** *** scene **** *** ****** in **** * ****** of ****.

Hardware *********** ** *******

*** ******* ********** ** doing ** ****** ******* has **** *** **** of *** ******** ** run ** ****** *** camera. **** **** ** AI ******* **** ************ been **** *********. ******* of ****, ******* **** VMD *******, ******* *** deficiencies *** ********* *** tradeoff ** **** ****** cost *** *** ******.

*******, ******** ****** **** begun ********** *** *********** increasing *************, ******* ** a **** ** ***-**** models ******** '**', **** varying ******* (*** ********* ********* ******** ****).

GPU ******** ********* ** ******* *** *********

******* ** ********* ********* in ******* *** ********* are **** ******* **** camera-based ********* *** **** to ******* ******** ******* simultaneously, **** ******* * or **** *** ***** that *** **** ********* of ******* *** ****.

***** **** ***** **** that ** ********* *** generally *** ** *** reach ** **** ***********, making **** **** ****** a *** ** ****-*** commercial, *********, ** ********** projects.

Deep ******** / ** ********** ** ****

***** ***** ************ ********* has **** ********, ***** and ******** *** ****** 20 *****,**** **** ** *** year **** ** ******* goes **********,******* **** ****** *** manufacturers **** ** ******** fairly ******** *** ******** people ********* *********. *** the **** **** ** not *** ***** ** stand *** ** ********, the ***** ***. **** is *** ****.

Single ****** **. **** ****** ***********

******* ********* *** ** difficult ** ********* ****** 3rd *******, **** ******* focus ** ******* ***** one '*** ** ***' video ********* / *** solutions. *** **** ****** example ** **** ** Avigilon, ***** ****** *** video ********* *** ******* integrated **** ************ ****** ***. ***** ******* ******** include *** ******** ****** manufacturers (*.*.,*******'* ******) ***** ********* **** work **** ***** *** VMS.

***** *************, **** ** Dahua, *********, *** *******, also ****** ********* ***** analytics ** ***** *** recorders (********* ******, ******** boxes, *** *************) ***** third-party ******* ** ******* to *** ********* *** events ****.

Video ******** ******** ********

***** ** * **** of ******* ***** ******** providers.

****** *************:

  • ********: ********* **** **** a **** ***** ** the ******* *** * number ** *****.
  • ***** *** *********: ***** emphasis ** ****** ** to ************* ******* ***** low-cost *********.
  • **** *** ******: **** have **** ********** **** to ******* *********, *** are **** ******** ** bring ********* ** ******.
  • *****: **** ******* ***** performing ********* *** * number ** *****, *** typically ** ***** **** expensive ******. ******** **** offered **** ******** ********* in *****-**** *******.

********-*****:

  • ******** - **** ****** specialist ******** *** ** expensive, ******* ** ****** systems (*** ****** *******).

********:

***** ********* ** *** ** analytics ************ **** *** *****, mostly ******** ********* ** add-ons *** *****-****** *******. These *** ********* **** higher ****** ********* **** camera *************, *** **** often ***** *********** ********** (e.g. ****, *******, ********, etc.).

Comments (5)

***** ****, ****** ******** some *********** ********.

****** *********** *** ******* usually ***** * *** experience ******* *** ****.

************ ** ********* **** happened ***** ******** ** the ******* ******* ** meet **************** ****** *** *** increase ** ********* ********, a ******* ** *****’* Law.

*** ******* ** **** promise *** ***** ******* is ****** ******* **** analytics. ****** ** ****, not *********.

* ****** * ******* that ************ ******* *** environment (***** **** *** setup), *** ** *** a ******* ****** **** learning. ***? ** *** often **** ** ****** fence **** ************ *** after * ****** ** time ** ***** ****** what ** *** ******* to ******.

****** **** “******* ***.”

******, **’* * *** better **** ** *** and *** ** **** need ** ****** *** “human ******.”

**** **** *******. ***** how *** ***** *** hype ** ** *** reality ** **** ** shipping. * ******** ******* deep ******** ******* ********* learning ** **** **** on ** * ******** to *** ****. **** line ** ******* ** many *** *** **** type ******* **** ** Uniview *** ** ****** good ** ** **********. I ***** ***** ******* this * ***** **** a **** **** **** that * ***** ****** possible ***** ********* ********** to *** *** ******** the ****** ***** **. Thanks *** *******.

* ***’* **** ** see *** *** *** how ******** ********* **** come ** *** **** few *****. **** * great **** **** **’* a *** **** ********.

* *** *****:
*. *** ********** ******* operation ****** *** ** night. ** *** **** as * *****, *** people **** ** *** more ********** ** *****/****/***. Night ***** *** **** no ***** *** **** visibility - ** ***** you ****** ** ********** lighting ***** ** ******* uneven, *** ********* ****** and ******* ***********. **** your ****** ** ***** time/rain.
*. "****/***** *******" ********* is ****** **** *** would *****. **** **** to ************* ******* **** and **** '**** ****** was *****/******** ******".
*. **** **** ***** about ***** ******* - your ****** ********* **** the **** *******/*** *****. Once **********, **** ****** become ***** ********* *********. Raw ** ****.

** ****** ******* *******, occupancy ********* ** ********* tied ** ****** ** IN *** ** *** badge ****** ** ****** of *****. *** ********* are ******** ** ******** badge *** ** ***** the ********. * **** the **** ** ****** the ****** **** *** enters ** ******, *** analytics *** ********* **** based ** ********* ** movement, *** **** * running ***** ** *** many ****** *** ** the ********. **** :)

Read this IPVM report for free.

This article is part of IPVM's 6,541 reports, 882 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
Vivotek Presents AI Analytics and LPR on May 19, 2020
Vivotek presented its AI Analytics and LPR at the April 2020 IPVM New...
Directory of 96 Video Surveillance Startups on May 20, 2020
This directory provides a list of video surveillance startups to help you see...
Camera Course Summer 2020 - Last Chance on Jul 18, 2020
This is your last chance to register for the Summer 2020 Camera Course. This...
Video Analytics Online Show 2020 - 35+ Manufacturer On-Demand Recordings on Sep 04, 2020
This show featured 35+ Video Analytics providers showcasing their latest...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Comparing 2020 Reality To 2010 Expectations on Sep 11, 2020
What can we learn from where the industry was in 2010 and what was believed...
The Future of H.266 For Video Surveillance Examined on Aug 17, 2020
First H.264, now H.265, is H.266 next? H.266 was recently announced amid...
Favorite Video Surveillance Hard Drive Manufacturer 2020 on Aug 27, 2020
Western Digital and Seagate effectively have a duopoly in hard drives but...
ZeroEyes Presents Firearm Detection Video Analytics on Jul 09, 2020
ZeroEyes presented its Firearm detection Video Analytics system at the May...
Hanwha Presents AI Analytics and First 8K Camera on May 11, 2020
Hanwha presented their AI Analytics and the "Industry's First 8K" camera at...
Sony 61MP Surveillance Sensor Examined on Sep 04, 2020
For a decade, the highest resolution single-imager surveillance cameras have...
AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...
Sony Launches AI Camera Sensors on May 18, 2020
Weeks after exiting the branded video surveillance business, Sony is making a...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020...

Recent Reports

Temperature Tablet Shootout - Dahua, Hikvision, ZKTeco, TVT + 5 More on Sep 30, 2020
Temperature tablets, aka terminal or stations, have emerged as a 'low-cost...
New Products Show Fall 2020 Tomorrow Bosch, FLIR, Hanwha, Tyco, Avigilon More! on Sep 30, 2020
IPVM's sixth online show concludes tomorrow with our special temperature...
ButterflyMX Raises $35 Million on Sep 30, 2020
Startup ButterflyMX has raised $35 million for its smartphone based intercom...
Worst Access Control Manufacturers 2020 on Sep 30, 2020
200+ Integrators told IPVM "In the past year, what access control...
Access Control Levels and Schedules Tutorial on Sep 29, 2020
Configuring access levels and setting up schedules is central to maintaining...
Avigilon / Motorola VS Virtual ISC West on Sep 29, 2020
ISC West has historically been so dominant that no player would think of...
Dartmouth College Deploys K3 Temperature Screening on Sep 29, 2020
While Dartmouth College has a $6+ billion endowment, the College has bought...
Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...