Video Analytics 101

By: IPVM Team, Published on Mar 16, 2020

This guide teaches the fundamentals of video surveillance analytics.

IPVM Image

****** ** *****:

  • *** *** ***** *********
  • ***** ********* *******
  • ***** *** ********* *********? Camera? ******? *****?
  • ******** ***-***** *********
  • *** ** *********? ********* and **************
  • ****** ** ** *********
  • ***** ** *******
  • ***** ** ******
  • ***** *********
  • ** ****** ******** *********
  • ** ************** ******
  • **** ******** ** *** Ongoing ** *******
  • ******** *********** ** *******
  • *** ******** ********* ** Servers *** *********
  • **** ******** / ** Mainstream ** ****
  • ****** ****** **. **** Systems
  • ***** ******** ******** ********

Why *** ***** *********

************, ************ ****** ** a ****** ** ******* multiple ******* ************** *** visually ******* **** *** occurring ** **** ** order ** ****** ******. However, **** ** *********** and ***** ** ****** because ****** *** **** monitor ** **** ***** at * ****, ******* to ****** ******.

***** ********* ******* ****** streams ** ****** ******** events, **** ** ****** or ******** ******, ******* faces, ** ******* ******. These ****** *** **** be **** ** ******* recording ** ****** ** operator ** **** *** effectively ******* **** ******* at *** ****.

Video ********* *******

****** ****** ** **** specific *******, ** **** to **** *** ******* clear: ***** ********* *********** varies***********, ******* **** **** strong ** ********. ***** should *** ***** ************ marketing ** *********, ** it *** ************ **** many *************** ****** *** overstated ***********.

***** *** **** ********** analytics *********, **** **** new ******** *** ************ in *** **** *** years ***** **** ******* drive ***********, *** ***** are **********, *** *** rule.

Historic ******: *** (***** ****** *********)

***** ****** ********* (***) is *** ******** ***** used ** ******* ** try ** ****** ********. It ** *** ** nor '*****' *** **** may ****** ** ** such.

*** ******* ** ********* rather ********** ******* ** pixels **** *** ***** to *** ****. ** enough ****** ****** ** enough ** * *****, the ****** ******** ****** detected.

*** ***** ***** ***** how *** ***** '***' a *** ****** *** correctly ********* ******:

VMD ***** ** ***** ******

*******, *** ** *** intelligent ****** ** **** whether ****** *** ***** movement ** ***, **** that **** *** ******. Because ** ****, ** makes **** ******** *** things **** *******, ******, branches, *******, *** ****** may ******* **. *** example, *** ***** ***** shows *** ****** * mistake ******* ** **** not '****' ******* *** changing ****** *** * person ** * ******:

\

Basic ********* **** *******

** *** ** ****** false ******, ************* ********* filters ***** ********* ** remove ***** ****** ******, leading ** ***** ***** analytics. ***** ******* *** include ****** **** ******/***** ratios, ****** ******, ********** motion, ***. **** ******** performance ******** ** ****** VMD, *** ***** ****** were/are ***** **** ******, with *******, ******, ****, animals, *** ***** ****** triggering **** ********* (*** our****** ********* ********).

Why ** *********

******* ** *** *********** to ******** ***-***** ********* and *** **** ***** alerts *** ***, ** analytics **** ********* *** video ************ ** ******** detection ******** *** ***** significantly **** ************** ************.

*** **** *********** ********* of ** ********* ** the ****** ** ******** effectively ****** *** **** detected ******: '** **** a ******?', '** **** a ***?', '** **** a *******?', '** **** a ***?' ***.

Basics ** ** *********

** ********* ******* **** accurate *********** ** ******** 'training' ** ***** **********. Simply ***, ***** ******* of ***** ******* *** analyzed ** ***** **********, which ******* ***** ******** determine ******* *** ****** is **** ** ** labeled **.

** **** * ****** learn ** ****** *****, many **** ****** *** fed **** *** ** system ** ** *** analyze *** ***** **** a **** ***** ****:

IPVM Image

**** ******** ** ********* automatically, ******* ** ******** defining *** ** ***** aspects ** *******. *** algorithm '******' ** *** own, ******** ** ****** ********.

AI ****** *********

*** **** ***** ***** of ** ** *********** if *** ****** ** looking ** * **** object ** ***** (****, dust, ******, *********). ***** more ******** **** ****** VMD, ** ** ***** challenged ** ************* ******* (rain, ****) *** ******** changes:

*** **** ***** ** AI ** *********** ** the ******** ****** ** a ****** ** ***. Detecting ******** ******* (******/*******/*******) is **** *********** **** simple *********, *** ******** higher-level *******.

**** **** *********** ** determining ** *** ****** is * ******, *******, or ***** ****** ** not.

IPVM Image

*******, ****** *** ******** are *** **** ****** while ***** ******* **** to **** ** ********* in **** ******** *** expensive *******.

AI ****** **************

***** ********* *** ** trained ** ****** ******** types ** *******:

  • ****** - ***, ******, ethnicity, ******** *****
  • ******** - ****, **** (car ** *****), *****, direction ** ******
  • ******* - **** (*** vs ***), *****
  • ********* ******* (****, ****) - ****, ****** (****-******), type (****** ** *****)

Person **************

******* * ******'* ******** attributes *** ******** *** finding * ******** ****** during ** ***** ** incident, ** ** ******* to ******** ******, ***, clothing **** *** *****, glasses, ****** ****, ***:

IPVM Image

*******, **** ** ***** classifications *** ********* ***********, and ** **** ******* of ******** *****, **** person ************** ********* *** not ****** ********.

Vehicle **************

* *******'* ******** ********** are *** **** ****** sources ** ***** *********** about ** ********, ** when ******* *** * person. ** *** ** trained ** ******** *** vehicle ****, *****, ****, model *** ********* ** travel:

IPVM Image

*******, ** ****, **** and ***** *** ********* challenging, ****, *** ********* marketed ** *********** ***/**** manufacturers.

Animal **************

**** **** ****** **** person ** ******* *********, AI *** ** ******* to ******** *** **** (dog, ***), *** *****.

IPVM Image

Inanimate ****** **************

********* ********** ******* *** help ******** ******** **** to *********** ********* **********. AI *** ** ******* to ******** *********, *****, briefcases, ****, *** ******** specific *************** ** ****:

IPVM Image

*******, ** ****, ****** detection *** ************** *** guns *** ********* ******* from *********** *********, ***** can ** ********* *** come **** *********** **********. Classification ** ********* *** other ********* ******* (**********, packages, ***.) *** ** very *********** ** ****, based ** ********, ****** and ********.

Color *********

***** *** ** ** important ****** *** *********** an ****** **** ********* for * ******** ****** or *******. ***** ********* can ** ******* ** themselves ** ** *********** with ***** ******* (********, vehicle *****):

IPVM Image

*******, ***** ********* *** perform ************ ** *** light ** *&* ** night *****, ********* ****** as ****** ** ***** and ****:

IPVM Image

******

********* *** ** ******* to ****** ******** ***** of *********. *** **** common ******** ********** ***:

  • ******** / **** ******** and *********
  • *********
  • ****** ********
  • ****** **** ****** / Removed

Tripwire / **** ******** *** *********

********* **** * ****** enters ** ********** * restricted **** *** ** critical ** ****-******** *********, or *** ****** *** safety ********.

**** ** *** **** basic ******** ******** *** is ******* ** **** cameras:

********* ** **** *** the **** ******* ** a ******** ********, *** the ***** ** ********* by * ****** ******** an ****, ****** **** just ******** * ****.

*********

******* * ****** ******** or *********** ** **** is *** ****** ****** to ******* ** *****, if **** *** ***** detected **** ******* ****** an ********** *****, ********* alerts *** *******.

******* ********* ********* ********** is **** **** *********** than ********, ***** *** analytic ****** **** ***** or ********* ** *** person *** *** ******* time *****.

People ********

************* *** ****** ** people *** ***** *** leave ** **** ******* a **** *** ** important ** ******** ********** for ****** ********, *** valuable *** ********* ** retail *** *********** *********.

****** ******** ********* **** increment ** ********* ** people **** ******* * defined **** ** ****:

**** ** ******* ** tripwire ********* *** **** not ******* ** ***** for ***** ****** ********.

Object **** ****** / *****

****** **** ****** *** taken ********* **** ********* because ********** ******* (****, boxes, *********) **** *** left ****** *** ** dangerous ** ***** ********* and ********* ************* **** closures ** ****-******** ********* (airports, *******, ********):

IPVM Image

*******, ******* ******-****-****** *** taken ********* *** **** challenging ** ******* **********, you **** ** ** careful ** ****** **** scene, *** ****** ***** will **** **** *** analytic.

Beware: **** ** ********* **********

********* ***** **** ******** object ***** **** ****** for *** ************** ** human ********' ******, ***, clothing *****, ***. *******, in *** *******, **** the **** ********** ********* often *********** ******** **** demographic ***********, **** *** classified ** *****, ******** classified ** ******, ***.

IPVM Image

Where ********* *** *********

********* *** ** ********* by *******, *********, *******, or *** *****.

*** ********* ** ***** 4 ********* ***:

  • ******:******-***** ********* *** ** more ******** ******* **** can ** ********* ** low ***********, ****-******* *****, before ********. *******, ******** processors ******** *** ******** analytics **** ********* **** limited ** ********* ******* and/or *********** ************ (*.*. LPR/ANPR).
  • ********:********* ***** ** * recorder ********* ****** *** a **** ******** ********* than * ****** ****** could *****, ***** ** used *** *** ******* connected ** *** ********. Also, *** ********* *** immediately ********** **** *** viewing ********. *******, ******** manufacturers ** *** **** to ****-******* *** ******** to **** *** ********'* price ***, *** ***** the ********* *** *******.
  • ******:********* ********* ********** *** built ** **** ********* analytics ********** **** *********, and ********* ******* ******-**** components. *******, ******-***** ********* add *********** **** *** can ** ***** *** power-intensive.
  • *****: ********* ***** ** the ***** ****** ********* the ******** *********** ** recorders ** *******, *** provide **** ******** *********. However, ***** **********, ************ public ***** ******* (******, Google), *** ** **** expensive. *****-***** ********* ******** typically **** ******* $**-$** per ****** *** *****. Moreover, ******** ****** *** will ******** *** *** limit *** ****** ** cameras **** *** ** analyzed.

Deep ******** ** *** *******

*** ****** ************* ** that **** ******** ********* to ***** ***** ************.

**** ********* *** * pre-trained ***** **** **** not ****** ***** ******** over **** ***** ** the *****. *******, * small ****** ** ******* and *******, **** ** Avigilon's ****-******** *** ******, attempt ** ***** *** scene **** *** ****** in **** * ****** of ****.

Hardware *********** ** *******

*** ******* ********** ** doing ** ****** ******* has **** *** **** of *** ******** ** run ** ****** *** camera. **** **** ** AI ******* **** ************ been **** *********. ******* of ****, ******* **** VMD *******, ******* *** deficiencies *** ********* *** tradeoff ** **** ****** cost *** *** ******.

*******, ******** ****** **** begun ********** *** *********** increasing *************, ******* ** a **** ** ***-**** models ******** '**', **** varying ******* (*** ********* ********* ******** ****).

GPU ******** ********* ** ******* *** *********

******* ** ********* ********* in ******* *** ********* are **** ******* **** camera-based ********* *** **** to ******* ******** ******* simultaneously, **** ******* * or **** *** ***** that *** **** ********* of ******* *** ****.

***** **** ***** **** that ** ********* *** generally *** ** *** reach ** **** ***********, making **** **** ****** a *** ** ****-*** commercial, *********, ** ********** projects.

Deep ******** / ** ********** ** ****

***** ***** ************ ********* has **** ********, ***** and ******** *** ****** 20 *****,**** **** ** *** year **** ** ******* goes **********,******* **** ****** *** manufacturers **** ** ******** fairly ******** *** ******** people ********* *********. *** the **** **** ** not *** ***** ** stand *** ** ********, the ***** ***. **** is *** ****.

Single ****** **. **** ****** ***********

******* ********* *** ** difficult ** ********* ****** 3rd *******, **** ******* focus ** ******* ***** one '*** ** ***' video ********* / *** solutions. *** **** ****** example ** **** ** Avigilon, ***** ****** *** video ********* *** ******* integrated **** ************ ****** ***. ***** ******* ******** include *** ******** ****** manufacturers (*.*.,*******'* ******) ***** ********* **** work **** ***** *** VMS.

***** *************, **** ** Dahua, *********, *** *******, also ****** ********* ***** analytics ** ***** *** recorders (********* ******, ******** boxes, *** *************) ***** third-party ******* ** ******* to *** ********* *** events ****.

Video ******** ******** ********

***** ** * **** of ******* ***** ******** providers.

****** *************:

  • ********: ********* **** **** a **** ***** ** the ******* *** * number ** *****.
  • ***** *** *********: ***** emphasis ** ****** ** to ************* ******* ***** low-cost *********.
  • **** *** ******: **** have **** ********** **** to ******* *********, *** are **** ******** ** bring ********* ** ******.
  • *****: **** ******* ***** performing ********* *** * number ** *****, *** typically ** ***** **** expensive ******. ******** **** offered **** ******** ********* in *****-**** *******.

********-*****:

  • ******** - **** ****** specialist ******** *** ** expensive, ******* ** ****** systems (*** ****** *******).

********:

***** ********* ** *** ** analytics ************ **** *** *****, mostly ******** ********* ** add-ons *** *****-****** *******. These *** ********* **** higher ****** ********* **** camera *************, *** **** often ***** *********** ********** (e.g. ****, *******, ********, etc.).

Comments (5)

***** ****, ****** ******** some *********** ********.

****** *********** *** ******* usually ***** * *** experience ******* *** ****.

************ ** ********* **** happened ***** ******** ** the ******* ******* ** meet **************** ****** *** *** increase ** ********* ********, a ******* ** *****’* Law.

*** ******* ** **** promise *** ***** ******* is ****** ******* **** analytics. ****** ** ****, not *********.

* ****** * ******* that ************ ******* *** environment (***** **** *** setup), *** ** *** a ******* ****** **** learning. ***? ** *** often **** ** ****** fence **** ************ *** after * ****** ** time ** ***** ****** what ** *** ******* to ******.

****** **** “******* ***.”

******, **’* * *** better **** ** *** and *** ** **** need ** ****** *** “human ******.”

**** **** *******. ***** how *** ***** *** hype ** ** *** reality ** **** ** shipping. * ******** ******* deep ******** ******* ********* learning ** **** **** on ** * ******** to *** ****. **** line ** ******* ** many *** *** **** type ******* **** ** Uniview *** ** ****** good ** ** **********. I ***** ***** ******* this * ***** **** a **** **** **** that * ***** ****** possible ***** ********* ********** to *** *** ******** the ****** ***** **. Thanks *** *******.

* ***’* **** ** see *** *** *** how ******** ********* **** come ** *** **** few *****. **** * great **** **** **’* a *** **** ********.

* *** *****:
*. *** ********** ******* operation ****** *** ** night. ** *** **** as * *****, *** people **** ** *** more ********** ** *****/****/***. Night ***** *** **** no ***** *** **** visibility - ** ***** you ****** ** ********** lighting ***** ** ******* uneven, *** ********* ****** and ******* ***********. **** your ****** ** ***** time/rain.
*. "****/***** *******" ********* is ****** **** *** would *****. **** **** to ************* ******* **** and **** '**** ****** was *****/******** ******".
*. **** **** ***** about ***** ******* - your ****** ********* **** the **** *******/*** *****. Once **********, **** ****** become ***** ********* *********. Raw ** ****.

** ****** ******* *******, occupancy ********* ** ********* tied ** ****** ** IN *** ** *** badge ****** ** ****** of *****. *** ********* are ******** ** ******** badge *** ** ***** the ********. * **** the **** ** ****** the ****** **** *** enters ** ******, *** analytics *** ********* **** based ** ********* ** movement, *** **** * running ***** ** *** many ****** *** ** the ********. **** :)

Read this IPVM report for free.

This article is part of IPVM's 6,530 reports, 880 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Sony Launches AI Camera Sensors on May 18, 2020
Weeks after exiting the branded video surveillance business, Sony is making a...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Vivotek LPR Camera Tested on Apr 15, 2020
Vivotek has historically sold license plate capture cameras but not LPR. Now,...
Vivotek Presents AI Analytics and LPR on May 19, 2020
Vivotek presented its AI Analytics and LPR at the April 2020 IPVM New...
Video Surveillance History on May 06, 2020
The video surveillance market has changed significantly since 2000, going...
Directory of 96 Video Surveillance Startups on May 20, 2020
This directory provides a list of video surveillance startups to help you see...
AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...
Camera Course Summer 2020 - Last Chance on Jul 18, 2020
This is your last chance to register for the Summer 2020 Camera Course. This...
Comparing 2020 Reality To 2010 Expectations on Sep 11, 2020
What can we learn from where the industry was in 2010 and what was believed...
Sony 61MP Surveillance Sensor Examined on Sep 04, 2020
For a decade, the highest resolution single-imager surveillance cameras have...
Video Analytics Online Show 2020 - 35+ Manufacturer On-Demand Recordings on Sep 04, 2020
This show featured 35+ Video Analytics providers showcasing their latest...
Dynamic vs Static IP Addresses Tutorial on Apr 16, 2020
While many cameras default to DHCP out of the box, that does not mean you...
Meditherm Medical Thermal Cameras Examined on May 07, 2020
US-based Meditherm emphasized to IPVM its 20+ year development history and...
Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
Fever Camera Sales From Integrators Surveyed on Jun 01, 2020
Fever cameras are the hottest trend in video surveillance currently but how...

Recent Reports

IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Norway Ethics Councils Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
Today is your last chance to save $50 on registration for the Fall 2020 Video...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...
China Bems Temperature Measurement Terminal Tested on Sep 22, 2020
Guangzhou Bems (brand Benshi) is the manufacturer behind temperature...
Axis Exports To China Police Criticized By Amnesty International on Sep 21, 2020
Axis Communications and other EU surveillance providers are under fire from...
Milestone XProtect on AWS Tested on Sep 21, 2020
Milestone finally launched multiple cloud solutions in 2020, taking a...
Mobile Access Control Usage Statistics 2020 on Sep 21, 2020
Most smartphones can be used as access control credentials, but how...
Axis Compares Fever Camera Sellers to 9/11 on Sep 18, 2020
Axis Communications, the West's largest surveillance camera manufacturer, has...
Avigilon Elevated Temperature Detection Camera Tested on Sep 17, 2020
Avigilon has entered the temperature screening market with the release of...
Chilean Official Investigated for Motorola And Hikvision Contracts on Sep 17, 2020
A corruption investigation is underway in Chile after a crime prevention...
Huawei HiSilicon Production Shut Down on Sep 17, 2020
Huawei HiSilicon chips are no longer being manufactured or supplied to...
Virtual ISC West and GSX+ Exhibiting Contrasted on Sep 17, 2020
Both ISC West and ASIS GSX are going virtual this year, just weeks apart, but...