AI/Smart Camera Tutorial

Published Feb 20, 2020 13:58 PM

Cameras with video analytics, sometimes called 'Smart' camera or 'AI' cameras, etc. are one of the most promising growth areas of video surveillance.

IPVM Image

But what makes a camera 'smart' or 'AI'? In this 101 tutorial, we explain.

No *********

***** *** ** ********* *** ***** of **** ******* *** ***** '**' or '*****'. ** ***** ************,****'* ****** ********* ********* *** ******* ***** ** *** proof ** **** ***** *** **** not.

**** ** ****, **** ******* ******* says **** **** ********* ** ** or * ***** ******, **** **** not **** ** ** ****.

VMD *****-***** '********'

***** ****** ********* (***) ** *** original ***** **** ** ******* ** try ** ****** ********. ** ** not ** *** '*****' *** **** may ****** ** ** ****. ********, it ** ********* ** ********** *** differences *** ****** ********.

** *** **** **** *** ***, in **** ****** **** **** **** still, ** ******* *** ****** ** correctly ****** **** ** ****** *** people, ***. **** *******. ** *** negative ****, *** ***** ****** ** falsely *********.

*** *** **** ******* ******* ** is *************** *** ********** *********** ** do.

*** ***** ***** ***** * ****** example ***** ****** *** ***** ***** and **** ***:

IPVM Image

*** ******* ** ********* ****** ********** changes ** ****** **** *** ***** to *** ****. ******* ***** ** made ** ** ****** **** ********* small ***** ** *** ******* ***** / *****. ** ****** ****** ****** by ****** ** * *****, *** camera ******** ****** ********.

*** ***** ***** ***** *** *** might '***' * *** ****** *** correctly ********* ******:

** ********, *** ***** ***** ***** VMD ****** * ******* ******* ** does *** '****' ******* *** ******** pixels *** * *** ** * shadow:

Filters / ******* *** ***

** ******* *** ***** ********** *** computation *** **** ** ********** *********, cameras ***** * ****** ** ******* or ******* ** **** ********* **** false ******, **** **:

  • ****** ** ******
  • ******** ** ********
  • **** ** ********
  • ******** ******** *******

Amount ** ***** ******

****** ** ******, ********* ****** ****** sensitivity, ** *** ****** ****** **** differ **** ******** ****** ** ***** to ** ********** "*******", ********* ** measuring *****/******** ***********. **** ** ******* to, *** ********* ****, *** ********** of ****** ***** ******.

IPVM Image

Duration ** ********

******** *** ******** ** ******** ******* VMD ******* ** ********* ****** ** pixels **** **** ****** ***********, ***** caused ** ******* ***** ** ********* illuminated ** **. **** ** ********* simply ******* ** *******.

IPVM Image

Size ** ********

*** **** ** ******** ****** ** the ****** ** ****** **** **** change ****** *** ** *********, ********* referred ** ** * *********, * percentage ** *** ****** **** ** some ******* *** * ******** ***** quantity ** ******. **** ****** ** the **** *********** **** ** ***, with **** ************* ********* ** ***** settings.

** **** *****, ******* ******* **** a ******* *** ******* **** ******* (shown *****) ** ********* **** ***** changes ** **** ** ***** ***** changes ***** *** ** ****** ** cameras ****** ** ****** ******* **/***.

IPVM Image

Movement *******

******** ********, **** ************* **** ********** filters ***** ****** ******** ***** ** movement, **** ** *** ******* ****** filter ***** ** **************** **************. **** ****** ** ******** ** ignore ******* ***** **** **** *** forth ****** * ******** *****, ** avoid ****** ** *****, *****, ** other ******* **** ********** ******.

IPVM Image

****** *** ***** ***** ** *** specific ********** ** ***** **, ******* of *** ********** (*.*., **** **** moving *****, *** *****).

Difference: ******* **** *** *** ****** *********** *** **

***** *** ******** **** **** *** is ******** ***** ********** ** **** it ***** *** ****** *********, *.*. - ****** *** **** *** ******* sizes ** ****** ******* **** *** more **** * *** *******. **** may ****** *** ** *****, *.*., a *** ****** *** **** *** VMD ****** ** * *** *** perhaps ** ** **** *** ******** people ** ********. *** **** ***** means **** ***** ****** *** ***.

*** **** *********** ********* ** **** 'smart' ** '**' ******* ** **** those ******* *** ******** *********** ****** for **** ****** "** **** * person?", "** **** * ***?", "** this * *******?", "** **** * gun?" ***.

Basics ** ** *******

**/'*****' ******* ******* **** ********* ** applying '********' ** ***** **********. ****** put, ***** ******* ** ***** ******* are ******** ** ***** **********, ***** decides ***** ******** ********* ******* *** object ** **** ** ** ******* as. *** *******, * ******'* ******, width, ********, *** *** *** ******, location ** ********, ***., *** *** be **** ** ******** ******* ** determine ******* ** ****** ** * real ******, ******* ** ** ****** or *******.

IPVM Image

**** ******** ** ********* *************, ******* an ******** ******** *** ** ***** aspects ** *******. *** ********* '******' on *** ***, ******** ** ****** ********.

AI ****** ******** *********

** ******** ** ****** ********* ********, AI **** ****** ******* ** ****** more ******** ****** ***** **** ****** VMD ** ***** *****-***** *********. *** example, ******* ** ****** *********** *** objects ***** ** ********, *** ** is ***** ****** ** ******** **** as ******, **** ****** ********** ** cars, ****, *****, ***.

IPVM Image

**** ******** ****** ********* ****** *** more ******** ********* ***** ** ** used (*.*., ***** ** **** * car ** ****** ** *** *** lane) *** *** ** **********, ******** operators ** **** ******** ******* **** quickly **** ******** ******* ******** ******* 'vehicle' **********.

Beware: **** ** ********* **********

********* ***** **** ******** ****** ***** also ****** *** ************** ** ***** subjects' ******, ***, ******** *****, ***. However, ** *** *******, **** *** best ********** ********* ***** *********** ******** this *********** ***********, **** *** ********** as *****, ******** ********** ** ******, etc.

IPVM Image

Deep ******** ** *** ******* ** *******

****: *** ****** ************* ** **** deep ********/** ******* ******** ** ***** after ************. **** ** ******** ** some *****, **** ** ********'* ****-******** H5A *******, ***** ******* ** ***** the ***** **** *** ****** **. However, **** ******* *** * ***-******* model **** **** *** ****** ***** analysis **** **** ***** ** *** scene.

Upgrading ********

** ***** ** ******* *** **** learning *****, * ******** ****** ** typically ********. ** ** ** ******** that ** ***'* ***** ****** ** making ******** **** * ******** ******* could ******* ***********.

*******, *********** *********** ** **** *** be **** **** ******** / ******** are ******* ** ******** *********** ** the *******.

Hardware *********** ** *******

*** ******* ********** ** ***** ** inside ******* *** **** *** **** of *** ******** ** *** ** inside *** ******. **** **** ** AI ******* **** ************ **** **** expensive. ******* ** ****, ******* **** VMD *******, ******* *** ************ *** realizing *** ******** ** **** ****** cost *** *** ******.

*******, ******** ****** **** ***** ********** and *********** ********** *************, ******* ** a **** ** ***-**** ****** ******** "AI", **** ******* ******* (*** ********* ********* ******** ****).

********* **** ******* ****** (********),********* ** *****, ****** *********, *******, *** ****** have ******** **** ******** ** *** past *** ***** **** ******* **** learning ** ***** ****** *******.

Outlook ***** ******* *******

****** ** ********* ******** ************, ** expect ** *** *** **** ***** cameras ** ********* ** **** *** over *** **** *** *****.

***** **** ******* ***** ******* ****** at * '***" *****, **** ***** hardware, ** ****** *********** ********* ** performance. ** **** ******* **** **** smart / **** ******** ***********, **** will ************ ****** *** **** ******* to ******** ** *********, *.***, *.***, smart ******, ***.

*** ***** *** ******** ******* *** will ***** ****** **** *** *****. By *** ***-*****, ** ***** ****** highly ******** ****** *** ******* ********* to ****** * ********* (*.*., ***** camera ****** ****) *** **** ******* elements **** ****** ***********, ******* **************, and ******** ************** ***** **** *** longer ** ****** ********** ** **** accuracy.

Comments (4)
UI
Undisclosed Integrator #1
Feb 20, 2020

Interesting article. I have not had much occasion to work with analytics beyond VMD. I do recall having to "train" an Avigilon camera a few years ago. Does deep learning on a camera require human feedback?

UM
Undisclosed Manufacturer #2
Feb 20, 2020

Deep learning does not "require" human (user) feedback other than at an engineering level where feedback can improve accuracy. Alternately, Avigilon's "teach by example" "allows" for human feedback. Play back stored video and check, "person true", "person false", "vehicle true", "vehicle false" on a classified object.

(3)
Avatar
Ethan Ace
Feb 20, 2020
IPVM

Undisclosed #2 said a lot of what I was going to say first. It's also worth noting that Avigilon does self-learn, but it takes several hundred events, if I recall correctly, to be fully trained. In areas where that would take a very long time, such as low traffic remote sites, the teach by example feature is used to speed training.

It's also worth pointing out that part of Avigilon's self-learning is determining what is background in the scene. They don't have specific manual calibration settings like some do, where you have to measure points in the camera's FOV to calibrate distance and figure out where the horizon is in the scene. The self-learning is intended to figure that out automatically.

(2)
UM
Undisclosed Manufacturer #2
Feb 20, 2020

It's always selfishly rewarding to take words out of Ethan's mouth!!! LOL!

(1)