Video Analytics Architecture 101

By IPVM Team, Published Feb 04, 2021, 12:11pm EST (Info+)

Video analytics can be run in a variety of ways that have significantly different pros and cons. IPVM has identified 9 fundamental architectures, explaining the tradeoffs of each one herein.

IPVM Image

These architectures are:

  • Run entirely on the camera using the camera manufacturer's own analytics
  • Run entirely on the camera using 3rd party analytics
  • Stream from a camera to a recorder using the recorder's analytics
  • Stream from a camera to a server using 3rd party analytics
  • Stream from a camera to a recorder than to a server using 3rd party analytics
  • Run entirely on the cloud, streamed from a camera
  • Run a combination of camera and recorder/server
  • Run a combination of camera and cloud
  • Run entirely on the cloud, streamed from a bridge

Additionally, certain architectures using 3rd parties for analytics or video management will require special integration. We conclude this report by looking at APIs, SDKs and the use of ONVIF to do so.

All **-****** ****** *********

** ******* ********* **** ***** ** motion ********** ***, ************, *** ****** in ******* ***** ** ***** ********* at ******* ****** ** ********.

IPVM Image

*** **** ** **-****** ********* ***:

  • *** **** *** ********* -********* *** ********* ** ******* **** in *** ***-$*** ***** (****** ******* will ****) *** ** * ************* cheaper ****** **** ****** ********* ** server ** *****.
  • ***** ******* ********* -******* *** ********* *** *** ****** the ******, *** **** ***** ****** need *** ** *********** *** ********.
  • ******** *********** ********- **-****** ********* *** ** *** before *********** *****, ***********, *** *** certainly, ********* ******** ****** ********* ***** that ** ***** ************.
  • **** *** ******/******* ********* -****** *** ******* ********* *** ***** efficient ****** ** ** *** ** lower-powered ****** **********.
  • **** *********** **** **** ************ -**** **** **** *** **** ************'* NVR/VMS, *********** ** ******** ****** *** live ********** *** ****** ** ****.

*** **** ** **-****** ****** ********* are:

  • *********** ******** **** *** ******* -***** ***** ******** ******** ***********, *********** on ******** *** ************** ***** ****, in ********, *********** ** ***** *** possible ** ******* **** *** *******.
  • ******** ****** *********** -** *** ********* ** * ****** using **-****** ************, *** ******* **** be ******* *** ********, ****** ******* and ***** ****.
  • ********* **** ** ******* ******* -****** ******** ********* *** **-***** ****** analytics *** ****** **** **** ***** accuracy ***-***** ******* *******.
  • ******* ******** ***** -******* ** *** ******* ********** ***** in **** *******, ********* *** ********* limited ** ******, ******, *** ******* detection.

Camera ************* ********* ** ******* *********

**** ** *** ******* ***** ************ manufacturers **** ******* *** *** ****** motivated ** ****** ********** ** **** cameras. ********* ********* ****** *** ******, is * *** ** ************* *** justify ******* *******. **** **** ******** on ***** ********** *** ****** ********* or ****** ***** ********* **** *******.

In-Camera **** ***/****** *********

**** ******* ******* *** ***** *** stores ** *******, ******** * ***** of ********* (***, ********* *********, ****** counting) **** ** *** **** ********. These *** **** ******** ********* **** low ****** *** ****** ************* ** develop ***** ***.

IPVM Image

******** ** **** ******* **** **** and ******** ******* ***** [*** ******** ****](*** **** *******).

*** **** ** **-****** ***/****** ********* are:

  • ******** ********* -*** ********* ***** ***********/******** ********* **** the ****** ************ **** *** ******* standard.
  • ** ***** ******** -**** *** ******* ** ******** ****** to *** *** ********* *******, ****** hardware **** *** ***********.

*** **** ** **-****** ***/****** ********* are:

  • ******* ******* *******: ***** **** ****** **** ****** its ****** ****** ******** ** ****** **** *****'* ********, ******* ******* ** ***** *** stores ** *******.
  • *********** ******** **** *** ******* -******* *** ********* *** *** **** of *** **** ****** *************, *** party ****/***** *** *** ********* *** analytics ** ******* ** ****** *********.
  • ***** ********* *** ******** -***** *** ****-****** ********* (****** *** vehicle *********) *** ********* ********, ***** limits *** ******** ****** ** **** complex ********.
  • ******* ****** -***** **** *** **** *** *******, issues **** *********** *** ****** ******** of *** ** ** ***** - e.g. *** ****** ************ ** *** app *********.
  • *******************- ***** ******** **** *** ** loaded ** *******, ***** **** *** not ********* *** ** *** ****** processing ***** ** ************, ** ** often *** ****.

Analytics ** ********

********* *** ***** ********* *** ********* cameras, ********* ***** *****-****** ****** ********* or ********* ****** *** ******* *********. AI-based ******* *** *** ******, ****** we ****** **** ** **** ** the **** *** *****.

IPVM Image

*** **** ** *** ** ******** analytics ***:

  • ***** **** -******** ** ******, *****, *** **-***** camera *********, ********* *** ***** *** lowest **** *** ******, ******* ** provides * ******* ****** ** ******* many ******* ** ****.
  • *** ********* ** ******** ******* -******* ** ********* **** ******* ** add *********, * ****** ******** *** add ********* ** *** ******** *******
  • ******* ********** ******* -******** ********* *** ******* ********** **** the ********'* *** ******* ********.

*** **** ** *** ** ******** analytics ***:

  • ******** ****** -******** ********* *** ********* **** ******** due ** ******* ********* ********* ****** across **** *******.
  • ********* ******** **** -****** ******** ********* *** **-***** ******** analytics *** ****** **** **** **** common *** ******** ***-***** *********.
  • **** ******** ********** **** ********* ******* -******** ************* ** *** **** ** over-specify *** ******** ** **** *** recorder's ***** ***.
  • ********* ********* ****** -********* *** ****-****** *** * ******* channel *****, *** ** *** ********* support ********* ** *** ********.
  • ******* ************ -*** ************* ***** ********* **** ****** performing *********, **** ***** ***** **-***** advanced ************, ****** ***********, ***, ***.

Analytics ** ******

********* ********* ******* *** ** **** to *** **** ******* *** *********** analytics. **-***** ********* ******* **-******* ******* using ******** **** *** ****** ************, facial *********** *** ***.

**** *** ** **** **** ***** directly **** *** ****** ** *** server:

IPVM Image

** ******* *** **** ******* ******* from * ********, ******* ** ********** each ****** ** *** ******.

IPVM Image

********* * ****** **** *** ******** can ****** *** ***** ** ********** multiple ******* **** * ****** *** simplify ******* ********** ** ********** ** 1 ** * *** ********* ****** dozens ** *******.

*** ******* **** ** ******-*** ********* are:

  • **** ******** ********** **** ******* -********* ******* *** ****-**** ** ******* CPUs, *** **-***** ******* ********* ***** 1 ** **** *** *** ****** complex **** ******** *********.
  • ******** ********** -******* *** ********* ******* ******** **** and ****, ***** *** ******* ******* to ****** ****** ******, ** **** complex *********.
  • **** ******* **** * ****** ****** -* ********* ********* ****** **** ******** CPUs *** **** *** ******* ****** or ******** ** *******, ********* ** the ********** ** *** ********.
  • **** ******* ********* -****** ******* ********* (****** ***********, *********, anomaly *********, ***) **** ******** ******* a ********* ********* ******.

*** **** ** ** ****** ********* are:

  • ****** ******** **** -******** ***/*** ******** ** ********* *** the ******* **** *** ********* ** are **** **** ****** **** **** low-cost *********.
  • ****** ********* **** -******** ** ********* *******
  • **** ******* -********* ******** ** * ********* ****** stream, ***** ******** ***-******* ***** ************* per ******.
  • ***** *** ***** -*********** ** ***** ******* *** **** complex, **** ****** **** ***** ******, or ** ******* ********* ** *** primary *** ******.
  • ********* ***** / ********** *** -******** ** *********, ********* ****** ******** is ***** *** ****** ** ******* in ** ********/****** ********.

Emergence ** ********** ********* *********

***** ***** ********* ** ******** *********, **** ** *** **** ***** own ******* ******* **** ** ** economic ************ ******* ****** ********* ** a ****** ** ******** ********* *** average ***** *** ******, ******** ** the ***** ** ******** ** ******* or ****.

*******, ********* ***** ********** ******** ********* provide **** ******** ** **** ************* analytics **** ***** ****** ********* ***********.

Combo ********* ** ****** *** ********/******

* **** ****** ******** ************ ** cameras ********** *** ***** **** ** people/vehicle/object *********, *** * ********/****** ********** higher ****** ************ ** ***** ********* (unusual ********, ****** ***********, ***):

IPVM Image

*** **** ** ****** *** ********/****** combo ********* ***:

  • ********* ** ****** ***** ****** ********** -** ********** ****** ****** *** ******* detection ** *** ******, ****** ********* are ********* ** **** ******* *********.
  • ******* ******** **** ****** ************ -****** ************ ***** ******* ***** ********** live ********** *** ***** ********* ** all ******** ****** ** *** *********.
  • ******** *** -** ********** ****** ****** *** ******* detection ** *** ******, ****** ********* can ** **** *** ********* *********** analytics (***, ****** **********, ***) *** individual *******.

*** **** ** ****** *** ********/****** combo ********* ***:

  • **** ******* -** *** ****** **** * ********** analytic (*.*. ****** ********* ****** ****** recognition) *** ** **** *** **-****** or ******, **** ************ ** ****** dependent ** *** ************ ***********.
  • ****** **** - *** **** **** ** **** ************ compared ** *** ** ****** ** recorder ********* ********* ****** ** ** enterprise *****
  • *** ***** ******* ******** -******* ** *** ********** ** *********** metadata ******* *******/******* **** ************ ** typically ******* ** ****** ************.

Analytics ** ***** **** ******

* ****** ************ *** **/**** ******** startups ** ***** *** ***** ** support *********, ********** ******* ********, ***** using *********, ***-********** *****:

IPVM Image

*** **** ** ** ***** ********* are:

  • ** / ******* ******** **** -********* ***** ** *** ***** ****** eliminate *** ******** *********** ** ********* or *******.
  • **** ******* ********* -******* ** *** ********* **********, *** cloud ** ******** **** *** ******* and *********** ********* (*** *********, ****** recognition, ***.)
  • ****** ******** **** -******* *** ***** ** ******** **** the ********, ****** ****** ** ******/****** is ****** **** **** **-******* ***** analytics.

*** **** ** ** ***** ********* are:

  • ********* ******** ********* -******** ****** *** **** ******** *** can ***** *** ****** ** ******* that *** ** ********
  • ********* ********* **** -***** **********, ************ ****** ***** ******* (Amazon, ******), *** ** **** *********.
  • **** ******* -************* *** **** ********** ****** **** complex **** **** ************ ******* *** video *** ** ******** ****** ** the ***** *** **** ** *** site *** **********.

******* ** *** *******, ** ****** a ***** **** **** ***** ********** to **-****** **********, *.*.,*** ******* ** ****** *** ** From ***** ** ****.

Combo ********* ** ****** *** *****

******* ******* *** ***** **** ** people/vehicle/object *********, *** *** ***** ******** higher-detail ************ ** ***** ********* (******* behavior, ****** ***********, ***). **** ** offered ********* ** ***********, ******-** ****** vendors.

IPVM Image

*** **** ** ****** *** ***** combo ********* ***:

  • ********* ********* -******-***** ********* *** ** *** ************ on *******, ************ ***** **** **** people ** ******** *** ********.
  • **** ******* ********* **** *** ****** -******* ** *** ********* **********, *** cloud *** ** **** *** ****** recognition, ************, ***.
  • ****** ****** / ***** *********** ****** -**** ************ ** ****** **** ***********/****** in ******* ******* ** *** *********** complexity, *** ****** *********** ********* ********* in * ****** *********.

*** **** ** ****** *** ***** combo ********* ***:

  • ********* ******** ********* **** ******/******** -******** ****** *** **** ******** ******** to ******/******** ***** ********* *** *** limit *** ****** ** ******* *********.
  • ********* **** -******* **** ********** ** ********* **-******, this *** ** **** ********* **** all-cloud *********, *******, ***** ********** *** be **** *********.
  • *** ***** ******* ******** -******* ** *** ********** ** *********** and ************* ********, **** ************ ** typically ******* ** ****** ************ *********.

Analytics ** ***** *** ******

*** ***** ********* *** ** *** video **** ** **-******* ******. *** bridge **** ** ** **-******* ********** appliance *** ******* *** **** *** offer *********:

IPVM Image

*** **** ** ** ***** *** bridge ********* ***:

  • *** ***** ****** ******* ****** -******* * ****** ******** **-******* ******* to *** *****, **** ********* ******* RTSP/ONVIF *******, ****** ******-** ******-**-***** *********.
  • **** ******* ********* -******* ** ******* ********* ** ***** from *******, ******* ** *** ********* processing, *** ***** *** ** **** for ****** ***********, ************, ***.

*** **** ** ** ***** *** analytics ***:

  • ********* **** -******* ********* ********** ** *** ** the *****, **** ** ********* *** most ********* ************ *** *********.
  • ********* ******** ********* **** ******/******** -******** ****** *** **** ******** ******** to ******/******** ***** ********* *** *** limit *** ****** ** ******* *********.
  • ********** ******** -***** **** ********* ******* *** * software ***, ********* ***** ** ** extra ******** ********* **-*******, ******** ** camera-to-cloud *********, ***** *** ******** **** and *************.

Integration ****** - *** / *** / *****

***** **** ******** ************* **** *********** with *** *******, ***** **** *********** is **** ******* ** ***************. *** example, ** ******** ************ *** *** they ********* **** * *** *** that *** **** ******* ********** ** video **** *** ***, *** ******** integrating ******** *********** ** ******.

*****, ********** ***** ******** ************* **** effectively ******* *** *** ** * client ********** - *** ******** / VMS *** ******* ***** ******* *** the **********'* *** ****** ********* ** monitor ******** ****** *** *******. **** is ********* *********** ** ** ****** operators ** **** ** *** *** switch ******* ******** ******* ****** **** a ****** *** **** *** ******** information.

********* ******** *** *********** ** ******** specific ** *** ******** ******. *** example, ** *** ******** *********** * person's ***, ****** ** *** **** of ******* (*.*., ***, *****, *******), the *** / ******** **** **** to ** **** ** ****** **** information ** * ****-******* *** ****** programmatic *********. ** ***, *** *** / ******** **** *** ** **** to ******* *** ******** *********** *** may **** **** * ******* ***** event.

***** ******** * ********* *** ********* integration, ************ ******* *********** *. ******* * ******** ****** *********, but ********* *********** ** ********, *** required. *******, ***** ******* * ******** analytics ***********, ****** ************ **** *********** *********** ** **** metadata *** ******** ********* **** *** cameras ** ********** ** *** ***, and ** *******' ********* ** ******** settings **** ************ **** *** *** (Profile * *********** ********).

VMS ********* ******

*******, ***/*** **** ********** *** ***** not ******** ** ******** ******* ********* types ** ********* ********** *** ******. This ***** **** ******** ***** *** not ******* ** *** ***, ****** they *** "***** **" ** *** camera:

IPVM Image

************, *** ****** ***, * *** search ********* ***** ** ******* **** different ******** ******** *****, ***** ******** providers *** ****** ** ****** *********.

******* * *** ** *** *** support *** ***** ***** ******** ******** (e.g. ****, *****, ******* **** ******), this *** ****** ** ****** * second ********* *** ********* *******, * significant ************ ******** ** ******-****** *******.

Comments (7)

Well done, very topical.

Agree: 1
Disagree
Informative
Unhelpful
Funny

Can you please share an example of Analytics in the cloud via bridge?

Agree
Disagree
Informative
Unhelpful
Funny

While this is not a common architecture, a few examples are Arcules, iVideon (using its Cloud Bridge), and Owal.

Agree
Disagree
Informative
Unhelpful
Funny

Thanks Sean

Agree
Disagree
Informative
Unhelpful
Funny

Team IPVM,

This is spot on and a great intro for both end users and service providers to grasp what happens in the back end. Often to many times projects w/video analytics are designed and sold incorrectly out the gate. Understanding the platform of the product you choose is key to making it scalable and successful.

Like many of you that have dabbled in video analytics for a while I have learned while I cut my teeth on analytics the hard way.

Maybe a follow up to this article up could be one about Video Analytics Deployments, the other half of how it works and where the partner often fails making the manufacturers products look inferior. IMO partner delivery failure is the biggest reason the technologies are not as widely adopted as they should be in this day and age.

Mine that video!

Agree: 2
Disagree
Informative
Unhelpful
Funny

I am surprised that the residential market seems under-served by analytics. Among my 100-home sub-development, dog poo is a recurring theme. Dog posture which results in unsavory byproducts is quite distinctive. My own experimentation in this area has been quite, er, fruitful. Where is the residential marketplace innovation, for goodness sake?

LOL!

P.S. Thanks for a really great overview of a rapidly evolving area. This is an area that even amateurs can dabble in and really get decent results, but real integration is more elusive. Thanks again!

Agree
Disagree
Informative: 2
Unhelpful
Funny: 1

It's pretty trivial to build a model to detect a person loitering around walking a dog (which likely implies the dog has paused to defacate).

But you would have to combine that with pose detection - if the human picks up the commode, then no alert; if she doesn't, then send alert.

It then depends on the facility manager's tolerance for false positives on this issue. Pose detection is something that can have a fairly high FP rate.

But the biggest takeaway is that most property managers aren't going to want to pay $X per camera / month on several dozen cameras for what's a fairly minor issue, especially since they'll have to send a human to go and clean it up after the detection anyway.

Agree: 2
Disagree
Informative: 2
Unhelpful
Funny
Login to read this IPVM report.
Why do I need to log in?
IPVM conducts reporting, tutorials and software funded by subscriber's payments enabling us to offer the most independent, accurate and in-depth information.
Loading Related Reports