Nvidia For Video Surveillance Examined

By: Brian Karas, Published on Aug 23, 2017

Nvidia is making a big push into the security market, claiming more than 50 partners, investing heavily in industry events, positioning their GPUs as the workhorses of deep learning applications. 

However, Nvidia offers multiple product platforms, including Tesla, Jetson, etc., based on different GPU architectures such as Pascal or Maxwell. It can be difficult to understand how these components are used in video surveillance systems (e.g., what to use in a camera vs server vs the cloud, etc.).

In this report, IPVM reviews Nvidia's products related to surveillance, including where the various Nvidia product lines are most applicable, how they compare to alternative products, and their limitations.

******** **. *********

*** ******* ******** ******* on ***** ** *** ******* tasks *** *** ** ***** used ***:

  1. ******** - ********* * set ** ****** ** learn ************* ** *********** among **** 
  2. ********* - ********* * given ***** (** ******* of ** *****) ** learned **** ** ******** ** object 

******** ** **** ********* *** time-consuming **** ********* ** *** typical ******** ***********, *** will **** ** *** the **** ********** *****. In ******, *** ***** GPU *** ** **** for ****** ********, ****** training ** **** *************** intensive *** * *** developed *** ******** ************ would ****** ** ******** for *********.

Product ******

*** ********* ***** **** ****** ***** how **** *** *********** their ******** *** ************ applications:

**** **** ** *****, the ***** ***** ******** of ********** ******* *****, which **** ***** ** correlate ** ****** ****, higher ***** *****, *** larger *********.

GPU *************

******* ** *** ***** categorizes ********** ** ***** names/families (*.*.: *******, ****, Xeon), ****** *** ***** * similar ********. ****** *** ***** GPU ************* ******** **** (ranked **** ******/**** ******** to ******/***** ********):

***** ******* ********* ***** come ** ******** **** use ********* *** *************. And ***** **** *** generally not **** ** ******** components, *** *** ***** sells ****, *** ******* tend ** **** ** part ** * ****** circuit ******** ** ***** product, ********* ** *** intended *** ****.

Product ********* - **** ******** **** ***** **********

*** ***-***** ******** **** ********** ** video ************ ***:

  • *****- *** **** *** servers
  • ****** - ****-***** *** *** cameras
  • ******* *** - ***-******* ******** *****
  • ******- ****** *********** *** graphics *****
  • ***- **** ***** ******** ******** for ********* **********

**** ****** ** **** of ***** ** ********* below.

Tesla - *******/****

*************** ** ********* *** most ****** ****** *** surveillance *****. ** ** ********* sold as * **** **** to ** ********* ** a ******, ** ** NVRs ******** ** *********** a *** ****, ****** a **** ****** **** interfaces ** ******'* ****** ***, ***** ****** ****** interconnect ********* ** **** available *** *********** ************.

****** *** ** **** *** **** inference *** ********, ********* on *** *****. *** most ****** ****** ********* marketed ** ************ ************ are (****** ********* *** platform, *=*****, *=******):

  • ****- ******* **********, ******* power, ******** ** ******** R&D ************ ********* *******-********* training. ~$**,***+
  • **** - ******** *** ******** use, ~$*,***-$*,***, ********* ** model/interface
  • ***- **** ******* ********/*********. Used ** **** ***** servers, ******* **** ***** do ******* ******** ** well ** *********. ~$*,***
  • **- ********* ************, **** common ** *** ******* or ********** ******** ****-******** applications (*.*.: *********** ******, advanced *********). ~$*,***

***** *** ********* ******* *** ***** ****** *********, ****** ***** *** less ******** **** ** video ************, ************ *** Kepler ****, ***** **** positioned **** ** ******* compute ************ **** ******* learning/deep ********.

*******, ***** ***** ** the **** ****** ****** now, ****** ** *********** the ************* ** **** learning ** ** *******.

Jetson - *********** *******

******** ******'* ****-************ ****, ******** for ******* ******* **-***** deep-learning *********. ***** **** in *** ******, *** TX1 (******* ************) *** the *** (****** ************).

***** *** ****** ****** is ****** ********, ** is ****** ($*** - $500 ***** ********* ** volume), *** ****** ***** (50 ** * ** mm / ~*" * 3.5") ******** ** *** electronics ********* ***** ****** modern ************ *******. ******** seen ** ******'* ***** **** demos ***** *** ****** modules **** ********** ****** than ******* *******. *** cost **** ******* *** entire *** *** **** some **** ******** *******, making ** * **** costly ********* ** ******* in * *****-****** ******.

GTX - ******** *****

*** ******** *********** **** **** graphics *****, *** *** not ******** *** ****-******** use ********, ** ****** **** not **** ***** *** the **** *********** *** environmental ***** ** *** Tesla *****. *******, ***** their ***-**** (********* ***** $500), *** *** **** they *** *** **** GPUs ** **** ** the ***** *****, **** manufacturers *** ***** *** cards ** *******.  

Quadro - ******** ******** *****

****** ***** *** * step ** **** *** cards. **** *** *********** intended *** ******* *********** applications, **** *** ******* market ***** *** ***** like *** ********* ** 3D ********. *******, **** are *** ******** *** more ********* *****, *** have * ****** ******** than *** *** *****, making **** **** ******** for ******* **** *********** closer ** * ***** is ********, *** ***** cost ** ***. ****** cards ********* ***** **** $500-$1,000, *** *** ** higher *** ******** ******.

******** ********** ****** ***** for ***** ********** ****** **********.

DGX - **** ****** / ******** *&*

******-* ***** ** **** *** training **** ******* ******* of ******* **** **** to ** ********. ****** range **** ~$***,***-$***,***, ****** it **** ********** ** organizations ******* ******* ** deep-learning, *** ********** ******** models *** **** ******** than **** ** ********* seen ** *** ******** industry. ** ** *********** an ***** ****-***** ****** with ** ** * Tesla **** *******.

GPU ***** - ***** *********

****** ** **** ********* a *** *****, ***** ********* ******** of ** ****** *** ******* (other **** *** ****** devices) ** * ******, where ********** *** *** applications **** ******* **** GPU ************. **** ******'* EC2 *****, ** ****** server ******* ********, ***** can ******** ****** *** ********* for *****-**** ** ****-**** needs. *** *******, * developer ******** ** *********** designed ** *** ** a ****** ****** ***** use *** ***** *** the ********* ******** *******, and **** **** *** output ** *** ******** done ** *** ***** to *** ** *** Jetson ****** *** *********. Developers ***** **** ***** cloud ********* ********* **** analyze ***** ***** **** cameras *** ****** ********* or ***** ********, ********** the **** *** ********* GPUs ** *** ******, this ** *** ******** that****** ****. 

Rival GPU *******

*** [**** ** ****** available], ******** ********** ** both ****** *** ***** **** has ********* * **** of ***'*, ****** ***** offering ** **** **** limited **** ******'*. *** primarily ****** * ******** of *** ****** ******* [**** no ****** *********] *** **** in * **** **** factor, ****** ** ********* suited *** *********** ********** applications *** ******* ********** to Nvidia ***** *****. *** has **** * ****** competitor ** ****** ** *** desktop ****** *** ***-***** video *****, *** ** have *** **** *** tests **** *** *** two ********* ***-******** ***** against **** ***** *** analytics ************.

*****'* ******** *** ******** *** ****-***** processing ******, ********** ***-***** GPU's *** *** ** smart *******, ******, *** similar *******. *** ******** chips **** ******** ************ for ***** ************, *** contain ***** ************ ***** at ******** *****, ***** the ****** ****** **** ****** is * **** ******* purpose ******. ***** ***** and ***** ******** ********* make *** ******** ***** a ********* ****** ********** to ******.

****** **********

****** **** *** ************ ****** as ** *********** ** sell ***** ******** **** previously ******** ********. *******, ****** is **** **** ** being **** ** ******* high ****** *** ***** products, ***** ** ********* to ** ** ********. When *** ***** ** a ** **** ***** is ******* ***** ** the **** ** *** **** of *** ******** *** the ****** ** ** installed **. *****'* ******* ** the ******** ******** **** relies ** ****-******** ********* finally ****** ******** **** have **** ********* **** over *** *****, ***** the ******* *** ****** direct ******* ****. 

Comments (8)

Great article and very technical as always.  I was not even aware of the DGX. Do you feel there is a future in deep learning for surveillance or is mostly hype at this point?  How far out do you think it is before something truly useful is available? 

First, I do think there are "truly useful" products already available. Avigilon's Appearance Search, Platesmart's LPR, Umbo's consumer camera, etc. None of these have been massive disruptors in the industry, but they are all "useful" for their target applications.

Second, the best applications are likely still to come, in the form of very low cost/main stream products, or capabilities that we have not yet seen. Deep learning itself should help to solve many of the object classification problems (sorting out interesting stuff in the image from the non-interesting). Because deep learning is gaining popularity in so many other industries and applications security/surveillance products are able to ride that development wave and benefit from it, but it is still somewhat of a trickle-down effect.

Behind the scenes there are also companies working on tagging datasets (e.g: this is a picture of a car, this is a picture of a circus bear, this is a picture of a cactus), and selling those datasets to other companies for commercial applications. Couple this with the general "Moore's Law" kind of advancements in GPUs, and we could start to see GPU's that come pre-trained for common surveillance applications. Making it possible for companies with very little analytics-dedicated R&D people to roll out products that rival anything currently available for a fraction of the cost. Much like how today you can manufacture a camera from a collection of already-developed components that will have very good performance specs.

OpenALPR has been optimized to run entirely on NVIDIA's newer GPUs. We have spent the last few months doing the heavy lifting to eliminate CPU bottlenecks. Our code runs on Ubuntu 16.04  supporting TX1, TX2, Tesla P100, Quadro M620, GTX 1050 and newer NVIDIA GPUs (https://developer.nvidia.com/cuda-gpus).

Surprised no one is mentioning this alongside the Nvidia/HikVision Supercomputing partnership, or HikVision's new "Deep Learning" NVRs.

If HikVision becomes capable of delivering better analytics at scale it could be another game changer for the monitoring side of the security industry.  

---

https://ipvm.com/reports/hikvision-nvidia

https://ipvm.com/reports/hik-deep

Hikvision is using the NVIDIA Tesla P4 in their deep learning NVR, according to Nvidia. Given the price of that part, even with volume discounts, the "at scale" part may be challenging, especially when you consider Hikvision had led primarily on a low-cost approach, and the Tesla P4 adds a significant cost to the unit, relatively speaking.

The Nvidia/Hikvision partnership is less significant overall, the DGX-1 that Hikvision bought can be used to accelerate training for DNN's, but Hikvision still has to do the core software development, feed in the training data, etc. Much like their Cisco "partnership" did not inherently make their devices more secure, the Nvidia partnership does not automatically make their devices smarter, they still need to do the heavy lifting.

I fundamentally agree with you. HikVision would have to do a lot of the heavy lifting before this even gets off the ground. That being said it does seem to put them in a good place for the future. 

Thank you # 2

Does anybody know if Hikvision iVMS software utilizes GPU at all? We're about to buy several agent computers, and I'm wondering if I should pick the discrete graphics card or rely on embedded intel one

Read this IPVM report for free.

This article is part of IPVM's 6,536 reports, 881 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Remote Network Access for Video Surveillance Guide on Jul 27, 2020
Remotely accessing surveillance systems is key in 2020, with more and more...
Quantum Dots Potential for Surveillance Cameras Explained on Sep 08, 2020
Quantum dots are starting to be used in TVs for better images, but how will...
Verkada Access Control Tested on Sep 09, 2020
Verkada raised $80 million earlier in 2020, expanding from video into access...
Verkada Speaks On Disrupting Security Sales Channel on Aug 28, 2020
Verkada's fast growth has taken the industry by storm and their enterprise...
NetApp Presents Hybrid Cloud Video Archive on May 11, 2020
NetApp presented its hybrid S3 cloud video archive at the April 2020 IPVM New...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
Favorite Video Surveillance Hard Drive Manufacturer 2020 on Aug 27, 2020
Western Digital and Seagate effectively have a duopoly in hard drives but...
Video Analytics Online Show 2020 - 35+ Manufacturer On-Demand Recordings on Sep 04, 2020
This show featured 35+ Video Analytics providers showcasing their latest...
Directory of 96 Video Surveillance Startups on May 20, 2020
This directory provides a list of video surveillance startups to help you see...
Milestone Presents XProtect On AWS on May 04, 2020
Milestone presented its XProtect on AWS offering at the April 2020 IPVM New...
GeoVision Presents AI and Facial Recognition on May 22, 2020
GeoVision presented its AI analytics and facial recognition at the April 2020...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
WDR Cheat Sheet and Camera Tracking - 30 Manufacturers on Aug 26, 2020
Manufacturers are regularly cryptic about what WDR support they actually...
Defendry Presents AI Active Shooter Security System on Jul 14, 2020
Defendry presented its Active Shooter security system at the May 2020 IPVM...

Recent Reports

Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
New Products Show Fall 2020 Starts Tomorrow! on Sep 27, 2020
Tomorrow, IPVM's sixth online show will feature New Products from over 25...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...