Hikvision Partners With Intel Movidius For Artificial intelligence Cameras

By: IPVM Team, Published on Oct 25, 2016

The world's largest camera manufacturer is partnering with the worlds largest semiconductor company to create a series of intelligent cameras.

Hikvision is partnering with chipmaker Movidius (soon to be acquired by Intel) to add Deep Neural Network (learning) video analytics to their cameras.

For background, see Intel Movidius IPVM overview, especially if you have not heard of Movidius before. Inside this post, we share feedback from Movidius and analyze the potential impact against incumbents including Axis and Avigilon.

*** *****'* ******* ****** manufacturer ** ********** **** the ****** ******* ************* company ** ****** * series ** *********** *******.

********* ** ********** **** chipmaker ******** (**** ** be ******** ** *****) to *** **** ****** Network (********) ***** ********* to ***** *******.

*** **********, *** ***** ******** **** ********, ********** ** *** have *** ***** ** Movidius ******. ****** **** post, ** ***** ******** from ******** *** ******* the ********* ****** ******* incumbents ********* **** *** Avigilon.

[***************]

Hikvision ******** **** ****

********* **** ** ***** Movidius' ****** * ****** ********** Unit. *** ****** * VPU ** * ****** on **** (***) ******, which ******* **** ****** chips ** **** ** integrates **** ********, ********* that ****** *** **** available ** ********** ** cameras.

'Deep ********' ** *********** ***** *********

*********, **** **** *************, has ******* **** **** of ***** ********* *** years. ***** *** *********** 'rule *****' ********* *** performance *** **** *******, especially ** ********* ******* environments *** ***** ******** is ******** (*.*. *** ********* ***** ********* ******).

'**** ********' ****** ** radically ******** *** ******** / *********** ** ***** analytics ** ******** ** individual ************ ******* ** relying ** ***-*** **********.

Advanced ******** / ****** ** *******

****** '******' *********, ******** also **** ** ******* 3D ******* **** ******** imagers ******** ******** ************, as **** ****:

****** ** **** ****** Networks *** ****** ** sensing, ********* *** **** able ** ******* ** to **% ******** ** their ******** ****** ********* applications. **** ** ***** applications *******: *** ***** classification, ******** *********, ********** baggage *****, *** ******** detection.

** *** ***** ******** show, ********* ************ * models, *** *****-****** ****** shown ** ***** ** the ***** *** ** intelligent ******* ******.

Nvidia ** ********

***** ***, ****** *** been *** ******* **** in '**** ********' *** video ************ ********* *** Hikvision *** **** * key ******* (***: ********* ****** ************** ***********). ********* *** **** deploying ****** / *********** based ********* **** ******. While ****** ******* **** edge ***** ********* (***** Tegra *****), ***** **** and ********** **** **** make **** ***********.

******** ** ****** ** bring ******* **** ******** but ** * **** and ***** ***** **** is **** ******** *** edge / ****** ***** analytics. **** ** ************ using *** ********' ****** * ****** ********** Unit. ******** ****** **** their ***** / ******** will ** * ******** of *** ***** *** power *********** ** ******.

****** ******** ** ******* about ****.

Hikvision ****** ******

** ********* **** ******* Movidius ***** ***** *******, it ***** **** * significant ****** ******.

***, *** ****** ****** lacks **** ******* ***** analytic ******* **** ******* developments ** ********* *** years (*.*.,******** / ******* ********* remains ********** ************* *** ** *** ****** challengers). ** ********* *** release ****** ******* *********, this ***** ******* ****** needed *** ******* ********** since ******** *** ***** more ** **** ***** camera's ********* ** ** used ** ***** *** VMS.

***, ********* *** **** extremely **** ** *** low ** *** ***** of *** ****** *** is ***** ****** ** expand **** *** ****-***. If **** *** ******* high ******* *********, **** could ** ** ********* differentiator ** *** **** demanding / ******* ******** customers ** *** ***** products.

*****, ** ********* *** succeed **** ****, ** *********** their *********** *********** ******* both ******** *** ****, who *** **** *********** analytics ** **** **** of ***** ****** ******** (e.g., ********'* ******** ***** approach *** **** ****** 2 ***** ********* ********* this **** -*********************).

** ** *** ***** when ********* **** ******* such *******, *** ** believe **** **** * higher ****** ** ***** adoption than *** ****** ******-***** analytics (******** ********* ***********) given *** ******* ********* of ****** ********* **** specific ******* ** ****** rather **** ****** *** deploying ********* ****** ***** analytics.

Comments (5)

Is Hikvision just quicker to adapt to change than Axis/Avigilon or are they just more public with their announcements of products a year in advance of availability?

Movidius is now announcing releases with Dahua and Uniview too:

What happened to Dahua?

No mention of Dahua now, no press release, google link broken...

Has anybody seen the chip working.
The adoption of the chip does sound promising and I really would like to hear first hand what it can and cannot do.

Other than the videos shown on Movidius website that is....

'Deep Learning' claims to radically increase the accuracy / performance of video analytics by adapting to individual environments instead of relying of pre-set heuristics.

Deep learning approaches use a lot of training data from somewhere to train detectors of important features in that data. Important means (for example) something that indicates presence of a person (or whatever is of interest). This process of training feature detectors replaces the previous technology in which feature detectors were hand crafted (an illustrative but not necessarily accurate example might be a detector to find beards as a possible component of faces). It turns out that for given training and test input (such as might occur in a competition such as ImageNet) the learned feature detectors are much better than hand crafted detectors are for given input. On the other hand the extent to which learned detectors generalise to input different to that typified by the training input is limited and may be inferior to that of the hand crafted detectors.

Historically most success with deep learning has involved supervised approaches (this is changing, however). In supervised approaches humans teach the DL system, for example by providing the correct (ground truth) results corresponding to the training input. This forces the DL system to learn to generate these correct results (basically it keeps trying and improving until it gets there).

To use supervised learning in the scenario described would be quite problematic as quite a lot of supervision is required. For example a human would need to provide the DL system with several hundred (at least) examples of the thing to be detected and a similar number of examples in which that thing was definitely absent. And in the scenario described this would have to be done separately for each and every camera (in its individual environment)

So, people are interested in unsupervised learning where no such input is required (at least not up front). One of the simplest unsupervised DL systems is the (variational) auto-encoder. An auto-encoder is a network that reconstructs its input (so given a 2 megapixel input image it should produce a 2 megapixel output image that is similar to the input . This sounds trivial: why not just copy the input pixels? the trick is that the network send all data through an intermediate layer (and in deep networks many intermediate layers) that have far fewer elements than the input and output layers (e.g. 50,000 instead of 2,000,000). So the auto-encoder has been "handicapped" forcing it to learn something other than a trivial copy of input to output. In particular to do well the intermediate layers need to learn a representation of the input that has far fewer dimensions (equivalent to pixels) and is thus forced to learn the important or distinctive aspects of that input. Notice that this process could run for each camera without supervision, and each camera could thus learn an internal representation specialized to the scene it observes (a so called generative model of that data). So each camera has (in a sense) an understanding of its individual environment encapsulated in this internal representation. Of course the next problem is to relate that internal representation to something the camera's owner cares about (e.g. person crossing the line) and it may be that at this point human intervention is again required (but perhaps at a lower volume than was required for the supervised approach). Think of a small child pointing to things and asking his or her parent "is that a dog?"; generative models can generate output that is characteristic of the model so a trained generative model could produce some number of (different) representative outputs and ask a human operator which of them are of interest...

Now all of this (deep learning) involves a training phase (supervised or unsupervised plus a few other options like reinforcement learning) during which the learning occurs and a later "test" phase during which input is presented and the (now trained) model generates a response (sound the alarum!). The training phase with deep learning is extremely intensive in its use of hardware, typically needing one or more powerful GPUs with multiple gigabytes of memory and quite possibly running for many days or even weeks (this is because the models are "deep" with many layers and may also be "wide"*, and are thus "big" structures). The test phase simply "evaluates" the trained model with new input and is much less intensive (still quite intensive though). I suspect that for the most part the Movideus chip is aimed at test, with learning having occurred elsewhere (e.g. in a data center with lots of GPUs) and this rather complicates the deployment model if one truly wants approaches adapted to each camera's individual environment...

* Not yet "tall", but that could come too...

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Leica Launches LIDAR / Thermal / IP Camera on Mar 04, 2020
Swiss manufacturer Leica is launching what it calls a "real-time reality capture device" fusing LIDAR, thermal cameras, IP cameras and more. In...
Masks Cause Major Facial Recognition Problems on Feb 24, 2020
Coronavirus is spurring an increase in the use of medical masks, which new IPVM test results show cause major problems for facial recognition...
Apple Acquires XNOR.ai, Loss For The Industry on Jan 16, 2020
Apple has acquired XNOR.ai for $200 million, reports GeekWire. This is a loss for the video surveillance industry. XNOR.ai stunned the industry...
Ipsotek UK Video Analytics Company Profile on Jan 08, 2020
UK-based Ipsotek is one of just a few surviving independent video analytic developers from the 2000s. We covered them back in 2011 when they first...
Directory Of 146 Video Analytics Suppliers on Dec 17, 2019
This directory provides a list of video analytics providers to help you see and research what options are available. Deep Learning / AI...
XNOR.ai Terminates Wyze on Nov 27, 2019
Wyze has shocked the industry again - this time with a major setback. Just months ago, Wyze triumphantly added AI analytics to their ~$20 cameras,...
Startup XNOR.ai, Inventors of YOLO, Video Surveillance Plans Examined on Sep 24, 2019
YOLO is arguably the most discussed and hyped computer vision model today. The inventors of YOLO have a startup named XNOR.ai that aims to bring...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
Calipsa - UK AI Startup Profile on Jul 10, 2019
Analytic startups are a major industry trend. One UK company, Calipsa is aiming to use AI to filter out false positive alarms for live video...
Startup Vaion Launching End-to-End AI Solution Backed with $20 Million Funding on Jun 17, 2019
An EU / USA video surveillance startup, Vaion, founded by ex-Cisco Senior Directors is launching an end-to-end VSaaS platform with $20 million in...

Most Recent Industry Reports

Embedded Logix Thermal Temperature Detection System Examined on Apr 08, 2020
Embedded Logix has been producing thermal temperature measurement systems for industry and fire detection for over 10 years. Now, they are entering...
Micron 1 TB SD Cards Aim To Eliminate NVRs on Apr 08, 2020
Micron has boldly proclaimed their latest 1TB microSD "eliminates the need for network video recorders", targeting the growing market of...
US DoD Declares "Can No Longer Do Business" With Contractors Using Dahua, Hikvision, Huawei on Apr 08, 2020
The US Department of Defense has confirmed to IPVM that they fully support and intend to proceed with the NDAA 'blacklist clause' covering Dahua,...
IPVM's 12th Anniversary - Thank You! on Apr 07, 2020
IPVM is proud to celebrate it's 12 anniversary expanding our commitment to providing the industry independent and objective information on video...
Mobotix Thermal Body Temperature Detection Examined on Apr 07, 2020
Mobotix has jumped into the Coronavirus temperature detection market, but how do they compare to thermal incumbents like FLIR or ICI who have been...
Verkada Coronavirus Response: Free Temp Systems For Government and Health Care on Apr 07, 2020
Verkada has built a reputation on giving away things for free - free Yeti Tumblers, free trial cameras and now free temporary systems for...
Hikvision USA Refuses, Dahua USA Drives Forward With "Coronavirus Cameras" on Apr 07, 2020
Both have been federally banned, both sanctioned for human rights abuses but only one - Dahua - is taking aim at the booming "coronavirus cameras"...
China Surveillance Vulnerabilities Being Used To Attack China, Says China on Apr 07, 2020
While China video surveillance vulnerabilities have been much debated in the West in the past few years, China is now saying those vulnerabilities...
USA ICI Elevated Skin Temperature Detectors Examined on Apr 06, 2020
Infrared Cameras, Inc. (ICI) is aiming to help slow the spread of COVID-19 with "pinpoint accurate skin temperature measurement" using their...
Trade Groups Request NDAA Blacklist Delay Citing Coronavirus on Apr 06, 2020
Two trade groups representing government contractors have asked Congress to delay implementation of the NDAA's 'blacklist' clause from this August...