Hikvision Partners With Intel Movidius For Artificial intelligence Cameras

By: IPVM Team, Published on Oct 25, 2016

The world's largest camera manufacturer is partnering with the worlds largest semiconductor company to create a series of intelligent cameras.

Hikvision is partnering with chipmaker Movidius (soon to be acquired by Intel) to add Deep Neural Network (learning) video analytics to their cameras.

For background, see Intel Movidius IPVM overview, especially if you have not heard of Movidius before. Inside this post, we share feedback from Movidius and analyze the potential impact against incumbents including Axis and Avigilon.

*** *****'* ******* ****** manufacturer ** ********** **** the ****** ******* ************* company ** ****** * series ** *********** *******.

********* ** ********** **** chipmaker ******** (**** ** be ******** ** *****) to *** **** ****** Network (********) ***** ********* to ***** *******.

*** **********, *** ***** ******** **** ********, ********** ** *** have *** ***** ** Movidius ******. ****** **** post, ** ***** ******** from ******** *** ******* the ********* ****** ******* incumbents ********* **** *** Avigilon.

[***************]

Hikvision ******** **** ****

********* **** ** ***** Movidius' ****** * ****** ********** Unit. *** ****** * VPU ** * ****** on **** (***) ******, which ******* **** ****** chips ** **** ** integrates **** ********, ********* that ****** *** **** available ** ********** ** cameras.

'Deep ********' ** *********** ***** *********

*********, **** **** *************, has ******* **** **** of ***** ********* *** years. ***** *** *********** 'rule *****' ********* *** performance *** **** *******, especially ** ********* ******* environments *** ***** ******** is ******** (*.*. *** ********* ***** ********* ******).

'**** ********' ****** ** radically ******** *** ******** / *********** ** ***** analytics ** ******** ** individual ************ ******* ** relying ** ***-*** **********.

Advanced ******** / ****** ** *******

****** '******' *********, ******** also **** ** ******* 3D ******* **** ******** imagers ******** ******** ************, as **** ****:

****** ** **** ****** Networks *** ****** ** sensing, ********* *** **** able ** ******* ** to **% ******** ** their ******** ****** ********* applications. **** ** ***** applications *******: *** ***** classification, ******** *********, ********** baggage *****, *** ******** detection.

** *** ***** ******** show, ********* ************ * models, *** *****-****** ****** shown ** ***** ** the ***** *** ** intelligent ******* ******.

Nvidia ** ********

***** ***, ****** *** been *** ******* **** in '**** ********' *** video ************ ********* *** Hikvision *** **** * key ******* (***: ********* ****** ************** ***********). ********* *** **** deploying ****** / *********** based ********* **** ******. While ****** ******* **** edge ***** ********* (***** Tegra *****), ***** **** and ********** **** **** make **** ***********.

******** ** ****** ** bring ******* **** ******** but ** * **** and ***** ***** **** is **** ******** *** edge / ****** ***** analytics. **** ** ************ using *** ********' ****** * ****** ********** Unit. ******** ****** **** their ***** / ******** will ** * ******** of *** ***** *** power *********** ** ******.

****** ******** ** ******* about ****.

Hikvision ****** ******

** ********* **** ******* Movidius ***** ***** *******, it ***** **** * significant ****** ******.

***, *** ****** ****** lacks **** ******* ***** analytic ******* **** ******* developments ** ********* *** years (*.*.,******** / ******* ********* remains ********** ************* *** ** *** ****** challengers). ** ********* *** release ****** ******* *********, this ***** ******* ****** needed *** ******* ********** since ******** *** ***** more ** **** ***** camera's ********* ** ** used ** ***** *** VMS.

***, ********* *** **** extremely **** ** *** low ** *** ***** of *** ****** *** is ***** ****** ** expand **** *** ****-***. If **** *** ******* high ******* *********, **** could ** ** ********* differentiator ** *** **** demanding / ******* ******** customers ** *** ***** products.

*****, ** ********* *** succeed **** ****, ** *********** their *********** *********** ******* both ******** *** ****, who *** **** *********** analytics ** **** **** of ***** ****** ******** (e.g., ********'* ******** ***** approach *** **** ****** 2 ***** ********* ********* this **** -*********************).

** ** *** ***** when ********* **** ******* such *******, *** ** believe **** **** * higher ****** ** ***** adoption than *** ****** ******-***** analytics (******** ********* ***********) given *** ******* ********* of ****** ********* **** specific ******* ** ****** rather **** ****** *** deploying ********* ****** ***** analytics.

Comments (5)

Is Hikvision just quicker to adapt to change than Axis/Avigilon or are they just more public with their announcements of products a year in advance of availability?

Movidius is now announcing releases with Dahua and Uniview too:

What happened to Dahua?

No mention of Dahua now, no press release, google link broken...

Has anybody seen the chip working.
The adoption of the chip does sound promising and I really would like to hear first hand what it can and cannot do.

Other than the videos shown on Movidius website that is....

'Deep Learning' claims to radically increase the accuracy / performance of video analytics by adapting to individual environments instead of relying of pre-set heuristics.

Deep learning approaches use a lot of training data from somewhere to train detectors of important features in that data. Important means (for example) something that indicates presence of a person (or whatever is of interest). This process of training feature detectors replaces the previous technology in which feature detectors were hand crafted (an illustrative but not necessarily accurate example might be a detector to find beards as a possible component of faces). It turns out that for given training and test input (such as might occur in a competition such as ImageNet) the learned feature detectors are much better than hand crafted detectors are for given input. On the other hand the extent to which learned detectors generalise to input different to that typified by the training input is limited and may be inferior to that of the hand crafted detectors.

Historically most success with deep learning has involved supervised approaches (this is changing, however). In supervised approaches humans teach the DL system, for example by providing the correct (ground truth) results corresponding to the training input. This forces the DL system to learn to generate these correct results (basically it keeps trying and improving until it gets there).

To use supervised learning in the scenario described would be quite problematic as quite a lot of supervision is required. For example a human would need to provide the DL system with several hundred (at least) examples of the thing to be detected and a similar number of examples in which that thing was definitely absent. And in the scenario described this would have to be done separately for each and every camera (in its individual environment)

So, people are interested in unsupervised learning where no such input is required (at least not up front). One of the simplest unsupervised DL systems is the (variational) auto-encoder. An auto-encoder is a network that reconstructs its input (so given a 2 megapixel input image it should produce a 2 megapixel output image that is similar to the input . This sounds trivial: why not just copy the input pixels? the trick is that the network send all data through an intermediate layer (and in deep networks many intermediate layers) that have far fewer elements than the input and output layers (e.g. 50,000 instead of 2,000,000). So the auto-encoder has been "handicapped" forcing it to learn something other than a trivial copy of input to output. In particular to do well the intermediate layers need to learn a representation of the input that has far fewer dimensions (equivalent to pixels) and is thus forced to learn the important or distinctive aspects of that input. Notice that this process could run for each camera without supervision, and each camera could thus learn an internal representation specialized to the scene it observes (a so called generative model of that data). So each camera has (in a sense) an understanding of its individual environment encapsulated in this internal representation. Of course the next problem is to relate that internal representation to something the camera's owner cares about (e.g. person crossing the line) and it may be that at this point human intervention is again required (but perhaps at a lower volume than was required for the supervised approach). Think of a small child pointing to things and asking his or her parent "is that a dog?"; generative models can generate output that is characteristic of the model so a trained generative model could produce some number of (different) representative outputs and ask a human operator which of them are of interest...

Now all of this (deep learning) involves a training phase (supervised or unsupervised plus a few other options like reinforcement learning) during which the learning occurs and a later "test" phase during which input is presented and the (now trained) model generates a response (sound the alarum!). The training phase with deep learning is extremely intensive in its use of hardware, typically needing one or more powerful GPUs with multiple gigabytes of memory and quite possibly running for many days or even weeks (this is because the models are "deep" with many layers and may also be "wide"*, and are thus "big" structures). The test phase simply "evaluates" the trained model with new input and is much less intensive (still quite intensive though). I suspect that for the most part the Movideus chip is aimed at test, with learning having occurred elsewhere (e.g. in a data center with lots of GPUs) and this rather complicates the deployment model if one truly wants approaches adapted to each camera's individual environment...

* Not yet "tall", but that could come too...

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

Rhombus Cameras, VMS and Analytics Tested on Nov 06, 2019
Rhombus boasts they have created "the new standard in Enterprise, cloud-managed video security" and told IPVM in January 2019 they offer twice the...
90+ Companies Profile Directory on Nov 06, 2019
While IPVM covers the largest companies in the industry regularly (like Axis, Dahua, Hikvision, etc.), IPVM strives to do a profile post on each...
nFlux AI Startup Profile on Oct 28, 2019
nFlux, an Amazon, Google, and Microsoft funded AI startup told IPVM their mission is to build the most intelligent video analytics platform in the...
RealNetworks SAFR Facial Recognition Profile on Sep 25, 2019
RealNetworks entered the surveillance market by giving away their analytics to schools for free, and is now targeting large commercial users with...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Directory of 70 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
Scylla AI Video Analytics Company Profile on Aug 29, 2019
Scylla, an AI analytics startup, says they are targeting 1 Billion dollar valuation in 5 years and it "is not rocket science" to detect weapons and...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...

Most Recent Industry Reports

Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
Glass Doors and Access Control Tutorial on Nov 21, 2019
One of the biggest access challenges are locking and securing glass doors. Unlike wood or steel doors that can be modified to work with...
Avigilon H4 Intercom Tested on Nov 20, 2019
Avigilon is well-known for video surveillance and access, but how well does the company's intercom work? We purchased and tested Avigilon's H4...
The Cowardly, Greedy "Leaders" of Video Surveillance - SIA on Nov 19, 2019
The video surveillance industry suffers from cowardly, greedy 'leaders' focused on maximizing easy money while undermining public trust. The...
Hikvision Dual Lens Face Recognition Camera Tested on Nov 19, 2019
Hikvision's Dual Lens Facial Recognition camera, claims that it "adopts advanced deep learning algorithm and powerful GPU to realize instant face...
Top Manufacturers Gaining and Losing 2019 on Nov 18, 2019
2019 has been an explosive year for video surveillance, with the world's two largest manufacturers, Dahua and Hikvision, being sanctioned for human...
Hidden Camera Detectors Tested on Nov 18, 2019
Hidden cameras are a growing problem as cameras become smaller, cheaper and easier to access. However, some companies claim to be able to detect...
Wyze Fires Back at JCI - Your Patents Are Invalid, Pay All Of Our Costs on Nov 18, 2019
Goliath JCI targeted startup Wyze this summer alleging the fast-growing consumer startup was violating a slew of JCI's patents. Now, Wyze has...
ADT Stock Surges - "Leading The Commercial Space" on Nov 15, 2019
Don't call it comeback... but maybe call it a commercial provider. ADT, whose stock dropped by as much as 2/3rds since IPOing in 2018, has now...