Hikvision Partners With Intel Movidius For Artificial intelligence Cameras

By IPVM Team, Published on Oct 25, 2016

The world's largest camera manufacturer is partnering with the worlds largest semiconductor company to create a series of intelligent cameras.

Hikvision is partnering with chipmaker Movidius (soon to be acquired by Intel) to add Deep Neural Network (learning) video analytics to their cameras.

For background, see Intel Movidius IPVM overview, especially if you have not heard of Movidius before. Inside this post, we share feedback from Movidius and analyze the potential impact against incumbents including Axis and Avigilon.

Hikvision ******** **** ****

********* **** ** ***** Movidius' ****** * ****** ********** Unit. *** ****** * VPU ** * ****** on **** (***) ******, which ******* **** ****** chips ** **** ** integrates **** ********, ********* that ****** *** **** available ** ********** ** cameras.

'Deep ********' ** *********** ***** *********

*********, **** **** *************, has ******* **** **** of ***** ********* *** years. ***** *** *********** 'rule *****' ********* *** performance *** **** *******, especially ** ********* ******* environments *** ***** ******** is ******** (*.*. *** ********* ***** ********* ******).

'**** ********' ****** ** radically ******** *** ******** / *********** ** ***** analytics ** ******** ** individual ************ ******* ** relying ** ***-*** **********.

Advanced ******** / ****** ** *******

****** '******' *********, ******** also **** ** ******* 3D ******* **** ******** imagers ******** ******** ************, as **** ****:

****** ** **** ****** Networks *** ****** ** sensing, ********* *** **** able ** ******* ** to **% ******** ** their ******** ****** ********* applications. **** ** ***** applications *******: *** ***** classification, ******** *********, ********** baggage *****, *** ******** detection.

** *** ***** ******** show, ********* ************ * models, *** *****-****** ****** shown ** ***** ** the ***** *** ** intelligent ******* ******.

Nvidia ** ********

***** ***, ****** *** been *** ******* **** in '**** ********' *** video ************ ********* *** Hikvision *** **** * key ******* (***: ********* ****** ************** ***********). ********* *** **** deploying ****** / *********** based ********* **** ******. While ****** ******* **** edge ***** ********* (***** Tegra *****), ***** **** and ********** **** **** make **** ***********.

******** ** ****** ** bring ******* **** ******** but ** * **** and ***** ***** **** is **** ******** *** edge / ****** ***** analytics. **** ** ************ using *** ********' ****** * ****** ********** Unit. ******** ****** **** their ***** / ******** will ** * ******** of *** ***** *** power *********** ** ******.

****** ******** ** ******* about ****.

Hikvision ****** ******

** ********* **** ******* Movidius ***** ***** *******, it ***** **** * significant ****** ******.

***, *** ****** ****** lacks **** ******* ***** analytic ******* **** ******* developments ** ********* *** years (*.*.,******** / ******* ********* remains ********** ************* *** ** *** ****** challengers). ** ********* *** release ****** ******* *********, this ***** ******* ****** needed *** ******* ********** since ******** *** ***** more ** **** ***** camera's ********* ** ** used ** ***** *** VMS.

***, ********* *** **** extremely **** ** *** low ** *** ***** of *** ****** *** is ***** ****** ** expand **** *** ****-***. If **** *** ******* high ******* *********, **** could ** ** ********* differentiator ** *** **** demanding / ******* ******** customers ** *** ***** products.

*****, ** ********* *** succeed **** ****, ** *********** their *********** *********** ******* both ******** *** ****, who *** **** *********** analytics ** **** **** of ***** ****** ******** (e.g., ********'* ******** ***** approach *** **** ****** 2 ***** ********* ********* this **** -*********************).

** ** *** ***** when ********* **** ******* such *******, *** ** believe **** **** * higher ****** ** ***** adoption than *** ****** ******-***** analytics (******** ********* ***********) given *** ******* ********* of ****** ********* **** specific ******* ** ****** rather **** ****** *** deploying ********* ****** ***** analytics.

Comments (5)

Is Hikvision just quicker to adapt to change than Axis/Avigilon or are they just more public with their announcements of products a year in advance of availability?

Movidius is now announcing releases with Dahua and Uniview too:

What happened to Dahua?

No mention of Dahua now, no press release, google link broken...

Has anybody seen the chip working.
The adoption of the chip does sound promising and I really would like to hear first hand what it can and cannot do.

Other than the videos shown on Movidius website that is....

'Deep Learning' claims to radically increase the accuracy / performance of video analytics by adapting to individual environments instead of relying of pre-set heuristics.

Deep learning approaches use a lot of training data from somewhere to train detectors of important features in that data. Important means (for example) something that indicates presence of a person (or whatever is of interest). This process of training feature detectors replaces the previous technology in which feature detectors were hand crafted (an illustrative but not necessarily accurate example might be a detector to find beards as a possible component of faces). It turns out that for given training and test input (such as might occur in a competition such as ImageNet) the learned feature detectors are much better than hand crafted detectors are for given input. On the other hand the extent to which learned detectors generalise to input different to that typified by the training input is limited and may be inferior to that of the hand crafted detectors.

Historically most success with deep learning has involved supervised approaches (this is changing, however). In supervised approaches humans teach the DL system, for example by providing the correct (ground truth) results corresponding to the training input. This forces the DL system to learn to generate these correct results (basically it keeps trying and improving until it gets there).

To use supervised learning in the scenario described would be quite problematic as quite a lot of supervision is required. For example a human would need to provide the DL system with several hundred (at least) examples of the thing to be detected and a similar number of examples in which that thing was definitely absent. And in the scenario described this would have to be done separately for each and every camera (in its individual environment)

So, people are interested in unsupervised learning where no such input is required (at least not up front). One of the simplest unsupervised DL systems is the (variational) auto-encoder. An auto-encoder is a network that reconstructs its input (so given a 2 megapixel input image it should produce a 2 megapixel output image that is similar to the input . This sounds trivial: why not just copy the input pixels? the trick is that the network send all data through an intermediate layer (and in deep networks many intermediate layers) that have far fewer elements than the input and output layers (e.g. 50,000 instead of 2,000,000). So the auto-encoder has been "handicapped" forcing it to learn something other than a trivial copy of input to output. In particular to do well the intermediate layers need to learn a representation of the input that has far fewer dimensions (equivalent to pixels) and is thus forced to learn the important or distinctive aspects of that input. Notice that this process could run for each camera without supervision, and each camera could thus learn an internal representation specialized to the scene it observes (a so called generative model of that data). So each camera has (in a sense) an understanding of its individual environment encapsulated in this internal representation. Of course the next problem is to relate that internal representation to something the camera's owner cares about (e.g. person crossing the line) and it may be that at this point human intervention is again required (but perhaps at a lower volume than was required for the supervised approach). Think of a small child pointing to things and asking his or her parent "is that a dog?"; generative models can generate output that is characteristic of the model so a trained generative model could produce some number of (different) representative outputs and ask a human operator which of them are of interest...

Now all of this (deep learning) involves a training phase (supervised or unsupervised plus a few other options like reinforcement learning) during which the learning occurs and a later "test" phase during which input is presented and the (now trained) model generates a response (sound the alarum!). The training phase with deep learning is extremely intensive in its use of hardware, typically needing one or more powerful GPUs with multiple gigabytes of memory and quite possibly running for many days or even weeks (this is because the models are "deep" with many layers and may also be "wide"*, and are thus "big" structures). The test phase simply "evaluates" the trained model with new input and is much less intensive (still quite intensive though). I suspect that for the most part the Movideus chip is aimed at test, with learning having occurred elsewhere (e.g. in a data center with lots of GPUs) and this rather complicates the deployment model if one truly wants approaches adapted to each camera's individual environment...

* Not yet "tall", but that could come too...

Read this IPVM report for free.

This article is part of IPVM's 6,604 reports, 890 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Intel Presents Edge-to-Cloud Ecosystem for Video Analytics on Oct 16, 2020
Intel presented its processors and software toolkit for computer vision at...
AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...
Video Analytics Online Show 2020 - 35+ Manufacturer On-Demand Recordings on Sep 04, 2020
This show featured 35+ Video Analytics providers showcasing their latest...
Verkada 2020 Cameras Image Quality Test on Oct 06, 2020
Verkada's first-generation cameras suffered from numerous video quality...
Augmented Reality (AR) Cameras From Hikvision and Dahua Examined on Oct 19, 2020
Hikvision, Dahua, and other China companies are marketing augmented reality...
Multi-Imagers Added to IPVM Camera Calculator on Jun 15, 2020
IPVM has added multi-imager cameras to the Camera Calculator, supporting this...
Motorola Solutions Acquires Pelco on Aug 03, 2020
Motorola Solutions has acquired Pelco, pledging to bring blue back and make...
Sony Launches AI Camera Sensors on May 18, 2020
Weeks after exiting the branded video surveillance business, Sony is making a...
Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
Ubiquiti Access Control Tested on Oct 21, 2020
Ubiquiti has become one of the most widely used wireless and switch providers...
New Products Show Fall 2020 - 25+ Manufacturers On-Demand Recordings on Sep 30, 2020
This show featured 25+ Manufacturers showcasing their latest new products....
Camera Course Summer 2020 - Last Chance on Jul 18, 2020
This is your last chance to register for the Summer 2020 Camera Course. This...
Camect Presents Residential Market Smart NVR with AI Analytics on Aug 19, 2020
Camect presented its AI video analytics enhanced NVR at the May 2020 IPVM...
Ava / Vaion Releases Cloud Connected IP Cameras, Verkada Competitor on Oct 01, 2020
Ava (formerly Vaion) announced its new direct-to-cloud AVA Aware IP cameras...
Iryx Presents Multi-Spectral AI Camera on Jun 17, 2020
Iryx presented its multi-spectral AI cameras at the May 2020 IPVM Startups...

Recent Reports

Recruiters Online Show LIVE Today! on Oct 29, 2020
IPVM's 7th online show resumes today with 12 recruiters presenting themselves...
Hikvision AcuSense G2 Camera Test on Oct 29, 2020
Hikvision has released their next generation of AcuSense analytic cameras...
Biggest Problems Selling Access Control 2020 on Oct 29, 2020
Access control can cause integrators big headaches. What practical issues do...
Taiwan Geovision AI Analytics and NDAA Examined on Oct 29, 2020
Taiwan manufacturer Geovision's revenue has been falling for years. However,...
Bedside Cough and Sneeze Detector (Sound Intelligence and CLB) on Oct 28, 2020
Coronavirus has increased interest in detecting symptoms such as fever and...
Fever Tablet Thermal Sensors Examined (Melexis) on Oct 28, 2020
Fever tablet suppliers heavily rely on the accuracy and specs of...
Verkada Fires 3 on Oct 28, 2020
Verkada has fired three employees over an incident where female colleagues...
Eagle Eye Networks Raises $40 Million on Oct 27, 2020
Eagle Eye has raised $40 million aiming to "reinvent video...
Hikvision Q3 2020 Global Revenue Rises, US Revenue Falls on Oct 27, 2020
While Hikvision's global revenue rises driven by domestic recovery, its US...
VICE Investigates Verkada's Harassing "RawVerkadawgz" on Oct 26, 2020
This month, IPVM investigated Verkada's sexism, discrimination, and cultural...
Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020
As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...
ISC Brasil Digital Experience 2020 Report on Oct 23, 2020
ISC Brasil 2020 rebranded itself to ISC Digital Experience and, like its...
Top Video Surveillance Service Call Problems 2020 on Oct 23, 2020
3 primary and 4 secondary issues stood out as causing the most problems when...
GDPR Impact On Temperature / Fever Screening Explained on Oct 22, 2020
What impact does GDPR have on temperature screening? Do you risk a GDPR fine...
Security And Safety Things (S&ST) Tested on Oct 22, 2020
S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...