Intel Neural Compute Stick 2 / Movidius AI Test

By: IPVM Team, Published on Nov 21, 2018

AI is a major trend in video surveillance with manufacturers paying significant attention to Intel's Movidius Myriad chips. Indeed, Avigilon has announced that their next generation AI H5 cameras will use the Myriad X.

But how well do these Myriad X chips perform?

IPVM has done its first testing of the Myriad X chip (via the NCS2) and shares results inside this report.

Intel / Movidius / Network Compute Stick Overview

Cameras like Avigilon will use Intel / Movidius chips inside them to deep learning / Artificial intelligence. To the side is an image of a Myriad X chip. Video will be sent into to on-board chip, the chip will run deep learning models and it will output categorizations of people, objects, faces, etc.

Just a week ago, Intel announced its second generation of 'Neural Compute Sticks' (NCS). While the first NCS had the original / older Movidius Myriad 2 chip, this new one has the newer Myriad X inside, which Intel claims "delivers 10X the performance compared to previous generations".

IPVM bought the NCS2 and tested it.

Areas Analyzed

Inside this report, we share results across:

  • Face detection using Intel's face-detection-retail-0004 model
  • Testing across Intel i7, Myriad 2 and Myriad X
  • FPS, CPU and RAM consumption variances across devices
  • Accuracy comparison of detection
  • YOLO support and issues

** ** * ***** trend ** ***** ************ with ************* ****** *********** attention *******'* ******** ****** *****. ******,******** *** ********* **** their **** ********** ** H5 *********** *** *** ****** X.

*** *** **** ** these ****** * ***** perform?

**** *** **** *** first ******* ** *** Myriad * **** (*** the ****) *** ****** results ****** **** ******.

Intel / ******** / ******* ******* ***** ********

******* **** ******** **** use ***** / ******** chips ****** **** ** deep ******** / ********** intelligence. ** *** **** is ** ***** ** a ****** * ****. Video **** ** **** into ** **-***** ****, the **** **** *** deep ******** ****** *** it **** ****** *************** of ******, *******, *****, etc.

**** * **** ***,***** ************ ****** ********** ** '****** ******* ******' (***). ***** *** first *** *** *** original / ***** ******** Myriad * ****, **** new *** *** *** newer****** *******, ***** ***** ****** "delivers *** *** *********** compared ** ******** ***********".

**** ****** *** **** and ****** **.

Areas ********

****** **** ******, ** share ******* ******:

  • **** ********* ***** *****'* face-detection-retail-0004 *****
  • ******* ****** ***** **, Myriad * *** ****** X
  • ***, *** *** *** consumption ********* ****** *******
  • ******** ********** ** *********
  • **** ******* *** ******

[***************]

Key ********

*** *** ******** **** our ******* ***:

  • Myriad * ~= *.** ****** * ***: The NCS2 ran roughly 2.7x frames-per-second more than the NCS1 in their face detection model we tested. Intel says that different optimizations and measurement changes would increase this significantly (discussed in caveats below).
  • Faster **** *** (**): The NCS2 / Myriad X outperformed the i7-7700K (a top-of-the-line in 2017) chip tested here, a significant advance given the Myriad X being significantly lower cost and lower power consumption.
  • Little/no ******** ****: Our tests noted no differences in output video accuracy in line's feedback that OpenVINO's model-optimization step should be considered "lossless." They pointed out that allowing lossy model compression (when converting a model to be run on Myriad; eg FP32->FP16 data-type downsizing) would cause issues with vendors training a model with certain expectations, and having a different (lossy) model for inferring.
  • Model ************* ** ******: While Intel has mentioned YOLO support for OpenVino, the current YOLOv3 is not yet compatible on Myriad chips due to a particular network layer. ***** **************** ***** *** ******* converting ****** ** ** run ** ***, *** YOLOv3 ** *** *** compatible ** ****** ******* due ** * ********** network *****.
    **** ** & **: Intel ******* ***** *** be *** ** ******, our *** ***** *******.
    **********+***: *** ***** ** this ****** **** *******, specifically ***** ****-*********-******-**** (********** light **** * ******-**** detector).
    *********+***: *** ***** *******. We **** ******* ****** models **** ****** ** Intel's *** ******.

*** ****** ***** ******** performance *******:

intel performance comparison2

Caveat ** *** / *****

***********, *****'* *** ******* are **** ****** **** our ***, *** **** reasons. **, *****'* ****-*********-******-**** model ******* *** *** on ***, **.* ** Myriad2 (**** ***** ******** comparable ******* ******* ** will ******).

* *** ****** ** our ***** ***** ******* out: (*) ** *** Python, **** ******* **** their *++ ****; (*) our ***-******* ******** ******* code (** ****** *******/******* frames), *** ********* ***** code; (*) ** *** not ***** ******* ************ handling ** ***** ***** loading, ***** ** ***** into ********.

Video **********

***** ** * ***** screencast **** ******* *** testing:

Questions / ******** / **** ** **** ****?

** **** ******* ******* of *** **** / Myriad * ***** **** other ********* *** **** more ****** **** *** next *** *****. **** would *** **** ** see ******?

Comments (12)

Undisclosed Manufacturer #1

11/21/18 02:30pm

*'* **** ** ********** **** **** ** * *** ****. Do *** "****" **** ***** **** * ******** *** *** a ******* *** *** ****** ** ***** *********** *******? *** these ******** **** ****** ** ******** *** *********?

Avatar

Tyler Renelle

In reply to Undisclosed Manufacturer #1 | 11/21/18 04:26pm

*** **** ****** ** **** * *** **** **** *** other *** ******. ** * **********, ***** ****** ******* ****** aren't ****** *** ********** ************, *** *** **********/******* **** ****** network / ******* ** *** ****** **** (** *** *** it ********, ****** *** **********, ***). ***'** ** ***** ** integrated ****** **** ** *** **** *****.

**** **** ** *** *** **** ** *** **** ***** (I'll *** ***** ******* ** ****-****** ******* ** **), *** it's **** **** **** *** ***. ***'** ** ****** ****** cloning ********'* *** ****** *++ *****. *** *** **** ***** (after *** ******* ********) ** ~/*****/*******************/****************/****************/*******. ** ** "*** **** open ****** / ********", ** ******** ***** ** "***" - they **** ** *** *** *******. *** ***'** **** ** read *** ******** ******* (**** ** *******) ** ~/*****/*******************/*********.

Undisclosed #2

11/21/18 04:40pm

**** ****** *** ****...

******* ********, *** ** ******* $ ** $$ ** $$$?

Avatar

Tyler Renelle

In reply to Undisclosed #2 | 11/21/18 04:46pm

**** *** $***. ********** **********, *** ****'** *** ****-***** *********

Michael Miller

In reply to Tyler Renelle | 11/21/18 04:54pm

****** **** **** **** **** **-*****. * ******* *** * days *** *** ** ** ******** ******.

Undisclosed Integrator #3

11/21/18 07:07pm

**** ******** - **** ***% *** *********** ** *** **-***** mean **** **** ********* *** ***** *** ***** **** **** of ** ** ** ** ******** ******* **** ***** ******?

****, *** *** *** *** **** *** ****** *******? ** there * *********** ****** ** ******* ** *** *****? **** wondering **** *** ****** **** ** ** *** ******* *******/****.

Avatar

Tyler Renelle

In reply to Undisclosed Integrator #3 | 11/21/18 08:02pm

*** **** * ** ***, *** *'* ************* ******. * think **'* ** *** ******, ** ********* ***% **** *********** of * **** *** ** **'* * ***** (** ********** aggregate ****** ****). ** ************ *'* ******** ** **** *.**/* cores *****.

* ***** *** ***** *** *** **** **, ** ********** heat. *'** *** ** ***** ** * ****** *** ** gauging. **** ***** ** * * *** *****, *********** ******* of ****** * **** (** ***** ****** **** *****) ******** to **** ****** ****.

Undisclosed #2

In reply to Tyler Renelle | 11/22/18 12:40am

* ***** **'* ** *** ******, ** ********* ***% **** utilization ** * **** *** ** **'* * ***** (** comparable ********* ****** ****).

** **** ** ****** *** ****, * ***** ******* **** the ****** **** ** ** ********** ****** ********, *.*. ***%=**%.

****** **** ******** *** ***%, ***** *** * *** ** cores? ** ** **** ***** ******** **** **** *?

Undisclosed Integrator #3

In reply to Tyler Renelle | 11/22/18 12:56pm

* *** **** ******* ******* ** *** ******* *******. ***** it ** ***** *** ***** *** ********* *** ***(******* ****** Power). **’* **** *** **** *** ****. * ** *** certain *** ** ******** ** *** *** ** * ******** chip **** ** ******* ** ** ******* *** ******** ***** to ******* **** **** ** **** ** ********... ** *** not **** ****. * *****’* **** **** **** ** **** wattage ** ******* **** ** **** ****** *****. **** ** how ****** * ******** ** ***** ****** **********:

****** * - *.* **** ***

**-***** - ** **** ***

**** ********* - *-** **** ***

****** ***** - ** ** *** **** *** is **** ** ** *** *** **** ******** **** *** server **** ********** ****** ********* *********

* *****’* **** **** ** **** *** *******/******* **** *** mobile ********** **** ********** ** *****. ***** ***** ** ******* everything **** ***. * ******* **** *** *** * **** but ******** **** ******* ***** ** ******* ***********.

John Honovich

IPVM | 11/22/18 12:17am

***, ** *** ***** ** ** *** / ************ ******** on ** / **** ******** ** *** **** ****** ** well.

** *** **** ******* ** ** ********* ***, ********** **, some *** *** **** **** ***** / ******** ********* ****. Upcoming ********* **** ******* ****.

Avatar

Fabian Muyawa

LONTECH SYSTEMS | IPVMU Certified | 11/26/18 08:33am

****** ************ ******** **** **** ** ********** *** ******* ******.

Undisclosed Manufacturer #4

11/27/18 12:02am

* ****** * **** ** ***** ** **** **** **** mouser ** *** ****** ****** ************ *** *** **** ** play **** **** **** *** *******. ** ******* * *** openVino **** *** ***** *** *** ** **** *** ********* the ***** ** ***(*** ******). ******* ** ********** ** *** it ****** *** *** ** **** ** ******.

(** *** ** * *** ****, *** "***" ****** ** only *** ***** ***'* *** ******, ***.)

* ** ************* ** *++, **** ******* *******, *** *** samples **** ****** ****.

* **** **** ******** *** ******* *** ******* **** ** the ******* **** ** *** **** *********** ** ****. ** is **** ** ********** *** *** *** ****** **** **** other *** *** ****** **** *** ** ***********. *** *** license ***** ***** *** ****** ** ********* **** ** *** into *** ******* ***** ********* ***** ** *** **** *** license ***** ***********. **** **** * *********** ******* ********* *** recognition.

** ***, ****** ************ **** ***********, *** ** ** ****** early ** **** ***** ***.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...
Startup Vaion Launching End-to-End AI Solution Backed with $20 Million Funding on Jun 17, 2019
An EU / USA video surveillance startup, Vaion, founded by ex-Cisco Senior Directors is launching an end-to-end VSaaS platform with $20 million in...
Sighthound Transforms Into Enterprise AI Provider Profile on Jun 14, 2019
Sighthound is now rapidly expanding its R&D team, building an enterprise AI service. This may come as a surprise given their origins 6 years...
Embattled $400 Million China Funded Philippines Surveillance System Proceeds on Jun 13, 2019
An embattled 12,000 camera surveillance system project that will cost ~$400 million will proceed.  The project contract was awarded, had its...
Carnegie Mellon AI Startup Zensors Profile on Jun 11, 2019
Zensors is a startup formed by Carnegie Mellon graduates from a Carnegie Mellon research project, offering customized models per camera that they...
Directory of 30+ VSaaS / Cloud Video Surveillance Providers on Jun 07, 2019
This directory provides a list of VSaaS / cloud video surveillance providers to help you see and research what options are available. 2019 State...
Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...
Startup Rhombus Systems Says Twice the Features, Half the Price of Verkada on Jun 04, 2019
Closed cloud systems may be the fastest growing segment of video surveillance with Meraki and Verkada. Now another California company is joining...
OWAL Startup Profile - Ex-Googler Cloud AI Video Platform on May 29, 2019
OWAL, a NYC-based startup developing AI video analytics, is aiming to "improve the quality of life" within high-rise apartments, and commercial...
Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...

Most Recent Industry Reports

Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...
Genetec Synergis Cloud Link - Complex, Costly and Confusing on Jun 18, 2019
Genetec's Synergis Cloud Link is complex, costly and confusing compared to competitor access control architectures. Inside this note, we examine...
Startup Vaion Launching End-to-End AI Solution Backed with $20 Million Funding on Jun 17, 2019
An EU / USA video surveillance startup, Vaion, founded by ex-Cisco Senior Directors is launching an end-to-end VSaaS platform with $20 million in...
Biometrics Usage Statistics 2019 on Jun 17, 2019
While face and fingerprint recognition are used regularly for smartphones, it is not as common in physical security. In this note, we examine...
The Scheme Hikvision and China Importers Use To Avoid Tariffs on Jun 17, 2019
Hikvision and numerous China importers are avoiding 25% tariffs by including an SD card slot in their IP cameras to claim they are 'digital still...
Sighthound Transforms Into Enterprise AI Provider Profile on Jun 14, 2019
Sighthound is now rapidly expanding its R&D team, building an enterprise AI service. This may come as a surprise given their origins 6 years...
ADT Eliminating Acquired Brands, Unifying Under 'Commercial' Brand on Jun 14, 2019
ADT is eliminating the brands of the many integrators it has acquired over the past few years, including Red Hawk, Aronson Security Group (ASG),...
NSA Director Keynoting Dahua and Hikvision Sponsored Cybersecurity Conference [Canceled] on Jun 13, 2019
The technical director for the NSA’s Cybersecurity Threat Operations Center will be keynoting a physical security cybersecurity conference that is...
Farpointe Data Conekt Mobile Access Reader Tested on Jun 13, 2019
California based Farpointe Data has been a significant OEM supplier of conventional access readers for years to companies including DMP, RS2, DSX,...
Embattled $400 Million China Funded Philippines Surveillance System Proceeds on Jun 13, 2019
An embattled 12,000 camera surveillance system project that will cost ~$400 million will proceed.  The project contract was awarded, had its...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact