Intel Neural Compute Stick 2 / Movidius AI Test

Author: IPVM Team, Published on Nov 21, 2018

AI is a major trend in video surveillance with manufacturers paying significant attention to Intel's Movidius Myriad chips. Indeed, Avigilon has announced that their next generation AI H5 cameras will use the Myriad X.

But how well do these Myriad X chips perform?

IPVM has done its first testing of the Myriad X chip (via the NCS2) and shares results inside this report.

Intel / Movidius / Network Compute Stick Overview

Cameras like Avigilon will use Intel / Movidius chips inside them to deep learning / Artificial intelligence. To the side is an image of a Myriad X chip. Video will be sent into to on-board chip, the chip will run deep learning models and it will output categorizations of people, objects, faces, etc.

Just a week ago, Intel announced its second generation of 'Neural Compute Sticks' (NCS). While the first NCS had the original / older Movidius Myriad 2 chip, this new one has the newer Myriad X inside, which Intel claims "delivers 10X the performance compared to previous generations".

IPVM bought the NCS2 and tested it.

Areas Analyzed

Inside this report, we share results across:

  • Face detection using Intel's face-detection-retail-0004 model
  • Testing across Intel i7, Myriad 2 and Myriad X
  • FPS, CPU and RAM consumption variances across devices
  • Accuracy comparison of detection
  • YOLO support and issues

** ** * ***** ***** ** ***** ************ **** ************* paying *********** ********* *******'* ******** ****** *****. ******,******** *** ********* **** ***** **** ********** ** ** *********** *** *** ****** *.

*** *** **** ** ***** ****** * ***** *******?

**** *** **** *** ***** ******* ** *** ****** * chip (*** *** ****) *** ****** ******* ****** **** ******.

Intel / ******** / ******* ******* ***** ********

******* **** ******** **** *** ***** / ******** ***** ****** them ** **** ******** / ********** ************. ** *** **** is ** ***** ** * ****** * ****. ***** **** be **** **** ** **-***** ****, *** **** **** *** deep ******** ****** *** ** **** ****** *************** ** ******, objects, *****, ***.

**** * **** ***,***** ************ ****** ********** ** '****** ******* ******' (***). ***** *** ***** *** *** *** ******** / older ******** ****** * ****, **** *** *** *** *** newer****** *******, ***** ***** ****** "******** *** *** *********** ******** ** previous ***********".

**** ****** *** **** *** ****** **.

Areas ********

****** **** ******, ** ***** ******* ******:

  • **** ********* ***** *****'* ****-*********-******-**** *****
  • ******* ****** ***** **, ****** * *** ****** *
  • ***, *** *** *** *********** ********* ****** *******
  • ******** ********** ** *********
  • **** ******* *** ******

[***************]

Key ********

*** *** ******** **** *** ******* ***:

  • Myriad * ~= *.** ****** * ***: The NCS2 ran roughly 2.7x frames-per-second more than the NCS1 in their face detection model we tested. Intel says that different optimizations and measurement changes would increase this significantly (discussed in caveats below).
  • Faster **** *** (**): The NCS2 / Myriad X outperformed the i7-7700K (a top-of-the-line in 2017) chip tested here, a significant advance given the Myriad X being significantly lower cost and lower power consumption.
  • Little/no ******** ****: Our tests noted no differences in output video accuracy in line's feedback that OpenVINO's model-optimization step should be considered "lossless." They pointed out that allowing lossy model compression (when converting a model to be run on Myriad; eg FP32->FP16 data-type downsizing) would cause issues with vendors training a model with certain expectations, and having a different (lossy) model for inferring.
  • Model ************* ** ******: While Intel has mentioned YOLO support for OpenVino, the current YOLOv3 is not yet compatible on Myriad chips due to a particular network layer. ***** **************** ***** *** ******* ********** ****** ** ** *** ** CPU, *** ****** ** *** *** ********** ** ****** ******* due ** * ********** ******* *****.
    **** ** & **: ***** ******* ***** *** ** *** on ******, *** *** ***** *******.
    **********+***: *** ***** ** **** ****** **** *******, ************ ***** face-detection-retail-0004 (********** ***** **** * ******-**** ********).
    *********+***: *** ***** *******. ** **** ******* ****** ****** **** Github ** *****'* *** ******.

*** ****** ***** ******** *********** *******:

intel performance comparison2

Caveat ** *** / *****

***********, *****'* *** ******* *** **** ****** **** *** ***, for **** *******. **, *****'* ****-*********-******-**** ***** ******* *** *** on ***, **.* ** ******* (**** ***** ******** ********** ******* numbers ** **** ******).

* *** ****** ** *** ***** ***** ******* ***: (*) We *** ******, **** ******* **** ***** *++ ****; (*) our ***-******* ******** ******* **** (** ****** *******/******* ******), *** isolating ***** ****; (*) ** *** *** ***** ******* ************ handling ** ***** ***** *******, ***** ** ***** **** ********.

Video **********

***** ** * ***** ********** **** ******* *** *******:

Questions / ******** / **** ** **** ****?

** **** ******* ******* ** *** **** / ****** * along **** ***** ********* *** **** **** ****** **** *** next *** *****. **** ***** *** **** ** *** ******?

Comments (12)

Undisclosed Manufacturer #1

11/21/18 02:30pm

*'* **** ** ********** **** **** ** * *** ****. Do *** "****" **** ***** **** * ******** *** *** a ******* *** *** ****** ** ***** *********** *******? *** these ******** **** ****** ** ******** *** *********?

Avatar

Tyler Renelle

In reply to Undisclosed Manufacturer #1 | 11/21/18 10:26am

*** **** ****** ** **** * *** **** **** *** other *** ******. ** * **********, ***** ****** ******* ****** aren't ****** *** ********** ************, *** *** **********/******* **** ****** network / ******* ** *** ****** **** (** *** *** it ********, ****** *** **********, ***). ***'** ** ***** ** integrated ****** **** ** *** **** *****.

**** **** ** *** *** **** ** *** **** ***** (I'll *** ***** ******* ** ****-****** ******* ** **), *** it's **** **** **** *** ***. ***'** ** ****** ****** cloning ********'* *** ****** *++ *****. *** *** **** ***** (after *** ******* ********) ** ~/*****/*******************/****************/****************/*******. ** ** "*** **** open ****** / ********", ** ******** ***** ** "***" - they **** ** *** *** *******. *** ***'** **** ** read *** ******** ******* (**** ** *******) ** ~/*****/*******************/*********.

Undisclosed #2

11/21/18 04:40pm

**** ****** *** ****...

******* ********, *** ** ******* $ ** $$ ** $$$?

Avatar

Tyler Renelle

In reply to Undisclosed #2 | 11/21/18 10:46am

**** *** $***. ********** **********, *** ****'** *** ****-***** *********

Michael Miller

In reply to Tyler Renelle | 11/21/18 10:54am

****** **** **** **** **** **-*****. * ******* *** * days *** *** ** ** ******** ******.

Undisclosed Integrator #3

11/21/18 01:07pm

**** ******** - **** ***% *** *********** ** *** **-***** mean **** **** ********* *** ***** *** ***** **** **** of ** ** ** ** ******** ******* **** ***** ******?

****, *** *** *** *** **** *** ****** *******? ** there * *********** ****** ** ******* ** *** *****? **** wondering **** *** ****** **** ** ** *** ******* *******/****.

Avatar

Tyler Renelle

In reply to Undisclosed Integrator #3 | 11/21/18 02:02pm

*** **** * ** ***, *** *'* ************* ******. * think **'* ** *** ******, ** ********* ***% **** *********** of * **** *** ** **'* * ***** (** ********** aggregate ****** ****). ** ************ *'* ******** ** **** *.**/* cores *****.

* ***** *** ***** *** *** **** **, ** ********** heat. *'** *** ** ***** ** * ****** *** ** gauging. **** ***** ** * * *** *****, *********** ******* of ****** * **** (** ***** ****** **** *****) ******** to **** ****** ****.

Undisclosed #2

In reply to Tyler Renelle | 11/21/18 06:40pm

* ***** **'* ** *** ******, ** ********* ***% **** utilization ** * **** *** ** **'* * ***** (** comparable ********* ****** ****).

** **** ** ****** *** ****, * ***** ******* **** the ****** **** ** ** ********** ****** ********, *.*. ***%=**%.

****** **** ******** *** ***%, ***** *** * *** ** cores? ** ** **** ***** ******** **** **** *?

Undisclosed Integrator #3

In reply to Tyler Renelle | 11/22/18 06:56am

* *** **** ******* ******* ** *** ******* *******. ***** it ** ***** *** ***** *** ********* *** ***(******* ****** Power). **’* **** *** **** *** ****. * ** *** certain *** ** ******** ** *** *** ** * ******** chip **** ** ******* ** ** ******* *** ******** ***** to ******* **** **** ** **** ** ********... ** *** not **** ****. * *****’* **** **** **** ** **** wattage ** ******* **** ** **** ****** *****. **** ** how ****** * ******** ** ***** ****** **********:

****** * - *.* **** ***

**-***** - ** **** ***

**** ********* - *-** **** ***

****** ***** - ** ** *** **** *** is **** ** ** *** *** **** ******** **** *** server **** ********** ****** ********* *********

* *****’* **** **** ** **** *** *******/******* **** *** mobile ********** **** ********** ** *****. ***** ***** ** ******* everything **** ***. * ******* **** *** *** * **** but ******** **** ******* ***** ** ******* ***********.

John Honovich

IPVM | 11/21/18 06:17pm

***, ** *** ***** ** ** *** / ************ ******** on ** / **** ******** ** *** **** ****** ** well.

** *** **** ******* ** ** ********* ***, ********** **, some *** *** **** **** ***** / ******** ********* ****. Upcoming ********* **** ******* ****.

Avatar

Fabian Muyawa

LONTECH SYSTEMS | IPVMU Certified | 11/26/18 08:33am

****** ************ ******** **** **** ** ********** *** ******* ******.

Undisclosed Manufacturer #4

11/26/18 06:02pm

* ****** * **** ** ***** ** **** **** **** mouser ** *** ****** ****** ************ *** *** **** ** play **** **** **** *** *******. ** ******* * *** openVino **** *** ***** *** *** ** **** *** ********* the ***** ** ***(*** ******). ******* ** ********** ** *** it ****** *** *** ** **** ** ******.

(** *** ** * *** ****, *** "***" ****** ** only *** ***** ***'* *** ******, ***.)

* ** ************* ** *++, **** ******* *******, *** *** samples **** ****** ****.

* **** **** ******** *** ******* *** ******* **** ** the ******* **** ** *** **** *********** ** ****. ** is **** ** ********** *** *** *** ****** **** **** other *** *** ****** **** *** ** ***********. *** *** license ***** ***** *** ****** ** ********* **** ** *** into *** ******* ***** ********* ***** ** *** **** *** license ***** ***********. **** **** * *********** ******* ********* *** recognition.

** ***, ****** ************ **** ***********, *** ** ** ****** early ** **** ***** ***.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Top 2019 Trend - AI Video Analytics on Dec 10, 2018
160+ Integrators answered: What do you think the top industry trend will be in 2019? Why? AI / video analytics was the run-away winner with...
Alarm.com "AI" Video Analytics Tested on Nov 30, 2018
Alarm.com has announced what it calls an "artificial intelligence (AI) architecture and video analytics service", touting that  Alarm.com's...
Vintra "AI-Powered" Video Analytics Startup Profile on Nov 27, 2018
Vintra is a Silicon Valley startup focused on AI-based video analytics. They had booths at IACP and ISC West demonstrating their hosted or...
Genetec Kiwi Intrusion Detector Analytics Tested on Nov 27, 2018
Genetec has built Kiwi Security's Intrusion Detection analytics into Security Center, aiming to simplify deployment compared to separate camera...
Top Manufacturers Gaining and Losing 2018 on Nov 26, 2018
This is the 5th year IPVM has tracked manufacturers gaining and losing: Top Manufacturers Gaining and Losing 2014 Top Manufacturers Gaining and...
Arcules Cloud VMS Tested on Nov 19, 2018
Arcules is a big bet, or as they describe themselves a 'bold company', spun out and backed by Milestone and Canon.  But how good is Arcules cloud...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...
Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...
Kogniz Silicon Valley AI Startup Profile on Nov 07, 2018
Kogniz is a Silicon Valley company that aims to bring AI analytics to security and surveillance, centering on their own smart cameras: We spoke...

Most Recent Industry Reports

Foolish Strategy: OEMing Facial Recognition on Dec 13, 2018
Almost as 'hot' as face recognition marketing right now is OEMing facial recognition. Last year, they were a who's who of company's with...
DVR Examiner - Video Recovery from Recorder Hard Drives on Dec 13, 2018
Bypassing passwords and long download times on-site, DVR Examiner collects and organizes video evidence directly from a hard drive extracted from...
2019 Access Control Book Released on Dec 12, 2018
This is the best, most comprehensive access control book in the world, based on our unprecedented research and testing has been significantly...
Huawei Hisilicon Quietly Powering Tens of Millions of Western IoT Devices on Dec 12, 2018
Huawei Hisilicon chips are powering, at least, tens of millions of Western IoT devices, such as IP cameras and surveillance recorders, a fact that...
FLIR Launches Body Cameras Unified With VMS (TruWitness) on Dec 11, 2018
While FLIR is best known for their thermal cameras, now they have expanded into body cameras, launching TruWITNESS, a public safety focused body...
Startup Sunflower Labs' Autonomous Drone Security System on Dec 11, 2018
Startup Sunflower Labs is claiming a unique design on a home security system, combining autonomous drones and 'Sunflower' sensors. Imagine an...
The 2019 Video Surveillance Industry Guide on Dec 10, 2018
The 300 page, 2019 Video Surveillance Industry Guide, covers the key events and the future of the video surveillance market, is now available,...
Multi-Factor Access Control Authentication Guide on Dec 10, 2018
Can a stranger use your credentials? One of the oldest problems facing access control is making credentials as easy to use as keys, but restricting...
Top 2019 Trend - AI Video Analytics on Dec 10, 2018
160+ Integrators answered: What do you think the top industry trend will be in 2019? Why? AI / video analytics was the run-away winner with...
AV Tech Company Profile on Dec 07, 2018
Taiwanese manufacturer AV Tech's revenue declined ~70% since 2012. Planning a comeback, AV Tech spoke to IPVM about their opportunities and...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact