Intel Neural Compute Stick 2 / Movidius AI Test

By: IPVM Team, Published on Nov 21, 2018

AI is a major trend in video surveillance with manufacturers paying significant attention to Intel's Movidius Myriad chips. Indeed, Avigilon has announced that their next generation AI H5 cameras will use the Myriad X.

But how well do these Myriad X chips perform?

IPVM has done its first testing of the Myriad X chip (via the NCS2) and shares results inside this report.

Intel / Movidius / Network Compute Stick Overview

Cameras like Avigilon will use Intel / Movidius chips inside them to deep learning / Artificial intelligence. To the side is an image of a Myriad X chip. Video will be sent into to on-board chip, the chip will run deep learning models and it will output categorizations of people, objects, faces, etc.

Just a week ago, Intel announced its second generation of 'Neural Compute Sticks' (NCS). While the first NCS had the original / older Movidius Myriad 2 chip, this new one has the newer Myriad X inside, which Intel claims "delivers 10X the performance compared to previous generations".

IPVM bought the NCS2 and tested it.

Areas Analyzed

Inside this report, we share results across:

  • Face detection using Intel's face-detection-retail-0004 model
  • Testing across Intel i7, Myriad 2 and Myriad X
  • FPS, CPU and RAM consumption variances across devices
  • Accuracy comparison of detection
  • YOLO support and issues

** ** * ***** trend ** ***** ************ with ************* ****** *********** attention *******'* ******** ****** *****. ******,******** *** ********* **** their **** ********** ** H5 *********** *** *** ****** X.

*** *** **** ** these ****** * ***** perform?

**** *** **** *** first ******* ** *** Myriad * **** (*** the ****) *** ****** results ****** **** ******.

Intel / ******** / ******* ******* ***** ********

******* **** ******** **** use ***** / ******** chips ****** **** ** deep ******** / ********** intelligence. ** *** **** is ** ***** ** a ****** * ****. Video **** ** **** into ** **-***** ****, the **** **** *** deep ******** ****** *** it **** ****** *************** of ******, *******, *****, etc.

**** * **** ***,***** ************ ****** ********** ** '****** ******* ******' (***). ***** *** first *** *** *** original / ***** ******** Myriad * ****, **** new *** *** *** newer****** *******, ***** ***** ****** "delivers *** *** *********** compared ** ******** ***********".

**** ****** *** **** and ****** **.

Areas ********

****** **** ******, ** share ******* ******:

  • **** ********* ***** *****'* face-detection-retail-0004 *****
  • ******* ****** ***** **, Myriad * *** ****** X
  • ***, *** *** *** consumption ********* ****** *******
  • ******** ********** ** *********
  • **** ******* *** ******

[***************]

Key ********

*** *** ******** **** our ******* ***:

  • Myriad * ~= *.** ****** * ***: The NCS2 ran roughly 2.7x frames-per-second more than the NCS1 in their face detection model we tested. Intel says that different optimizations and measurement changes would increase this significantly (discussed in caveats below).
  • Faster **** *** (**): The NCS2 / Myriad X outperformed the i7-7700K (a top-of-the-line in 2017) chip tested here, a significant advance given the Myriad X being significantly lower cost and lower power consumption.
  • Little/no ******** ****: Our tests noted no differences in output video accuracy in line's feedback that OpenVINO's model-optimization step should be considered "lossless." They pointed out that allowing lossy model compression (when converting a model to be run on Myriad; eg FP32->FP16 data-type downsizing) would cause issues with vendors training a model with certain expectations, and having a different (lossy) model for inferring.
  • Model ************* ** ******: While Intel has mentioned YOLO support for OpenVino, the current YOLOv3 is not yet compatible on Myriad chips due to a particular network layer. ***** **************** ***** *** ******* converting ****** ** ** run ** ***, *** YOLOv3 ** *** *** compatible ** ****** ******* due ** * ********** network *****. **** ** & **: ***** ******* these *** ** *** on ******, *** *** tests *******.**********+***: *** ***** in **** ****** **** variety, ************ ***** ****-*********-******-**** (SqueezeNet ***** **** * single-shot ********).*********+***: *** ***** pending. ** **** ******* public ****** **** ****** to *****'* *** ******.

*** ****** ***** ******** performance *******:

intel performance comparison2

Caveat ** *** / *****

***********, *****'* *** ******* are **** ****** **** our ***, *** **** reasons. **, *****'* ****-*********-******-**** model ******* *** *** on ***, **.* ** Myriad2 (**** ***** ******** comparable ******* ******* ** will ******).

* *** ****** ** our ***** ***** ******* out: (*) ** *** Python, **** ******* **** their *++ ****; (*) our ***-******* ******** ******* code (** ****** *******/******* frames), *** ********* ***** code; (*) ** *** not ***** ******* ************ handling ** ***** ***** loading, ***** ** ***** into ********.

Video **********

***** ** * ***** screencast **** ******* *** testing:

Questions / ******** / **** ** **** ****?

** **** ******* ******* of *** **** / Myriad * ***** **** other ********* *** **** more ****** **** *** next *** *****. **** would *** **** ** see ******?

Comments (12)

Undisclosed Manufacturer #1

11/21/18 02:30pm

*'* **** ** ********** this **** ** * can ****. ** *** "plug" **** ***** **** a ******** *** *** a ******* *** *** camera ** ***** *********** objects? *** ***** ******** open ****** ** ******** for *********?

Avatar

Tyler Renelle

In reply to Undisclosed Manufacturer #1 | 11/21/18 04:26pm

*** **** ****** ** into * *** **** like *** ***** *** device. ** * **********, these ****** ******* ****** aren't ****** *** ********** applications, *** *** **********/******* your ****** ******* / program ** *** ****** chip (** *** *** it ********, ****** *** compatible, ***). ***'** ** using ** ********** ****** chip ** *** **** world.

**** **** ** *** our **** ** *** repo ***** (*'** *** about ******* ** ****-****** license ** **), *** it's **** **** **** for ***. ***'** ** better ****** ******* ********'* own ****** *++ *****. You *** **** ***** (after *** ******* ********) at ~/*****/*******************/****************/****************/*******. ** ** "are **** **** ****** / ********", ** ******** guess is "***" - **** want ** *** *** started. *** ***'** **** to **** *** ******** license (**** ** *******) at ~/*****/*******************/*********.

Undisclosed #2

11/21/18 04:40pm

**** ****** *** ****...

******* ********, *** ** talking $ ** $$ or $$$?

 

Avatar

Tyler Renelle

In reply to Undisclosed #2 | 11/21/18 04:46pm

**** *** $***. ********** **********, *** ****'** *** back-order ********* 

Michael Miller

In reply to Tyler Renelle | 11/21/18 04:54pm

****** **** **** **** them **-*****. * ******* one * **** *** and ** ** ******** ******. 

 

Undisclosed Integrator #3

11/21/18 07:07pm

**** ******** - **** 622% *** *********** ** the **-***** **** **** each ********* *** ***** out ***** **** **** of ** ** ** it ******** ******* **** other ******?

 

****, *** *** *** the **** *** ****** testing?  ** ***** * significant ****** ** ******* on *** *****?  **** wondering **** *** ****** will ** ** *** cameras *******/****.

Avatar

Tyler Renelle

In reply to Undisclosed Integrator #3 | 11/21/18 08:02pm

*** **** * ** all, *** *'* ************* myself. * ***** **'* as *** ******, ** considers ***% **** *********** of * **** *** of **'* * ***** (or ********** ********* ****** them). ** ************ *'* thinking ** **** *.**/* cores *****.

* ***** *** ***** now *** **** **, no ********** ****. *'** try ** ***** ** a ****** *** ** gauging. **** ***** ** a * *** *****, temperature ******* ** ****** X **** (** ***** rather **** *****) ******** to **** ****** ****.

Undisclosed #2

In reply to Tyler Renelle | 11/22/18 12:40am

* ***** **'* ** you ******, ** ********* 100% **** *********** ** 1 **** *** ** i7's * ***** (** comparable ********* ****** ****).

** **** ** ****** the ****, * ***** suggest **** *** ****** need ** ** ********** before ********, *.*. ***%=**%.

****** **** ******** *** 104%, ***** *** * has ** *****? ** it **** ***** ******** more **** *?

Undisclosed Integrator #3

In reply to Tyler Renelle | 11/22/18 12:56pm

* *** **** ******* digging ** *** ******* portion.  ***** ** ** Intel *** ***** *** available *** ***(******* ****** Power).  **’* **** *** draw *** ****.  * am *** ******* *** it ******** ** *** TDP ** * ******** chip **** ** ******* as ** ******* *** industry ***** ** ******* this **** ** **** as ********... ** *** not **** ****.  * haven’t **** **** **** to **** ******* ** thermal **** ** **** Artpec *****.  **** ** how ****** * ******** to ***** ****** **********:

****** * - *.* watt ***

**-***** - ** **** TDP

**** ********* - *-** watt ***

****** ***** - ** to *** **** *** **** ** **** is ** *** *** that ******** **** *** server **** ********** ****** analytics *********

 

* *****’* **** **** to **** *** *******/******* info *** ****** ********** like ********** ** *****.  Apple ***** ** ******* everything **** ***.  * suspect **** *** *** 1 **** *** ******** back ******* ***** ** thermal ***********.

 

 

John Honovich

IPVM | 11/22/18 12:17am

***, ** *** ***** to ** *** / introductory ******** ** ** / **** ******** ** the **** ****** ** well. 

** *** **** ******* to ** ********* ***, rightfully **, **** *** not **** **** ***** / ******** ********* ****. Upcoming ********* **** ******* that.

Avatar

Fabian Muyawa

LONTECH SYSTEMS
IPVMU Certified | 11/26/18 03:33pm

****** ************ ******** **** help ** ********** *** concept ******.

Undisclosed Manufacturer #4

11/27/18 12:02am

* ****** * **** of ***** ** **** with **** ****** ** the ****** ****** ************ and *** **** ** play **** **** **** the *******. ** ******* 7 *** ******** **** SDK ***** *** *** OS **** *** ********* the ***** ** ***(*** driver). ******* ** ********** it *** ** ****** but *** ** **** as ******.

(** *** ** * can ****, *** "***" choice ** **** *** intel ***'* *** ******, etc.)

* ** ************* ** C++, **** ******* *******, but *** ******* **** pretty ****.

* **** **** ******** the ******* *** ******* them ** *** ******* line ** *** **** performance ** ****. ** is **** ** ********** the *** *** ****** feed **** ***** *** the ****** **** *** on ***********. *** *** license ***** ***** *** output ** ********* **** is *** **** *** license ***** ********* ***** is *** **** *** license ***** ***********. **** make * *********** ******* detection *** ***********.

** ***, ****** ************ with ***********, *** ** is ****** ***** ** even ***** ***.

 

 

 

Read this IPVM report for free.

This article is part of IPVM's 6,438 reports, 865 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Leica Launches LIDAR / Thermal / IP Camera on Mar 04, 2020
Swiss manufacturer Leica is launching what it calls a "real-time reality...
Video Analytics 101 on Mar 16, 2020
This guide teaches the fundamentals of video surveillance...
Sony Launches AI Camera Sensors on May 18, 2020
Weeks after exiting the branded video surveillance business, Sony is making a...
AI/Smart Camera Tutorial on Feb 20, 2020
Cameras with video analytics, sometimes called 'Smart' camera or 'AI'...
Video Surveillance Trends 101 on Apr 01, 2020
This report examines major industry factors and how they could impact video...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Video Surveillance Cameras 101 on Feb 25, 2020
Cameras come in many shapes, sizes and specifications. This 101 examines the...
VSaaS 101 on Mar 25, 2020
Video Surveillance as a Service (VSaaS) is the common industry term for cloud...
Video Surveillance Architecture 101 on Feb 18, 2020
Video surveillance can be designed and deployed in a number of ways. This 101...
Hanwha Presents AI Analytics and First 8K Camera on May 11, 2020
Hanwha presented their AI Analytics and the "Industry's First 8K" camera at...
AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...
Magos Presents AI Radar Object Detector on May 08, 2020
Magos presented its AI radar object detection at the April 2020 IPVM New...
Video Surveillance History on May 06, 2020
The video surveillance market has changed significantly since 2000, going...
Milestone Presents XProtect On AWS on May 04, 2020
Milestone presented its XProtect on AWS offering at the April 2020 IPVM New...
Cambium Presents cnVision Surveillance Wireless on May 12, 2020
Cambium presented its cnVision wireless for surveillance at the April 2020...

Recent Reports

VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...
Dogs For Coronavirus Screening Examined on Aug 06, 2020
While thermal temperature screening is the surveillance industry's most...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
AHJ / Authority Having Jurisdiction Tutorial on Aug 06, 2020
One of the most powerful yet often underappreciated characters in all of the...
SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...
ADI Returns To Growth, Back To 'Pre-COVID Levels' on Aug 05, 2020
While ADI was hit hard in April, with revenue declining 21%, the company's...
Exposing Fever Tablet Suppliers and 40+ Relabelers on Aug 05, 2020
IPVM has found 40+ USA and EU companies relabeling fever tablets designed,...
Indian Government Restricts PRC Manufacturers From Public Projects on Aug 04, 2020
In a move that mirrors the U.S. government’s ban on Dahua and Hikvision...
Directory of 201 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Dahua Loses Australian Medical Device Approval on Aug 04, 2020
Dahua has cancelled its medical device registration after "discussions" with...
Google Invests in ADT, ADT Stock Soars on Aug 03, 2020
Google has announced a $450 million investment in the Florida-based security...
US Startup Fever Inspect Examined on Aug 03, 2020
Undoubtedly late to fever cameras, this US company, Fever Inspect, led by a...
Motorola Solutions Acquires Pelco on Aug 03, 2020
Motorola Solutions has acquired Pelco, pledging to bring blue back and make...
False: Verkada: "If You Want To Remote View Your Cameras You Need To Punch Holes In Your Firewall" on Jul 31, 2020
Verkada falsely declared to “3,000+ customers”, “300 school districts”, and...