Wyze AI Analytics Tested - Beats Axis and Hikvision, Now Improved, Now Being Terminated

By: Ethan Ace and Rob Kilpatrick, Published on Nov 25, 2019

When we originally tested Wyze's free person detection deep learning analytics in July 2019, they performed well, with few false alarms, but a long 5-minute cooldown period which caused missed alerts.

[UPDATE: days after releasing this updated test, XNOR.ai has terminated their agreement with Wyze and XNOR.ai's analytics will be removed from Wyze firmware in early 2020.]

Now, they have released a new paid Complete Motion Capture plan which eliminates the cooldown.

To see how Complete Motion Capture impacts performance, we tested multiple Wyze Cams examining:

  • How does this new plan improve person detection?
  • How well does person detection work? Does it miss people day or night?
  • How does walking/running speed impact detection?
  • Do nuisance sources like lights, shadows, foliage, and animals trigger person detection?
  • How difficult is analytic setup?
  • How does performance compare to Nest Cam IQ?
  • How does performance compare to Hikvision Intrusion analytics?

**** ** ********** ****** Wyze's**** ****** ********* **** learning *********** **** ****, **** performed ****, **** *** false ******, *** * long *-****** ******** ****** which ****** ****** ******.

[******: **** ***** ********* this ******* ****,****.** *** ********** ***** agreement **** ******* ****.**'* ********* **** be ******* **** **** firmware ** ***** ****.]

***, **** **** ******** a *** ************ ****** *********** ***** ********** *** cooldown.

** *** *** ******** Motion ******* ******* ***********, we ****** ************ *************:

  • *** **** **** *** plan ******* ****** *********?
  • *** **** **** ****** detection ****? **** ** miss ****** *** ** night?
  • *** **** *******/******* ***** impact *********?
  • ** ******** ******* **** lights, *******, *******, *** animals ******* ****** *********?
  • *** ********* ** ******** setup?
  • *** **** *********** ******* to **** *** **?
  • *** **** *********** ******* to ********* ********* *********?

[***************]

*******

****'* ****** ********* ********* performed **** **** *** course ** ***** ** testing, ******** **** ***** person ****** **** ******* which ******** ********* **** commercial *******, **** ** shadows, ***** *******, ******* foliage, *** *******.

**** *********** *** ** par **** *** **** more ********* **** *** Outdoor ** *** ****** than *********'* ********* *********, which ******* ** *******, shadows, *** *******.

*******, ***** **** ***** key ********* ***** ** our *******:

  • ****** ********* ******* ** 12 ******* *** *****:****** ********* ** ******* to *** ***** ** seconds ** **** ****** clip, **** **** ***** their ************ ****** ***********. **** ***** ****** in ****** ***** ****** in ***** **** **** amounts ** ******, ** people **** *** ** detected **** ****** ** of ** ***** ***** motion ***** *** ********.
  • * ****** ******** ****** without **** ****:** *******, ****'* ********* have * **** * minute ******** ****** ******* Person ********* ****** ***** could ****** ** ****** activity ** **** ******* areas. **** *** ********** a **** **** ***** eliminates **** ******** (******** Motion *******, $*.**/*****).
  • ****** ******* ********:*** **** *** ****** to ****** ******** ******* through *** *****, ********** of ******** ** ******** conditions. ** ******** ******* at ****** ** **** speeds **** ******.

** ******* ** ********* results ** **** *****:

Versus ***** ******** / *** *********: ****** ********* *** ** ******* ******

****'* ****** ********* ********* similarly ** ** ****** than ***** ********/*** ********* in *********** ** ****** ********* Shootout, ********** ******* ** Wyze's **** ******** **** completely ** *** ****, without ***** ************, ******** by ******.

****,****, *******, *** *** ***** on ******* ** *******, either, ***** *********'************ ******* ** ****** all ****** ** *** scene. **** ****, ***** other ********* **** ****** running ******** (****** ***** did ***).

*******, **** ** **** less ********* **** ***** other *******, **** ****** ranging ** ***** **** ~$110 (*****) ** $*** (Nest *** *******). ************, Wyze **** *** ******* a ************ *** ***** analytics, ***** ****, ****, and **** ** ($*-*/***** per ******), ****** **** do ******* * ***** cost $*.**/***** *** ****** for ********** ****** *******.

*** ******* ******** ** Wyze ******** ** ***** other ******* ** *** lack ** ******* ****** models, ***** ***** ************* offer. **** **** ***** outdoor ***** ** ******* for **** ****/***** ****.

************

**** ****** ********* ** available ** ******* *** ($** ***)******* *** ********** *** ****. ***** simply **** ** ******** the ****** ******** *** turn ** ****** *********.

Person ********* ***********

**** *** *** *** limitations ** **** ******** not ****** ** ***** consumer ** ********** ****** we **** ****** (****** present ** **'***** ****** * **** AI *********):

  • ****** ********* ******* ** 12 ******* *** *****
  • * ****** ******** ******* paid ****

** ******* ***** ** more ****** *****.

People ********* ******* ** ***** ** ******* ** *****

**** ****** ********* ***** only ** *** ***** 12 ******* ** **** motion ****. **** ***** that ** * ****** enters * ***** ***** motion ** ******* ***** 12 *******, **** **** not ** ********, *** will * ****** ****** trigger ** ********** ***** if *** ** ******* in *** *****.

**** ** ***** ***** this ********** ** ***** documentation *** ***** * notice ** ****** ********* clips ** ***** ****** app:

**** *** ** ** issue ** ***** ***** constant ****** ** *******, such ** * ****** facing * ****** **** blowing *******, ** ****** detection *** ****** *** trigger. **, ** * subject ****** *** *** but **** *** ******* person ********* ****** ** seconds, ** ****** **** not *******, ***** ***** (green ******** *** ********* motion, *** ****** *********):

Five ****** ******** ****** ****** ****** ** *******

***** * ****** ********* event ** *********, ** default **** *** ** unconfigurable * ****** ******** period ****** ******* ****** detection ***** ** ****. This ***** ****** ***** missed ****** ********* ** high ******* ***** **** as ******* ** *******.

**** **** **** ** a **** ***** **********, not ** **/******** **********. We ********* **** ********** with **** **** *******, as ****.

5 Minute Cooldown Results In MIssed Alerts_2

*** ****** ****** ******, this ******** **** *** exist, **** ****** **** closer (***** * ****** apart *****):

Motion Events No Cooldown

No ******** **** **** ****

** ****** **** ********, Wyze ********** * **** plan ************** ****** ************ ********** *** * minute ******** ****** ******* events. ** *** *****, this ****** ** *******, with ********** ****** ********* events ******** ******* ***** seconds *****.

**** **** ***** *** not ** ******** ******, but ****** ** **** 5 ****** ********, *.*., if ****** ***** * minutes, *** ***** *** created. *******, **** **** person ********* **** **** use *** ***** ** seconds ** **** ****, regardless ** ******.

******** ****** ******* ***** $1.50 *** *** ***** per ******.

Person ********* ***********

****'* ** ****** ********* performed **** ** *** tests, ********* ******** **** day *** ***** (**** IR **) **** ** missed ********** ** ******** walking ** ****** ** fast *****.

People-Detected-Day-And-Night-Walking-Normal_Fast-Speed

**** **** *** *** alert ** ****** ******* of ***** ****** ***** triggered **** *******, **** as ******* ** *** scene:

No False Alerts From Shadows

** ****** ******* ** and ***:

No False Alerts From Light Changes

************, ****** **** ****** are ****** ****, ** also ****** ***** ** analytics ********. ********, ****** Detection ******* ******* ******* and ******* ***** ********* other ****** ** **** tests. **** **** ******** boxes ******** ****** ****, not ****** *********.

No-False-Alerts-On-Foliage

***** *** ***** ******* were **** ******* ** Person *********.

No False Alerts On Animals

Running ******** ******

*** **** ****** ** detect ******* ******** ** our *****, ***** *****. However, ***** ***** ****** market (*********** ******), **** is **** ****** ** be * ******* **** commercial ******* ** **** residential ******* *******.

Running-Subjects-Completely-Missed

Simple *****: ****** ******** *** **** **

****** ********* ***** ** simple, ********* ***** **** to ****** ******** *** turn *** ******* ** on **** ******. ** setup *** ****, *******/******* sizes, ** ***** ************* is ********.

Simple-Setup--Switch-On-For-Each-Camera-copy

Xnor: *** ******* ******** **** **

****'* ****** ********* ********* were ********* ** *********** with****, * *******-***** *******. Xnor's ***** ** ** optimizing ****** ** *** on *** **** ******** hardware, **** ** ********** ******* ** *** **** Cam *****:

**** ** *********** ****** as ****** *****-**** ***** perform **** ********, ***** historically *** *** **** capable. **** ** ** alternative ** ***** **** expensive **** ******** ***** such *******'* ******** ******.

****'* ****** *** ********** on *** ****, ******* analyzing ** *** *****. Wyze *********** **** ** Nest ** **** ******* cloud ************ (*** *************) to ****** ***** **** Aware/Arlo ***** *********. *********** **** ****'* ********* video********* ****:

**** *** ******* ** 2016 *** *** ****** nearly$*** *** ** ***. *** **** *******, see *** **** ******:******* ****.**, ********* ** YOLO, ***** ************ ***** Examined

Vs ********* ********* *** **** ******* ** ****** *********

**** ****** ********* ********* similarly ** **** ****** detection, *** ***-********** ******** in*** ******** ********* ********, **** **** ******** false ****** **** *******, lights, *******, *******, ***., though **** ****** ******* subjects.

**** ****** ********* ************ Hikvision's ********* *********, ** Hikvision ******* ** ******* such ** ******* ******* and ****** *******.

Hikvision False Alerts On Foliage Shadows

** **** ** ***** and ***** ******* ** the **********.

Hikvision False Alerts On Animals

*******, *********'* ********* **** alerted ** *** ********** of ******* ****, ***** neither *** **** *** Nest ******* ******* **.

Hikvision False Alerts On Headlights

Vs. **** *********

****'* ****** ********* *** not ******* ** **** sources ***** ****** ***** alerts ** **** ******* analytics, ********' ****,****** *****, ************ ************ *** ********* ** shadows, *******, ** ******* in *** *****.

**** ****** ** ******** object ********* ** ***** new******-* ****, ****** *********** ** the ***** ****** ***** this *** ****,*** *****-**** **** ******* ** slightly ****** **** **** tests.

Versions ****

*** ********* ******** **** used ****** *******:

  • **** *** **: *.*.*.**
  • **** ** *******: *******
  • ********* **-**********-*: **.*.** ***** 180718

Comments (35)

* **** *** ** these **** *** ********* installed ******* *** ** front ****** ** *** sidewalk ****** ** ** my *****. *** *** most **** ** *** worked ****** **** *********** this ** **** *** traffic, **** ********* * person **** ******* *** from *** ***** ** the ********. ** *** missed **** ******. ******* for *** ***** ***** these *** **** ****** cameras. * **** *** new ******* *** ***** bulbs ** **** *** haven't **** **** **** these *** ** * had *****. *** **** reason ** ******** ****** to *** ******* *** weekends *** ** ** spare **** *** **** involved ** ****. 😊

**** ** ********* **** for *** ********, ** this **** **** ********** to *** **** **** learning ********.

*******, ** ** ********* embarrassing *** *** *** big ********* **** ***** can’t ** ****. *** example, ********* *** *** its “*** ****”, “********* R&D”, **,*** “*********”, ******.  Axis ***, ***** **** do *** *** **** about **, **** ****** should ** **** **** to ******* ***** ***** premium.

** ** **** **** person ********* *** ***** this **** ** ****** normal *** ***** ************ but **** ** * good **** ** *** now ***** *****.

*** ***** ** **** typing *** **** *******. Spot **.

*** *** **** ***** ****** *** ****. :*

**** **** **** ** Wyze *******.  * **** not *** *** ****** with *** ****** ******* out ** ***** ****** at *** ******** *** get ** ************* **** faster **** *** **** I **** ******** *** same ****.  

****: * ******* *** title ** "**** ** Analytics ****** - **** Axis *** *********"

*** ****** ** ** emphasize *** ************ ** professional ***** ************. * can *** ** ***** and *********** **** **** is *** ** **** interest (*** **** **** report, *** ******* ******* we **** **** ** Wyze).

*******, **** **** *** done **** ** **** significant *** ************ ***** surveillance. **** ** ***** to **** * ******* or *** ******* ******* this **** *** **** 'regular' ****** *** ***** to ****** ****** ********* as ******** (**** ** they ***'* ********** **** 'deep ********' ** **** or ****** ************** **). And ******** **** **** and ********* *** ***** to **** ******* **** Wyze ** ******* **** they ***.

***** ************ ********* **** catch ** ******* ****** be **** *** ** could ******* ***** **** for ******** ** **.

* **** **** *** it ** ********** ** relation ** ****.  **** drives ** ***** ** the * ****** **** down *** *********.  ******* I **** *** ****** wrong, *** * ******* inserting ** ** **** would **** ***** ****.

****, *** *** ****** Detection ** ****, ****** when * ** ** in **** ** *** camera.....

***, **** *** ****** the ** **** *** can ** ** ******** settings > ***** ********* and ****** ********** *********, the ****** ****** **** just ************ ****** ** the ** **** *** you *** ****** ******* recorded *****.

** *** ***** ****** events **** ******** ****** 5 ******* ** ********* but ****** ********* ***** triggered * * ****** cooldown.

Motion Events No Cooldown

***, * *** *** that.  *** **** ****** I ******* ** ***** the ** **** ***** allow *** ** *********** record ****** ******* * minute ********.

** *** *** ****** detection ********* ** ******, I ****** **** ** allow *** ** ** privacy ***** ********* ****.

***** **** ***** **** be ** ******* ** Anyvision's ****** *********** ****** ****.

 

**** ******* *** ***/***** little ******.  *** **** if ** *** ******* here *** **** **** have * **** ******** so *** *** **** it **** ***** *** VMS.  * **** * few ******* **** * have ********* ** ** with **** *** **** are *** *****.

** **** *** ******* Wyze's **** *******.

********* ** ******* *** **** *******, ** ** * separate ******** ******* **** will ** ******** ************, so ** * ******** / **** *********, ** could **** ***** *** not **** **** *** commercial ************.

***... **** ***...

* **** * ** these ** ** ***** and *** **** ***** that **** ** ** the *** ***** ****, but **** ** * tiny *********.  **** **** fine *** ******* ******* stuff *** ****** **** my *** ** *** eating *** *****.  

* ** ******* ***** the ******** *****.  **** Xnor ****** **** * per-unit *******?  ***?  **** sort ** *********** ***** on ****** ********?  ** Wyze **** ****** *** cost *** *** ** order ** **** ******** in ****** *** *****, maybe ************ *****, ** algorithms?

**** ******** ** ******** pricing ****** ********** **** it ** * ********* / ******** ***** *****.

** ***** ** **** it ** ** ***** somewhat ** * ***** / ****** ***** ****.**'* wordmark ** ********* *** on **** *****, ***** is ** ************** ****. It's *** **** *********** speaking **** ***** **** to **** ****'* ******** on ***** ***** ****** so ****'* *** * guess ** *** **********. If ** **, ** is ******** * **** deal *** **** ***** that **** *** **** lots ** ******** *** other ********* *********.

* **** ******* **** Wyze *** **** ********* questions ***** ***** ****** detection:

* **** *** ******* yet, ******* ***** *** others **********.

********** * ***** ****** would ****** *** **** as *** *********.  *** damn ****** ******* ** sun ******* ********** *** day.  

***, ** ****** **** and ********* *** ******** as **** *** ************ the ******* ******* *** China *************.

*** **** ***** **** Dahua, ******, ******* *** pretty **** ***** ***** mainstream ****** ************ ***** now **** *** ******** and *****. *******: ** ****** ********* ******** - ********, ****, *****, Dahua, ******, *********, *******

* ****** **** ** retract ** ******** ******* about *** ****** *********. My ****** ****’* ******** anyone *** **** **** a **** ***. * even ***** ******* *** a *** ******* ** the ****** *** ********* me. ***** ** * glitch *** **** ** be ****** *** *** back ** *** **** to **** ** ** that ***. 

* *********** ********* ******* with ** *******, ** was **** *** ************* needed ** ** ******* on/off, *** *** ****** in ** *********.

********, ******* (* ******* chip ************), ** **** a ******** *** ****** (for **** ********* *******) and, **** *************, ********* (!) *** ***** ** be ****** ****** ** the ******* **********:

*****://***.*******************.***/*******-****/*******-*******-*****-********-******-*******-***-***-***-********.****

* ****** *** **** "stitches" *** *** **** real ********** ** ****** Xnor *** **** ** the ***** "**" ***** is ****** *** ****, as *** *** ************* states **.

 

**** ******* * ****** of *****.  ***'* **** to *** **** ***!  Anybody **** ** *** AWS ***** **** ***** in ******?

**#*, * ******* **** Wyze *******, ***** ********:

***! *** ***** ******* is ********* ** ********* whose ******* *** ***** and ******* ** ****** and ***** ********* ******* of *** *.*.

****** ***. * ********* 4 **** *******, * motion ****** *** * door ******** ***** * weeks ***. *'* ** sales ** *** ************* side. **** **** ** install *** ** ************ was **** *** ** it **** ** **** for *** ** **** readers. ****** ********* *** significant ***** ********* ********* but **** *** ******** to *** ***** ** almost **** ***** *********. It ********** ****** ****** at ***** ******. ***** example: **'* ********* *** and * ** *** office. * *** *** my *******-**-*** ******** ** beer ** *** "******** camera" *** ***** *** no ****** ******** ** the ******** ** ** the ***** ** *** house. (*** **** **** to *** ** ** back ****.) **** *** not ****** ** *** 5-minute ******** ******* ** people **** **** ******** since *:****. * **** on * ****** ***** residential ****** ** *** city. ****** **** ********** walked ** ** *** sidewalk ** ***** ** my ***** ** *** past * *****.

****** **** ****; *'* pretty ********* **** ****. For ***** *********** *** they **** ****** ******* at * **** *** price *** **** **** installation. ** *** **** to **** ** ****** security ******* *** **** install *** *****-** ******* though. ********* *** *** 12 ******* ** *** burglar *********** ** *** distance *** **** * 5 ****** *****. ********* the ******* *** ** can ** ****** ****** or *********. *** **'* better **** ** ****** system.

*** ******* ******** **** work ****** **** *** alert ******** ** ** phone ** ***** ***** are **** ****. **** blogged ******** ***** ** outdoor ******; ******* ******* to ******** **** ***...

Test ****** / ****-**-**:

*** ****** *** **** up *** ******* ***** we ********* *** ****, looking ** *** ********* and ******* ****. ***** alert *********** *** **** very *****, **** **** 2 ***** ****** ** the **** ****, **** at *****, ********* ** a *** ****** **** the ******. *** **** clip:

** *** **** ******** alarms **** ***** ******* here, **** **** *** overhead ****** ******* ** and *** *** * nearby **** *******/******* ***** the ****** *** *** in **** ****.

****** -

**** *** ***** **** ***-** ******* *** 1.49/month**** ******* *** ******** period ******* ****** ******, we **** ** ******* this *** ********* ** update ** *** ******.

**** **** ******* ***...** can't ** **** **** to *********

**** ******:

"****** ******** **** ** temporarily ******* **** **** Cam ********* **** * new ******** ******* ******* for ***-******* ****, *** to *** ********** *********** of *** ********* **** our ** ********."

***** **** *** ******* is **.

** ******** **** ***** as **** *** *** in *** ******* ** getting **** ******* **** Wyze *** ****. **’** post **** **** ** have ** ******.

**** **** ************ **** they **** *** * falling *** **** ****. It *** ** ** with *** ********* **** had ** *****. ***** they *** *** ********* they ****** *** *** they **** **** *****? It ***** ** *********** to **** *** *** and ******* **** ** able ** ****** ******** comparable (**'* ********* ** the **** ***** *****) to ******* **** (***** is ** ****** ***** on *** *******).

******** ****** ********* ** cew ****** ***** ** one *****. ** ****** like **** **** ******* to ******* ******* *********! I ***'* *** *** than **** **** *** firmware *********. **** ********* the ***** **** **** sold *** **** **** person *********. ****** **** can't **** ***** "******" a *** ******* ** product **** *********...

***'* **** ******* *** scrapping ****** *** ****** on *** ** ****!

***

***,

**** ** ** ** not ******* ********?

***** **** ***** * bigger *****.

******* ****** ** **** deserves ** ** **** didn't **** * **** contract ** *****.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Bosch AI Camera Trainer Released And Tested on Apr 09, 2019
Bosch is releasing a highly unusual new AI feature - 'Camera Trainer'. Now, coming as a standard feature in Bosch IVA/EVA analytics, one can train...
Hikvision DeepinView Camera Analytics Tested on May 08, 2019
Hikvision is expanding its 'deep learning' offerings with a new camera series called 'DeepinView' claiming false alarm reduction and improved...
Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they claim their new Analytics+ "algorithms significantly improve accuracy and...
Yi Home Camera 3 AI Analytics Tested on Sep 10, 2019
Yi Technology is claiming "new AI features" in its $50 Home Camera 3 "eliminates 'false positives' caused by flying insects, small pets, or light...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Consumer IP Camera Analytics / AI Shootout - Arlo, Google / Nest, Amazon / Ring, Hikvision / Ezviz, Wyze Cam, Yi Home on Sep 26, 2019
AI analytics are hitting the mainstream in the consumer camera market, with entrants Wyze and Yi Home releasing free people detection on their...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Camect "Worlds Smartest Camera Hub" Tested on Oct 18, 2019
Camect is a Silicon Valley startup that claims the "Smartest AI Object Detection On The Market", detecting not only people and vehicles, but...

Most Recent Industry Reports

Every VMS Will Become a VSaaS on Feb 21, 2020
VMS is ending. Soon every VMS will be a VSaaS. Competitive dynamics will be redrawn. What does this mean? VMS Historically...
Video Surveillance 101 Course - Last Chance on Feb 20, 2020
This is the last chance to join IPVM's first Video Surveillance 101 course, designed to help those new to the industry to quickly understand the...
Vulnerability Directory For Access Credentials on Feb 20, 2020
Knowing which access credentials are insecure can be difficult to see, especially because most look and feel the same. Even insecure 125 kHz...
AI/Smart Camera Tutorial on Feb 20, 2020
Cameras with video analytics, sometimes called 'Smart' camera or 'AI' cameras, etc. are one of the most promising growth areas of video...
China Manufacturer Suffers Coronavirus Scare on Feb 20, 2020
Uniview suffered a significant health scare last week after one of its employees reported a fever and initially tested positive for coronavirus....
Cheap Camera Problems at Night on Feb 19, 2020
Cheap cameras generally have problems at night, despite the common perception that integrated IR makes cameras mostly the same, according to new...
Milestone Launches Multiple Cloud Solutions on Feb 18, 2020
Milestone is going to the cloud, becoming one of the last prominent VMSes to do so. Milestone is clearly late but how competitive do these new...
Video Surveillance Architecture 101 on Feb 18, 2020
Video surveillance can be designed and deployed in a number of ways. This 101 examines the most common options and architectures used in...
UK Stands Behind Hikvision But Controversy Continues on Feb 18, 2020
Hikvision is exhibiting at a UK government conference for law enforcement, provoking controversy from the press, politicians, and activists due to...
IronYun AI Analytics Tested on Feb 17, 2020
Taiwan startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service...