Wyze AI Analytics Tested - Beats Axis and Hikvision, Now Improved, Now Being Terminated

By Ethan Ace and Rob Kilpatrick, Published Nov 25, 2019, 01:31pm EST

When we originally tested Wyze's free person detection deep learning analytics in July 2019, they performed well, with few false alarms, but a long 5-minute cooldown period which caused missed alerts.

[UPDATE: days after releasing this updated test, XNOR.ai has terminated their agreement with Wyze and XNOR.ai's analytics will be removed from Wyze firmware in early 2020.]

Now, they have released a new paid Complete Motion Capture plan which eliminates the cooldown.

IPVM Image

To see how Complete Motion Capture impacts performance, we tested multiple Wyze Cams examining:

  • How does this new plan improve person detection?
  • How well does person detection work? Does it miss people day or night?
  • How does walking/running speed impact detection?
  • Do nuisance sources like lights, shadows, foliage, and animals trigger person detection?
  • How difficult is analytic setup?
  • How does performance compare to Nest Cam IQ?
  • How does performance compare to Hikvision Intrusion analytics?

*******

****'* ****** ********* ********* performed **** **** *** course ** ***** ** testing, ******** **** ***** person ****** **** ******* which ******** ********* **** commercial *******, **** ** shadows, ***** *******, ******* foliage, *** *******.

**** *********** *** ** par **** *** **** more ********* **** *** Outdoor ** *** ****** than *********'* ********* *********, which ******* ** *******, shadows, *** *******.

*******, ***** **** ***** key ********* ***** ** our *******:

  • ****** ********* ******* ** 12 ******* *** *****:****** ********* ** ******* to *** ***** ** seconds ** **** ****** clip, **** **** ***** their ************ ****** ***********. **** ***** ****** in ****** ***** ****** in ***** **** **** amounts ** ******, ** people **** *** ** detected **** ****** ** of ** ***** ***** motion ***** *** ********.
  • * ****** ******** ****** without **** ****:** *******, ****'* ********* have * **** * minute ******** ****** ******* Person ********* ****** ***** could ****** ** ****** activity ** **** ******* areas. **** *** ********** a **** **** ***** eliminates **** ******** (******** Motion *******, $*.**/*****).
  • ****** ******* ********:*** **** *** ****** to ****** ******** ******* through *** *****, ********** of ******** ** ******** conditions. ** ******** ******* at ****** ** **** speeds **** ******.

** ******* ** ********* results ** **** *****:

Versus ***** ******** / *** *********: ****** ********* *** ** ******* ******

****'* ****** ********* ********* similarly ** ** ****** than ***** ********/*** ********* in *********** ** ****** ********* Shootout, ********** ******* ** Wyze's **** ******** **** completely ** *** ****, without ***** ************, ******** by ******.

****,****, *******, *** *** ***** on ******* ** *******, either, ***** *********'************ ******* ** ****** all ****** ** *** scene. **** ****, ***** other ********* **** ****** running ******** (****** ***** did ***).

*******, **** ** **** less ********* **** ***** other *******, **** ****** ranging ** ***** **** ~$110 (*****) ** $*** (Nest *** *******). ************, Wyze **** *** ******* a ************ *** ***** analytics, ***** ****, ****, and **** ** ($*-*/***** per ******), ****** **** do ******* * ***** cost $*.**/***** *** ****** for ********** ****** *******.

*** ******* ******** ** Wyze ******** ** ***** other ******* ** *** lack ** ******* ****** models, ***** ***** ************* offer. **** **** ***** outdoor ***** ** ******* for **** ****/***** ****.

************

**** ****** ********* ** available ** ******* *** ($** ***)******* *** ********** *** ****. ***** simply **** ** ******** the ****** ******** *** turn ** ****** *********.

Person ********* ***********

**** *** *** *** limitations ** **** ******** not ****** ** ***** consumer ** ********** ****** we **** ****** (****** present ** **'***** ****** * **** AI *********):

  • ****** ********* ******* ** 12 ******* *** *****
  • * ****** ******** ******* paid ****

** ******* ***** ** more ****** *****.

People ********* ******* ** ***** ** ******* ** *****

**** ****** ********* ***** only ** *** ***** 12 ******* ** **** motion ****. **** ***** that ** * ****** enters * ***** ***** motion ** ******* ***** 12 *******, **** **** not ** ********, *** will * ****** ****** trigger ** ********** ***** if *** ** ******* in *** *****.

**** ** ***** ***** this ********** ** ***** documentation *** ***** * notice ** ****** ********* clips ** ***** ****** app:

IPVM Image

**** *** ** ** issue ** ***** ***** constant ****** ** *******, such ** * ****** facing * ****** **** blowing *******, ** ****** detection *** ****** *** trigger. **, ** * subject ****** *** *** but **** *** ******* person ********* ****** ** seconds, ** ****** **** not *******, ***** ***** (green ******** *** ********* motion, *** ****** *********):

Five ****** ******** ****** ****** ****** ** *******

***** * ****** ********* event ** *********, ** default **** *** ** unconfigurable * ****** ******** period ****** ******* ****** detection ***** ** ****. This ***** ****** ***** missed ****** ********* ** high ******* ***** **** as ******* ** *******.

**** **** **** ** a **** ***** **********, not ** **/******** **********. We ********* **** ********** with **** **** *******, as ****.

IPVM Image

*** ****** ****** ******, this ******** **** *** exist, **** ****** **** closer (***** * ****** apart *****):

IPVM Image

No ******** **** **** ****

** ****** **** ********, Wyze ********** * **** plan ************** ****** ************ ********** *** * minute ******** ****** ******* events. ** *** *****, this ****** ** *******, with ********** ****** ********* events ******** ******* ***** seconds *****.

IPVM Image

**** **** ***** *** not ** ******** ******, but ****** ** **** 5 ****** ********, *.*., if ****** ***** * minutes, *** ***** *** created. *******, **** **** person ********* **** **** use *** ***** ** seconds ** **** ****, regardless ** ******.

******** ****** ******* ***** $1.50 *** *** ***** per ******.

Person ********* ***********

****'* ** ****** ********* performed **** ** *** tests, ********* ******** **** day *** ***** (**** IR **) **** ** missed ********** ** ******** walking ** ****** ** fast *****.

People-Detected-Day-And-Night-Walking-Normal_Fast-Speed

**** **** *** *** alert ** ****** ******* of ***** ****** ***** triggered **** *******, **** as ******* ** *** scene:

No False Alerts From Shadows

** ****** ******* ** and ***:

No False Alerts From Light Changes

************, ****** **** ****** are ****** ****, ** also ****** ***** ** analytics ********. ********, ****** Detection ******* ******* ******* and ******* ***** ********* other ****** ** **** tests. **** **** ******** boxes ******** ****** ****, not ****** *********.

No-False-Alerts-On-Foliage

***** *** ***** ******* were **** ******* ** Person *********.

No False Alerts On Animals

Running ******** ******

*** **** ****** ** detect ******* ******** ** our *****, ***** *****. However, ***** ***** ****** market (*********** ******), **** is **** ****** ** be * ******* **** commercial ******* ** **** residential ******* *******.

Running-Subjects-Completely-Missed

Simple *****: ****** ******** *** **** **

****** ********* ***** ** simple, ********* ***** **** to ****** ******** *** turn *** ******* ** on **** ******. ** setup *** ****, *******/******* sizes, ** ***** ************* is ********.

Simple-Setup--Switch-On-For-Each-Camera-copy

Xnor: *** ******* ******** **** **

****'* ****** ********* ********* were ********* ** *********** with****, * *******-***** *******. Xnor's ***** ** ** optimizing ****** ** *** on *** **** ******** hardware, **** ** ********** ******* ** *** **** Cam *****:

IPVM Image

**** ** *********** ****** as ****** *****-**** ***** perform **** ********, ***** historically *** *** **** capable. **** ** ** alternative ** ***** **** expensive **** ******** ***** such *******'* ******** ******.

****'* ****** *** ********** on *** ****, ******* analyzing ** *** *****. Wyze *********** **** ** Nest ** **** ******* cloud ************ (*** *************) to ****** ***** **** Aware/Arlo ***** *********. *********** **** ****'* ********* video********* ****:

**** *** ******* ** 2016 *** *** ****** nearly$*** *** ** ***. *** **** *******, see *** **** ******:******* ****.**, ********* ** YOLO, ***** ************ ***** Examined

Vs ********* ********* *** **** ******* ** ****** *********

**** ****** ********* ********* similarly ** **** ****** detection, *** ***-********** ******** in*** ******** ********* ********, **** **** ******** false ****** **** *******, lights, *******, *******, ***., though **** ****** ******* subjects.

**** ****** ********* ************ Hikvision's ********* *********, ** Hikvision ******* ** ******* such ** ******* ******* and ****** *******.

Hikvision False Alerts On Foliage Shadows

** **** ** ***** and ***** ******* ** the **********.

Hikvision False Alerts On Animals

*******, *********'* ********* **** alerted ** *** ********** of ******* ****, ***** neither *** **** *** Nest ******* ******* **.

Hikvision False Alerts On Headlights

Vs. **** *********

****'* ****** ********* *** not ******* ** **** sources ***** ****** ***** alerts ** **** ******* analytics, ********' ****,****** *****, ************ ************ *** ********* ** shadows, *******, ** ******* in *** *****.

**** ****** ** ******** object ********* ** ***** new******-* ****, ****** *********** ** the ***** ****** ***** this *** ****,*** *****-**** **** ******* ** slightly ****** **** **** tests.

Versions ****

*** ********* ******** **** used ****** *******:

  • **** *** **: *.*.*.**
  • **** ** *******: *******
  • ********* **-**********-*: **.*.** ***** 180718

Comments (40)

* **** *** ** these **** *** ********* installed ******* *** ** front ****** ** *** sidewalk ****** ** ** my *****. *** *** most **** ** *** worked ****** **** *********** this ** **** *** traffic, **** ********* * person **** ******* *** from *** ***** ** the ********. ** *** missed **** ******. ******* for *** ***** ***** these *** **** ****** cameras. * **** *** new ******* *** ***** bulbs ** **** *** haven't **** **** **** these *** ** * had *****. *** **** reason ** ******** ****** to *** ******* *** weekends *** ** ** spare **** *** **** involved ** ****. 😊

**** ** ********* **** for *** ********, ** this **** **** ********** to *** **** **** learning ********.

*******, ** ** ********* embarrassing *** *** *** big ********* **** ***** can’t ** ****. *** example, ********* *** *** its “*** ****”, “********* R&D”, **,*** “*********”, ******.  Axis ***, ***** **** do *** *** **** about **, **** ****** should ** **** **** to ******* ***** ***** premium.

** ** **** **** person ********* *** ***** this **** ** ****** normal *** ***** ************ but **** ** * good **** ** *** now ***** *****.

*** ***** ** **** typing *** **** *******. Spot **.

*** *** **** ***** ****** *** ****. :*

**** **** **** ** Wyze *******.  * **** not *** *** ****** with *** ****** ******* out ** ***** ****** at *** ******** *** get ** ************* **** faster **** *** **** I **** ******** *** same ****.  

****: * ******* *** title ** "**** ** Analytics ****** - **** Axis *** *********"

*** ****** ** ** emphasize *** ************ ** professional ***** ************. * can *** ** ***** and *********** **** **** is *** ** **** interest (*** **** **** report, *** ******* ******* we **** **** ** Wyze).

*******, **** **** *** done **** ** **** significant *** ************ ***** surveillance. **** ** ***** to **** * ******* or *** ******* ******* this **** *** **** 'regular' ****** *** ***** to ****** ****** ********* as ******** (**** ** they ***'* ********** **** 'deep ********' ** **** or ****** ************** **). And ******** **** **** and ********* *** ***** to **** ******* **** Wyze ** ******* **** they ***.

***** ************ ********* **** catch ** ******* ****** be **** *** ** could ******* ***** **** for ******** ** **.

* **** **** *** it ** ********** ** relation ** ****.  **** drives ** ***** ** the * ****** **** down *** *********.  ******* I **** *** ****** wrong, *** * ******* inserting ** ** **** would **** ***** ****.

****, *** *** ****** Detection ** ****, ****** when * ** ** in **** ** *** camera.....

***, **** *** ****** the ** **** *** can ** ** ******** settings > ***** ********* and ****** ********** *********, the ****** ****** **** just ************ ****** ** the ** **** *** you *** ****** ******* recorded *****.

** *** ***** ****** events **** ******** ****** 5 ******* ** ********* but ****** ********* ***** triggered * * ****** cooldown.

Motion Events No Cooldown

***, * *** *** that.  *** **** ****** I ******* ** ***** the ** **** ***** allow *** ** *********** record ****** ******* * minute ********.

** *** *** ****** detection ********* ** ******, I ****** **** ** allow *** ** ** privacy ***** ********* ****.

***** **** ***** **** be ** ******* ** Anyvision's ****** *********** ****** ****.

 

**** ******* *** ***/***** little ******.  *** **** if ** *** ******* here *** **** **** have * **** ******** so *** *** **** it **** ***** *** VMS.  * **** * few ******* **** * have ********* ** ** with **** *** **** are *** *****.

** **** *** ******* Wyze's **** *******.

********* ** ******* *** **** *******, ** ** * separate ******** ******* **** will ** ******** ************, so ** * ******** / **** *********, ** could **** ***** *** not **** **** *** commercial ************.

***... **** ***...

* **** * ** these ** ** ***** and *** **** ***** that **** ** ** the *** ***** ****, but **** ** * tiny *********.  **** **** fine *** ******* ******* stuff *** ****** **** my *** ** *** eating *** *****.  

* ** ******* ***** the ******** *****.  **** Xnor ****** **** * per-unit *******?  ***?  **** sort ** *********** ***** on ****** ********?  ** Wyze **** ****** *** cost *** *** ** order ** **** ******** in ****** *** *****, maybe ************ *****, ** algorithms?

**** ******** ** ******** pricing ****** ********** **** it ** * ********* / ******** ***** *****.

** ***** ** **** it ** ** ***** somewhat ** * ***** / ****** ***** ****.**'* wordmark ** ********* *** on **** *****, ***** is ** ************** ****. It's *** **** *********** speaking **** ***** **** to **** ****'* ******** on ***** ***** ****** so ****'* *** * guess ** *** **********. If ** **, ** is ******** * **** deal *** **** ***** that **** *** **** lots ** ******** *** other ********* *********.

* **** ******* **** Wyze *** **** ********* questions ***** ***** ****** detection:

* **** *** ******* yet, ******* ***** *** others **********.

********** * ***** ****** would ****** *** **** as *** *********.  *** damn ****** ******* ** sun ******* ********** *** day.  

***, ** ****** **** and ********* *** ******** as **** *** ************ the ******* ******* *** China *************.

*** **** ***** **** Dahua, ******, ******* *** pretty **** ***** ***** mainstream ****** ************ ***** now **** *** ******** and *****. *******: ** ****** ********* ******** - ********, ****, *****, Dahua, ******, *********, *******

* ****** **** ** retract ** ******** ******* about *** ****** *********. My ****** ****’* ******** anyone *** **** **** a **** ***. * even ***** ******* *** a *** ******* ** the ****** *** ********* me. ***** ** * glitch *** **** ** be ****** *** *** back ** *** **** to **** ** ** that ***. 

* *********** ********* ******* with ** *******, ** was **** *** ************* needed ** ** ******* on/off, *** *** ****** in ** *********.

********, ******* (* ******* chip ************), ** **** a ******** *** ****** (for **** ********* *******) and, **** *************, ********* (!) *** ***** ** be ****** ****** ** the ******* **********:

*****://***.*******************.***/*******-****/*******-*******-*****-********-******-*******-***-***-***-********.****

* ****** *** **** "stitches" *** *** **** real ********** ** ****** Xnor *** **** ** the ***** "**" ***** is ****** *** ****, as *** *** ************* states **.

 

**** ******* * ****** of *****.  ***'* **** to *** **** ***!  Anybody **** ** *** AWS ***** **** ***** in ******?

**#*, * ******* **** Wyze *******, ***** ********:

***! *** ***** ******* is ********* ** ********* whose ******* *** ***** and ******* ** ****** and ***** ********* ******* of *** *.*.

****** ***. * ********* 4 **** *******, * motion ****** *** * door ******** ***** * weeks ***. *'* ** sales ** *** ************* side. **** **** ** install *** ** ************ was **** *** ** it **** ** **** for *** ** **** readers. ****** ********* *** significant ***** ********* ********* but **** *** ******** to *** ***** ** almost **** ***** *********. It ********** ****** ****** at ***** ******. ***** example: **'* ********* *** and * ** *** office. * *** *** my *******-**-*** ******** ** beer ** *** "******** camera" *** ***** *** no ****** ******** ** the ******** ** ** the ***** ** *** house. (*** **** **** to *** ** ** back ****.) **** *** not ****** ** *** 5-minute ******** ******* ** people **** **** ******** since *:****. * **** on * ****** ***** residential ****** ** *** city. ****** **** ********** walked ** ** *** sidewalk ** ***** ** my ***** ** *** past * *****.

****** **** ****; *'* pretty ********* **** ****. For ***** *********** *** they **** ****** ******* at * **** *** price *** **** **** installation. ** *** **** to **** ** ****** security ******* *** **** install *** *****-** ******* though. ********* *** *** 12 ******* ** *** burglar *********** ** *** distance *** **** * 5 ****** *****. ********* the ******* *** ** can ** ****** ****** or *********. *** **'* better **** ** ****** system.

*** ******* ******** **** work ****** **** *** alert ******** ** ** phone ** ***** ***** are **** ****. **** blogged ******** ***** ** outdoor ******; ******* ******* to ******** **** ***...

Test ****** / ****-**-**:

*** ****** *** **** up *** ******* ***** we ********* *** ****, looking ** *** ********* and ******* ****. ***** alert *********** *** **** very *****, **** **** 2 ***** ****** ** the **** ****, **** at *****, ********* ** a *** ****** **** the ******. *** **** clip:

** *** **** ******** alarms **** ***** ******* here, **** **** *** overhead ****** ******* ** and *** *** * nearby **** *******/******* ***** the ****** *** *** in **** ****.

****** -

**** *** ***** **** ***-** ******* *** 1.49/month**** ******* *** ******** period ******* ****** ******, we **** ** ******* this *** ********* ** update ** *** ******.

**** **** ******* ***...** can't ** **** **** to *********

**** ******:

"****** ******** **** ** temporarily ******* **** **** Cam ********* **** * new ******** ******* ******* for ***-******* ****, *** to *** ********** *********** of *** ********* **** our ** ********."

***** **** *** ******* is **.

** ******** **** ***** as **** *** *** in *** ******* ** getting **** ******* **** Wyze *** ****. **’** post **** **** ** have ** ******.

**** **** ************ **** they **** *** * falling *** **** ****. It *** ** ** with *** ********* **** had ** *****. ***** they *** *** ********* they ****** *** *** they **** **** *****? It ***** ** *********** to **** *** *** and ******* **** ** able ** ****** ******** comparable (**'* ********* ** the **** ***** *****) to ******* **** (***** is ** ****** ***** on *** *******).

******** ****** ********* ** cew ****** ***** ** one *****. ** ****** like **** **** ******* to ******* ******* *********! I ***'* *** *** than **** **** *** firmware *********. **** ********* the ***** **** **** sold *** **** **** person *********. ****** **** can't **** ***** "******" a *** ******* ** product **** *********...

***'* **** ******* *** scrapping ****** *** ****** on *** ** ****!

***

***,

**** ** ** ** not ******* ********?

***** **** ***** * bigger *****.

******* ****** ** **** deserves ** ** **** didn't **** * **** contract ** *****.

**** ******** * ******** for ******** ******** *** their **********-********** ********* ***** **** not **** * ******* date. ** ** ********* shown ** ***** ** Alpha:

Product Progress Bars-12

**** *** **** ** say, ***** **** ****** up *** ***** "****" as * ******* ****:

** **** ****** ****** when ** *** ** remove ****** ********* **** Wyze **** *** ** the ****.** ***********. ***** their ***********, ** **** been ******** **** ** our ********. *** **-***** person ********* *** *** Wyze **** ** ** alpha *******. ** *** making ***** ******* **** and ****** **** **** highly ********* ******* **** again ****.

*** *****. **** ******** released ***** ******* ** Person *********. ***** **** to *** ** **********. Also ********* ** *'* at **** ** ******* the *** ******** **** Xnor *********....

** **** ** ******* it, *** ** **** probably ** ** * few *****. *** *** been ** *** **** test ******* *** *** be **** ** ***** some ********. *** **** make ***** ****** ********* public? * ******* *** newsletters **** **** ***** that **** ** *****.

** *** ** * risk ** ******* *** firmware, * ** *** sure. ***** ******* ***** don't ******* ******** ************, but **** *****'* **** there ****'* ***.

******* **** *** ******** their ******* *** ***'* find ********. ***** * was ********. "***** ****" is **** ** **** stage *** **** ***** to **** * ***** problem. ***** ******, ******* bands, ***...

*** **** ***** **** have ******** ** ******** to ******* * ****** into * ******. *** anyone ***** **** *************?

**** ******** ***** ***** own "****** *********" *********? Is **** ******** ** testing **? **** *** others **** ****** **? I **** * **** but **** *** **** doing ******* ** **** the **** *********.

Read this IPVM report for free.

This article is part of IPVM's 6,810 reports, 914 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now
Loading Related Reports