Alarm.com "AI" Video Analytics Tested

By: Brian Rhodes, Published on Nov 30, 2018

Alarm.com has announced what it calls an "artificial intelligence (AI) architecture and video analytics service", touting that 

Alarm.com's computer vision research team trained the AI engine with millions of frames of video donated from field-deployed cameras, and extensive feedback from service provider partners and beta program participants.

Indeed, this follows Alarm.com's 2017 acquisition of Object Video, the original, but much-maligned, video surveillance analytics provider.

How good is Alarm.com's "AI" Engine? We own an Alarm.com system (tested here), connected a supported camera, enabled the "AI" analytics and tested the system.

tested 2

In this report, we share our results including:

  • Analytic performance rankings
  • False alert resistance versus foliage, shadows, animals, lights, and more
  • Detection distances/PPF levels
  • Configuration/zone creation for each
  • How pricing compares, for cameras and cloud service

*****.****** ************* ** ***** ** "artificial ************ (**) ************ and ***** ********* *******", touting **** 

*****.***'* ******** ****** ******** team ******* *** ** engine **** ******** ** frames ** ***** ******* from *****-******** *******, *** extensive ******** **** ******* provider ******** *** **** program ************.

******, **** ******* *****.***'* **** *********** ** ****** Video, *** ********, *** much-maligned, ***** ************ ********* provider.

*** **** ** *****.***'* "AI" ******? ** *** an *****.*** ****** (****** ****), ********* * ********* camera, ******* *** "**" analytics *** ****** *** system.

tested 2

** **** ******, ** share *** ******* *********:

  • ******** *********** ********
  • ***** ***** ********** ****** foliage, *******, *******, ******, and ****
  • ********* *********/*** ******
  • *************/**** ******** *** ****
  • *** ******* ********, *** cameras *** ***** *******

[***************]

Key ********

*** ******* ****** **** the ****** *** ******* decent ******** ** ************ VMD *** *** ****** that ***********, ********* **** 2 **** ******:

  1. *** ****** *** ****** restrictive / *********** ************ 'recommendations', **** ******* ** - **° ********.
  2. **** **** *** ******** recommendation, ***** **** ***** false ********* (*.*., ****** ***** categorized **** ** ****** were *******).
  3. *******, *** ********* *** restrictive downtilt **************, *** ***** positives **** **** **** significant.

**** *****, ******** ** conventional ***, ******* ***** alerts **** *****.

Solid ***** ***** **********

** *** *******, *****.***'* Video ****** ********* (***** Analytics) *** ********* ********* in ******** ****** ***** alerts ****** ** ******* foliage, ****** ******, *****, insects, *******, *** ****** which ********** ********* ************** ********* ** *** testing.

********** *** *********** *** customers, ***** *** ***** Analytics ****** **** *** down ** *** **** 'false *****' ******. *******, it *** ******* *** reliable ****** ** ********* all ******.

Classification ******

*** ******* ******** *********** is *** ******** ***-***-****, even **** ******* *** installed ********* ** *************.  Some *******/****** **** ***** to ** **** ****** inaccurate **** ******. *** example, *** ****** ******** often ******** *** ******* 'people' ** *** **** scene ** ********:

** ******* ** ***** events, ** ****** **** present, ******* *** *****. The ******** ** ** LP-Natural **** *** *****, in *********** **** * moving *******, ***** ******** in *** ****** ********* the *** ***** ******** as * '******':

** ***** *****, *** system ****** ****** *** animals ********, ** ** this *****:

not all people animals detected

****** *** ********** ** the *** **** * person ******* ** ** classification ****.

Small ****** *********

*** **** ***** ******** the '******' ************** ** working. *** ****** *** not **** ** ****** and ****** ****** ******** accurately (** **** *********, dogs *** *******), *** the ****** *** *** classify *** ******** ** 'animal' ********* ** *** way ** ******* ****** and ********.

*** **** ***** ** an ******* ** ********, but *** **********, ****** movement:

********** *********** ***** ****** may ***** ********* ********, especially ** ***** *** rules ** ****** *** general ****** ****** **** a **** *****-***** ***********, but ******* ******* ****** to ***** ** ******* or **** **** *** be ********* ** **** that **** ****** *****.

** ***** *****, *** zone ****** ********* *** have ** ** *** as **** ** **** 'fast' ***** ***** ** 0.5 ******* ** **** an ***** ** ****** small ** ****-****** *******, but ***** ******** *** also ************* ******** ******** alarms ** *** **** time.

Steep ******** *********

****** **** *** ******** analytic ****** ** ******, Alarm.com *** *********** *********** requirements ** **-**° ********, mounted ** ***** * feet **** *** ** coverage ****** **' ** night:

steep downtilt setup recommendation

*** *********** ** ***** makes ** ***** *********** in *** ** *** be ***** *** *** far ** *** *****, even ******** ***** ** consumer *********.

Nonconformance ********* ******

******* *** ****** ** be *** ** **** shallower *********, ******** **-**° for ****** *** ** users ** ********** *** familiar **** ***'* **************.

*******, ** **** *****, we *********** ***** ******** errors ** * ******.  For *******, ** **** case * ******* *** not ********** ** ** approached *** ******, *** was ********** ******** ***** the **** ** ** was *******:

**** **** ***** ******* was ******* ** ** activity ***** ** *** system, *** ********* *** clip ***** ** *********** movement ** *** ****** at ***:

***** ******** ******** ****** did *** ******* **** adjusted ** *** ******** specification *********** ** ***, but ***** ******** ***** are *** ***** ** highlighted ** ********* ********* during *****.

Rain/Snow ********* ******

** **** *** *** tested **** *** **** to *** **** ****** that ******. ** ****** to *** **** ** the **** ****** *** will **** ** ****** in *** ******.

******: **** ***********

***** * ~* **** period ** ****** **** in ******* *** *****, our **** *** *** record *** ***** ******** or ******** ****** ** classification.

Detection *********

*** ******* ************ ******** objects ********** ** *** levels ***** **** ********* in *** ***** *****.  For *******, *** ***** disclaims ****** ********* ****** 25' ** *** *** 15' ** *****, *** the ****** ********* ****** at **** ** ***** ranges.

*** ***** ***** ***** ~50' ************** ** * vehicle ** ******* *****:

Good *** **********

******* ****** ******* ** VMD **** ***'* ********* overcomes ** ****** ********** due ** ****** *******, leaves, *** *******.  *** ADC ****** *** *** trigger ********** ** **** nuisance ************* ** *** point ****** *** ****.

**** ** ** ******* clip ******* ****** ******** that ***** ******* *** but *** *** ***** Analytics *****:

Motion/Analytic *************

** ******, *** ** offering *** ********* *****, a ***- ** ************* 'tripwire' ** * '****** zone' **** ******* **** objects ***** ****-******* *****:

** ******** ** *** rules, ***** *** ********* assign *** **** ******* must ** ** ********* of *** **** ****** an ***** ** ****, or **** ** ***** arm/disarm ****** ** **** of *** ********** ********. The ******** **** ****** assigning ** ***** ** objects ***** ** *** direction ** *** *****.

*** '****** ****', *** detection **** ***** ** flexible *** *********** ****** scenes ******* *********** ********* areas:

Camera *********

*****.*** ****** ~* ***** camera ******, *** **** 2 ** **** *** supported ** ***** ** analytics, *** ****** ***** w/IR (***-******) ********* ******** (***-*****). ** ****** *** (Vivotek ***'*) ******* ****, shown ** *** *****. 

Camera/Service *******

*** *** ******* ******* a ******* ************ ** order ** ******* ********/***** alerts ***/** **** ***** video. ****** ******* ** ~$1 **** *** ***** added ** *** ~$*/*** four ******* '***' ***** plan ** ******** *** AI *********. *** ********* package **** **** ******** clips, ******** *** ***** to *,*** *** * cameras ** **** *,***. Camera ****** *** ~$*** for ***-*****.

Versus ******/****

****'* ********* **** **** accurate **** *****.*** *** does *** ********* **** installation ************. ***** ****** detection ********* ** *** require * ************ ** receive ******. *******, ***** video ******** ** *********** without * **** ***** ************, ******* **** $*/***** per ****** (* ****) through $**/***** *** ** days. *** **** ******* IQ ** ********* ******** **** **** *** $349.

Versus ****

*******'* ****** ********* *** more ***** ****** *** require **** ****** ******** distances/higher *** **** ***. Arlo ****** ********* ********* require * ************ ** **** *****, ******** ** $*.** per ******, ********* * days *******, *** ** to $**.** *** ** days *******. **** ******* and **** ******* ***** at $*** *** *** original **** **** ** $*** *** *** ***** **** *

Versus ******/****

** *******, ***'* ********* are ****** ********** **** Amazon/Ring, *** ******* ***** quality *** **** ** not **** *** ***** made ***** ** ******* WiFi.

****'* "******** ****** *********" motion ********* **** *** require * ************ *** motion ******, ******** * subscription ** ****** ** view ******** ***** ******** at $* *** *****. **** ********* *** ******* *** $*** *** can ** ********* **** the **** *******.

Comments (13)

John Honovich

IPVM | 11/30/18 12:19pm

*****, **** ******!

******* **** ** ** more ******** *** ************ about ***** "**" ** marketing, ** ******** *********** like **** ** ***** to ********** *** ********* *** confidence ** "**" *********.

** *** *** ****, since ******* ******** ** generally ********** **** ** AI *** ****** *****.*** is ***** **** **** of ******* ********, **** could *********** **** *** case **** ** ** "AI".

*** ******* ** **** most ****** ****** "**" to **, ****, *********** or ** ***** ** intelligent ** * *-****-***. For $* * *****, this ** *** * bad ******** *** **'* not **** ****** ** be ******* *** **** accuracy ** ** ** marketed ** "**".

Avatar

Brian Rhodes

IPVMU Certified | 11/30/18 03:45pm

*** *********** ****** ** the '**' ************** ** that '********' ** ****** coarse *** **** ******* without **** **********.

***** ***, ** ***** learning ******* ** *** video ** ******** **** ADC's ***** *** ** opt-in ******* *******:

*****.*** ********* ** ** in * **** **** plan ** *** * self-reporting ******* ******** ***** to **** *********** ********** objects.

*** ******** **** *** currently **** **** ** any ****** ** ******** 'teach' ** '*****' *** system ***** ** **** feedback.

Undisclosed #1

In reply to Brian Rhodes | 11/30/18 04:52pm

***** ***, ** ***** learning ******* ** *** video ** ******** **** ADC's ***** *** ** opt-in ******* *******...*** ******** does *** ********* **** this ** *** ****** to ******** '*****' ** 'learn' *** ****** ***** on **** ********.

******* ********, ****/*** *** it ***** **** **** the ***** ***********?

Avatar

Brian Rhodes

IPVMU Certified | In reply to Undisclosed #1 | 11/30/18 05:49pm

*** **** ******** ** general *****, **** ***** 'internal *******' ******* *******.  The ******* **** *** describe ******* ******* ******** is *********, ***** **** checking, ** **** ***** refinement ******.

Avatar

Michael Gonzalez

Integrated Security Technologies, Inc. | 11/30/18 06:49pm

********* ****** *****! ****** for ***** ****, ** saved ** * ******* amount ** ****.

Scott Sheldrake

12/01/18 12:58am

****** *** *** ******** report.  ****** ****** **** you **** **** ******* a **** ****.  ****'* going ** ** *** real ****.

** *** **** * rough **** ** *** number ** ***** *** get ** * ******* day?  *** **** **** the ********** **** ****/***** recommendation **** *** **** up?  **** ***** /**= 33 ***** *** *** or *.* ***** *** hour.  ***** ******** *** would ** **** ** have **** **** **** clips *** *****.

Avatar

Brian Rhodes

IPVMU Certified | In reply to Scott Sheldrake | 12/02/18 04:08am

*'* ********* ***** ******** now.  ** ***** **** our ****** **** ****** averages ** ***** *** day (*=* ****, *** clips).

************* **** ***, ** clips/day * ** **** = *** *****/*****.

*******, *** **** ****** was ******* ** * fairly ***** ********.  * busy *****, **** * residential ***, ***** ****** 1000 *****/* *** ******.

 

Undisclosed #2

12/01/18 06:19pm

*******-********** ** ** ****:*** ******

Avatar

Brian Rhodes

IPVMU Certified | In reply to Undisclosed #2 | 12/02/18 03:55am

***** = */**

Avatar

Brian Rhodes

IPVMU Certified | 12/02/18 04:21am

******: **** *********** (***** above ** ******)

***** * ~* **** period ** ****** **** in ******* *** *****, our **** *** *** record *** ***** ******** or ******** ****** ** classification.

Undisclosed #1

In reply to Brian Rhodes | 12/02/18 07:23am

...*** **** *** *** record *** ***** ******** or ******** ****** ** classification.

*** ** **** ****** ;)

Avatar

Brian Rhodes

IPVMU Certified | In reply to Undisclosed #1 | 12/02/18 04:17pm

****** ****, *****'* *** possibility **** ****** ** already ** *******'* *******...

Scott Sheldrake

12/15/18 09:52pm

**** ***** ********** *** video : 

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Bezos-Funded Deep Sentinel Tested on Mar 28, 2019
Backed by Jeff Bezos, the Silicon Valley startup, Deep Sentinel, has declared: No One Does Home Security Like We Do Our Surveillance Team has...
Bosch AI Camera Trainer Released And Tested on Apr 09, 2019
Bosch is releasing a highly unusual new AI feature - 'Camera Trainer'. Now, coming as a standard feature in Bosch IVA/EVA analytics, one can train...
Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...
Wyze AI Analytics Tested - Beats Axis and Hikvision, Now Improved, Now Being Terminated on Nov 25, 2019
When we originally tested Wyze's free person detection deep learning analytics in July 2019, they performed well, with few false alarms, but a long...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they claim their new Analytics+ "algorithms significantly improve accuracy and...
Yi Home Camera 3 AI Analytics Tested on Sep 10, 2019
Yi Technology is claiming "new AI features" in its $50 Home Camera 3 "eliminates 'false positives' caused by flying insects, small pets, or light...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Consumer IP Camera Analytics / AI Shootout - Arlo, Google / Nest, Amazon / Ring, Hikvision / Ezviz, Wyze Cam, Yi Home on Sep 26, 2019
AI analytics are hitting the mainstream in the consumer camera market, with entrants Wyze and Yi Home releasing free people detection on their...
Camect "Worlds Smartest Camera Hub" Tested on Oct 18, 2019
Camect is a Silicon Valley startup that claims the "Smartest AI Object Detection On The Market", detecting not only people and vehicles, but...
Halo Smart Vape Detector Tested on Jan 16, 2020
The Halo Smart Sensor claims to detect vaping, including popular brand Juul and even THC vapes. But how well does it work in real world...

Most Recent Industry Reports

Hazardous & Explosion Proof Access Control Tutorial on Feb 27, 2020
Controlling access to hazardous environments requires equipment meeting specific ratings that certify they will not start fires or will not...
Motorola / Avigilon Drops ISC West on Feb 26, 2020
Motorola Solutions has pulled out of ISC West 2020 effective immediately, because of coronavirus concerns, IPVM has learned. This is done amidst...
Cancel or Not? Industry Split Over ISC West on Feb 26, 2020
The industry is split, polarized, over whether ISC West 2020 should run or be canceled. New IPVM survey results of 400+ respondents show heated...
Coronavirus Hits Sony, Bosch Says Switch on Feb 26, 2020
Sony's fall in video surveillance has been severe over the past decade. Now, they may be done. In this note, we examine Bosch's new...
Video Surveillance Cameras 101 on Feb 25, 2020
Cameras come in many shapes, sizes and specifications. This 101 examines the basics of cameras and features used in 2020. In this report, we...
Favorite Video Analytic Manufacturers 2020 on Feb 25, 2020
Video analytics is now as hot as ever, driven by the excitement of advancing deep learning offers. But what are actually integrator's...
Latest London Police Facial Recognition Suffers Serious Issues on Feb 24, 2020
On February 20, IPVM visited another live face rec deployment by London police, but this time the system was thwarted by technical problems and...
Masks Cause Major Facial Recognition Problems on Feb 24, 2020
Coronavirus is spurring an increase in the use of medical masks, which new IPVM test results show cause major problems for facial recognition...
Every VMS Will Become a VSaaS on Feb 21, 2020
VMS is ending. Soon every VMS will be a VSaaS. Competitive dynamics will be redrawn. What does this mean? VMS Historically...
Video Surveillance 101 Course - Last Chance on Feb 20, 2020
This is the last chance to join IPVM's first Video Surveillance 101 course, designed to help those new to the industry to quickly understand the...

What IPVM Is

The world's leading authority on video surveillance, with 200,000+ visits monthly.

  • Articles on cameras, video analytics, VMS, and trends
  • Tests showing actual performance and problems
  • Courses in surveillance, access control, etc
  • Camera Calculator for designing systems

Dedicated To Independence

We're dedicated to staying independent and objective. We're the only industry source to refuse any and all advertisements, sponsorship, and consulting from manufacturers. Why?