Alarm.com "AI" Video Analytics Tested

By: Brian Rhodes, Published on Nov 30, 2018

Alarm.com has announced what it calls an "artificial intelligence (AI) architecture and video analytics service", touting that 

Alarm.com's computer vision research team trained the AI engine with millions of frames of video donated from field-deployed cameras, and extensive feedback from service provider partners and beta program participants.

Indeed, this follows Alarm.com's 2017 acquisition of Object Video, the original, but much-maligned, video surveillance analytics provider.

How good is Alarm.com's "AI" Engine? We own an Alarm.com system (tested here), connected a supported camera, enabled the "AI" analytics and tested the system.

tested 2

In this report, we share our results including:

  • Analytic performance rankings
  • False alert resistance versus foliage, shadows, animals, lights, and more
  • Detection distances/PPF levels
  • Configuration/zone creation for each
  • How pricing compares, for cameras and cloud service

*****.****** ************* ** ***** ** "artificial ************ (**) ************ and ***** ********* *******", touting **** 

*****.***'* ******** ****** ******** team ******* *** ** engine **** ******** ** frames ** ***** ******* from *****-******** *******, *** extensive ******** **** ******* provider ******** *** **** program ************.

******, **** ******* *****.***'* **** *********** ** ****** Video, *** ********, *** much-maligned, ***** ************ ********* provider.

*** **** ** *****.***'* "AI" ******? ** *** an *****.*** ****** (****** ****), ********* * ********* camera, ******* *** "**" analytics *** ****** *** system.

tested 2

** **** ******, ** share *** ******* *********:

  • ******** *********** ********
  • ***** ***** ********** ****** foliage, *******, *******, ******, and ****
  • ********* *********/*** ******
  • *************/**** ******** *** ****
  • *** ******* ********, *** cameras *** ***** *******

[***************]

Key ********

*** ******* ****** **** the ****** *** ******* decent ******** ** ************ VMD *** *** ****** that ***********, ********* **** 2 **** ******:

  1. *** ****** *** ****** restrictive / *********** ************ 'recommendations', **** ******* ** - **° ********.
  2. **** **** *** ******** recommendation, ***** **** ***** false ********* (*.*., ****** ***** categorized **** ** ****** were *******).
  3. *******, *** ********* *** restrictive downtilt **************, *** ***** positives **** **** **** significant.

**** *****, ******** ** conventional ***, ******* ***** alerts **** *****.

Solid ***** ***** **********

** *** *******, *****.***'* Video ****** ********* (***** Analytics) *** ********* ********* in ******** ****** ***** alerts ****** ** ******* foliage, ****** ******, *****, insects, *******, *** ****** which ********** ********* ************** ********* ** *** testing.

********** *** *********** *** customers, ***** *** ***** Analytics ****** **** *** down ** *** **** 'false *****' ******. *******, it *** ******* *** reliable ****** ** ********* all ******.

Classification ******

*** ******* ******** *********** is *** ******** ***-***-****, even **** ******* *** installed ********* ** *************.  Some *******/****** **** ***** to ** **** ****** inaccurate **** ******. *** example, *** ****** ******** often ******** *** ******* 'people' ** *** **** scene ** ********:

** ******* ** ***** events, ** ****** **** present, ******* *** *****. The ******** ** ** LP-Natural **** *** *****, in *********** **** * moving *******, ***** ******** in *** ****** ********* the *** ***** ******** as * '******':

** ***** *****, *** system ****** ****** *** animals ********, ** ** this *****:

not all people animals detected

****** *** ********** ** the *** **** * person ******* ** ** classification ****.

Small ****** *********

*** **** ***** ******** the '******' ************** ** working. *** ****** *** not **** ** ****** and ****** ****** ******** accurately (** **** *********, dogs *** *******), *** the ****** *** *** classify *** ******** ** 'animal' ********* ** *** way ** ******* ****** and ********.

*** **** ***** ** an ******* ** ********, but *** **********, ****** movement:

********** *********** ***** ****** may ***** ********* ********, especially ** ***** *** rules ** ****** *** general ****** ****** **** a **** *****-***** ***********, but ******* ******* ****** to ***** ** ******* or **** **** *** be ********* ** **** that **** ****** *****.

** ***** *****, *** zone ****** ********* *** have ** ** *** as **** ** **** 'fast' ***** ***** ** 0.5 ******* ** **** an ***** ** ****** small ** ****-****** *******, but ***** ******** *** also ************* ******** ******** alarms ** *** **** time.

Steep ******** *********

****** **** *** ******** analytic ****** ** ******, Alarm.com *** *********** *********** requirements ** **-**° ********, mounted ** ***** * feet **** *** ** coverage ****** **' ** night:

steep downtilt setup recommendation

*** *********** ** ***** makes ** ***** *********** in *** ** *** be ***** *** *** far ** *** *****, even ******** ***** ** consumer *********.

Nonconformance ********* ******

******* *** ****** ** be *** ** **** shallower *********, ******** **-**° for ****** *** ** users ** ********** *** familiar **** ***'* **************.

*******, ** **** *****, we *********** ***** ******** errors ** * ******.  For *******, ** **** case * ******* *** not ********** ** ** approached *** ******, *** was ********** ******** ***** the **** ** ** was *******:

**** **** ***** ******* was ******* ** ** activity ***** ** *** system, *** ********* *** clip ***** ** *********** movement ** *** ****** at ***:

***** ******** ******** ****** did *** ******* **** adjusted ** *** ******** specification *********** ** ***, but ***** ******** ***** are *** ***** ** highlighted ** ********* ********* during *****.

Rain/Snow ********* ******

** **** *** *** tested **** *** **** to *** **** ****** that ******. ** ****** to *** **** ** the **** ****** *** will **** ** ****** in *** ******.

******: **** ***********

***** * ~* **** period ** ****** **** in ******* *** *****, our **** *** *** record *** ***** ******** or ******** ****** ** classification.

Detection *********

*** ******* ************ ******** objects ********** ** *** levels ***** **** ********* in *** ***** *****.  For *******, *** ***** disclaims ****** ********* ****** 25' ** *** *** 15' ** *****, *** the ****** ********* ****** at **** ** ***** ranges.

*** ***** ***** ***** ~50' ************** ** * vehicle ** ******* *****:

Good *** **********

******* ****** ******* ** VMD **** ***'* ********* overcomes ** ****** ********** due ** ****** *******, leaves, *** *******.  *** ADC ****** *** *** trigger ********** ** **** nuisance ************* ** *** point ****** *** ****.

**** ** ** ******* clip ******* ****** ******** that ***** ******* *** but *** *** ***** Analytics *****:

Motion/Analytic *************

** ******, *** ** offering *** ********* *****, a ***- ** ************* 'tripwire' ** * '****** zone' **** ******* **** objects ***** ****-******* *****:

** ******** ** *** rules, ***** *** ********* assign *** **** ******* must ** ** ********* of *** **** ****** an ***** ** ****, or **** ** ***** arm/disarm ****** ** **** of *** ********** ********. The ******** **** ****** assigning ** ***** ** objects ***** ** *** direction ** *** *****.

*** '****** ****', *** detection **** ***** ** flexible *** *********** ****** scenes ******* *********** ********* areas:

Camera *********

*****.*** ****** ~* ***** camera ******, *** **** 2 ** **** *** supported ** ***** ** analytics, *** ****** ***** w/IR (***-******) ********* ******** (***-*****). ** ****** *** (Vivotek ***'*) ******* ****, shown ** *** *****. 

Camera/Service *******

*** *** ******* ******* a ******* ************ ** order ** ******* ********/***** alerts ***/** **** ***** video. ****** ******* ** ~$1 **** *** ***** added ** *** ~$*/*** four ******* '***' ***** plan ** ******** *** AI *********. *** ********* package **** **** ******** clips, ******** *** ***** to *,*** *** * cameras ** **** *,***. Camera ****** *** ~$*** for ***-*****.

Versus ******/****

****'* ********* **** **** accurate **** *****.*** *** does *** ********* **** installation ************. ***** ****** detection ********* ** *** require * ************ ** receive ******. *******, ***** video ******** ** *********** without**** ***** ************, ******* **** $*/***** per ****** (* ****) through $**/***** *** ** days. *** **** ******* IQ ** ********* ******** **** **** *** $349.

Versus ****

*******'* ****** ********* *** more ***** ****** *** require **** ****** ******** distances/higher *** **** ***. Arlo ****** ********* ********* require * ************ ** **** *****, ******** ** $*.** per ******, ********* * days *******, *** ** to $**.** *** ** days *******. **** ******* and **** ******* ***** at $*** *** *** original **** **** ** $*** *** *** ***** **** *

Versus ******/****

** *******, ***'* ********* are ****** ********** **** Amazon/Ring, *** ******* ***** quality *** **** ** not **** *** ***** made ***** ** ******* WiFi.

****'* "******** ****** *********" motion ********* **** *** require * ************ *** motion ******, ******** * subscription ** ****** ** view ******** ***** ******** at $* *** *****. **** ********* *** ******* *** $*** *** can ** ********* **** the **** *******.

Comments (13)

*****, **** ******!

******* **** ** ** more ******** *** ************ about ***** "**" ** marketing, ** ******** *********** like **** ** ***** to ********** *** ********* *** confidence ** "**" *********.

** *** *** ****, since ******* ******** ** generally ********** **** ** AI *** ****** *****.*** is ***** **** **** of ******* ********, **** could *********** **** *** case **** ** ** "AI".

*** ******* ** **** most ****** ****** "**" to **, ****, *********** or ** ***** ** intelligent ** * *-****-***. For $* * *****, this ** *** * bad ******** *** **'* not **** ****** ** be ******* *** **** accuracy ** ** ** marketed ** "**".

*** *********** ****** ** the '**' ************** ** that '********' ** ****** coarse *** **** ******* without **** **********.

***** ***, ** ***** learning ******* ** *** video ** ******** **** ADC's ***** *** ** opt-in ******* *******:

*****.*** ********* ** ** in * **** **** plan ** *** * self-reporting ******* ******** ***** to **** *********** ********** objects.

*** ******** **** *** currently **** **** ** any ****** ** ******** 'teach' ** '*****' *** system ***** ** **** feedback.

***** ***, ** ***** learning ******* ** *** video ** ******** **** ADC's ***** *** ** opt-in ******* *******...*** ******** does *** ********* **** this ** *** ****** to ******** '*****' ** 'learn' *** ****** ***** on **** ********.

******* ********, ****/*** *** it ***** **** **** the ***** ***********?

*** **** ******** ** general *****, **** ***** 'internal *******' ******* *******.  The ******* **** *** describe ******* ******* ******** is *********, ***** **** checking, ** **** ***** refinement ******.

********* ****** *****! ****** for ***** ****, ** saved ** * ******* amount ** ****.

****** *** *** ******** report.  ****** ****** **** you **** **** ******* a **** ****.  ****'* going ** ** *** real ****.

** *** **** * rough **** ** *** number ** ***** *** get ** * ******* day?  *** **** **** the ********** **** ****/***** recommendation **** *** **** up?  **** ***** /**= 33 ***** *** *** or *.* ***** *** hour.  ***** ******** *** would ** **** ** have **** **** **** clips *** *****.

*'* ********* ***** ******** now.  ** ***** **** our ****** **** ****** averages ** ***** *** day (*=* ****, *** clips).

************* **** ***, ** clips/day * ** **** = *** *****/*****.

*******, *** **** ****** was ******* ** * fairly ***** ********.  * busy *****, **** * residential ***, ***** ****** 1000 *****/* *** ******.

 

*******-********** ** ** ****:*** ******

***** = */**

******: **** *********** (***** above ** ******)

***** * ~* **** period ** ****** **** in ******* *** *****, our **** *** *** record *** ***** ******** or ******** ****** ** classification.

...*** **** *** *** record *** ***** ******** or ******** ****** ** classification.

*** ** **** ****** ;)

****** ****, *****'* *** possibility **** ****** ** already ** *******'* *******...

**** ***** ********** *** video

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Camect "Worlds Smartest Camera Hub" Tested on Oct 18, 2019
Camect is a Silicon Valley startup that claims the "Smartest AI Object Detection On The Market", detecting not only people and vehicles, but...
IPVM Camera Calculator User Manual / Guide on Oct 16, 2019
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The guide below includes instructions, images, gifs, and videos...
Camera Focusing Tutorial on Oct 14, 2019
Camera focus is fundamental to quality imaging. Mistakes can significantly reduce details, making cameras less effective. In this guide, we...
Avigilon H5A Analytic Cameras Tested on Oct 07, 2019
Avigilon has released its H5A analytic cameras, claiming to "detect more objects with greater accuracy even in crowded scenes." We tested the...
Vivotek 4K S-Series Camera Tested on Sep 30, 2019
Vivotek's highest-end S-series camera claims "Supreme Night Visibility", "Smart IR II", "Smart Stream II", "WDR Pro for unparalleled visibility in...
Consumer IP Camera Analytics Shootout - Arlo, Google / Nest, Amazon / Ring, Hikvision / Ezviz, Wyze Cam, Yi Home on Sep 26, 2019
AI analytics are hitting the mainstream in the consumer camera market, with entrants Wyze and Yi Home releasing free people detection on their...
RealNetworks SAFR Facial Recognition Profile on Sep 25, 2019
RealNetworks entered the surveillance market by giving away their analytics to schools for free, and is now targeting large commercial users with...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Directory of 70 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...

Most Recent Industry Reports

Access Control Door Controllers Guide on Oct 22, 2019
Door controllers are at the center of physical access control systems connecting software, readers, and locks. Despite being buried inside...
Alarm.com Acquires OpenEye on Oct 21, 2019
Alarm.com is targeting commercial expansion and now they have a commercial cloud VMS with the acquisition of OpenEye. In this note, based on...
Government-Owned Hikvision Wants To Keep Politics Out Of Security on Oct 21, 2019
'Politics' made Hikvision the goliath it is today. It was PRC China 'politics' that created Hikvision, funded it, and blocked its foreign...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Alarm Veteran "Demands A Criminal Investigation" Of UL on Oct 18, 2019
The Interceptor's Project pressure against UL continues to rise. Following Keith Jentoft's allegation that "UL Has Blood On Their Hands", Jentoft...
Camect "Worlds Smartest Camera Hub" Tested on Oct 18, 2019
Camect is a Silicon Valley startup that claims the "Smartest AI Object Detection On The Market", detecting not only people and vehicles, but...
Hikvision Global News Reports Directory on Oct 17, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Camera Calculator V3.1 Release Improves User Experience on Oct 17, 2019
IPVM has released a new version of our Camera Calculator, V3.1, with significant user experience improvements, a new development plan, and an...
Securing Access Control Installations Tutorial on Oct 17, 2019
The physical security of access control components is critical to ensuring that a facility is truly secure. Otherwise, the entire system can be...
Access Control Course Fall 2019 - Last Chance on Oct 17, 2019
Register Now - Fall 2019 Access Control Course. Thursday, October 17th is the last day to register. IPVM offers the most comprehensive access...