*****.****** ************* ** ***** ** "********** ************ (AI) ************ *** ***** ********* *******", touting ****
*****.***'* ******** ****** ******** **** ******* the ** ****** **** ******** ** frames ** ***** ******* **** *****-******** cameras, *** ********* ******** **** ******* provider ******** *** **** ******* ************.
******, **** ******* *****.***'***** *********** ** ****** *****, *** ********, *** ****-********, ***** surveillance ********* ********.
*** **** ** *****.***'* "**" ******? We *** *******.*** ****** (****** ****), ********* * ********* ******, ******* the "**" ********* *** ****** *** system.
** **** ******, ** ***** *** results *********:
- ******** *********** ********
- ***** ***** ********** ****** *******, *******, animals, ******, *** ****
- ********* *********/*** ******
- *************/**** ******** *** ****
- *** ******* ********, *** ******* *** cloud *******
Key ********
*** ******* ****** **** *** ****** was ******* ****** ******** ** ************ VMD *** *** ****** **** ***********, suffering **** * **** ******:
- *** ****** *** ****** *********** / unrealistic ************ '***************', **** ******* ** - **° ********.
- **** **** *** ******** **************, ***** were ***** ***** ********* (*.*., ****** being *********** **** ** ****** **** present).
- *******, *** ********* *** *********** ******** recommendation, *** ***** ********* **** **** more ***********.
**** *****, ******** ** ************ ***, overall ***** ****** **** *****.
Solid ***** ***** **********
** *** *******, *****.***'* ***** ****** Detection (***** *********) *** ********* ********* in ******** ****** ***** ****** ****** by ******* *******, ****** ******, *****, insects, *******, *** ****** ***** ********** triggered ************** ********* ** *** *******.
********** *** *********** *** *********, ***** the ***** ********* ****** **** *** down ** *** **** '***** *****' events. *******, ** *** ******* *** reliable ****** ** ********* *** ******.
Classification ******
*** ******* ******** *********** ** *** accurate ***-***-****, **** **** ******* *** installed ********* ** *************. **** *******/****** were ***** ** ** **** ****** inaccurate **** ******. *** *******, *** camera ******** ***** ******** *** ******* 'people' ** *** **** ***** ** vehicles:
** ******* ** ***** ******, ** people **** *******, ******* *** *****. The ******** ** ** **-******* **** Gas *****, ** *********** **** * moving *******, ***** ******** ** *** system ********* *** *** ***** ******** as * '******':
** ***** *****, *** ****** ****** people *** ******* ********, ** ** this *****:
****** *** ********** ** *** *** with * ****** ******* ** ** classification ****.
Small ****** *********
*** **** ***** ******** *** '******' classification ** *******. *** ****** *** not **** ** ****** *** ****** animal ******** ********** (** **** *********, dogs *** *******), *** *** ****** did *** ******** *** ******** ** 'animal' ********* ** *** *** ** handled ****** *** ********.
*** **** ***** ** ** ******* of ********, *** *** **********, ****** movement:
********** *********** ***** ****** *** ***** usability ********, ********** ** ***** *** rules ** ****** *** ******* ****** events **** * **** *****-***** ***********, but ******* ******* ****** ** ***** on ******* ** **** **** *** be ********* ** **** **** **** gotten *****.
** ***** *****, *** **** ****** detection *** **** ** ** *** as **** ** **** '****' ***** times ** *.* ******* ** **** an ***** ** ****** ***** ** fast-moving *******, *** ***** ******** *** also ************* ******** ******** ****** ** the **** ****.
Steep ******** *********
****** **** *** ******** ******** ****** we ******, *****.*** *** *********** *********** requirements ** **-**° ********, ******* ** least * **** **** *** ** coverage ****** **' ** *****:
*** *********** ** ***** ***** ** quite *********** ** *** ** *** be ***** *** *** *** ** can *****, **** ******** ***** ** consumer *********.
Nonconformance ********* ******
******* *** ****** ** ** *** up **** ********* *********, ******** **-**° for ****** *** ** ***** ** installers *** ******** **** ***'* **************.
*******, ** **** *****, ** *********** other ******** ****** ** * ******. For *******, ** **** **** * vehicle *** *** ********** ** ** approached *** ******, *** *** ********** depicted ***** *** **** ** ** was *******:
**** **** ***** ******* *** ******* as ** ******** ***** ** *** system, *** ********* *** **** ***** no *********** ******** ** *** ****** at ***:
***** ******** ******** ****** *** *** reoccur **** ******** ** *** ******** specification *********** ** ***, *** ***** atypical ***** *** *** ***** ** highlighted ** ********* ********* ****** *****.
Rain/Snow ********* ******
** **** *** *** ****** **** nor **** ** *** **** ****** that ******. ** ****** ** *** rain ** *** **** ****** *** will **** ** ****** ** *** report.
******: **** ***********
***** * ~* **** ****** ** steady **** ** ******* *** *****, our **** *** *** ****** *** false ******** ** ******** ****** ** classification.
Detection *********
*** ******* ************ ******** ******* ********** at *** ****** ***** **** ********* in *** ***** *****. *** *******, the ***** ********* ****** ********* ****** 25' ** *** *** **' ** night, *** *** ****** ********* ****** at **** ** ***** ******.
*** ***** ***** ***** ~**' ************** of * ******* ** ******* *****:
Good *** **********
******* ****** ******* ** *** **** ADC's ********* ********* ** ****** ********** due ** ****** *******, ******, *** cobwebs. *** *** ****** *** *** trigger ********** ** **** ******** ************* at *** ***** ****** *** ****.
**** ** ** ******* **** ******* insect ******** **** ***** ******* *** but *** *** ***** ********* *****:
Motion/Analytic *************
** ******, *** ** ******** *** analytics *****, * ***- ** ************* 'tripwire' ** * '****** ****' **** detects **** ******* ***** ****-******* *****:
** ******** ** *** *****, ***** can ********* ****** *** **** ******* must ** ** ********* ** *** rule ****** ** ***** ** ****, or **** ** ***** ***/****** ****** or **** ** *** ********** ********. The ******** **** ****** ********* ** alarm ** ******* ***** ** *** direction ** *** *****.
*** '****** ****', *** ********* **** shape ** ******** *** *********** ****** scenes ******* *********** ********* *****:
Camera *********
*****.*** ****** ~* ***** ****** ******, but **** * ** **** *** supported ** ***** ** *********, *** Indoor ***** */** (***-******) ********* ******** (***-*****). ** ****** *** (******* ***'*) outdoor ****, ***** ** *** *****.
Camera/Service *******
*** *** ******* ******* * ******* subscription ** ***** ** ******* ********/***** alerts ***/** **** ***** *****. ****** pricing ** ~$* **** *** ***** added ** *** ~$*/*** **** ******* 'Pro' ***** **** ** ******** *** AI *********. *** ********* ******* **** more ******** *****, ******** *** ***** to *,*** *** * ******* ** from *,***. ****** ****** *** ~$*** for ***-*****.
Versus ******/****
****'* ********* **** **** ******** **** Alarm.com *** **** *** ********* **** installation ************. ***** ****** ********* ********* do *** ******* * ************ ** receive ******. *******, ***** ***** ******** is *********** ******* ***** ***** ************, ******* **** $*/***** *** ****** (5 ****) ******* $**/***** *** ** days. *** **** ******* ** ** available******** **** **** *** $***.
Versus ****
*******'* ****** ********* *** **** ***** alarms *** ******* **** ****** ******** distances/higher *** **** ***. **** ****** detection ********* ******* * ************ ****** *****, ******** ** $*.** *** ******, including * **** *******, *** ** to $**.** *** ** **** *******. Arlo ******* *** **** ******* ***** at $*** *** *** ************ ****** $*** *** ******** **** *
Versus ******/****
** *******, ***'* ********* *** ****** performing **** ******/****, *** ******* ***** quality *** **** ** *** **** and ***** **** ***** ** ******* WiFi.
****'* "******** ****** *********" ****** ********* does *** ******* * ************ *** motion ******, ******** * ************ ** needed ** **** ******** ***** ******** at $* *** *****.**** ********* ********** *** $*** *** *** ** purchased **** *** **** *******.
Comments (13)
John Honovich
Brian, good report!
Vendors need to be more cautious and conservative about using "AI" in marketing, as mediocre performance like this is going to disappoint and undermine the confidence in "AI" generally.
On the one hand, since machine learning is generally considered part of AI and surely Alarm.com is using some form of machine learning, they could technically make the case that it is "AI".
The problem is that most people expect "AI" to be, well, intelligent or at least as intelligent as a 5-year-old. For $1 a month, this is not a bad offering but it's not good enough to be trusted for high accuracy or to be marketed as "AI".
Create New Topic
Brian Rhodes
One interesting aspect of the 'AI' implementation is that 'learning' is fairly coarse and only happens without user refinement.
Right now, AI video learning happens as all video is ingested into ADC's cloud via an opt-in sharing feature:
Alarm.com mentioned to us in a call they plan to add a self-reporting feature allowing users to flag incorrectly classified objects.
The platform does not currently have this or any method to manually 'teach' or 'learn' the system based on user feedback.
Create New Topic
Michael Gonzalez
11/30/18 06:49pm
Excellent report Brian! Thanks for doing this, it saved me a massive amount of time.
Create New Topic
Scott Sheldrake
Thanks for the detailed report. Please update when you have gone through a good rain. That's going to be the real test.
Do you have a rough idea of the number of clips you get in a typical day? How well does the ridiculous 1000 clip/month recommendation from ADC hold up? 1000 clips /mo= 33 clips per day or 1.3 clips per hour. Seems unlikely you would be able to have less than 1000 clips per month.
Create New Topic
Undisclosed #2
highest-performing AI to date: The Answer
Create New Topic
Brian Rhodes
UPDATE: RAIN PERFORMANCE (added above to report)
After a ~3 hour period of steady rain in evening and night, our test did not record any false positive or observed errors in classification.
Create New Topic
Scott Sheldrake
This about summarizes ADC video :
Create New Topic