Simplisafe Has Lower False Alarm Rates Than Professional Systems

By: John Honovich, Published on Mar 01, 2017

'Everybody' 'knows' that DIY alarm systems, like Simplisafe, generate more false alarms than traditional, professionally installed ones.

But it is evidently false, as two executives in the know from large central stations explained to IPVM.

'*********' '*****' **** *** alarm *******, **************, ******** **** ***** alarms **** ***********, ************** installed ****.

*** ** ** ********* false, ** *** ********** in *** **** **** large ******* ******** ********* to ****.

[***************]

Lower ***** ******

*** *******, *** ** particular **********, **** "**** ** *** ****** false ***** ***** ** the ********" *** * "small ********** ** **** the ****** ****** ****" has ********* ** *** McMullen [**** ** ****** available], ********* ****** ********** *** ****** ** ** Morgan ****** [**** ** longer *********], ** ******* ********, ** *** *********************. ********, ** **********, would **** ***** *** company **** ******** ********** *** Simplisafe.

Benefits ******* ********

**** **** *** ***** false ***** ***** ** DIY *** * ******* to ******* ******** *** for ****** ********** ***** it ******* *** ******* false ***** **** *** thereby ******* ****** ** police.

Explanations ***?

* *** ********** ** why **** ** *** case:

  • ***** ******* ***** ***** technology *** ******** **** false ****** **** ******* deployed * ****** *** with ****** ********** *** with ******* ****.
  • ******* ********* ** ********** themselves *** ** ****** understood *** ****** ********* to ****** ***** ****** than **** **** **** put ** ** ******* else **** * ********* who *** ****** ********* of *** ** ***** the ********* **** ******.
  • ****** ***** ***** ************ features ****** ** ***** systems *** **** *** users ** **** ***** alarms ****** *** ******* station ***** ** ****** them.

******

** *** ****** *** systems *** **** ***** false ***** *****, ** would ****** **** **** would ** **** ** negotiate ***** ********** **** from ******* ********, ***** could ********** ***** *********** advantage.

****** ****, *** ** *** top ******* ****** ******* DIY / ********** ** that ************** ********* ******* are ****** / **** accurate **** ***. ** this ** ********* *** the ****, *** ***** stats ******** ****, ** could **** *** *** greater ********.

Positive ****

** *** ******** **** to ************ *******, **** executives *** ********* ***** belief **** *** ** primarily ********* *** ****** to **********, ******* **** *****, rental **********, ***. *** is *** ****** * materially ******** ****** ** the *********** ****** *** alarm ********.

Comments (28)

Why is this? Less detectors? Better kit? 

Or for example could they using a high pir pulse count.:)

I would think that the ability for a user to acknowledge and cancel an alarm via a push notification to a phone would be a very likely reason some of the false alarm rates are so much lower. That coupled with the fact that users that are likely to buy a DIY kit and actually take the time and effort to install it themselves are going to be the users that are more likely to utilize the system properly, thus reducing false alarms as well.

Frankly, it's a bit of waste of everyone's time to even acknowledge such claims.  I sincerely hope you took the time to establish the definition of "false alarm" to begin with?   Certainly user errors / false dispatches are not false alarms.  System did exactly what it was designed to do.

I am not an expert on this system & have little interests in it.  But typical systems similar to these, have you noticed they never brag about how well they detect?  

What I do thank these platforms is, to bring up security awareness to consumers that its about time they get serious about securing their premises.  Now, Its just a choice between the Pro's & the DIY Amateurs   No one needs to worry we are going out of business soon.   Crooks are very creative and tenacious 

I don't think it is a waste of anyone's time to acknowledge that these claims are being made. If they are untrue, then it is an important bit of information for the "pros" to know and to communicate to their potential customers; if they are true, then the industry should make sure to utilize any of the lessons learned from that to try and spread those features into our systems as well. 

 

Just because it was user error or false dispatch doesn't mean that we as an industry can just look at it and say "well our hardware did what we built it to do, nothing to see here." False alarms (from whatever cause, be it equipment failure or user error) still take up resources at the call centers (and raise prices there because of it) and dispatch police (and either fine home/business owners, or risk police being less mindful when responding to alarm systems). Both of those potential impacts have a huge bearing on our industry, so if it is user error or false dispatches that are causing a noticeable percentage, then it is on us as integrator and on the manufacturers to make sure that the equipment takes that into consideration and actively works to minimize them so that alarm dispatches can be taken seriously again. 

These are from two separate central station monitoring companies, and the definition of false alarm they used was whether they would have attempted to dispatch police or not. We in the industry can say "oh, not our problem, user error". But if in fact this DIY system has a lower incidence of user error, then we should probably wonder why, and what we can learn from it.

Related.

The big thing in DIY systems I'm seeing is that a lot of them are mobile phone driven, with the phone the main (or only) interface to the system.

Because of this, you can do things like confirm before dispatch via the app. For example, looking at Dragonfly during testing yesterday, when an event is triggered, you get this:

You can immediately dismiss it or disarm the zone, or dispatch if it's real. So nuisance alarms can be eliminated before they go to the central. If the user doesn't answer? It goes to dispatch automatically.

This seems like the modern evolution of companies calling before dispatch. Does that not routinely happen anymore? That would seemingly eliminate user error (wrong code, lack of training, etc.) as well. 

This seems like the modern evolution of companies calling before dispatch.

Most centrals use verification (calling before dispatching police). SIAC is pushing what they call Enhanced Call Verification (calling two numbers instead of one before dispatching police). Some municipalities mandate ECV, and I believe ECV is mandatory statewide in Florida. 

DMP has an app that pushes notification to the subscriber's smartphone that will allow them to confirm an alarm, including video if they have it. 

I don't know that what effect ECV actually has on false alarm rates. 

If there ist a timeframe between the alarm and the transmission, the burgler has also this time to smash the system from the wall and prevent a later transmission? So it is less secure but mor fals alarm secure?

Its better known as - Training.  DIY can't train themselves.  You can't train on what you don't know.  We have techs that read the manuals last.  Its more human nature

I think that you also have a large demographic that are interested in buying a DIY system...because they are technical enough to feel comfortable with the installation process...which also means that they are more comfortable with the system...thus more understanding of how it works and why. Therefore less likely to accidentally set it off. Plus the modern features of an App based Verification Filter should provide lots of opportunity to cancel the false alarms before they are communicated all the way to the C.S.  Just my hunch.  

I believe people who feel confident enough to DIY a home alarm system also have a better comprehension of electronics and the manuals for many DIY systems provide enough information to install them properly.

Sounds like there are a lot disenfranchised home system dealers with sour dispositions still trying to tell the public that DIY security systems are no good. As mentioned before, most motion sensors are greatly improved over those installed in the past. And the preponderance of phone interfaces now provide the owner with decision making capacity they never had with old systems.

This is why it behooves us to reach out to the older system owners and up sell and upgrade. I do this and it works. I have seen some of the DYI installs and there is no rime or reason for some of these device placements. More education and good customer service can go along way.

This article addresses "false positives".

How does the Simplisafe system do for "false negatives" (not detecting something when it should)?

How do other systems do for "false negatives"?

How does the Simplisafe system do for "false negatives" (not detecting something when it should)?

Craig, that's a good point / question. We don't have enough information to make a claim on that one way or the other.

John - I think one more piece of information that is crucial is needed. Usage rates.

In a prior life I designed, manufactured and sold for a high end European company burg/fire equipment for commercial applications. People who pay good money for a system use it. DIY people, I assert, have the emotion, but not the commitment.

I'd like to see arm/disarm (we used to call these openings/closings) rates for DIY vs professionally sold/installed.

If the DIY are "using" the system at the same rates as professional systems then all the potential reasons for lower rates become valid. My hunch is that the DIY group has a system, but don't actually use them as much. Thus, lower false alarm rates.

But really... where are the statistics for this and how are they measured? 

But really... where are the statistics for this and how are they measured?

The two people commenting on this run central stations, and make their money on pricing / handling such issues, so presumably they know how to calculate these statistics.

What is the skepticism here?

So my skepticism is in the fact that there is no real test environments here. Is it simply being assumed based on what the central stations are receiving in calls. 

What I'm trying to understand is how they came to this statistic.  What was the criteria used?  For example, did they compare 1000 accounts from each comparable group in order to determine the number of false alarms?  If not, then how did they reach this conclusion?  To me it seems the variables are wide to make a solid comparison because there is a number of varying units deployed that could be aged compared to Simplisafe.  I just think the criteria has to be the same or nearly the same in order to make a real determination.

"But really... where are the statistics for this and how are they measured?"

 - "What is the skepticism here?"

Any statistical measurement attempting to discern a 'false negative' would need a comparative entity that uses the same or similar tech (like another camera that uses motion detection).  Think 'shoot out'.  A comparative study of two or more things.

And for the record, the use of 'false negative' to describe a lower-performing device (in comparison to any other device) is troubling to me... it is a bad descriptor imo.

 

Thanks #3... I didn't see your response before but that was exactly what I was trying to say.

This article is certainly contentious amongst the alarm system integrators.  Not being one myself I am wondering if the capability to, via phone, set it to ignore an alarm is the key differentiator.  If that is the case, do all alarm systems not have this capability?  If they do are they just not setup that often due to difficulty?

I cannot begin to count how many times I am at the office when our alarm arms, I set it off, I have head phones on, miss the call and faint beeping from several rooms away.  The folks on the escalation list are called.  They know I am there and tell the agency to stand down.  This would be a nice feature for those of us with company phones to have.

I am not buying this, the police chiefs hate DIY because of the false alarms.

Just looking at the equipment which is not UL listed tells me your going to have false alarms due to the low level of technology that is used. Compared to professional manufacturer's equipment which is designed to UL standards, recognized to provide more secure installations with less false alarms.

A good example is the PIR which doesn't even have a pigmented lens to withstand white light which is a major source of false alarms and a UL requirement.

Should we all stop buying Honeywell and Bosch products and start buying China made DIY to install, I think not.

 

I am not buying this, the police chiefs hate DIY because of the false alarms.

Larry, any chiefs you can put us in touch with?

Any theory about why these 2 executives would say this if it is completely false as you are implying?

Larry - are you the same LT that ran Radionics?

Yes

 

I have spoken with a lot of monitoring station owners, and surprisingly they do not measure their statistics about false alarms. Why? Because they have to call the premises the next day and confirm the outcome - I am not aware of anyone doing this, so the industry accepts the police figures. We started doing this in Dec and the first few data points appear significantly different than the usual number quoted of 98%. I would rather not say, I need more data.  

I believe Cops and Rapid are seeing a difference - what I think though they are measuring is the alarm factor: number of police dispatches compared to the number of accounts in these two classes of accounts. Typically the industry tracks the number of police dispatches compared against the respective number of residential and commercial accounts. typically commercial has more alarms per system than residential. Now there is a 3rd demographic DIY, perhaps this is what they are seeing. There is a great deal of variation between the number of system/100,000 people and number of alarms per system (IMHO) depending on the differences in the regulations in the jurisdictions and the execution on the regulations. 

For example, here are 12 month stats for 3 cities in 3 countries:

Phoenix from 2012 - pop 1.5m

34,691 police dispatches on 147,623 registered systems, n/a false

Calgary for 2016 - pop 1.39m

7,110 police dispatches on 144,966 registered systems, 95.7% false

Metropolitan London for 2013/2014 - pop 13.7m

14,781 police dispatches on 164,105 registered systems, 96.6% false

There are two stories in the above statistics: Why does Calgary have so few police dispatches compared to Phoenix?, and Why so few alarm systems in London,UK? 

 

A system that doesn't work doesn't give any false alarms either... 

I have sen some of these DIY systems installed by the homeowner and it is just scary, wrong position of contacts, motion detectors and such. I make sure that my customer is fully involved with the install of my systems and how they operate. I also push for the interactive use of their phone. The customers that use the phone option, do not have that many false alarms. There is plenty of work out there and we can't do it all. More people are using the internet to buy and obtain instructions for the work they are doing. Some are misleading and some work out ok. We as professionals just need to be there to help when we can and sometimes this works into another job for us. 

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Resideo AlarmNet Has Major Outage on Mar 12, 2020
AlarmNet suffered a major outage yesterday, impacting Total Connect, Resideo, and Honeywell / Ademco alarm customers. Inside we examine what...
Halo Smart Vape Detector Tested on Jan 16, 2020
The Halo Smart Sensor claims to detect vaping, including popular brand Juul and even THC vapes. But how well does it work in real world...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance testing facility that will allow us to significantly expand our...
ADT CEO Not Worried About DIY: "2 Discrete Markets" on Dec 13, 2019
ADT's CEO is not worried about DIY, characterizing DIY and ADT's DIFY as "2 discrete markets" at the Imperial Capital Security Investor's...
"Good Market, Bad Business Models" - Residential Security on Dec 11, 2019
Industry banker John Mack, at his company's annual event, took aim squarely at the problems in the residential security...
"Stress in the Residential Market" - Major Lender Exits on Nov 06, 2019
The residential security / 'alarm' market is getting worse, at least for traditional players. Now, one of the biggest lenders in the industry has...
Alarm.com Suffers Outage on Jul 26, 2019
Alarm.com suffered a major outage this week, impacting its 5+ million customers. Inside, we examine what happened, what Alarm.com told IPVM and...
Alarm.com Favorability Results 2019 on Apr 15, 2019
The once dot com startup has evolved to become a core provider for home security and is now expanding into commercial. In their first entry in...
UK Installer CCTV Aware - Flat Pricing, No Salespeople on Apr 10, 2019
This is a different kind of company. They do flat pricing, they do not have any salespeople and 50% of their sales are sold and booked...
Camera Disruptor Wyze Enters Sensor / Security Market on Mar 28, 2019
Wyze, the company that has disrupted consumer IP cameras, combining American marketing and Chinese manufacturer, has just announced its expansion...

Most Recent Industry Reports

FLIR New Coronavirus Prioritized Temperature Screening Camera Examined on Apr 03, 2020
FLIR has announced a new series of thermal cameras "prioritized for entities working to mitigate the spread of COVID-19 virus", the A400/A700...
ADI Branch Burglary on Apr 03, 2020
A security systems distributor branch is an odd target for burglary but that happened this week at ADI's Memphis location. Vehicle Smash &...
YCombinator AI Startup Visual One Tested on Apr 02, 2020
Startup Visual One, backed by Silicon Valley's powerful Y Combinator, aims to be "Your 24/7 Watchman" with advanced analytics and object...
Free IPVM Memberships For The Unemployed on Apr 02, 2020
IPVM is giving 3-month free memberships (regular price $99) for the unemployed, no questions asked. To get it, just contact us, your request...
Dahua Faked Coronavirus Camera Marketing on Apr 01, 2020
Dahua has conducted a coronavirus camera global marketing campaign centered around a faked detection. Now, Dahua has expanded this to the USA,...
Video Surveillance Trends 101 on Apr 01, 2020
This report examines major industry factors and how they could impact video surveillance in the next 5 - 10 years. This is part of our Video...
USA's Seek Scan Thermal Temperature System Examined on Apr 01, 2020
This US company, Seek, located down the road from FLIR and founded by former FLIR employees is offering a thermal temperature system for the...
Terrible Convergint Coronavirus Thermal Camera Recommendation on Apr 01, 2020
A week after Convergint disclosed falling revenue, pay and job cuts, Convergint is touting 'extensive research' that is either grossly incompetent...
The IPVM New Products Online Show April 2020 Opens With 40+ Manufacturers on Mar 31, 2020
IPVM is excited to announce the first New Products Online show, with 40+ manufacturers, to be held April 14 to the 16th, free to IPVM members,...