10,500 Accounts Down - 8 Weeks To Fix

By: John Honovich, Published on Feb 09, 2017

At the Barnes Buchanan Conference, Alarms Detections Systems explained that 10,500 of their accounts, consisting of half of their RMR, went down and took 8 weeks to fix.

This chart shows the start of the outage:

** ********* ******** **********,****** ********** **************** **** **,*** ** their ********, ********** ** half ** ***** ***, went **** *** **** 8 ***** ** ***.

**** ***** ***** *** start ** *** ******:

[***************]

** *** * ************ ************** problem **** ***** *** be ***** ********. *******, and ******* *********, *** to ** ** **** of *** **,*** ******** down:

*** ********* **** ******** schools, ********, ******* *****, etc. *** **** ******** fire ******. **** *** the ********* *** *** that.

Product ******

*** **** *** **** need ** ** ** site, **** ****** ** replace *** ******* / transceiver. *****, *** ****** products **** ********* **** the ************ ** *** got *,*** ** *** devices ******* **** ***** dealers ** ****.

****, ** *** ********, antennas **** ******** ****** the ****** ** * temporary ********.

** *** *****, *,*** of *** ***** **** from *** ************ *** not **** ******, ** the ****** ***** ***** a ***** *** ******* to **** ***** ** the ******:

*******, * ***** *****, in ********, **** **** done.

****

** ******** *** **** just *** ****** **** to ** * *** hundred ********* ** *******, given *** * ***** of * *** ********* of ~** *********** ** to ** ***** * day, ********* ********. *** that ** **** ******* the ***** **** ** lost ******** *** ********** of ******* ** *** accounts, ***.

Manufacturer ******** ***********

*** ******** ** ********* who *** ************ *** citing ******* **** **** that ************. *******, ***** ****** ********** ***-**********, ****** * ****** from *** ************:

* ****** *********, ***** transmits ** *** **** 465.9875 *** ********* ** our ********’* ***-*****************, ******* *** *****’* surface ** **** ******** area ** ******** **** un-decodable **** *******. ** we **** **** **** satellite *** **** ************ over **** **** ********* all **** *** ***** since ****, ** ******* those ************* ***** **** highly ******** ** **** caused *** ******** **** occurred.

**** **** **** ***** unique *** * ************ incident ** ******, ******-***** radio ********* ************ (***) in *** **** ******* area ** ********. ***** have **** ******* ******* RFI ****** ***** ** the **** ******* **** over ****** ******. **** had **** ********** ** penetrate ** ***-*****************. ******* *** *** our ********* ** *** area **** ********** *** concerns ** *** **** from *** ** ***** RFI ****** ***** **** most ****** ***** *****.

** **** ** *********** to *** **** ********** or ************ *** ************ will make ** *** *** this.

Comments (18)

Avatar

Brandon Knutson

IPVMU Certified | 02/09/17 09:49pm

2G dialer no-longer-supported issue?

Avatar

Ethan Ace

IPVM | In reply to Brandon Knutson | 02/09/17 09:51pm

It was an AES-Intellinet issue. I'm trying to find some related articles about it now and we'll update.

John Honovich

IPVM | In reply to Ethan Ace | 02/09/17 10:00pm

Just found an article in SSI from a few months ago confirming AES. Given that, strange that ADS would not disclose the manufacturer.

Marty Calhoun

IPVMU Certified | In reply to Ethan Ace | 02/09/17 10:22pm

Exactly what I was thinking, AES had to be them.Only long range wireless that I considered worth a hoot in hell, but now??

Avatar

Joel Kriener

IPVMU Certified | 02/09/17 10:15pm

Very interested in hearing more background on this .....

Avatar

Paul Curran

02/09/17 10:20pm

Seems to be caused by a rogue French satellite. 

Eddie Perry

In reply to Paul Curran | 02/10/17 01:42pm

no it was totally the Russians, they made the French satellite go rouge

Mendy lewis

02/10/17 08:36pm

What wen wrong with the radio frequency, is it the alarm communicator with central station , or the wireless alarm system?

Avatar

Ethan Ace

IPVM | In reply to Mendy lewis | 02/10/17 08:45pm

AES-Intellinet is an alternative to telephone, cellular, or IP dialers. It uses spread spectrum, 450-470 Mhz radios, which act as a mesh. So if you have customers clustered in one area, they all act as transmitter and receiver, til the signal riches an uplink, which is usually IP to the central station.

That frequency is licensed in the United States, so nothing else should have been transmitting on it, but according the AES' investigation, a satellite malfunctioned and sent a packet which was received and rebroadcast by the network. Instead of ignoring it, essentially the radios just didn't know what to do with it, so they kept trying to rebroadcast it until they finally went down. 

SSI has a followup article with AES in which they talk about what happened/how they're preventing it from happening again, etc.

Avatar

Paul Curran

In reply to Ethan Ace | 02/10/17 09:17pm

I wonder why the network wasn't encrypted? How could a external packet drop into the network and what's the stop anyone land based doing this? 

Avatar

Ethan Ace

IPVM | In reply to Paul Curran | 02/10/17 09:27pm

According to AES, it was a combination of that rogue packet and some ground based interference. 

I'm not an RF genius and I'm not that well versed on AES' product, but...I'd tend to agree with you. I don't get a lot of warm fuzzies about it not being possible.

Undisclosed End User #1

02/10/17 09:33pm

You cannot even imagen how much stuff, that is "certified" by various manufacturers and agencies who is using ISM band (433 MHz), for instance burglar alarms that are totally B.S, so many of these system that can easily be "disabled" by using using one simple handheld radio and transmitting on the right (or near) frequency...

Undisclosed End User #1

02/12/17 11:32pm

The french satellite? http://www.hydrowise.com.cn/images/images/Argos3PMT-KHD.pdf

AES-IntelliNet Data Radio: https://fccid.io/L9N-7085UE5

I tend to believe it was a combination (or only #1)

#1. Satellite blocked the Data Radios receiver (when passing over).

#2. "Ground station" made reverse engineering of the traffic (most likely clear text), injected an "packet" that caused "broadcast storm" and overloaded the [low speed] network. (I assume it is Mesh as it says here, otherwise this will can go out from this hypothesis)

 

John Honovich

IPVM | In reply to Undisclosed End User #1 | 02/13/17 12:01am

#2. "Ground station" made reverse engineering of the traffic (most likely clear text), injected an "packet" that caused "broadcast storm" and overloaded the [low speed] network.

So do you think this was malicious then or?

Undisclosed End User #1

In reply to John Honovich | 02/13/17 12:22am

Frankly speaking, no.

I did only take the "report" in consideration, and besides, I have no clue how the "network" works, could be "Mesh" AKA repeating of packets - I have no idea how the protocol they are using works. (would be interesting to know tough)

The Radio is simple analogue stuff (as can been seen on FCC site), nothing special, this leave me personally to believe they has interference from the Satellite alone, and there was no "packet" was entered into their "network". And that would also make sense with their "temporary" vehicles all around, only to pickup the radio traffic from the customers and relay in. (with 3G / GSM?)

(Depending what's behind the radios (on the serial port), it could be possible to relay packets (most probably not even IP), but personally I don't think so)

Anyhow, that's the price to pay when using license free frequencies AKA ISM band for pretty serious applications. - Maybe embarrassing enough to make up a story to justify the change... 

 

Avatar

Robert Baxter

02/14/17 09:39pm

The issues raised are well known in the Central Station Community. There were actually two different situations. Issue 1 was from a few years ago: The discussion about the satellite interference was related to tracking of marine life fitted with communicators that happened to be on the same frequency as the one FCC granted to ADS. The french satellite did not have approval to use the frequency. 

Issue #2 is a recent incident that occurred around Sept of last year. This is what I have heard was the cause - there was a faulty packet of data introduced by one of the radios that was being distributed throughout the network that caused the receivers to not respond or rebroadcast. The network was very large and should have been isolated onto a few different frequencies, also a number of the radios were very old and did not have up to date firmware.

Undisclosed End User #1

In reply to Robert Baxter | 02/14/17 10:07pm

#1

"The french satellite did not have approval to use the frequency."

Well, the frequency seems to me (to what I have been reading) is free frequency to use for anyone, i.e. license to use this frequency are not required.

#2

I have been thinking about the "faulty packet", and personally i cannot find out how the "faulty packet" can enter one another "network" to be "rouge" packet that would put the "legal" network in faulty state.

What I can only think of, is simply "RF choke" of the central receiver, since this is listening on the frequency that the "rouge" french satellite transmitting on.

My personal conclusion

 Very good example on how manufactures think they can use free frequencies for implementing pretty serious applications without any drawbacks. The frequency is free to use for anyone, and anyone who will implement anything on these frequencies must be aware of the highly risk to have another applications on same frequency.

I personally know several cases when "the only legal" application is disturbed by a nearby hamradio repeater, who is transmitting 50 watt on near frequency and locking out AFSK/FSK receivers with totally lacking of any input filters. (of course, the "legal" application is the hamradio repeater and the ISM stuff, but there is absolutely nothing that can be said "I have priority of this frequency" - but the power of 50watt of registered repeater beats easily all other ISM stuff with lack of proper bandpass filter) 

As I said before, this is the price to pay to use free frequencies for pretty serious applications...

 

Avatar

Robert Baxter

02/15/17 03:14am

"The frequency is free to use for anyone, and anyone who will implement anything on these frequencies must be aware of the highly risk to have another applications on same frequency."

This is not a Wi-Fi frequency. The frequencies in these bands are not free, it is regulated, meaning it is assigned to users. Users of the AES-Intellinet system have to get approval from the FCC or Industry Canada (or both if near the border) and pay annually for the band requested and then assigned to them and the assigned geographical area they can operate their transmitters by the regulators. 

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Resideo AlarmNet Has Major Outage on Mar 12, 2020
AlarmNet suffered a major outage yesterday, impacting Total Connect, Resideo, and Honeywell / Ademco alarm customers. Inside we examine what...
2020 Camera Book Released on Jan 10, 2020
This is the best, most comprehensive security camera training in the world, based on our unprecedented testing. Now, all IPVM PRO Members can get...
2020 IP Networking Book Released on Jan 06, 2020
The new IP Networking Book 2020 is a 280 page in-depth guide that teaches you how IT and telecom technologies impact modern security systems,...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance testing facility that will allow us to significantly expand our...
3 Weeks Later, Honeywell Still Cannot Say Whether They Are Vulnerable To Dahua Wiretapping [Now Admits] on Aug 27, 2019
The Dahua wiretapping vulnerability and Dahua's decision to delay disclosing it until IPVM inquired underscored problems with cybersecurity and...
TMA Apologizes to Amazon / Ring on Aug 23, 2019
Not only is Amazon / Ring making major incursions into the residential security market, the organization representing the biggest incumbents, The...
Alarm.com Suffers Outage on Jul 26, 2019
Alarm.com suffered a major outage this week, impacting its 5+ million customers. Inside, we examine what happened, what Alarm.com told IPVM and...
Manufacturer Favorability Guide 2019 on Jun 12, 2019
The 259 page PDF guide may be downloaded inside by all IPVM members. It includes our manufacturer favorability rankings and individual...
Closed Cloud Cameras Trashed on May 13, 2019
When you buy a camera, do you own it? Not anymore. In the world of closed cloud cameras, you may think you are buying a camera but all you are...
Verkada Wins $783,000 Memphis Deal on Apr 29, 2019
The US city, most famous in video surveillance for standardizing on Hikvision, has issued an RFQ for 962 Verkada cameras due Wednesday, May 1,...

Most Recent Industry Reports

Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter of a billion dollars in VC funding, and multiple failures to gain...
Athena CEO Criticizes 'Deplorable' 'Nitpicking', IPVM Refutes on Mar 27, 2020
Athena Security's CEO Lisa Falzone has strongly objected to IPVM's reporting on Athena, calling it 'deplorable' and repeatedly criticizing IPVM's...
Hikvision Admits Sanctions Harming Its Financial Performance on Mar 27, 2020
While Hikvision initially downplayed being sanctioned for human rights abuses, the company is now admitting a significant impact in a new PRC...
New Axis M30 Cameras Tested on Mar 26, 2020
Axis has released a new generation of, for them, relatively low cost M30 series cameras, claiming to deliver "sharp video quality even in poor...
Coronavirus Shuts Down ADT Door Knockers on Mar 26, 2020
Coronavirus has another victim - this time, alarm giant ADT has stopped all door to door sales. Door knockers are a critical but controversial...
Access Control Course Spring 2020 - Save $50 Last Day on Mar 26, 2020
Register Now - Spring 2020 Access Control Course. Today, March 26th is the last day to save $50. IPVM offers the most comprehensive access...
Convergint Coronavirus Cuts on Mar 25, 2020
One of the world's largest security integrators, Convergint, has made a major move to handle the impact of coronavirus, with cuts across the...
VSaaS 101 on Mar 25, 2020
Video Surveillance as a Service (VSaaS) is the common industry term for cloud video. But what does it mean? How does it all work? Inside this...
TVT / InVid Facial Recognition Tested on Mar 25, 2020
Facial recognition is frequently sold for thousands of dollars per channel but some China manufacturers are offering full facial recognition...
IPVM Launches On-Demand Courses on Mar 24, 2020
For nearly a decade, IPVM has been a leader in online live courses. Now, we have added on-demand versions for all courses. The same course...