Axis Suffers Outage, Provides Postmortem

Published Aug 15, 2019 13:36 PM

This week, Axis suffered an outage impacting their website and cloud services.

axis outage_2

Inside this note, we examined what happened, what was impacted and what response Axis has provided, contrasting it to recent outages for Alarm.com and Hikvision.

** *******, ****** ****, **** ******* started ** **** ** ***** *******:

************, ********** **** ** ****** *****, *.*.:

***** ***** ******** **** ******** ** well ******* **** *** ** **** to *****. ***** ********** ****** **** cache, *** **** **** **** ** seconds *** **. ******* ***** **** a **** **** ** ****, *** eventually ********, ** ************ *****:

*** ****** ****** ******* * *****.

**********

**** ******** *** ********* ********** ** IPVM:

******* ******* ** *** * ******** network ******* ** *** ** *** sites. *** ******** ********* *** **** performing **** ******** ****** ******* *** stopped ******* ** * *** **** should ***** ** ********. *** ****** is ******** *** ******* ******, ******* performance *** ******** **********. ************, ********** went **** ******* ******* ** ************* 18:45 ***.******** **** *** ******* ***** *** the **** ******/******* ******** ** ******* working ** ** ******** *** ***. Given *** **** ** *** **** and **********, **** **** ***** ************* 21:00 *** ******* *******, ********* ******* within **** *** ****** ******* **** our ********, **** ** ******** *** remotely **** ***.*** **** ** ******* ********** ** working ********** ******* ** **** ** we *** ** ************* ** *** cause. ** ************* **:** ***, *** core ******* *** ******** *** ** could ***** ******** ******* ** *****. As ** **** ******* ****** **:** CET, ** **** **** ** **** back ** **** ******** **** * few ********* ******. ** ********* (*****) 12:00 ***, *** ***** ****** *** been ******** *** ********** **** ** normal.*** ******** **** ***** ******** **** be ********* ** *** ********’* ****; the ******** **** **** **** **** and ** *** ********** **** *******. All ******* **** **** ******** *** complete **********. ******* ****, ** *** problems, ***** ** ****** ** * humbling **********. ** **** ******* *** design, ******** **** *** ********, *** make ********* *******.

** ***** ***** ********** *** **** elaborated:

*** ***** ****** ** ***, ** have ***** **** ********** *****. *** slightly ****** ****** ** **** *** multi-site ***** ** *** *** ***** uses * ****** ******* *** **** all ***** ****** **** ** ****** to * ******* ******* *******. ****** by ******* * ***** ***** ****** or ** ******** *** ***** *** renewing *** *******. ** *** ********* roadmap *** *** ***, *** ***** caches **** ** **** ** ** more **********, **** **** **** ******* content. ** ** * ******* ******* ensuring **** ******* ** ********* *** current. ******** ** ***, ** **** look **** **** ******* *****, *** we *** ********** ****** ** ******* even ******* ********** **** ** *** most ****** **********.

*********** (*** **** ****), ** **** ** ****** ****** notifications, *** *** **** ** **, though ** ***** ************ *** ******** they *** **** ******.

Alarm.com *** ********* *******

**** ** *** *** ****** (** least **** ** **** ********** ** the **** *** ******). *****.*** *** the **** ******* ***, ********* ******** of ********'* ******* **** * *****. Hikvision *** *** ******* *** ********* one ** ********* *****'* ******* *** down ** ***** * ****, *** Hikvision *** *** **** ************, *** hours ** * ****, **** * month.

** *** *, **** *** *** only *** *** ******** ****** ****** while ** *** ********* *** ******* any **********.

** *** *** *** ****** ******** become ************ ******** *** **********, *** ability ** ************ ** **** ***** services ****** *** ******** ****** ** issues *** *********** **** ** ** increasing **************.

Comments (4)
JS
Jonathan Strauss
Aug 15, 2019

**** ** **** ******* ****? * like ****, *** **** **** ********* for **** **** ******* ******* *********, Apache ****** (*** ********), *********, **********, and ********** **** ** **** *** provide ** ****** **** ***** **** are ******** ** ** ***** ******** (and **** ** **** **** ***** systems **** ****, ********* ***), ******, with ******* ***********, *** *** *** be ******* ** **** ** "*** is *** *********"

(4)
(1)
(4)
(2)
Avatar
Steve Saltzgiver
Aug 15, 2019
IPVMU Certified

* *** ****** ** ******** *** sheets **** **** *** ********** ** took **** ***** ********* ** ********* websites ** *** ********** * ****** and **** ** ** *** ** so ** ****

(1)
(4)
UI
Undisclosed Integrator #1
Aug 16, 2019

****** *****. **** ******** **** ** our ********* **** ***** ****** *** demand ** *** **** "********" *******.

(1)
(1)
U
Undisclosed
Aug 19, 2019

*** * **** ********* ** *** they **** ***...

"*** **** **** ****, *** ******** were ******, *** ******* ********** *** a ****** ***** ** *******, *** we *** ******** *** ****** ****** under *** *** **** ****** *** non-spectacular ******* ********** *** ** *********** complex *************."

(2)
(2)