Verkada Notification Outage

By: Sean Patton, Published on Dec 12, 2019

Verkada is suffering an event notification outage and analytic search failures.

Inside, we examine what the issues are, what Verkada told IPVM and the risks of these outages for VSaaS users.

******* ** ********* ** event ************ ****** *** analytic ****** ********.

******, ** ******* **** the ****** ***, **** Verkada **** **** *** the ***** ** ***** outages *** ***** *****.

[***************]

Update **/** - ***** *** *** ************* ********* / ** ******

** ** *** ******* of **/** ***** *** SMS ************* *** ****** have **** ******** **** our *******. ****** *** notifications *** ***** *** working. ** ******* *** to ******* *** ********** feedback *** **** ****** the ****** **** ** is ********.

************, ****** ****** ** also ******* ********, ******* for *** ***(*) **** it *** *** ***********, people ********* ****** *** still *** *****.

Outage ********

*************, *** *****, *** and ****** ***, *** all *** *******, ********** users **** ******* ****** about ********** *** ******** risks.

**** ********* *** ****** has ****** ** ***** 1 **** *** ** the **** ** **** publication. ******* ******* *** still ********* ** *******'* servers *** ********* ** functioning ********, ** ********* notifications ** *** ******** were **** ** *******.

*******, **** ** ********* Verkada ******* ** **/** at * ** **, they ********* **** **** aware ** *** ***** and **** ********** * fix:

******* *** ****** ** provide ** *** *** the ***, *** ***** it *** *** *** priority *** ***********:

*************, *** ******* ***** noted **** ****** *** issue ******* ******* **** are ***** ******* ******* in ***** *****:

** ******** * ************* at ~* ** **, by *** *** *****, but **** *** ******** any *****. ******* ****** App ************* *** **** not *******.

****** **** ***** ** the ***** *** *** trigger *** ******:

No ******* ************

******* *** *** **** email ************* ** ********/*** users ** ****** * blog ***** ***** *** outage ** ** *** morning ** **/**, ~** hours ***** **** ****** aware ** **. ******* this *******.*** ******* ** ***** to ******** *.* ***** after ***** ****** *******(* **** ***** ** was ********).

*** ********** ***** *****.*** experienced * **** ****** outage, ***** ******* ** suffering * ******* ****** of ***** ************* *** analytic ********.

** ***** ******* **** the ***** ** *** issue *** **** **** not ******** * ***** response. ** **** ****** with ***************** **** ******* ***, which ** ****** ** the ** ********.

Cloud - ***** ************ *****

*** ************ ****** ***** cause ***** ** **** critical ****** (****** ** vehicles ** ***** ********), especially ** ****** ***** or ***** ****** ******** hours **** ** *** may ** ******** ********** their *******. **** ** especially ********* *** ***** users *** **** ***** ** *******'* *** 5 ********, "***** ******** *** Alerts", **:

***** ***** ** ******** situational ********* ******* ****** to *********** ******* ************ around *** *****. **** notifications **** *********** ***** stakeholders ** ******* **********, such ** * ****** detected ** *** ******** of * ****** ***** hours, *** ********** ** on-site ********* ** ******* or ********** **********.

**** ** *** *** same ***** ** *** loss ** *** ******** at * ********, ***** could ********* ****** **** traditional ***/*** *******. ******** events *** ****** *** very ***** *** ******** that ********* *** ************* have ********* *** *******, and *** ********* ******** are *** *********** ** complicated.

Person ********* ****** ******

** ******** ** *** notification *******, ****** ****** is **** *** *********** properly. ***** ** *** basic ******** ******* ******, people *** ******* *** highlighted ** *** ******, switching ** ****** ****** returns "** ****** ******** within **** **** *****":

******* **** **** ***** was ******* ** *** camera *** ******* * fix ********, ******* ** of *** **** ** publishing, *** ***** ***** persists.

Cloud ** **-**** *******

******* ********* ******* ***** the ******** ** ******** outages *** ****** **** come **** ************ *************. And **** *** ********* right **** ***** *** such *****.

** *** ***** ****, as **** ******* ******* notification ****** *****, ***** are **** ***** **** one's ***** ******** *** problems **** ***** **** to ****** **** *** hope **** ** ******** as ******* ** ********.

Comments (36)

** ******** ** *** notification *******, ****** ****** is **** *** *********** properly.

** *** ****** ** anything ***** **** **** notifications ** ******? **** what ** ******* ** the ******, **** ****** as ** ** *** be ********* **** **** just "*************", *** *** be ********* **** **** of *** ********* ******* in *** ***** ** well.

** **** ** *********** to *** ** *** search ******** ***** ***** things *** ********, ************ on ***** ******** ****** the **** ** *** outage.

****** ************* ******* ********* restored *** ******** ****** today, *** *** *** some ********** ******** *****.

*****, *** *** ***** question, *** ****** *** email/SMS/app ************* ** ******** events (******, ********) ***** on * **** ******* schedule (******, ******** *****, after *****, ***). *** analytics **** ** ** working ********, ** *** people *** *********** **** bounding ***** ** *** timeline, *** *** ****** results **** *** **********.

***** *** *** ********** to ****** ** *** cons ** *** ******* technologies. ****** **** **** didn't *****.

** ***** ** ***** beneficial ** **** **** this ******* ******.

** ** ************ **** any ********** ***** *** a ***** ********** ******** for ********* *** ****** or * ******** ***-***** interface ****** ********. **** is *** ** **** ways ******** ****** *** go *********.

* ****** **** ****** on *** ********** *** it ******* ***** **** useless ** **** *** using ******* *** *** like. **********, ******** ** foreign, **** **** * field *** **** ******* who ****** ***** *******, just **** **** ****** anything **** ******** ***************.

*** **** ***** ****** will *** **** ******** of ****** *** ****** vulnerable.

** ** ************ **** any ********** ***** *** a ***** ********** ******** for ********* *** ****** or * ******** ***-***** interface ****** ********.

"************", ** *** ** all. ******** **** ***** payroll, ***, ***, *****, and ***** ******** ********* are *** ****** ******** outsourced ** *****-****** *********. Why ***** ** ** "unbelievable" **** ***** ******** cameras ***** ** *** different?

** ***** **************** **** ** *** cloud-based *******, ** ***** short-sighted ****, *** ** you ***** ***** ** is "************" **** *** as * ************ *** in *** * **** rough **** *****.

* *** ******** ** watching ****** ** ******* for ***** **** "****** 365/Google ***** ** ****, guess *'** ** ****!" It ******* **** ***** than ***'* *****, *** a *** ** ************* seem ** ** **** with **.

** ** "***********" *** you ** ***** **** losing *****, *******, ***, etc ***** ****** ** loss ** **** **** losing * ************ ****** using ********* *** ******** areas *** *** **** you ****** *** ** would ** *** *********. Or ***** "************", ********* on **** **** **** in *** ******** **.

***'* **** ********* *******, fire ***** **** ********, and ***** ********* **** to *** ******* *** cloud, ***. ***'* **** access ******* ******* **** to ** ** *** cloud *****, ****** ******* a **** *** ********* egress. **'* *** *** same ** ***** *** CRM.

******** ************ ***** *** (or **** *** ***) for ******** *** * very ***** **** *****.

** ** "***********" *** you ** ***** **** losing *****, *******, ***, etc ***** ****** ** loss ** **** **** losing * ************ ****** using ********* *** ******** areas *** *** **** you ****** *** ** would ** *** *********.

* ***** *** ****** my *****. * ***** that *** *** ***** of ********* ******** ****** not ** ******** ** the **** ***, *** I *** ******* *** how *** *** ***-***** are ***** ******* ****. Calling ** "************" ******* that *** *** *** understanding *** ****** ****** of *** ******, *** are ******** ** ***** accordingly, ***.

** *** **** ** minimize ** ******* ********** demands *** *** ********* costs ** *** ****** that *** ****** ** manage *** ********* ** networked *******, **** ******* cloud *** ****** ************ operating *****.

** *** **** ** own *** ******* ** your ** *** *******, data *********, ********, **********, fault *********, **-****, ***, to ******** ****, *** have ** *** *** price *** ** ** in-house.

****'* ** ****-************** ** two ********* ** ******, but **** ** *** essense ** **. *** lesser ** *** ***** or *** ******* ** two *****.

***** *********** **** **** it's *** *** ** risks ** ******** *** the *********** ********* ** mitigate ***** *****.

** *** ********* ***** as * **** ****** technology, ** ** ** house ** ** ******** to ****** *** ************ of ********** ** ****** (the *****). ** *** does *** ******** ***** as * **** ****** technology, ***** *** **** sense.

** ****** *****'* **** more ** **** ** each ************ ***, *****, I ***** ****'* *** essence ** **.

***, **** ***** *** ill-communicated. * ***** **** that ****** *** *** a ****** ** **** industry ***** **** ********** and *********** ** * huge ****** ****** ** IT. * ****'* ***** I *** ** ***** the *******. **** ** unbelievable ** *** **** that **** ****** ****** has ******* ******** **** reliability ** * ****** used ** ******* ***** and ******. **** ** ERM ***** ** ****, "unadvisable" ** ** ********** adjective ** ******** *** ignorant *** ********* **** is, ***.

*** ******* ** **** executives\board ******* ***'* ********** technology **** * **** perspective ** ******** ** says, *******. ** *** cloud ******** ***** ** that ***** ***** **** be ****** ******* *********** logical ********, ** **** for ** ******* ******** about *** ********** ** physical ********.

***, * ***** ***** based ******** *** *** time, **** *********** ** the **** *****.

**** * **** **** I *** *** ******** in *** ************ ** undesirable *********, **** ****** to **** * **** to ******** *** ************ and ************* ** *** given ******** ** *** risks *** ********** ** those ***** ** **** particular ***********.

***, **** ***** *** ill-communicated.

*** **** ******** **** was * ***** ** vague *********** ******** ** with ************ * *****-***** botnet **** ***** **** corporations *** ***** *****-********* surveillance *******.

**** ** *** *********** I **** **** **** their *** **** **** multiple ********* *** *** not *********** ** * "simple" **** ******. ****, Verkada ****** **** ***** viewing, ***** **** *** have * ***** **********.

**** ** ************ ** the **** **** **** buying ****** *** ******* priority **** *********** ** a ****** **** ** protect ***** *** ******.

******** ******. **** "*****" are *** *********** **** show ****** ****** ***************** *** *********** ** the ******?

Update **/** - ***** *** *** ************* ********* / ** ******

** ** *** ******* of **/** ***** *** SMS ************* *** ****** have **** ******** **** our *******. ****** *** notifications *** ***** *** working. ** ******* *** to ******* *** ********** feedback *** **** ****** the ****** **** ** is ********.

************, ****** ****** ** also ******* ********, ******* for *** ***(*) **** it *** *** ***********, people ********* ****** *** still *** *****.

* ** **** ******* to *** *** ******* is ***** ** ******* the ****-****** ** ****.

********* **** ******** *** events ** ********* ****: Person ******** --> ****(*) matched --> ***** **** logged ** ******** --> Event **** ********** ** notification *******.

* **** ** ********** that *** ***** ************ stack ***** ** ** somehow ********** **** *** rules *****, *** ***** separate **** *** ****** detection **********.

**** **** **** *** been ******, ** ***** more **** * ******* in *** ***** ****** that *** *** *********** events *** ******* *** event *** ** *** notification **********, *** ** course * ***** *** say *** ****.

** ** **** **** common ** *** * third ***** ******* *** the ************ ******** (**:******), ** ***** ** interesting ** **** ** Verkada ** ******** ** have ****** (** ******) their *** **** ************ stack.

******* *** * *** funny, ********* ******* *** not **** * ** team ***** ********, **** a**** ********* ******* *********:

** ******* ***** ** a ***-****** ***** **** before ****** * ** team.

***** * *** ** people **** ** *****, sometimes **'* ** *** to **** * **.
***** *** * **** driven ********** **********
**** ****** *********** - Google ******

******* ********, **** ** 100% ******* **** *** autotests, ***** ** **** more ******** *** ********* than ****** **. ** should **** ** **** if ********* ***** *** be *********.

******, **** ******* ***** have * ** ****? Why ** *** ***?

** **. *** * few ******* *** * cannot *** ***** *** is *** ***** *** more ********* ***, * just **** **** ***. And **'* *** **** binary...

*) ** *******. ***** TDD ** **** **** efficient, ********** ** * startup ** ****** ** ship *** **** **** and **** **** ** manually ****** ** ******** with ***********. ****** ***** term ****, *** **** term **** ****. ** we ***** ** ** again, ** ***** **** a **** ******* **.

*) ** *** ****** client *** **** ** the ****, ** *** much ****** ** ********.

*) *****, ***** *** things ***** ****** ** is **** *********(********** ***** term).

*) ** *** ************, QA **** ***** *** role ** ********* *******. They **** *** ********* to ****** ********** ***** and ****** ********** ***** to **** ****** **** simple *** *****.

***** **** * *** of *** ******** ** members ******** **** ****** QA ** **** *******.

*** ****** * **** some *********/******** ** *** use ****** ** ** all. * ******* ***** would ** ** ******* form *** ********. **'* totally ****, **** *********.

**** ******** ** ********* reasonable. *** "********* **'* ** *** to **** * **" is ***.

** *** ******** ** the ******-**, ***** ********** test ******** ** *********, in ********, *** ****** any ***** ** ******* an ************'* ********* ** all ***** ** **** and ********.

*'* *** ** **** list, * ***** *****, that *** ****** ********** and *** * **** for ***** ********* ** interaction, ****** ******* *** can't ***** ******* *** the ******** ******** ******* that ** *** ***** will ******** ***.

********* * **** *** are **** ******* *****'* advocate, * ***'* ******* you ****** ***** **'* sensible ** **** *** salespeople *** ** *** in **...

**** *** ***** ********* interview ** **** **** they **** * **** of************(*** **** *****). ** means **** ****** ***** have ****** *** ** role ** ************ *******(*'* sure **** ***).

** **'* *** ***** "no *** ** **.." or "*** ****** *** human **".

***, * ***** **** someone ****** ** ******* even ******** ***** **** out ** ******* ****** deploying ** **********. ** still ** *****, ********* to **** ** **, that ** *********** **** them **** **** ** formalize **.

**** ****, *** ********** advocated *** **********:

******* ********, **** ** 100% ******* **** *** autotests

*****, *** ********** ** detracting **** *** **** of **********, **** ****** that *** ********** ********, whether ******* ***** ** now *******, ** ***** to **** * ********** QA *******, ****** ***.

* ******** **'* ***** to **** * ***** good ****** ***** ***** product *******.

**** ******* ** ***'* that *** **** ***** oil??

** **** ******** ******* of ********* ************ *******, with ** *** *** resolution ******** **** *******. A ******* ******* **** us **** *** ***** having ****** *** **** not ******** * ******** in * ****.

** **** ********* ** receive *****/*** *************, **** still ** ****** *** notifications.

******* *** *** ******** a ****** ** ********** for *** ******, *** we **** ****** *** report **** ** ******* one, ** ******* ********* a ****-******.

**** ****** ** ***** like **** ****** * software ****** **** **** massively ******* * ******** schema, ** ******* **** other *********** ************* ** the ************ **** ** very **** **** ** roll ****.

** **** *** *** fault ** * *** party ******* ********, ** would **** **** ****** been **** **** ** a **** *****, ******** along **** ******* ********* to * ********* *** party. *** ** *******, we ***** ** ******* of ***** ********* ****** notification ******** *** ***** products.

** **** *** *** result ** * ***** bug, *****, ***., **** would **** ****** **** back, ** ***** *** issue ** ***.

** **** **** ******* out ** ****** *********, they ***** **** **** a ***** ** **** tumblers ** **** ** fund **** **** *** cycles :)

**** ****** ** ** believe **** ** **** very ******* ** **** architecture, *** ******* **** Verkada **** **** *** very *********, ** **********, to *******.

* ****** ** ******* customers **** **** ** given *** ****** ***** how *** **** *** changes, ************, ***. *** rolled *** ** ***** personal ********* *** ********. This ** *** ** the ***** ********* ** SaaS-style *******, **** ******** experience ** **** ** good ** *** ******* link ** **** ********* resources.

*********** *******'* ********* ***** them ** ***** '****** reliable, ****** **':

****** *** ******* ***** of **** *********, ********* rarely ***** ** ** 'always' ******** ** '**' as *** ******* (******* its ******* ** ***** or ***, ***.) ** any ******* *** **** issues ********.

*********** *******'* ********* ***** them ** ***** '****** reliable, ****** **'

****, ** **** ***** the ******* *** **** impacted **** ****** **** you ***************** ** ***'* *** fixed *******.

*'* ******** **** *** rethinking ******** **** ** sign ** ** * customer ***** ***.

** ********* *** ******* through * ***** ******* dealer *** ********** *** system ******* ******** **********.

***** * ******* ***** they ***** ***** ******** created **** *** ***** address/domain, * ** *** know ** **** ***. They **** ** **** channel, ****** *** ******** through ***/************.

***** *** **** ******** partnering **** * ***** integrator ** ** **** covert *******, ** * manufacturer ***** ** **** their ******** **** **** you?

*'* **** ****** *** of *********; ** ******* doesn't ******* ** ************.

*** **** ** ** uptime ** **** ********* in ***** ***? ** they *** *** ******* like **********.** ** ****** outages?

** **** ** *** advertising ******* **** ** SLA ** ********** ** back ** **, ****'*... not ********** ** *** from **** *******.

* *'* ** ******, we **** ***** **** are ******** ******* ******* for ***** **** **** not **** ********* *************.

**** ******* *** *********'* *** ******* ****.

* ** * ******* partner. ***.

******: **** ******* *** been ***** ** *** own **********:* ** * ******* Partner. ***.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Security Fail: ASISNYC Auto Emails Passwords In Plain Text on May 14, 2019
ASIS NYC automatically emails a user with the password the user just entered, in plain text, when one registers for the site / event, as the...
OWAL Startup Profile - Ex-Googler Cloud AI Video Platform on May 29, 2019
OWAL, a NYC-based startup developing AI video analytics, is aiming to "improve the quality of life" within high-rise apartments, and commercial...
Startup Vaion Launching End-to-End AI Solution Backed with $20 Million Funding on Jun 17, 2019
An EU / USA video surveillance startup, Vaion, founded by ex-Cisco Senior Directors is launching an end-to-end VSaaS platform with $20 million in...
Exacq Remote Cloud Access Tested on Jun 20, 2019
Remote cloud access has been missing from most VMSes (including Exacq and Milestone). Now, Exacq, after releasing Cloud Drive Storage earlier in...
Network Optix / Hanwha Cloud Access Tested on Jul 02, 2019
Remote cloud access is becoming a bigger differentiator, as cybersecurity issues underscore the problems of port forwarding and many integrators...
Ivideon Russian VSaaS Profile on Jun 27, 2019
Ivideon was an early VSaaS entrant, initially focusing on the consumer market, claiming massive growth to IPVM in 2014. We spoke to Ivideon, to...
Calipsa - UK AI Startup Profile on Jul 10, 2019
Analytic startups are a major industry trend. One UK company, Calipsa is aiming to use AI to filter out false positive alarms for live video...
CheckMySystems Company Profile on Aug 14, 2019
CheckMySystems says that too many users respond, "I get an email when something is wrong" when talking about their video system maintenance plan,...
Axis Suffers Outage, Provides Postmortem on Aug 15, 2019
This week, Axis suffered an outage impacting their website and cloud services. Inside this note, we examined what happened, what was impacted...
Vunetrix Health Monitoring Company Profile on Nov 26, 2019
Vunetrix boasts that they make the integrators the 'HERO' by using Vunetrix's monitoring. We spoke to Vunetrix to better understand their...

Most Recent Industry Reports

Apple Acquires XNOR.ai, Loss For The Industry on Jan 16, 2020
Apple has acquired XNOR.ai for $200 million, reports GeekWire. This is a loss for the video surveillance industry. XNOR.ai stunned the industry...
Installation Course January 2020 - Last Chance on Jan 16, 2020
Thursday, January 16th is your last chance to register for the Winter 2020 Video Surveillance Installation Course. This is a unique installation...
Halo Smart Vape Detector Tested on Jan 16, 2020
The Halo Smart Sensor claims to detect vaping, including popular brand Juul and even THC vapes. But how well does it work in real world...
PRC Government Entity Now Controlling Shareholder of Infinova/March Networks on Jan 16, 2020
A PRC government entity is now the controlling shareholder of US security manufacturer Infinova as well as its wholly-owned subsidiary March...
Network Cabling for Video Surveillance on Jan 15, 2020
In this guide, we explain the fundamentals of network cabling for video surveillance networks, how they should be installed, and the differences in...
ONVIF Trashed Statement, Confirms Dahua and Hikvision Still Suspended on Jan 15, 2020
ONVIF has 'trashed' the suspension statement for Dahua, Hikvision, Huawei, etc. but confirms to IPVM that those companies are all still...
Wyze Smart Door Lock Test on Jan 14, 2020
Wyze's inexpensive cameras have grabbed the attention of many in the consumer market, but can the company's new smart lock get similar...
Wesco Wins Anixter on Jan 13, 2020
Despite Anixter earlier arguing that Wesco's bid was inferior to CD&R's by nearly 10%, Anixter confirmed that they are taking Wesco's 3.1%...
Anixter Resisting Takeover From Competitor, Bidding War Emerges, Wesco Wins on Jan 13, 2020
Mega distributor Anixter is going to be acquired but by whom? Initially, Anixter planned to go private, being bought by a private equity firm....
Bandwidth Fundamentals For Video Surveillance on Jan 13, 2020
Bandwidth is the most fundamental element of computer networking for video surveillance systems. Because video surveillance can consume an immense...