Verkada Below Average Facial Recognition Tested

Published May 26, 2023 12:55 PM

Verkada told the Washington Post "its facial recognition system accurately matched more than 99 percent of faces". But after multiple calls between IPVM and Verkada's engineering team, and weeks of us testing Verkada, we found the accuracy far worse and inferior to most competitors we tested.

IPVM Image

IPVM tested Verkada's facial recognition, and inside this report, we detail the full results of our testing, including:

  • Strengths and Weaknesses found during testing.
  • Facial recognition with shallow, moderate, and harsh camera down-tilt angles in full light (~180 lux).
  • Facial recognition in low light (~1 lux) with IR.
  • Facial recognition with sunglasses, hats, and masks added.
  • Identification of people within groups.
  • Face "De-Duplication" testing.
  • IPVM stress testing, showing enrollment, total matches, and false match rates.
  • Interface overview of the system.
  • Bulk uploading of faces for watchlists.
  • Approximate PPF needed for facial recognition.
  • Pricing and Availability.

This report expands upon the Facial Recognition Rankings 2023 - Avigilon, Briefcam, Hikvision, IronYun, Oosto, Rhombus, Turing, and Verkada, by providing more details of Verkada facial recognition performance.

************

*******'* ****** *********** ** *********, ** no ********** **** **** ****** ******** licenses, ** ******* ******* *** *********. However, *******'* ****** ************* *** ********* ** *****, ********, and ********, **.

Command ********* ********

******* ******* ********* *** *** **** ("People" *** "*****") ***** ***** *** utilize ****** ***********. ** *** "******" tab ***** * ******, ***** *** click ** *** ***** **** ***** a ********* *** ****** "****** ** this ******" ** **** ******* ********. Alternatively, ***** *** *** *** "*****" tab *** ***** ** *** **** thumbnails ** **** ******* ********. ***** is * ***** ***** ** *** Verkada ******* *********.

******* ********* ***** ***** *** **** up ** ** ******* ** ****** on *** "*****" ***, *** *** all ***** *** ** ********.

IPVM Image

******* **** ****, *** *** **** accurate ******* ***** **** *** *** "People" *** *** ******* ****** ***********.

Verkada ******** *********** ******* ****** ** ******** *** ********

******* **** **** *** ***** ***** to ***** ****** **** ** ** marked ** * "****** ** ********" for **** ************* ********* ******. ******* said, ***** * ******* ** ** entry ***** *** **** ******, *** allows *** ****** *** ******** * better ************** ** ***** *******.

* ******* *** ****** ** ******** (POI) *** ********* ******** ** *** products. * ******* ** * ***** image ** * ******’* **** **** a ******** *** *** ** ** entry ***** *** ******. * *** is * **** **** * ******** has ******** ** ***** ** ******** an *****.

******* ***** **** **** ****** ****** precision *** ****** **** *** *************, which *** ******* ** * ****** alert *** ******* *** ****** ****** a **-****** ****** **** *** ********, using *** "**** ******" *******.

**** *** *******, ** ***** ****** higher ********* *** ****** **** *** notifications **. **** ******.

****** *******, **** *** *** ******* a ********** ******* ******** ****** ** POI ** ******. *** **** ************** observed *** *** ******* ** ******* alert ************* ********** **** *** ****.

** *** ******** *******, ** ******* the ******* *** ***** ******** ******** of *** *** ***** ******* ****** recognition ****** *** ***** ** *** not.

Executive *******

***** ******* ****** ** **** "**** than ** *******" ****** *********** ********, IPVM ******* ***** *** ******** ** significantly ***** **** *** ******* **%, matching **% ** *** ***** ** ideal ********** (***** ******* *****, ****-*** scenes), ***** **** ******** **** **** 15% ** *** ***** ** ***-***** conditions (******* *****,***-*****/**** ******), *** ** exhibited ******** *********** **** ***** **** it * **** *** *** **** use *****.

*** **** *********** *********** ********* ** that ** ** ********, ** ** additional ****, **** ******/*********** ** *******, so **** *****, **** ***-*********** ************, may ** ********* ***** **** **** are *** ****** ***** *** **.

Technical **** *******

**** ******** ** ***** ****** *********** offerings *******'* *********** ** ******** *** to ***-******* ** ***** ******* *** partial *****, *** ******* ** ********* identify *** ******** ** * *****. Additionally, ******* ******** ** ******* ** faces ** ***-*****/**** ****** **** ** on *** **** *********** ***** (****, sunglasses, *** *****) *** **** ***** rate *** ***.

** *** ******** ****, ******* ******** quick *************, ********* ****** ~* ******* via *** ******* ********* *** *****, however, *** ****** *** ******* ** a ****** ***** *** ******* *** camera ****** * **-****** **** *****. Verkada's ****** *********** ** **** ** set ** *** ****** ***** ** programmatically *** ******-**-******** ******** ******* *** API.

*********

  • **** *****:******* ****** *********** ** **** ** set **, **** **** **** * clicks ****** *** **** ****** (****** recognition ** ******** ** *******).
  • ***** ******:******* ******** ***** ******-**-******** ****** (~* seconds) ******* *** ********* *** *****.
  • ************ *********:******* ****** *** ************ ********* ** people, ** "****** ** ********" *** Verkada's ***.

**********

  • **** ******** *******:******* *** * *** ******* ***** rate *** **** *** ******* ***** in ******** *** ***** ****-**** ****** in **** ***** (~*** ***). ************, with *********** ***** ******** ** ******** degraded.
  • ** ***** ** ***-*****/**** ******:******* ******** * *** ******* ***** rate **** *********** (****, **********, *****) in **** ***** (~*** ***).
  • ************ ******** ** ******:******* *** ************ **** *** ************** of *********** ****** ******.
  • ***** ******* ********:******* ******** ******* ***** ** *** "Faces" *** ** ********* ***** ***** across *******, **** ** ****** *** users ** ***/****** *** ***** *** to **** **** **** "**-***********".
  • **-****** "****-****":"****** ** ********" ****** *** ******* to * ****** ************ ***** **** per ******, *** ****** ** * 15-minute **** ******.

Simple ****** *********** *************

******** *******'* ****** *********** ** ******, and ******** * ****** *** ****** overall ** *** ******* ******* ********* to ** *******, ***** *****.

IPVM Image

** ********, ***********, **** *********** ********** (*** ****), ***** ******** ******* *************, *** additional ********, **** ** ** ***, whereas ******* ** ****** ** *** cloud, *** ******** * *** ****** per ****** *** *************.

Poor *********** ** ******* ****** ****-**** ******

****** *******, ******* ********* ****** **** cameras ********* ** ******* ****-**** ****** (7' - **°) ** **** ***** (~180 ***), ******** ***** *********** *** camera ******** ~**% ** *** *****, and **** ~**% **** ******** *********** at **°.

***** ******* ******* ~**% ** *** faces *********, ** ****** ** ******* the ******* ~**% ** *** ***** and *** *** ***** ~**% ** the ***** ** *** *********.

IPVM Image

*** ******* ***** (~**° ********) ** the *****, ******* *** * ******* face ***** **** ** ~**%, *** not ***** ~**% ** *** ***** to *** *********, *** ******** * single ***** **** ***** ***** **** failing ** ****** * ****** ****** a ****** ****.

IPVM Image

*** ******* ***** (~**°) ** *** scene, ******* *** *** ******* *** correct **** *******, ****** ** ****** a ****** ** ~**% ** *** walks, *** ******** * ***** **** match.

IPVM Image

Poor *********** ** ******** *** ***** ****** ****-**** ******

****** *******, ******* ********* ****** **** cameras ********* ** ******** (*' - 22°) *** ***** (**' - **°) down-tilt ****** ** **** ***** (~*** lux), ******** ***** *********** *** ****** directly **** **** **% ** *** walks, *** ******** ******* ***** ~**% of *** *********.

******** ****-****:

IPVM Image

***** ****-****:

IPVM Image

Poor *********** **** ***********

****** *******, ******* ********* ****** ** full ***** (~*** ***) **** ******** wearing *********** (****, **********), *** *** less **** ~%** ******* ******* **** subjects *********** *** ****** ********. ************, with ******** ******* ********** *** *****, Verkada **** ******* * ****** **** correctly *** ** ** *********.

IPVM Image

Poor *********** **** **** *****

****** *******, ******* ********* ****** ** full ***** (~*** ***) **** *** subject **** **** *****, ********* ******** faces *********** *** ****** ******** **** than **% ** *** *****.

IPVM Image

Poor *********** ** *** *****/**** ** **

****** *******, ******* ********* ****** ** low-light/Dark ****** **** ** **, *** matching *** ***** *** ** ** walks *********.

IPVM Image

Poor *********** **** ******

****** *******, ******* ********* ****** ** full ***** (~*** ***) ** ******* Down-tilt ****** (*' - **°) *** groups, ********* ******** *** *** ** 6 *****.

IPVM Image

************, ******* ******** ***** *** ** matches ** **** ** *** ******** within * ***** **** *** ******** were ******* ** * ****, ********* one ******* ** * ****. ********, the ******* "***** ****" ****** **** multiple ****** ** * ***, *** person ** ***** *** ****** *********** is ***** ** *** ******* ********* below.

IPVM Image

Person ** ******** ******

******* ****** ***** ** *** ** "Person ** ********" ******, *** **** the ***** ** *** ****** ***.

IPVM Image

*** ***** ****** *** **** *** delivered ** ~* *******, *** ******* the ********* *****, ****** **** *** image, ****** ****, *** ****.

IPVM Image

******* **** ******** *** ****** ** its ******* *********, ******* *** ********* video *** ***** ******* ******** ** the *****.

IPVM Image

******* **** ****, **** ** *** perform ************* *** "****** ** ********" notifications, *** ***** ** * **-****** cooldown ****** *** ************* ** *** same ****** ** *** **** ******.

*** ****** ** ******** (***) *************, two ********* ****** ** ****: (*) we ** *** ******* ******** *** to *** ******* ************ *** *** notifications. (*) *** ***************, *******, **** * ** ****** cooldown ****** *** ************* ** *** same ****** ** *** **** ******. We ******** **** ******** ****** ** avoid ******* ********** ************* ** *** customers *** * ********** *** ****** a ***** ******.

**** ******* *****, ***** ** * 15-minute ******** ****** ******* *** ******.

IPVM Image

***** *** *** ****** *** *** or ******** (** ** **) **** on *** ****** ***, *** ****** to ** ******** ******* *** *********, email, ** ***.

IPVM Image

Faces ******* ** "*****" ***

****** *******, ******* ******** ********** ****** detection, *******, **** **-**% ** ***** were ***** ** *** *********. ******* told ****, ***** ****** ** ******** to **-********* **** **********, *** **** expect ** *** ***** "****" ********** than "******" ********* ** *** *********.

** ******** *** ********* *** ****** to *********** **** **********. *** ****** page *** *** ********* ****** ******* and *** **** **** ** ** entry ***** *** ******. *** **** reason, *** **** *** **** “******” detections **** “****” **********.

******* ********* **** **-*********** ***** ** batches, *** ********* ** ******* ********* user *******, *** **** ** ***, the ***** **** ***** ****** **** a *** ******* ** *** ****.

****’* *** *** **** ************* *****: our ****** ********* ***** ** *******, and *** **** ** **** ***** depends ** **** ******* (*.*., **** traffic, **** ** ***, ***.). ***** the ******* **** ** **** ***** for ************* ** *** ** *** hour, **** ******* **** **** * few *******. **** ******* ** ** perform *** ******** **** ** ******* to *** ********* ******* *********** *** much ******* ** *** **** ****** pipeline.

******* ***** **** ** *** ******* de-duplication *** *** ****** ** ******** notifications, *** **** **** * **-****** cooldown *** ************ ** *** **** person ** *** **** ******.

*** ****** ** ******** (***) *************, two ********* ****** ** ****: (*) we ** *** ******* ******** *** to *** ******* ************ *** *** notifications. (*) *** ***************, *******, **** * ** ****** cooldown ****** *** ************* ** *** same ****** ** *** **** ******. We ******** **** ******** ****** ** avoid ******* ********** ************* ** *** customers *** * ********** *** ****** a ***** ******.

Testing **-*********** *** *****

**** ********* ** ***** ****** *** camera ** * ****-*** ***** (~*** lux) **** *** ****** ******* ** a ******* ****-**** (*' - **°) but ******* *** ** ***** * minutes ******* **** ****.

*** **** ******** ***** ** *** "Faces" *** *** ************ ****** ******** walks, ******* **** ** ***** ** three ***** *** ****, ***** ** the *********. **** *** *** ******* any ***** ******* ** *******'* ******* "De-Duplication", *** ** ****** **** ********/******.

IPVM Image

Does *** **** **** ******, ****** ************ ********* **** ***

******* ****** ***** ** *** ***** one ** *** ** * ********* using ***** ******* *********. ** *** a **** ** * ****** ** interest, ***** **** ******** ** *** "People" ***, **** ** ** "********" and ***** "****** *******." (***** *****) Then ***** *** ****** ****** *** exceeding ** ** ** ****, ****** a ******* ** * ****** ** interest, *** *** **** ** *** profile.

IPVM Image

*************, ******* ****** ***** ** ******, update, *** ****** "****** ** ********" using ***** ***. ** ****** * face ***** ***** *** ***, *** users **** ******* *** ***** ** base64, *** **** * ****** ***** can ** ******** ** * ****.

IPVM Image

****** **** *******, ** **** * script ** ************* ****** "****** ** Interest" ******** ** **** *** **** ~2,500 ******.

IPVM Image

*** ******* ******* ********* ************* ******* images **** ** *** **** ***** specifications *** ******** ** ***** ******* on *** ******* ******. ** * face ** ********** ********, ** ***** in *** ********* ***** *** "********", and "****** ** ********" ** ********* by * **** **** ** *** top **** ****** ** *** *****.

IPVM Image

** ********, **** *********** (****** *** IronYun) ** *** **** ****-****** **** uploading, *** **** ***** ******* ***** to ******* *** ********* ******** ** request **** ** * ***** ********* is ********/******.

IPVM ****** *******

**** ********* ****** ******* ********* ***-* *************, ******** *** ********** **** ** faces, ***** ***** ****, *** ***** match ****. ** **** ~*,*** ***** to ********* *** ********** **** ** the ******, ***** ******** ~*,*** ********** face ******.

**** *** ********* *** *******, ** recorded * ********* ****** ******* *** videos ** ****** ******* **** **** and ******* ******, *** ******* **** detected ~** ****** **** * ******* face ******* *** * ***** **** matches.

IPVM Image

~120 *** ******** *** ******** ****** ***********

****** **** *******, ******* ******** ~*** PPF ** **** *** ******** ****** recognition *** ******* ********* ** ******* down-tilt ****** ** **** ***** (~*** lux).

IPVM Image

***** *** *** ******* ******* ** the ****** ******** *** *** *****, this ****** ********* **** ** ****** for *******'* ****** ***********.

Firmware ******

******* ****-*: "** ** ****"

Comments