UK Facial Recognition Essex Errors Report

By: John Honovich, Published on Jul 05, 2019

Facial recognition trials in the UK have generated significant controversy and debate over the past few years. This week, it flared again when Sky News / Guardian trumpeted that 81% of 'suspects' flagged were false. However, their posts did not analyze the details nor share the original research report. IPVM has.

london MPS police face rec report

In this report, we share and examine the 128-page report including:

  • The new and enhanced methodology that Essex used to analyze these results from more recent facial recognition trials in 2018 and 2019.
  • Why police / human review of matches was so critical and so difficult
  • How the 'accuracy' statistics vary and what the tradeoffs in different approaches were
  • How logs recorded show logistical challenges
  • How UK / EU / GDPR rules for consent complicate the challenges involved
  • China / PRC facial recognition systems contrasted

****** *********** ****** ** the ** **** ********* significant *********** *** ****** over *** **** *** years. **** ****, ** flared ***** ******* **** / ******** trumpeted **** **%** '********' ******* **** false. *******, ***** ***** did *** ******* *** details *** ***** *** original ******** ******. **** has.

london MPS police face rec report

** **** ******, ** share *** ******* *** 128-page ****** *********:

  • *** *** *** ******** methodology **** ***** **** to ******* ***** ******* from **** ****** ****** recognition ****** ** **** and ****.
  • *** ****** / ***** review ** ******* *** so ******** *** ** difficult
  • *** *** '********' ********** vary *** **** *** tradeoffs ** ********* ********** were
  • *** **** ******** **** logistical **********
  • *** ** / ** / **** ***** *** consent ********** *** ********** involved
  • ***** / *** ****** recognition ******* **********

[***************]

Report ********

************* ** ***** ***** Rights ****** *** ******** a ***-**** ******:

Observing ******

*** **** ********* ********** of **** ***** *** here ** ** ********** observe *** ****** ****** recognition *********** ** **** they ***** *** **** happened **** *** ****** were ******* *** ****** recognition *** ********** *******. The ***** **** ***** report ***** *** * trials **** ********:

Problems ********* **** *********** *******

*** ******* ******* *** perhaps **** ********** ******* of *** ****** ** that ********* *** ***** difficulty ******** ********* *******, i.e., ** *** ****** on *** ****** *** same ****** ** *** person *** ****** *********** system **** ********?

** ***** **** *** 6 ******, *** ****** were *** **** ******* the ***** *** *** person ** *** ****** so **** ******* *** person, *** **** ** 8 ** ***** ** times *** *** ****** flagged ** *** ****** the ****** ****** ** the ******, ** *** chart ***** *****:

***** ********* **** *** unreliability ** ****** ********* the ****** ** * key *******:

Sky **** **% *********

*** **% ******** ** Sky **** ******** ** matches **** *** ****** were **** ** ******* dismiss ** ***** ***** matches (*.*., *** ****-**** surveillance ***** *** ******* much ********* **** *** watchlist *****):

***********, *** **% ** wrong ** ***** **** only ** ******* **** were **** ** ** verified *** ** *****, 30 **** ******** ** being *****, *** * rate ** **.*%. *** difference ** **** * matches **** ****** ** be ********. ****** ***, the **** ** '****'.

Debate **** **********

**** *********** * ****** on *** ** ******* the *********** ** ***** systems.

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******. *** ****** mentions **** ********:

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** ********* **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

***** ** *****? **** are, ** **** *****. The ******** ******* ***** is **** ********.

Hard ** Visually ******

*** ******* ** **** it ** **** ** visually ****** ******* * match ** ***** ** wrong. ****** **** *****. For *******, ** ********* *********** ****, **** had ** ******** '*************'******* *** ****** *** generating *** **** ******, e.g.:

*** **** *** ********* high ******* ***** ******, not ************ ***** ***** where ******, ********, ******** variances, ***. *** **** it **** **** ** know *** **** ** just ******* ** * screen.

*************, *** ***** *** not ******* *** ******** of *** ******* ** show *** **** ** was ** **** ******* the ********* ***** *** the ****-**** *****.

Logs **** **********

*** *********** ******** * detailed *** ** ************ for *** ** *** test ***********. ** ******** one ******* **** ** front ** * ******* being ********:

** **** ******** ******** mistakes. ******* *** **** interesting ** * ** them ********* **** * minutes. ** *** *****, the ********* ******** ***** whether * ***** ** accurate *** *** ****** one ***** ***** *** ready ** ****** ***** they **** *** ******** processing *** *****:

*** *********** ******* ** that **** ** ***** have ********** *** ********** scores (** *.** *** 0.60). *** ****** ***** that *** **** *********** vendor (***) *** * threshold ** *.**:

*** ******* ********** ***** can ** ********, *** higher ** **, *** more ****** *** ****** rejects ***** ******* *** misses **** ******* *** vice *****. ** **** not ****** ***'* ****** recognition ** ** ****** opine ** *********** ******** but ******* **** ***** would ********* ****** ***** matches *** *** ******* "81%" ***** ****.

Technology ************

*** ****** ***** **** the **** ************ *** the ******* **** ********:

** ******* **** ******** about **** ******* **** used.

Positioning *** *******

*** ******* **** ********* mounted ********, ** ****, as *** ***** ***** from *** ****** *****:

*** *********** ******** ******* is **** *** *** strove ** ******* ******* and ***** ********* **** facial *********** *** ***** performed, ** **** ******* notes:

** *** **** ****, some ****** **** ******** after ******** *** ****** recognition:

China / *** **********

*** ******'* ******** ** China (***) ****** ** such ****** ******* ** facial *********** *** **** it **** *** ******* of *********** ******** ** it ** ************* ********** to ******** *** *********** of ***** *******.

**** ** **** ************** is *** **** ***** PRC ****** *********** ******* work (****** ***** **** been ******* ********* ** the ********, *.*.************************* ***********).

*** ******* **** *** PRC ****** *********** ******* is **** **** **** more ***** ***** ***** on ****, **** ******** data, **** ********* ****** (i.e., ******** ******** **), and **** (** **) legal ************.

*** ******* **** ** that ****** **** *******, especially **** *** *** dealing **** ***** ********** (e.g., ****** **** *** a *** ******* ** a *** ********, ***** PRC ******* ****** ***** have ********). ** ** inevitable **** ***** *** going ** ** ******** mistakes **** **** **** humans ** ******** ****** if **** **** ***** accuracy ** ********.

**********, ***** **** **** and ******* *** ****** about ***** *** ******* performance, ** **** ** hard ** ****** **** how **** ** *****.

UK ****** *********** ******?

***** ******* **** ********** about *** ****** ** facial *********** ** *** UK. ***** *** **** to *** **** (*******, software, *********, ***.) *** the **** ** ******* informed *******, ** ** hard ** *** **** as ***** * '**********' or *********** *******. ***** are ****** *** *** people ***** ******** *** the **** *** ********** involved.

**** ********* *** ****** as *** ********** ******** but *** ********** ** visually ********* ****** *** likely ** ************* ****** given *** **** ****** look ***** ********** ***** the *********** ** ***** quality ** ********** *******, open ****** ***********.

Comments (3)

Slava H

07/05/19 11:24pm

*********** ******, ***** ***. It's ****** ** *** real **** ***** *******.

******** ******* ****** ***** NEC **** **** ********* by ********** ********** ** Justice*****://***.****.***/*****/*******/******/**********-*****-******-********-*******-**-*************-******-***********-********

** *** ***** **** NN ******* ** ****** face ******** (*****, *** and ****..) ******** ****** in **** **** ********, where ******* ***/*** ******* are **** *** **** position ** *** ** perfect ** ** ********.

** ********** *** "******" (we *** ** ****** to **** *********) ** has **** ******** **** recognition ********** *** ************ performed **** ** ******* NIST *****.

Undisclosed Integrator #1

07/08/19 12:31pm

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******....

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** *** **** 30 **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

** *** ************* ** any *** **** ***** negatives **** ******* ** their **********? *** *** this ** ********* **** sounds ****** *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 07/08/19 12:42pm

** *********, ************* ********* just **** *** ***** numbers, *.*.,**** ** * ********* explanation:

** '*** *** **%' is ****** *****. **** does ** *** **%? How **** ***** *** it **, ***.?

***** *** ********* **** to **** ***** ********* into *******, ** ***** is ** ******** ******** between ***** ********* *** false *********.

* ********** ********* *** ******** ***** to *********** ****, *.*.:

Image result for roc curve facial recognition

*******, ** ************ *********, they *** ******, ** ever *****.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Most Recent Industry Reports

Mobile Access Usage Statistics 2019 on Jul 18, 2019
The ability to use mobile phones as access credentials is one of the biggest trends in a market that historically has been slow in adopting new...
New GDPR Guidelines for Video Surveillance Examined on Jul 18, 2019
The highest-level EU data protection authority has issued a new series of provisional video surveillance guidelines. While GDPR has been in...
Anyvision Aims For 2022 Revenue of $1 Billion on Jul 17, 2019
Only 3 video surveillance manufacturers do a billion dollars or more in annual revenue - Hikvision, Dahua, and Axis. Now, Anyvision plans to join...
HD Analog vs IP Guide on Jul 16, 2019
For years, HD resolution and single cable signal/power were IP camera advantages, with analog cameras limited to much lower resolution and...
How To Troubleshoot Wiegand Reader Problems - Inverted Wiring on Jul 16, 2019
Wiegand is the dominant method of connecting access readers, but problems can arise for installers. In fact, one of the most difficult reader...
ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
Motorola Acquires Watchguard, Adds to Vigilant And Avigilon on Jul 15, 2019
2 years ago, Motorola had no position nor relevancy to video surveillance. Now, they own major video surveillance, LPR and body camera providers...
Hikvision Global News Reports Directory on Jul 15, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Vivotek Trend Micro Cyber Security Camera App Tested on Jul 15, 2019
Vivotek and Trend Micro are claiming five million blocked attacks on IP cameras, with their jointly developed app for Vivotek cameras. This new...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact