UK Facial Recognition Essex Errors Report

By John Honovich, Published on Jul 05, 2019

Facial recognition trials in the UK have generated significant controversy and debate over the past few years. This week, it flared again when Sky News / Guardian trumpeted that 81% of 'suspects' flagged were false. However, their posts did not analyze the details nor share the original research report. IPVM has.

london MPS police face rec report

In this report, we share and examine the 128-page report including:

  • The new and enhanced methodology that Essex used to analyze these results from more recent facial recognition trials in 2018 and 2019.
  • Why police / human review of matches was so critical and so difficult
  • How the 'accuracy' statistics vary and what the tradeoffs in different approaches were
  • How logs recorded show logistical challenges
  • How UK / EU / GDPR rules for consent complicate the challenges involved
  • China / PRC facial recognition systems contrasted

Report ********

************* ** ***** ***** Rights ****** *** ******** a ***-**** ******:

Observing ******

*** **** ********* ********** of **** ***** *** here ** ** ********** observe *** ****** ****** recognition *********** ** **** they ***** *** **** happened **** *** ****** were ******* *** ****** recognition *** ********** *******. The ***** **** ***** report ***** *** * trials **** ********:

Problems ********* **** *********** *******

*** ******* ******* *** perhaps **** ********** ******* of *** ****** ** that ********* *** ***** difficulty ******** ********* *******, i.e., ** *** ****** on *** ****** *** same ****** ** *** person *** ****** *********** system **** ********?

** ***** **** *** 6 ******, *** ****** were *** **** ******* the ***** *** *** person ** *** ****** so **** ******* *** person, *** **** ** 8 ** ***** ** times *** *** ****** flagged ** *** ****** the ****** ****** ** the ******, ** *** chart ***** *****:

***** ********* **** *** unreliability ** ****** ********* the ****** ** * key *******:

Sky **** **% *********

*** **% ******** ** Sky **** ******** ** matches **** *** ****** were **** ** ******* dismiss ** ***** ***** matches (*.*., *** ****-**** surveillance ***** *** ******* much ********* **** *** watchlist *****):

***********, *** **% ** wrong ** ***** **** only ** ******* **** were **** ** ** verified *** ** *****, 30 **** ******** ** being *****, *** * rate ** **.*%. *** difference ** **** * matches **** ****** ** be ********. ****** ***, the **** ** '****'.

Debate **** **********

**** *********** * ****** on *** ** ******* the *********** ** ***** systems.

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******. *** ****** mentions **** ********:

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** ********* **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

***** ** *****? **** are, ** **** *****. The ******** ******* ***** is **** ********.

Hard ** Visually ******

*** ******* ** **** it ** **** ** visually ****** ******* * match ** ***** ** wrong. ****** **** *****. For *******, ** ********* *********** ****, **** had ** ******** '*************'******* *** ****** *** generating *** **** ******, e.g.:

*** **** *** ********* high ******* ***** ******, not ************ ***** ***** where ******, ********, ******** variances, ***. *** **** it **** **** ** know *** **** ** just ******* ** * screen.

*************, *** ***** *** not ******* *** ******** of *** ******* ** show *** **** ** was ** **** ******* the ********* ***** *** the ****-**** *****.

Logs **** **********

*** *********** ******** * detailed *** ** ************ for *** ** *** test ***********. ** ******** one ******* **** ** front ** * ******* being ********:

** **** ******** ******** mistakes. ******* *** **** interesting ** * ** them ********* **** * minutes. ** *** *****, the ********* ******** ***** whether * ***** ** accurate *** *** ****** one ***** ***** *** ready ** ****** ***** they **** *** ******** processing *** *****:

*** *********** ******* ** that **** ** ***** have ********** *** ********** scores (** *.** *** 0.60). *** ****** ***** that *** **** *********** vendor (***) *** * threshold ** *.**:

*** ******* ********** ***** can ** ********, *** higher ** **, *** more ****** *** ****** rejects ***** ******* *** misses **** ******* *** vice *****. ** **** not ****** ***'* ****** recognition ** ** ****** opine ** *********** ******** but ******* **** ***** would ********* ****** ***** matches *** *** ******* "81%" ***** ****.

Technology ************

*** ****** ***** **** the **** ************ *** the ******* **** ********:

** ******* **** ******** about **** ******* **** used.

Positioning *** *******

*** ******* **** ********* mounted ********, ** ****, as *** ***** ***** from *** ****** *****:

*** *********** ******** ******* is **** *** *** strove ** ******* ******* and ***** ********* **** facial *********** *** ***** performed, ** **** ******* notes:

** *** **** ****, some ****** **** ******** after ******** *** ****** recognition:

China / *** **********

*** ******'* ******** ** China (***) ****** ** such ****** ******* ** facial *********** *** **** it **** *** ******* of *********** ******** ** it ** ************* ********** to ******** *** *********** of ***** *******.

**** ** **** ************** is *** **** ***** PRC ****** *********** ******* work (****** ***** **** been ******* ********* ** the ********, *.*.************************* ***********).

*** ******* **** *** PRC ****** *********** ******* is **** **** **** more ***** ***** ***** on ****, **** ******** data, **** ********* ****** (i.e., ******** ******** **), and **** (** **) legal ************.

*** ******* **** ** that ****** **** *******, especially **** *** *** dealing **** ***** ********** (e.g., ****** **** *** a *** ******* ** a *** ********, ***** PRC ******* ****** ***** have ********). ** ** inevitable **** ***** *** going ** ** ******** mistakes **** **** **** humans ** ******** ****** if **** **** ***** accuracy ** ********.

**********, ***** **** **** and ******* *** ****** about ***** *** ******* performance, ** **** ** hard ** ****** **** how **** ** *****.

UK ****** *********** ******?

***** ******* **** ********** about *** ****** ** facial *********** ** *** UK. ***** *** **** to *** **** (*******, software, *********, ***.) *** the **** ** ******* informed *******, ** ** hard ** *** **** as ***** * '**********' or *********** *******. ***** are ****** *** *** people ***** ******** *** the **** *** ********** involved.

**** ********* *** ****** as *** ********** ******** but *** ********** ** visually ********* ****** *** likely ** ************* ****** given *** **** ****** look ***** ********** ***** the *********** ** ***** quality ** ********** *******, open ****** ***********.

Comments (3)

*********** ******, ***** ***. It's ****** ** *** real **** ***** *******.

******** ******* ****** ***** NEC **** **** ********* by ********** ********** ** Justice *****://***.****.***/*****/*******/******/**********-*****-******-********-*******-**-*************-******-***********-********

** *** ***** **** NN ******* ** ****** face ******** (*****, *** and ****..) ******** ****** in **** **** ********, where ******* ***/*** ******* are **** *** **** position ** *** ** perfect ** ** ********.

** ********** *** "******" (we *** ** ****** to **** *********) ** has **** ******** **** recognition ********** *** ************ performed **** ** ******* NIST *****. 

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******....

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** *** **** 30 **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

** *** ************* ** any *** **** ***** negatives **** ******* ** their **********? *** *** this ** ********* **** sounds ****** *****.

** *********, ************* ********* just **** *** ***** numbers, *.*.,**** ** * ********* explanation:

** '*** *** **%' is ****** *****. **** does ** *** **%? How **** ***** *** it **, ***.?

***** *** ********* **** to **** ***** ********* into *******, ** ***** is ** ******** ******** between ***** ********* *** false *********.

* ********** ********* *** ******** ***** to *********** ****, *.*.:

Image result for roc curve facial recognition

*******, ** ************ *********, they *** ******, ** ever *****.

 

Read this IPVM report for free.

This article is part of IPVM's 6,598 reports, 889 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

The US Fight Over Facial Recognition Explained on Jul 08, 2020
The controversy around facial recognition has grown significantly in 2020,...
UK Court Rules Police Facial Recognition Needs Reform on Sep 01, 2020
A UK court has ruled that the South Wales Police use of facial recognition is...
Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020
The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Favorite Access Control Credentials 2020 on Sep 15, 2020
Credential choice is more debated than ever, with hacking risk for 125kHz and...
Temperature Screening Is Ineffective, Says US, UK, Canada, Israel, And Ireland Health Leaders on Aug 25, 2020
Health leaders around the world are increasingly speaking out about the...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Briefcam Responsible Use Examined on Aug 24, 2020
While mega-companies Amazon, IBM, and Microsoft have been criticized for...
Vape Detection Legal Battle: Soter Sues IPVideo Corp on Jul 22, 2020
The crosstown vape detection rivals are now in a legal battle. While IPVideo...
Ear Recognition Examined on Oct 12, 2020
Will ear recognition become a viable biometric? Facial, fingerprint, and iris...
Gait Recognition Examined on Sep 14, 2020
Facial recognition faces increasing ethical and political criticisms while...
U.S. Government Accountability Office Urges Facial Recognition Regulation on Aug 27, 2020
The US Government Accountability Office (GAO) is urging facial recognition...
Chilean Official Investigated for Motorola And Hikvision Contracts on Sep 17, 2020
A corruption investigation is underway in Chile after a crime prevention...
Herta Facial Recognition Plus Masks Tested on Aug 19, 2020
Masks increase face recognition errors, but facial recognition developer...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...

Recent Reports

Consultants Online Show LIVE Today! on Oct 27, 2020
IPVM's 7th online show will feature 20+ consultants and recruiters presenting...
Eagle Eye Networks Raises $40 Million on Oct 27, 2020
Eagle Eye has raised $40 million aiming to "reinvent video...
Hikvision Q3 2020 Global Revenue Rises, US Revenue Falls on Oct 27, 2020
While Hikvision's global revenue rises driven by domestic recovery, its US...
VICE Investigates Verkada's Harassing "RawVerkadawgz" on Oct 26, 2020
This month, IPVM investigated Verkada's sexism, discrimination, and cultural...
Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020
As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...
ISC Brasil Digital Experience 2020 Report on Oct 23, 2020
ISC Brasil 2020 rebranded itself to ISC Digital Experience and, like its...
Top Video Surveillance Service Call Problems 2020 on Oct 23, 2020
3 primary and 4 secondary issues stood out as causing the most problems when...
GDPR Impact On Temperature / Fever Screening Explained on Oct 22, 2020
What impact does GDPR have on temperature screening? Do you risk a GDPR fine...
Security And Safety Things (S&ST) Tested on Oct 22, 2020
S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...
Nokia Fever Screening Claims To "Advance Fight Against COVID-19" on Oct 22, 2020
First IBM, then briefly Clorox, and now Nokia becomes the latest Fortune 500...
Deceptive Meridian Temperature Tablets Endanger Public Safety on Oct 21, 2020
IPVM's testing of and investigation into Meridian Kiosk's temperature...
Honeywell 30 Series and Vivotek NVRs Tested on Oct 21, 2020
The NDAA ban has driven many users to look for low-cost NVRs not made by...
Ubiquiti Access Control Tested on Oct 21, 2020
Ubiquiti has become one of the most widely used wireless and switch providers...
Avigilon Aggressive Trade-In Program Takes Aim At Competitors on Oct 20, 2020
Avigilon has launched one of the most aggressive trade-in programs the video...
Mexico Video Surveillance Market Overview 2020 on Oct 20, 2020
Despite being neighbors, there are key differences between the U.S. and...