UK Facial Recognition Essex Errors Report

By John Honovich, Published on Jul 05, 2019

Facial recognition trials in the UK have generated significant controversy and debate over the past few years. This week, it flared again when Sky News / Guardian trumpeted that 81% of 'suspects' flagged were false. However, their posts did not analyze the details nor share the original research report. IPVM has.

london MPS police face rec report

In this report, we share and examine the 128-page report including:

The new and enhanced methodology that Essex used to analyze these results from more recent facial recognition trials in 2018 and 2019.
Why police / human review of matches was so critical and so difficult
How the 'accuracy' statistics vary and what the tradeoffs in different approaches were
How logs recorded show logistical challenges
How UK / EU / GDPR rules for consent complicate the challenges involved
China / PRC facial recognition systems contrasted

Report ********

************* ** ***** ***** Rights ****** *** ******** a ***-**** ******:

Observing ******

*** **** ********* ********** of **** ***** *** here ** ** ********** observe *** ****** ****** recognition *********** ** **** they ***** *** **** happened **** *** ****** were ******* *** ****** recognition *** ********** *******. The ***** **** ***** report ***** *** * trials **** ********:

Problems ********* **** *********** *******

*** ******* ******* *** perhaps **** ********** ******* of *** ****** ** that ********* *** ***** difficulty ******** ********* *******, i.e., ** *** ****** on *** ****** *** same ****** ** *** person *** ****** *********** system **** ********?

** ***** **** *** 6 ******, *** ****** were *** **** ******* the ***** *** *** person ** *** ****** so **** ******* *** person, *** **** ** 8 ** ***** ** times *** *** ****** flagged ** *** ****** the ****** ****** ** the ******, ** *** chart ***** *****:

***** ********* **** *** unreliability ** ****** ********* the ****** ** * key *******:

Sky **** **% *********

*** **% ******** ** Sky **** ******** ** matches **** *** ****** were **** ** ******* dismiss ** ***** ***** matches (*.*., *** ****-**** surveillance ***** *** ******* much ********* **** *** watchlist *****):

***********, *** **% ** wrong ** ***** **** only ** ******* **** were **** ** ** verified *** ** *****, 30 **** ******** ** being *****, *** * rate ** **.*%. *** difference ** **** * matches **** ****** ** be ********. ****** ***, the **** ** '****'.

Debate **** **********

**** *********** * ****** on *** ** ******* the *********** ** ***** systems.

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******. *** ****** mentions **** ********:

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** ********* **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

***** ** *****? **** are, ** **** *****. The ******** ******* ***** is **** ********.

Hard ** Visually ******

*** ******* ** **** it ** **** ** visually ****** ******* * match ** ***** ** wrong. ****** **** *****. For *******, ** ********* *********** ****, **** had ** ******** '*************'******* *** ****** *** generating *** **** ******, e.g.:

*** **** *** ********* high ******* ***** ******, not ************ ***** ***** where ******, ********, ******** variances, ***. *** **** it **** **** ** know *** **** ** just ******* ** * screen.

*************, *** ***** *** not ******* *** ******** of *** ******* ** show *** **** ** was ** **** ******* the ********* ***** *** the ****-**** *****.

Logs **** **********

*** *********** ******** * detailed *** ** ************ for *** ** *** test ***********. ** ******** one ******* **** ** front ** * ******* being ********:

** **** ******** ******** mistakes. ******* *** **** interesting ** * ** them ********* **** * minutes. ** *** *****, the ********* ******** ***** whether * ***** ** accurate *** *** ****** one ***** ***** *** ready ** ****** ***** they **** *** ******** processing *** *****:

*** *********** ******* ** that **** ** ***** have ********** *** ********** scores (** *.** *** 0.60). *** ****** ***** that *** **** *********** vendor (***) *** * threshold ** *.**:

*** ******* ********** ***** can ** ********, *** higher ** **, *** more ****** *** ****** rejects ***** ******* *** misses **** ******* *** vice *****. ** **** not ****** ***'* ****** recognition ** ** ****** opine ** *********** ******** but ******* **** ***** would ********* ****** ***** matches *** *** ******* "81%" ***** ****.

Technology ************

*** ****** ***** **** the **** ************ *** the ******* **** ********:

** ******* **** ******** about **** ******* **** used.

Positioning *** *******

*** ******* **** ********* mounted ********, ** ****, as *** ***** ***** from *** ****** *****:

*** *********** ******** ******* is **** *** *** strove ** ******* ******* and ***** ********* **** facial *********** *** ***** performed, ** **** ******* notes:

** *** **** ****, some ****** **** ******** after ******** *** ****** recognition:

China / *** **********

*** ******'* ******** ** China (***) ****** ** such ****** ******* ** facial *********** *** **** it **** *** ******* of *********** ******** ** it ** ************* ********** to ******** *** *********** of ***** *******.

**** ** **** ************** is *** **** ***** PRC ****** *********** ******* work (****** ***** **** been ******* ********* ** the ********, *.*.************************* ***********).

*** ******* **** *** PRC ****** *********** ******* is **** **** **** more ***** ***** ***** on ****, **** ******** data, **** ********* ****** (i.e., ******** ******** **), and **** (** **) legal ************.

*** ******* **** ** that ****** **** *******, especially **** *** *** dealing **** ***** ********** (e.g., ****** **** *** a *** ******* ** a *** ********, ***** PRC ******* ****** ***** have ********). ** ** inevitable **** ***** *** going ** ** ******** mistakes **** **** **** humans ** ******** ****** if **** **** ***** accuracy ** ********.

**********, ***** **** **** and ******* *** ****** about ***** *** ******* performance, ** **** ** hard ** ****** **** how **** ** *****.

UK ****** *********** ******?

***** ******* **** ********** about *** ****** ** facial *********** ** *** UK. ***** *** **** to *** **** (*******, software, *********, ***.) *** the **** ** ******* informed *******, ** ** hard ** *** **** as ***** * '**********' or *********** *******. ***** are ****** *** *** people ***** ******** *** the **** *** ********** involved.

**** ********* *** ****** as *** ********** ******** but *** ********** ** visually ********* ****** *** likely ** ************* ****** given *** **** ****** look ***** ********** ***** the *********** ** ***** quality ** ********** *******, open ****** ***********.

Comments (3)

Slava H

07/05/19 11:24pm

*********** ******, ***** ***. It's ****** ** *** real **** ***** *******.

******** ******* ****** ***** NEC **** **** ********* by ********** ********** ** Justice *****://***.****.***/*****/*******/******/**********-*****-******-********-*******-**-*************-******-***********-********

** *** ***** **** NN ******* ** ****** face ******** (*****, *** and ****..) ******** ****** in **** **** ********, where ******* ***/*** ******* are **** *** **** position ** *** ** perfect ** ** ********.

** ********** *** "******" (we *** ** ****** to **** *********) ** has **** ******** **** recognition ********** *** ************ performed **** ** ******* NIST *****.

Undisclosed Integrator #1

07/08/19 12:31pm

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******....
** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** *** **** 30 **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

** *** ************* ** any *** **** ***** negatives **** ******* ** their **********? *** *** this ** ********* **** sounds ****** *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 07/08/19 12:42pm

** *********, ************* ********* just **** *** ***** numbers, *.*.,**** ** * ********* explanation:

** '*** *** **%' is ****** *****. **** does ** *** **%? How **** ***** *** it **, ***.?

***** *** ********* **** to **** ***** ********* into *******, ** ***** is ** ******** ******** between ***** ********* *** false *********.

* ********** ********* *** ******** ***** to *********** ****, *.*.:

Image result for roc curve facial recognition

*******, ** ************ *********, they *** ******, ** ever *****.

Read this IPVM report for free.

This article is part of IPVM's 6,598 reports, 889 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Related Reports

The US Fight Over Facial Recognition Explained on Jul 08, 2020

The controversy around facial recognition has grown significantly in 2020,...

UK Court Rules Police Facial Recognition Needs Reform on Sep 01, 2020

A UK court has ruled that the South Wales Police use of facial recognition is...

Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020

The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...

Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020

COVID-19 has led to widespread facemask use, which as IPVM testing has shown...

Favorite Access Control Credentials 2020 on Sep 15, 2020

Credential choice is more debated than ever, with hacking risk for 125kHz and...

Temperature Screening Is Ineffective, Says US, UK, Canada, Israel, And Ireland Health Leaders on Aug 25, 2020

Health leaders around the world are increasingly speaking out about the...

Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020

While many argue that face recognition is inherently racist, results from one...

Briefcam Responsible Use Examined on Aug 24, 2020

While mega-companies Amazon, IBM, and Microsoft have been criticized for...

Vape Detection Legal Battle: Soter Sues IPVideo Corp on Jul 22, 2020

The crosstown vape detection rivals are now in a legal battle. While IPVideo...

Ear Recognition Examined on Oct 12, 2020

Will ear recognition become a viable biometric? Facial, fingerprint, and iris...

Gait Recognition Examined on Sep 14, 2020

Facial recognition faces increasing ethical and political criticisms while...

U.S. Government Accountability Office Urges Facial Recognition Regulation on Aug 27, 2020

The US Government Accountability Office (GAO) is urging facial recognition...

Chilean Official Investigated for Motorola And Hikvision Contracts on Sep 17, 2020

A corruption investigation is underway in Chile after a crime prevention...

Herta Facial Recognition Plus Masks Tested on Aug 19, 2020

Masks increase face recognition errors, but facial recognition developer...

Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020

Dahua is effectively taunting the Australian government by continuing to sell...

Recent Reports

Consultants Online Show LIVE Today! on Oct 27, 2020

IPVM's 7th online show will feature 20+ consultants and recruiters presenting...

Eagle Eye Networks Raises $40 Million on Oct 27, 2020

Eagle Eye has raised $40 million aiming to "reinvent video...

Hikvision Q3 2020 Global Revenue Rises, US Revenue Falls on Oct 27, 2020

While Hikvision's global revenue rises driven by domestic recovery, its US...

VICE Investigates Verkada's Harassing "RawVerkadawgz" on Oct 26, 2020

This month, IPVM investigated Verkada's sexism, discrimination, and cultural...

Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020

As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...

ISC Brasil Digital Experience 2020 Report on Oct 23, 2020

ISC Brasil 2020 rebranded itself to ISC Digital Experience and, like its...

Top Video Surveillance Service Call Problems 2020 on Oct 23, 2020

3 primary and 4 secondary issues stood out as causing the most problems when...

GDPR Impact On Temperature / Fever Screening Explained on Oct 22, 2020

What impact does GDPR have on temperature screening? Do you risk a GDPR fine...

Security And Safety Things (S&ST) Tested on Oct 22, 2020

S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...

Nokia Fever Screening Claims To "Advance Fight Against COVID-19" on Oct 22, 2020

First IBM, then briefly Clorox, and now Nokia becomes the latest Fortune 500...

Deceptive Meridian Temperature Tablets Endanger Public Safety on Oct 21, 2020

IPVM's testing of and investigation into Meridian Kiosk's temperature...

Honeywell 30 Series and Vivotek NVRs Tested on Oct 21, 2020

The NDAA ban has driven many users to look for low-cost NVRs not made by...

Ubiquiti Access Control Tested on Oct 21, 2020

Ubiquiti has become one of the most widely used wireless and switch providers...

Avigilon Aggressive Trade-In Program Takes Aim At Competitors on Oct 20, 2020

Avigilon has launched one of the most aggressive trade-in programs the video...

Mexico Video Surveillance Market Overview 2020 on Oct 20, 2020

Despite being neighbors, there are key differences between the U.S. and...