UK Facial Recognition Essex Errors Report

By: John Honovich, Published on Jul 05, 2019

Facial recognition trials in the UK have generated significant controversy and debate over the past few years. This week, it flared again when Sky News / Guardian trumpeted that 81% of 'suspects' flagged were false. However, their posts did not analyze the details nor share the original research report. IPVM has.

london MPS police face rec report

In this report, we share and examine the 128-page report including:

  • The new and enhanced methodology that Essex used to analyze these results from more recent facial recognition trials in 2018 and 2019.
  • Why police / human review of matches was so critical and so difficult
  • How the 'accuracy' statistics vary and what the tradeoffs in different approaches were
  • How logs recorded show logistical challenges
  • How UK / EU / GDPR rules for consent complicate the challenges involved
  • China / PRC facial recognition systems contrasted

****** *********** ****** ** the ** **** ********* significant *********** *** ****** over *** **** *** years. **** ****, ** flared ***** ******* **** / ******** trumpeted **** **%** '********' ******* **** false. *******, ***** ***** did *** ******* *** details *** ***** *** original ******** ******. **** has.

london MPS police face rec report

** **** ******, ** share *** ******* *** 128-page ****** *********:

  • *** *** *** ******** methodology **** ***** **** to ******* ***** ******* from **** ****** ****** recognition ****** ** **** and ****.
  • *** ****** / ***** review ** ******* *** so ******** *** ** difficult
  • *** *** '********' ********** vary *** **** *** tradeoffs ** ********* ********** were
  • *** **** ******** **** logistical **********
  • *** ** / ** / **** ***** *** consent ********** *** ********** involved
  • ***** / *** ****** recognition ******* **********

[***************]

Report ********

************* ** ***** ***** Rights ****** *** ******** a ***-**** ******:

Observing ******

*** **** ********* ********** of **** ***** *** here ** ** ********** observe *** ****** ****** recognition *********** ** **** they ***** *** **** happened **** *** ****** were ******* *** ****** recognition *** ********** *******. The ***** **** ***** report ***** *** * trials **** ********:

Problems ********* **** *********** *******

*** ******* ******* *** perhaps **** ********** ******* of *** ****** ** that ********* *** ***** difficulty ******** ********* *******, i.e., ** *** ****** on *** ****** *** same ****** ** *** person *** ****** *********** system **** ********?

** ***** **** *** 6 ******, *** ****** were *** **** ******* the ***** *** *** person ** *** ****** so **** ******* *** person, *** **** ** 8 ** ***** ** times *** *** ****** flagged ** *** ****** the ****** ****** ** the ******, ** *** chart ***** *****:

***** ********* **** *** unreliability ** ****** ********* the ****** ** * key *******:

Sky **** **% *********

*** **% ******** ** Sky **** ******** ** matches **** *** ****** were **** ** ******* dismiss ** ***** ***** matches (*.*., *** ****-**** surveillance ***** *** ******* much ********* **** *** watchlist *****):

***********, *** **% ** wrong ** ***** **** only ** ******* **** were **** ** ** verified *** ** *****, 30 **** ******** ** being *****, *** * rate ** **.*%. *** difference ** **** * matches **** ****** ** be ********. ****** ***, the **** ** '****'.

Debate **** **********

**** *********** * ****** on *** ** ******* the *********** ** ***** systems.

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******. *** ****** mentions **** ********:

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** ********* **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

***** ** *****? **** are, ** **** *****. The ******** ******* ***** is **** ********.

Hard ** Visually ******

*** ******* ** **** it ** **** ** visually ****** ******* * match ** ***** ** wrong. ****** **** *****. For *******, ** ********* *********** ****, **** had ** ******** '*************'******* *** ****** *** generating *** **** ******, e.g.:

*** **** *** ********* high ******* ***** ******, not ************ ***** ***** where ******, ********, ******** variances, ***. *** **** it **** **** ** know *** **** ** just ******* ** * screen.

*************, *** ***** *** not ******* *** ******** of *** ******* ** show *** **** ** was ** **** ******* the ********* ***** *** the ****-**** *****.

Logs **** **********

*** *********** ******** * detailed *** ** ************ for *** ** *** test ***********. ** ******** one ******* **** ** front ** * ******* being ********:

** **** ******** ******** mistakes. ******* *** **** interesting ** * ** them ********* **** * minutes. ** *** *****, the ********* ******** ***** whether * ***** ** accurate *** *** ****** one ***** ***** *** ready ** ****** ***** they **** *** ******** processing *** *****:

*** *********** ******* ** that **** ** ***** have ********** *** ********** scores (** *.** *** 0.60). *** ****** ***** that *** **** *********** vendor (***) *** * threshold ** *.**:

*** ******* ********** ***** can ** ********, *** higher ** **, *** more ****** *** ****** rejects ***** ******* *** misses **** ******* *** vice *****. ** **** not ****** ***'* ****** recognition ** ** ****** opine ** *********** ******** but ******* **** ***** would ********* ****** ***** matches *** *** ******* "81%" ***** ****.

Technology ************

*** ****** ***** **** the **** ************ *** the ******* **** ********:

** ******* **** ******** about **** ******* **** used.

Positioning *** *******

*** ******* **** ********* mounted ********, ** ****, as *** ***** ***** from *** ****** *****:

*** *********** ******** ******* is **** *** *** strove ** ******* ******* and ***** ********* **** facial *********** *** ***** performed, ** **** ******* notes:

** *** **** ****, some ****** **** ******** after ******** *** ****** recognition:

China / *** **********

*** ******'* ******** ** China (***) ****** ** such ****** ******* ** facial *********** *** **** it **** *** ******* of *********** ******** ** it ** ************* ********** to ******** *** *********** of ***** *******.

**** ** **** ************** is *** **** ***** PRC ****** *********** ******* work (****** ***** **** been ******* ********* ** the ********, *.*.************************* ***********).

*** ******* **** *** PRC ****** *********** ******* is **** **** **** more ***** ***** ***** on ****, **** ******** data, **** ********* ****** (i.e., ******** ******** **), and **** (** **) legal ************.

*** ******* **** ** that ****** **** *******, especially **** *** *** dealing **** ***** ********** (e.g., ****** **** *** a *** ******* ** a *** ********, ***** PRC ******* ****** ***** have ********). ** ** inevitable **** ***** *** going ** ** ******** mistakes **** **** **** humans ** ******** ****** if **** **** ***** accuracy ** ********.

**********, ***** **** **** and ******* *** ****** about ***** *** ******* performance, ** **** ** hard ** ****** **** how **** ** *****.

UK ****** *********** ******?

***** ******* **** ********** about *** ****** ** facial *********** ** *** UK. ***** *** **** to *** **** (*******, software, *********, ***.) *** the **** ** ******* informed *******, ** ** hard ** *** **** as ***** * '**********' or *********** *******. ***** are ****** *** *** people ***** ******** *** the **** *** ********** involved.

**** ********* *** ****** as *** ********** ******** but *** ********** ** visually ********* ****** *** likely ** ************* ****** given *** **** ****** look ***** ********** ***** the *********** ** ***** quality ** ********** *******, open ****** ***********.

Comments (3)

Slava H

07/05/19 11:24pm

*********** ******, ***** ***. It's ****** ** *** real **** ***** *******.

******** ******* ****** ***** NEC **** **** ********* by ********** ********** ** Justice *****://***.****.***/*****/*******/******/**********-*****-******-********-*******-**-*************-******-***********-********

** *** ***** **** NN ******* ** ****** face ******** (*****, *** and ****..) ******** ****** in **** **** ********, where ******* ***/*** ******* are **** *** **** position ** *** ** perfect ** ** ********.

** ********** *** "******" (we *** ** ****** to **** *********) ** has **** ******** **** recognition ********** *** ************ performed **** ** ******* NIST *****. 

Undisclosed Integrator #1

07/08/19 12:31pm

************* ****** ******** **** use *** ***** ******* of ***** ******* ****** them ********** ** **% or ******....

** **** ****, *** system ****** ******* ********* of ***** ** ****** walking ** **** ***** 6 ****** *** **** 30 **** ****** ** be *****. ********** ** this *** (*** ** false / **,*** ***** scanned) ***** * ***** positive **** ** **** 0.3% ** ** '********' of **.*%).

** *** ************* ** any *** **** ***** negatives **** ******* ** their **********? *** *** this ** ********* **** sounds ****** *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 07/08/19 12:42pm

** *********, ************* ********* just **** *** ***** numbers, *.*.,**** ** * ********* explanation:

** '*** *** **%' is ****** *****. **** does ** *** **%? How **** ***** *** it **, ***.?

***** *** ********* **** to **** ***** ********* into *******, ** ***** is ** ******** ******** between ***** ********* *** false *********.

* ********** ********* *** ******** ***** to *********** ****, *.*.:

Image result for roc curve facial recognition

*******, ** ************ *********, they *** ******, ** ever *****.

 

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Masks Cause Major Facial Recognition Problems on Feb 24, 2020
Coronavirus is spurring an increase in the use of medical masks, which new IPVM test results show cause major problems for facial recognition...
AI/Smart Camera Tutorial on Feb 20, 2020
Cameras with video analytics, sometimes called 'Smart' camera or 'AI' cameras, etc. are one of the most promising growth areas of video...
Clearview AI Alarm - NY Times Report Says "Might End Privacy" on Jan 20, 2020
Over the weekend, the NY Times released a report titled "The Secretive Company That Might End Privacy as We Know It" about a company named...
Wyze Massive Data Leak on Dec 26, 2019
Wyze has exposed millions of user's data, as reported by Twelve Security, and confirmed by IPVM, who has spoken with Twelve Security and reviewed...
RealNetworks SAFR Facial Recognition Profile on Sep 25, 2019
RealNetworks entered the surveillance market by giving away their analytics to schools for free, and is now targeting large commercial users with...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
China Subway Facial Recognition System Examined on Jun 24, 2019
A China city of 6+ million people has installed facial recognition-enabled gates in subways, allowing commuters to enter stations by simply showing...
China Jaywalking Facial Recognition Guide on May 27, 2019
News reports touting the PRC's AI prowess often showcase facial recognition cameras being used to automatically catch and fine jaywalkers. In...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
IBM Shuts Down "Intelligent Video Analytics" [Update: New Video Analytics Offered] on May 02, 2019
Abruptly, IBM has discontinued its Intelligent Video Analytics solution, it confirmed to IPVM. IBM's video analytics have faced recent media...

Most Recent Industry Reports

GeoVision Presents AI and Facial Recognition on May 22, 2020
GeoVision presented its AI analytics and facial recognition at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
Density Presents Occupancy Monitoring For Coronavirus Protection on May 22, 2020
Density presented its cloud-based occupancy sensor to deal with Coronavirus at the May 2020 IPVM Startups show. Inside this report: A...
Openpath Presents Two Door PoE Controller on May 21, 2020
Openpath presented its new PoE controller at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from Openpath including...
Bosch Presents MIC 7100 Extreme PTZs on May 21, 2020
Bosch presented its MIC 7100 Extreme PTZs at the April 2020 IPVM New Products show. Inside this report: A 30-minute video from Bosch...
Hikvision Chairman Targeted For Sanctions As Federal Watchdog Calls Out Hikvision "Serious Religious Freedom Violations" on May 21, 2020
The US government's religious freedom watchdog has criticized Hikvision for being "credibly implicated in serious religious freedom violations"....
Hikvision Temperature Screening Tested on May 20, 2020
Hikvision has ramped up the promotion of its 'temperature screening' system, including their salespeople arguing for no blackbody needed. But how...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020 IPVM New Products show. Inside this report: A 30-minute video...
Indoor Robotics Presents Tando Aerial Drones on May 20, 2020
Indoor Robotics presented Tando indoor autonomous drones at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from...
Directory of 89 Video Surveillance Startups on May 20, 2020
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly...
FLIR Cancelling Contract With X.Labs / Feevr on May 20, 2020
While X.Labs announced the signing of a new agreement with FLIR on May 12, 2020, FLIR said, in response, on May 18, 2020, that they had cancelled a...