Face Masks Increase Face Recognition Errors Says NIST

By: Zach Segal, Published on Aug 04, 2020

COVID-19 has led to widespread facemask use, which as IPVM testing has shown drastically reduces face recognition accuracy.

IPVM Image

Now NIST (National Institute of Standards and Technology) is analyzing the effect of masks on face recognition algorithms through their Face Recognition Vendor Tests (FRVT). We will explore the results of their recently released FRVT 6A, on face recognition algorithms submitted before COVID-19 (without the expectation of being used on masked subjects) to explain the impact face masks have on face recognition algorithms and answer what the study means for users.

Executive *******

***** **** ********** ****** still *** **** **% accuracy **** **** ***** worn, **** ********** *** their ******** **** **** ~**% ******* ***** ** ~50% **** *****.

*******, ******** ********** *** greatly ******** *** **** match **** ***** **** having * ***** ****** on *** **** ********* rate, ** ***-***** *** want ** ****** ********** to ******** *** *****. Finally, ** ** ** safe, ** *** **** sense *** ***** ** lower ***** *****, ******** their ****, ***** ***** scanned, ** ******** *** nose *** ******** *** negative ****** ** * face **** ** **% or ****.

**** **** *** ******* submitting ********** ********** *** many ** ***** *** research ******** **** *** not ******* **** *** company ** ******** ******* in **********.

******:**** *** ****** ***** submitted**********, **** ** ***** will ********* ****** **+% and ******* **+% ** people ******* **** *****.

*******

*** **** ***** ******* on ***** ***-***** **** and ***** ***** ****, which ** ********** *** gives *********** **** *** not ****** *** ***-*****. They ****** ** *** change ** *** ********* of *****, ** ** algorithm ***** **** **.*% accurate ** **% **** face ***** ***** ** 10 ***** ***** ** their ******, *** ** algorithm ***** **** **% accurate ** **% ***** only ** * ***** worse. **** ** **********, so ** *** ********* in ***** ** *** true ************ **** (*** percent ** ********* ********* verifies *** ****** ** the **** ****** ** a *****), *** *** true ********* **** (*** percent ** ********* ********* labels *** ********* ****** as *********).

Study ********

**** **** ~* ******* border ******** ****** ***** with ******* ** ******* with ~* ******* **** Application ****** *** ************/ 1:1 ******** (*.*. ** the ****** ******** ***** matched *** **** *****). The **** *********** ****** were ****-******* *** ***** in *********** ******* **** a ***** **********. **** are ******* ** ***/*** 10918 *.*. **** *** are *** * *** pixels. *** ****** ******** images *** *** ****** with *** ***/*** *****-* full-frontal ***** ********* *** in **** ***** **** highly *********.

**** **** ***** ******* “masks” ** *** ****** crossing ******. **** ****** 2 ****** (*****-**** *** black), * ********** (**** and *****), *** * levels ** **** ******** (low/nose ************, ******/**** ********* covered, ****/**** ****** ** to ***-*****, ********** ******** nose).

IPVM Image

**** **** ******** *** border ******** ****** (**** different ******* **** ************ applied) **** *** **** Application ******, ******* **** of *** ** **********. NIST **** * ***** threshold, **** *** ** 1 ** ***,*** ******** images ***** ********, ** decide ** ********* *** a ***** ** ***.

****, **** *** *** test **** *********** ** every ********* *** ** time ***********, *** ******* some ********** **** ****** to ****** * **** when ***** **** ****.

**** *** ********* ******* newer ************** *** **** *******.

Results **** * **** **** **** *** ****** **** ********

******: ***** ******* *** based ** ***-***** **********.

***** ********* *** **** verification ****, ** **** as ********* *** **** an ********* ****** ** detect * ****, ****** many ********** ******** ********** error-prone. ******** ******* ** all *****, *** *** change ** ****** ********. While *********'* *** **********'* true ************ **** **** decreased ** *.* *** 2 ********** ****** ************, Samsung's **** ************ **** decreased ** **.* ********** points, ** *** ***** below **********:

IPVM Image

*** ***** ***** ***** the **** **** ** tabular **** *** * selected ****** ** ********** tested ** ****:

IPVM Image

**** ***** ********** ********* ******* ******** ** Deepglint's ***-********** **** * **** worn. *******, ** ********* has **** ****** **** it. ****, ** ********* with * ****** ******* is ***** ** *** best ********** **** * maskless ***.

Effects ** ********* **** ******

** *** *****, ***** decreased ********. ***** ***** had * ****** ****** than ***** **** (*** style).****, ***** *******, **** black ***** ****** * slightly ****** ****** **** blue (*******, **** *** not **********).

*** ******* ****** *** nose ********, ***** ** many *****, *********** ** over **** *** *** decrease ** **** ************ accuracy.

Implications *** ***-*****

***-***** **** ** ********** if ***** **** *********** solutions *** ***** ****** with ********** **** **** use. **** ** *** best ********** ********** ** unmasked ***** ****** ********* inaccurate ** ****** ********, while ***** ********** ******** high-levels ** ********, ** end-users **** ********** *** mask-use ******* ***** ********** algorithm.

Adjusting ********** ** ***** ******

******** ********** *** **** limit *** ****** ** face-masks ** ********** ******* ************ ******** **** ******* ******* on ***** ***********, ** shown ** *** ******* below.

IPVM Image

Exposing *****

** ** ** ****, it *** **** ***** for ***** ** ***** their ***** ******** ***** nose, ** **** *** greatly ******** *** **** verification ****.

***********

**** **** *** ******* submitting ********** ********** *** many ** ***** *** research ******** **** *** not ******* **** *** company ** ******** ******* in **********.***** *** ******* *** still ***********, ** ***** that ***-***** ****** *********** use *** ****** ** see *** * ***** solution **** ** ******** by ****-***.

**** ** *** ********** were ********* ** ****-******* subjects ** ******** *** mask-wearing ********. ********** *** significantly ******* *** *********** of ** ********* ** masked ********, *** ********* may **** ******** ******** updates ** ******* ****.

****, *** ***** **** digital. ***** **** ****** for ********** *********** *** was ********* *** *** volume ** *******, ** means *** ******* *** not ******* ********* *******. There *** **** ***** of ****-***** **** **** not ******, **** ** which *** **** ********* effects. ****, *** ***** or ******* ** * mask *** ****** *** photo ***** ** *** subject, ** ********** ***** or ******** *******.

*******, **** *** *** test *** ****** ** verifying ******* * ****** image.******* ****** **** ***** to *** **** *********** images *****’** ********* *** negative ******* ** ******* a **** ****.

** **** ******* ** covering ****'* ****** **** Recognition ****** **** ******* on *** ******* ** face-masks.

Comments (9)

***** *** ******* ************* missing **** *** *****. I ****** *** **** would ****.

** ** *****, *** significant ****** ** *** the **** ** ******* (fully ** *********). ** a ****** **** * mask ******** **** .... sorry ******* *** *** do ********.

** ****** **** *** face **** ** *** percentage ** ***** ****.

***** *** * ****** of ****** ***** *** their *********** ****** **** keep ** **** ****. First, ** *** ** the *********** ******* (*** a ****** *****) **** when ******* **** *** have * **** **? Are *** ******** ***** the **** ** ****** or **** **** ******* (or *** ***** ******* or ***** **** *********) due ** *** ************ of *** ******** ****? Second, ** *** **** the ************ ** * mask ********* **** ***** (race, ******)? ** *** taken ** * *** of **** *** * mix ** **** *** synthetic ******** **** ** get *** ***** *** to ********** ******. ****, the ********** ** *** threshold ** * ***** argument, ********** ** ******* is ***** ****-***** ********* where *** ************ ** a ***** ******** ******* stack-ranked ******* ** ********** (as ******* ** ** alarming ********).

** **** ** *********** to *** *** ********** submitted ** **** **** masks ** **** ******* to ********** ********* ****** COVID *** ****** ** unmasked *****. **** **** should **** ***** *******, but **** ********** **** pretty ********* ******* **********, so ***** ********* **** be **** ** ******* high ******** **** ***** on ** ****.

*** *'* *** **** what ********** **** *****, but****'* ******** ****** ** bias***** ********** ******, ***********-*****, and ******-***** **** ******* algorithms ******* *****.

****, "** ******** ********" ***** be ********** *********** ******* error ********* ************* **** watchlist ****.

**'* **** *** **** to ** ** **** but *** ********** ***** is **** ** *.*% or ** ** *** RFW ******* (****** ***** ***** ********* Industry ** **** *********) *** ******* ***** each *******.

*** * ***** **** you ** *** ******** scenario. ****'* ***** *** really *** ******** *** false *********.

******* ** **** - one ******** - *** table *** *** ****** of ******** ********* (***** Sertis ****) *** *** imposter ********* ****** **** 1/100,000 (*.*****) ** */*** (.03). ** ***'* ********* see * ***** ****** in *** ********* ****** minimum ****** ** *** FAR. *** **** * typo ** *** *****? I *** * ****** for ****** ** *** NIST ****** *** ****'** missed *** ****** **** in *****.

** ***'* ********* *** a ***** ****** ** the ********* ****** ******* impact ** *** ***.

*** ******* ** * little ***** *****, *** NIST *****'* ******* *** actual **********, **** * graph ** **** ** FMR, ** ***** *********** to *** ****** ** FMR *** *********. ***, a ***** ****** ** FMR ****** **** * lot, ***** ** *** we ***** ** ********* it ** ** ******** in *** ***** ** 3 ********** ******, ***** I ***** ** * more *********** ******.

***, *** ***** ** took ** **** ** on **** **. **'* a ****** **** ** see, *** *** **** and *** *** ***** for ***** ********* ** different ********** (*** *******).

****. ****** *** *** context.

*******. *'* **** *** enjoyed *** *******.

*'** ******* *** ******* because**** *** ****** ***** submitted**********, **** ** ***** will ********* ****** **+% and ******* **+% ** people ******* **** *****.

Read this IPVM report for free.

This article is part of IPVM's 6,538 reports, 881 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Avigilon Face Mask Detection Tested on Jun 24, 2020
Face mask detection or, more specifically not wearing a face mask, is an...
Herta Facial Recognition Plus Masks Tested on Aug 19, 2020
Masks increase face recognition errors, but facial recognition developer...
Hanwha Face Mask Detection Tested on Jul 01, 2020
Face mask detection or, more specifically lack-of-face-mask detection, is an...
Clinton Public View Monitor (PVM) Mask Detection Tested on Jul 09, 2020
Face mask detection, or more specifically not wearing one, is expanding...
Trueface Presents AI Face Recognition, Mask and Temperature Detection on Jun 10, 2020
Trueface presented its AI facial recognition, mask and temperature detection...
Gait Recognition Examined on Sep 14, 2020
Facial recognition faces increasing ethical and political criticisms while...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Face Detection Shootout - Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jul 30, 2020
Face detection analytics are available from a number of manufactures...
Face Shields Impact On Temperature Measurement And Mask Detection on Jul 27, 2020
First, the use of face masks, and now, plastic face shields are rising...
FLIR Screen-EST Screening Software Tested on Jun 30, 2020
In our FLIR A Series Test, the cameras' biggest drawback was their lack of...
The US Fight Over Facial Recognition Explained on Jul 08, 2020
The controversy around facial recognition has grown significantly in 2020,...
Dahua, Hikvision, ZKTeco Face Mask Detection Shootout on Jun 19, 2020
Temperature tablets with face mask detection are one of the hottest trends in...
Directory of 206 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
U.S. Government Accountability Office Urges Facial Recognition Regulation on Aug 27, 2020
The US Government Accountability Office (GAO) is urging facial recognition...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...

Recent Reports

Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
New Products Show Fall 2020 Starts Tomorrow! on Sep 27, 2020
Tomorrow, IPVM's sixth online show will feature New Products from over 25...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...