EU AI Proposal Impact on Video Surveillance Examined

By Zach Segal, Published May 04, 2021, 10:30am EDT

The EU has released a proposal for how it plans to regulate AI, directly impacting certain video surveillance technologies but exempting many products through a major loophole.

IPVM Image

"High-risk" AI like facial recognition will require numerous mandatory compliance measures and will face more "narrow" constraints for law enforcement usage. Lower-risk AI such as emotion/demographic analytics will require being disclosed to passerby.

The law has major loopholes that may be great for manufacturers but undermines the intent of the regulation.

In this post, IPVM examines the proposal for this sprawling, GDPR-style law in detail.

Executive *******

*** **** ***** ************ impacts ** *** ******** include:

  • ** ** *********** ** either "************" (******), "****-****" (mandatory ********** *****), *** "low ****" (******* ********** required)
  • * ***** ******** ** that ** ******* ******** within *** **** ***** the *** ** ****** will ** ************* **, avoiding *** *****
  • ****** *********** ** ****** "high ****" ********* ******** "mandatory" ********** ******** **** as ******** * "**** management ******", ********* ******** for "******** ****," ******** "human *********," *** ****
  • ****** **** **** ** allowed ** *** **** recognition ** ****** ***** for ******* ******* ********, finding **** ********/*******, *** investigating "********* *******"
  • *******/****** ********* **** "************ obligations" ********* ********** ** end *****.

********* **** ***** ******* fines ** *% ** global ******* ** €** million ($** *******), ********* is ******.

Background *** *******

***** ** ********** **** ** *****'* **** ** ******** and ****** ****** ** AI**** ******* ** ****. This ****-**** **** ************ from *** ** **** over ***** ****-**** ****:

*** ******** ** **** meant ** ****** "***** dignity, *******, ********, ********* and *** **** ** law *** ***** *********** rights" ** ******* *********** on **.

"2023 ** *** ********"

** ****** ****** **** first *********** ***** ** the ****; **** **** have *** ***** ** enact **. ***** ** no ******** ******** ****** ********* ***** *********** "*** *********** ** expected ** **** ** the ********, ********* ** people ********* *** ******* closely."

Major ********: ******** ** ******* ************* **

******** ** ******* *** those ******** ****** *** year ***** *** *** is ****** **** ** grandfathered **, ******** *** rules ****** ***** ** a "*********** ****** ** the ****** ** *******" of *** ** ******:

IPVM Image

**** ***** ********** *** end-users *** ***** *** regulation ** ******* ** purchasing ******* **** **** released **** **** * year ***** *** ********** passed. **** **** ******* larger ********* *** **** many ******** "****-****" ** products *******, *************'* ****** *********** *******.** ********* ***** ********, of ******, ***** ***** products **** ** ************* highly *********.

Risk **********/"************" ** *********

***************** ** *** ***** into **** **********: "************" which ** ******, "****-****" which *** ********* ********** steps, *** "*** ****" where ******* ********** ** required.

** ***** ************ ************ are ********** ******** ** the "************" *****. *** only ** ********** ****** "unacceptable" ** "**-***** ****** scoring" ** ***********. **** means * ***** ********* provider ***** *** **** a ****** ** ****** that ***** ****** ********* to *** '**********' **** look, ** **** *** be ****** "**-***** ****** scoring."

Face *********** "****-****"

**** *********** ("****** ********* identification ** ******* *******") is ********** ** "****-****" due ** **** ******* potential "************** *******":

IPVM Image

************ ** ****** *********** bias***** **** **** ******* are **** ******** *** ethnic ****** **** ***** home *********.

"High-Risk" ** ********** *********

*** ******** ******** ******** rules (******** *-**) *** "high-risk" ** ******* **********:

IPVM Image

* "**** ********** ******" is ****** ** ******* possible ***** ********** *** product's ******** ** ********** "identification" *** "**********" ** risks ***** **** "********" of ********** ********. ***** must ** ********** ** reduced "******* ******** ****** and ***********", **** ******* mandated "*****" ** ******* launch ** ***** ** achieve ****.

IPVM Image

********/******* **** ** ******* to "**** *** **** governance *********". **** ******** identifying "******** ******" ***** ensuring ******** *** "********, representative, **** ** ****** and ********." ******** ****** also *** "*****-**-***-*** ******** and *******-********** ********, **** as ****************, ** **********."

IPVM Image

********* ************* *** *** high-risk ** ******** ***** "demonstrate **********" **** *** EU's ** ********** *** relevant ******** **** ***********.

IPVM Image

"******-*******" ** ********* ** "ensure * ***** ** traceability" ********** *** ** system's "*********." ******** **** be ******** ** *** recording *****, ********* *********, input **** ***** *** to * *****, *** corresponding ***** ****. *** goal ** ** *** "situations **** *** ****** in *** ** ****** presenting * ****" ** fundamental ******.

IPVM Image

"************ *** ********* ** information ** *****" ***** systems ***** ** "*********** by ************" ***** ******* intended *******, ******** ******, potentials *** ****** (***** risk "*********** ******"), *** performance ** ******** ********.

IPVM Image

***** *********" ** ****-**** AI ******** ** ******** so ***** *** "***** understand *** ********** *** limitations" ** *** ****** and "*********" ********* *** AI's ****** ******* "****-*******" on *** ** ******. This ***** *** ****** must **** * ****** "override" ****** **** * "stop ******" ** "******* procedure."

IPVM Image

****-**** ** ******* **** pay ******* ********* ** "accuracy, ********** *** *************": accuracy ******* "***** ** declared ** ************ ************" while ******* **** ** "resilient" ** "************ ***** party" ******* ********. ******* must ***** ******* ******** to ********** ******** **** ("data *********") *** ****** designed ** **** ******** ("adversarial ********") ***** **** flaws ** *** *****.

Role ** ********* *******: *************, *********, ************

IPVM Image

*** ******** ****** ******* into ************* (** ***** representatives), ************, *********, *** end-users **** ********* **************** for ****:

  • *************"***** **** *** ************** of *** ********** ** the ** ****** **** this **********" (*.*. ********* with *** ******** *****).
  • ************* ******* ********** *********** and ****** ********* ************* is ** *****. **** must **** ****** "****** surveillance ***********" ** ******* that ******* * **** to "****** ** ****** or ** *** ********** of *********** ****** ** persons *** *********". ** an ******** ****** ** identified, ************* **** "******* an ********** ************** ***** is *********** ** *** Union."
  • Distributors must ensure the "provider and the importer of the system, as applicable, have complied with the obligations set out in this Regulation", not sell products that do not meet conformity standards and inform authorities of risks to "health or safety or to the protection of fundamental rights of persons are concerned."
  • Users must follow the provider's "instructions" as well as "Union or national law" and the required "human oversight measures". While following directions, users must ensure "input data is relevant" to the intended purpose of the system, must "monitor the operation" of a system, notifying the provider or distributor and suspending use if it presents a risk to "health or safety or to the protection of fundamental rights of persons are concerned". "Users of high-risk AI systems shall keep the logs" of that system "for a period that is appropriate" and "carry out a data protection impact assessment" as ******** ***** *** ****.

*** ***********, ********, **** or ***** *****-***** ***** be ********** * ********" if **** **** * system ** ******* ***** their ****, "****** *** intended *******" ** ******** system, ** **** "*********** modification" ** * ******.

Police *** ** ****-**** **** *********** *******

*** *********** ****** *** enforcement *** ** ****-**** face *********** ** ****** places ** ******** *********** (finding ******* ** ******* people), ******* ** ****** or ********* *******, *** identification ** *********** ** criminals *** ******* ******* laws:

IPVM Image

*******, *********** ****** ** charge ** ******** **** constitutes ********** *** ** face *********** *** ** punishing ***** *** ******. For *******, ****** ********* *********** *** ** ***** surveillance ** ******* ******* as ****-********* *** ******'********* ***** *** ****** oppoisition**********, ***** ***** ****** both ********* ** *** real-time ****** *********** ** those ****** ******* ********* the ********.

UPDATE */**/****: *** **'* *** *** data ********** ******, **************,**** ****** * ***** call*** *** *** ** regulations ** ******* * "general ***" ** ****** recognition ** ****** ******:

********* ****** ********* ************** in ******** ********** ****** means *** *** ** anonymity ** ***** ******. Applications **** ** **** facial *********** ********* **** fundamental ****** *** ******** to **** ** ****** that **** *** **** into ******** *** ******* of ***** ****** *** freedoms. **** ***** *** an ********* *********** ** the ************* ********.A ******* *** ** *** *** ** ****** *********** ** ******** ********** ***** ** *** ********* ******** ***** ** ** **** ** ******** *** ******** *** ****** * *****-******* ***** ********* *** **. [emphasis added]

*** ****** **** ***** for * "***" ** an *********** ********* *.*. "AI ******* ***** ********** to ********** *********** **** clusters ***** ** *********, gender, ********* ** ****** orientation":

Similarly, *** **** *** **** ********* * *** ** ** ******* ***** ********** ** ********** *********** **** ******** ***** ** *********, ******, ********* ** ****** ***********, or other grounds on which discrimination is prohibited under Article 21 of the Charter of Fundamental Rights. [emphasis added]

******* ********* *** ** permitted *** **** ***** "very ********* *****".

*** **** & **** have ** ***** ********* to ***** *** ** their *** ****. ******* as *** **'* ******** data ******** **** ** have *********** *********, *** example *** **** *** a **** ** *** "European ********** ************ *****" created ** *** ******** AI *****. **** ****** comes ****************** *** *** ** regulation **** *** **** loopholes *** ****** **** face *** *** *********.

**** **** ****** **** closely ** **** *** any ******** ****** ** the ** ** ***********.

Disclosure ******** *** *********** *********

***** *******/*********** ********* ******** disclosure ** ********, **** the *** ******* **** "natural ******* ****** ** notified **** **** *** exposed ** ** ******* recognition ****** ** * biometric ************** ******." ****** use ** ******* ********* is ********** ******** "****-****," but *** ******* ***.

*** *******, * ******** camera ********* ******* ******** are *****/*** **** ******** that ** ******** ******* along **** ******* ***** lump ****** **** "***, age, **** ******, *** colour, *******, ****** ****** or ****** ** ********* orientation."**** *** ***** ******* analytics** ** **** ******* of ***** ** ********** video ********* ******* **** see * ******* ******.

Fees ** ** *% ****** ******* ** €***

********* *** ********* *** law *** ****** ** a ******* **** ** 6% ** ****** ******* or €*** ($***) *** prohibited ********* ** ***-********** with ************ ** ****, 4% ** ****** ******* or €*** *** ***-********** with ***** *****, *** 2% ** ****** ******* or €*** *** ********* incomplete ** ********** ***********. Member ****** **** ** in ****** ** ********** violations ******* **** ********** Authorities ** ***** ******** national ********** ******.

Costs ********* *** ****-**** ** *********/*****

*** ** ********* **** each ******** ** ****-**** AI ******* **** **** to ***** ***** €*,*** to €*,*** ($*,***-$*,***) ** conform **** ****-**** ** system. *** ****-**** ** users, ****** ***** *** estimated ** ****** €*,*** to €*,*** ($*,***-$*,***) *** year *** ******.

**********

** *********, *** ******** surrounding ******** ** ******** will ******* *** ******** with ***** ******** ******** of ****-**** ******** *** deter *** ********.

** ***** ** *** overall ********** ******, *** larger ******** ** **** be *********** *** *** insurmountable. * *** ******** dollars *** **** *** face *** ****** ** not **** *** * company ********* **** $* ******* in ********* ****.

*******, *** **** *********** and *** ***** **** a ****** ** **** more *********** *** ***** likely ****** *** ******* availability ** "****-****" ** products ** *** **.

Comments (5)

*** ** **** ******* development ** ******** ****** AI ******* **** ******** in *** ******** ***** with *** ** *** advanced *********** ****** ***** overseas. ** **** ** this ****, ** ** so **** ****** *********** tech, *** ** **** end ** ** ********** backwater.

Agree: 2
Disagree
Informative
Unhelpful
Funny

****, ** ************* ***** reading ** * *** more ******* ** **** "placed ** *** ****** or *** **** ******* before *** **** *** elapsed **** *** **** of *********** ** **** Regulation" ****** ***** **** the ********* ******* **** to *** ** ******* already ********* *** ***********. I.e. ***** * **** is ** * ****** cannot **** ** *** AI ****** ** * new ******** ** ** is ** ********* ** this **********. ** **'* not ****** * ******** for ****** *******. ********* EU ********. ** **** an ** ****** ** comment!

Agree
Disagree
Informative
Unhelpful
Funny

*******, * ** ****** sure *** *** *****.

'****** ** *** ******' typically ***** ********* *** sale *********, *** ************ installed ** * ****. For *******, ****** ** ********** ********, ** ** ******* as:

* ******* ** ****** on *** ****** (** the ** ** **) when ** ** **** available *** *** ***** time ** *** ******, i.e. **** ** ** first ******** *** ************, consumption ** *** ** the ****** ** *** course ** * ********** activity, ******* ** ****** for ******* ** **** of ******.

******* ** *********** * ******* ***********:

******* ** *** ****** is ******* ** *** "first ****** ********* ** the ******" (** *** manufacturer ** *** ********).* Making ********* ** *** market ** ******* ** "any ****** ** * product *** ************, ***********, or *** ** *** […] ****** ** *** course ** * ********** activity, ******* ** ****** for ******* ** **** of ******"

** ** *****, ***** the ****** ** *** law, ************** ** ******** systems ** * ******* since ** ********* *** law ** ******* *** existing ******* ** ****** but '****** ** *** market'

Agree
Disagree
Informative
Unhelpful
Funny

** *******,

*** *********** ******* * ******* *************** ********** **** *** interpretation:

IPVM Image

*** **** *** ** "or *** **** *******..." as ******* ** "*** put **** *******..." ********* meaning ***** ****** ** the ****** ** ********** for ********* ******* ********* being *** **** *******.

** **** ******* *** for ************ *** **** update *** *** **** article **** ** ******* it.

Agree
Disagree
Informative
Unhelpful
Funny

Update: The EU's top two data protection bodies, the******** **** ********** *****(* ***** *** *** the **'* **** ********** agencies) *** *********** **** ********** **********(* ******** ****** ********** EU **** *********)**** ****** * ***** call*** *** *** ** regulations ** ******* * "general ***" ** ****** recognition ** ****** ******:

********* ****** ********* ************** in ******** ********** ****** means *** *** ** anonymity ** ***** ******. Applications **** ** **** facial *********** ********* **** fundamental ****** *** ******** to **** ** ****** that **** *** **** into ******** *** ******* of ***** ****** *** freedoms. **** ***** *** an ********* *********** ** the ************* ********.A ******* *** ** *** *** ** ****** *********** ** ******** ********** ***** ** *** ********* ******** ***** ** ** **** ** ******** *** ******** *** ****** * *****-******* ***** ********* *** **.[emphasis added]

*** ****** **** ***** for * "***" ** an *********** ********* *.*. "AI ******* ***** ********** to ********** *********** **** clusters ***** ** *********, gender, ********* ** ****** orientation":

****** **** ******* *** extremely **** ***** ***** by ****** ********* ************** of *********** ** ******** accessible ******, *** **** and *** **** **** for * ******* *** on *** *** ** AI *** ********* *********** of ***** ******** ** publicly ********** ******, **** as *********** ** *****, gait, ************, ***, *****, keystrokes *** ***** ********* or *********** *******, ** any *******.Similarly, *** **** *** **** ********* * *** ** ** ******* ***** ********** ** ********** *********** **** ******** ***** ** *********, ******, ********* ** ****** ***********,** ***** ******* ** which ************** ** ********** under ******* ** ** the ******* ** *********** Rights. [******** *****]

******* ********* *** ** permitted *** **** ***** "very ********* *****":

***********, *** **** *** the **** ******** **** the *** ** ** to ***** ******** ** a ******* ****** ** highly *********** *** ****** be **********,except *** **** ********* *****, such as some health purposes, where the patient emotion recognition is important, and that the use of AI for any type of social scoring should be prohibited. [emphasis added]

*** **** & **** have ** ***** ********* to ***** *** ** their *** ****. ******* as *** **'* ******** data ******** **** ** have *********** *********, *** example *** **** *** a **** ** ***"******** ********** ************ *****" created ** *** ******** AI *****.

**** ****** ***** ****************** *** *** ** regulation **** *** **** loopholes *** ****** **** face *** *** *********. As**** *******, ** ** ********* stands, *** *********** ****** law *********** *** ** real-time **** *********** ** public ****** ** ******** recognition (******* ******* ** missing ******), ******* ** people ** ********* *******, and ************** ** *********** of ********* *** ******* certain ****.

**** **** ****** **** closely ** ***** ** any ******** ****** ** the ** ***********.

Agree
Disagree
Informative
Unhelpful
Funny
Read this IPVM report for free.

This article is part of IPVM's 7,333 reports and 971 tests and is only available to subscribers. To get a one-time preview of our work, enter your work email to access the full article.

Already a subscriber? Login here | Join now
Loading Related Reports