Detection, Classsification, Recognition and Identification (DCRI)

Author: John Honovich, Published on Feb 04, 2013

Detection, classification, recognition and identification is all very easy until you put it in practice. Then you realize that there are big practical and subjective problems that make using them difficult.

Academically, the terms are straightforward and reflect what they mean in real English:

  • Detection - The ability to detect if there is some 'thing' vs nothing.
  • Recognition - The ability to recognize what type of thing it is (person, animal, car, etc.)
  • Identification - The ability to identify a specific individual from other people

Obviously, each level is harder and requires more detail, going from detection to recognition to identification.

*********, **************, *********** *** ************** ** *** **** **** ***** you *** ** ** ********. **** *** ******* **** ***** are *** ********* *** ********** ******** **** **** ***** **** difficult.

************, *** ***** *** *************** *** ******* **** **** **** in **** *******:

  • *********- *** ******* ** ****** ** ***** ** **** '*****' vs *******.
  • ***********- *** ******* ** ********* **** **** ** ***** ** is (******, ******, ***, ***.)
  • **************- *** ******* ** ******** * ******** ********** **** ***** people

*********, **** ***** ** ****** *** ******** **** ******, ***** from ********* ** *********** ** **************.

[***************]

**** ************* ******** ***** ********** ********* ** **** ******** *** * ***** ***** *****. *** ********, ****'* *********** **** ***** **** ** ******* ******** *******:

*** **** ** *** **** *****:

**** ****** * ******** *** ****** ** * ******* *****. While ***** **** ******** *** **** **** ****** *****, *** two ************* ******* *** *** ***.

*** **************:

  • ***** ********** ~*****
  • **** ********** ~*****
  • *** ******* ******** *** ********** ~****** (***** ****** *** **** paper)

**** ***** ******** ***** **, "**** ** ***** ** ****? Is ******* *****, ***** ** ********?"

*** ** **** ***** ** *** **** ************, ***, *************, two *********** ****** ***** **** ***** ***** *******.

2 *********** ******

*****, *** ***** *** ********** ********** *** ****** ** *** perception *** *********** ** *** ********** ******.

**** ** **** ****** *** '**************' *** **** ************ ***** people. ** *** ********* *** *************, ** **** **** ********** debates ***** *** ***** **** ****** *** **************.

*** **** *** ********. **** ** *** * ****** **** by **** *****:

***** ***,*** ***, ** ********** *** **************? ** (** *** ****), ** (in *** ******) ** ** (** *** *****)?

** ** **** *****, ** *** * ***** *** ***.

*** **** *** **** ********** ** *********** ****'* **** ****** for *********. ***** **** ***** ***** **** ** ****:

**** ***** **** ************ *********** ** **** ********* ****** ******* in ****** ******* ******** *** **** *** ********** ** ** the ****** ** ****** *** ****, ***** *** **** * massive ****** ** ****** ******* *** ******* ******.

*******

**** ****** **** ** ** ***** ** **********, *** ****** often ******* '*******'. ** ** **** **** **** ****** **** other ****** **** ** ******* * ****** ** **** ******* many ****** **** ********* ***********.

*** ** *** ******* **** **************? ** ** * ***** call *** ********** *** '******' ** ******* ** ****** *** the ******.

****** *** ***** *******

*** ***** ***** ** **** *** **** ****** ** ****** will ******* ********* ***** ******* ********* ** *** **** ** day. *** ***** ** ** ** ******* **** ******** ********** with ***** *** ************** *** ** *** *** **** ** rises ** **** **** *** ****** *** ***** **** ****. Worse, ** *** **** **** ****** ******** ** *****, *** still ***** **** ***** ** **** ****** *** ****.

What ** **?

***** ***** ***** *** ******** ***** **** ** * **** is ******. **** ** *** ***** **** ** ****** **** that ** ********** ** ****** ****.

**** ***********, *** *** ***** ************:

  • **** ***** ** ******* **** *** ****/*****/******** ***** ****** ****? Decide **** * ****** *******, ***'* **** *** '*********' *** hope **** ***** **** *** ****** ** ************.
  • **** ******** ** ************* ****** *** ***** *** *** **** of ** ****** **** ** ****? **** **** ***** ** front **** *** ****/*****/******** ****** ** **** ********** *** ******** challenges ** * **** ***** *********.

Comments (16)

Is there a ppf threshold that facial recognition analytics need to be effective? i.e. how many ppf are required before analytics can differentiate one face in its database from another?

Good question. Typically, ppf requirements for face recognition analytics are significantly higher than identification.

Face recognition systems typically use a slightly different pixels metrics. Instead of ppf, they generally cite pixels between the eyes. However, that can be easily converted to ppf. Assuming 2.5 inches between the eyes, multiply the pixel between the eyes metric by ~5. A common facial recognition metric is 35 pixels between the eyes, which means 175ppf.

However, some systems ask for even more. We've seen requirements for 50 pixels between the eyes (e.g., 300ppf, requiring a 1.3MP camera to cover a tiny 4 foot wide FoV).

Indeed, one vendor recently said they can do it with just 22 pixels between the eye, which would be 110ppf, lower than what the Sweden National Lab claims for a human to identify a face.

All that said, computers have much lower tolerance for variation and fuzzy images so expect to provide a lot higher PPF for facial recognition analytics.

John,

Of course, many specifications still refer to the Johnson Criteria from before you were born. That creates it's own set of hardship. When they say detection, that can be as little as 1.5 pixels. Recognition can be as litttle as 6 pixels. Recognition can be 12 pixels. That criteria is based on seeing anything at all (Detection), to knowing it's at human, vehicle etc. 2 pixels....LOL

Greg

Greg, thanks, here's a 2 page overview from FLIR on it :)

I had been looking for a more detailed technical paper but could not find one yet on the Internet that explained it detail how it was designed / determined. Anyone who can find, please share.

The problem I see with the Johnson criteria is the same fundamental one as for any conventional surveillance camera, specifically the subjectivity in saying how much is enough to 'detect' a person.

For instance, here's Vumii's video of detecting at 1.5 pixels.

Maybe my eyesight is gone, but that is incredibly difficult to tell that there is an object there. Even if they could spot someone, the level of eyestrain and difficulty must be severe for anyone trying to do this on an ongoing basis. I have to imagine many people would look at that and say, "I need more details / more pixels on target"

Thanks for this, John. I had to look very hard at this and I have years of experience forensically watching very low quality video, a ton of which was on VCR tapes. Every time the tape was played the video was degraded. These people in the above video could easily be mistaken for tape "wow and flutter" if on video tape and could be mistaken for low resolution shifting seen on compressed video archives. I find it extremely difficult to believe that a live person monitoring this video would detect that movement unless they were ONLY monitoring the one camera, AND the image was full screen!

John,

The Johnson Criteria should have been updated many times over. The function of DRI has a completely different meaning today. Imagine the technology of CCTV in 1958. 330TVL was amazing!

It's time to update the criteria. I really don't know anyone who argues to retain it, but it is the only imperical reference for US companies. I hope you don't think I'm defending it.

The concept of megapixel imagers for security wasn't even a pipe dream in that time period.

Greg

Let's replace the Johnson Cirteria with the Johonovich Criteria!

: )

Regarding face rec criteria, there is also a differnce between having enough pixels to to do a face search that brings back nearby similar faces, vs, face authentication, which claims with a high degree of confidence that a face is a particular person.

Gator

The UK has used a human size/aspect ratio test chart called a Rotakin for testing end-to-end cctv performance for many years. It is a practical method of testing for identificaton criteria. It was developed by the UK Police Scientific Development Branch

A Rotakin testing requirement was written into the UK minimum survellance standards for all licensed CCTV installations although I am not sure if this is still used.

Re: Rotakin, we had a recent discussion on it. None of us could understand the value of it, save for in the UK, it has a legal basis. Otherwise, it's just another chart that is still subject to issues of lighting variations and differences in perception about what is good enough for detection, identification, etc.

Hello all!
Let me see if I can shed some light on this.

Identify, recognize, detect, etc. come from European standards published in 1996, see http://www.cenelec.eu/dyn/www/f?p=WEB:110:956246286239172::::FSP_PROJECT, FSP_LANG_ID: 5028.25 (do not buy this because it recently (Jan 2012) has been replaced).

From there you can read that the possibility of such identify a person for an operator (i.e. primarily for live viewing) is that the person occupies 120% of the image height (cut off at the knees). And to be able to detect a person is thus about an operator, at the right distance from the monitor, reliably shall be able to detect a person moving in the picture. The prerequisite is that the image resolution is 400 TV lines or more (scanned in the horizontal plane). After these basic requirements, then also lenses, lighting, etc. has to be taken into account. This works quite well.

Regarding Swedish National Lab recommendations then these are actually from - the FBI! Note that these recommendations are really just for commercial establishments (ie indoors). And this gets very messy because it does not comply with European standards (are you still with me?).

By the way, if anyone wants a copy of the FBI's "Recommendations and Guidelines for Using Closed-Circuit Television Security Systems in Commercial Institutions" just say the word.

Regarding Johnson's Criteria, I believe that these should only be used in conjunction with night vision (thermal) cameras and they describe the ability to, for example, tell the difference between enemy or friend - thus, these criteria creditor only for military use!

Jan, here is the FBI's recommendations. The one I know of is from 2004/2005 and is woefully out of date with current technology.

Ok John, thanks, I saw that it was now as web text, but I had the "original" as a pdf. Looks, however, that the content is the same.
I agree - these recommendations have significant shortcomings today. But as I mentioned, it's probably the case that many of the "new" recommendations today are sometimes a mix of these recommendations and other (maby European) Standards.

Hey guys, would anyone like to offer feedback on this application note that we will publish soon?

ftp://ftp.vumii.com/Documentation/Vumii_Camera_Performance_Criteria.pdf

Roy, as your note points out, the Johnson criteria has been around for a long time.

The main challenge is that it seems military use / thermal manufacturers define 'detection, recognition and identification' differently than the commercial surveillance world.

For instance, I think most people in video surveillance associate 'identification' with being able to tell whom a specific person is ("Oh that's John, not Roy") whereas the Johnson criteria associates 'identification' with seeing that a subject is there, but not whom the person specifically is.

I don't think either is right or wrong but since the same words are being used to mean different things, there is risk for confusion.

What is the definition of "Classification"? The same as "Recognition"?

Never mind, I think I find one in http://resource.boschsecurity.com/documents/WhitePaper_enUS_2233028875.pdf .

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Introducing Effective PPF (ePPF) - Improving Video Surveillance Designs on Jun 11, 2018
Pixel density (PPF / PPM) is the best metric the industry has to define and project video quality. It allows simple communication of estimated...
H.265 / HEVC Codec Tutorial on Jun 07, 2018
H.265 support has improved significantly in 2018, with H.265 camera/VMS compatibility increased compared to only a year ago, and more manufacturers...
Bosch IVA Video Analytics And Motion+ VMD Tested on Jun 06, 2018
Bosch's video analytics now ship on nearly every model, from indoor domes to high-end 5MP starlight cameras.  In this test, we evaluate Bosch's...
Keypads For Access Control Tutorial on May 31, 2018
Keypad readers present huge risks to even the best access systems. If deployed improperly, keypads let people through locked doors almost as if...
Installing Box Cameras Indoors Tutorial on May 22, 2018
This tutorial starts our physical installation for video surveillance series, starting with Box Cameras, one of the oldest and most basic types....
Dahua Intrusion Analytics And VMD Tested (Poorly) on May 21, 2018
Dahua ships basic analytics on practically all their cameras, ranging from low cost to high end. To see how these analytics work in real world...
Installing Cameras in Plenums Tutorial on May 15, 2018
There is often confusion about plenum ceilings, with misinformation about what is required when running cables through them and mounting cameras...
Access Visitor Management Systems Guide on May 11, 2018
"Who are you, and why are you here?" Facilities that implement Visitor Management Systems hope they never need to ask that question to anyone,...
Axis 12MP Stereographic Camera Tested (M3058-LVE) on May 10, 2018
Axis has released the M3058-PLVE, a 12MP sensor, stereographic panoramic camera and Axis' first with integrated IR claiming images "sharp to the...
Access Control Card Printers Guide on May 03, 2018
Card printers are a core component of professional access control systems, often used as photos IDs and prominently displayed. Modern badges put...

Most Recent Industry Reports

IPVM Vulnerability Scanner Released on Jun 18, 2018
IPVM is proud to announce video surveillance's first and only cybersecurity vulnerability scanner. This tool allows quickly and simply...
Hikvision Corrects False Cybersecurity Announcement on Jun 18, 2018
Hikvision has corrected a false cybersecurity announcement that claimed a British government-sponsored program endorsed the cybersecurity of...
July 2018 IP Networking Course on Jun 16, 2018
The last chance to save $50 on registration is this Thursday, June 21st. Register now and save. This is the only networking course designed...
The Dumb Ones: PSA's Bozeman On Cybersecurity on Jun 15, 2018
The smart ones are the hundred people who flew to Denver and spent $500+ on a 1.5-day conference featuring Dahua as a 'cyber responsible partner',...
Amazon Ring Launches $10 Monthly Professional Alarm Monitoring on Jun 15, 2018
Amazon's Ring has announced an alarm system with 24/7 professional alarm monitoring for $10 per month, a fraction of the $30+ per month traditional...
Axis Releases First New Access Controller In 5 Years (A1601) on Jun 15, 2018
It has been 5 years since Axis 2013 entry in the physical access control market, with the A1001 (IPVM test). Now, Axis has released its second...
Hikvision 12MP Fisheye Camera Tested (DS-2CD63C2F-IV) on Jun 14, 2018
Hikvision's DS-2CD63C2F-IV is their flagship panoramic camera, with a 12MP imager, 15m integrated IR, smart codec, and more. We tested the 63C2 in...
Four Major Outdoor Camera Install Problems on Jun 14, 2018
Over 140 integrators told us the top four camera installation mistakes that lead to unexpected problems and failures. Their comments often...
Security Sales Course Summer 2018 on Jun 14, 2018
Based on member's interest, IPVM is offering a security sales course this summer. Register Now - IPVM Security Sales Course Summer...
China Public Video Surveillance Guide: From Skynet to Sharp Eyes on Jun 14, 2018
China is expanding its video surveillance network to achieve “100%” nationwide coverage by 2020, including facial recognition capabilities and a...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact