Subscriber Discussion

Why AI Facial Recognition Become Real Game Changer

Avatar
Alan Ataev
Aug 28, 2018

Human beings are really good at recognizing faces, it is an innate ability, evolved over deep time. We are now applying this natural trait within our technology stack to add the digital equivalent of this capability, facial recognition technology, to many applications.

Being able to recognize faces can be thought of as a sort of human ‘super-power’ - it allows us to pick out a face in a thousand. Now, facial recognition technology is being applied to a variety of industries to do a similar thing. These applications are pushing the market for facial recognition technology to grow at a rate of around 17% CAGR with a value predicted to be worth $9.78 billion by 2023. The technology is being applied to many areas such as access control, criminal detection, tailored marketing campaigns, and health assessments. Facial Recognition works by using data, in this case, image markers, and matching them to existing database entries. In much the same way that fingerprints are mapped to identify unique features, faces can also be mapped. This ‘faceprint’ is analyzed and cross-referenced against existing ‘faceprints’. New generation facial recognition technologies are powered using deep learning, a subset of Artificial Intelligence that provides a highly accurate analysis.

What is Driving Facial Recognition Technology?

A number of market analysts have identified drivers for the rapid uptake of facial recognition systems, these include crime prevention - the increase in the use of the technologies for surveillance, border control, and general crime prevention. In addition, the use of facial analytics and deep learning are improving match rates and outcomes of this application of the technology. Increasing identity theft - Identity-related fraud is increasing year on year.

The wide-ranging applications of facial recognition are moving the technology into more commercial use cases. Typical IP cameras in retail outlets, fitted with facial recognition software, are being used to create smarter marketing and theft prevention by gathering intelligence on shoppers such as their predicted age, gender, dwell time etc.

What are the Security Concerns with Facial Recognition?

Our face is a very intimate part of our being and certain concerns have been raised in terms of facial recognition technology. Amongst the various ethical concerns, certain security ones stand out, examples include:

 

  • False matches - Facial recognition has a perfect use for crime or theft prevention. However, the false alarms of false positives is worrying, as the result of being incorrectly identified by software, could result in a wrongful conviction. However, this is being addressed as the technology matures. Intelligent face matching using deep learning facial recognition are improving match rates significantly.
  • Authentication - Controversy has surrounded certain applications of facial recognition used to authenticate users to, for example, mobile devices. Apple’s iPhoneX which uses the technology was recently lambasted for being ‘racist’. For example, the colleague of a Chinese woman was able to unlock her phone using her own face - the woman accused Apple of using ‘white faces only’ to train the software.

Both of the above issues are being addressed as the technology becomes more intelligent. The use of deep learning-based algorithms, are improving the quality and ultimately the security of facial recognition. In addition, the National Institute of Standards and Technology (NIST) are working with industry partners to develop standards. They state, “NIST is actively pursuing the standards and measurement research necessary to deploy interoperable, secure, reliable and usable identity management systems.”

What’s Happening Across the World of Facial Recognition

The security world is exploring facial recognition at a fast pace. Projects are growing across the world and if you aren’t doing it now it is likely to be on your near-term roadmap. Here are some examples of where the technology is being used in real-life:

 Preventing Retail Crime:

One of the natural fit areas with facial recognition capability is the retail sector. Retail crime is a major issue across the world. The amount of financial loses in the industry, in 2017, was $46.8 billion, with shoplifting and organized retail crime being the two most prevalent issues. AI Facial Recognition is able to help prevent shoplifting. The system works by referencing a database of known offenders with shoppers images. These are then used to prevent future crimes. In an LPM survey, a full 80% of shoplifters said they were habitual shoplifters because they knew they could get away with it. Having an intelligent system as a strong deterrent can help to reduce repeat crime. The AxxonSoft system has shown both a successful return on investment in retail stores with 3-4 criminals being caught per week per store among 10 000 visitors per week.  Though the system is not ideal and has 10 false alarms per camera per day, it is fully satisfying the customer.

 

(1)
JH
John Honovich
Aug 28, 2018
IPVM

Wait, when did IPVM become a trade magazine? I am kidding... I think.

These applications are pushing the market for facial recognition technology to grow at a rate of around 17% CAGR with a value predicted to be worth $9.78 billion by 2023.

You cited research from Oristep Consulting?

Even for scam Indian 'research' firms, this company seems to be especially tiny and unauthoritative. Is this how little care you take in checking your sources?

What is the point of posting this? To be clear, I think less of your company, Axxon, for doing so. It's fluff.

Feel free to make your case but make it a good one. Don't post this marketing nonsense.

(6)
Avatar
Alan Ataev
Aug 28, 2018

Thanks for your comments, John. May be looks too much marketing but it is all about real case we have in retail stores with 3-4 criminals being caught per week per store among 10 000 visitors. This is only happened once we have implemented AI facial recognition, accuracy dramatically increased. 

JH
John Honovich
Aug 28, 2018
IPVM

Alan, if that is the case, say that directly. Do you think that Oristep Consulting has more credibility than Axxon? Evidently, you do, since you cited them up front.

Why would you bury the only real novel information at the every end?

The AxxonSoft system has shown both a successful return on investment in retail stores with 3-4 criminals being caught per week per store among 10 000 visitors per week. Though the system is not ideal and has 10 false alarms per camera per day, it is fully satisfying the customer.

So expand on that? How are you getting images of these criminals? How many total cameras? How does the store respond to alerts? Does a guard immediately go out and intervene to the criminal in the store?

Avatar
Alan Ataev
Aug 28, 2018

We are getting face images directly from installed IP cameras. The store security creating their own criminals database which we are synchronizing across the stores. At the moment it is 180 face cameras. Once person recognized with accuracy more than 94% the alert goes for human verification. Combination of AI + Human helping us to achieve a good results. Once human confirm the match a guard immediately go out and follow the suspect. Due to the fact that 80% are habitual shoplifters the guard most likely will prevent the crime.

JH
John Honovich
Aug 28, 2018
IPVM

has 10 false alarms per camera per day

At the moment it is 180 face cameras.

So 1,800 false alarms per day? 

Once human confirm the match a guard immediately go out and follow the suspect.

Does the guard wait for the person to shoplift right there or do they immediately apprehend based on previous shoplifting / warrants?

Avatar
Alan Ataev
Aug 28, 2018

Maximum is 10 false alarms per day with 4 cameras per store it is 40 false alarms.
The guard wait for the person to shoplift right there.

JH
John Honovich
Aug 28, 2018
IPVM

So roughly 1 positive match for every 80 alerts, based on the numbers you provide (3 to 4 criminals per week per store, 4 cameras per store, 10 false alerts per camera per day).

Avatar
Alan Ataev
Aug 29, 2018

The worse scenario looks like that.

JH
John Honovich
Aug 29, 2018
IPVM

Ok what is the normal scenario?

For the "has 10 false alarms per camera per day", I am quoting your own statment.

I have to believe that not every store, every week, gets 3 to 4 criminals alerted via the face system. What happens if a week goes by and there were no criminals captured? False alarms remain right?

Avatar
Alan Ataev
Aug 29, 2018

That is right, false alarms remain even if there is no match. Normal scenario is 3-4 false alarms per camera.

U
Undisclosed #1
Aug 29, 2018

"Maximum is 10 false alarms per day with 4 cameras per store it is 40 false alarms.
The guard wait for the person to shoplift right there."

i am assuming that a 'false alarm' is a false positive? - since a false negative wouldn't provide the store guard with anyone to follow around waiting for them to steal something.

So - on any given day the store guard will be following around ~40 people who aren't known shoplifters?

JH
John Honovich
Aug 29, 2018
IPVM

No, as he says earlier:

the alert goes for human verification. Combination of AI + Human helping us to achieve a good results. Once human confirm the match a guard immediately go out and follow the suspect. 

Presumably, most of the false positives are easy enough to distinguish from the real suspect that the human can easily and quickly discard.

However, I do wonder about the cases when the match looks similar and it hard to tell. At that point, are you following around an innocent person? How often does that happen, etc.

Alan, what country are these stores located in? Curious about the legal implications / background for such processing.

U
Undisclosed #1
Aug 29, 2018

"Once human confirm the match a guard immediately go out and follow the suspect."

What constitutes confirmation?  The subjective opening line of this marketing piece? ---> "Human beings are really good at recognizing faces"

'Really good' compared to what?  Recognizing dog breeds or clothing?

JH
John Honovich
Aug 29, 2018
IPVM

I do agree with your underlying point. There will certainly be cases where a human could make a mistake or simply not be confident enough that the two faces are a match. Do you ignore that then or? 

UM
Undisclosed Manufacturer #2
Aug 29, 2018

A simple case would be what if twins walk-in and can a human eye recognize exactly who is who?

Avatar
Alan Ataev
Aug 29, 2018

That is a really rare case I guess.

U
Undisclosed #1
Aug 29, 2018

Some People Are Great At Recognizing Faces. Others...Not So Much

""We are fantastic at recognizing faces – of people we know," he says. "We can recognize our family and friends across a huge range of conditions – distances, bad lights, all kinds. But we falsely assume that this means we're quite good at faces in general and in fact, we're not."

Avatar
Alan Ataev
Aug 29, 2018

I think that people and computers which work alongside each other produce the best results for now, and I believe in the future AI will do it (facial recognition) better than human.

U
Undisclosed #1
Aug 29, 2018

i'd try and figure out how super recognisers brains work vs normal humans and let them train your AI.

since nobody has ever actually figured out how super recognizers are able to do what they do as yet, I can agree with your assessment that AI will be able to do it better than humans eventually, without sharing your occupational optimism that this will happen any time soon.

i.e. AI certainly can't do it better than super recognizers can do it now, and I am not as confident as you are that AI will be able to do this better than 'normal' humans without the understanding of how the two types of brains work differently.

Avatar
Alan Ataev
Aug 29, 2018

In case security is not confident enough they can ignore that. Even if they made a mistake most probably that person would steal nothing as he is may not be criminal.

U
Undisclosed #1
Aug 29, 2018

question:  Will active - on floor - surveillance agents change the behavior of a professional shoplifter?  Of course they would.

Your premise is that identification of known repeat shoplifters allows LP agents to 'follow' them (once they are 'identified') to observe the expected shoplifting - and only then confront them.

I find that operational premise to be pretty weak.

Why wouldn't you just use the hot list as an exclusionary tool?  i.e. if someones face comes up 'hot' - you walk up and tell them that and ask them to leave.  Sort out the bad 'hits' right on the spot and spin the actions as a way to protect them.  sorry, and all that.

This approach seems far more likely to prevent pros from lifting stuff in stores than maybe potentially catching them in the act visually might be able to do.

as an example, US casinos have a similar hot list of known cheaters - and if they get a 'hit', they don't send over pit bosses to observe them and catch them cheating - instead they just boot them.

Avatar
Alan Ataev
Aug 29, 2018

make sense, but how to exactly react on a face match relies on the store management/security, they can go either way.

Avatar
Alan Ataev
Aug 29, 2018

The case I'm talking about is in Canada, we also have implemented multiple projects around the Globe.

New discussion

Ask questions and get answers to your physical security questions from IPVM team members and fellow subscribers.

Newest discussions