How China's Pay By Facial Recognition Works

By: Charles Rollet, Published on Apr 02, 2019

Many social media posts have variously celebrated or warned about the growing use of facial recognition for payments in China. An example of one such video is shown to the right.

When one looks at such videos, an obvious question is: how do they do that accurately? There are many millions of people in China and, in these videos, the person seems to simply look at the camera and is promptly recognized.

However, the system is not omniscient. While facial recognition for payments in China is real, it relies on verification, not identification, a key difference.

In this post, we examine how facial recognition payments really work in China, and how it fundamentally relies on the country's system of national ID cards.

How It Works

In many convenience stores and restaurants in China, it is indeed possible to pay without bringing a cellphone or cash. But it is not as simple as just looking into a camera at the check-out counter. There are actually two steps:

  1. Look into the camera
  2. Enter your cellphone number on the screen

The cellphone number is used to bring up your personal details and an existing photo of your face. That existing photo is compared to the one just taken, and if it is a match, the payment goes through.

Why It Is Possible: Alipay

Alipay is the mobile payments arm of Chinese e-commerce giant Alibaba (in China similar to Amazon in the US). Over 900 million, mostly Chinese people, have Alipay accounts, which require a national ID card, bank account, and mobile phone to activate. Alipay users can also enable facial recognition by taking a selfie with their cellphone. Therefore, just by plugging in a phone number at check-out, Alipay can directly access a high-res image of a user's face along with bank account details.

Alipay released a video showcasing how this system works here

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

As the video shows, a phone number is required, not just a face. The still below demonstrates:

The video also claims that the camera is able to correctly match users despite heavy make-up, different hair color, and other people being present in the photo, as the still below demonstrates:

This is certainly possible, though the more a facial recognition system allows variance in appearance, the greater the risk that it could mismatch to another person. However, since they are doing verification, not identification, the risk is reduced.

Verification vs Identification

Therefore, payment via facial recognition in China is not done by comparing someone's photo to mass numbers of people in an existing database. Technically, this is called '1:N' or one-to-many identification. This is the kind of facial recognition that would need to be done by video surveillance cameras in shopping malls looking for shoplifters or in cities looking for terrorists, etc.

One example of this somewhat science fiction approach is Dahua's 2017 marketing video where they (impossibly) generate a facial recognition match of a person with a hat, in a shadow, looking away from the camera:

While looking directly into a camera's FoV improves image quality vs public surveillance cameras, identification is still difficult to do accurately and reliably when comparing to even thousands of people and would be vastly more difficult in trying to match across millions or hundreds of millions in China. People look alike, especially across large groups and especially when the system is trying to tolerate differences in hairstyle, makeup, weight gain, etc.

Rather, in the China payments case, '1:1' verification is being used: Alipay's software is only comparing the photo taken at check-out to an existing photo that is part of someone's Alipay account. As such, the system just needs to assess how probable the face presented at the camera is to the reference image on file.

National ID Card System Crucial

A major factor making such a system easier is that Chinese citizens, by law, must have a detailed national ID card, officially called a Resident Identity Card or 居民身份证. These detailed cards are issued by police and function as a sort of domestic passport. Because a national ID card is required to activate Alipay, an Alipay account is effectively as trustworthy as a legal ID.

(In the US, however, many people have a driver's license as their only official ID. Because they are relatively easy to get and commonly faked, driver's licenses from many states are not enough to even fly domestic. )

Privacy Concerns

While a national ID card system that is used and shared with corporations for payments adds convenience, it does raise privacy concerns about the data being shared. For example, the ACLU has spoken out against national ID cards expressing concerns about them being used to expand surveillance. Of course, inside China, this is the norm.

Other countries do have national ID card systems, like France. However, in France, having such a card is not obligatory and many people do not have one. Compulsory national ID cards have a controversial past in France, as they were instrumental in deporting Jews to camps during WW2; when France attempted to make biometric ID cards compulsory in 2011, the proposal was heavily criticized and ultimately dropped.

Partly because of the lack of such a history, China is well-known for giving short shrift to privacy issues. For example, the CEO of Baidu (China's Google) once said that Chinese people care less about privacy. Still, there are signs this is changing. China passed a personal privacy law in 2018 described by some as "more onerous" than the EU's GDPR. Alipay, for its part, claimed in its promo video that:

We don't store data. We also protect data by using encryption. We want to do everything in our capacity to protect users' privacy and security online.

Popularity in China

IPVM understands that while facial recognition payment is possible in many Chinese outlets, most people still prefer to use their cellphone. The way this is done is by scanning the unique Alipay barcode that is part of their Alipay 'wallet' at check-out. This does not require inputting a cellphone number or posing for a picture and is therefore significantly faster.

However, if one was to leave a cellphone at home, Alipay's facial recognition feature does enable payments without needing anything at hand, a significant convenience.

UPDATE: Face Pay for ATMs

A LinkedIn post shows a man using facial recognition instead of a card at a China ATM. "No card needed anymore, just bring your face", the poster claims.

Screen Shot 2019-04-04 at 4 01 09 PM

IPVM has confirmed that some ATMs in China do use facial recognition. However, this is the same system as using your face to pay for groceries, i.e. it is based on verification not identification. What the LinkedIn post does not show is that a phone number or national ID number is typically required as well.

5 reports cite this report:

China Subway Facial Recognition System Examined on Jun 24, 2019
A China city of 6+ million people has installed facial recognition-enabled gates in subways, allowing commuters to enter stations by simply showing...
China Jaywalking Facial Recognition Guide on May 27, 2019
News reports touting the PRC's AI prowess often showcase facial recognition cameras being used to automatically catch and fine jaywalkers.  In...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
19 Facial Recognition Providers Profiled on Apr 23, 2019
IPVM interviewed 19 facial recognition providers at ISC West to understand their claimed accuracy, success and positioning. 9 from China, where...
UK Camera Commissioner Calls for Regulating Facial Recognition on Apr 15, 2019
IPVM interviewed Tony Porter, the UK’s surveillance camera commissioner after he recently called for regulations on facial recognition in the...
Comments (4) : PRO Members only. Login. or Join.

Related Reports

Hikvision Global News Reports Directory on Jul 15, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Hikvision's Government Owner Website Blocked To World on Jul 11, 2019
Hikvision's PRC government owner, CETHIK, has had its website blocked outside of China, hiding a major information source proving Hikvision's...
First Video Surveillance GDPR Fine In France on Jul 08, 2019
The French government has imposed a sizeable fine on a small business for violating the GDPR after it constantly filmed employees without informing...
RaySharp Revealed - Major China OEM For Western Consumer Video Surveillance on Jul 02, 2019
RaySharp is mostly unknown, even among people in the video surveillance industry, though it is a major supplier of OEM surveillance equipment such...
2019 Mid-Year Video Surveillance Guide on Jul 01, 2019
IPVM's new 400+ page Mid-Year Industry Guide brings all of these issues and events together in a single resource to read and review. It can be...
GDPR / ICO Complaint Filed Against Dahua on Jun 27, 2019
IPVM has filed a GDPR complaint against Dahua UK's facial recognition conducted at their booth during this year's IFSEC show.  In this post, we...
Axis Live Privacy Shield Analytics Tested on Jun 25, 2019
Privacy is becoming a bigger factor in video surveillance, driven both by increased public awareness and by GDPR. Now, Axis has released Live...
China Subway Facial Recognition System Examined on Jun 24, 2019
A China city of 6+ million people has installed facial recognition-enabled gates in subways, allowing commuters to enter stations by simply showing...
IFSEC 2019 Show Report on Jun 19, 2019
The UK's largest trade show, IFSEC, is underway and IPVM has been examining what is new and happening at the show. Inside, we cover: Huawei...
Biometrics Usage Statistics 2019 on Jun 17, 2019
While face and fingerprint recognition are used regularly for smartphones, it is not as common in physical security. In this note, we examine...

Most Recent Industry Reports

Wyze Disruptive AI Analytics Tested on Jul 17, 2019
$20 camera disruptor Wyze has released free person detection deep learning analytics to all of their users, claiming users will "Only get notified...
Anyvision Aims For 2022 Revenue of $1 Billion on Jul 17, 2019
Only 3 video surveillance manufacturers do a billion dollars or more in annual revenue - Hikvision, Dahua, and Axis. Now, Anyvision plans to join...
HD Analog vs IP Guide on Jul 16, 2019
For years, HD resolution and single cable signal/power were IP camera advantages, with analog cameras limited to much lower resolution and...
How To Troubleshoot Wiegand Reader Problems - Inverted Wiring on Jul 16, 2019
Wiegand is the dominant method of connecting access readers, but problems can arise for installers. In fact, one of the most difficult reader...
ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
Motorola Acquires Watchguard, Adds to Vigilant And Avigilon on Jul 15, 2019
2 years ago, Motorola had no position nor relevancy to video surveillance. Now, they own major video surveillance, LPR and body camera providers...
Hikvision Global News Reports Directory on Jul 15, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Vivotek Trend Micro Cyber Security Camera App Tested on Jul 15, 2019
Vivotek and Trend Micro are claiming five million blocked attacks on IP cameras, with their jointly developed app for Vivotek cameras. This new...
Beware African 50,000 IP Camera Contract Scam on Jul 12, 2019
A “Nigerian Prince” scam for the video surveillance market is going around. You, or at least we, could be lucky enough to be the single bidder for...
Axis ARTPEC-7 P1375-E Camera Tested on Jul 12, 2019
Axis claims the new P1375-E box camera with ARTPEC-7 chip delivers "clear, sharp images in any lighting condition." But how well does it do? We...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact