Debunking Start-Up's FST21 Case Study

Author: IPVM Team, Published on Oct 07, 2013

This company won ISC West Best in Show 2 years ago, recently received $5 million in funding and is being talked about as the next big thing in security and surveillance for its 'revolutionary' incorporation of facial, voice and behavioral recognition.

Indeed, this summer, FST21 has been touting a large New York City apartment complex as a success story. Multiple security trade magazines have done case studies on the project so we wanted to see what all the excitement was about for ourselves. We sent a reporter to Knickerbocker Village to take video of the installation and talk to some of its tenants.

We were not the first to see SafeRise in action, but needless to say, our results are much different than the claims. We found the system was not as reliable or convenient for the tenants as the case studies make it seem and that piggybacking, doors being held open, new tenants and obscured faces were clear practical problems.

Background

Knickerbocker Village is a 12-building Manhattan complex that houses  ~1600 people, with 4,000+ coming and going daily. The FST21 SafeRise system is supposed to be an easy way for residents to access their apartment building using facial recognition instead of a keycard (FST21 says the system can be configured for voice or facial recognition). The premise is simple: If the camera sees a person enrolled in Knickerbocker’s database then the system should unlock the door and let them in.

SafeRise was installed on one door last year, but it was destroyed by Hurricane Sandy. That camera was replaced at the beginning of this year.

Future Plans / Phase Out Key Cards

There are plans to expand the system to all 12 buildings in the complex (though it is deployed at only two currently). Knickerbocker hopes to phase out key cards and operate solely on facial recognition.

Cost

Daniel Peled, FST21 vice president of sales says the cost of implementing this technology on one door (FST21's Digital Doorman solution) is $8,000 MSRP. 

“The whole complex is not commissioned yet, they are doing it in stages, starting from the interior building entrances, and then moving to the outside gates as well,” he said of Kncikerbocker. 

Operation

When a person first enters the lobby, here is the initial greeting. The red indication means the camera has detected movement. 

 

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

The indicator turns yellow briefly when it detects a face and green when the person is granted entry. Here is how it looks when it works:

Peled says if five people walk in together, SafeRise can identify all five through images without having them queue up, however our video shows that when three people walked in together (two tenants and our reporter) it did not identify any of them. This video shows some people opting to use keycards instead of facial recognition and the system failing to recognize anyone when three people walk in. 

For unknown or known people who are barred from entry, the system is designed to send an alert to building security. 

What Residents Had to Say

Initial Deployment Problems

The building’s manager told Security Today that he has not heard a single complaint about the system, but according to multiple residents, when the system was initially deployed it was unreliable. "At the beginning I had a problem, but I went to the office and they took care of it," the resident below says. "I love it. I think it's cool," he says. 

Ongoing Issues

Other residents say the regularly have problems trying to get in using the facial recognition feature and have to use their key cards. Others have defaulted to using their keycards because of frustrations with the system. In the video below, one resident says it "breaks down" occasionally and based on her neighbors experiences, another chose not to get enrolled for facial recognition at all: 

FST21 Response 

FST21 says the initial troubles are part of the tuning process for the system. “This is how our system works. We take your enrollment photo, and for the first six to eights times you use it, the system learns your behavior -- about 20 different biometric features we are learning per each person and use as part of our fusion platform. Once the system knows you it, lets you enter much faster and also we can raise the security level of it.”

FST21 says it would be hard to determine why it is not working for some residents without being able to analyze each specific incident, but the first place would start is making sure the tenant is enrolled. Peled says the system should have a 99.7% accurate detection rate and in the past people who say the system never works for them were often not enrolled. At Knickerbocker around 500 people are enrolled. 

Nine out of 15 people either said or showed us that the facial recognition feature worked for them. For the others, the system didn’t recognize them, they used their keycards instead, and some refused to use the system at all.

What The Security Director Says

Paroulek says he is happy with how the system has worked so far. He says he likes that the system helps keep a more accurate record of who is coming in and out of the building. “We know that sometimes people like to trade off and give their cards to other people and then we don’t know really who’s coming in unless my guards see it,” he said. 

The most common problem he said he sees is that residents are resistant to use it. Some still haven’t come to get their pictures taken, he said. “Sometimes I’ll run into people in the courtyard and they’ll say this system is crazy or it doesn’t work so I’ll say let’s go over and try it. When we go over and try it they’re being a little combative. They’re not looking at the camera or looking away. They’re wearing a hat or something to obscure their features. They’re trying to make it not work.”

Some still are not sure how the system even works. “There’s a fella who walks into the lobby and he puts his arm up and waves at the camera when it releases the door like there’s a security guard on the inside opening the door.”  

Camera Angle

FST21 says the camera is placed 75 inches from the floor and can capture faces from children, people in wheelchairs and people walking upright. Enrollment pictures are taken from as close to the same height and angle as the person would be coming through the door, he said. As a person comes through the lobby door, they are in the center of the camera's field of view (see below). 

The ideal distance is eight to 12 feet from the camera, he said. "We will set the actual recognition spot at the most natural path that people walk through. Ideal lighting is 300 LUX, however since you have been at Knickerbocker Village, you know the lighting there is not nearly up to what is ideal, and the system still works great," he said. 

FST21 said the concept behind SafeRise came from the company's founder, a former Israeli general. "Trying to find all the bad guys isn't going to work. But you can identify the good guys," he said. "It's a different concept of security. The technology is to identify people. Identify people who have already enrolled. When we train people we tell them if you want to get in, show yourself ... Even people who make the most minimal effort to be identified will be successful." 

Issues

Beyond sheer accuracy concerns, a number of issues exist:

New Users

Even if the system is 99.7% accurate, as FST21 claims, the system will be frustrating to new users. FST21 said the system is most accurate after a person comes through six to eight times. As more people enroll, and SafeRise is added to more doors, there is going to be a constant population of new enrollees who are having issues with the system. 

Presenting One's Face

User needs to present their face at an odd angle, tilting their face up and towards the corner where the camera is mounted. While the system may work quickly when properly presenting one's face, not doing do will cause many legitimate users to be denied entrance.

Removing One's Headware

While the security director implies that residents are trying to obscure their faces when wearing a hat, many people simply do not know that they need to remove their hat. Others, may not want to do so.

User 'Error'

Because people need to present their face and remove their headwear, many will make a mistake in doing so (e.g., forgetting to take off their baseball cap or looking straight ahead instead of at the camera). While this can be blamed on 'user error', either way, with so many residents, it will become a practical pain.

Residents Who Preferred the Key Card

Despite the ease the system is supposed to provide, some residents we spoke to still preferred the key card system and did not plan to enroll in the facial recognition system. This will cause problems when the complex decides to make all entrances facial recognition only. 

Tailgaiting

As the videos show, tailgating, piggybacking and letting other people in are still a problem. More than once people offered to let us in as we took video, and in one case facial recognition did not work for a two men without a keycard and they just waited until someone leaving let him in.

Peled says the system can count the number of people passing the door and send an immediate alert and if needed lock the door, but a feature that can lock a door does not matter if a door is being held open. 

Logging Unknown Visitors 

The system takes photos of people that try to enter and are not recognized and send photos and the alert to the security guards for review. This image below the reporter we sent taking photos of the camera. You can see on the right side of the screen a log of all of the alerts and messages broadcast by the intercom for that entrance.

A significant limitation to this system is that it relies on a clear shot of a person's face to be effective against unknown visitors. If a person wears sunglasses or has a hat pulled low, the system has no way to recognize that a person entered the building. If they come in along with someone else, the system would never know someone piggybacked their way in. 

"What we've done in places that need a bit extra security is installed another mechanism that counts the number of people coming through the door. We check that against the number of people we saw and if that doesn't match it triggers and alarm," Peled said. 

Conclusion

On the positive side, the system works for most residences on an outdoor entrance. The challenge, though, is that an access control system needs to work virtually every time or else the level of complaints and inconveniences becomes unmanageable. Given the repeated user 'errors', new enrollment issues, and user objections, using such a system for more than a thousand people in a residence seems infeasible. By contrast, we suspect that this would operate far more effectively in a government or corporate facility where users would be forced and trained to use the system.

Comments (4) : PRO Members only. Login. or Join.

Related Reports on Facial Recognition

GDPR / ICO Complaint Filed Against IFSEC Show Facial Recognition on Jun 20, 2018
IPVM has filed a complaint against IFSEC’s parent company UBM based on our concern that the conference violates core GDPR principles on...
IFSEC 2018 Final Show Report on Jun 20, 2018
IPVM attended the IFSEC show for the first time this year. The Chinese have taken over the UK, centered on Hikvision, flanked by Dahua, Huawei and...
China Public Video Surveillance Guide: From Skynet to Sharp Eyes on Jun 14, 2018
China is expanding its video surveillance network to achieve “100%” nationwide coverage by 2020, including facial recognition capabilities and a...
Facial Surveillance Used On US Politicians, Technical Challenges Remain on Jun 12, 2018
Many fear that facial surveillance will be used against people by governments, such as the vast facial surveillance apparatus being built in China...
Amazon's "Dangerous New Face Recognition Technology" Says ACLU on May 23, 2018
The ACLU has caused a stir, with a new report Amazon Teams Up With Law Enforcement to Deploy Dangerous New Face Recognition Technology,...
Digifort VMS Profile on Apr 25, 2018
Digifort, a Brazilian company, has a strong presense in their home country. In a crowded and mature Enterprise VMS market, will they be able to...
Favorite Biometrics 2018 on Apr 23, 2018
Biometrics are on the rise, or at least integrator opposition to them is declining, according to new IPVM integrator statistics.   Almost half of...
Dahua and Hikvision Win Over $1 Billion In Government-Backed Projects In Xinjiang on Apr 23, 2018
Dahua and Hikvision have won well over $1 billion worth of government-backed surveillance projects in China’s restive Xinjiang province since 2016,...
GDPR For Video Surveillance Guide on Apr 12, 2018
The European Union’s General Data Protection Regulation (GDPR) comes into force on May 25, but there is much confusion and no clear guidelines on...
Destructive Video Analytics Hype Returns on Mar 27, 2018
It is not just Hikvision's false advertising campaign. With marketing money being pumped into deep learning, we are returning to the bad old...

Most Recent Industry Reports

Installation Hardware for Video Surveillance - Indoor Fasteners on Jun 22, 2018
As part of our Installation for Video Surveillance series, in this note, we cover drywall anchors. A key part of installing security hardware is...
Hikvision ColorVu Integrated Visible Light Cameras Examined on Jun 22, 2018
When it comes to low light, infrared light has become the defacto standard in surveillance. But IR is limited to monochrome images, making colors...
Last Chance - Save $50 - July 2018 IP Networking Course on Jun 21, 2018
Today, Thursday the 21st is the last chance to save $50 on registration. Register now and save. This is the only networking course designed...
'Secure Channel' OSDP Access Control Examined on Jun 21, 2018
Despite claiming to be better than Wiegand, OSDP's initial releases did not address the lack of encryption between reader and controller, leaving...
Most Wanted Improvements In Manufacturer Technical Support (Statistics) on Jun 21, 2018
5 key areas of improvement and 1 clear wanted support feature were voiced by 140+ integrator responses to: What improvement in manufacturer...
GDPR / ICO Complaint Filed Against IFSEC Show Facial Recognition on Jun 20, 2018
IPVM has filed a complaint against IFSEC’s parent company UBM based on our concern that the conference violates core GDPR principles on...
IFSEC 2018 Final Show Report on Jun 20, 2018
IPVM attended the IFSEC show for the first time this year. The Chinese have taken over the UK, centered on Hikvision, flanked by Dahua, Huawei and...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Cybersecurity Startup VDOO Disclosing 10 Manufacturer Vulnerabilities Starting With Axis And Foscam on Jun 20, 2018
Cybersecurity startup VDOO has uncovered significant vulnerabilities in Axis cameras along with many others not yet disclosed. In this report, we...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact