Disney Developing Re-Identification Analytics

By: Brian Karas, Published on Oct 27, 2017

When most people think of Disney, they probably think of cartoon characters or maybe innovative theme park rides and RFID bracelets. But Disney researchers have also developed an person-tracking analytic they claim can significantly outperform state-of-the-art approaches. [link no longer available]

We analyze Disney's approach, using dynamically trained convolutional neural networks to find appearances of the same person across multiple surveillance cameras.

Multi-Camera ****** ********

******'* ***** ***** ******* ** ************ ** "**-**************", the ******** ****** ******** terminology *** ******** *********** of a ****** ** ******** images. *** ***** ***** does *** ************* ** the ********* ** ******** for *** ** **** or ******** *****, ****** as-described, ** ***** ****** be **** ** ****** scenario, **** ****** ********.

Applications *** ******

****** ***** ***** ********* an "**********", ***** ** effectively * ****-**** *****, in ***** ** **** things "****-****", **** **** to ******* ****** ********, without *** ******* ********** of ***** **. ** a ****** ****** * disruption, ********** **** ****** from ******* ********** *********** (and ***** *** ********** for ***** *********) ** a **** ********. ***** able ** ****** * person ** **** **** from ******** *******, ******* of ******* ******** ******** guards **** *** ****, would ** ** *********** benefit. ****, **** ********** could **** ****** ******* their ******** ******* ** customers, *** ****-**** **********.

Overview ** ****** **-************** *********

****** ** ******** **** breaking ** ***** ** a ****** **** ******* sections (***** **** **** "patches"), *** ***** **** ***** to ***** ************ ***** algorithms ** * **** neural ******* ********* *** probability ** * *****. This ** *** ** looking *** ************ ** individual ******* ** *** image, ******* ** ******* only ** *** ***** image ** *** ******. If * ***** ***** is ***** ** ****** patches, *** ***** ** deemed ** ** ** the **** ****** ** the ******/******** *****. **** improves *********** **** *** person ** *** ****** seen **** *** **** angle, ****, ** ********/********** across ******** *******.

****** ******* **** ******** over *********** ******* ** relying ** ***** ** texture **** ******* **** data ** *** ****** reliably ******* (**** ** when *** ***** ** the ****** ** **** a **** ******** **** of ** **********).

Specifics ** "*****" ********

***** ******** ************* ****** ******** are ******* **** ********** of * ****** *****, in * ****-******** ********. The ***** (***** *) is ******* ***** * full-body ********** ** *** person, *** ****** (***** 1) ***** *** **** image, *** ****** **** horizontal ********, *** **** the ***** (***** *) slicing **** ** *** horizontal ***** **** ****/***** halves. **** ********** ***** ** ******** to ** * *****.

**** ********* ** ***** for *** **** ** patch ** **** ** fed. ****, *** *** Level * (****** *****) portion, **** ** *** 4 ******/******* ** *** individually ** *** **** algorithm ** ******* * separate ********. *** ******* **** distinct ***********, ** *** Level * ********* ******* at *** *** ***** ** images **** **** ** the *** ***** ** ***** images *** ********** ********.

* ********* **** ****** each ***** **** ******** sub-patches *** ******* ******** and deep ******* **********. **** stage ******* ** **** the ***-******* **** ******* of ******** ** *** image ******* ****, ***** the ***** ***** **** not ******* *********** ******.

 

*******, * *********** ****** learning ******* ** ******* out ** * ***** and ***** ***** ** the *******.

****** ****** ** **** 3-step ******** ** * Deep ******* ******* (***) method.

*********** **-************** **********

******** ** ******* ********** are ********* ** ******'* paper. ***** ******* **** of * ********** ****** of ****** ** * given ****** (***** ***** ideally ** ********* ** distinct ***** ******** ** the **** ******) ** train * ******* ****** network, *** ****** ** use ******* ******** ** "people" **** ****-****** ******* from ********** ******** *** differentiators ** * ***** person:

Claimed ******** ** ***** ********

** *** ********** ** the *****, ****** ****** that ** ********* *********** learning ********** ***** *** images *** ******** ** determine ********* ** ********* between **** (************** ******), **** *** *****-***** image ******** ********, **** can ******* ******** ******* for ******* ******* *********** of * ****** ****** multiple *******.

 

VIPeR ******* ****

** ******* ***** *** re-identification ****** ** *********** methods, ****** *********** **** the ***** *******. ***** ****** ** "Viewpoint ********* ********** ***********", which ** * ******* of ****** ** ****** captured **** ************ ******* having ********** ** ********/*******, poses, ******, ***. ** represent ******* **********. ******** of ***** ****** *** shown *****:

Performance ************ ** *********** *******

** ***** ***** **** to ******* ***** ******** to *********** **-************** *******, Disney ******** * *********** increase ** *********** **********.

*** **** **** ** the ***** ********** ***** the **** ******* ******* approach ** *** ***** 2 ******* (***** *** person's ***** ** ****** into * *******), **** overlapping ***-******* **** ********. The ***** **** ** using *** *** ********, but **** * *********** of * *********** ******* (color **********, ***/**********/***** ****, and ***** ***********), *** the *** **** ** the *** ******** ***** the ***** * ******* with ** *********** ****. The ***** *** **** lines *** *********** "**** crafted" ********** ***** ***** 2 ******* *** *** color ****:

 

********** **** ****** **** Disney ******** *** *** approach ****** **** * significant *********** ** **-************** accuracy, *** *** *** best ******* ***** ***** 2 *********** *******, ****** DSP ******* ** *********** input **** (***** ******) also ****** ***** ************ in **-**************.

Disney ** *******

****** ******** ******* ** IPVM ** ******* ******* of **** ********.

Impact ** ************ ********

******** ************* ***** **** ** sell ******, *** ***** large *********, ***** *** versions ** **-************** *********. **********************, *** ***** ********* companies **** *** ******** heavily ** ******** **** ************ for ***** **** ******. However, ************ ****** ********, *** ***** **********, are ****** ** ****** to ******* ********** ********* ** a ***** **** ** developers. ** ****, **** allows ************* **** ****** to ***** ***** *** advanced ********* *********, ******* of ********** **** *********** suppliers.

***** ** ** ******** that ***** ***** ************ will **** ** ******* their *** **-************** *********, or ******* *********, *** possibly **** **** ***** do ** ***** ** harder *** ************* ** charge ******* ******. **** may **** ** **** affordable *********, ****** ***** technologies ********* ** * wider ******* ** *****. 

Comments (4)

Dear Brian, thank you for this article. I think that one of the most interesting parts of the article is the last figure. We may consider it as a current state of research in the field of reidentification. RANK 1 below 50% (and RANK 15 near 90%) may be interpreted as an indicator that the task of reidentification is not reasonably solved even on a database like VIPeR (it contains only 632 persons). So I suggest that on real sites (with thouthands of different persons per a day and hungreds of cameras) the method will not work feasible. Also it is interesting what about CPU (or GPU) consumption.

 

AvigilonIronYunQognify, and other analytics companies have all invested heavily in building such applications

After this article from Disney Research it's interesting how these analytics work on real sites. Does someone have experience?

Avigilon would not cope well with the crowds.  I suspect other analytics would be much the same.

Brian, thanks for a very interesting article. Interesting that Disney would "go it alone" instead of partner for technology. Makes me wonder if that reflects their desire to keep the details of this project as contained as possible (not supported by letting a technical paper), or if they just couldn't find suitable commercial technology. 

Skip - hard to say since they did not want to participate in an interview, however given Disney's overall approach to technology/innovation, I did not find this overly surprising.

Read this IPVM report for free.

This article is part of IPVM's 6,538 reports, 881 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Exacq "Facial Matching" Facial Recognition Tested on Sep 03, 2020
Exacq is claiming "Accurate Recall of Every Noteworthy Person of Interest"...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Gait Recognition Examined on Sep 14, 2020
Facial recognition faces increasing ethical and political criticisms while...
Face Detection Shootout - Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jul 30, 2020
Face detection analytics are available from a number of manufactures...
Clinton Public View Monitor (PVM) Mask Detection Tested on Jul 09, 2020
Face mask detection, or more specifically not wearing one, is expanding...
Access Visitor Management Systems Guide on Jul 22, 2020
"Who are you, and why are you here?" Facilities that implement Visitor...
Startup Digeiz Reidentification Video Analytics Profile on Jul 20, 2020
French Start-Up Digeiz is marketing 'shopping centre analytics' with, most...
TVT Temperature Measurement Terminal Tested on Jul 23, 2020
While Dahua and Hikvision get the most attention for China temp products,...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Startup Solink $17 Million USD Fund Raise Expands To Mass Market on Jun 24, 2020
Solink has raised ~$17 million USD, a sizeable round for the company that...
Sunell Panda Cam Body Temperature Measurement Camera Tested on May 14, 2020
Sunell is far less well known than its gargantuan domestic competitors Dahua...
Avigilon Face Mask Detection Tested on Jun 24, 2020
Face mask detection or, more specifically not wearing a face mask, is an...
Favorite Network Switches 2020 on Aug 31, 2020
Cisco has long been the gorilla of network switches but would an upstart...

Recent Reports

Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
New Products Show Fall 2020 Starts Tomorrow! on Sep 27, 2020
Tomorrow, IPVM's sixth online show will feature New Products from over 25...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...