Disney Developing Re-Identification Analytics

•Published Oct 27, 2017 13:27 PM

When most people think of Disney, they probably think of cartoon characters or maybe innovative theme park rides and RFID bracelets. But Disney researchers have also developed an person-tracking analytic they claim can significantly outperform state-of-the-art approaches. [link no longer available]

We analyze Disney's approach, using dynamically trained convolutional neural networks to find appearances of the same person across multiple surveillance cameras.

Multi-Camera ****** ********

******'* ***** ***** ******* ** ************ ** "**-**************", *** ******** vision ******** *********** *** ******** *********** of a ****** ** ******** ******. *** white ***** **** *** ************* ** the ********* ** ******** *** *** in **** ** ******** *****, ****** as-described, ** ***** ****** ** **** in ****** ********, **** ****** ********.

Applications *** ******

****** ***** ***** ********* ** "**********", which ** *********** * ****-**** *****, in ***** ** **** ****** "****-****", they **** ** ******* ****** ********, without *** ******* ********** ** ***** so. ** * ****** ****** * disruption, ********** **** ****** **** ******* additional *********** (*** ***** *** ********** for ***** *********) ** * **** priority. ***** **** ** ****** * person ** **** **** **** ******** footage, ******* ** ******* ******** ******** guards **** *** ****, ***** ** of *********** *******. ****, **** ********** could **** ****** ******* ***** ******** product ** *********, *** ****-**** **********.

Overview ** ****** **-************** *********

****** ** ******** **** ******** ** image ** * ****** **** ******* sections (***** **** **** "*******"), *** using **** ***** ** ***** ************ ***** algorithms ** * **** ****** ******* increases *** *********** ** * *****. This ** *** ** ******* *** similarities ** ********** ******* ** *** image, ******* ** ******* **** ** the ***** ***** ** *** ******. If * ***** ***** ** ***** in ****** *******, *** ***** ** deemed ** ** ** *** **** person ** *** ******/******** *****. **** improves *********** **** *** ****** ** not ****** **** **** *** **** angle, ****, ** ********/********** ****** ******** cameras.

****** ******* **** ******** **** *********** methods ** ******* ** ***** ** texture **** ******* **** **** ** not ****** ******** ******* (**** ** when *** ***** ** *** ****** is **** * **** ******** **** of ** **********).

Specifics ** "*****" ********

***** ******** ************* ****** ******** *** ******* from ********** ** * ****** *****, in * ****-******** ********. *** ***** (Level *) ** ******* ***** * full-body ********** ** *** ******, *** second (***** *) ***** *** **** image, *** ****** **** ********** ********, and **** *** ***** (***** *) slicing **** ** *** ********** ***** into ****/***** ******. **** ********** ***** ** ******** to ** * *****.

**** ********* ** ***** *** *** kind ** ***** ** **** ** fed. ****, *** *** ***** * (second *****) *******, **** ** *** 4 ******/******* ** *** ************ ** the **** ********* ** ******* * separate ********. *** ******* **** ******** ***********, so *** ***** * ********* ******* at *** *** ***** ** ****** **** look ** *** *** ***** ** ***** images *** ********** ********.

* ********* **** ****** **** ***** into ******** ***-******* *** ******* ******** and deep ******* **********. **** ***** ******* in **** *** ***-******* **** ******* of ******** ** *** ***** ******* them, ***** *** ***** ***** **** not ******* *********** ******.

*******, * *********** ****** ******** ******* is ******* *** ** * ***** and ***** ***** ** *** *******.

****** ****** ** **** *-**** ******** as * **** ******* ******* (***) method.

*********** **-************** **********

******** ** ******* ********** *** ********* in ******'* *****. ***** ******* **** of * ********** ****** ** ****** of * ***** ****** (***** ***** ideally ** ********* ** ******** ***** examples ** *** **** ******) ** train * ******* ****** *******, *** trying ** *** ******* ******** ** "people" **** ****-****** ******* **** ********** elements *** *************** ** * ***** person:

Claimed ******** ** ***** ********

** *** ********** ** *** *****, Disney ****** **** ** ********* *********** learning ********** ***** *** ****** *** compared ** ********* ********* ** ********* between **** (************** ******), **** *** *****-***** ***** ******** approach, **** *** ******* ******** ******* for ******* ******* *********** ** * person ****** ******** *******.

VIPeR ******* ****

** ******* ***** *** **-************** ****** to *********** *******, ****** *********** **** the ***** *******. ***** ****** ** "********* ********* Pedestrian ***********", ***** ** * ******* of ****** ** ****** ******** **** surveillance ******* ****** ********** ** ********/*******, poses, ******, ***. ** ********* ******* conditions. ******** ** ***** ****** *** shown *****:

Performance ************ ** *********** *******

** ***** ***** **** ** ******* their ******** ** *********** **-************** *******, Disney ******** * *********** ******** ** recognition **********.

*** **** **** ** *** ***** represents ***** *** **** ******* ******* approach ** *** ***** * ******* (where *** ******'* ***** ** ****** into * *******), **** *********** ***-******* also ********. *** ***** **** ** using *** *** ********, *** **** a *********** ** * *********** ******* (color **********, ***/**********/***** ****, *** ***** descriptors), *** *** *** **** ** the *** ******** ***** *** ***** 2 ******* **** ** *********** ****. The ***** *** **** ***** *** traditional "**** *******" ********** ***** ***** 2 ******* *** *** ***** ****:

********** **** ****** **** ****** ******** the *** ******** ****** **** * significant *********** ** **-************** ********, *** had *** **** ******* ***** ***** 2 *********** *******, ****** *** ******* to *********** ***** **** (***** ******) also ****** ***** ************ ** **-**************.

Disney ** *******

****** ******** ******* ** **** ** further ******* ** **** ********.

Impact ** ************ ********

******** ************* ***** **** ** **** ******, and ***** ***** *********, ***** *** versions ** **-************** *********. ********, *******, *******, *** ***** ********* ********* **** all ******** ******* ** ******** **** ************ for ***** **** ******. *******, ************ in**** ********, *** ***** **********, *** ****** it ****** ** ******* ********** ********* ** a ***** **** ** **********. ** turn, **** ****** ************* **** ****** to ***** ***** *** ******** ********* solutions, ******* ** ********** **** *********** suppliers.

***** ** ** ******** **** ***** large ************ **** **** ** ******* their *** **-************** *********, ** ******* analytics, *** ******** **** **** ***** do ** ***** ** ****** *** manufacturers ** ****** ******* ******. **** may **** ** **** ********** *********, making ***** ************ ********* ** * wider ******* ** *****.

Comments (4)

Igor Falomkin

•Oct 30, 2017

AxxonSoft

Dear Brian, thank you for this article. I think that one of the most interesting parts of the article is the last figure. We may consider it as a current state of research in the field of reidentification. RANK 1 below 50% (and RANK 15 near 90%) may be interpreted as an indicator that the task of reidentification is not reasonably solved even on a database like VIPeR (it contains only 632 persons). So I suggest that on real sites (with thouthands of different persons per a day and hungreds of cameras) the method will not work feasible. Also it is interesting what about CPU (or GPU) consumption.

Avigilon, IronYun, Qognify, and other analytics companies have all invested heavily in building such applications

After this article from Disney Research it's interesting how these analytics work on real sites. Does someone have experience?

Reactions:

Undisclosed Integrator #1

•Oct 31, 2017

In reply to Igor Falomkin

Avigilon would not cope well with the crowds. I suspect other analytics would be much the same.

Reactions:

(1)

Skip Cusack

•Oct 31, 2017

Brian, thanks for a very interesting article. Interesting that Disney would "go it alone" instead of partner for technology. Makes me wonder if that reflects their desire to keep the details of this project as contained as possible (not supported by letting a technical paper), or if they just couldn't find suitable commercial technology.

Reactions:

Brian Karas

•Oct 31, 2017

IPVM

In reply to Skip Cusack

Skip - hard to say since they did not want to participate in an interview, however given Disney's overall approach to technology/innovation, I did not find this overly surprising.

Reactions: