1, thanks for sharing, very interesting.
No matches, or at least no arrests or evicitions resulted from the system, although the control cops were picked up 77 times.
The control cops being up 77 times is no big deal, one way or another. (1) They were enrolled right then and there, which means similar look / time and probably a high quality camera and direct pose. (2) Those cops certainly walked past the six cameras numerous times so you would expect them to be picked up a lot.
The other point is harder to interpret. Does that mean that there were no matches against that "database of offenders from across Europe who were known by the police to target large music festivals to commit crime" or does it mean that they got correct hits but simply choose not to arrest or evict those known criminals?
One interesting point that would be great to know is how many times did the 100,000 festival goers incorrectly match the hit list of known criminals? This is generally a big issue. Did they get 10 false matches, 100, 1,000, 10,000? It would be great to know this to better assess the performance.
I will give it to NEC, they are obviously spending a lot on this (e.g., this free system / trial) but I still wonder how much success they are getting.
IPVMU Certified | 05/09/16 02:31pm
The vagueness of the response is a win for FUD (ie: Fear, Uncertainty, Doubt) playing a role in the usefulness of this deployment.
The actual performance of the system is secondary to the fact now both the Donington Download Festival and Leicestershire Police have established they use the system and offered up some ambiguous claims of effectiveness, ignoring hard success metrics.
The response makes it clear two different NEC products were used:
- NeoFace Watch: Real-time analysis used at the festival
- NeoFace Reveal: Forensic only, adopted by Leicestershire Police
I gather from this that real-time face detection of the city/area was never a goal, but the music festival presented a test opportunity. The risk for NEC and the city were small, because rumors about the deployment of a face-rec system in the area would be win enough.
However, the win: At this point, will not criminals seek other venues and locations to commit premeditated crimes?
From my experience, the first thing such kind of vendors ask you to do is to sign CDA or similar document where all test results are mentioned as the confidential information and it is strictly prohibited to share any data without the written consent from the vendor side. I could test them but all I could say officially to customers was that in this particular case vendor x is better than vendor y without any numbers. Thus it is difficult to expect to get any real results from such kind of tests.