As details emerge on the Boston bombing, the impact and use of surveillance technologies is coming into view. [Now, updated below with a list of manufacturer claims on how their products would have (ha ha) prevented or solved the bombings.]
The FBI says that one of the bombs was contained in a black backpack that looked like so:
The best way an analytic might be able to help is only if you already have a person or item of interest. And if you were able to collect all video and pictures of the area in one place (exported video from surveillance system, YouTube and picture postings made on the Internet, any other video turned in by bystanders), like a folder on a computer, and have that analytic search all that video and pictures in the folder for any other instances of that person or item, you might be able to piecemeal together the person's movements and possibly find clues as to who they were and maybe even if anyone else was involved.
That would be an "offline" use per say, and would not require any integration with a system.
I just caught the tail end of Fox News interviewing the ObjectVideo CEO on analytics and Boston. I have no idea what he was saying because I only saw the last few seconds but if I can find it online, and it's anything interesting, I'll post it on here.
Given the false reports so far, take this with some skepticism but the NYPost is reporting that they have obtained an email saying that the two guys in the photo at the top of this discussion are now wanted suspects.
If they turn out to be the bombers, this would be a pretty amazing milestone in the use of personal cameras and Internet investigations to identify criminals.
Animetrics is a niche player specializing in face recognition. They've been marketing 2d to 3d conversion for nearly a decade.
As for the claims in the video, let's say you could take a subject with a hat, at an angle and convert it. Best case scenario that would help searching (not live alerting) against mugshuts, not against regular surveillance video (which also will overwhelmingly have shots of people with the same issue).
"Even without a name, [3VR's CEO] said, investigators could program multiple cameras at airports and elsewhere with the suspects’ images so the cameras would send an alert to them if someone resembling a suspect passed by."
I heard an interview with 3VR's CEO on NPR on way to work this morning. He was saying talking about using analytics to sift through video for clues, but to his credit he also talked about the limitations of analytics and actually said analytics have overpromised and under-delivered over the years. They did not say directly, but it seemed to imply 3VR analytics were used to sift through video.
I'll refrain on commenting on what Ann Coulter thinks.
"Attempting facial recognition on images like those released by the FBI Thursday is out of the question, [the professor] says. However, there may be other images and videos available that contain a better view that could be high quality enough, he says. “You could search all the other images based on clothing,” he says, “[and then] you could locate the same person and collect multiple images.”
I agree with the former, on it being out of the question for face recognition with those images. However, while you could do a search for color, there are an immense number of people wearing those colors, so it might help a little.
Kudos to the 3VR marketing department who got CNET to run what's little more than an advertorial for them:
The video concludes with a dismissal of a core limitation, noting 'while a hat or sunglasses can stump some cameras, engineers are already working to counteract" that. Lulz. They maybe working on it but I doubt they are solving it.
If the FBI has a clear video or photo image of a suspect, it's possible to quickly search through surveillance tapes from businesses that already use searchable video systems, which contain a ready-made catalogue of all individuals video taped, indexed by their facial characteristics. Search requests will turn up a list of close matches, leaving it up to the human investigator to make the final call, [3VR's CEO] says.
Even if this works perfectly (it's nowhere close but let's assume), less than 1% of deployments have 'searchable video systems' for the type of metadata that 3VR is suggesting. So unless the plan is to standardize Boston on 3VR, it's not much of a practical recommendation
It's also the first mention of Briefcam I've seen in print, which is maybe the only video analysis program that actually could be of help, simply to make searching faster. Even still, operating in such crowded scenes is hard, at best, and impossible (and irresponsible to claim) at worst.
All of these articles use lots of sentences describing what various software "could" do, not what it "did".
Briefcam still seems to me like the only real practical option here, and even that is no magic bullet.
What would a BRS system do in this case? This day was essentially a complete anomoly from start to finish (as it would have been even if it went perfectly normal). I find it hard to believe that any truly useful data would have come out of a video analytics platform meant to spot rogue activity (rules based or not). I also don't see this changing much in the near future. It's a really really hard problem to solve, and statistically speaking we don't see enough of these events (thankfully) to cause people to want to budget for a solution, which discourages anyone from attempting to solve this problem.
It would certainly be nice if some of what we saw on TV (or what bored reporters dreamed up) was true, but I think this is going to be human-analytics, assisted at times by tools like Briefcam, invetigating these kinds of events. The computers aren't going to find the red shirts and black backpacks for us.
SRI has an IR based system called VerifIR that I saw demonstrated at last years ISC West.
It tries to give the viewer a picture of what's under clothing and I even saw a video of it showing a shallow buried device under dirt. The rep at the show walked in front of the camera and I could see his threat resistant vest under his shirt.
So might this have helped as a preventive measure? Some caveats.
... How close would a person have to be to the camera to make out an object?
... Would require active viewing, I think. The picture doesn't look clear enough to really use an analytic to detect threats, and in this case, would a pressure cooker have been obvious enough to raise an alarm?
"David Antar of New York-based IPVideo Corporation says video surveillance can be set up to trigger warnings if bags are left unattended or suspicious activity takes place before or during a large-scale event."
I thought everyone abandoned this idiotic idea years ago?