This story is so last week. :)
The frame rates of the videos averaged 2000fps - that's a lot...
Though consumer grade frame-rates of 60 fps were also exploited to some degree...
In other experiments, however, they used an ordinary digital camera. Because of a quirk in the design of most cameras' sensors, the researchers were able to infer information about high-frequency vibrations even from video recorded at a standard 60 frames per second. While this audio reconstruction wasn't as faithful as it was with the high-speed camera, it may still be good enough to identify the gender of a speaker in a room; the number of speakers; and even, given accurate enough information about the acoustic properties of speakers' voices, their identities.
I think the 'quirk' here is the standard rolling shutter of CMOS. Since it is not a snapshot of any particular moment in time, like a CCD or global shutter is, is it giving information on a pixel by pixel basis possibly up to a max frequency of FPS x pixel count!?!
IPVMU Certified | 08/26/14 01:47am
Shhhhhhh! The plants are listening.
I can't believe this hasn't been the pivotal topic of a CSI episode yet.
IPVMU Certified | 08/31/14 06:25pm
Very interesting. This could be worth a Phd. I bet this has been well know by Military/Researches for years
This is the exact opposite of what they did in "The Dark Knight". They used audio only recordings to map out a video image.