Normalize Exposure Settings for IP Camera Comparisonsby John Honovich, IPVM posted on Dec 23, 2009 About John Contact John
We recommend all surveillance camera comparisons be performed with normalized exposure settings to ensure fairness and eliminate 'games'. Starting immediately, we will use 1/30th and 1/8th second exposure times as standard settings to test and compare cameras. This is especially critical in the assessment and measurement of low light performance.
Why This is Important
In testing a wide range of cameras, it has become clear that manufacturers select a wide range of default maximum exposure settings. While there are valid uses for different settings, those manufacturers who choose longer defaults for maximum exposure settings are viewed unfairly as having superior low light performance. For background on this issue/trick, review our testing and analysis of exposure's impact on low light video quality.
Maximum exposure settings can have a dramatic impact on 'visible' image quality because changing it from 1/30th to 1/8th or 1/2th can increase light captured by 400% to 1500% - a dramatic difference that overshadows practically any other setting.
Comparing still images from one camera with 1/30th s exposure to a 1/2 s exposure will always be unfair and almost always lead to the 1/2 s exposure camera being viewed as better (because manufacturers will show still objects hiding the problem of motion blur).
Here's a clear visual on image tradeoffs from varying exposure settings that you would almost never see from a manufacturer:
Why 1/30th and 1/8th Second Exposure Settings?
1/30th second exposure matches the maximum frame rate and is a commonly used setting by manufacturers. It's also generally the shortest maximum exposure setting we find in IP cameras that we are testing.
1/8th second exposure provides a significantly longer exposure increasing both the 'brightness' of a dark scene and the risk of motion blur. We think 1/8th is a good intermediate point - much lower and motion blur is guaranteed to be strong.
Not all cameras allow for direct setting of their maximum exposure time. Some only allow indirect qualitative settings.
Other cameras offer special modes for very long exposures - 1/2s or even 1s exposures.
We will make note of either circumstance and provide additional, clearly marked tests of such modes.
We believe clarity on exposure settings and testing normalization will provide fairer testing that more accurately demonstrates real-world use and relative trade-offs.
Most Recent Industry Reports
30 vs 60 FPS Shootout on May 22, 2013
30 frames per second used to be the maximum practical limit for surveillance cameras. Now, it is becoming increasingly common for IP cameras to support double that, 60 frames per second. (For backg...
#1 IP Camera Benefit on May 20, 2013
Megapixel was, far and away, the number #1 cited benefit in going to IP cameras / video. We asked over 100 integrators to name the "3 biggest reasons" they found, allowing them to name whatever the...
Testing VSaaS / Dropcam HD on May 15, 2013
Dropcam is pretty clearly the strongest upstart in the VSaaS market. While Axis has pushed their hosted service offering for years, it is beset by poor ROI and weak performance. There are dozens of...
Testing Panoramic Cameras Outdoors on May 13, 2013
Outdoors, PTZs tend to be a favorite for covering large open areas but they only see whatever they are currently pointed at. Panoramics are an emerging alternative but how well do they perform and ...
Testing CarCam on May 08, 2013
Dash cams are getting a lot of attention for the amazing video they inadvertently capture, like a crashing 747 in Afghanistan, a meteor explosion, Russian crazy fights and accidents, etc. Moreov...
#1 IP Camera Problem on May 07, 2013
Cost was, far and away, the number #1 cited problem in going to IP cameras / video. We asked over 100 integrators to name the "3 biggest problems / barriers" they found, allowing them to name whate...
Testing Covert Cameras on May 02, 2013
Covert cameras are regularly referenced in TV shows and undercover reporting. We ordered two of the most frequently sold covert cameras on Amazon - a Car Key cam and a PenCam, as shown below: We...
Stop The Lying and Crazy Claims on Apr 29, 2013
The last few weeks have been an embarrassment for surveillance, with a small number of companies turning this into a despicable marketing campaign perpetuating lies and crazy myths about what surve...
Panoramic Camera Shootout on Apr 22, 2013
Panoramic cameras are one of the hottest growing markets within surveillance. The combination of multi-megapixel resolution and super wide FoVs claims to deliver greater coverage than conventional ...
Top Trends in Access Control on Apr 17, 2013
All of a sudden, Access Control has momentum? After a long period of apparent stagnation and staleness, new technologies and devoted marketing campaigns have breathed life into the segment. Indeed,...