Normalize Exposure Settings for IP Camera Comparisons

Author: John Honovich, Published on Dec 22, 2009

We recommend all surveillance camera comparisons be performed with normalized exposure settings to ensure fairness and eliminate 'games'. Starting immediately, we will use 1/30th and 1/8th second exposure times as standard settings to test and compare cameras. This is especially critical in the assessment and measurement of low light performance.

Why This is Important

In testing a wide range of cameras, it has become clear that manufacturers select a wide range of default maximum exposure settings. While there are valid uses for different settings, those manufacturers who choose longer defaults for maximum exposure settings are viewed unfairly as having superior low light performance. For background on this issue/trick, review our testing and analysis of exposure's impact on low light video quality.

Maximum exposure settings can have a dramatic impact on 'visible' image quality because changing it from 1/30th to 1/8th or 1/2th can increase light captured by 400% to 1500% - a dramatic difference that overshadows practically any other setting.

Comparing still images from one camera with 1/30th s exposure to a 1/2 s exposure will always be unfair and almost always lead to the 1/2 s exposure camera being viewed as better (because manufacturers will show still objects hiding the problem of motion blur).

Here's a clear visual on image tradeoffs from varying exposure settings that you would almost never see from a manufacturer:

Why 1/30th and 1/8th Second Exposure Settings?

1/30th second exposure matches the maximum frame rate and is a commonly used setting by manufacturers. It's also generally the shortest maximum exposure setting we find in IP cameras that we are testing.

1/8th second exposure provides a significantly longer exposure increasing both the 'brightness' of a dark scene and the risk of motion blur. We think 1/8th is a good intermediate point - much lower and motion blur is guaranteed to be strong.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Limitations

Not all cameras allow for direct setting of their maximum exposure time. Some only allow indirect qualitative settings.

Other cameras offer special modes for very long exposures - 1/2s or even 1s exposures.

We will make note of either circumstance and provide additional, clearly marked tests of such modes.

Conclusion

We believe clarity on exposure settings and testing normalization will provide fairer testing that more accurately demonstrates real-world use and relative trade-offs.


2 reports cite this report:

Readers Respond: 134 Votes, 25 Comments Examined on Feb 14, 2010
Over 100 people voted and more than 25 left detailed comments to our recent question/discussion. In this post, we review and respond to the...
Testing IQinVision's 4 Series and PSIA Integration on Feb 02, 2010
IP camera standards are a hot topic. Determining how, when and with whom these 'standards' will work are key questions. IQinVision was the first...

Related Reports on Low Light

Camera Course Winter 2017 on Jan 05, 2017
Learn video surveillance and get certified. IPVM provides live online classes, recorded videos, personal help, cutting edge education and...
Avigilon Pro 4K Camera Tested on Jan 03, 2017
Avigilon is best known for their large sensor, high megapixel cameras. But with new offerings from Sony and soon Axis, the questions is how well...
Surveillance Cameras 2017 Review on Jan 02, 2017
This report concisely explains the developments and most common options for surveillance cameras offered in 2017, including resolution, H.265, HD...
Calculating Video Surveillance Storage / Bandwidth on Dec 29, 2016
Calculating surveillance bandwidth is complex, and inexperienced users can easily underestimate bandwidth, leading to reduced storage durations...
Lux Rating / Minimum Illumination Guide 2017 on Dec 23, 2016
Lux ratings are one of the poorest specifications to use in selecting cameras. Now, with the rise of integrated IR, they are increasingly...
The PPF / PPM Video Surveillance Guide on Dec 23, 2016
Pixels per foot / Pixels per meter is the most fundamental and valuable, though imperfect, metric for specifying video surveillance image...
Surveillance Camera Imager Tutorial on Dec 23, 2016
Imagers - CCD, CMOS, 1/2", 1/4", big pixels, small pixels, etc. In this tutorial, we explain the fundamental issues and drivers in surveillance...
IR Video Surveillance Tutorial 2017 on Dec 21, 2016
Almost all surveillance cameras perform worse in low light than they do in the day time. One of the most common techniques to overcome this is to...
WDR Tutorial 2017 on Dec 20, 2016
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
HD Analog vs IP Guide 2017 on Dec 19, 2016
For years, HD resolution was IP camera's greatest advantage. However, starting in 2013, analog cameras with HD resolution started shipping and,...

Most Recent Industry Reports

Geovision Launches Direct Cloud Offering on Jan 18, 2017
Add cloud, subtract integrator. Geovision has launched myGVcloud, an offering that allows consumers to buy cameras and cloud services directly...
Anixter / Bosch Sells Direct to Amazon on Jan 18, 2017
Anixter regularly says they do not sell direct to end users or that they do not do it anymore. However, over the past year, Anixter has sold Bosch...
Smart Power Tools For Security Installs on Jan 18, 2017
Installing a smart camera? Perhaps you should use a 'smart' drill. The intelligent appliance / IoT trend has hit power tools. In this note, we...
Canon 250MP Prototype Targeted At Surveillance on Jan 17, 2017
At one point Axis declared the megapixel race was over, but now parent company Canon is showing an imager that would be a rocket ship in a...
Cut in Half, Everfocus Shifts Strategies on Jan 17, 2017
The race to the bottom impact continues. Now, Everfocus, who used to be one of the larger budget providers, is shifting strategies after years of...
Top ISC West 2017 Booth Trends on Jan 16, 2017
There are significant moves among many major manufacturers on the ISC West show floor, and very few prime spaces left unoccupied. In this report we...
Genetec Favorability Results on Jan 16, 2017
In the race to the bottom and flight to 'solutions', Genetec has taken a contrary path. The company remains independent, focusing up market,...
Free VMS Software Directory on Jan 13, 2017
Many Video Management Software (VMS) providers offer free versions, either open source, for a limited number of cameras or for a limited amount of...
Milestone Essential Subscription Removed on Jan 12, 2017
Subscriptions may be the future for Milestone and VMSes but not right now. Responding to negative feedback, Milestone has removed subscriptions...
Alarm Reporting Formats Overview on Jan 12, 2017
Alarm reporting formats are methods for communicating complicated information quickly, using plain old telephone service. It is still the main...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact