Normalize Exposure Settings for IP Camera Comparisons

Author: John Honovich, Published on Dec 22, 2009

We recommend all surveillance camera comparisons be performed with normalized exposure settings to ensure fairness and eliminate 'games'. Starting immediately, we will use 1/30th and 1/8th second exposure times as standard settings to test and compare cameras. This is especially critical in the assessment and measurement of low light performance.

Why This is Important

In testing a wide range of cameras, it has become clear that manufacturers select a wide range of default maximum exposure settings. While there are valid uses for different settings, those manufacturers who choose longer defaults for maximum exposure settings are viewed unfairly as having superior low light performance. For background on this issue/trick, review our testing and analysis of exposure's impact on low light video quality.

Maximum exposure settings can have a dramatic impact on 'visible' image quality because changing it from 1/30th to 1/8th or 1/2th can increase light captured by 400% to 1500% - a dramatic difference that overshadows practically any other setting.

Comparing still images from one camera with 1/30th s exposure to a 1/2 s exposure will always be unfair and almost always lead to the 1/2 s exposure camera being viewed as better (because manufacturers will show still objects hiding the problem of motion blur).

Here's a clear visual on image tradeoffs from varying exposure settings that you would almost never see from a manufacturer:

Why 1/30th and 1/8th Second Exposure Settings?

1/30th second exposure matches the maximum frame rate and is a commonly used setting by manufacturers. It's also generally the shortest maximum exposure setting we find in IP cameras that we are testing.

1/8th second exposure provides a significantly longer exposure increasing both the 'brightness' of a dark scene and the risk of motion blur. We think 1/8th is a good intermediate point - much lower and motion blur is guaranteed to be strong.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Limitations

Not all cameras allow for direct setting of their maximum exposure time. Some only allow indirect qualitative settings.

Other cameras offer special modes for very long exposures - 1/2s or even 1s exposures.

We will make note of either circumstance and provide additional, clearly marked tests of such modes.

Conclusion

We believe clarity on exposure settings and testing normalization will provide fairer testing that more accurately demonstrates real-world use and relative trade-offs.


2 reports cite this report:

Readers Respond: 134 Votes, 25 Comments Examined on Feb 14, 2010
Over 100 people voted and more than 25 left detailed comments to our recent question/discussion. In this post, we review and respond to the...
Testing IQinVision's 4 Series and PSIA Integration on Feb 02, 2010
IP camera standards are a hot topic. Determining how, when and with whom these 'standards' will work are key questions. IQinVision was the first...

Related Reports on Low Light

Uniview (UNV) IP Cameras Tested on Feb 22, 2017
"We're #3," in China says Uniview (UNV). While the company significantly trails Hikvision and Dahua in total sales, one notable difference is that...
Arecont Vision MicroDome Duo Tested on Feb 14, 2017
Arecont Vision is back with another multi-head camera, this time thinking smaller with the MicroDome Duo, a two-imager model, with the tagline...
Hikvision PanoVu Multi Imager Tested on Feb 08, 2017
Hikvision has entered the multi-imager market with their 180° PanoVu DS-2CD6986F-H, an 8MP, 4-imager model equipped with ~1/1.8" imagers and...
Axis 15MP Multi-Imager Tested (Q3708-PVE) on Feb 07, 2017
Axis continues to expand in the multi imager market, adding to a segment started with the 33MP Q3709. We bought the Q3708-PVE and tested it...
Sony Favorability Results on Feb 06, 2017
Sony is one of the largest brands in the world and a long term provider of both video surveillance imagers and cameras. But, like all incumbents,...
LAST DAY - Camera Course Winter 2017 on Feb 02, 2017
[NOTE: Today, Thursday is the last day to register.] Learn video surveillance and get certified. IPVM provides live online classes, recorded...
Invisible IR Camera Tested (Vivotek) on Jan 30, 2017
Integrated IR is everywhere in surveillance, from high-end long range cameras to even the lowest cost models. But this IR usually comes with a...
Panasonic Extreme H.265 Cameras Tested on Jan 26, 2017
Panasonic has released their latest generation, the i-Pro Extreme series, with enhanced compression (smart H.265) enhanced WDR and secure...
Avigilon Pro 4K Camera Tested on Jan 03, 2017
Avigilon is best known for their large sensor, high megapixel cameras. But with new offerings from Sony and soon Axis, the questions is how well...
Surveillance Cameras 2017 Review on Jan 02, 2017
This report concisely explains the developments and most common options for surveillance cameras offered in 2017, including resolution, H.265, HD...

Most Recent Industry Reports

Artificial Intelligence Robot Assistant (ACTi) on Feb 23, 2017
Has artificial intelligence come to the video surveillance industry? ACTi has released 'SARA' which it bills as an 'AI assistant that brings...
Cutting Costs 70% Using Milestone With HD Analog on Feb 23, 2017
HD analog and enterprise VMSes are often thought of as being on opposite sides of the spectrum, with HD analog best for small jobs due to its low...
Dahua 4K HD Analog Cameras Announced on Feb 23, 2017
HD analog has been gaining popularity (even if Axis hopes otherwise). Last year, HD analog's max resolution doubled from 1080p to 4MP (see our 4MP...
Uniview (UNV) IP Cameras Tested on Feb 22, 2017
"We're #3," in China says Uniview (UNV). While the company significantly trails Hikvision and Dahua in total sales, one notable difference is that...
Glass Doors and Access Control Tutorial on Feb 22, 2017
The biggest challenge for many access control systems are glass doors. Here's what happens when a maglock is improperly installed to an existing...
Exacq Favorability Results on Feb 22, 2017
For years, Exacq has been one of the most frequently favored VMSes in IPVM integrator statistics (e.g., see Favorite VMS Manufacturers...
The Hot RMR Company - Electric Guard Dog on Feb 22, 2017
The financiers at the Barnes Buchanan conference praised a company named 'Electric Guard Dog'. While the name sounds fairly low tech, the money and...
Hikvision Leads Multi-Manufacturer Sales Promo on Feb 21, 2017
Earlier this month, Hikvision launched new 'super value' kits, with 40% discounts, and now Hikvision is offering another promo, but this time they...
Washington DC MPD's Surveillance Equipment on Feb 21, 2017
The Washington DC Metropolitan Police Department's surveillance system was hacked in January 2017. Two immediate questions were: Whose...
Hikvision Ezviz Mini 360 Plus - $80 Autotracking Camera Tested on Feb 21, 2017
Autotracking, integrated IR, local storage, full HD, cloud access: $80. That is the claim of Hikvision EZVIZ's new Mini 360 Plus. But for this...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact