Normalize Exposure Settings for IP Camera Comparisons

Author: John Honovich, Published on Dec 22, 2009

We recommend all surveillance camera comparisons be performed with normalized exposure settings to ensure fairness and eliminate 'games'. Starting immediately, we will use 1/30th and 1/8th second exposure times as standard settings to test and compare cameras. This is especially critical in the assessment and measurement of low light performance.

Why This is Important

In testing a wide range of cameras, it has become clear that manufacturers select a wide range of default maximum exposure settings. While there are valid uses for different settings, those manufacturers who choose longer defaults for maximum exposure settings are viewed unfairly as having superior low light performance. For background on this issue/trick, review our testing and analysis of exposure's impact on low light video quality.

Maximum exposure settings can have a dramatic impact on 'visible' image quality because changing it from 1/30th to 1/8th or 1/2th can increase light captured by 400% to 1500% - a dramatic difference that overshadows practically any other setting.

Comparing still images from one camera with 1/30th s exposure to a 1/2 s exposure will always be unfair and almost always lead to the 1/2 s exposure camera being viewed as better (because manufacturers will show still objects hiding the problem of motion blur).

Here's a clear visual on image tradeoffs from varying exposure settings that you would almost never see from a manufacturer:

Why 1/30th and 1/8th Second Exposure Settings?

1/30th second exposure matches the maximum frame rate and is a commonly used setting by manufacturers. It's also generally the shortest maximum exposure setting we find in IP cameras that we are testing.

1/8th second exposure provides a significantly longer exposure increasing both the 'brightness' of a dark scene and the risk of motion blur. We think 1/8th is a good intermediate point - much lower and motion blur is guaranteed to be strong.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Limitations

Not all cameras allow for direct setting of their maximum exposure time. Some only allow indirect qualitative settings.

Other cameras offer special modes for very long exposures - 1/2s or even 1s exposures.

We will make note of either circumstance and provide additional, clearly marked tests of such modes.

Conclusion

We believe clarity on exposure settings and testing normalization will provide fairer testing that more accurately demonstrates real-world use and relative trade-offs.


2 reports cite this report:

Readers Respond: 134 Votes, 25 Comments Examined on Feb 14, 2010
Over 100 people voted and more than 25 left detailed comments to our recent question/discussion. In this post, we review and respond to the...
Testing IQinVision's 4 Series and PSIA Integration on Feb 02, 2010
IP camera standards are a hot topic. Determining how, when and with whom these 'standards' will work are key questions. IQinVision was the first...

Related Reports on Low Light

Last Chance February 2018 Camera Course on Feb 15, 2018
This is the last chance to get into the Winter camera course, starts next Tuesday. Register now. IPVM provides the best education, live online...
Hanwha Wisenet X 5MP Camera Tested (XNV-8080R) on Feb 13, 2018
Wisenet X is Hanwha's high-end camera line. We tested their Wisenet X 1080p camera last year. Now Hanwha is offering 5MP cameras listing super low...
Axis 'Best' Q3517-LVE 5MP Camera Tested on Feb 05, 2018
Axis boasts of its Q3517-LVE: Simply put, AXIS Q3517-LVE delivers the best video quality possible. But is it really the 'best'? We bought...
Dahua 5MP Starlight Camera Tested (N52BM3Z) on Jan 30, 2018
Is 5MP the new 1080p? According to our recent statistics, average resolution continues to trend upwards. And now, manufacturers releasing new...
Resolution Usage Statistics 2018 - Moving Up From 1080p on Jan 22, 2018
In 2016, IPVM statistics showed the most common camera resolution used was 1080p, rising from 2014's 720p. Now, new IPVM statistics of 200+...
Hanwha ExtraLux Camera Tested on Jan 11, 2018
Hanwha has released the latest in their Wisenet X line, the "extraLUX" series, claiming to "capture crystal clear, true-color images in low-light...
Canon Launches World's Most Expensive IP Camera (ME20F-SHN) on Jan 09, 2018
Canon has launched the ME20F-SHN , likely the world's most expensive single imager, non-thermal, IP camera at ~$20,000. And Canon subsidiary...
Hikvision IR Bullet Camera Shootout on Jan 08, 2018
Hikvision's widely used Value Plus line claims 30m/~98' IR illumination range, on multiple lens options ranging from wide angle (100°+) to...
Resolution Tutorial on Dec 28, 2017
Understanding video surveillance resolution can be surprisingly difficult and complex. While the word 'resolution' seems self-explanatory, its use...
Repositionable Multi-Imager Camera Guide on Dec 22, 2017
Multi-imager usage has been growing strongly over the past few years. Now, a new segment of multi-imagers has taken off, with many manufacturers...

Most Recent Industry Reports

Why 3VR Failed on Feb 16, 2018
3VR destroyed transformed ~$65 million in VC funding into a $6.9 million exit. The reason they failed is simple. They bet on analytics. They...
"Fear Mongering": Hikvision USA Cybersecurity Director Dismisses Chinese Government Ownership Concerns on Feb 16, 2018
The facts are: The Chinese government created Hikvision and is Hikvision's controlling shareholder. Hikvision's Chairman, a Communist Party...
16:9 vs 4:3 Video Aspect Ratio Statistics on Feb 16, 2018
What aspect ratio do security integrators prefer? The 'standard' 4:3 or the 'wide' 16:9 one? 100+ integrators told us what they preferred, with...
Mercury Releases New Series 3 Redboard Access Panels on Feb 15, 2018
Mercury Security has their first major product release post-HID buyout, and things literally look different. The Series 3 SIO boards now are red...
Last Chance February 2018 Camera Course on Feb 15, 2018
This is the last chance to get into the Winter camera course, starts next Tuesday. Register now. IPVM provides the best education, live online...
Hikvision DeepInMind Tested Terribly on Feb 15, 2018
While Hikvision is heavily marketing deep learning and 'AI' as their next big thing, new IPVM test results of their DeepInMind NVR shows their deep...
Genetec CEO: You Cannot Buy Trust on Feb 14, 2018
Genetec's CEO, Pierre Racz, delivered a direct message at their channel partner conference: Racz has become a focal point in the industry debate...
Assa's Lowest Power Draw Maglock: Securitron M680E Examined on Feb 14, 2018
Securitron produces some of the most extreme maglocks on the market, including massively strong maglocks and even ones with integrated CCTV cams...
Hanwha Wisenet X 5MP Camera Tested (XNV-8080R) on Feb 13, 2018
Wisenet X is Hanwha's high-end camera line. We tested their Wisenet X 1080p camera last year. Now Hanwha is offering 5MP cameras listing super low...
Top Problems For Integrator Project Management on Feb 13, 2018
Security projects routinely encounter issues that jeopardize deadlines, create confusion, and shrink profits. Unfortunately, there are common...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact