Normalize Exposure Settings for IP Camera Comparisons

Author: John Honovich, Published on Dec 22, 2009

We recommend all surveillance camera comparisons be performed with normalized exposure settings to ensure fairness and eliminate 'games'. Starting immediately, we will use 1/30th and 1/8th second exposure times as standard settings to test and compare cameras. This is especially critical in the assessment and measurement of low light performance.

Why This is Important

In testing a wide range of cameras, it has become clear that manufacturers select a wide range of default maximum exposure settings. While there are valid uses for different settings, those manufacturers who choose longer defaults for maximum exposure settings are viewed unfairly as having superior low light performance. For background on this issue/trick, review our testing and analysis of exposure's impact on low light video quality.

Maximum exposure settings can have a dramatic impact on 'visible' image quality because changing it from 1/30th to 1/8th or 1/2th can increase light captured by 400% to 1500% - a dramatic difference that overshadows practically any other setting.

Comparing still images from one camera with 1/30th s exposure to a 1/2 s exposure will always be unfair and almost always lead to the 1/2 s exposure camera being viewed as better (because manufacturers will show still objects hiding the problem of motion blur).

Here's a clear visual on image tradeoffs from varying exposure settings that you would almost never see from a manufacturer:

Why 1/30th and 1/8th Second Exposure Settings?

1/30th second exposure matches the maximum frame rate and is a commonly used setting by manufacturers. It's also generally the shortest maximum exposure setting we find in IP cameras that we are testing.

1/8th second exposure provides a significantly longer exposure increasing both the 'brightness' of a dark scene and the risk of motion blur. We think 1/8th is a good intermediate point - much lower and motion blur is guaranteed to be strong.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Limitations

Not all cameras allow for direct setting of their maximum exposure time. Some only allow indirect qualitative settings.

Other cameras offer special modes for very long exposures - 1/2s or even 1s exposures.

We will make note of either circumstance and provide additional, clearly marked tests of such modes.

Conclusion

We believe clarity on exposure settings and testing normalization will provide fairer testing that more accurately demonstrates real-world use and relative trade-offs.


2 reports cite this report:

Readers Respond: 134 Votes, 25 Comments Examined on Feb 14, 2010
Over 100 people voted and more than 25 left detailed comments to our recent question/discussion. In this post, we review and respond to the...
Testing IQinVision's 4 Series and PSIA Integration on Feb 02, 2010
IP camera standards are a hot topic. Determining how, when and with whom these 'standards' will work are key questions. IQinVision was the first...

Related Reports on Low Light

Axis 4MP Camera Tested (M3046-V) on Sep 28, 2016
Axis has brought 4MP to its camera line in the new M3046-V, the highest resolution model in their revamped M30 series. We bought and tested this...
History of Video Surveillance on Sep 22, 2016
This is a concise history of video surveillance covering the past decade.  The goal is to help professionals newer to the industry understand...
Camera Course September 2016 on Sep 15, 2016
This is the only independent surveillance camera course, based on in-depth product and technology testing. Lots of manufacturer training exists...
Hikvision 4K Camera Tested on Sep 09, 2016
Hikvision is the most common choice for low price entry level products but they are also competing with low light models, smart CODECs, WDR...
Pelco Optera 270° Camera Tested on Sep 06, 2016
Multi-imager cameras are typically 180° or 360°. Pelco has released a fixed 270° versions of their Optera intended to cover exterior building...
Panoramic Camera (Fisheye / Multi-Imager) Guide on Aug 31, 2016
Panoramic cameras, including fisheyes and multi-imagers, have become increasingly widespread, with most manufacturers offering fisheyes and an...
Dahua Smart H.264+ Tested on Aug 17, 2016
The smart codec trend continues, with Dahua adding Smart H.264+ to many of their models in new firmware. In this test we see how it performs and...
21 Scenes Lux Readings For Video Surveillance on Aug 11, 2016
IPVM went to numerous locations and measured the lux readings / light levels at each one. Here is an example of the approach we took and output...
Vivotek 12MP IR Multi-Imager Tested on Aug 09, 2016
A key weakness of multi-imager cameras is poor low light. While integrated IR has become dominant in cameras overall, it is still uncommon in...
Integrated IR Camera Use Dominates - 2016 Statistics on Aug 03, 2016
In 2014, IPVM statistics showed integrated IR camera use was surging. Now, new IPVM statistics show that the surge continues, with integrated IR...

Most Recent Industry Reports

Dahua USA CEO Tim Wang, Where Is Your Integrity? on Sep 29, 2016
Dahua USA CEO Tim Wang and Dahua Director of Marketing Tim Shen shared their IPVM passwords extensively, resulting in Dahua USA CEO's account...
Allegion NDE Wireless Lock Examined on Sep 29, 2016
While wireless locks are one of the hottest areas of access control, two of its biggest challenges are high cost and limited integration with...
The 'Last Chance to Save' On Hikvision Is Here on Sep 29, 2016
It is over. After at least 8 across the board price cuts in the past 10 months, including an unprecedented back to back 20% off, Hikvision has...
Camera Calculator Class and IPVM Member Orientation October 2016 on Sep 28, 2016
Members, learn how to better design video surveillance systems and get the most out of your IPVM memberships with 2 upcoming live classes. Both...
Axis 4MP Camera Tested (M3046-V) on Sep 28, 2016
Axis has brought 4MP to its camera line in the new M3046-V, the highest resolution model in their revamped M30 series. We bought and tested this...
Hiring Spree At Aimetis 6 Months After Being Acquired on Sep 28, 2016
Aimetis was acquired in April 2016, and is now expanding almost all of their departments, hiring employees from Axis and other industry...
Hikvision Chairman Tours With Chinese Government Boss on Sep 28, 2016
Two China Communist senior officials toured Europe this summer, one was Hikvision's Chairman and the other was his boss, SASAC Director. In this...
Camio Natural Language Processing Tested on Sep 27, 2016
The ex-Googler led team from Camio has advanced its video monitoring offering to include natural language processing. Camio ingests video,...
Access Door Controller Configuration Guide on Sep 27, 2016
Properly configuring access control door controllers is key to a professional system. These devices have fundamental settings that must be...
Hacked Dahua Cameras Drive Massive Cyber Attack on Sep 27, 2016
Cyber attacks are accelerating and IP cameras are behind many of them. Worse, last week, a 'massive' attack was carried out using numerous Dahua...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact