Optimized Camera Shootout - Upcoming and Released

Author: John Honovich, Published on May 16, 2011

The response to our camera shootout series has been phenomenal with more than 10,000 reads in the last month and growing.

The main question or concern raised is our use of camera setting defaults. A number of members raised the point that results could be better (potentially significantly) better if the settings were tweaked for the environment.

[UPDATE: The Optimized Camera Shootout results are released.]

On the one hand, we want tests to be fair and representative of common real world use. Starting with the defaults shows what every camera delivers 'out of the box'. On the other hand, some deployments and some cameras may provide better results with a change of settings specific for the environment.

To test such a scenario, we are launching an 'Optimized Camera Shootout' for our Parking Garage scene. Here's how it is going to work:

  • We will email technical representatives of each manufacturer included in the Parking Garage shootout. They can review the complete video clips from the original test. Each manufacturer can then submit what software or hardware settings they would recommend for that scene.
  • By May 26th, all manufacturers must respond with their recommendations.
  • On May 31st, we will re-do the Parking Garage scene using the recommended settings for each manufacturer.
  • On June 6th, we will release the 'Optimized Camera Shootout' results (1)  demonstrating the differences between default and optimized settings for each manufacturer and (2) the relative performance of optimized settings across all manufacturers.

We are choosing the Parking Garage scene as the first 'optimization' test because the scene has significant lighting challenges that may respond well to optimization.

One important rule for this test is that the settings choosen cannot be changed during the course of the test. For instance, we will not adjust the aperture on a manual iris camera to adjust for day vs night conditions nor manually change exposure zones for different times of the day. All settings will be applied at the start of the test and will be used throughout. This is important to ensure that we are not 'gaming' the test. While such 'tricks' are common in sales demos, in the read world, settings are not changed manually during the day. Nor will it be in our tests.

Please let us know if you have any questions or feedback.

Comments : PRO Members only. Login. or Join.

Most Recent Industry Reports

Startup SafePass Profile on Oct 19, 2018
A major problem with visitor management is that the systems mostly require adhesive printed paper labels and paper logs, creating waste and an...
China Is Not A Security Megatrend, Says SIA on Oct 19, 2018
The US Security Industry Association has released its 10 "Security Megatrends" for 2019. SIA declares that these megatrends, such as "Advanced...
Hanwha Dual Imager Dome Camera Tested (PNM-7000VD) on Oct 18, 2018
Hanwha has introduced their first dual-imager model, the PNM-7000VD, a twin 1080p model featuring independently positionable sensors and a snap-in...
Camera Height / Blind Spot Added to IPVM Camera Calculator on Oct 18, 2018
IPVM has added camera height and blind spot estimation to the Camera Calculator. This is especially helpful for those who need to mount cameras up...
Axis Strong US Growth, Flat EMEA - Q3 2018 Financials on Oct 18, 2018
This spring, Axis had its best financials in many years (see Axis Strong Q2 2018 Results). However, over the summer, Axis had many products sold...
Best Alternatives to Banned Dahua and Hikvision on Oct 17, 2018
With the US government ban and a growing number of users banning Dahua and Hikvision, one key question is what to use for low cost? While Dahua and...
Video Quality / Compression Tutorial on Oct 17, 2018
While CODECs, like H.264, H.265, and MJPEG, get a lot of attention, a camera's 'quality' or compression setting has a big impact on overall...
Knightscope Winning Investors, Struggling With Growth on Oct 16, 2018
While Knightscope's new financials show the company only winning 11 new customers in the past 12 months, the company continues to win new...
Integrator Laptop Guide on Oct 16, 2018
This 18-page guide provides guidance and statistics about integrator laptop use. 150 integrators explained to IPVM in detail about their laptops,...
Huawei Admits AI "Bubble" on Oct 16, 2018
A fascinating article from the Chinese government's Global Times: Huawei’s AI ambition to reshape industries. While the Global Times talks about...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact