Optimized Camera Shootout - Upcoming and Released

Author: John Honovich, Published on May 16, 2011

The response to our camera shootout series has been phenomenal with more than 10,000 reads in the last month and growing.

The main question or concern raised is our use of camera setting defaults. A number of members raised the point that results could be better (potentially significantly) better if the settings were tweaked for the environment.

[UPDATE: The Optimized Camera Shootout results are released.]

On the one hand, we want tests to be fair and representative of common real world use. Starting with the defaults shows what every camera delivers 'out of the box'. On the other hand, some deployments and some cameras may provide better results with a change of settings specific for the environment.

To test such a scenario, we are launching an 'Optimized Camera Shootout' for our Parking Garage scene. Here's how it is going to work:

  • We will email technical representatives of each manufacturer included in the Parking Garage shootout. They can review the complete video clips from the original test. Each manufacturer can then submit what software or hardware settings they would recommend for that scene.
  • By May 26th, all manufacturers must respond with their recommendations.
  • On May 31st, we will re-do the Parking Garage scene using the recommended settings for each manufacturer.
  • On June 6th, we will release the 'Optimized Camera Shootout' results (1) demonstrating the differences between default and optimized settings for each manufacturer and (2) the relative performance of optimized settings across all manufacturers.

We are choosing the Parking Garage scene as the first 'optimization' test because the scene has significant lighting challenges that may respond well to optimization.

One important rule for this test is that the settings choosen cannot be changed during the course of the test. For instance, we will not adjust the aperture on a manual iris camera to adjust for day vs night conditions nor manually change exposure zones for different times of the day. All settings will be applied at the start of the test and will be used throughout. This is important to ensure that we are not 'gaming' the test. While such 'tricks' are common in sales demos, in the read world, settings are not changed manually during the day. Nor will it be in our tests.

Please let us know if you have any questions or feedback.

Comments : PRO Members only. Login. or Join.

Most Recent Industry Reports

Top ISC West 2017 Booth Trends on Jan 16, 2017
There are significant moves among many major manufacturers on the ISC West show floor, and very few prime spaces left unoccupied. In this report we...
Genetec Favorability Results on Jan 16, 2017
In the race to the bottom and flight to 'solutions', Genetec has taken a contrary path. The company remains independent, focusing up market,...
Free VMS Software Directory on Jan 13, 2017
Many Video Management Software (VMS) providers offer free versions, either open source, for a limited number of cameras or for a limited amount of...
Milestone Essential Subscription Removed on Jan 12, 2017
Subscriptions may be the future for Milestone and VMSes but not right now. Responding to negative feedback, Milestone has removed subscriptions...
Alarm Reporting Formats Overview on Jan 12, 2017
Alarm reporting formats are methods for communicating complicated information quickly, using plain old telephone service. It is still the main...
Amazon Sales of Hikvision China Cameras on Jan 12, 2017
Hikvision has become widely available in the US, including on popular retail outlets like Amazon, with over 2,600 results: 4MP Hikvision outdoor...
Last Day IP Networking Course January 2017 on Jan 12, 2017
This is the only networking course designed specifically for video surveillance professionals plus it includes live training, personal help and...
ONVIF Favorability Results on Jan 11, 2017
ONVIF has been one of the most debated aspects of the video surveillance industry. On the one hand, its aim to increase interoperability has been...
Honeywell Ademco Vista Intrusion System Tested on Jan 11, 2017
One of the biggest brands in security holds one of the most common intrusion lines. We bought and tested a Honeywell Vista 15P intrusion...
ADI Battles Manufacturer Partners on Jan 11, 2017
ADI is battling their manufacturer partners, building up their own competitive house brand W-Box, while manufacturers still fund ADI's business...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact