Optimized Camera Shootout - Upcoming and Released

Author: John Honovich, Published on May 16, 2011

The response to our camera shootout series has been phenomenal with more than 10,000 reads in the last month and growing.

The main question or concern raised is our use of camera setting defaults. A number of members raised the point that results could be better (potentially significantly) better if the settings were tweaked for the environment.

[UPDATE: The Optimized Camera Shootout results are released.]

On the one hand, we want tests to be fair and representative of common real world use. Starting with the defaults shows what every camera delivers 'out of the box'. On the other hand, some deployments and some cameras may provide better results with a change of settings specific for the environment.

To test such a scenario, we are launching an 'Optimized Camera Shootout' for our Parking Garage scene. Here's how it is going to work:

  • We will email technical representatives of each manufacturer included in the Parking Garage shootout. They can review the complete video clips from the original test. Each manufacturer can then submit what software or hardware settings they would recommend for that scene.
  • By May 26th, all manufacturers must respond with their recommendations.
  • On May 31st, we will re-do the Parking Garage scene using the recommended settings for each manufacturer.
  • On June 6th, we will release the 'Optimized Camera Shootout' results (1)  demonstrating the differences between default and optimized settings for each manufacturer and (2) the relative performance of optimized settings across all manufacturers.

We are choosing the Parking Garage scene as the first 'optimization' test because the scene has significant lighting challenges that may respond well to optimization.

One important rule for this test is that the settings choosen cannot be changed during the course of the test. For instance, we will not adjust the aperture on a manual iris camera to adjust for day vs night conditions nor manually change exposure zones for different times of the day. All settings will be applied at the start of the test and will be used throughout. This is important to ensure that we are not 'gaming' the test. While such 'tricks' are common in sales demos, in the read world, settings are not changed manually during the day. Nor will it be in our tests.

Please let us know if you have any questions or feedback.

Comments : PRO Members only. Login. or Join.

Most Recent Industry Reports

Security Robots Are Just Entertainment on Jul 21, 2017
Great entertainment, no real security value.  That is the happy (or sad) state of security robots in 2017. Knightscope robot's drowning, the...
Wireless Burglar Alarm Sensors Guide on Jul 21, 2017
Wireless sensors for burglar alarm sensors are an increasingly common option for the historical labor intensive wired alarm systems. However,...
Competing Against ADT on Jul 20, 2017
ADT is one of the biggest players in the security industry, with ~$4 billion revenue. In 2017, they were acquired / merged with Protection...
Hikvision Launching Deep Learning Recorders on Jul 20, 2017
Hikvision has become a common choice for super low cost NVRs. Now, Hikvision is aiming to move up market, with deep learning NVRs that claim far...
PR Campaign Exploiting Manufacturer Cybersecurity on Jul 20, 2017
Manufacturers increasingly have a bulls-eye on their back. As cyber security solutions providers grow, they realize a great way to get publicity...
Axis Door Station Tested (A8105-E) on Jul 19, 2017
Axis continues their push into niche markets, especially audio, with network speakers, an IP horn, and video door stations. We bought and tested...
Manufacturer Favorability Guide on Jul 19, 2017
This 120 page PDF guide may be downloaded inside by all IPVM members. It includes our 20 manufacturer favorability rankings and 20 manufacturer...
$8 Billion Utility Georgia Power Enters Surveillance Business Offering Avigilon And Genetec on Jul 19, 2017
Utilities are typically considered major customers of surveillance integrators but one utility, Georgia Power, with $8+ billion in annual revenue...
Knightscope Laughs off Robot Drowning on Jul 18, 2017
A day after a Knightscope robot drowned, Knightscope has issued an 'official statement' making fun of the issue: The implied message is that...
Microsoft Video AI Cloud Services Examined on Jul 18, 2017
Microsoft has released one of the most amazing video analytics marketing videos ever. In it, they detect oil spills, track individual people giving...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact