Optimized Camera Shootout - Upcoming and Released

Author: John Honovich, Published on May 16, 2011

The response to our camera shootout series has been phenomenal with more than 10,000 reads in the last month and growing.

The main question or concern raised is our use of camera setting defaults. A number of members raised the point that results could be better (potentially significantly) better if the settings were tweaked for the environment.

[UPDATE: The Optimized Camera Shootout results are released.]

On the one hand, we want tests to be fair and representative of common real world use. Starting with the defaults shows what every camera delivers 'out of the box'. On the other hand, some deployments and some cameras may provide better results with a change of settings specific for the environment.

To test such a scenario, we are launching an 'Optimized Camera Shootout' for our Parking Garage scene. Here's how it is going to work:

  • We will email technical representatives of each manufacturer included in the Parking Garage shootout. They can review the complete video clips from the original test. Each manufacturer can then submit what software or hardware settings they would recommend for that scene.
  • By May 26th, all manufacturers must respond with their recommendations.
  • On May 31st, we will re-do the Parking Garage scene using the recommended settings for each manufacturer.
  • On June 6th, we will release the 'Optimized Camera Shootout' results (1)  demonstrating the differences between default and optimized settings for each manufacturer and (2) the relative performance of optimized settings across all manufacturers.

We are choosing the Parking Garage scene as the first 'optimization' test because the scene has significant lighting challenges that may respond well to optimization.

One important rule for this test is that the settings choosen cannot be changed during the course of the test. For instance, we will not adjust the aperture on a manual iris camera to adjust for day vs night conditions nor manually change exposure zones for different times of the day. All settings will be applied at the start of the test and will be used throughout. This is important to ensure that we are not 'gaming' the test. While such 'tricks' are common in sales demos, in the read world, settings are not changed manually during the day. Nor will it be in our tests.

Please let us know if you have any questions or feedback.

Comments : PRO Members only. Login. or Join.

Most Recent Industry Reports

SimpliSafe Violating California, Florida, and Texas Licensing Laws on Aug 14, 2018
IPVM has verified that DIY security system provider SimpliSafe, founded in 2006 and acquired in June of 2018 at a billion dollar valuation, is...
Cut Milestone Licensing Costs 80% By Using Hikvision and Dahua NVRs (Tested) on Aug 13, 2018
Enterprise VMS licensing can be quite expensive, with $200 or more per channel common, meaning a 100 camera system can cost $20,000 in VMS...
Nortek Sues SDS, Battle Over Unpaid Bill and Cancelled Lines on Aug 13, 2018
Nortek and SDS legal battle continues. As IPVM reported, SDS sued Nortek alleging bribery and antitrust violation. However, Wave fired back at SDS,...
Uniview Intrusion Analytics and VMD Tested on Aug 13, 2018
IPVM's IP Camera Analytics Shootout featuring Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision created some ill will with a Uniview distributor who...
ADT Employees Protest ADT CEO on Aug 10, 2018
So many ADT employees were so upset with ADT's CEO speech reported on by IPVM, that ADT's CEO was forced to send a mass email to employees to...
Axis / Avigilon Legal Battle Rises on Aug 09, 2018
In what is shaping up to be high-powered, will-not-back-down battle, Axis and Avigilon are squaring off in multiple legal contests. In 2017, IPVM...
Camera Focusing Tutorial on Aug 09, 2018
A camera's focus is fundamental to quality imaging. Mistakes can cause important problems. In this guide, we explain focus issues and proper...
Dahua Ban Response: NOT Chinese Government Owned on Aug 08, 2018
Dahua has responded to the US Congress passing a US government ban on Dahua and Hikvision's products. While Dahua offered the now standard...
Bad Move: ADT Markets Rival Amazon on Aug 08, 2018
Amazon may be lining up ADT as its next victim but ADT is happy to promote Amazon. Amazon has made major moves recently, including acquiring...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact