Lens Selection Standards for Camera Testing

By: John Honovich, Published on May 15, 2011

With surveillance cameras, deciding what lenses to use for testing can be a difficult decision. We see two basic yet fundamentally opposing approaches:

  • Use the same lens on every camera tested: This approach ensures that no camera has an unfair lens advantage, allowing the test to focus on the camera's own performance.
  • Use the manufacturer recommended lens for each camera: This approach ensures that each camera uses the typical production lens, allowing the test to show real world use.

We use and recommend the second approach - testing with the manufacturer recommended lens for each camera. Here's why:

  • Many cameras have integrated lens: most domes, cube and bullet cameras as well as box cameras with built in optical zoom. For cameras with integrated lenses, it is simply impossible to use the same lens on every camera.
  • Many box cameras that allow for interchangeable lenses ship with a standard lens (e.g., Axis, Sony, IQ, IndigoVision, Mobotix, etc.). These manufacturers treat lenses as a core component of their camera system. If we used a different lens, this would be unrepresentative of the experience (good or bad) of regular users.
  • Even manufacturers that do not ship box cameras with lenses (e.g., Arecont Vision, Pelco Sarix), generally have recommended lenses that they sell and that many, if not most, of their users choose. In this scenario, we use the lens that the manufacturer recommend / sells.
  • If we did use the same lens on every camera (for cameras where this is possible), criticism would still exist as industry people would differ on the quality of the 'standard' lens chosen in our test (e.g. we used Lens Brand X but they prefer Lens Brand Y).

Our philosophy is to mirror real world use as closely as possible. To that end, using lens provided and/or recommended by the manufacturer is the best way to do this.

Indeed, it would actually be easier and cheaper to simply buy 10 lenses of the same brand/model and use them for every test. However, we are confident that this would result in increased criticism and concerns over the validity of the tests.

Given the differing approaches of manufacturers for lens provision, we do not think it is possible to reconcile or appease proponents of both approaches. On balance, we believe using the manufacturer recommended lens is the best approach for providing realistic comparisons.

1 report cite this report:

IPVM Seminar Poll Results on Sep 24, 2011
At our first ever IPVM seminar, we held a number of real time polls asking attendees what they thought on a variety of important surveillance...
Comments : PRO Members only. Login. or Join.

Related Reports

Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
China PRC Government New National Video Surveillance Standards on May 14, 2019
The People's Republic of China (PRC) government has released a new set of overarching standards for authorities to follow when they install video...
Access Control Request to Exit (RTE) Tutorial on May 13, 2019
For access controlled doors, especially those with maglocks, 'Request to Exit', or 'RTE' devices are required to override electrified locks to...
ADT's Top Dealer "The Defenders" Sued 20+ Times on May 07, 2019
ADT's largest authorized dealer, The Defenders, has been sued more than 20 times since 2012, IPVM has verified through analyzing legal...
Verkada Gets Half Billion Dollar Valuation on Apr 26, 2019
Last week, when we profiled Verkada (The Fastest Growing Video Surveillance Sales Organization Ever - Verkada), we predicted they would raise $40...
ONVIF Favorability Results 2019 on Mar 15, 2019
In the past decade, ONVIF has grown from a reaction to the outside Cisco-lead PSIA challenge, to being the de facto video surveillance standard...
Church Technology Director Security Interview on Mar 07, 2019
With 40+ years of experience in IT from a wide array of verticals, including US and foreign military, and large corporate and industrial settings,...
Cable Firestopping Installation Guide on Mar 06, 2019
Installing cables through firewalls is a critical installation issue. Failing to properly seal a penetration can cause smoke and fire to spread,...
Mobotix Move OEM Camera Line Tested on Feb 25, 2019
Mobotix has long been criticized for not offering integrated IR, mechanical cut filters, varifocal lenses, optical zoom and other features that...
Axis IR Multi Imager Camera Tested (P3717-PLE) on Feb 18, 2019
Axis has released their first IR multi imager, the P3717-PLE, a repositionable model listing 360° IR illumination and flexible positioning,...

Most Recent Industry Reports

NJ Law Requires Apprenticeship For Public Works Integrators on May 24, 2019
Few integrators do a formal apprenticeship program. However, now a NJ law is requiring any integrator on public works projects (such as state...
Security / Privacy Journalist Sam Pfeifle Interview on May 24, 2019
Sam Pfeifle is best known as the outspoken former Editor of Security Systems News. After that, he was publications director at the International...
Verkada Video Quality Problems Tested on May 23, 2019
Verkada suffers from numerous video quality problems, not found in commercial IP cameras, new IPVM testing of Verkada vs Axis and Hikvision...
Average Frame Rate Video Surveillance 2019 on May 23, 2019
What is the average frame rated used in video surveillance systems? In IPVM's 2011 statistics, the average was 6-8fps increasing to ~10fps in...
Access Control Job Walk Guide on May 22, 2019
Significant money can be saved and problems avoided with an access control job walk if you know what to look for and what to ask. By inviting...
ASCMA / Monitronics Declares Chapter 11 Bankruptcy Plan on May 22, 2019
Monitronics is entering into Chapter 11 bankruptcy. The company, also called Ascent Capital Group Inc., aka ASCMA, aka Brinks Home Security,...
US Considers Sanctions Against Hikvision and Dahua on May 22, 2019
The US government is considering blacklisting "up to 5" PRC surveillance firms, including Hikvision and Dahua, Bloomberg reported, with human...
Dahua USA Celebrates 5 Years of Errors on May 21, 2019
Dahua USA is, in their own words, 'celebrating' 5 years in North America or as trade magazine SSN declared: Dahua Technology finds success in...
Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact