Lens Selection Standards for Camera Testing

By: John Honovich, Published on May 15, 2011

With surveillance cameras, deciding what lenses to use for testing can be a difficult decision. We see two basic yet fundamentally opposing approaches:

  • Use the same lens on every camera tested: This approach ensures that no camera has an unfair lens advantage, allowing the test to focus on the camera's own performance.
  • Use the manufacturer recommended lens for each camera: This approach ensures that each camera uses the typical production lens, allowing the test to show real world use.

We use and recommend the second approach - testing with the manufacturer recommended lens for each camera. Here's why:

  • Many cameras have integrated lens: most domes, cube and bullet cameras as well as box cameras with built in optical zoom. For cameras with integrated lenses, it is simply impossible to use the same lens on every camera.
  • Many box cameras that allow for interchangeable lenses ship with a standard lens (e.g., Axis, Sony, IQ, IndigoVision, Mobotix, etc.). These manufacturers treat lenses as a core component of their camera system. If we used a different lens, this would be unrepresentative of the experience (good or bad) of regular users.
  • Even manufacturers that do not ship box cameras with lenses (e.g., Arecont Vision, Pelco Sarix), generally have recommended lenses that they sell and that many, if not most, of their users choose. In this scenario, we use the lens that the manufacturer recommend / sells.
  • If we did use the same lens on every camera (for cameras where this is possible), criticism would still exist as industry people would differ on the quality of the 'standard' lens chosen in our test (e.g. we used Lens Brand X but they prefer Lens Brand Y).

Our philosophy is to mirror real world use as closely as possible. To that end, using lens provided and/or recommended by the manufacturer is the best way to do this.

Indeed, it would actually be easier and cheaper to simply buy 10 lenses of the same brand/model and use them for every test. However, we are confident that this would result in increased criticism and concerns over the validity of the tests.

Given the differing approaches of manufacturers for lens provision, we do not think it is possible to reconcile or appease proponents of both approaches. On balance, we believe using the manufacturer recommended lens is the best approach for providing realistic comparisons.

1 report cite this report:

IPVM Seminar Poll Results on Sep 24, 2011
At our first ever IPVM seminar, we held a number of real time polls asking attendees what they thought on a variety of important surveillance...
Comments : PRO Members only. Login. or Join.

Related Reports

Open Access Controller Guide (Axis, HID, Isonas, Mercury) on Sep 19, 2019
In the access control market, there are many software platforms, but only a few companies that make non-proprietary door controllers. Recently,...
Lens Iris Tutorial on Aug 08, 2019
Cameras, like humans, have irises, controlling the light which hits the imager and impacting image details. However, cameras have multiple types of...
Honeywell Speaks On NDAA Ban, New Non-Banned Cameras and Cybersecurity on Aug 06, 2019
For years, Honeywell has depended on Dahua, a company with a poor cybersecurity track record and now banned by the US NDAA, for the development and...
HD Analog vs IP Guide on Jul 16, 2019
For years, HD resolution and single cable signal/power were IP camera advantages, with analog cameras limited to much lower resolution and...
Lens Focal Length Tutorial on Jul 10, 2019
3mm, 6mm, 2.8 - 9mm, 5 - 50mm, etc. Camera specifications often list lens lengths but what do they mean? These metrics are important in...
Poor OSDP Usage Statistics 2019 on Jul 09, 2019
OSDP certainly offers advantages over decades-old Wiegand (see our OSDP Access Control Guide) but new IPVM statistics show that usage of OSDP, even...
Maglocks Usage Statistics 2019 on Jul 01, 2019
Maglocks divide access control specifiers perhaps more than any other component. Many are concerned about life safety codes, but others cite...
Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager camerasĀ are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
China PRC Government New National Video Surveillance Standards on May 14, 2019
The People's Republic of China (PRC) government has released a new set of overarching standards for authorities to follow when they install video...

Most Recent Industry Reports

ONVIF Suspends Huawei on Sep 20, 2019
Huawei has been 'suspended', and effectively expelled, from ONVIF so long as US sanctions remain on the mega Chinese manufacturer. Inside this...
Open Access Controller Guide (Axis, HID, Isonas, Mercury) on Sep 19, 2019
In the access control market, there are many software platforms, but only a few companies that make non-proprietary door controllers. Recently,...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Uniview Prime Series 4K Camera Tested on Sep 18, 2019
Is the new Uniview 'Prime' better than the more expensive existing Uniview 'Pro'? In August, IPVM tested Uniview 4K 'Pro' but members advocated...
US Army Base To Buy Banned Honeywell Surveillance on Sep 17, 2019
The U.S. Army's Fort Gordon, home to their Cyber Center of Excellence, has issued a solicitation to purchase Honeywell products that are US...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Schmode is Back, Aims To Turn Boulder AI Into Giant on Sep 16, 2019
One of the most influential and controversial executives in the past decade is back. Bryan Schmode ascended and drove the hypergrowth of Avigilon...
Manufacturers Unhappy With Weak ASIS GSX 2019 And 2020 Shift on Sep 16, 2019
Manufacturers were generally unhappy with ASIS GSX, both for weak 2019 booth traffic and a scheduling shift for the 2020 show, according to a new...