Lens Selection Standards for Camera Testing

Author: John Honovich, Published on May 15, 2011

With surveillance cameras, deciding what lenses to use for testing can be a difficult decision. We see two basic yet fundamentally opposing approaches:

  • Use the same lens on every camera tested: This approach ensures that no camera has an unfair lens advantage, allowing the test to focus on the camera's own performance.
  • Use the manufacturer recommended lens for each camera: This approach ensures that each camera uses the typical production lens, allowing the test to show real world use.

We use and recommend the second approach - testing with the manufacturer recommended lens for each camera. Here's why:

  • Many cameras have integrated lens: most domes, cube and bullet cameras as well as box cameras with built in optical zoom. For cameras with integrated lenses, it is simply impossible to use the same lens on every camera.
  • Many box cameras that allow for interchangeable lenses ship with a standard lens (e.g., Axis, Sony, IQ, IndigoVision, Mobotix, etc.). These manufacturers treat lenses as a core component of their camera system. If we used a different lens, this would be unrepresentative of the experience (good or bad) of regular users.
  • Even manufacturers that do not ship box cameras with lenses (e.g., Arecont Vision, Pelco Sarix), generally have recommended lenses that they sell and that many, if not most, of their users choose. In this scenario, we use the lens that the manufacturer recommend / sells.
  • If we did use the same lens on every camera (for cameras where this is possible), criticism would still exist as industry people would differ on the quality of the 'standard' lens chosen in our test (e.g. we used Lens Brand X but they prefer Lens Brand Y).

Our philosophy is to mirror real world use as closely as possible. To that end, using lens provided and/or recommended by the manufacturer is the best way to do this.

Indeed, it would actually be easier and cheaper to simply buy 10 lenses of the same brand/model and use them for every test. However, we are confident that this would result in increased criticism and concerns over the validity of the tests.

Given the differing approaches of manufacturers for lens provision, we do not think it is possible to reconcile or appease proponents of both approaches. On balance, we believe using the manufacturer recommended lens is the best approach for providing realistic comparisons.

1 report cite this report:

IPVM Seminar Poll Results on Sep 24, 2011
At our first ever IPVM seminar, we held a number of real time polls asking attendees what they thought on a variety of important surveillance...
Comments : PRO Members only. Login. or Join.

Related Reports

2Gig Intrusion Megatest (GC2 & GC3 Panels Tested) on Mar 28, 2017
2Gig is one of the most widely used intrusion systems, with two product lines that are the main offering of many alarm companies, huge national...
Hikvision PanoVu Multi Imager Tested on Feb 08, 2017
Hikvision has entered the multi-imager market with their 180° PanoVu DS-2CD6986F-H, an 8MP, 4-imager model equipped with ~1/1.8" imagers and...
ONVIF Favorability Results on Jan 11, 2017
ONVIF has been one of the most debated aspects of the video surveillance industry. On the one hand, its aim to increase interoperability has been...
Introduction To Burglar Alarm Systems on Jan 04, 2017
While alarm systems are popular, balancing between the right level of protection, the appropriate components and an acceptable price can be very...
Avigilon Pro 4K Camera Tested on Jan 03, 2017
Avigilon is best known for their large sensor, high megapixel cameras. But with new offerings from Sony and soon Axis, the questions is how well...
ONVIF Tutorial 2017 on Dec 19, 2016
ONVIF is well known within the surveillance industry as an interface to connect IP cameras and VMS systems but: Is ONVIF a 'Standard'? Why...
Lens Iris Tutorial on Dec 19, 2016
Cameras, like humans, have irises. However, cameras have five types of iris options - fixed, manual, auto, P iris. In this tutorial, we explain the...
API / SDK Tutorial on Dec 18, 2016
While Application Programming Interfaces (APIs) are key to 'open' platforms, they are frequently misunderstood and over-hyped in physical security....
F-Stop Tutorial on Dec 16, 2016
To understand low light surveillance, appreciating the importance and role of the f-stop metric is critical. In this tutorial, we explain: Why...
No One Should Ever Use Simplisafe on Dec 12, 2016
Simplisafe, the upstart DIY intrusion alarm system, is increasingly Public Enemy Number One in the alarm business. Recently, Security Sales ran an...

Most Recent Industry Reports

IP Networking Course May 2017 on Apr 26, 2017
NOTE: Registration ends tomorrow, Thursday the 27th. This is the only networking course designed specifically for video surveillance professionals...
Tri-Ed Favorability Results on Apr 25, 2017
Tri-Ed, owned by Anixter, far outranked Anixter, the lowest ranked company in our distributor favorability series. Still, Anixter's ownership did...
Chinese 'Attacking Us From Every Direction', Says US FBI on Apr 25, 2017
"Chinese eating our lunch. Attacking us from every direction" said the US FBI's Deputy Director Andrew McCabe at the ASIS 2017 CSO Summit. .@FBI...
Eagle Eye Exec On Mountain Of Servers - VSaaS Growth Analysis on Apr 25, 2017
Eagle Eye VP of Operations, Hans Kahler, posted a picture of himself sitting on top of a shipment of new servers, as a testament to the companies...
Axis Posts Strong Q1 2017 Financial Results on Apr 24, 2017
Axis posted strong numbers for Q1 2017, after having some challenges in 2016 (Q1 2016, Q3 2016). Inventory levels and overall spending show...
Axis Lowest Cost Outdoor IR Camera M2025-LE Tested on Apr 24, 2017
Axis has lagged offering low cost IR cameras while their Asian competitors have made IR standard even in their most entry level cameras. Recently,...
IPVM First Dean's List W2017 - Thomas Atkinson, Matt Hurly and Fredrik Lundqvist on Apr 24, 2017
IPVM is happy to congratulate and celebrate our first "Dean's List", the top students in our courses. For the Winter 2017 IP Networking course...
Splicing Alarm Circuits Guide on Apr 24, 2017
Alarm installers commonly connect multiple sensors to a single zone. They do this by splicing the wires together. In this report, we will explain...
PureTech Video Analytics Examined on Apr 21, 2017
PureTech's analytics were chosen for a US border protection system (see related post), which the company claims no other analytics vendor was able...
US Border RVSS / Video Analytics System Examined on Apr 21, 2017
US Customs and Border Protection has been rolling out a video analytics-based detection system along the US/Mexico border, with detection ranges...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact