Lens Selection Standards for Camera Testing
With surveillance cameras, deciding what lenses to use for testing can be a difficult decision. We see two basic yet fundamentally opposing approaches:
- Use the same lens on every camera tested: This approach ensures that no camera has an unfair lens advantage, allowing the test to focus on the camera's own performance.
- Use the manufacturer recommended lens for each camera: This approach ensures that each camera uses the typical production lens, allowing the test to show real world use.
We use and recommend the second approach - testing with the manufacturer recommended lens for each camera. Here's why:
- Many cameras have integrated lens: most domes, cube and bullet cameras as well as box cameras with built in optical zoom. For cameras with integrated lenses, it is simply impossible to use the same lens on every camera.
- Many box cameras that allow for interchangeable lenses ship with a standard lens (e.g., Axis, Sony, IQ, IndigoVision, Mobotix, etc.). These manufacturers treat lenses as a core component of their camera system. If we used a different lens, this would be unrepresentative of the experience (good or bad) of regular users.
- Even manufacturers that do not ship box cameras with lenses (e.g., Arecont Vision, Pelco Sarix), generally have recommended lenses that they sell and that many, if not most, of their users choose. In this scenario, we use the lens that the manufacturer recommend / sells.
- If we did use the same lens on every camera (for cameras where this is possible), criticism would still exist as industry people would differ on the quality of the 'standard' lens chosen in our test (e.g. we used Lens Brand X but they prefer Lens Brand Y).
Our philosophy is to mirror real world use as closely as possible. To that end, using lens provided and/or recommended by the manufacturer is the best way to do this.
Indeed, it would actually be easier and cheaper to simply buy 10 lenses of the same brand/model and use them for every test. However, we are confident that this would result in increased criticism and concerns over the validity of the tests.
Given the differing approaches of manufacturers for lens provision, we do not think it is possible to reconcile or appease proponents of both approaches. On balance, we believe using the manufacturer recommended lens is the best approach for providing realistic comparisons.
Author: John Honovich, Published on May 16, 2011
Other Updates on IP Cameras
IPVM Camera Testing Procedures on May 09, 2013
The foundation of IPVM's camera testing procedure is simultaneous, head to head comparisons, like...
Focusing Panoramic Cameras on May 06, 2013
Focusing panoramic cameras is really important. Indeed, after testing 9 different panoramic camer...
Automatic Location Based Camera Control on Apr 25, 2013
This is a very neat idea; One that we have not seen any IP camera / VMS provider offer before. H...
The First Windows Based IP Camera - Genius or Crazy? on Mar 29, 2013
[Update: this product won 'Best in Show' and we have added the rationale based on our interview w...
H.265 / HEVC Codec Tutorial on Jan 25, 2013
It is quickly becoming the next big CODEC but: How big will it be? and When will it hit? For the ...
Panoramic Camera Guide on Jan 20, 2013
Panoramic cameras are increasingly popular but they can suffer from confusion between the many ty...
Lens Iris Tutorial on Jan 20, 2013
Cameras, like humans, have irises. However, cameras have four types of iris options - fixed, manu...
Infrared IR Surveillance Tutorial on Jan 13, 2013
Almost all surveillance cameras perform worse in low light than they do in the day time. One of t...
WDR Tutorial on Jan 04, 2013
WDR is one of the most important and highly differentiating capabilities of surveillance cameras,...
Field of View (FoV) Tutorial on Dec 27, 2012
Field of View, or FoV, is deceptively complex. At its most basic, it is simply what the camera ca...
Most Recent Industry Updates
Failed Manufacturer Enters Surveillance on May 20, 2013
Polaroid is one of the most spectacular failures of the century and has become, quite literally, ...
A Solid Proposal For a City on a Budget on May 17, 2013
It is far too common to find RFPs and proposals with missing details, inadequate equipment, and o...
Stop Saying 'It Depends on the Application' on May 16, 2013
"It depends on the application" has to be the worst saying in the industry. It conveys no inform...
Deadly Pushbuttons on May 16, 2013
A simple and common misunderstanding in specifying pushbuttons can kill people trying to escape b...
Vicon Steep Revenue Decline on May 16, 2013
We have been following Vicon's slow, downward spiral since 2009 and the company's struggles conti...
Special Webinar - Calculating Bandwidth / Storage on May 16, 2013
The most common technical request we hear from our members is how to properly calculate bandwidth...
Crappy Cameras Trigger City Surveillance Shutdown on May 15, 2013
An Australian city has shut off its surveillance system after being ordered to determine how to o...
MicroPower 2.0 Solar Wireless Surveillance on May 14, 2013
When we first looked at MicroPower's solar surveillance system in 2010, key limitations existed, ...
Bug Eye Camera Reviewed on May 14, 2013
In the past month, the so called 'bug eye' camera has captured popular attention around the world...
The New Manufacturer Input System on May 13, 2013
We are rolling out a new system that makes it easier to get input from manufacturers on new relea...