HD Lens Shootout

By: Benros Emata, Published on Oct 02, 2011

Conventional wisdom says that lenses make a big difference in image quality but the question remains: "How much of a difference?" With the shift to megapixel cameras increasing demands for higher quality lenses, this question has gained even greater importance.

We wanted to better understand quality differences by doing our own series of shootouts. This is our first report in that series.

Lens Shootout Approach

The most common lens type used with megapixel cameras are varifocal lenses with a relatively wide field of view (e.g., 3 - 8 mm). This is the normal stock or default lens provided with most megapixel cameras today.

We wanted to start with this type, selecting 5 of the more common lens manufacturers. This test include lenses from:

  • Computar
  • Evetar
  • Fujinon
  • Tamron
  • Tuss

We then used these lenses with three commonly used IP cameras:

  • Axis P1344
  • Panasonic WV-SP306
  • Sony CH140

We conducted tests in 3 different scenes:

  • Indoor office for a medium size area
  • Enclosed parking structure for a larger area
  • Indoor darkroom for night time testing

Since lens focusing is a key issue in optimizing cameras, we used the auto back focus features available in all 3 cameras to provide a standardized way to focus all lenses.

Preview

Below is a preview of one of the scenes that shows variations in performance achieved.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Inside the Pro section, we dig into the key differences and how the lens performance compared.

Future Tests

Here are the key findings:

  • Among MP lenses, differences in quality/detail levels more apparent in wider FoVs
  • Loss of detail at fringe more evident at wider FoVs (e.g. ~35ft HFoV)
  • The SD lens on a MP camera produced somewhat worse image quality, more pronounced at wider FoVs
  • The practical differences between worst and best MP lens tended to be modest
  • Fujinon and Tamron lenses tended to outperform other MP lenses throughout test scenarios
  • However, Fujinon and Tamron were not the best in every test but was at least average in all and the best in many
  • Fujinon lens exhibited the least image quality degradation at fringe
  • Evetar performed the poorest especially at night

In light of these findings the following is recommended:

  • Avoid SD lenses with MP cameras. This should be obvious but the tests results do bear out diminished performance (as to be expected).
  • The Fujinon might be preferable if you want to maximize performance. However, differences likely will not be huge.
  • The only lens that really concerns us is the Evetar one. While it is by far the lowest cost, the negative tradeoff in performance is clear. Evetar is increasingly popular with camera manufacturers and the biggest challenge is that you may not know that you are getting such a lens because the manufacturer may remove the original manufacturer's label.
  • Do not presume that all Fujinon and Tamron lenses are better. While both manufacturers do have good overall reputations, we have only tested one lens out of the dozens that each company makes (model numbers of lens tested listed at end of report).

Picture of Indoor Scene

Below is the indoor scene we used. The yellow/orange boxes indicate the areas zoomed into and analyzed. We also had the subjects move to the right side for a fringe test. We had both a near and far subject. For the near subject, there were no material differences in image quality so we skipped an analysis of that. 

Indoor Daytime Moderately Wide FoV (~35ft)

Axis P1344 (Center/Fringe)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~35ft HFoV  near the center of the FoV and then moves laterally towards the fringe of the FoV. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

 

Images (both center and fringe) from the SD lens are clearly inferior, less detailed or 'fuzzier' than any of the MP lenses. The SD lens also shows a high degree of detail loss from center to fringe.

Center images from MP lenses exhibit subtle/slight but detectable differences in detail levels. Both Fujinon and Tamron appear to produce the best detail levels among the MP lenses in both the center and fringe images. The Computar MP lens appears to produce the most center vs. fringe detail loss or quality degradation.

Sony CH140 (Center/Fringe)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~45ft HFoV  near the center of the FoV and then moves laterally towards the fringe of the FoV. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Overall the SD lens images (both center and fringe) provide less detail than MP lenses. However, the SD performs roughly similar to the Evetar (worst performing MP lens).

The Fujinon lens looks best compared to the field in both center and fringe images. The Computar MP lens provides relatively strong details at the fringe. Oddly it appears to perform slightly better at the fringe than center in this particular test case.

Parking Garage Artificially Lit Wide FoV (~50ft/~75ft)

Below is a sample picture of the parking garage scene. The subject first went to a mid-way point and then to the far wall as depicted by the orange/yellow boxes displayed.

Axis P1344 (~50ft FoV/~75ft FoV)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~50ft HFoV near the center of the FoV and then moves back corresponding to a ~75ft HFoV - still in center. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Both ~50ft and ~75ft HFoV SD lens images indicate some clear deficiencies of SD in comparison to MP lenses. The wider field of views used in this comparison tend to make separation between lenses more detectable or apparent without having to digitally zoom any further. The Tuss appears particularly less 'sharp' or clear as the other MP lenses. Meanwhile, Tamron looks the most detailed in the ~50ft HFoV image comparison, with Fujinon just slightly behind. The Fujinon appears best in the ~75ft HFoV comparison.

Indoor Low-Light (~1 Lux) Narrow FoV

For our low light tests, we used an enclosed area and an eye chart to discern differences:

Axis P1344 (~5ft HFoV)

In this scenario, all six test lenses are setup with equal lens angles. An eye-chart is positioned at a distance corresponding to a ~5ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

In this narrower HFoV (~5ft), differences between the lenses are not as distinct. For example, even the SD lens provides detail levels nearly on par with the MP lenses. Overall, differences among MP lenses are quite minimal in this narrow HFoV. The Evetar lens is notably 'darker' than the field and as a result provides less image contrast.

Panasonic WV-SP306 (~10ft HFoV)

In this scenario, all seven test lenses are setup with equal lens angles (this test includes an additional stock lens). An eye-chart is positioned at a distance corresponding to a ~10ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Note that differences are considerably more detectable in this wider HFoV (~10ft), compared to the previous ~5ft HFoV. Both the SD lens and Evetar lens provide the least in terms of image quality. However, they present with slightly different problems. The SD lens image appears blurry with less contrast, whereas the Evetar exhibits fairly strong contrast but characters on the eye-chart appear 'blocky' or tend to 'bleed'excessively.

The Fujinon lens provides greatest details by quite a margin over the other MP lenses. Tamron and the stock Panasonic lens are above average, as well.

Sony CH140 (~10ft HFoV)

In this scenario, all seven test lenses are setup with equal lens angles (this test includes an additional stock lens). An eye-chart is positioned at a distance corresponding to a ~10ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Again the SD lens image is clearly less detailed than any of the MP lens images. The Computar MP lens exhibits the least detailed image among the MP lenses. The Tamron appears to produce the most detailed image, edging out both the Fujinon stock and test lenses.

Methodology

Here are the lenses tested:

  • Computar (SD) - F1.0; 3.5 to 10.5mm; 1/3"; CS
  • Computar TG3Z0312FCS-MPIR (MP/IR) - F1.2; 3 to 8mm; 1/3"; CS
  • Evetar M13VD2812IR (MP/IR) - F1.4; 2.8 to 12mm; 1/3"; CS
  • Fujinon YV2.1x2.8SR4A-SA2 (MP/IR) - F1.3; 2.8 to 6mm; 1/3"; CS
  • Tamron M13VG288IR 3(MP/IR) - F1.2; 2.8 to 8mm; 1/3"; CS
  • Tuss VT3Z3280MDIR - (MP/IR) - F1.4; 3.3 to 8mm; 1/3"; CS

Here are the cameras used:

  • Axis P1344 (online $759) - 720p D/N; 1/4" CMOS; 0.05 Lux (BW)
  • Panasonic WV-SP306 (online $550) - 1.3MP D/N; 1/3" MOS;  0.3/0.05 lux (Color/BW)
  • Sony CH140 (online $800) - 720p D/N; 1/3" CMOS; 0.1 Lux (BW)

2 reports cite this report:

Directory of Camera Shootout Series on Dec 27, 2011
The following directory lists all of our camera shootouts. These shootouts pit 4 - 8 different surveillance cameras in simultaneous tests on real...
The Importance of Megapixel Lenses on Feb 21, 2009
Selecting the right megapixel lens is as confusing as it is important. The wrong choice of lens can make an expensive megapixel camera no better...
Comments : PRO Members only. Login. or Join.

Related Reports

Milestone Machine Learning Camera Auto-Setting Examined on Mar 13, 2019
Milestone wants to improve image quality using Machine Learning to solve the problem of "a camera doesn't know what it is being used for",...
Startup Spectral Edge RGB+IR Claims "Unique Low Light Performance Tech" on Apr 03, 2019
This UK startup, born out of university research, is boldly proclaiming that they deliver "Unique low light performance tech for video surveillance...
Speco Ultra Intensifier Tested on Apr 22, 2019
While ISC West 2019 named Speco's Ultra Intensifier the best new "Video Surveillance Cameras IP", IPVM testing shows the camera suffers from...
Hikvision ColorVu Camera Tested on Jun 24, 2019
Hikvision says their new ColorVu line captures "vivid chromatic images in darkness", with unconventional white light illuminations whereas most...
Lens Iris Tutorial on Aug 08, 2019
Cameras, like humans, have irises, controlling the light which hits the imager and impacting image details. However, cameras have multiple types of...
Wide Dynamic Range (WDR) Guide on Oct 01, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Hikvision ColorVu is Smart Marketing on Oct 03, 2019
Hikvision ColorVu (see IPVM test results) is smart marketing, a lesson to be learned by competitors and a rising trend. Inside this note, we...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Budget Covert Cameras Tested on Nov 26, 2019
Covert cameras under $100 are widely available online but are they any good? To see how these models really work in the real world, we bought...

Most Recent Industry Reports

Hanwha Wisenet X Plus PTRZ Tested on Feb 14, 2020
Hanwha has released their PTRZ camera, the Wisenet X Plus XNV-6081Z, claiming the "modular design allows for easy installation". We bought and...
PRC Warns Against China Video Surveillance Hacks, Hikvision Targeted on Feb 14, 2020
Hackers are targeting China video surveillance manufacturers and systems, according to the PRC's main cyber threat monitoring body. The hackers...
IPVM Conference 2020 on Feb 13, 2020
IPVM is excited to announce our 2020 conference. This is the first and only industry event that will be 100% sponsor-free. Like IPVM online, the...
Bosch Dropping Dahua on Feb 13, 2020
Bosch has confirmed to IPVM that it is in the process of dropping Dahua, over the next year, as both IP camera contract manufacturer and recorder...
BluB0X Alleges Lenel, S2, Software House Are Dinosaurs on Feb 13, 2020
BluB0X is running an ad campaign labeling Lenel, S2, Software House, Honeywell, AMAG and more as dinosaurs: In a follow-up email to IPVM,...
London Live Police Face Recognition Visited on Feb 13, 2020
London police have officially begun using live facial recognition in select areas of the UK capital, sparking significant controversy. IPVM...
Converged vs Dedicated Networks For Surveillance Tutorial on Feb 12, 2020
Use the existing network or deploy a new one? This is a critical choice in designing video surveillance systems. Though 'convergence' was a big...
Monitoreal "Completely Autonomous" Home AI Tested on Feb 12, 2020
Monitoreal claims to allow users to "see the things you want (people, vehicles, animals) and ignore the things you don’t”, using AI to distinguish...
Cisco Video Surveillance Is Dead, Long Live Cisco Meraki Video Surveillance on Feb 11, 2020
A dozen years ago much of the industry thought that Cisco was destined to dominate video surveillance. They stumbled repeatedly, failing. Now it is...
BICSI For IP Video Surveillance Guide on Feb 11, 2020
Spend enough time around networks and eventually someone will mention BICSI, the oft-referenced but only vaguely known standards body prevalent in...