HD Lens Shootout

Author: Benros Emata, Published on Oct 02, 2011

Conventional wisdom says that lenses make a big difference in image quality but the question remains: "How much of a difference?" With the shift to megapixel cameras increasing demands for higher quality lenses, this question has gained even greater importance.

We wanted to better understand quality differences by doing our own series of shootouts. This is our first report in that series.

Lens Shootout Approach

The most common lens type used with megapixel cameras are varifocal lenses with a relatively wide field of view (e.g., 3 - 8 mm). This is the normal stock or default lens provided with most megapixel cameras today.

We wanted to start with this type, selecting 5 of the more common lens manufacturers. This test include lenses from:

  • Computar
  • Evetar
  • Fujinon
  • Tamron
  • Tuss

We then used these lenses with three commonly used IP cameras:

  • Axis P1344
  • Panasonic WV-SP306
  • Sony CH140

We conducted tests in 3 different scenes:

  • Indoor office for a medium size area
  • Enclosed parking structure for a larger area
  • Indoor darkroom for night time testing

Since lens focusing is a key issue in optimizing cameras, we used the auto back focus features available in all 3 cameras to provide a standardized way to focus all lenses.

Preview

Below is a preview of one of the scenes that shows variations in performance achieved.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Inside the Pro section, we dig into the key differences and how the lens performance compared.

Future Tests

We plan to do more lens tests to examine other applications and use cases. Future tests will include fixed focal lenses (vs varifocal ones) and multi-megapixel camera performance.

Key Findings and Recommendations

Here are the key findings:

  • Among MP lenses, differences in quality/detail levels more apparent in wider FoVs
  • Loss of detail at fringe more evident at wider FoVs (e.g. ~35ft HFoV)
  • The SD lens on a MP camera produced somewhat worse image quality, more pronounced at wider FoVs
  • The practical differences between worst and best MP lens tended to be modest
  • Fujinon and Tamron lenses tended to outperform other MP lenses throughout test scenarios
  • However, Fujinon and Tamron were not the best in every test but was at least average in all and the best in many
  • Fujinon lens exhibited the least image quality degradation at fringe
  • Evetar performed the poorest especially at night

In light of these findings the following is recommended:

  • Avoid SD lenses with MP cameras. This should be obvious but the tests results do bear out diminished performance (as to be expected).
  • The Fujinon might be preferable if you want to maximize performance. However, differences likely will not be huge.
  • The only lens that really concerns us is the Evetar one. While it is by far the lowest cost, the negative tradeoff in performance is clear. Evetar is increasingly popular with camera manufacturers and the biggest challenge is that you may not know that you are getting such a lens because the manufacturer may remove the original manufacturer's label.
  • Do not presume that all Fujinon and Tamron lenses are better. While both manufacturers do have good overall reputations, we have only tested one lens out of the dozens that each company makes (model numbers of lens tested listed at end of report).

Picture of Indoor Scene

Below is the indoor scene we used. The yellow/orange boxes indicate the areas zoomed into and analyzed. We also had the subjects move to the right side for a fringe test. We had both a near and far subject. For the near subject, there were no material differences in image quality so we skipped an analysis of that. 

Indoor Daytime Moderately Wide FoV (~35ft)

Axis P1344 (Center/Fringe)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~35ft HFoV  near the center of the FoV and then moves laterally towards the fringe of the FoV. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

 

Images (both center and fringe) from the SD lens are clearly inferior, less detailed or 'fuzzier' than any of the MP lenses. The SD lens also shows a high degree of detail loss from center to fringe.

Center images from MP lenses exhibit subtle/slight but detectable differences in detail levels. Both Fujinon and Tamron appear to produce the best detail levels among the MP lenses in both the center and fringe images. The Computar MP lens appears to produce the most center vs. fringe detail loss or quality degradation.

Sony CH140 (Center/Fringe)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~45ft HFoV  near the center of the FoV and then moves laterally towards the fringe of the FoV. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Overall the SD lens images (both center and fringe) provide less detail than MP lenses. However, the SD performs roughly similar to the Evetar (worst performing MP lens).

The Fujinon lens looks best compared to the field in both center and fringe images. The Computar MP lens provides relatively strong details at the fringe. Oddly it appears to perform slightly better at the fringe than center in this particular test case.

Parking Garage Artificially Lit Wide FoV (~50ft/~75ft)

Below is a sample picture of the parking garage scene. The subject first went to a mid-way point and then to the far wall as depicted by the orange/yellow boxes displayed.

Axis P1344 (~50ft FoV/~75ft FoV)

In this scenario, all six test lenses are setup with equal lens angles. A subject is positioned at a distance corresponding to a ~50ft HFoV near the center of the FoV and then moves back corresponding to a ~75ft HFoV - still in center. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Both ~50ft and ~75ft HFoV SD lens images indicate some clear deficiencies of SD in comparison to MP lenses. The wider field of views used in this comparison tend to make separation between lenses more detectable or apparent without having to digitally zoom any further. The Tuss appears particularly less 'sharp' or clear as the other MP lenses. Meanwhile, Tamron looks the most detailed in the ~50ft HFoV image comparison, with Fujinon just slightly behind. The Fujinon appears best in the ~75ft HFoV comparison.

Indoor Low-Light (~1 Lux) Narrow FoV

For our low light tests, we used an enclosed area and an eye chart to discern differences:

Axis P1344 (~5ft HFoV)

In this scenario, all six test lenses are setup with equal lens angles. An eye-chart is positioned at a distance corresponding to a ~5ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

In this narrower HFoV (~5ft), differences between the lenses are not as distinct. For example, even the SD lens provides detail levels nearly on par with the MP lenses. Overall, differences among MP lenses are quite minimal in this narrow HFoV. The Evetar lens is notably 'darker' than the field and as a result provides less image contrast.

Panasonic WV-SP306 (~10ft HFoV)

In this scenario, all seven test lenses are setup with equal lens angles (this test includes an additional stock lens). An eye-chart is positioned at a distance corresponding to a ~10ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Note that differences are considerably more detectable in this wider HFoV (~10ft), compared to the previous ~5ft HFoV. Both the SD lens and Evetar lens provide the least in terms of image quality. However, they present with slightly different problems. The SD lens image appears blurry with less contrast, whereas the Evetar exhibits fairly strong contrast but characters on the eye-chart appear 'blocky' or tend to 'bleed'excessively.

The Fujinon lens provides greatest details by quite a margin over the other MP lenses. Tamron and the stock Panasonic lens are above average, as well.

Sony CH140 (~10ft HFoV)

In this scenario, all seven test lenses are setup with equal lens angles (this test includes an additional stock lens). An eye-chart is positioned at a distance corresponding to a ~10ft HFoV. Each camera/lens combination is auto focused in b/w mode with ~300 lux of ambient light. Lighting levels were subsequently reduced to ~1 lux for testing. The composite below shows each of the camera/lens combinations digitally zoomed to better reveal differences between them. Note that a green box indicates our assessment of the best image quality, a yellow box indicates slightly better than average, and a red box indicates worst or very poor image quality.

Again the SD lens image is clearly less detailed than any of the MP lens images. The Computar MP lens exhibits the least detailed image among the MP lenses. The Tamron appears to produce the most detailed image, edging out both the Fujinon stock and test lenses.

Methodology

Here are the lenses tested:

  • Computar (SD) - F1.0; 3.5 to 10.5mm; 1/3"; CS
  • Computar TG3Z0312FCS-MPIR (MP/IR) - F1.2; 3 to 8mm; 1/3"; CS
  • Evetar M13VD2812IR (MP/IR) - F1.4; 2.8 to 12mm; 1/3"; CS
  • Fujinon YV2.1x2.8SR4A-SA2 (MP/IR) - F1.3; 2.8 to 6mm; 1/3"; CS
  • Tamron M13VG288IR 3(MP/IR) - F1.2; 2.8 to 8mm; 1/3"; CS
  • Tuss VT3Z3280MDIR - (MP/IR) - F1.4; 3.3 to 8mm; 1/3"; CS

Here are the cameras used:

  • Axis P1344 (online $759) - 720p D/N; 1/4" CMOS; 0.05 Lux (BW)
  • Panasonic WV-SP306 (online $550) - 1.3MP D/N; 1/3" MOS;  0.3/0.05 lux (Color/BW)
  • Sony CH140 (online $800) - 720p D/N; 1/3" CMOS; 0.1 Lux (BW)

2 reports cite this report:

Directory of Camera Shootout Series on Dec 27, 2011
The following directory lists all of our camera shootouts. These shootouts pit 4 - 8 different surveillance cameras in simultaneous tests on real...
The Importance of Megapixel Lenses on Feb 21, 2009
Selecting the right megapixel lens is as confusing as it is important. The wrong choice of lens can make an expensive megapixel camera no better...
Comments : PRO Members only. Login. or Join.

Related Reports

Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Hanwha Dual Imager Dome Camera Tested (PNM-7000VD) on Oct 18, 2018
Hanwha has introduced their first dual-imager model, the PNM-7000VD, a twin 1080p model featuring independently positionable sensors and a snap-in...
Dahua Face Recognition Camera Tested on Oct 15, 2018
Dahua has been one of the industry's most vocal proponents of the value that AI creates: As part of this, Dahua has released a facial...
Last Chance - October 2018 Camera Course on Oct 04, 2018
Today is the last day to register for the October 2018 Camera Course, register now. This is the only independent surveillance camera course,...
Axis 4K vs. 5MP Camera Shootout (Q3518-LVE + Q3517-LVE) on Oct 04, 2018
Axis has released the 4K counterpart to their 5MP Q3517-LVE (see our test). Axis claims of both these cameras: Simply put, AXIS Q3518(17)-LVE...
Hikvision 4MP Camera Tested (DS-2CD2345FWD-I) on Sep 27, 2018
Hikvision's latest Performance Series / EasyIP 3.0 4MP model, the DS-2CD2345FWD-I, was the top performer in our 4MP shootout, besting rivals from...
4MP Camera Shootout - Axis, Dahua, DW, Hanwha, Hikvision, Uniview, Vivotek on Sep 24, 2018
4MP usage continues to climb, especially for low cost fixed lens models. To see who was best, we bought and tested seven 4MP models from Axis,...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Amazon Ring Spotlight Cam Tested on Sep 17, 2018
Amazon's Ring has released their latest camera entry, the Spotlight Cam, which we bought and tested in our Consumer IP Camera Analytics...
Vivotek 4MP Camera Tested (FD8379-HV) on Sep 13, 2018
Next in our series of updated 4MP testing, we bought and tested Vivotek's FD8379-HV, and entry level 4MP model claiming "top-notch quality video in...

Most Recent Industry Reports

'Sticker' Surveillance Camera Developed (CSEM Witness) on Nov 16, 2018
The Swiss Center for Electronics and Microtechnology (CSEM) has announced what it calls the: world’s first fully autonomous camera that can be...
ISC East 2018 Mini-Show Final Report on Nov 16, 2018
This is our second (updated) and final show report from ISC East. ISC East, by its own admission, is not a national or international show, billed...
Facial Detection Tested on Nov 16, 2018
Facial detection and recognition are increasingly offered by video surveillance manufacturers. Facial detection detects faces in an image/video...
Throughtek P2P/Cloud Solution Profile on Nov 15, 2018
Many IoT manufacturers either do not have the capabilities or the interest to develop their own cloud management software for their devices....
ASIS Offering Custom Research For Manufacturers on Nov 15, 2018
Manufacturers often want to know what industry people think about trends and, in particular, the segments and product they offer.  ASIS and its...
Hikvision Silent on "Bad Architectural Practices" Cybersecurity Report on Nov 14, 2018
A 'significant vulnerability was found in Hikvision cameras' by VDOO, a startup cybersecurity specialist. Hikvision has fixed the specific...
French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...
Integrator Credit Card Alternative Divvy on Nov 13, 2018
Most security integrators are small businesses but large enough that they have various employees that need to be able to expense various charges as...
Directory of Video Intercoms on Nov 13, 2018
Video Intercoms, also known as Video Door-Phones or Video Entry Systems, have been growing in the past decade as more and more IP camera...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact