Super Low Light vs Integrated IR Shootout 2013

By: Ethan Ace, Published on Oct 07, 2013

Two of the biggest trends in IP cameras collide in this unique IPVM shootout.

In the past few years, a surge of manufacturers have released integrated IR cameras as well as 'super' low light ones. Indeed, many manufacturer now offer both types.

They both address the same core problem - poor low light performance - but which one is better? and what are the tradeoffs?

The Test

In this shootout, we took 6 cameras - 3 integrated IR ones and 3 super low light optimized ones and tested them head to head.

  • Integrated IR cameras: Avigilon H3 (both 3-9 and 9-22mm models), Dahua and Axis M1114-L 
  • Super Low Light cameras: Axis Lightfinder P3354, Bosch Starlight NBN-733v, and Sony Gen 6 SNC-VB600

We then tested them indoors and outdoors, ranging from distances of 6' to 300', and light levels of 10 lux down to 0.1 lux.

Below is a preview of the 14 image comparisons we compiled from our tests:

The Questions

Our test results answered the following questions:

  • Which cameras provided the best details?
  • How did the results vary across light levels (e.g., who was better at 0.1 lux, 1 lux, 10lux, etc.)?
  • How did the results vary across distance? (including a special long range 125' - 300' test)
  • How did the results differ indoor vs outdoors?
  • Which cameras did better in minimizing bandwidth consumption? Is IR's advantage here real or a myth?

*** ** *** ******* trends ** ** ******* collide ** **** ****** IPVM ********.

** *** **** *** years, * ***** ** manufacturers **** ******** ********** IR ******* ** **** as '*****' *** ***** ones. ******, **** ************ now ***** **** *****.

**** **** ******* *** same **** ******* - poor *** ***** *********** - *** ***** *** is ******? *** **** are *** *********?

The ****

** **** ********, ** took * ******* - 3 ********** ** **** and * ***** *** light ********* **** *** tested **** **** ** head.

  • ********** ** *******: ******** H3 (**** *-* *** 9-22mm ******), ***** *** Axis *****-* 
  • ***** *** ***** *******: Axis *********** *****, ***** Starlight ***-****, *** **** Gen * ***-*****

** **** ****** **** indoors *** ********, ******* from ********* ** *' to ***', *** ***** levels ** ** *** down ** *.* ***.

***** ** * ******* of *** ** ***** comparisons ** ******** **** our *****:

The *********

*** **** ******* ******** the ********* *********:

  • ***** ******* ******** *** best *******?
  • *** *** *** ******* vary ****** ***** ****** (e.g., *** *** ****** at *.* ***, * lux, *****, ***.)?
  • *** *** *** ******* vary ****** ********? (********* a ******* **** ***** 125' - ***' ****)
  • *** *** *** ******* differ ****** ** ********?
  • ***** ******* *** ****** in ********** ********* ***********? Is **'* ********* **** real ** * ****?

[***************]

Key ********

***** *** *** *** findings **** **** ****:

  • ** * *** ******* parking *** (< ****), low ***** ******* ************ integrated ** ******, ********* better ****** ** ***** range, *** ******** ********* at ******* ******, ** to ***'. **** *** Avigilon ** (*-***) ****** provided ******* ***** ** low ***** ******.
  • ********, **** *** ****** out, ~*.* *** *** below, ** ******* ******** much ****** ******* **** low ***** ******, **** details ** ***** ***** and ********* ** ****** ranges. *** ***** ******* produce **** ********* ** very ***** *****, *** no ****** ****** ******.
  • ** **** ***** (** to ***'), ********'* *-**** IR ******, ** *** maximum ***** ******, ************ low ***** ********* ******* with *** **** ***. *** Avigilon ****** *** **** to ****** * ******* up ** ***' ****, while *** ***-*** ******** detection ** ~***', *** not ******. *** **** VB630 *** ****** ** detect ******** ** ***** ranges ** ***.
  • *******, ** *** ***** up ** **', ********** IR ******* ******* ************ low ***** *******, **** better ****** *** ******* visible *****. 
  • **** ******* ******** **, color **** ******** ******** image ******* ** *** light ******* ******** ** their **********, *** ** increased ******** *** ***** information. However, **** ******* ******** off, ********** **** ********* better **** *****.
  • ********* ***********, ******** ** conventional ******, *** *** split ******* *** *** categories. ***** ********** ** models, ***** **** **** bandwidth **** *** *** light ****** ** *** light ******. ********'* ** bullet *** *** ******* consumption ** *** ****** in *** ***** **** lights ***. *******, *** ***** 733's ********* ***** *** lower **** **** ********** IR ******.

*******

*** ***** *******:

********** ** *******:

*** *-**** **** **** was ********* **********(~$*** *** ******).

***************

** **** *** ***** scenes ***** * *** (outdoors **** ** ********), integrated ** ******* ***** details ** ***** ***** where *** ***** ****** do ***, *** ********* of ******** ** ******* distances, ***** *** ***** cameras ******* ****** ** no ****** ******. ********* in ***** ********* ***** cost, ********** ** ** the ********* ****** ** these ******.

** ****** ***** ******, 5 *** *** ***** (such ** *** ******* lots), *** ***** ******* are ****** *** **** choice, *** ** ******** details *** ***** *********** instead ** * ********** image. **** ** ********** true ** ****** ****** where *********** ******* *** be ********. 

** ****** *** ***** scenes, ********** ** ******* are ********* *** **** option. ** ************ ** often **** ********* ** these ****** *** ** the *********** ** ***** and ***** ******* ** enclosed ******, ********* ** less ***** *** ***** bandwidth **** *** ***** optimized *******.

*******, ****** ********** ** cameras ********* ******* **** bandwidth ** ***** **** low ***** *****, ***** should ** ***** **** severe ****** *** ***** even **** ****.*** **** * ***** ******** ************* ************ ********* *** ******* space.

Outdoors, ****** **

*** ***** **** ***** was * ******* *** and *****, **** ******* light **, ******* **** below * *** ** ~10.

** *', *** ********** IR *** *** ***** cameras *** ******* ** performance. *** *** ***** cameras ******* ****** *******, providing **** ****** ** the *******'* **** *** clothes. **** ************ *** present ** **** ** and *** ***** ****** from ****.

** **', *** ***** cameras ******* ********** ******, still ********* **** ******* and ****** ******** ** most *****.

** **', *** *********** gap ******. ** ************ begins ** **** ** all ******* ** **** range, *** ******** ** lost, **** *** ******* blending **** *** ********** and ******** ** *****. The *** ***** ******* still ***** ***** *********** and *********** ****** ******** between ********** *** *******. Neither ******* **** ****** of *** *******.

** ***', *** ******* is ****** **** ** all ********** ** *******, while ***** ******* ********** in *** *** ***** models.

Outdoors ****** ***

******* *** ****** ***, monochrome **** ********* ****** than ***** ** *** light ********* *******. ***** levels ******* ** ~*.* lux **********.

** *', *** ********** IR ******* ******* ****** and ******** ******* ** the *******, ***** *** low ***** ********* ****** provide ********* ****.

*** ** ******* ******** to ********** *** ***** models ** **', ******* showing *** *******. *** light ******* ** **** range ******* **** *****.

** **', *** ******* is ***** ********** ** integrated ** *******, ****** noticeably **** ********* ** detect.

*******, ** ***', *** subject ** ********* ** detect **** ** ********** IR ******.

Long *****

** **** ******* ******, we **** ********'* *-**** IR ******, ***** **** two *** ***** ****** equipped **** *-**** ********* lenses. ** ******* ******** ********* ********'* *** ********* IR ************ ***** ** this ***** *** ********, though***** ** ******* ******* at ******* *****.

******** ** ***', *** IR ****** ** ******* superior ** *** ***** models. *** ***** ***-**** is ********** **** ** detect * ****** *******, but *** ***** ** not.

** ***', ******** ***** easily ******* *** *******, while *** *** ** still ********. 

*******, ** ***', *** IR ****** *** ********** detecting *** *******, ****** he ** ***** *******. Other ******* ******* ** usable ******.

*******

*******, ** ****** ** our ******** ****** ********** room ** *** * baseline ** ***** ******* and *** *********** ********* in ******* ******.

** **' *****, ****** 1 ***, *** ** cameras ******* ****** ****** than *** ***** ******, with *** **** ***** more *******, *** **** facial ****** ********. *** light ******* ******** **** higher ***** **************.

** **** *****, *********** is *****, **** ******* generally ********** ***** ** the ****. *** **** M1114-L ******** **** ******************* ***** ****** ** this ****, ********* **** details.

*********

*** ********** ** ******* in *** ***** ********* consumed **** ********* **** low ***** ********* *******, as **** ** *** charts *****. **** **** the ******** ** ******, Dahua *********, *** ***** NBN-733V **** ******** ** this, *******. ***** ******** more ********* **** *** light ******* ******** **** lights **, ***** ***** consumed **** **** **** IR *******. **** *******, with *** ****** ***, the ******** ** ****** consumes *** **** ********* of *** ****** ** the ****, **** *** VBR *** ** ** Mb/s, * ** ******** over *** ********* **** lights **.

Test ********** 

*** ********* ******** ******** were **** ** **** test:

*** ***** *******

  • **** *****: *.**.**
  • ***** ***-****: ********
  • **** ***-*****: *.*.*
  • **** ***-*****: *.*.*

********** ** *******

  • ******** *.**-**-***-** (*-*** ******): 2.4.6.24(8181)
  • ******** *.**-**-***-** (*-**** ******): 2.4.6.26(8383)
  • **** *****-*: *.**.**.*
  • ***** *********: *.***.******* **.*.*,*****:****-**-**(**.*.*)

******* **** ************ ** 1/30s ******* ******* ********. Other ******** **** **** defaulted.

Comments (16)

This is very informative. Just adds to the compelxity of trying to design an optimal low light surveillance system :)

Nice Test & report for understanding of system designers on what goes where?

Thanks.

Not sure who is picking which Dahua cams to include in testing, but this one is a much better low light performer.

Jon, this is a technology test comparing two segments (IR and super low light). While we obviously picked real cameras, the focus is not on specific vendors but how the two segments compared. Regardless of whether we used the Dahua model you suggested (or the Axis P series integrated IR model), the overall segment results most certainly would have been the same.

In the future, we will do an Integrated IR Shootout where we take the 'best' of each camera manufacturer and then test them head to head. At that time, we will ask Dahua for their input on which of their cameras they believe is their strongest integrated IR model.

John, sorry if I upset you. Your response seems as if I touched a nerve. Was not my intent, and maybe my post could have been worded better.

That said, my point has merit. You could buy the lower cost model that I linked above on Amazon for $161, which is cheaper than the model you chose, and on top of the savings, you would find that it would perform better than the more expensive unit. Not every Dahua cam is worth a review, as is probably true with other brands, but it seems like your staff keeps picking the losers in their lineup.

I think your coverage of Dahua is fair and unbiased, but just think you would see better results with selecting their better units. If the focus is low light, you wouldn't pick the worst performing Avigilon or Axis., I'm sure.

Jon, we asked Dahua directly for recommendations and bought those cameras directly from them. Perhaps you can ask them why they are 'losers'? :)

Also, the model you recommend (IPC-HFW2100) and the model we used (IPC-HFW3200S) are rated for the same maximum IR distance: 20 meters.

Btw, we used an Axis M series integrated IR model instead of the P series one. So your insinuation that we would somehow choose a 'bad' Dahua model but not do that with Axis is wrong.

But again, the point is that this is a technology test and even if we used the HFW2100 or the Axis P series integrated IR unit, the overall recommendations between super low light and integrated IR would remain the same.

Can't wait for your Integrated IR Shootout. I presume only the adaptive IR ones will be good performers.

That's one topic we'll definitely be testing. Interestingly enough, the Dahua camera shown here does not have adaptive IR and the illuminator is very strongly aimed toward the middle of the image. Yet it doesn't wash out at close range like the Axis M1144-L (which has a more dispersed IR pattern). It will be an interesting test.

The Dahua is not bad, though a bit overexposed nonetheless. The wringles on the shirt are not visible.

Likewise, I've used at least one analog IR camera (not adaptive) that did not overexpose, even at fairly close range.

Whats the difference between "Low light camera" vs "High dynamic rage" vs "Wide dynamic range" cameras? Are these cameras slves the same problem (capturing image in low light)?

High dynamic range and wide dynamic range cameras are essentially the same thing, intended to deliver better images in scenes with wide variations in lighting, such as lobbies with many windows, loading docks with open overhead doors, etc.

Low light cameras are intended to produce images at lower lux levels than other cameras, often in color at night. They aren't usually intended for scenes with wide light variations, however.

There is some overlap in performance, as some new models perform well in both WDR and low light scenes. We see this in cameras like the Axis Q1604, Bosch NBN-733V, and Sony's 6th generation. Most cameras claim one or the other, however, not both.

Any chance we could get a look at the Samsung WiseNet III cameras in a low light shootout? At ASIS, they had a display that touted their low light abilities, but I want to see if it was all marketing, or if they really do have their place in the top tier of low light models.

Have you guys (and ladies) thought of testing the cameras using optimal settings in addition to your baseline test that you already test? For instance, I know that you like to standardize the shutter speed, but leave all other settings at defaults. Isn't that unfair to a camera that has WDR, but is off by default? It is like saying you are test driving a Ferrari, but you only drive it in first gear.

I know that it is a larger undertaking when spending that much time on any given camera, but I think it would give us a more clear performance winner. Some of us are looking for the least expensive, yet effective product, where others are looking for the best performers. This should elevate the bar and make it clear why spending twice the amount for a top tier camera is worth it, or maybe not.

Jon, what are the specific settings you would like us to change? You want us to turn WDR on for cameras where it available but off by default? Do you mean digital WDR or multi-exposure WDR? What other settings?

We have heard this concern before, and we tested this but it turned out that manufacturer optimizations did very little to improve performance.

For example, most of the cameras we have installed out of the box are usually poorly tuned for the environment they are installed into. I can't remember many times where the default settings were already perfect. Here are a short list of settings that commonly get changed:

1) WDR/DWDR on/off

2) Shutter speed (which you usually standardize for fairness, but maybe not optimize)

3) Gain

4) Brightness/contrast/saturation/etc

I'm not saying this would make or break an image, but if we are testing cameras that are close in performance, setting them up in the best possible scenario would possibly give the edge to a clear winner/loser scenario. I think that you may find in the low light testing especially, these manual adjustments might make a difference.

And I'm not suggesting that you abandon your current method, because it has merit as well. I like that you test with defaults, with the exception of shutter. It is a fair baseline test that is good to compare against the optimized settings.

"In the low light testing especially, these manual adjustments might make a difference."

No.

Obviously, shutter speed makes a difference, and as you have acknowledged, this is why we adjust/normalize them.

Essentially every camera defaults to automatic gain control, allowing the camera to increase gain to its max in low light. You can reduce the gain levels but this will certainly make cameras worse in low light (you'll reduce some digital noise at the expense of considerably darker images).

Brightness/Color/Saturation do not make material differences in details captured/displayed and certainly make no material difference in low light. However, some people like their images 'visually' better with changes to these settings but ultimately these are subjective.

For WDR, if it's digital, it rarely makes any difference either way (whether it's day or night). If it's multi-exposure, it can make a modest difference and we often show that for cameras where this is the case (if they allow it to be turned off at night).

Your said that we are doing the equivalent of test driving a Ferrari in first gear, which implies that our result are way off.

If you or any one else has images that show massive optimizations, feel free to post and we will consider. However, I am telling you we have tried tests with every combination that you have mentioned and that those settings make nearly no difference outside of subjective personal preferences.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Uniview Prime Series 4K Camera Tested on Sep 18, 2019
Is the new Uniview 'Prime' better than the more expensive existing Uniview 'Pro'? In August, IPVM tested Uniview 4K 'Pro' but members advocated...
Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
Yi Home Camera 3 AI Analytics Tested on Sep 10, 2019
Yi Technology is claiming "new AI features" in its $50 Home Camera 3 "eliminates 'false positives' caused by flying insects, small pets, or light...
WDR Camera Mega Shootout 2019 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Sep 04, 2019
This is the biggest WDR Shootout ever, with 23 cameras from 8 manufacturers: We included true multi-exposure WDR and non-WDR models, ranging...
Uniview Pro 4K Camera Tested (IPC3238ER3-DVZ) on Aug 29, 2019
In our 8MP / 4K Fixed Lens Camera Shootout, Uniview's low end 8MP was firmly in the middle of the pack. Does their higher end Pro Series 4K camera...
Register Now - October 2019 IP Networking Course on Aug 28, 2019
Register now for the Fall 2019 IP Networking Course. This is the only networking course designed specifically for video surveillance...
Wyze Image Quality Tested vs Axis, Hikvision And Nest on Aug 27, 2019
With Wyze's new AI feature, it is strong at analytics, but how good is the camera's image quality? Is it just as good as incumbents like Axis,...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Dahua 4K Camera Shootout on Aug 20, 2019
Dahua's new Pro Series 4K N85CL5Z claims to "deliver superior images in all lighting and environmental conditions", but how does this compare to...

Most Recent Industry Reports

ONVIF Suspends Huawei on Sep 20, 2019
Huawei has been 'suspended', and effectively expelled, from ONVIF so long as US sanctions remain on the mega Chinese manufacturer. Inside this...
Open Access Controller Guide (Axis, HID, Isonas, Mercury) on Sep 19, 2019
In the access control market, there are many software platforms, but only a few companies that make non-proprietary door controllers. Recently,...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Uniview Prime Series 4K Camera Tested on Sep 18, 2019
Is the new Uniview 'Prime' better than the more expensive existing Uniview 'Pro'? In August, IPVM tested Uniview 4K 'Pro' but members advocated...
US Army Base To Buy Banned Honeywell Surveillance on Sep 17, 2019
The U.S. Army's Fort Gordon, home to their Cyber Center of Excellence, has issued a solicitation to purchase Honeywell products that are US...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Schmode is Back, Aims To Turn Boulder AI Into Giant on Sep 16, 2019
One of the most influential and controversial executives in the past decade is back. Bryan Schmode ascended and drove the hypergrowth of Avigilon...
Manufacturers Unhappy With Weak ASIS GSX 2019 And 2020 Shift on Sep 16, 2019
Manufacturers were generally unhappy with ASIS GSX, both for weak 2019 booth traffic and a scheduling shift for the 2020 show, according to a new...