Color Versus Day/Night Shootout

By: Antony Look, Published on Apr 16, 2011

Most people prefer color over black and white but when it gets dark out, almost all surveillance experts agree that black and white video provides superior performance. To that end, professional surveillance users generally choose Day / Night cameras over Color only cameras for night time outdoor applications.

A number of important questions, though, remain unanswered:

  • How dark does it need to be before you should switch to black and white mode?
  • How much better of an image does black and white mode provide over color mode?
  • How much better is a Day / Night camera over a Color only camera?
  • What is the impact on visual quality for people and vehicles?

To better understand these tradeoffs, we conducted a series of 4 tests using 6 IP cameras.

  • 6 IP Cameras: We selected 2 color only cameras (an SD from Axis and a MP from IQinVision) and 4 day / night cameras (2 Bosch's - one at SD and HD, and MP Sony and Pelco Sarix cameras). We wanted a broad range of cameras to see how performance varied across camera types and camera manufacturers.
  • 4 Test Scenes: We tested (1) in an unlit field at under 1 lux to understand challenges in poorly lit scenes; (2 and 3) in a parking lot with typical street lighting for vehicles and people; (4) Finally, we tested in an outdoors athletic complex at ~50 lux to see the impact of very well lit night time scenes.

The images below provide a visual overview of some of the tests we conducted.

  • In an unlit field, with less than 1.0 lux , BW image quality was clearly superior to color mode. Amongst the D/Ns capable of BW mode, the higher resolution HD or MP cameras tend to provide a slight edge over SD D/Ns. Color mode tests at this light level reveal scenes are generally too dark or under-exposed. As a result our human subject is poorly visible in color mode.
  • In the 3 to 5 lux parking lot scene, only the HD/MP D/Ns in BW mode produced enough detail to read license plates at fairly narrow FoVs (headlights off). In contrast, color mode tests discovered no cameras able to produce enough clarity and/or details for license plate reading even with headlights off. When a human subject is examined in this 3 to 5 lux range, BW again demonstrates overall superior image quality.
  • In a very well lit, outdoor tennis court, at ~50 lux level, both color and BW mode produce good detail in the various subjects/objects. In other words, BW mode did not produce any real benefit, while color mode added a level of 'richness' to the scenes (e.g. skin tone, other object colors, etc.).
  • The video below shows you the tradeoffs in action:

    Video Clips Download (ZIP File)

    Review our Color vs. D/N videos zip file [link no longer available] (~500 MB) containing all the video clips and images generated during our testing. The clips are embedded inside an ExacqVision player and simply needs to be double clicked to view. In the Exacq player's Options menu we recommend enabling 'Show Camera Names' to show the names of the cameras on-screen.

    ~1.0 Lux Color vs. BW Analysis

    Get Notified of Video Surveillance Breaking News
    Get Notified of Video Surveillance Breaking News

    In this video we examine the results for tests performed in the ~1.0 lux open field. At this particularly low light level (<1.0 lux) BW mode is shown to clearly outperform color mode. Digitally zooming in to both human subject and the ensemble of license plates demonstrates that a better level of detail and overall clearer image is produced by the BW modes of TDN cameras. These results are generally expected, and most TDN cameras will automatically switch to monochrome under these lighting conditions.

    In color mode testing all cameras (both color-only and D/Ns set to color-mode) appear to 'struggle' to produce a strong picture quality especially in terms of details on the human subject. Somewhat unexpectedly, D/Ns set to color mode, tend to outperform the color-only cameras at this ~1.0 lux level.

    3 to 5 Lux Color vs. BW Analysis (Person)

    In the video below, we examine the results for tests performed in the 3 to 5 lux parking lot. Interestingly, results at this light level generally show BW mode outperforming color mode. Thus, despite many TDN camera specifications citing color mode minimum illuminations much lower (e.g. 1.0 lux) than this 3 to 5 lux scene, our real-world tests show material benefits using BW mode. When TDN cameras are tested in BW mode, both human and license plate details improve versus color mode. Applying this finding in the real-world can prove challenging since most D/Ns will tend to operate in color-mode automatically at this light level. Thus, an ability to fine-tune the cut-over between color and monochrome mode must be provided by the camera and properly configured by the user.

    In the color mode tests, no significant additional value is provided by color capability. In fact, in the darker scenes typical to this light level it is not so obvious that the D/Ns display any additional 'coloring'. While in color mode the Sony CH140 and Bosch NBN-921 (both MP) appear to provide best overall image quality compared to the rest of the field (color only Axis 1011 and IQEye 042SI; and the Pelco HD and Bosch SD D/Ns). At such a light level where scenes are dark, the additional color details (e.g., color of clothing or vehicles) are less likely to come through clearly enough to make a material difference.

    3 to 5 Lux Color vs. BW Analysis (Vehicle)

    In this video we revisit the 3 to 5 lux parking lot scene, but instead focus on a vehicle subject. Our first observation is that headlight glare or blooming effects appear more problematic in BW mode. This is evident across all TDN cameras from our study. However, both the Bosch NBN-921 (720p) and NBN-498 (D1) were able to mitigate the blooming phenomenon relatively better than the other D/Ns (Sony CH140 and Pelco Sarix). In BW mode, only the HD version of the Bosch provided a legible reading of the license plate through the glare of headlights. With headlights off, all the HD/MP D/Ns provide readable license plates.

    ~50 Lux Color vs. BW Analysis

    In this video we analyze the differences and trade-offs of color vs. BW in a very well lighted (~50 lux) athletic complex. It is no surprise that in such a well lit environment TDN cameras will almost always switch to color-mode or stay in color-mode. It is also not surprising that our tests suggest that this is the 'right' behavior as monochrome mode did not produce any clear advantages in image quality. In fact, color mode brought our greater overall 'richness' to the scene - e.g. identifying color of clothing and other objects of interest.

    Methodology

    A total of six (6) cameras are included in the Color vs. Monochrome Low-light Shootout. Four (4) cameras feature true D/N (IR cut-filter). Two (2) cameras are color only.

    True Day/Night Cameras:

    • Bosch NBN-921 [link no longer available] (online $750) - 1/3" CCD; F1.3 Bosch; 720p; 0.4 Lux (30 IRE, B/W); 1 Lux (Color)
    • Bosch NBN-498 [link no longer available] (online $700) - 1/3" CCD; F1.3 Bosch, 4CIF; 0.06 Lux (30 IRE, B/W)
    • Sony CH140 (online $800) - 1/3" CMOS; F1.2 Fujinon; 720p; 0.1 Lux (50 IRE, B/W); 0.2 Lux (Color)
    • Pelco Sarix IXE20DN (online $1,300) - 1/3" CMOS; F1.2 Pelco; 720p; 0.25 Lux (Mono, 33 ms)

    Color Only Cameras:

    • Axis M1011 (online $160) - 1/4" CMOS; Integrated F2.0; 4CIF; 1.0 Lux (Color)
    • IQEye 042SI (online $400) - 1/3" CMOS; F1.6 IQinvision; 2MP; 0.2 Lux (Color)

    All six (6) cameras were simultaneously recorded to an Exacqvision VMS throughout three (3) low-light environments. Each of the three (3) environments were designed to simulate real-world low-light surveillance applications:

    • ~1.0 lux open field with no direct lighting
    • 3 to 5 lux parking lot with street lamps
    • ~50 lux recreation area with liberal degree of lighting present

    For each light level both an all-color mode test (all TDN cameras forced into color mode) and a monochrome test (TDN cameras forced into monochrome mode) are conducted. Each test involves a human subject carrying an ensemble of license plates at an approximate 20ft FoV. The subject moves across horizontally to demonstrate motion and momentarily stops in the center of the scene to present static facial and object details. Note that color-only cameras (Axis M1011 and IQEye 042SI) were run again in color mode during the monochrome portions.

    The 3 to 5 lux parking lot scene features two (2) additional tests. The tests involve a vehicle rather than human subject. The vehicle is driven from background to foreground with head-lights turned on directly facing the cameras.

    Here is a summary of all eight (8) tests:

    • ~1.0 lux open field with human/license plate subjects - cameras all set to color mode
    • ~1.0 lux open field with human/license plate subjects - D/N cameras set to monochrome mode (2 color mode cameras repeated)
    • 3 to 5 lux parking lot with human/license plate subjects - cameras all set to color mode
    • 3 to 5 lux parking lot with human/license plate subjects - D/N cameras set to monochrome mode (2 color mode cameras repeated)
    • 3 to 5 lux parking lot with vehicle headlights - cameras all set to color mode
    • 3 to 5 lux parking lot with vehicle headlights - D/N cameras set to monochrome mode (2 color mode cameras repeated)
    • ~50 lux recreation area with human/license plate subjects - cameras all set to color mode
    • ~50 lux recreation area with human/license plate subjects - D/N cameras set to monochrome mode (2 color mode cameras repeated)

    Throughout all tests, all cameras are maintained at default settings.

    Here are the key default settings relevant to low light performance for each camera:

    • Bosch NBN-921 - 1/60s shutter; SensUp 4x; AGC on '15'
    • Bosch NBN-498 -  1/60s shutter; SensUp 4x; AGC on '15'
    • Sony CH140 - 1/30s shutter; View-DR/VE Off; AGC 'Middle'
    • Pelco Sarix IXE20DN - 1/8s shutter
    • Axis M1011 -Exposure Value '50'; Exposure Control 'Automatic'
    • IQEye 042SI -1/30s shutter
    Comments : PRO Members only. Login. or Join.

    Related Reports

    Milestone Machine Learning Camera Auto-Setting Examined on Mar 13, 2019
    Milestone wants to improve image quality using Machine Learning to solve the problem of "a camera doesn't know what it is being used for",...
    Startup Spectral Edge RGB+IR Claims "Unique Low Light Performance Tech" on Apr 03, 2019
    This UK startup, born out of university research, is boldly proclaiming that they deliver "Unique low light performance tech for video surveillance...
    Speco Ultra Intensifier Tested on Apr 22, 2019
    While ISC West 2019 named Speco's Ultra Intensifier the best new "Video Surveillance Cameras IP", IPVM testing shows the camera suffers from...
    Hikvision ColorVu Camera Tested on Jun 24, 2019
    Hikvision says their new ColorVu line captures "vivid chromatic images in darkness", with unconventional white light illuminations whereas most...
    Lens Iris Tutorial on Aug 08, 2019
    Cameras, like humans, have irises, controlling the light which hits the imager and impacting image details. However, cameras have multiple types of...
    Wide Dynamic Range (WDR) Guide on Oct 01, 2019
    Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
    Hikvision ColorVu is Smart Marketing on Oct 03, 2019
    Hikvision ColorVu (see IPVM test results) is smart marketing, a lesson to be learned by competitors and a rising trend. Inside this note, we...
    Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
    Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
    Biggest Low Light Problems 2019 on Nov 08, 2019
    Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
    Budget Covert Cameras Tested on Nov 26, 2019
    Covert cameras under $100 are widely available online but are they any good? To see how these models really work in the real world, we bought...

    Most Recent Industry Reports

    Verkada Paying $100 For Referrals Just To Demo on Jan 22, 2020
    Some companies pay for referrals when the referral becomes a customer. Verkada is taking it to the next level - paying $100 referrals fees simply...
    Camera Analytics Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jan 22, 2020
    Analytics are hot again, thanks to a slew of AI-powered cameras, but whose analytics really work? And how do these new smart cameras compare to top...
    Intersec 2020 Final Show Report on Jan 21, 2020
    IPVM spent all 3 days at the Intersec 2020 show interviewing various companies and finding key trends. We cover: Middle East Enterprise...
    Vehicle & Long Range Access Reader Tutorial on Jan 21, 2020
    One of the classic challenges for access control are parking lots and garages, where the user's credential is far from the reader. With modern...
    Clearview AI Alarm - NY Times Report Says "Might End Privacy" on Jan 20, 2020
    Over the weekend, the NY Times released a report titled "The Secretive Company That Might End Privacy as We Know It" about a company named...
    Favorite Camera Manufacturers 2020 on Jan 20, 2020
    The past 2 years of US bans and sanctions have shaken the video surveillance industry but what impact would this have on integrators' favorite...
    "Severely Impacted" Mercury Security 2020 Leap Year Firmware Issue on Jan 17, 2020
    One of the largest access controller manufacturers has a big problem: February 29th. Mercury Security, owned by HID, is alerting partners of the...
    Apple Acquires XNOR.ai, Loss For The Industry on Jan 16, 2020
    Apple has acquired XNOR.ai for $200 million, reports GeekWire. This is a loss for the video surveillance industry. XNOR.ai stunned the industry...
    Installation Course January 2020 - Last Chance on Jan 16, 2020
    Thursday, January 16th is your last chance to register for the Winter 2020 Video Surveillance Installation Course. This is a unique installation...
    Halo Smart Vape Detector Tested on Jan 16, 2020
    The Halo Smart Sensor claims to detect vaping, including popular brand Juul and even THC vapes. But how well does it work in real world...