Camera Color Fidelity Shootout

By: Figen Bekisli, Published on Sep 04, 2013

The surveillance industry is obsessed with more and more pixels. But color fidelity - accurately rendering yellow as yellow or blue as blue - can be critical for identifying individuals or objects.

We decided to test 5 camera manufacturers - Axis, Avigilon, Bosch, Dahua and Sony - to see how faithful their cameras could reproduce color.

The Test

We used a ColorChecker (aka Macbeth chart) and shot out all cameras side by side simultaneously. Here's a preview of the results with the models blacked out.

This was a fairly simple low light indoor scene but still notice how much color fidelity varied across them.

Scenes

Moreover, we tested in a variety of conditions including different forms of outdoor street lighting to see how LED, mercury vapor, and sodium lights impacted performance.

We concluded with real world examples of a subject wearing different colored shirts.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Here's one example of a major manufacturer who made a range colors look basically the same:

Contrast to another major manufacturer who handled the same scene, same time dramatically better:

Who Won?

Here are our key findings from the test:

  • Avigilon's H3 1MP and Axis' M1114 had the most issues in our tests, with difficulty in nearly all scenes, especially difficulty differentiating between bright colors.
  • The Bosch NBN-733V and Sony SNC-VB600 were most accurate and consistent across scenes.
  • Low light conditions (~1 lx) generated less accurate colors for most of the cameras tested, with dark colors especially more difficult to discern.
  • Indoors, in full light, few problems were present, aside from Avigilon and Axis issues mentioned above.
  • Fluorescent and LED lights produced relatively true colors compared to mercury vapor and sodium lights.
  • Mercury vapor and sodium light created the most discoloration and differentiation issues, resulting in greenish and yellowish tints, respectively.
  • WDR improved color fidelity in all scenes. In some cases, colors became slightly more washed out with WDR on, however, they were generally easier to differentiate. Notably, WDR had little to no effect on color fidelity in the Sony VB600, which was true regardless of setting.
  • We found automatic white balance settings performed better in all scenes than using light-specific modes. 

Recommendations

Users seeking truest color in a wide variety of scenes should consider Bosch and Sony, as both were strong under the widest variety of light levels and types. Both the Avigilon H3 1MP and Axis M1114 had numerous problems faithfully representing colors, and should be avoided in these applications.

We recommend using automatic white balance as it results in best performance under most conditions. Specific modes and manual settings should be used with caution as they may reduce fidelity as light changes throughout the day. 

Overview Screencast [WATCH THIS!]

Take 5 minutes and let us show you all the key findings in this video screencast:

White Balance Settings

All images in this test are taken using automatic white balance settings. While a number of cameras offered multiple modes in order to compensate for different lighting types, we found automatic actually offered best performance. For example, in the case of Sony, while the camera offers modes specifically for mercury or sodium lighting, the camera essentially did not need them, staying true on their default automatic mode. 

Additionally, users could manually adjust white balance to compensate for harsh colored lighting such as sodium. However, unless this is turned on and off on a schedule, adjusting to compensate for yellow light at night would tint daytime video violet, as red and blue must be increased.

For these reasons, automatic white balance is recommended unless lighting problems are constant, 24/7, without change, in which case manual white balance could be attempted.

Indoor Lighting

We tested six cameras under three different indoor lighting conditions. These tests were performed under fluorescent office lighting, very common in commercial buildings.

Interior fluorescent, ~160 lx

Color fidelity in most cameras was fairly true. The Axis M1114 had the most severe problems, with yellow, light green and other lighter colors nearly indistinguishable. Additionally, light gray tones at the bottom row appeared white. Avigilon H3-B2 experienced similar problems, though to a lesser degree. Colors that had significant issues were highlighted on the charts below. The colors on the remaining four cameras were truer, with Axis Q1604 being more vibrant than the other three. 

30 lux

When the light was reduced to 30 lux, slight color changes occurred in all cameras. The colors were less vibrant but the distinguishability observed with full light was still present. Notably, the M1114 improves, with colors more discernable than in full light.

Low Light, ~1 lx

At 1 lux, low light conditions and noise greatly affect the color performance of the cameras. In the Avigilon H3-B2 camera, most darker colors appeared black (highlighted). Colors turned greenish in the Axis Q1604 and Dahua HF3101N, the latter being affected more drastically. Colors in the VB600 begin to wash out at this light level. Dark red appeared as brown in both the Axis Q1604 and Sony VB600. The M1114 improved yet again, with colors most true at this light level. The Bosch NBN-733V remained most true under all light conditions.

We also did some color tests using a person wearing different colored t-shirts under the same lighting conditions and FOV. This way we could see how well MacBeth Chart color results match with more real objects. Below are some darker color t-shirts which appear as black with Avigilon H3-B2, consistent with the MacBeth chart results. The results of the Bosch NBN-733V are also added for comparison of the worst and best performance in this scene.

Outdoor Daytime

In full sun, all cameras experienced issues. The Avigilon H3-B2 and Axis M1114 performed similarly to indoors, with lighter colors and gray tones washed out. Colors in the Q1604 were pale, with light grays hard to discern. For the NBN-733V, light green and yellow were difficult to distinguish. The VB600 displayed bluish green (top right) and cyan (bottom right) almost the same. 

Since bright green, yellow, and orange were among the most washed out colors in the Avigilon H3 and Axis M1114, we tested these colors in shirts on our subject. Though still washed out in places, these colors are easier to discern on our subject since reflected light illuminates folds and wrinkles of the shirt much less harshly than the bright direct sun overhead. The MacBeth chart is a single, flat surface, so is illuminated only by this harsh light, resulting in poorer fidelity.

Outdoor Lights

We also tested under three different outdoor lighting types, in order to see what effects each had on fidelity.

LED

Since LEDs produce bright white light, it intensified issues in the Avigilon H3-B2 and Axis M1114, which both had difficulty distinguishing many colors on the chart. The remaining four cameras handled the color fidelity well, similar to our indoor test.

These images show four of the most difficult colors from our test chart, (gray, bright green, yellow, and orange) on our subject for the cameras H3-B2, M1114 (two worst) and Sony VB600 (one of the best). Discerning one from the other is difficult under the bright white LED light for both H3-B2 and M1114 while VB600 doesn't have any issues.

Mercury Vapor

Mercury vapor lamps, another common outdoor choice, produce a bluish-green tint. This can be seen in the Q1604 and HF3101N, which experienced some discoloration with a more greenish tint. Other cameras were much the same as under LED lighting.

Light colors were washed out for Avigilon H3-B2 and Axis M1114 while darker colors were distinguishable in our t-shirt tests under mercury vapor. This result is consistent with the MacBeth Chart.

 

Sodium Vapor

Sodium vapor lights are notorious for having poor color rendition, due to the strongly orange light they produce. Under a sodium lamp, discoloration was significantly worse for Dahua HF3101N and the Axis Q1604. Although all cameras yielded worse results relative to other outdoor lighting conditions, Sony performed more satisfactorily in terms of both color fidelity and distinguishability.

The significant effect of the yellowish tint with Dahua HF3101N under sodium vapor light can be seen by comparing images of five different colored t-shirts below. Avigilon H3-B2, which showed significantly washed out colors, and the NBN-733, which remained true in this scene, are shown below for comparison.

WDR ON vs. OFF

Generally, color fidelity was better with WDR on. 

Indoor

First, in our indoor scene, the Q1604 improved with WDR turned on, with colors more saturated and truer.

Notably, Sony remains relatively unchanged, as it did under all lighting styles. Dark colors were slightly truer, though others look nearly identical.

This t-shirt example shows the differences in bright and dark colors in the Q1604. Much like the MacBeth chart shows, bright green is washed out with WDR off, while it is clearly visible when turned on. Darker colors, such as red in the example below, are not a problem.

Sodium Vapor

Under sodium vapor, the harshest lighting style in our test, WDR had the largest effect in the Q1604. Much of the test chart was desaturated when WDR was turned off. However, with WDR on, the yellow tint of the sodium vapor lighting is much more pronounced.

The comparison below demonstrates these issues using our subject in different colored t-shirts. With WDR off, bright green is extremely washed out, appearing white. However, turning it on, the entire scene becomes tinted yellow, including his skin tone, and the shirt looks much more yellow than green. Dark colors are much less of an issue, though the tint remains.

 

Test Parameters

For all cameras, we used the same camera settings.  Brightness, sharpness, and contrast were default. The exposure setting was 1/30 s and white balance was automatic. Below are the firmware versions we used in this test:

1 report cite this report:

Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low light models from 10 manufacturers: Increasingly, each manufacturer...
Comments (42) : PRO Members only. Login. or Join.

Related Reports

Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
Hikvision Dual Lens Face Recognition Camera Tested on Nov 19, 2019
Hikvision's Dual Lens Facial Recognition camera, claims that it "adopts advanced deep learning algorithm and powerful GPU to realize instant face...
Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low light models from 10 manufacturers: Increasingly, each manufacturer...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Rhombus Cameras, VMS and Analytics Tested on Nov 06, 2019
Rhombus boasts they have created "the new standard in Enterprise, cloud-managed video security" and told IPVM in January 2019 they offer twice the...
Avigilon Appearance Search Tested on Oct 30, 2019
Avigilon Appearance Search claims that it "sorts through hours of video with ease, to quickly locate a specific person or vehicle of interest...
Illustra Pro Gen3 4K Camera Tested on Oct 23, 2019
Johnson Controls has released the latest generation in their Illustra Pro line, the Pro Mini-Dome Gen 3, a non-OEM model claiming to "optimize...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Pelco Sarix Pro3 Camera Tested on Oct 16, 2019
Pelco has released their Sarix Professional Series 3 cameras, claiming "more security detail in challenging scenes with excellent low light and...
Avigilon H5A Analytic Cameras Tested on Oct 07, 2019
Avigilon has released its H5A analytic cameras, claiming to "detect more objects with greater accuracy even in crowded scenes." We tested the...

Most Recent Industry Reports

Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
Glass Doors and Access Control Tutorial on Nov 21, 2019
One of the biggest access challenges are locking and securing glass doors. Unlike wood or steel doors that can be modified to work with...
Avigilon H4 Intercom Tested on Nov 20, 2019
Avigilon is well-known for video surveillance and access, but how well does the company's intercom work? We purchased and tested Avigilon's H4...
The Cowardly, Greedy "Leaders" of Video Surveillance - SIA on Nov 19, 2019
The video surveillance industry suffers from cowardly, greedy 'leaders' focused on maximizing easy money while undermining public trust. The...
Hikvision Dual Lens Face Recognition Camera Tested on Nov 19, 2019
Hikvision's Dual Lens Facial Recognition camera, claims that it "adopts advanced deep learning algorithm and powerful GPU to realize instant face...
Top Manufacturers Gaining and Losing 2019 on Nov 18, 2019
2019 has been an explosive year for video surveillance, with the world's two largest manufacturers, Dahua and Hikvision, being sanctioned for human...
Hidden Camera Detectors Tested on Nov 18, 2019
Hidden cameras are a growing problem as cameras become smaller, cheaper and easier to access. However, some companies claim to be able to detect...
Wyze Fires Back at JCI - Your Patents Are Invalid, Pay All Of Our Costs on Nov 18, 2019
Goliath JCI targeted startup Wyze this summer alleging the fast-growing consumer startup was violating a slew of JCI's patents. Now, Wyze has...
ADT Stock Surges - "Leading The Commercial Space" on Nov 15, 2019
Don't call it comeback... but maybe call it a commercial provider. ADT, whose stock dropped by as much as 2/3rds since IPOing in 2018, has now...