Bosch Starlight Tested vs Axis

Author: Ethan Ace, Published on Mar 03, 2013

[UPDATE June 2013: We tested the Bosch Starlight camera against the new Sony Gen 6 camera. When doing so, we upgraded Bosch to its newest available firmware (5.80). We found this change (moving from 5.70 to 5.80), resulted in significant improvements in image quality and bandwidth consumption. The March 2013 test has been updated inside.]

Low light performance is critical for high end surveillance cameras. Delivering high quality, detailed low light images without any added light is highly valued and a key competitive differentiator.

In the past two years, Axis has boasted 'Lightfinder' technology in their top tier camera line, claiming quality color images even in extremely dark environments. And those cameras have performed well in IPVM shootouts - see our tests of the Q1602 and Q1604. Plus, Axis has integrated Lightfinder to many new cameras, helping to differentiate and justify its premium prices.

Now, Bosch has launched a new 'Starlight' series claiming exceptional low light performance.

Lightfinder vs Starlight

We wanted to see how they would compete so we matched up Axis's Q1602 and Q1604 vs Bosch's Starlight NBN-733V and their NBN-932V 1080p box camera.

We did series of tests indoors at very low light levels including 0.1 lux, 0.5 lux and outdoors from 5 lux to less than 1 lux.

[UPDATE: The report now includes comparisons of image quality and bandwidth for Bosch's new 5.80 firmware.]

Key Findings 

Here are our key findings:

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

  • Low light performance equal or better than leading low light cameras from Axis (Q1602 and Q1604), especially with the upgraded 5.80 firmware.
  • Superior low light performance when using Bosch's Vibrant Mode, over the default one, to increase gain, saturation, and contrast.
  • Modest motion blur present in very low light scenes. Bosch says it is a result of their intelligent digital noise correction, not slow shutter.
  • Bandwidth consumption extremely impressive and better than comparable Axis camera across the board with the most dramatic savings in low light.
  • Firmware 5.80 greatly improves motion blur and noise levels in low light scenes. Note that images in this test are using 5.70 firmware, except where noted in the 5.70 vs. 5.80 section.

Other Key Factors

  • Capable of up to 60 FPS at 720p resolution, though this frame rate is required rarely.
  • Lens Selection: These tests were performed with a Tamron IR-corrected day/night megapixel lens. Bosch recommends its new SR series lenses with these cameras (basically a P iris lens), but we did not have one for the test.
  • Price: The NBN-733V has a street price of approximately $650 USD without integrated analytics, or about $780 with Bosch's IVA on board, not including lens. Adding a lens brings total price to about $750 for the non-analytic version, and $880 for the IVA model. This is below Axis' pricing, with the Q1602 and Q1604 both selling for about $950-1,000 online. Axis' more recent P1354 720p model with Lightfinder is closer in price to the NBN-733V, selling for $800-850, including lens. Though we have not tested this specific model, we expect its performance is on par with the Q1604, since Axis rates its low light performance the same.
  • Multiple Starlight Models: In addition to the NBN-733V, Bosch will be releasing two more starlight models in Q1 2013, in rugged and vandal-resistant dome form factors. These options help to fill out the line compared to Axis, which offers Lightfinder in box, as well as indoor and vandal resistant dome form factors.

Recommendations

The NBN-733V is a competitive choice for low light applications, at an attractive price point. In some scenes, it outperforms Axis. However, users should be aware of its moderate motion blur issues, which Axis did not exhibit in our tests, and may be a problem for high-motion areas.

While the Bosch 1080p camera is a top tier performer in previous low light shootouts, the new 720p is so much better that it makes the 1080p look bad. If you are making a Bosch vs Bosch decision, the tradeoffs between the higher pixel count of the 1080p and higher price should be weighed against the 720p's much stronger low light performance.

Market Impact

This helps Bosch more than it hurts Axis. Just a few years ago, Bosch was OEMing Arecont and was a non factor in IP cameras. Now, they have multiple top tier offerings (Starlight plus the 1080p WDR camera). That should help Bosch cameras be more seriously considered. On the other hand, it does not leap Axis, who has been deploying this technology for a year and a half already. The two big questions become: What does Axis do next in low light and when will other manufacturers deliver similar low light cameras?

Axis: The Historical Top Performer

The image below is from our test of the Axis Q1602, where it clearly outperformed other D/N cameras with above average low light capability:

Default vs. Vibrant Mode

As discussed in our Bosch 1080p HDR model test, using default settings, the NBN-733V is desaturated compared to some competitors such as Axis. We tested Vibrant mode with the 733 to adjust color, but found that it also resulted in gains in low light image quality in both color and monochrome modes. The difference between the two modes may be seen in these comparison images, starting at .5 lux, in color mode:

 

At .1 lux in color mode, the difference is more pronounced: 

Vibrant mode impacts black and white as well. In monochrome mode, at .1 lux, vibrant mode results in a noticeably brighter image.

Because of this increase in low light performance and saturation, we recommend users try vibrant mode in their scenes. We have found few, if any, tradeoffs when using this mode. Bandwidth consumption remains approximately the same as in default mode. The only caveat is that images may be moderately noisier, due to the increase in gain, but we found that the increase in brightness outweighed the increase in noise.

Indoor Comparison, Vibrant Mode

In the first of our low light scenes (~.5 lux) in color mode, the NBN-733V provides clearer detail of our subject, though it is noticeably noisier than the Axis cameras. 

Lowering the light to ~.1 lux, the 733 still provides more detail than the other cameras, with more color information available, and the subject's face still somewhat distinguishable.

 

In monochrome mode at ~.1 lux, the 733's advantage diminishes, but the subject's face and letters on the chart are still more visible:

Finally, in full light, we can see the 733 (and 932) is desaturated compared to the Q1604. The blurriness of the Q1602 in this case is simply due to its lower resolution.

Outdoor Comparison

Results in an outdoor low light scene were fairly consistent with our indoor tests, with a few differences. In this example, outdoor lighting was left on, resulting in ~4-5 lux on target. In this scene, the horizontal field of view at the target is approximately as wide as our indoor scene, about 22'.

In this case, the NBN-733V provided the truest color of the cameras tested in a reversal from our indoor tests. Both the 733 and the Q1604 deliver similar detail, though the 733 edges out Axis in handling the light reflected by the chart, which washes out the letters in the Q1604's image, and is especially severe in the Q1602.

Turning off the outside lights, light levels drop to about 1 lux. The NBN-733V and Q1604 again perform fairly similarly, with the Q1604 providing more color, but letter slightly more readable in the 733. The Q1602's performance improves without the strong reflective light, though its lower resolution is a factor in details delivered.

In monochrome mode at 1 lux, performance is again fairly similar. 

Motion Blur Issues

In low light scenes, the NBN-733V exhibited noticeable blurring on moving objects, which worsened as light levels decreased. This was not caused by slow shutter, as the 733's default shutter is 1/60s. Instead, Bosch informs us that this is due to its temporal noise filtering, part of their intelligent digital noise reduction algorithm. This adjusts noise reduction dynamically based on motion in the scene. Users may see this blur in this still image at ~.1 lux:

Download clips of all four cameras at .5 lux and .1 lux to see this effect.

5.80 Firmware Improvements

(Updated, 06/04/2013)

After our original tests, Bosch publicly released version 5.80 of their firmware.  There are two key changes which users should be aware of:

  • Lower noise and brighter low light imaging. Better detection capability, but some details may be obscured by greater digital noise reduction schemes.
  • Lower bandwidth in low motion scenes, especially in low light.

We set up two NBN-733V cameras with identical lenses and settings (Vibrant Mode defaults, standardized to 30 FPS and 1/30s shutter speed) in order to see differences between these two versions. Starting at ~0.5 lx, we can see differences in 5.80. The image is brighter, with a very slight improvement to details seen in the subject. However, the chart becomes slightly less legible. In the 5.70 camera, some of row 5 can be read (PECFD), while in 5.80, row 4 (LPED) is the last row readable.

At ~0.02 lx, however, 5.80 has clear advantages over 5.70. The subject is visible, and the top letter of the chart is legible, while in the 5.70 camera, nothing can be seen but noise.

In full light, both cameras look nearly identical, with no gains in tone or saturation for either firmware:

Bandwidth Comparison 

5.80 has definite advantages over 5.70 in low motion scenes. In our full light scene, consumption was as follows:

  • Firmware 5.80: ~400 Kb/s average
  • Firmware 5.70: ~1.7 Mb/s average
  • Difference: ~1.3 Mb/s (~75%)

In our low light scene, the advantage was even greater:

  • Firmware 5.80: ~1.3 Mb/s average
  • Firmware 5.70: ~7.3 Mb/s average
  • Difference: ~6 Mb/s (~82%)

However, using a stage laser to simulate extreme amounts of motion, the difference is small, only about 100 Kb/s:

  • Firmware 5.80: ~5.7 Mb/s average
  • Firmware 5.70: ~5.8 Mb/s average
  • Difference: ~100 Kb/s (~1.5%)

Based on all of the above factors, we believe users will likely find upgrading the version 5.80 advantageous in most cases. Those using the camera for scenes in which fine details must be read, such as license plates or other markings should test the firmware in place first, as we found some detail in written characters lost in low light scenes with 5.80.

Users wishing to see firmware 5.80 shot out against competitive cameras from Sony and Axis may see our Sony Gen 6 test for comparisons.

Competitive Bandwidth Consumption

Factoring in Bosch's improvements with 5.80, Bosch bandwidth consumption was significantly lower than Axis across the board - in low light, even daytime and high motion scenes. The most dramatic difference was in low light where Bosch's advantage was 10x+.

6 reports cite this report:

Pros and Cons - Automating Firmware Updates on Jul 01, 2015
Firmware and software updates are one of the most tedious tasks in surveillance, so why not make them easier? While other devices, like PCs,...
WDR Camera Shootout 2015 on May 04, 2015
This is the most comprehensive Wide Dynamic Range (WDR) IP camera shootout ever. We tested 10 of the latest generation multiple-exposure true WDR...
Axis Advances Its Best Overall Camera on Jun 17, 2014
While Chinese competitors rush to sell HD cameras at 1/5th to 1/10th the price of Axis, Axis continues to push up market. Axis has announced the...
5MP Super Low Light Tested (Bosch) on May 27, 2014
Low light performance remains the biggest showstopper for multi-megapixel cameras. Test after test, 5 MP and even 1080p cameras are consistently...
Trend: Day/Night Profiles for IP Cameras on Jan 09, 2014
A rising trend in IP cameras is adding different profiles for day and night video. While most manufacturers lock you into only one set of...
Camera Pre-Installation / Bench Testing - OLD on May 04, 2012
There is a fine line between profit and loss on many surveillance projects. If just a few unexpected camera problems arise, the integrator may as...
Comments (19) : PRO Members only. Login. or Join.

Related Reports

Covert IP Camera Shootout - Axis, Hanwha, Hikvision, March, Vivotek on Mar 20, 2019
Covert cameras were one of the last holdout areas for analog cameras. However, in the past few years, IP / HD covert cameras have become...
Axis IR Multi Imager Camera Tested (P3717-PLE) on Feb 18, 2019
Axis has released their first IR multi imager, the P3717-PLE, a repositionable model listing 360° IR illumination and flexible positioning,...
Hanwha Smaller Multi Imager Tested (PNM-9000VQ) on Feb 14, 2019
Hanwha's first repositionable multi imager PNM-9081VQ tested well, but was huge, over 12" wide and weighing in at over 10 pounds. Now, they have...
Bandwidth vs Low Light Shootout - Avigilon, Axis, Bosch, Dahua, Geovision, Hanwha, Hikvision, Uniview, Vivotek on Feb 08, 2019
Nighttime bandwidth spikes are a major concern in video surveillance, but do all manufacturers' cameras perform the same? Are some more consistent...
Sony Favorability Results 2019 on Feb 06, 2019
Sony Favorability amongst integrators improved moderately compared to their 2017 favorability results, with a modest net positive...
Verkada Cloud VMS/Cameras Tested on Jan 28, 2019
Verkada is arguably the most ambitious video surveillance startup in many years. The company is developing their own cameras, their own VMS, their...
Camera Course Winter 2019 - Last Chance on Jan 24, 2019
This is the last chance to register for the Winter 2019 Camera Course. This is the only independent surveillance camera course, based on in-depth...
Testing Bandwidth vs. Frame Rate on Jan 23, 2019
Selecting frame rate has a major impact on surveillance bandwidth and storage consumption. But with smart codecs now common and cameras more...
Testing Bandwidth Vs. Low Light on Jan 16, 2019
Nighttime bandwidth spikes are a major concern in video surveillance. Many calculate bandwidth as a single 24/7 number, but bit rates vary...
WDR Tutorial on Jan 11, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...

Most Recent Industry Reports

IBM / Genetec Surveillance System Investigated Over Philippines Human Rights Abuses on Mar 22, 2019
A lengthy investigation into an IBM video surveillance project in the Philippines, raising concerns IBM helped local police conduct a bloody...
Eagle Eye Favorability Results 2019 on Mar 21, 2019
Eagle Eye has been the biggest spender in the cloud VMS market including (via their owner) acquiring Brivo for $50 million and CameraManager from...
Large Hospital Security End User Interview on Mar 21, 2019
This large single-state healthcare system consists of many hospitals, and hundreds of health parks, private practices, urgent care facilities, and...
Silicon Valley Cybersecurity Insurance Startup Coalition Profile on Mar 20, 2019
Many industry people believe cybersecurity insurance is not worth it, as the voting and debate in our Cybersecurity Insurance For Security...
Covert IP Camera Shootout - Axis, Hanwha, Hikvision, March, Vivotek on Mar 20, 2019
Covert cameras were one of the last holdout areas for analog cameras. However, in the past few years, IP / HD covert cameras have become...
Top Metrics For Ensuring Integrator Profitability - Statistics on Mar 20, 2019
How do integrators ensure the profitability of their projects? As part of our profitability study, 100+ integrators answered the following...
Avigilon Launches 'Renewed Products Program' on Mar 19, 2019
There are lots of 'pre-owned' cars but pre-owned IP cameras? While such programs are common in other industries, in video surveillance, they are...
Hanwha Tax Evasion Probe, Camera Division Implicated on Mar 19, 2019
A Hanwha group subsidiary was raided as part of a tax evasion probe. While a Korean news media report listed the raided entity as 'Hanwha...
Genetec Security Center 5.8 Tested on Mar 19, 2019
Genetec has released Version 5.8. This comes after a wait of more than a year that caused frustrations for many Genetec partners. Our previous...
Retired Mercury President Returns As Open Options President on Mar 18, 2019
Open Options experienced major changes in 2018, including being acquired by ACRE and losing its President and General Manager, John Berman who...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact