Testing Sony's 6th Gen IP CamerasBy Ethan Ace, Published on Jun 03, 2013
Sony's long awaited 6th generation IP cameras are now available. In our 2010-2011 tests, Sony's 5th generation cameras were one of the top offerings of that era. However, the market has advanced in the past few years.
In this report, we share our test results of Sony's 6th generation premium series, specifically the SNC-VB600B. We matched it up against recent entrants from Bosch and Axis that offer some of the best low light and WDR performance on their lines (see our recent Bosch vs Axis low light test).
Indeed, Sony has been making its own waves, talking about how the 6th generation cameras were a major advance in low light imaging.
Here is a preview of the side by side simultaneous shootouts we did:
Here are our key findings:
- Radically improved low light performance compared to the 5th generation, but modestly lags behind competitive low light models from Bosch and Axis.
- WDR performance on par or better than other top true WDR cameras and consistent with previous generation V series models.
- VBR is added to the 6th Gen but bandwidth jumps to extremely high levels in low light or high motion scenes. However, daytime low motion bandwidth was average, on par with Axis, though higher than Bosch. The default is CBR at 8 Mb/s. [[NOTE: Sony added a VBR cap in firmware update 2.2]]
[NOTE: Regular IPVM readers may notice that the Bosch looked even better than our previous test with them. This is not an error. Since our last test, Bosch released new firmware that significantly improved the camera's performance. Read the updated Bosch Starlight test report for more.]
Other Key Factors
- The 720p/30fps VB600B is in line with competitor's pricing, selling for about $900-1,000 online, including lens. Bosch and Axis are priced at ~$850 (~$700 + lens) and ~$1,000, respectively.
- Though this test focuses on the 30 FPS VB600B, the VB600 is also available, supporting up to 60 FPS. A 1080p60 model, the VB630, is also available, detailed below. However, both models are far more expensive than HD professional cameras.
The SNC-VB600B is a competitive choice for a 720p low light/WDR camera, outperforming the Axis Q1604 in some scenes. The main sticking point is Sony's implementation of VBR, which will be detrimental in low light and high motion scenes. Users may find that CBR provides a lower average bitrate because of this. Users preferring Sony would do well selecting this camera instead of the similarly priced CH140, as well.
Physically, the Gen 6 cameras are mostly the same as Gen 5, with most differences simply being the location of rear connectors. There are two other main differences:
- Instead of the Compact Flash slot built into Gen 5, new models include an SD slot. SD, SDHC, and SDXC cards are all supported.
- Instead of the Fujinon 2.8-8mm varifocal lens that shipped with Gen 5, Sony has opted for a Tamron model.
Configuration / Camera Web Interface
See our screencast overviewing the Gen 6 web interface. Users should note the following key points:
- Menus have been reorganized since Gen 5 to improve navigation, with fewer menu sections with multiple tabs.
- Most common configuration options, including image quality, WDR, CODEC settings, day/night, and more, are all found in a single menu section, making them easier to find.
- Sony has added main and high profile H.264 encoding, as well as VBR, into Gen 6.
Sony's sixth generation does much help Sony's positioning, as their fifth generation cameras, now 3-4 years old, lagged behind competitors in low light performance. The future E series, which Sony informs us will maintain WDR and low light performance, though with a lower price point, may further strengthen their line. We plan to test the E series upon release.
First, with the cameras forced into color mode, at light levels below one lux, we can see the VB600B is noisier than Axis and especially Bosch, with most of the chart obscured by noise. The subject is unrecognizable in both the VB600B and Q1604, while Bosch provides some level of detail, as well as more legible lines on the chart. This also shows the most striking improvement between Sony's fifth and sixth generations, as the CH140 is nearly completely black at this level.
In monochrome mode, results are similar, with noise levels roughly the same.
In full light, ~300 lx, we can see that images are fairly similar across cameras. The VB600B and Q1604 are most similar in tone and saturation, with the 733 and CH140 more washed out. Some artifacting is visible around the edges of the subject, but this does not affect recognition.
Wide Dynamic Range
In our strongly backlit overhead door scene, the VB600B performs comparably to the past generation Sony CH140 and the Bosch 733V. The Q1604 lags in this portion of the scene.
With our subject in the dark area to the side of the overhead door, the Sony cameras are consistent, while the Q1604 improves, and the NBN-733V performs slightly worse.
We tested the cameras' motion performance in both interior and exterior scenes to look for motion artifacts and blurring.
First, we set up the cameras near an active roadway, with vehicles passing at 40-50 miles per hour. This daytime shot was taken in an area where there was no direct sunlight, in order to minimize issues from glare. Both Sony cameras exhibit some ghosting on the vehicle, especially the wheels, and worse in the CH140. Axis and Bosch did not have this problem, though the Q1604 suffered from overexposure on the brighter areas of the car. (Download this 5s clip)
[UPDATE: Sony says the reason for the blur is because their camera defaults to 'high' WDR using 4 exposures. Sony recommends turning WDR To medium/mid in such scenes that will only use 2 exposure, eliminating a longer exposure and therefore the blur.]
At night, at about .5 lx, all cameras exhibit blur on headlights and tailights, with Sony and Bosch handling these lights about equally, both better than the Axis Q1604. Note that all cameras were standardized to a maximum 1/30s exposure. (Download this 5s clip)
In the sixth generation, Sony added VBR encoding, addressing complaints that they were one of few major manufacturers to allow only CBR. In firmware update 2.2, they added a cap to their VBR implementation. This is key because in low light scenes we found bandwidth jumped to very high levels.
In our still indoor daytime scene, Sony was slightly lower than the Axis Q1604, but higher than the Bosch NBN-733V. Note that we list only consumption for the SNC-VB600B, but found the VB600 to be roughly equal.
- Sony SNC-VB600B: ~1.1 Mb/s average
- Axis Q1604: ~1.3 Mb/s average
- Bosch NBN-733V: ~400 Kb/s average
In our low light scene, the VB600's VBR bitrate jumps drastically, the highest we observed in our tests. Bandwidth was approximately the same regardless of color or monochrome mode:
- Sony SNC-VB600B: ~22.3 Mb/s average
- Axis Q1604: ~19.4 Mb/s average
- Bosch NBN-733V: ~1.3 Mb/s average
Finally, simulating extreme amounts of motion with a laser under 1 lux, Sony remains approximately the same, while Axis and Bosch both jump:
- Sony SNC-VB600B: ~22.9 Mb/s average
- Axis Q1604: ~34.8 Mb/s average
- Bosch NBN-733V: ~7.1 Mb/s average
Other Sixth Gen Cameras
In addition to the 30fps VB600B tested here, Sony offers 720p60 (VB600) and 1080p60 (VB630) models. This increase in frame rate comes at a premium, however, as the VB600 sells for $1,300-1,400, and the VB630 for $1,500-1,600. Compared to Bosch models such as the NBN-733V (~$850-) and the 1080p HDR NBN-932V (~$1,000-1,100), they are priced far higher. We will test the 1080p VB630 vs. other 3MP WDR or low light cameras separately.
We tested the VB630's low light performance against Bosch's NBN-932V. At ~.1 lux, the subject is difficult to detect in the 932V, with no details supplied, and the chart barely visible. However, the VB630 reveals some letters of the chart, with the subject easily visible in the scene:
Sony informs us that they will be releasing 6th generation E series of cameras at a lower price point later this year, which retains low light and WDR performance but removes 60 FPS capability, audio, SD storage, etc. Exact pricing and feature set are not yet available.