Analytics vs Rain: Axis, Bosch & Sony

By: Ben Wood, Published on Oct 21, 2013

Rain. This was a key objection to our Camera Analytics Test: Axis vs. Bosch vs. Sony. Members rightfully noted it is one thing for an analytics to do well indoors and outdoors at night but what about in the rain?

In this report, we share our findings of testing the same camera analytic in moderate to heavy rain. Here's what the day looked like:

We set up crosslines / tripwires from 20' to 200' away from our cameras.

Additionally, we tested a crossline perpendicular to the camera from 20' to 200' away.

Here are our key findings from this test:

  • No false positives were generated due to either rain (moderate-to-heavy) or droplets falling from camera housings.
  • Cross line performance was slightly reduced at long ranges (at and over ~150') in rain, when compared to the results from our Camera Video Analytics shootout
  • With a human subject, the Bosch NBN-733V's IVA and Axis Crossline Detection started to have missed activations at 150' and completely missed activations at 200'. With no rain conditions, the true alert rate was 100% until 150' and 200' for Axis Crossline and Bosch IVA, respectively. Detection success rates of Sony SNC-VB600's VMF continued to be low even at close ranges (70% at 20', 40% at 45' and 0% at 100') consistent with the no-rain results. 
  • When the object was a vehicle, no major differences in the detection performance of each camera were observed, compared to the test in no-rain condition.  

Recommendations

In addition to our overall recommendations of the previous report, these tests show that rain and other weather conditions will also be an important factor to consider when designing a reliable cross-line detection system. The maximum detection distance will be reduced in rain and it should be taken into account, together with other factors, such as mounting location, FOV and lighting conditions. Particular attention is needed when the target object is crossing an imaginary tripwire at long distances over 100-150' away.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

However, false positive / alerts, while understandably feared, did not demonstrate increased problems due to the rain.

Test

We tested the cross line analytics in two common outdoor scenarios:

Tripwire

First, we began with setting a virtual tripwire along our parking lot/driveway, as shown in the overhead view below. 

Our subject crossed the tripwire 10 repetitive times at various distances from 20' to 250' away from the camera.

At 20', both Axis P3354 and Bosch NBN-733V detected with full accuracy, while Sony SNC-VB600's success rate was 7/10.

At distances between 20' and 75', success rate of VB600 decreased gradually and it missed all activations at 100'. P3354 and NBN-733V continued to perform reliably at this range.

At 150', both the P3354 and NBN-733V started to miss some activations. This is lower performance from both when compared to their accuracy at this range in our previous no rain test.

At 200', none of the cameras triggered at all. In clear conditions, the NBN-733V was found to be 100% accurate 200'.

Detection success rates of each camera from the virtual tripwire tests have been tabulated below. Check marks mean 100% success rate, while an X denotes full failure to detect. Since we have not observed any false alerts in this test, success rate is based on true alerts in the summary table.

Vehicle on Driveway

We also tested the accuracy of the crossline analytics of three cameras, targeting vehicle detection at three distances; 25', 100' and 250'. This scene was similar to the tripwire test, but lines were set up on the driveway, across the FOV.

Neither the Axis P3354 or Bosch NBN-733V missed any of the vehicle activations at any of the three distances. The Sony VB600, on the other hand, had missed activations even at the closest test range of 25', and gradually more at longer distances. These results were similar to what we saw in the no rain test. Therefore, we have not observed any effect of the rain in the detection range of bigger objects, such as vehicles, until 250'.


At ~100' Sony's accuracy drops to ~50%.

Finally, at 250', the SNC-VB600 is unable to detect our vehicle at all.


The table below summarizes overall performance of vehicles in the rain:

 

1 report cite this report:

Axis vs Sony Super Size Shootout (Q1659 vs SNC-VB770) on Sep 11, 2017
Super low light, super sized sensor cameras are a growing trend. In the past...
Comments (7) : Members only. Login. or Join.

Related Reports

Camio Presents Coronavirus Social Distancing Analytics on Apr 20, 2020
Camio presented its social distancing analytics for responding to coronavirus...
Video Analytics 101 on Mar 16, 2020
This guide teaches the fundamentals of video surveillance...
BriefCam Video Analytics Tested on Jan 06, 2020
BriefCam, acquired by Canon in 2018, is one of the most commonly used video...
Avigilon Social Distancing Analytics Tested on Aug 26, 2020
Avigilon released its social distancing analytics in response to the...
Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
Bosch / Milestone Forensic Search Tested on Jan 08, 2020
Bosch's Forensic Search Milestone plugin integrates Bosch IVA and EVA...
Uniview Heat-Tracker Temperature Screening Series Examined on Apr 22, 2020
Uniview is marketing #UNVagainstCOVID19 with their Heat-Tracker series,...
Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low...
Dynamic vs Static IP Addresses Tutorial on Apr 16, 2020
While many cameras default to DHCP out of the box, that does not mean you...
Integrators Rising Against Coronavirus on May 27, 2020
IPVM integrator statistics make it clear - Coronavirus's impact on business...
Avigilon H5A Analytic Cameras Tested on Oct 07, 2019
Avigilon has released its H5A analytic cameras, claiming to "detect more...
Use Access Control Logs To Constrain Coronavirus on Apr 09, 2020
Access control users have included capabilities that are not commonly used...
Hazardous & Explosion Proof Access Control Tutorial on Feb 27, 2020
Controlling access to hazardous environments requires equipment meeting...
Hikvision Salespeople: We Don't Need A Blackbody on May 13, 2020
Dahua jumped out on its cross-town rival selling fever cameras but Hikvision...
Latest London Police Facial Recognition Suffers Serious Issues on Feb 24, 2020
On February 20, IPVM visited another live face rec deployment by London...

Recent Reports

OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...
China Bems Temperature Measurement Terminal Tested on Sep 22, 2020
Guangzhou Bems (brand Benshi) is the manufacturer behind temperature...
Axis Exports To China Police Criticized By Amnesty International on Sep 21, 2020
Axis Communications and other EU surveillance providers are under fire from...
Milestone XProtect on AWS Tested on Sep 21, 2020
Milestone finally launched multiple cloud solutions in 2020, taking a...