Bosch Person / Car / Bike / Truck Analytics Tested

Author: Ethan Ace, Published on Jun 05, 2015

Automatically identify what objects are persons vs cars vs bikes vs trucks. That is the new feature and claim from Bosch in their newest IVA analytics (6.10 version). 

We first tested Bosch IVA here. With this new feature, we wanted to see how accurately this worked.

This video shows the basic setup process we used before testing:

We tested these analytics on multiple cameras in a busy outdoor scene, to answer these questions: 

  • Are cars, trucks, people, and bikes reliably detected and classified?
  • What objects are missed most often?
  • How do busy scenes impact performance?
  • Are VMSes able to receive these events distinctly?

************* ******** **** ******* *** ******* ** **** ** ***** vs ******. **** ** *** *** ******* *** ***** **** Bosch ** ***** ****** *** ********* (*.** *******). 

** *********** ***** *** ****. **** **** *** *******, ** ****** ** *** *** accurately **** ******.

**** ***** ***** *** ***** ***** ******* ** **** ****** testing:

** ****** ***** ********* ** ******** ******* ** * **** outdoor *****, ** ****** ***** *********: 

  • *** ****, ******, ******, *** ***** ******** ******** *** **********?
  • **** ******* *** ****** **** *****?
  • *** ** **** ****** ****** ***********?
  • *** ***** **** ** ******* ***** ****** **********?

[***************]

Key ******** 

*****'* *** ****** ************** *** **** ******** **** **** *** people. ** *** ******** ******, ********* *** ******* ************** ** these ******* ****** * ~***' ***** ** **** *** ********, ******* *** objects.

********* ** ****** *** **** ********, **** ******** **** ******* together ********** ** * *****, *** **** ******* ****** ********** as ****.

******** **** ********** ***** ********, **** ****** ******* **** ********* **  and **** **** ******** ** *****. ****** ******** **** ************ missed ** ********** ** ******* **** ** ******.

*** ******** *********** *** ****** **************, ********* ***** ** ******* multiple **********/******** *****, ** **** ** *** ** **** ****** for ****** *********. *********** *** ****, ** ***** ************ *** known, *** ******* ******** ** *** ****/******** ***********.

***** *** ****** ********** **** ******* ******** ****** *** ********* XProtect, **** ******** ***** ******** ********** (*.*., ****** ********* **. vehicle *********, ***.).

***************/******

**** ***** ***** ***** ****** ************** *********, *****'* *** ********* take * **** ****** ** ******** ** ****** *** ******** providers **** ********/******* *** *******, ***** **** ******* ***** ************ for **** ****.

*******, ***** ****** ** ******* ** ***********, *** ***** ***** these ********* *** ********, **** **** ******** ****** ********** ******* objects ** ***** *** ** *************. ************, ** ********* ******** expectations ** ****** **. ******** (**** **** *** ******), ** proper ********* ** ******** ********* *****.

Firmware ************

***** ************ ** *** *** ********* ******** ** ******** *.**, available *** **** ******* ** ******* ** *** ***** ****. Firmware ** ********* *** ******** **** *** ***** ******** *******.

VMS ***********

*** ******* ****** ******** ****** ** ******* ******** ****** *** each *** **** ******* ** *** ******. **** ** ***** in *** ***** ****, ****, **** ****, ******, *** ******* "Detect *** ******" ***** ***** **********.

 

********* ******** ******** ** ** ** ******** ***** ********* ****** from ***** *** *******, ****** **** ***** *** *** ****** from *** ****** *** **** ** ********** **********.

******** ******* ****** *** ***** *** *** ******* ***** ******** events, **** ***** ****** *********.

Calibration *******

*********** ******** ***** ** **** ***** *********, *******, ***/** ****** in *** ******'* ***** ** ****. ** ********* *********** ***** Google **** ************ *** ***** ********* *** ***** ** ** be ****** ********, ****** * *** **** ** ****** ************.

**** ******* ** ******** ** *** ***** *****:

Detection ***********

**** ****** ******** ** *** *****, ****, ******, *** ****** are ********** ********* >**% ** *** ****. *** *******, ****** flags *** **** *** ****** *** ** **** ********* ******** to *** ********** ******* ** **** *****:

********* *** ******** *** ******, **** **** ******** ******* ** the *****.

**** *** ****** **** ********* ********** ** *** ******** ** cases, ****** ***** *** **** ******* **** ******, ********* ** size (*****):

*******, **** * **** (******** ** *********) *** *******, ** was ********* ********** ** *** *****, **** ** *** *** seen ****:

Misclassification ******

*******, ****************** **** ****** *** *****, *** ** * ****** extent, ******.

******* ******* ** "******"

**** ********, ****************** **** ****** ** ******** ******* ******* ******** when ***** *** **** ******** ** *** *****, ********* ** a ****** ****** ****** ** *** ******. **** *** **** often *** ** * ***** ** **** ********* ** * truck, **** ****:

** *** ************* *******, *** *********** ******* **** *** ****** is ****** **** *****. *********, ***** **** ** **** ******* a ******* ** *******, ********** ** *** ****. *******, ** some **** *********** ************ (*.*., ******* ** ******* ***** ****** are **********, ****-**** *********, ***.), ********* ** *** ******** ******* is *********.

***** ******* ********* ** *****

***** **** *** **** ****** *********** ****** ****, **** *********** every ***** ****** **** ********* ** * **** ** *** camera ** *** ***** ** *******. 

*** *******, * ***** ******* **** * ********:

** ******* * ******:

**** ** **** ** ***** *****, *** ****** ** *******, in * ******* ******* ** ******* ****** * ****, ****** the ****** *** *** *****************.

*******, ** *** ***** ****, *********, * *** *** ********** as * ******* ** ****:

 

Cameras **** 

*** ******* **** **** *** **** ****:

  • ***** ***-*****: *.**.****
  • ***** ***-****: *.**.****

******* ******** ****** *.* *** *** **** *** *********.

Comments (14)

I'm curious how it would work with a different FOV. Two things I notice:

1) The camera seems relatively low, it looks like maybe 8-9' high. I would expect improved results from a higher vantage point with a little more downward tilt of the camera

2) The FOV seems exceptionally wide and you appear to be getting barrel distortion from the lens. Looks like a ~3mm lens. I'd suggest trying something no less than 4mm to get a flatter image and to keep the overall horizon line and geometry more squared up.

What was the logic in using this FOV? Was it more or less random in the sense you picked a "typical" scene, or did it conform to some recommendations from Bosch?

Are the analytics included with the camera purchase similar to the way Samsung bundles them in with the WiseNetIII. Overall they appear to work fairly well. It will be interesting to see how they perform over a longer period of time. I have had issues with "in camera" analytics where they just stop sending alerts and the camera needs to be rebooted.

They're included on all 7000/8000 series cameras at no charge (5MP starlight, 1080p HDR, 4K, etc.), but not on the 5000 series.

I think that Bosch is trying to do too much.

Avigilon approach of people/cars is much more reliable as I don't see any tech today that can really detect a the difference between a person and a bicycle.

Its better to do less in a good way than to do more poorly.

Finally, when a bike (bicicyle or motorbike) was present, it was correctly classified in all cases...

However, misclassifications were common for bikes...

Meaning other types were commonly misclassified as bikes, since no bikes were actually misclassified?

Ethan could you post some video clips from the intersection shot showing objects being detected? Also could you show images/video of the calibration setup for the intersection?

Just following up with the request for some video clips from the street shots.

I would really like to know detection ranges in day and night scenarios, with the lens length or angle used. That to me are the most important numbers along with reliability. Getting an idea of reliable ranges gives you an idea of how many cameras are needed for coverage.

In this test we were trying to get an idea of how well classification worked, not intending this to be a redo of their IVA detection performance. We tested that here (and in the rain). That being said, in this scene, I'd say detection of humans was reliable out to about 150' using the Bosch 5MP, or about a 285' HFOV, something like this:

I know I asked already asked but could you please post some video so we can see the detection range.

The issue with video clips here is that Bosch doesn't embed bounding boxes in the video (like Avigilon no longer does), and to my knowledge, no one has integrated the bounding boxes via metadata other than their own VMS, which we don't use. So we can see them live using Configuration Manager, but Genetec (which fully integrates the separate rules, sans bounding boxes) doesn't display the box.

So I can show you clips and you can see what is in the scene, but it's not going to show you bounding boxes. It's not going to show you events as they happen, either. Video associated with each event can be exported, but multiple events can't be exported with one stretch of video.

I will look through what we have saved as far as config/screen captures of Configuration Manager, as that's the only thing that'll show bounding boxes and path.

The cameras tested here don't support The Bosch CPP6 platform on which this IVA version is supported, therefore tests are i"not really relevant. Re-test on the Starlight 8000 and would be interesting to see results.

1. We used a Starlight 8000, the NBN-80052, as we mentioned in the report. The images in the report are taken from that camera.

2. As per Bosch's documentation IVA 6.10 is supported on more than CPP6.

IP cameras from Bosch are grouped by their common
product platform (CPP) generation. IVA 6.10 is
available on CPP4 and CPP6 based IP cameras

The NBN-932 (now numbered NBN-71027) is CPP4, and supported.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

Stealth / UCIT - Remote Video Monitoring Provider Profile on May 18, 2018
Can 2 remote video monitoring companies, Stealth Monitoring from the US and UCIT from Canada combine to impact the market and compete in a changing...
Nortek Acquires IntelliVision on May 08, 2018
One of the largest intrusion manufacturers, Nortek, has acquired the self-proclaimed 'Leader in AI-Based Video Analytics Software',...
Hikvision's Minority Analytics on May 08, 2018
Hikvision has developed and is deploying minority analytics inside China, automatically identifying and categorizing individuals as ethnic...
Hikvision VMD And Intrusion Analytics Tested on May 04, 2018
VMD worked poorly on Hikvision cameras, new IPVM testing found. However, Hikvision ships analytics on practically every IP camera, with intrusion...
JCI / Tyco VideoEdge NVR Profile on May 03, 2018
JCI (formerly Tyco) is one of the largest players in the global security industry, both as a manufacturer and an integrator. The company's most...
FLIR Launches Saros on May 01, 2018
Has FLIR solved the video intrusion / remote monitoring problem or have they created an overkill, overly expensive device? FLIR has launched...
Netwatch / NMC Mega Deal Targets Global Remote Video Monitoring on Apr 27, 2018
Big money has entered the remote video monitoring market. While remote video monitoring has been done for more than a decade, the market has...
Best and Worst ISC West 2018 on Apr 16, 2018
ISC West 2018 had strong attendance, modest overall new products, and a surge in Artificial Intelligence marketing. First, here are 20+...
Eocortex / Macroscop VMS Company Profile on Apr 09, 2018
Eocortex is the international brand of Russian VMS manufacturer Macroscop. Macroscop was founded in 2008, and the Eocortex name created in 2013. We...
VMS New Developments Spring 2018 (Avigilon, Exacqvision, Genetec, Hikvision, Milestone, Network Optix) on Apr 04, 2018
What's new with VMS software? In this report, we examine new features and releases for Spring 2018 to track different areas of potential...

Most Recent Industry Reports

Stealth / UCIT - Remote Video Monitoring Provider Profile on May 18, 2018
Can 2 remote video monitoring companies, Stealth Monitoring from the US and UCIT from Canada combine to impact the market and compete in a changing...
Cybersecurity for IP Video Surveillance Guide on May 18, 2018
Keeping surveillance networks secure can be a daunting task, but there are several methods that can greatly reduce risk, especially when used in...
Forced Entry / Duress Access Tutorial on May 17, 2018
Even though access control normally keeps people safe, tragedies have revealed a significant issue. If users are forced to unlock doors for...
ADT Stock Drops 50% Since IPO on May 17, 2018
It has been a brutal 4 months for ADT. They first expected to IPO at ~$18. They IPOed at $14, dropping immediately to $12.39 And now, not even...
Dahua 12MP Fisheye Camera Tested (NK8BR4) on May 16, 2018
Continuing our coverage of 12MP sensor fisheye cameras, we bought and tested the Dahua NK8BR4, examining: Default vs. Optimized...
Worst Manufacturer Technical Support 2018 on May 16, 2018
5 manufacturers stood out as providing the worst technical support to 190+ integrators in new IPVM results. These integrators answered: In the...
Installing Cameras in Plenums Tutorial on May 15, 2018
There is often confusion about plenum ceilings, with misinformation about what is required when running cables through them and mounting cameras...
Top Benefits Of Attending Trade Shows (Statistics) on May 15, 2018
150 integrators told IPVM: What are the top benefits of going to trade shows? The clear top 2 responses in order: (1) Networking (2) New...
Measuring For Security Installation Guide on May 15, 2018
Accurate measurement is a fundamental skill, yet many installers do not know how to do it. Using these tools are a key skill needed for security...
Arecont Files Ch.11, Agrees To Sell To Turnaround Specialist on May 14, 2018
The long-anticipated sale of Arecont Vision is finally happening. After raising $80 million in debt in 2014, a failed sale in 2017 and the...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact