Bosch Person / Car / Bike / Truck Analytics Tested

Author: Ethan Ace, Published on Jun 05, 2015

Automatically identify what objects are persons vs cars vs bikes vs trucks. That is the new feature and claim from Bosch in their newest IVA analytics (6.10 version). 

We first tested Bosch IVA here. With this new feature, we wanted to see how accurately this worked.

This video shows the basic setup process we used before testing:

We tested these analytics on multiple cameras in a busy outdoor scene, to answer these questions: 

  • Are cars, trucks, people, and bikes reliably detected and classified?
  • What objects are missed most often?
  • How do busy scenes impact performance?
  • Are VMSes able to receive these events distinctly?

************* ******** **** ******* *** ******* ** **** ** ***** vs ******. **** ** *** *** ******* *** ***** **** Bosch ** ***** ****** *** ********* (*.** *******). 

** *********** ***** *** ****. **** **** *** *******, ** ****** ** *** *** accurately **** ******.

**** ***** ***** *** ***** ***** ******* ** **** ****** testing:

** ****** ***** ********* ** ******** ******* ** * **** outdoor *****, ** ****** ***** *********: 

  • *** ****, ******, ******, *** ***** ******** ******** *** **********?
  • **** ******* *** ****** **** *****?
  • *** ** **** ****** ****** ***********?
  • *** ***** **** ** ******* ***** ****** **********?

[***************]

Key ******** 

*****'* *** ****** ************** *** **** ******** **** **** *** people. ** *** ******** ******, ********* *** ******* ************** ** these ******* ****** * ~***' ***** ** **** *** ********, ******* *** objects.

********* ** ****** *** **** ********, **** ******** **** ******* together ********** ** * *****, *** **** ******* ****** ********** as ****.

******** **** ********** ***** ********, **** ****** ******* **** ********* **  and **** **** ******** ** *****. ****** ******** **** ************ missed ** ********** ** ******* **** ** ******.

*** ******** *********** *** ****** **************, ********* ***** ** ******* multiple **********/******** *****, ** **** ** *** ** **** ****** for ****** *********. *********** *** ****, ** ***** ************ *** known, *** ******* ******** ** *** ****/******** ***********.

***** *** ****** ********** **** ******* ******** ****** *** ********* XProtect, **** ******** ***** ******** ********** (*.*., ****** ********* **. vehicle *********, ***.).

***************/******

**** ***** ***** ***** ****** ************** *********, *****'* *** ********* take * **** ****** ** ******** ** ****** *** ******** providers **** ********/******* *** *******, ***** **** ******* ***** ************ for **** ****.

*******, ***** ****** ** ******* ** ***********, *** ***** ***** these ********* *** ********, **** **** ******** ****** ********** ******* objects ** ***** *** ** *************. ************, ** ********* ******** expectations ** ****** **. ******** (**** **** *** ******), ** proper ********* ** ******** ********* *****.

Firmware ************

***** ************ ** *** *** ********* ******** ** ******** *.**, available *** **** ******* ** ******* ** *** ***** ****. Firmware ** ********* *** ******** **** *** ***** ******** *******.

VMS ***********

*** ******* ****** ******** ****** ** ******* ******** ****** *** each *** **** ******* ** *** ******. **** ** ***** in *** ***** ****, ****, **** ****, ******, *** ******* "Detect *** ******" ***** ***** **********.

 

********* ******** ******** ** ** ** ******** ***** ********* ****** from ***** *** *******, ****** **** ***** *** *** ****** from *** ****** *** **** ** ********** **********.

******** ******* ****** *** ***** *** *** ******* ***** ******** events, **** ***** ****** *********.

Calibration *******

*********** ******** ***** ** **** ***** *********, *******, ***/** ****** in *** ******'* ***** ** ****. ** ********* *********** ***** Google **** ************ *** ***** ********* *** ***** ** ** be ****** ********, ****** * *** **** ** ****** ************.

**** ******* ** ******** ** *** ***** *****:

Detection ***********

**** ****** ******** ** *** *****, ****, ******, *** ****** are ********** ********* >**% ** *** ****. *** *******, ****** flags *** **** *** ****** *** ** **** ********* ******** to *** ********** ******* ** **** *****:

********* *** ******** *** ******, **** **** ******** ******* ** the *****.

**** *** ****** **** ********* ********** ** *** ******** ** cases, ****** ***** *** **** ******* **** ******, ********* ** size (*****):

*******, **** * **** (******** ** *********) *** *******, ** was ********* ********** ** *** *****, **** ** *** *** seen ****:

Misclassification ******

*******, ****************** **** ****** *** *****, *** ** * ****** extent, ******.

******* ******* ** "******"

**** ********, ****************** **** ****** ** ******** ******* ******* ******** when ***** *** **** ******** ** *** *****, ********* ** a ****** ****** ****** ** *** ******. **** *** **** often *** ** * ***** ** **** ********* ** * truck, **** ****:

** *** ************* *******, *** *********** ******* **** *** ****** is ****** **** *****. *********, ***** **** ** **** ******* a ******* ** *******, ********** ** *** ****. *******, ** some **** *********** ************ (*.*., ******* ** ******* ***** ****** are **********, ****-**** *********, ***.), ********* ** *** ******** ******* is *********.

***** ******* ********* ** *****

***** **** *** **** ****** *********** ****** ****, **** *********** every ***** ****** **** ********* ** * **** ** *** camera ** *** ***** ** *******. 

*** *******, * ***** ******* **** * ********:

** ******* * ******:

**** ** **** ** ***** *****, *** ****** ** *******, in * ******* ******* ** ******* ****** * ****, ****** the ****** *** *** *****************.

*******, ** *** ***** ****, *********, * *** *** ********** as * ******* ** ****:

 

Cameras **** 

*** ******* **** **** *** **** ****:

  • ***** ***-*****: *.**.****
  • ***** ***-****: *.**.****

******* ******** ****** *.* *** *** **** *** *********.

Comments (14)

I'm curious how it would work with a different FOV. Two things I notice:

1) The camera seems relatively low, it looks like maybe 8-9' high. I would expect improved results from a higher vantage point with a little more downward tilt of the camera

2) The FOV seems exceptionally wide and you appear to be getting barrel distortion from the lens. Looks like a ~3mm lens. I'd suggest trying something no less than 4mm to get a flatter image and to keep the overall horizon line and geometry more squared up.

What was the logic in using this FOV? Was it more or less random in the sense you picked a "typical" scene, or did it conform to some recommendations from Bosch?

Are the analytics included with the camera purchase similar to the way Samsung bundles them in with the WiseNetIII. Overall they appear to work fairly well. It will be interesting to see how they perform over a longer period of time. I have had issues with "in camera" analytics where they just stop sending alerts and the camera needs to be rebooted.

They're included on all 7000/8000 series cameras at no charge (5MP starlight, 1080p HDR, 4K, etc.), but not on the 5000 series.

I think that Bosch is trying to do too much.

Avigilon approach of people/cars is much more reliable as I don't see any tech today that can really detect a the difference between a person and a bicycle.

Its better to do less in a good way than to do more poorly.

Finally, when a bike (bicicyle or motorbike) was present, it was correctly classified in all cases...

However, misclassifications were common for bikes...

Meaning other types were commonly misclassified as bikes, since no bikes were actually misclassified?

Ethan could you post some video clips from the intersection shot showing objects being detected? Also could you show images/video of the calibration setup for the intersection?

Just following up with the request for some video clips from the street shots.

I would really like to know detection ranges in day and night scenarios, with the lens length or angle used. That to me are the most important numbers along with reliability. Getting an idea of reliable ranges gives you an idea of how many cameras are needed for coverage.

In this test we were trying to get an idea of how well classification worked, not intending this to be a redo of their IVA detection performance. We tested that here (and in the rain). That being said, in this scene, I'd say detection of humans was reliable out to about 150' using the Bosch 5MP, or about a 285' HFOV, something like this:

I know I asked already asked but could you please post some video so we can see the detection range.

The issue with video clips here is that Bosch doesn't embed bounding boxes in the video (like Avigilon no longer does), and to my knowledge, no one has integrated the bounding boxes via metadata other than their own VMS, which we don't use. So we can see them live using Configuration Manager, but Genetec (which fully integrates the separate rules, sans bounding boxes) doesn't display the box.

So I can show you clips and you can see what is in the scene, but it's not going to show you bounding boxes. It's not going to show you events as they happen, either. Video associated with each event can be exported, but multiple events can't be exported with one stretch of video.

I will look through what we have saved as far as config/screen captures of Configuration Manager, as that's the only thing that'll show bounding boxes and path.

The cameras tested here don't support The Bosch CPP6 platform on which this IVA version is supported, therefore tests are i"not really relevant. Re-test on the Starlight 8000 and would be interesting to see results.

1. We used a Starlight 8000, the NBN-80052, as we mentioned in the report. The images in the report are taken from that camera.

2. As per Bosch's documentation IVA 6.10 is supported on more than CPP6.

IP cameras from Bosch are grouped by their common
product platform (CPP) generation. IVA 6.10 is
available on CPP4 and CPP6 based IP cameras

The NBN-932 (now numbered NBN-71027) is CPP4, and supported.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

BCDVideo Expansion And Switch From HP To Dell Examined on Mar 11, 2019
BCDVideo says they have more than tripled revenue in the past 5 years and are continuing to grow, powered most recently by switching their lead...
Church Technology Director Security Interview on Mar 07, 2019
With 40+ years of experience in IT from a wide array of verticals, including US and foreign military, and large corporate and industrial settings,...
Police Department Surveillance Manager Interview on Feb 28, 2019
Former Memphis PD Surveillance Manager, Lt. Joseph Patty retired months ago, but kept busy during his decades on the force, working to build up...
BluB0x Company Profile on Feb 20, 2019
BluB0x has doubled in revenue every year since its founding in 2013, according to CEO Patrick Barry. We originally reported on them in 2015. At the...
Solink Raises $12 Million - Company Profile on Feb 12, 2019
Most industry professionals have never heard of Solink, a company whose tagline is: It's time to revolutionize the way business uses...
ONVIF Video Surveillance Tutorial on Jan 29, 2019
ONVIF is well known within the surveillance industry as an interface to connect IP cameras and VMS systems. However, new users may find it...
Bosch Favorability Results 2019 on Jan 23, 2019
Bosch's favorability moderately strengthed, in new IPVM integrator statistics over their results from 2017, with 2019 results showing strong net...
Avigilon Favorability Results 2019 on Jan 15, 2019
Since IPVM's 2017 Avigilon favorability results, the company was acquired by Motorola and has shifted from being an aggressive startup to a more...
Gorilla Technology AI Provider, Raises $15 Million, Profiled on Jan 15, 2019
Gorilla Technology is a Taiwanese video analytics manufacturer that recently announced a $15 million investment from SBI Group, saying this...
Managed Video Services UL 827B Examined on Jan 09, 2019
Historically, UL listings for central stations have been important, with UL 827 having widespread support. However, few central stations have...

Most Recent Industry Reports

Retired Mercury President Returns As Open Options President on Mar 18, 2019
Open Options experienced major changes in 2018, including being acquired by ACRE and losing its President and General Manager, John Berman who...
Large US University End-User Video Surveillance Interview on Mar 18, 2019
Schools have become targets in modern days of active shooters and terrorist fears. The need for video and access security is high. Universities...
Hikvision Favorability Results 2019 on Mar 18, 2019
Hikvision favorability results declined significantly in IPVM's 2019 study of 200+ integrators. While in 2017 Hikvision's favorability was...
ONVIF Favorability Results 2019 on Mar 15, 2019
In the past decade, ONVIF has grown from a reaction to the outside Cisco-lead PSIA challenge, to being the de facto video surveillance standard...
Hanwha Aerospace / Techwin Korean Tax Evasion Raid on Mar 15, 2019
A Hanwha group subsidiary was raided as part of a tax evasion probe. While a Korean news media report listed the raided entity as 'Hanwha...
Installation Course - Last Chance on Mar 14, 2019
This is the last chance to register for the March Installation course. This is a unique installation course in a market where little practical...
City Physical Security Manager Interview on Mar 14, 2019
This physical security pro is the Physical Security Manager for the City of Calgary. He is a criminologist by training with an ASIS CPP credential....
US Drafting Separate Rule for NDAA Dahua/Hikvision 'Blacklist' on Mar 14, 2019
The most debated provision of the NDAA ban of Dahua, Hikvision, Huawei, et al. is the so-called 'blacklist' provision which would ban any company...
OpenALPR Acquired By Mysterious Novume on Mar 13, 2019
Startup OpenALPR has been acquired by Novume, a company virtually unknown in the industry. While there are many LPR providers (see our directory),...
Milestone Machine Learning Camera Auto-Setting Examined on Mar 13, 2019
Milestone wants to improve image quality using Machine Learning to solve the problem of "a camera doesn't know what it is being used for",...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact