Bosch Person / Car / Bike / Truck Analytics Tested

Avatar
Ethan Ace
•Published Jun 05, 2015 04:00 AM

************* ******** **** ******* *** ******* vs **** ** ***** ** ******. That ** *** *** ******* *** claim **** ***** ** ***** ****** IVA ********* (*.** *******). 

** *********** ***** *** ****. **** **** *** *******, ** wanted ** *** *** ********** **** worked.

**** ***** ***** *** ***** ***** process ** **** ****** *******:

** ****** ***** ********* ** ******** cameras ** * **** ******* *****, to ****** ***** *********: 

  • *** ****, ******, ******, *** ***** reliably ******** *** **********?
  • **** ******* *** ****** **** *****?
  • *** ** **** ****** ****** ***********?
  • *** ***** **** ** ******* ***** events **********?

    • *****'* *** ****** ************** *** **** accurate **** **** *** ******. ** low ******** ******, ********* *** ******* classification ** ***** ******* ****** * ~190' field ** **** *** ********, ******* *** objects.

    ********* ** ****** *** **** ********, with ******** **** ******* ******** ********** as * *****, *** **** ******* trucks ********** ** ****.

    ******** **** ********** ***** ********, **** people ******* **** ********* **  *** **** cars ******** ** *****. ****** ******** were ************ ****** ** ********** ** another **** ** ******.

    *** ******** *********** *** ****** **************, requiring ***** ** ******* ******** **********/******** lines, ** **** ** *** ** more ****** *** ****** *********. *********** was ****, ** ***** ************ *** known, *** ******* ******** ** *** size/distance ***********.

    ***** *** ****** ********** **** ******* Security ****** *** ********* ********, **** distinct ***** ******** ********** (*.*., ****** detection **. ******* *********, ***.).

    ***************/******

    **** ***** ***** ***** ****** ************** abilities, *****'* *** ********* **** * step ****** ** ******** ** ****** end ******** ********* **** ********/******* *** AgentVI, ***** **** ******* ***** ************ for **** ****.

    *******, ***** ****** ** ******* ** calibration, *** ***** ***** ***** ********* are ********, **** **** ******** ****** frequently ******* ******* ** ***** *** be *************. ************, ** ********* ******** expectations ** ****** **. ******** (**** cars *** ******), ** ****** ********* of ******** ********* *****.

    Firmware ************

    ***** ************ ** *** *** ********* starting ** ******** *.**, ********* *** most ******* ** ******* ** *** Bosch ****. ******** ** ********* *** download **** *** ***** ******** *******.

    VMS ***********

    *** ******* ****** ******** ****** ** Genetec ******** ****** *** **** *** rule ******* ** *** ******. **** is ***** ** *** ***** ****, here, **** ****, ******, *** ******* "Detect *** ******" ***** ***** **********.

     

    ********* ******** ******** ** ** ** distinct ***** ********* ****** **** ***** IVA *******, ****** **** ***** *** not ****** **** *** ****** *** must ** ********** **********.

    ******** ******* ****** *** ***** *** not ******* ***** ******** ******, **** basic ****** *********.

    Calibration *******

    *********** ******** ***** ** **** ***** distances, *******, ***/** ****** ** *** camera's ***** ** ****. ** ********* calibration ***** ****** **** ************ *** angle ********* *** ***** ** ** be ****** ********, ****** * *** feet ** ****** ************.

    **** ******* ** ******** ** *** video *****:

    Detection ***********

    **** ****** ******** ** *** *****, cars, ******, *** ****** *** ********** correctly >**% ** *** ****. *** example, ****** ***** *** **** *** people *** ** **** ********* ******** to *** ********** ******* ** **** image:

    ********* *** ******** *** ******, **** with ******** ******* ** *** *****.

    **** *** ****** **** ********* ********** in *** ******** ** *****, ****** there *** **** ******* **** ******, depending ** **** (*****):

    *******, **** * **** (******** ** motorbike) *** *******, ** *** ********* classified ** *** *****, **** ** the *** **** ****:

    Misclassification ******

    *******, ****************** **** ****** *** *****, and ** * ****** ******, ******.

    ******* ******* ** "******"

    **** ********, ****************** **** ****** ** multiple ******* ******* ******** **** ***** was **** ******** ** *** *****, appearing ** * ****** ****** ****** to *** ******. **** *** **** often *** ** * ***** ** cars ********* ** * *****, **** here:

    ** *** ************* *******, *** *********** between **** *** ****** ** ****** most *****. *********, ***** **** ** know ******* * ******* ** *******, regardless ** *** ****. *******, ** some **** *********** ************ (*.*., ******* or ******* ***** ****** *** **********, cars-only *********, ***.), ********* ** *** distinct ******* ** *********.

    ***** ******* ********* ** *****

    ***** **** *** **** ****** *********** object ****, **** *********** ***** ***** object **** ********* ** * **** to *** ****** ** *** ***** or *******. 

    *** *******, * ***** ******* **** a ********:

    ** ******* * ******:

    **** ** **** ** ***** *****, the ****** ** *******, ** * similar ******* ** ******* ****** * bike, ****** *** ****** *** *** misclassification.

    *******, ** *** ***** ****, *********, a *** *** ********** ** * bicycle ** ****:

     

    Cameras **** 

    *** ******* **** **** *** **** test:

    • ***** ***-*****: *.**.****
    • ***** ***-****: *.**.****

    ******* ******** ****** *.* *** *** used *** *********.

Comments (14)
U
Undisclosed #1
•Jun 05, 2015

I'm curious how it would work with a different FOV. Two things I notice:

1) The camera seems relatively low, it looks like maybe 8-9' high. I would expect improved results from a higher vantage point with a little more downward tilt of the camera

2) The FOV seems exceptionally wide and you appear to be getting barrel distortion from the lens. Looks like a ~3mm lens. I'd suggest trying something no less than 4mm to get a flatter image and to keep the overall horizon line and geometry more squared up.

What was the logic in using this FOV? Was it more or less random in the sense you picked a "typical" scene, or did it conform to some recommendations from Bosch?

(1)
(2)
(2)
UI
Undisclosed Integrator #2
•Jun 06, 2015
Are the analytics included with the camera purchase similar to the way Samsung bundles them in with the WiseNetIII. Overall they appear to work fairly well. It will be interesting to see how they perform over a longer period of time. I have had issues with "in camera" analytics where they just stop sending alerts and the camera needs to be rebooted.
Avatar
Derek Ward
•Jun 08, 2015
Hanwha
In reply to Undisclosed Integrator #2

They're included on all 7000/8000 series cameras at no charge (5MP starlight, 1080p HDR, 4K, etc.), but not on the 5000 series.

IK
Itamar Kerbel
•Jun 07, 2015

I think that Bosch is trying to do too much.

Avigilon approach of people/cars is much more reliable as I don't see any tech today that can really detect a the difference between a person and a bicycle.

Its better to do less in a good way than to do more poorly.

(2)
U
Undisclosed #3
•Jun 07, 2015
IPVMU Certified

Finally, when a bike (bicicyle or motorbike) was present, it was correctly classified in all cases...

However, misclassifications were common for bikes...

Meaning other types were commonly misclassified as bikes, since no bikes were actually misclassified?

Avatar
Derek Ward
•Jun 08, 2015
Hanwha
In reply to Undisclosed #3

Correct.

MM
Michael Miller
•Jun 07, 2015

Ethan could you post some video clips from the intersection shot showing objects being detected? Also could you show images/video of the calibration setup for the intersection?

MM
Michael Miller
•Jun 10, 2015

Just following up with the request for some video clips from the street shots.

Avatar
Luis Carmona
•Jun 16, 2015
Geutebruck USA • IPVMU Certified

I would really like to know detection ranges in day and night scenarios, with the lens length or angle used. That to me are the most important numbers along with reliability. Getting an idea of reliable ranges gives you an idea of how many cameras are needed for coverage.

Avatar
Ethan Ace
•Jun 17, 2015
In reply to Luis Carmona

In this test we were trying to get an idea of how well classification worked, not intending this to be a redo of their IVA detection performance. We tested that here (and in the rain). That being said, in this scene, I'd say detection of humans was reliable out to about 150' using the Bosch 5MP, or about a 285' HFOV, something like this:

MM
Michael Miller
•Jun 17, 2015
In reply to Ethan Ace

I know I asked already asked but could you please post some video so we can see the detection range.

Avatar
Ethan Ace
•Jun 18, 2015
In reply to Michael Miller

The issue with video clips here is that Bosch doesn't embed bounding boxes in the video (like Avigilon no longer does), and to my knowledge, no one has integrated the bounding boxes via metadata other than their own VMS, which we don't use. So we can see them live using Configuration Manager, but Genetec (which fully integrates the separate rules, sans bounding boxes) doesn't display the box.

So I can show you clips and you can see what is in the scene, but it's not going to show you bounding boxes. It's not going to show you events as they happen, either. Video associated with each event can be exported, but multiple events can't be exported with one stretch of video.

I will look through what we have saved as far as config/screen captures of Configuration Manager, as that's the only thing that'll show bounding boxes and path.

UD
Undisclosed Distributor #4
•Jun 17, 2015

The cameras tested here don't support The Bosch CPP6 platform on which this IVA version is supported, therefore tests are i"not really relevant. Re-test on the Starlight 8000 and would be interesting to see results.

(1)
Avatar
Ethan Ace
•Jun 17, 2015
In reply to Undisclosed Distributor #4

1. We used a Starlight 8000, the NBN-80052, as we mentioned in the report. The images in the report are taken from that camera.

2. As per Bosch's documentation IVA 6.10 is supported on more than CPP6.

IP cameras from Bosch are grouped by their common
product platform (CPP) generation. IVA 6.10 is
available on CPP4 and CPP6 based IP cameras

The NBN-932 (now numbered NBN-71027) is CPP4, and supported.