Bosch Person / Car / Bike / Truck Analytics Tested

By: Ethan Ace, Published on Jun 05, 2015

Automatically identify what objects are persons vs cars vs bikes vs trucks. That is the new feature and claim from Bosch in their newest IVA analytics (6.10 version). 

We first tested Bosch IVA here. With this new feature, we wanted to see how accurately this worked.

This video shows the basic setup process we used before testing:

We tested these analytics on multiple cameras in a busy outdoor scene, to answer these questions: 

  • Are cars, trucks, people, and bikes reliably detected and classified?
  • What objects are missed most often?
  • How do busy scenes impact performance?
  • Are VMSes able to receive these events distinctly?

    • ************* ******** **** ******* are ******* ** **** vs ***** ** ******. That ** *** *** feature *** ***** **** Bosch ** ***** ****** IVA ********* (*.** *******). 

    ** *********** ***** *** ****. **** **** *** feature, ** ****** ** see *** ********** **** worked.

    **** ***** ***** *** basic ***** ******* ** used ****** *******:

    ** ****** ***** ********* on ******** ******* ** a **** ******* *****, to ****** ***** *********: 

    • *** ****, ******, ******, and ***** ******** ******** and **********?
    • **** ******* *** ****** most *****?
    • *** ** **** ****** impact ***********?
    • *** ***** **** ** receive ***** ****** **********?

    [***************]

    Key ******** 

    *****'* *** ****** ************** was **** ******** **** cars *** ******. ** low ******** ******, ********* and ******* ************** ** these ******* ****** * ~190' field ** **** *** ********, missing *** *******.

    ********* ** ****** *** less ********, **** ******** cars ******* ******** ********** as * *****, *** some ******* ****** ********** as ****.

    ******** **** ********** ***** reliably, **** ****** ******* **** strollers **  *** **** cars ******** ** *****. Actual ******** **** ************ missed ** ********** ** another **** ** ******.

    *** ******** *********** *** object **************, ********* ***** to ******* ******** **********/******** lines, ** **** ** one ** **** ****** for ****** *********. *********** was ****, ** ***** measurements *** *****, *** roughly ******** ** *** size/distance ***********.

    ***** *** ****** ********** with ******* ******** ****** and ********* ********, **** distinct ***** ******** ********** (e.g., ****** ********* **. vehicle *********, ***.).

    ***************/******

    **** ***** ***** ***** object ************** *********, *****'* IVA ********* **** * step ****** ** ******** to ****** *** ******** providers **** ********/******* *** AgentVI, ***** **** ******* these ************ *** **** time.

    *******, ***** ****** ** careful ** ***********, *** limit ***** ***** ********* are ********, **** **** activity ****** ********** ******* objects ** ***** *** be *************. ************, ** recommend ******** ************ ** people **. ******** (**** cars *** ******), ** proper ********* ** ******** performed *****.

    Firmware ************

    ***** ************ ** *** are ********* ******** ** firmware *.**, ********* *** most ******* ** ******* in *** ***** ****. Firmware ** ********* *** download **** *** ***** Security *******.

    VMS ***********

    *** ******* ****** ******** events ** ******* ******** Center *** **** *** rule ******* ** *** camera. **** ** ***** in *** ***** ****, here, **** ****, ******, and ******* "****** *** object" ***** ***** **********.

     

    ********* ******** ******** ** to ** ******** ***** analytics ****** **** ***** IVA *******, ****** **** names *** *** ****** from *** ****** *** must ** ********** **********.

    ******** ******* ****** *** Exacq *** *** ******* these ******** ******, **** basic ****** *********.

    Calibration *******

    *********** ******** ***** ** mark ***** *********, *******, and/or ****** ** *** camera's ***** ** ****. We ********* *********** ***** Google **** ************ *** angle ********* *** ***** it ** ** ****** accurate, ****** * *** feet ** ****** ************.

    **** ******* ** ******** in *** ***** *****:

    Detection ***********

    **** ****** ******** ** the *****, ****, ******, and ****** *** ********** correctly >**% ** *** time. *** *******, ****** flags *** **** *** people *** ** **** correctly ******** ** *** respective ******* ** **** image:

    ********* *** ******** *** people, **** **** ******** objects ** *** *****.

    **** *** ****** **** correctly ********** ** *** majority ** *****, ****** there *** **** ******* with ******, ********* ** size (*****):

    *******, **** * **** (bicicyle ** *********) *** present, ** *** ********* classified ** *** *****, such ** *** *** seen ****:

    Misclassification ******

    *******, ****************** **** ****** for *****, *** ** a ****** ******, ******.

    ******* ******* ** "******"

    **** ********, ****************** **** caused ** ******** ******* grouped ******** **** ***** was **** ******** ** the *****, ********* ** a ****** ****** ****** to *** ******. **** was **** ***** *** to * ***** ** cars ********* ** * truck, **** ****:

    ** *** ************* *******, the *********** ******* **** and ****** ** ****** most *****. *********, ***** want ** **** ******* a ******* ** *******, regardless ** *** ****. However, ** **** **** specialized ************ (*.*., ******* or ******* ***** ****** are **********, ****-**** *********, etc.), ********* ** *** distinct ******* ** *********.

    ***** ******* ********* ** Bikes

    ***** **** *** **** common *********** ****** ****, with *********** ***** ***** object **** ********* ** a **** ** *** camera ** *** ***** or *******. 

    *** *******, * ***** subject **** * ********:

    ** ******* * ******:

    **** ** **** ** these *****, *** ****** is *******, ** * similar ******* ** ******* riding * ****, ****** the ****** *** *** misclassification.

    *******, ** *** ***** case, *********, * *** was ********** ** * bicycle ** ****:

     

    Cameras **** 

    *** ******* **** **** for **** ****:

    • ***** ***-*****: *.**.****
    • ***** ***-****: *.**.****

    ******* ******** ****** *.* SR9 *** **** *** recording.

Comments (14)

Undisclosed #1

06/05/15 01:07pm

I'm curious how it would work with a different FOV. Two things I notice:

1) The camera seems relatively low, it looks like maybe 8-9' high. I would expect improved results from a higher vantage point with a little more downward tilt of the camera

2) The FOV seems exceptionally wide and you appear to be getting barrel distortion from the lens. Looks like a ~3mm lens. I'd suggest trying something no less than 4mm to get a flatter image and to keep the overall horizon line and geometry more squared up.

What was the logic in using this FOV? Was it more or less random in the sense you picked a "typical" scene, or did it conform to some recommendations from Bosch?

Undisclosed Integrator #2

06/06/15 12:24am
Are the analytics included with the camera purchase similar to the way Samsung bundles them in with the WiseNetIII. Overall they appear to work fairly well. It will be interesting to see how they perform over a longer period of time. I have had issues with "in camera" analytics where they just stop sending alerts and the camera needs to be rebooted.

Derek Ward

In reply to Undisclosed Integrator #2 | 06/08/15 03:04pm

They're included on all 7000/8000 series cameras at no charge (5MP starlight, 1080p HDR, 4K, etc.), but not on the 5000 series.

Itamar Kerbel

06/07/15 09:18am

I think that Bosch is trying to do too much.

Avigilon approach of people/cars is much more reliable as I don't see any tech today that can really detect a the difference between a person and a bicycle.

Its better to do less in a good way than to do more poorly.

Undisclosed #3

06/07/15 09:54am

Finally, when a bike (bicicyle or motorbike) was present, it was correctly classified in all cases...

However, misclassifications were common for bikes...

Meaning other types were commonly misclassified as bikes, since no bikes were actually misclassified?

Derek Ward

In reply to Undisclosed #3 | 06/08/15 03:05pm

Correct.

Michael Miller

06/07/15 03:35pm

Ethan could you post some video clips from the intersection shot showing objects being detected? Also could you show images/video of the calibration setup for the intersection?

Michael Miller

06/10/15 02:14pm

Just following up with the request for some video clips from the street shots.

Avatar

Luis Carmona

IPVMU Certified | 06/16/15 01:33pm

I would really like to know detection ranges in day and night scenarios, with the lens length or angle used. That to me are the most important numbers along with reliability. Getting an idea of reliable ranges gives you an idea of how many cameras are needed for coverage.

Avatar

Ethan Ace

IPVM | In reply to Luis Carmona | 06/17/15 11:27pm

In this test we were trying to get an idea of how well classification worked, not intending this to be a redo of their IVA detection performance. We tested that here (and in the rain). That being said, in this scene, I'd say detection of humans was reliable out to about 150' using the Bosch 5MP, or about a 285' HFOV, something like this:

Michael Miller

In reply to Ethan Ace | 06/17/15 11:50pm

I know I asked already asked but could you please post some video so we can see the detection range.

Avatar

Ethan Ace

IPVM | In reply to Michael Miller | 06/18/15 12:07am

The issue with video clips here is that Bosch doesn't embed bounding boxes in the video (like Avigilon no longer does), and to my knowledge, no one has integrated the bounding boxes via metadata other than their own VMS, which we don't use. So we can see them live using Configuration Manager, but Genetec (which fully integrates the separate rules, sans bounding boxes) doesn't display the box.

So I can show you clips and you can see what is in the scene, but it's not going to show you bounding boxes. It's not going to show you events as they happen, either. Video associated with each event can be exported, but multiple events can't be exported with one stretch of video.

I will look through what we have saved as far as config/screen captures of Configuration Manager, as that's the only thing that'll show bounding boxes and path.

Undisclosed Distributor #4

06/17/15 11:03pm

The cameras tested here don't support The Bosch CPP6 platform on which this IVA version is supported, therefore tests are i"not really relevant. Re-test on the Starlight 8000 and would be interesting to see results.

Avatar

Ethan Ace

IPVM | In reply to Undisclosed Distributor #4 | 06/17/15 11:10pm

1. We used a Starlight 8000, the NBN-80052, as we mentioned in the report. The images in the report are taken from that camera.

2. As per Bosch's documentation IVA 6.10 is supported on more than CPP6.

IP cameras from Bosch are grouped by their common
product platform (CPP) generation. IVA 6.10 is
available on CPP4 and CPP6 based IP cameras

The NBN-932 (now numbered NBN-71027) is CPP4, and supported.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...
Hikvision DeepinView Camera Analytics Tested on May 08, 2019
Hikvision is expanding its 'deep learning' offerings with a new camera series called 'DeepinView' claiming false alarm reduction and improved...
Aegis AI Gun Detection Video Analytics Startup on May 07, 2019
Gun detection analytic startups are increasing as the promise of AI and the threats of active shooters grow.  One company, Aegis AI, is being led...
IBM Shuts Down Intelligent Video Analytics on May 02, 2019
Abruptly, IBM has discontinued its Intelligent Video Analytics solution, it confirmed to IPVM. IBM's video analytics have faced recent media...
LenelS2 Launches VRx Video Platform on Apr 29, 2019
For years, S2's video management platform, the NetVR, was based on Exacq. Now, after years of internal development, S2 has launched its own...
The HIVIDEO $31 Face Detection DVR Tested on Apr 25, 2019
Face detection in a $31 DVR? That is what "HIVIDEO" (not to be confused with Hikvision, even if the company intends to do that) was promoting at...
Verint Victimized By Ransomware on Apr 18, 2019
Verint, which is best known in the physical security industry for video surveillance but has built a sizeable cybersecurity business as well, was...
ISC West 2019 Report on Apr 12, 2019
The IPVM team has finished at the Sands looking at what companies are offering and how they are changing their positioning. See below for 50+...
Bosch AI Camera Trainer Released And Tested on Apr 09, 2019
Bosch is releasing a highly unusual new AI feature - 'Camera Trainer'. Now, coming as a standard feature in Bosch IVA/EVA analytics, one can train...
Airship VMS Profile on Apr 03, 2019
Airship has been developing VMS software for over 10 years, however, with no outside investment, and minimal marketing, the company is not well...

Most Recent Industry Reports

Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Amazon Ring Public Subsidy Program Aims To Dominate Residential Security on May 20, 2019
Amazon dominates market after market. Quitely, but increasingly, they are doing so in residential security, through a combination of significant...
LifeSafety Power NetLink Vulnerabilities And Problematic Response on May 20, 2019
'Power supplies' are not devices that many think about when considering vulnerabilities but as more and more devices go 'online', the risks for...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
Inside Look Into Scam Market Research on May 17, 2019
Scam market research has exploded over the last few years becoming the most commonly cited 'statistics' for most industries, despite there clearly...
Maglock Selection Guide on May 16, 2019
One of the most misunderstood yet valuable pieces of electrified hardware is the maglock. Few locks are stronger, but myths and confusion surround...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
Trump Signs 'Huawei Ban' - Executive Order Targeting Foreign Adversary Technology on May 16, 2019
US President Donald Trump has signed an executive order targeting technology provided by 'foreign adversaries', in what is widely being called a...
Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact