Bosch Person / Car / Bike / Truck Analytics Tested

By: Ethan Ace, Published on Jun 05, 2015

Automatically identify what objects are persons vs cars vs bikes vs trucks. That is the new feature and claim from Bosch in their newest IVA analytics (6.10 version). 

We first tested Bosch IVA here. With this new feature, we wanted to see how accurately this worked.

This video shows the basic setup process we used before testing:

We tested these analytics on multiple cameras in a busy outdoor scene, to answer these questions: 

  • Are cars, trucks, people, and bikes reliably detected and classified?
  • What objects are missed most often?
  • How do busy scenes impact performance?
  • Are VMSes able to receive these events distinctly?

    • ************* ******** **** ******* are ******* ** **** vs ***** ** ******. That ** *** *** feature *** ***** **** Bosch ** ***** ****** IVA ********* (*.** *******). 

    ** *********** ***** *** ****. **** **** *** feature, ** ****** ** see *** ********** **** worked.

    **** ***** ***** *** basic ***** ******* ** used ****** *******:

    ** ****** ***** ********* on ******** ******* ** a **** ******* *****, to ****** ***** *********: 

    • *** ****, ******, ******, and ***** ******** ******** and **********?
    • **** ******* *** ****** most *****?
    • *** ** **** ****** impact ***********?
    • *** ***** **** ** receive ***** ****** **********?

    [***************]

    Key ******** 

    *****'* *** ****** ************** was **** ******** **** cars *** ******. ** low ******** ******, ********* and ******* ************** ** these ******* ****** * ~190' field ** **** *** ********, missing *** *******.

    ********* ** ****** *** less ********, **** ******** cars ******* ******** ********** as * *****, *** some ******* ****** ********** as ****.

    ******** **** ********** ***** reliably, **** ****** ******* **** strollers **  *** **** cars ******** ** *****. Actual ******** **** ************ missed ** ********** ** another **** ** ******.

    *** ******** *********** *** object **************, ********* ***** to ******* ******** **********/******** lines, ** **** ** one ** **** ****** for ****** *********. *********** was ****, ** ***** measurements *** *****, *** roughly ******** ** *** size/distance ***********.

    ***** *** ****** ********** with ******* ******** ****** and ********* ********, **** distinct ***** ******** ********** (e.g., ****** ********* **. vehicle *********, ***.).

    ***************/******

    **** ***** ***** ***** object ************** *********, *****'* IVA ********* **** * step ****** ** ******** to ****** *** ******** providers **** ********/******* *** AgentVI, ***** **** ******* these ************ *** **** time.

    *******, ***** ****** ** careful ** ***********, *** limit ***** ***** ********* are ********, **** **** activity ****** ********** ******* objects ** ***** *** be *************. ************, ** recommend ******** ************ ** people **. ******** (**** cars *** ******), ** proper ********* ** ******** performed *****.

    Firmware ************

    ***** ************ ** *** are ********* ******** ** firmware *.**, ********* *** most ******* ** ******* in *** ***** ****. Firmware ** ********* *** download **** *** ***** Security *******.

    VMS ***********

    *** ******* ****** ******** events ** ******* ******** Center *** **** *** rule ******* ** *** camera. **** ** ***** in *** ***** ****, here, **** ****, ******, and ******* "****** *** object" ***** ***** **********.

     

    ********* ******** ******** ** to ** ******** ***** analytics ****** **** ***** IVA *******, ****** **** names *** *** ****** from *** ****** *** must ** ********** **********.

    ******** ******* ****** *** Exacq *** *** ******* these ******** ******, **** basic ****** *********.

    Calibration *******

    *********** ******** ***** ** mark ***** *********, *******, and/or ****** ** *** camera's ***** ** ****. We ********* *********** ***** Google **** ************ *** angle ********* *** ***** it ** ** ****** accurate, ****** * *** feet ** ****** ************.

    **** ******* ** ******** in *** ***** *****:

    Detection ***********

    **** ****** ******** ** the *****, ****, ******, and ****** *** ********** correctly >**% ** *** time. *** *******, ****** flags *** **** *** people *** ** **** correctly ******** ** *** respective ******* ** **** image:

    ********* *** ******** *** people, **** **** ******** objects ** *** *****.

    **** *** ****** **** correctly ********** ** *** majority ** *****, ****** there *** **** ******* with ******, ********* ** size (*****):

    *******, **** * **** (bicicyle ** *********) *** present, ** *** ********* classified ** *** *****, such ** *** *** seen ****:

    Misclassification ******

    *******, ****************** **** ****** for *****, *** ** a ****** ******, ******.

    ******* ******* ** "******"

    **** ********, ****************** **** caused ** ******** ******* grouped ******** **** ***** was **** ******** ** the *****, ********* ** a ****** ****** ****** to *** ******. **** was **** ***** *** to * ***** ** cars ********* ** * truck, **** ****:

    ** *** ************* *******, the *********** ******* **** and ****** ** ****** most *****. *********, ***** want ** **** ******* a ******* ** *******, regardless ** *** ****. However, ** **** **** specialized ************ (*.*., ******* or ******* ***** ****** are **********, ****-**** *********, etc.), ********* ** *** distinct ******* ** *********.

    ***** ******* ********* ** Bikes

    ***** **** *** **** common *********** ****** ****, with *********** ***** ***** object **** ********* ** a **** ** *** camera ** *** ***** or *******. 

    *** *******, * ***** subject **** * ********:

    ** ******* * ******:

    **** ** **** ** these *****, *** ****** is *******, ** * similar ******* ** ******* riding * ****, ****** the ****** *** *** misclassification.

    *******, ** *** ***** case, *********, * *** was ********** ** * bicycle ** ****:

     

    Cameras **** 

    *** ******* **** **** for **** ****:

    • ***** ***-*****: *.**.****
    • ***** ***-****: *.**.****

    ******* ******** ****** *.* SR9 *** **** *** recording.

Comments (14)

Undisclosed #1

06/05/15 01:07pm

I'm curious how it would work with a different FOV. Two things I notice:

1) The camera seems relatively low, it looks like maybe 8-9' high. I would expect improved results from a higher vantage point with a little more downward tilt of the camera

2) The FOV seems exceptionally wide and you appear to be getting barrel distortion from the lens. Looks like a ~3mm lens. I'd suggest trying something no less than 4mm to get a flatter image and to keep the overall horizon line and geometry more squared up.

What was the logic in using this FOV? Was it more or less random in the sense you picked a "typical" scene, or did it conform to some recommendations from Bosch?

Undisclosed Integrator #2

06/06/15 12:24am
Are the analytics included with the camera purchase similar to the way Samsung bundles them in with the WiseNetIII. Overall they appear to work fairly well. It will be interesting to see how they perform over a longer period of time. I have had issues with "in camera" analytics where they just stop sending alerts and the camera needs to be rebooted.
Avatar

Derek Ward

IPVM | In reply to Undisclosed Integrator #2 | 06/08/15 03:04pm

They're included on all 7000/8000 series cameras at no charge (5MP starlight, 1080p HDR, 4K, etc.), but not on the 5000 series.

Itamar Kerbel

06/07/15 09:18am

I think that Bosch is trying to do too much.

Avigilon approach of people/cars is much more reliable as I don't see any tech today that can really detect a the difference between a person and a bicycle.

Its better to do less in a good way than to do more poorly.

Undisclosed #3

06/07/15 09:54am

Finally, when a bike (bicicyle or motorbike) was present, it was correctly classified in all cases...

However, misclassifications were common for bikes...

Meaning other types were commonly misclassified as bikes, since no bikes were actually misclassified?

Avatar

Derek Ward

IPVM | In reply to Undisclosed #3 | 06/08/15 03:05pm

Correct.

Michael Miller

06/07/15 03:35pm

Ethan could you post some video clips from the intersection shot showing objects being detected? Also could you show images/video of the calibration setup for the intersection?

Michael Miller

06/10/15 02:14pm

Just following up with the request for some video clips from the street shots.

Avatar

Luis Carmona

IPVMU Certified | 06/16/15 01:33pm

I would really like to know detection ranges in day and night scenarios, with the lens length or angle used. That to me are the most important numbers along with reliability. Getting an idea of reliable ranges gives you an idea of how many cameras are needed for coverage.

Avatar

Ethan Ace

IPVM | In reply to Luis Carmona | 06/17/15 11:27pm

In this test we were trying to get an idea of how well classification worked, not intending this to be a redo of their IVA detection performance. We tested that here (and in the rain). That being said, in this scene, I'd say detection of humans was reliable out to about 150' using the Bosch 5MP, or about a 285' HFOV, something like this:

Michael Miller

In reply to Ethan Ace | 06/17/15 11:50pm

I know I asked already asked but could you please post some video so we can see the detection range.

Avatar

Ethan Ace

IPVM | In reply to Michael Miller | 06/18/15 12:07am

The issue with video clips here is that Bosch doesn't embed bounding boxes in the video (like Avigilon no longer does), and to my knowledge, no one has integrated the bounding boxes via metadata other than their own VMS, which we don't use. So we can see them live using Configuration Manager, but Genetec (which fully integrates the separate rules, sans bounding boxes) doesn't display the box.

So I can show you clips and you can see what is in the scene, but it's not going to show you bounding boxes. It's not going to show you events as they happen, either. Video associated with each event can be exported, but multiple events can't be exported with one stretch of video.

I will look through what we have saved as far as config/screen captures of Configuration Manager, as that's the only thing that'll show bounding boxes and path.

Undisclosed Distributor #4

06/17/15 11:03pm

The cameras tested here don't support The Bosch CPP6 platform on which this IVA version is supported, therefore tests are i"not really relevant. Re-test on the Starlight 8000 and would be interesting to see results.

Avatar

Ethan Ace

IPVM | In reply to Undisclosed Distributor #4 | 06/17/15 11:10pm

1. We used a Starlight 8000, the NBN-80052, as we mentioned in the report. The images in the report are taken from that camera.

2. As per Bosch's documentation IVA 6.10 is supported on more than CPP6.

IP cameras from Bosch are grouped by their common
product platform (CPP) generation. IVA 6.10 is
available on CPP4 and CPP6 based IP cameras

The NBN-932 (now numbered NBN-71027) is CPP4, and supported.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Video Analytics

RealNetworks SAFR Facial Recognition Profile on Sep 25, 2019
RealNetworks entered the surveillance market by giving away their analytics to schools for free, and is now targeting large commercial users with...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Directory of 70 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
Scylla AI Video Analytics Company Profile on Aug 29, 2019
Scylla, an AI analytics startup, says they are targeting 1 Billion dollar valuation in 5 years and it "is not rocket science" to detect weapons and...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Verkada People And Face Analytics Tested on Aug 16, 2019
This week, Verkada released "People Analytics", including face analytics that they describe is a "game-changing feature" that "pushes the...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they claim their new Analytics+ "algorithms significantly improve accuracy and...
Honeywell Speaks On NDAA Ban, New Non-Banned Cameras and Cybersecurity on Aug 06, 2019
For years, Honeywell has depended on Dahua, a company with a poor cybersecurity track record and now banned by the US NDAA, for the development and...

Most Recent Industry Reports

Resideo Stock Plunges 40%, CFO Ousted on Oct 23, 2019
The horrible year for the ADI / Honeywell Home spinout, Resideo, just got worse, with their stock plunging another 40% today. Not even a year...
Access Control Door Controllers Guide on Oct 22, 2019
Door controllers are at the center of physical access control systems connecting software, readers, and locks. Despite being buried inside...
Alarm.com Acquires OpenEye on Oct 21, 2019
Alarm.com is targeting commercial expansion and now they have a commercial cloud VMS with the acquisition of OpenEye. In this note, based on...
Government-Owned Hikvision Wants To Keep Politics Out Of Security on Oct 21, 2019
'Politics' made Hikvision the goliath it is today. It was PRC China 'politics' that created Hikvision, funded it, and blocked its foreign...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Alarm Veteran "Demands A Criminal Investigation" Of UL on Oct 18, 2019
The Interceptor's Project pressure against UL continues to rise. Following Keith Jentoft's allegation that "UL Has Blood On Their Hands", Jentoft...
Camect "Worlds Smartest Camera Hub" Tested on Oct 18, 2019
Camect is a Silicon Valley startup that claims the "Smartest AI Object Detection On The Market", detecting not only people and vehicles, but...
Hikvision Global News Reports Directory on Oct 17, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Camera Calculator V3.1 Release Improves User Experience on Oct 17, 2019
IPVM has released a new version of our Camera Calculator, V3.1, with significant user experience improvements, a new development plan, and an...

What IPVM Is

The world's leading authority on video surveillance, with 200,000+ visits monthly.

  • Articles on cameras, video analytics, VMS, and trends
  • Tests showing actual performance and problems
  • Courses in surveillance, access control, etc
  • Camera Calculator for designing systems

Dedicated To Independence

We're dedicated to staying independent and objective. We're the only industry source to refuse any and all advertisements, sponsorship, and consulting from manufacturers. Why?