Axis Guard Suite Video Analytics Tested

By Rob Kilpatrick, Published Jun 25, 2018, 11:40am EDT

In 2015, we declared Axis' Guard Suite analytics "weak", with missed detections and false alerts common. But after nearly 3 years and a 2.0 version release, has this improved?

We tested Motion Guard, Fence Guard, and Loitering Guard to find out, using two cameras:

And in multiple scenes outdoors and indoors, examining:

  • Configuration and calibration
  • False alert performance
  • Detection range
  • Comparison to Axis VMD4
  • Camera compatibility

Readers should also see our other updated camera analytics tests, including Axis VMD4, Bosch IVA Video Analytics And Motion+ VMD, Hanwha Wisenet X Analytics, Hikvision Intrusion Analytics, and Dahua Intrusion Analytics.

Guard ***** *********** *******

*** ***** ***** ************ (Motion, *****, *********) ******** from ***** ****** ****** by *****, *******, *** rain ********, **** ******* *********** to **** ** ***** issues.

************, ********* ******** ** all ************ *** *********** reduced **** ********** ******* object ******** *** ** such ** ********* ********* these ***** **** *** FOV ******* ** ********** to *********** **** *** settings *******.

*******, ** *** **** side, ********* ** ****** from ***** ******* *** solid due ** *** ******** perspective ***********, **** **** few ****** (* *** *-* days) ****** ** ******* in * **** ** testing.

Detection *********** *********

** ******** ** ***** overall ********, ** ***** these *** ******** ******** to **** ***** ***** application ** *** *****:

****** *****

****** ***** ******** ******** subjects ** ~**-** ***, ~150' ********/***' **** ** the ***** *** **' distance/~185' **** ** *** P3225, **** ** ***** negatives/missed ********** ** *** tests. 

***** ***** 

********* ** *******/******** ******** *** much **************** ** *** ******** tests, ***** ***** ******* were *** ******** ** did *** *****. ********* range *** ******* ** Motion ***** (~**-** ***), regardless ** ********* ** travel/virtual ******** *********. ** with ***** ******* ******** analytics, ***** ********* ****** be ********* **********, ** shadows *** ***** ** at ******** ***** ** day, ******* ******.

********* *****

********* ***** ********* *********** like ****** ***** **** a **** ****** ******* detection **** (******* ** 120 *******), **** ** missed *********** ** *** testing. ********* ***** *** ******** less ***** ** ***** alerts **** ***** ******** to ******, *** ** its ********* ***** ****, though ***** ******** **** regular ****** *** ** blowing ***** *** *******.

Motion ***** **. **** 

******** ** ****, ****** Guard ******** **** ***** false ****** ** ***** animals *** ** ***** Suite's *********** ***********. **** could ** ******** ** reject ***** ****** ** increasing ******* ****** ****, but ** *** ******* of ********* *****, ***** Motion ***** **** *** require.

******* ** ****, *** Axis ***** ******* *** the **** ********** ****** analytic, ****** ***** ** recommended, ********** ** * series ******* ***** *** install ** *** ****.

*************/************

**** ***** ***** ** compatible **** *** **** cameras ******* ******** *.* or ******, ***** ****** most ****** (*-* ***** old) *, *, *** Q ********.

*** ************ *** **** for * ****** *******, and ~$** *** *** others, *** ***********, *.*., running **** ****** *** Fence ***** ** * single ****** ***** **** $120.

Configuration *** ***********

*** ***** ***** ***** applications ***** **** ****** configuration *******, **** ** small ******, ******* ******, and *****-***** ****** *******, though ***** **** ******** depending ** *** ******** (loitering **** *** ******* short *****, *** *******, as ***** ***** ******* would *** ****** ** nature).

*** **** ******* ************* change **** **** ** the ********* ** *********** in ***** ****** *******. Users ***** *** ** more *****/**** ** ******* of ***** ****** (********* people) ** *** ***** of ****, *** ***** the ******'* ******, ***** here:

***** *** **** ******** define ***** ****** ******** manually, ** ** ******** versions *** ****/*. ** review **** ******* *** the ********* ** **** analytic ** **** *****:

Beware: ******* ****** ******* ********* *****

********* ******** *** ********* by **** **% **** swaying ****** ******** **** increased **** ******* (*%) to *** (**%) ** ignore ******* *****. ******** decreased ** ~**' **** 150' ** *** ***** (shown *****) *** ~**' from ~**' ** *** P3225-LVE ** **.

Common ******: *****/*******/****

********** *******, ******* ***** was * ****** ***** among *** ***** ***** applications, ******* ******** ***** alerts. **** **** ********* these *****, ***** ****** be ******* ** ***** space ******* ***** *** detection *****, ** ******** boxes *** ****** ****** further **** ********, ******* false ******.

********* ***** **** ******** **** false ****** ****** ** swaying ***** ** ***** "Time ** ****" ******** of **-** *******, **** foliage/brush ********** **** ****** to *****.

******* **** **** ********** caused ******, ***** ********** Motion ***** *** ***** Guard, ***** *****.

*******, *** ***** ************ had issues **** ******** ******* false ******, ******* ** **** other ****** ********* ** have ******.

Motion ***** ***********

********, ****** ***** *** not ***** ** ***** animals, * ****** ***** during **** *******, ** well ** ***** *********.

*******, ****** ***** *** not ***** ** ****** false ***** ******* **** as ******* ***** ******* in *** ***** ** view.

 

****** ***** ************ ******** ******** at ~**-** *** **** day *** *****. **** results ** *** ********* outdoor ******/*** ****** ** cameras ******:

  • *****-*** (*** **:*): ~***' **** *****/~***' ********
  • *****-*** **** (*** **:*) ~196' **** *****/~***' ********

Improved ***** ***** ***********

****** *******, ***** ***** consistently ******* ** ******** crossing *** **** ** ~90'/10PPF. ***** ***** **** captured ******** ***** ********** ** *** ******* tests, ********* ******** ******* across *** ***, **** during *** ***:

** **** ** ** night, ****** *** ******* *** difficult ** **** ********.

*******, ** *** ** issues ********* ****** ******* very ****** ** ********, shown *****:

Solid ********* ***** ***********

********* ***** *** *** fail ** ****** *** loitering ********, *** ** night, ** *** *****. Objects *** *********** ********* to ****** *****, *** with *** ******** ** a *****/*** ***** ***** as *** ****** *******, alarming **** ****:

**** **** **** ********* Guard **** *** ***** for * ******* ****** of ******* *******, *** instance **** ******** ** a ***** ** ***** or ****. *** "*****" setting ** ********* ***** refers ******* ** ******* loitering ** ********** ***** on * ****** ****** individually, ** ** *** objects ** *** ***** (e.g., ** **** ** any ******* ******* *** 120 *******, *** ******* is **********), *********** **** of * ******* ****** than *********** **********.

Versions ****

*** ********* ******** *** software ******** **** **** during *******:

  • **** *****-***: *.**.* 
  • **** *****-*** ****: *.**.*.*
  • ***** *****: *.*.*

Comments (12)

Avatar

Ethan Ace

IPVM | 06/25/18 04:06pm

This is the latest in our series of updated analytics testing. Next up are Avigilon's H4 analytics (camera based, with Appearance Search and UMD later) and Axis Perimeter Defender.

Readers should also see our others in this series:

Agree
Disagree
Informative: 4
Unhelpful
Funny

Stian Bjerkenås

In reply to Ethan Ace | 06/25/18 06:42pm

When you get to perimeter defender, could you also include an axis thermal camera? 

That is usualy what's recomended for such application, and it would be interesting to see how they perform compared to eo cameras. (given that you mount them side by side during your test) 

Agree: 4
Disagree
Informative
Unhelpful
Funny

Undisclosed Manufacturer #4

In reply to Ethan Ace | 06/26/18 07:00am

It would be really nice to see comparison side by side Avigilon, Axis and Bosch analytics. I mean same scene same situations and compare the results from 1 week testing.

Agree: 4
Disagree
Informative
Unhelpful
Funny

Undisclosed #1

06/25/18 05:14pm

Finally, we saw no issues detecting people walking very slowly or crawling, shown below

If it cannot eliminate the false alarms from other motion, this really is not that impressive.

Agree: 2
Disagree
Informative
Unhelpful
Funny

Undisclosed Manufacturer #2

In reply to Undisclosed #1 | 06/25/18 05:23pm

It's all impressive and far better than not using analytics. 

Agree
Disagree: 4
Informative
Unhelpful
Funny

Undisclosed #1

In reply to Undisclosed Manufacturer #2 | 06/25/18 05:32pm

"Analytics", to me, infers the ability for the system to make intelligent decisions with repeatable or predictable results. Intelligent decisions would mean ignoring general motion and only alerting on specific objects of interest.  Based on the test results here, the Axis system failed to show significant intelligence, as it had several false alarms.  There is nothing to indicate it detected a "person" crawling, just that it saw the crawling as the same kind of random motion it picked up elsewhere and was unable to classify or filter out.

Such a system is, to me, nowhere near "far better than not using analytics", as it just generates random alarms and can't be trusted.

Agree: 4
Disagree: 3
Informative
Unhelpful
Funny
Avatar

Daniel Cyr

Sirix Video Monitoring Central
In reply to Undisclosed #1 | 06/28/18 01:26pm

I think that it all depends on your application and reason of using analytics rule.  If you want to go through all activity the next day to see what went on, then this analytics could help you accomplish this faster. It would at least reduce drastically the number of events compared to if you would have simply relied on motion detection.

I think that as one of the leading manufacturer of IP cameras, Axis needs to be more competitive in this aspect of their products. As per many who I have talked to that attended the Axis Summit in Jamaica, they mention that they are focusing and investing on improving their analytics. They also mentioned that most partners where not even using analytics yet so I guess some of us are just a little ahead in that sense.

Let's wait and see what this gives in the next couple of months!

Agree
Disagree
Informative
Unhelpful
Funny
Avatar

Ethan Ace

IPVM | In reply to Undisclosed #1 | 06/25/18 05:59pm

To be clear, we are not saying that it's impressive that it detects people running or crawling. It should detect those people. 

It was specifically called out only because in our original test of Fence Guard, it failed to detect in these cases. I clarified that in the text.

Agree: 1
Disagree
Informative: 1
Unhelpful
Funny

Undisclosed Manufacturer #2

06/25/18 05:53pm

Analytics are not and will never (for a long time, anyway) be 100%. Users should expect false alarms regardless of the vendor. What noise would you receive without analytics? This is my point. If this does not make sense, please explain. 

Where does it say that they analytics failed to classify the crawling person vs. 'random motion' as you say? The crawling person displayed a green box that turned red upon crossing the line. This suggests the person was detected and triggered the line. Again, not sure what I'm misunderstanding but I'd genuinely like to know. 

 

Agree: 2
Disagree
Informative
Unhelpful
Funny

Undisclosed #1

In reply to Undisclosed Manufacturer #2 | 06/25/18 06:17pm

The shadows crossing the line showed the exact same response:

Given that it failed to properly suppress the shadows and false motion, there is no reason to believe the alarm on the crawling person was anything more than accidental. Going on the results of this test as shown here, the system did not exhibit signs of being able to actually be used to detect crawling people in a manner that would not generate excessive false alarms.

Agree
Disagree
Informative
Unhelpful
Funny
Avatar

Daniel Cyr

Sirix Video Monitoring Central
In reply to Undisclosed Manufacturer #2 | 06/28/18 01:36pm

The thing is that if you have used solid analytics like Avigilon, although they are not 100% they are VERY high up there. Avigilon has AI which over time increases efficiency or the analytic rules and eliminates some detections that at the time of install would have generated a false alarm.

At our monitoring central we monitor several hundreds of Avigilon cameras and sometimes we can go many minutes without one single event. A lot has to do with the the way these rules are configured by our integrators and the understanding of how they work.

One thing that I find amazing is that on all analytic solutions that I have tested or used,  Avigilon is way ahead as the best solution but what amazes me is that it is also by far the simplest to configure.

Agree
Disagree
Informative
Unhelpful
Funny

Undisclosed #3

IPVMU Certified | 06/26/18 05:09am

Excellent performance! Feet planted, both hands thrust into front pockets, sporadic movement, furtive glances throughout; capturing the very essence of loitering.  

 

Agree
Disagree
Informative
Unhelpful
Funny: 2
Read this IPVM report for free.

This article is part of IPVM's 6,956 reports, 927 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now
Loading Related Reports