Axis Video Analytics Are Weak

By: Ethan Ace, Published on Oct 05, 2015

For more than a decade, video analytics has frustrated and disappointed users.

Now, Axis has released their own "series of robust video analytics applications" that they call Guard Suite [link no longer available]. Unfortunately, IPVM's testing shows that Axis' video analytics are weak. We tested both the Q1615 and the P1428E with the motion and fence applications ($149 MSRP each but free 30-day trial applications are available here [link no longer available]).

******** ** ****' ******** effort,*** *, **** ***** ***** sources **** **** ******* or **********. ** *** tests, ***** ***** *** not ******** ******* ******, birds, ** **** ** *******, occasional ******** ** *** 3. 

** **** ***, ******** size, **********-****, **** *** weather, ********** ******** ****** slowly **** ***** ***** should work ********** *** ********.

*********

**** ***** ***** ** dumb.

***** ******* *** ** the ******, *** **** Guard ***** ********* ** reliably ****** ***-***** **********. **** modest **** ***** **********, false ********* *** ***** negatives ****** *********** **** Guard ***** ********** ** recognize **** ** * real ***** ** ******, wires, *******, ***. ***** problems *** *** **** severe ************ (******)******** ******* (******).

*********** *** **** ** intelligence is * ********** ***** process **** ***** ******** controls ** ******* **** might **** ********** *** this, ****** ********, ***** largely ******* **** *************, and ***** ******* **** provides ************* ***** *** calibration ** ******* ***********.

Market ****** / ***************

** *** *** **** Guard ***** ****** *** use ** ** ****** indoor ****** ** ****** in ** ***** *** week ** ******* ** the ***** ******** *** plan ** *** **. Despite ****' ****** ******, Guard ***** ** *** 'robust'.

** ****** *********** ***** this ** ** ********** by *** **** *********** and *** ********* ** overcome **. ** ** not *** **** ***** widely ****, ******* **** to ******** ** ***** on *** ***** ******** apps.

Performance ******

** **** ******* ** ***** down *** *** ****** impacting **** ***** ***** performance, ********* ***** ***** issues, ****** ***********, *** more, ** **** *****:


***** *********** 

****' *********, **** *** 3 ****** **, ****** from ******** ***** *********** from *****, ********, *******, and ***** **********. ** the ***** *****, *** brush ** *** ***** side ** *** *** is **** ** ******* by *** ******, ******* calibrating *** **** *** perspective. **** ******** ** far ** ** ************ cause ***** *********** ** the ******** **** ** the *****. 

***** *********, **** ** Avigilon *** ******* *** not ********** ***** ******** activations.

****** *********** 

** *** *******, ******** crossing * ******** ***** Axis ***** ***** **** often *** ********. ** the ***** *****, *** camera ****** **** *** detect *** ******* ** an ****** ***** ** is **** *** ****. Avigilon's *** ****** *** 100% ******** ***** **** same *****.

** ******* ******, **** was **** *****, **** Axis ******* ******* **** than **% ** *** time, ***** ******** *** successful >**%. ** *** example *****, ******* *** subject ***** **** ** an ****** ***** ** running, *** ****** ***** to ****** *** **** he ****** ******.

**** **** ** ***** FOVs, **** **** **** to ****** *** ******* as * ***** ******, tripwire *********** ****** **** not ** ****** ** *** examples *****. *******, **** still *** ******* ********* running ********, ******* **** about **% ** *** time.

** *****, ****** ********** at ****** ****** **** frequent, ** ****, **** with *** ******* ** well ***** ****** ******** areas ** *** *****, reviewed ** **** *****:

********* *****

***** * ~**° ********** field ** ****, ***** Suite ********* **** ******** at * ******* ***** of ***** ***' ***** *** 1080p ***** ****** *** day. **** ** ***** **% less ******** **** *** Avigilon *** ******, ***** covered ~***' ****.

**** **** **** ** the ******* ***** ******** detection *** ******** (>**%). Beyond ****, ******** ** normal ******* ****** *** **** frequently ******, ****** ********* spotty.

Setup *** ***********

**** ***** ***** ********** perspective *********** *** ***** ** their ******** ************, **** as *** *, ******** to ****** ********* ******** and ****** **** ** measuring ******* ** *** FOV.

**** ******** ******* ******** on **** *******, **** instructing ***** ** *** measurements "** ********* ********* from *** ******."

******** ** *****

******** ** *****, ***** also ******** *********** (******** does ***), ***** *** several *** *********** ** this *******:

  • ** ******* ****/***** ***** window:****' *********** ************ *** performed ** * ***** window, **** ** ****** to ********* **** ** enlarge *** ****** ** more ********** ******* ******** as ** ***** (**** A ** *** ***** below). **** *** **** it ********* ** ****** measurements ** *** ***** top *** ****** ** an ******, ******** ********.
  • ***** ********* ** ********:**** **** * **** to ******* *******, **** a ***** *** ** either *** ***** ********* size, ***** *** ******* the **** ** *** object ***** ********. ***** uses * ******* * shape (**** * *****) to ******* *** ****** scroll ***** ********** ** size, ****** ** ****** to ****** ** *** top *** ****** ** an ******.
  • ** ******** ***********:**** ******** **** ****** of *******, *** ******** calibration ***** ** ***** (and *****'* ****** *** releases). (**** * ** image *****)
  • ** ******* ****:***** ******** * ******* marker ***** ** **** to ****** ****** *********** of *** ******, ** well ** ******* ******* in *** ***. **** does ***.

************, **** ******** ** visual ************ ***** ** check *** ******** ** measurements, **** ** ****** or ********, ** ****** measurements *** ********. ***** and ***** **** ******* this *******.

*******, **** ******** ** maximum **** ******** ** vehicle **. ***** **************. All ******* *** ********, regardless ** ****/*****.

*********** *************

** *** ***** ***** we *********** *** **** calibration ******* *** *** issues ***** *****:

VMS ***********

*********, **** ***** ***** is ******* ** ****** integration *** *** ****** or ***** ***** ****. It ** ****** **** integrations **** ** ******** in *** **** *** months, **** **** *******:

"**** ***** ***** **** be ********* ** **** ****** ******* *** ******* *** ********* Genetec *** ******* ******* through **** *******’ ***** stream, ***** ********* ******* will ******* ****** ***********. Support ** ******* ****., Exacq ************ *** ***** is ******* ** ** available ** *** *** of ****."

** ** ***, ***** may ******* ***** ****** by ********** **** ** the ***** *** ****** in *** ******, ** seen ** *** *** of *** ****** *****. Users *** *** * motion **** ** ********* motion **** ** *** area ***** **** **** appears, *********** ******** ** the ******** ****:

***** *** **** **** TCP ****** ************* **** the ****** ** ***** which ****** ****. **** is ************ ** *** video ***** ***** ***** the *********** ** ***** Suite **** *****, **** event **** ********** *** ********** overlaid **** **** *****.

Comments (9)

Use digital barriers on a Axis - UK iLids approved. IMHO it just works :)

The analytics developed by Axis was informed to target a low-end segment of VCA, although a step up from their VMD and simple cross-line it was not to become a high-end VCA (yet at least). The argument was not to compromise their open platform by competing with the 3rd party higher-end VCA solutions that can run on their cameras.

What I'm a little bit surprised about is the price, I had anticipated that they were going to offer this for a much lower cost, more in line with their previous Cross Line Detection.

I think it is dangerous to offer analytics for a 'low-end segment of VCA'. It is very hard to determine how poorly the analytics will work in different scenarios, which makes it likely that they are deployed in conditions they cannot handle well, which makes customers frustrated and causes integrators to lose lots of money troubleshooting / trying to optimize.

Axis lead marketing claims for Guard Suite is "Robust and reliable indoor and outdoor detection" that "Protect and detect around the clock". If they really wanted it to be 'low-end', then they should have avoided such claims. As is, they have set expectations that they cannot meet.

Yes, unfortunately marketing talk will almost always over-sell products.

As for targeting the low-end, that's what they did with the Cross Line (in my opinion). It seemed to perform rather well compared to its competitors in the tests you performed. But I guess their marketing language wasn't as bold then.

http://ipvm.com/report/analytics-rain-axis-bosch-sony

http://ipvm.com/report/camera-analytics-tested

I would personally be extremely reluctant to use the Axis Cross Line in any outdoor environment since the consequences of missed alarms and a high false alarm rate would be devastating to our costs and brand value.

It will however be interesting to see how well the new Axis analytics perform. Hopefully it is a step up from the old Cross Line and you seemed to think that it at least reduced the false-alarm rate somewhat compared to VMD 3.0. Perhaps it can perform good enough in ideal, sterile environments (as you mentioned in the test).

If you have time for it, it would be interesting to see how the latest Bosch-analytics compares with the new Axis as the latest Bosch should be much better than the old.

Similarly to the Bosch analytics (as well as just about any other VCA on the market that is actively developed), I think we'll see improved performance over time with the new Axis solution, the question is when (or if) it will be a good enough to use in non-ideal scenarios as well and whether it will be enough to be competitive towards the other camera manufacturers. Only time will tell...

Axis Crossline definitely had more false alert issues than you see in Guard Suite. I recall headlights, shadows, and blowing leaves being bigger issues than even what you see here. Guard Suite is at least far less susceptible to the headlights/shadows.

That being said, Crossline also didn't seem to have the same rate of missed objects that Guard Suite does. That's likely because it detected everything as an object, like debris/headlights/shadows, so it was less choosy and less likely to drop an object once detected.

I would love to see an on-board analytic shoot between Pelco, Axis, Samsung, Bosch etc..

The placement of bars for calibration in you tests (see the "Axis Perspective Calibration" Figure) is certainly wrong because bars should be normal to the ground plane. Otherwise the data essential for calibration will be inaccurate. This is best seen with bars 1 and 2 drawn over the two cars. The bars should go along the front door vertical edge (which is not at all "vertical" in the picture).

I don't know if Axis has made a note of this fact in its manual but no calibration is possible with bars drawn at random.

The bars are not drawn at random. The bars you see on the cars were drawn along the door line from the roof to the ground as you point out. However, Axis snaps the lines to vertical after they're drawn, but they remain the same length. I measured the cars those lines were drawn on, as well, to be accurate.

The cars themselves don't appear level due to the angle of view. The FOV overall is level, though, as you can see the poles in the background are vertical.

Also, this scene was later recalibrated when I moved cameras back to this point for further testing.

For reference, Axis gives little guidance as to what is right/wrong in this calibration, nor any best practice in their manual.

Thanks for your clarification. Really strange that Axis "snaps" the bars to vertical... No way to double check the bars had been drawn correctly.

Read this IPVM report for free.

This article is part of IPVM's 6,534 reports, 880 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Video Analytics 101 on Mar 16, 2020
This guide teaches the fundamentals of video surveillance...
Facial Recognition: Weak Sales, Anti Regulation, No Favorite, Says Security Integrators on Jul 07, 2020
While facial recognition has gained greater prominence, a new IPVM study of...
Fever Camera Sales From Integrators Surveyed on Jun 01, 2020
Fever cameras are the hottest trend in video surveillance currently but how...
Axis Compares Fever Camera Sellers to 9/11 on Sep 18, 2020
Axis Communications, the West's largest surveillance camera manufacturer, has...
Verkada: "IPVM Should Never Be Your Source of News" on Jul 02, 2020
Verkada was unhappy with IPVM's recent coverage declaring that reading IPVM...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Latest London Police Facial Recognition Suffers Serious Issues on Feb 24, 2020
On February 20, IPVM visited another live face rec deployment by London...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
Injes Tiny Temperature Terminal Tested on Jul 17, 2020
While temperature terminals have trended bigger, the Injes DFace801 is...
Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter...
Terrible Convergint Coronavirus Thermal Camera Recommendation on Apr 01, 2020
A week after Convergint disclosed falling revenue, pay and job cuts,...
Sunell Panda Cam Body Temperature Measurement Camera Tested on May 14, 2020
Sunell is far less well known than its gargantuan domestic competitors Dahua...
WDR Cheat Sheet and Camera Tracking - 30 Manufacturers on Aug 26, 2020
Manufacturers are regularly cryptic about what WDR support they actually...
Mobile Access Control Usage Statistics 2020 on Sep 21, 2020
Most smartphones can be used as access control credentials, but how...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...

Recent Reports

OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...
China Bems Temperature Measurement Terminal Tested on Sep 22, 2020
Guangzhou Bems (brand Benshi) is the manufacturer behind temperature...
Axis Exports To China Police Criticized By Amnesty International on Sep 21, 2020
Axis Communications and other EU surveillance providers are under fire from...
Milestone XProtect on AWS Tested on Sep 21, 2020
Milestone finally launched multiple cloud solutions in 2020, taking a...