Axis Perimeter Defender Video Analytics Tested

By: IPVM Team, Published on Jul 12, 2018

Axis 'high security' video analytics offering is Perimeter Defender, OEMed / developed with Digital Barriers.

But how good is Perimeter Defender? And how does it compare to Axis VMD4 and Guard Suite analytics?

We tested Perimeter Defender in indoor and outdoor scenes to find out, using two cameras:

 

We tested in multiple scenes outdoors and indoors, examining:

  • Configuration and calibration
  • False alert performance
  • Detection range
  • Detection scenarios
  • Comparison to Axis VMD4 and Guard Suite analytics
  • Camera compatibility
  • VMS integration

Readers should also see our other updated camera analytics tests, including Axis Guard SuiteAxis VMD4Bosch IVA Video Analytics And Motion+ VMDHanwha Wisenet X AnalyticsHikvision Intrusion Analytics, and Dahua Intrusion Analytics.

*******

**** ********* ******** **** results **** *********** *** 'high ********'. ***** ** performed ****** **** *** free **** *** *** ~$60 ***** *****, ** still *** *********** ***** alerts ********. ***** *** premium ***** *** **** 'high ********' ****'* ************ for ****-**** ***** ******, Perimeter ******** ***** ***** problematic.

****, *************, ** *** upcoming ******** **** ****, there *** * ***** vendors **** ******* ****** performing ********* *** ***** that **** **** ********, low ***** ***** *********.

** *** *** *********:

  • ******* ******* ***** ******:********* ******** *** *** trigger ** **** ****** sources ** ***** ****** outdoors, **** ** ***** animals, ******* ******, ** shadows.
  • **** ********* *****:********* ********'* ********* ***** was ****** **** **** competitive ********* ******, **** detection ** **** ~*-* PPF, ***** **** ********* required **+ *** ******** detection.
  • ****/******** ***********:********* *********** ****** ******* and ********** ** *** tests, **** *****-***** ******* within * *** ****** of ****** ****, *** ground ***** ******** *******, and *** ******* ********** estimated.

*******, ***** **** *** negatives:

  • ********** ***** ****** ***********: **** ********* ***** ** moving ***** ** **** screen *****, ********* ******** frequently ********* ***** ******. Alerts **** ******* ** less **** *** *** day **** ******** ***** areas **** *** ********* zone.
  • **** ***** ******:******* ** **** *********** camera *********, ********* ******** triggered ********** ** **** dripping **** *** ******'* dome, **** ******** ****** sent ****** ******** ****** over *** ****** ** testing (**** *** *****).
  • ******* ***** **** **** VMSes: **** ******* *** ********* require ** ********** ******** component ** ********** ** order ** ********* ******** to *** ***, ** additional **** *** ******** when ***** ***** ** Nx *******, *** ******** by **** ***** ****** analytics ****** (***** ***, VMD4, ******, ***.). 

****: ** **** * future **** ** *** Axis ********* ** ** Axis ******* ******, ****** the ************* ****** ***** point ** ******* **** limit *************, ********** ** results.

Vs. ***** *****/****

********* ******** *********** ****' other ********* (****/****** *****) in **** ***** ***** resistance *** ********* *****. VMD4 *** ***** ***** both **** *********** ** blowing *****, *******, *** especially ***** *******. ********, the ****** *** ******** at **-** ***, ***** Perimeter ******** ****** **** 5-6 *** *** ******** detection.

Camera *************

********* ******** ** ************** **** ** ****' current * *** * series ****** *** ****** M ****** ******. **** that ****' ********** ******* listing ** *** ** to ****, *** ** verified ************* **** **** product ********** ****** *******. Additionally, **** **** **** may ****** *********** ** other ****** ***** ** customer ******* *** ** such ** ********* ***** contact **** ** *** desired ***** ** *** listed.

**** ****** ******* ** not ***** ** ***** as ***** ***** ***** or **** ************, ***** support ****** *** ******* models, *** ****** **** mid ** **** *** models ***** *** ****** to ** **** ** these ************.

*******

********* ******** ******** **** for ~$*** *** *** camera. ****** ******** *** ten ***** *** *********. This ******* ** ****** than ****' *** ***** Suite (~$** *** ***********). Many *********** ******* ***** analytics ** ** ********** charge **** *** ******** of ***** *******.

Separate Application *** *************

********* ******** ** ********** using * ******** ***********, not ** *** *******' web *********, ******* ** Bosch *** *** ********'* H4 *********. **** *********** does *** **** ** run **** **********, **** events *** ******** **** directly **** *** ******* to ********** ***.

Automatic ***********

********* ******** **** ** automatic *********** ****** ***** analyzes ***** ** * subject ******* ********** *** field ** **** ** interpret *** *****. ***** calibration, ***** *** ********* with ** ***** *** verification, ******* *** ******* at ******* ******, *** marking *** ******* (***** in ****), ***** **** a "*********" ****** ***** indicates *** ******'* ********** in **** ***********. ***** calibration, ***** *** **** feed *** ******** **** used *** *********** **** the ******** ** **** detection ** ***** ******.

** *** *****, ********* calibration ****** ******** *** accurately ***** **** ** was ********* *******, **** subject **** **** ***** at *** ******. ** smaller ****** ******, ****** calibration *** ********, ** the ******** ***** *** properly interpret *** *****.

** ****** *** *********** process ** **** *****:

Improved ***** ***** **********

****** ****' ***** *********, ********* Defender *** *** ****** from ***** ****** ** many ** *** ****** outdoor *******. *** *******, cameras *** *** ***** on ***** ******* ** the **** ***** ** view, ****** ** **** and ***** *****.

****** ******* *** *** trigger *** ****** ** our *****, ******, ***** below.

*******, ********* ******** *** significant ****** **** ***** alerts ****** ** ******* brush, **** ******** ****** on **** ******* ***** days (***** *****). **** when ******** ***** ***** from *** ********* ****, some ****** **** ***** triggered (~* *** ***) due ** ***** ******.

************, **** ***** ********* caused ***** ******, **** as *** ******* ****** down *** **** *****, with ******* ***** ****** during ******** ****** ** the ****** ** *******.

Solid ****** ***********

******** ****** ******** ** larger ******* *****, ********* Defender *** **** ** used ******* (**** ****** calibration).

*******, ********* ******** *** not ***** ** *** typical ***** ***** *******, such ** ****** ******* on *** ***, ***** below:

 

************, ** ****** **** triggered **** ******** ****** on/off, * ****** ****** false ***** ****** ** other *****:

*** **** ****** ** ******** rooms ******* *******/***********:

Detection *********

********* ******** ************ ******* on *** ******* ** ~5-6 *** ****** *** and ***** ***** ******** in *** ********* ***** of **** ******/*********. ***** ranges **** **** ** the ******* **** ** our *****, ****** **** most ***** *********, **** the ********* ** ***** (~4-5 *** ** **** scenes). ******* ****** ********* ranged **** ~** *** to **** **. 

  • *****-*** (***/*:*): ~***' ****/~***' ********
  • *****-*** ** ** (***/**:*): ~***' HFOV/~200' ********

Detection *********

********* ******** ******** **** ********* *********:

  • *********: ******** **** ** object ****** * ****
  • **** ********: ******** **** when ******* ***** **** one ******** **** **** another
  • ***********: ******** **** ******* enter * **** ******* first ******** *******
  • *********: ******** ***** * specific ****** ** ****

** ****** ******** ******** in **** *****:

** *** *****, ***** more ***** ***** ****** without *****, **** ****** and ***** ***** *********** similar ** *********. *** example, ** *** **** crossing ***** *****, *** camera **** ****** **** the ******* ***** **** the ********* **** ** the **** ****** ** the ********. 

VMS ***********

********* ******** *********** ****** ********* on *** ***, **** Genetec *** ********* ********** both ****** *** ******** boxes, ***** ***** *** Network ***** ******* **** events, **** ** ******** boxes *********. ******** ******* Center **** *** ******* either.

Milestone/Genetec ***********

** ********* *** *******, cameras *** ******** **** zone *** ******** *** information, ** **** ** a *****/*** ***** ********* in *** *** ***** corner, ***** *** **** an ********'* ********* ****** than ******* ******** ***** in *****-****** *****.

****** *** **** ** used ** ****** ******, shown ****:

***** ************ ******* ********** software ********* ** *** VMS ******, ****** *** Perimeter ******** ******, ***** translate ******** **** *** proper ****** *** **** VMS. **** **** **** is * *********** ***********, only ******** ********, *** is *** ********* *********.

** ******** ** *** bridge, ******* ***** **** have *** ** **** SDK ******** ********* ** their ********* ******* ** order ** ******* ********* Defender ******, * ~$*** MSRP *******.

Exacq/Network ***** ***********

** ***** *** ******* Optix, ********* ******** ** only ********** ***** ******, with ** ******** ***** displayed. ***** ************ ** not ******* ********** ******** and **** *** ** the ***. ** **** VMSes, ***** **** **** select ********* ******** ** an ***** ******* ** start *********, **** *************, trigger ******, ***., ***** in ***** ****:

Versions ****

*** ********* ******** *** software ******** **** **** during *******:

  • **** *****-***: *.**.*
  • **** *****-*** ****: *.**.*
  • ********* ********: *.*.*.*****

 

Comments (15)

We use this - (well what it really is - Safezone edge from Digital barriers ;) ). Its usually spot on. The bush detection shouldn't have been an issue as if the zone was set correct and drawn around to avoid the area IMHO.

You can easily do a "lite" install to most VMS's by sending TCP notifications in to the VMS. The more complicated full version is more work but also quite useful on larger installations.

The only issue we get is reflections, so if you have a large vehicle near a road the anayltics will see a mirror of this and trigger, same for people walking past. Something any analytic will suffer - poor positioning.

The bush detection shouldn't have been an issue as if the zone was set correct and drawn around to avoid the area IMHO.

I'll let Ethan / Rob talk about the specific test results with 'bush detection' but I want to emphasize a fundamental point.

If an analytic system cannot tell the difference between leaves and a human, that's a major constraint. There are simply too many areas and applications where leaves and trees will be an issue. It also shows the analytics 'intelligence' is quite rudimentary.

bush or human - that is a fair point! lol :)

We removed the brush from the zone during testing and it improved, but did not eliminate false alerts. We still ended up with ~1 per day as the bush encroached too near the zone drawn strictly on the ground.

Yes, it's true that you can draw it further still from the brush, but in real world scenes, this is not always possible, as it may narrow a zone too much and risk missing detections, or brush may simply be in the middle of a zone.

Moreover, others such as Bosch IVA and Avigilon (test coming) did not trigger on these same areas.

Hi Ethan,

i have a question regarding the methodology of the testing. In full disclosure I am a field guy with one of the manufacturers tested.

In all of the tests so far, the cameras have been set to a wide field of view.  I suspect that towards the back of the field of view the stated capabilities of some or all of the analytics are exceeded.  My guess would be that you are attempting to gauge the ultimate detection performance (ppf) on a level playing field?  I’m wondering how you weigh false detections outside of the design envelope of the analytics? I don’t know if there were any occurrences with any of the manufacturers, but I was wondering if it was a consideration.

Thank you

The false alerts we have seen in this as well as other tests on brush have almost all been triggered by brush in the near field of view, not at long ranges. Additionally, we have tested all the analytics in this series in both wide and narrow fields of view to check differences, and performance has been fairly consistent in both wide and narrow AOVs in terms of false alerts. Meaning, if a camera has issues with brush using wide fields of view, it also had issues in narrower fields of view.

Also worth noting, we have discussed our findings with manufacturers as we've been testing these analytics, both tech support and product management where possible. We have adjusted settings and retested based on that feedback, as well. So manufacturers have had opportunity to point out whether we were testing outside of their capabilities.

"Axis Perimeter Defender test results were problematic for 'high security'"... I think any IVA will be problematic for outdoor applications if were used visual cameras, because there are smoke, dust, illumination issues, rain, etc.. a lot of potential troubles that will inevitably produce false alerts. Besides that, if a simple bug lend at the lenses, your detection system will fail... In my oppinion, a system with these fragility can not be used in an 'high security' application.

In my projects, I avoid to use IVA in outdoor and usually use auxiliar systems to detect acuratelly.

Good point Rafael, in addition we have seen Axis AVMD 4 completely miss a person walking across a parking lot on a few occasions.  We tested it side by side in a real environment (office parking, docks) and it missed too many people to use effectively although it did remove a ton of non-critical alerts.  Missing the few real people is a big deal, especially if you're not doing a secondary full time recording.

Let me make clear my comment. I was no criticizing Axis specifically, but, the technology of Video Analysis (does not matter the manufacturer). I dont think it is a good technology for outdoor applications in 'high security' systems using visual cameras. There are several non visual systems much more reliable for this.

 

 

 I dont think it is a good technology for outdoor applications in 'high security' systems using visual cameras.

I agree entirely.  The problem is that software creators, vendors, and even trade magazines are all over how wonderful video analytics are.  This means that when I tell our director and GSOC leadership that I do not recommend analytics because they are not sufficient to remove live monitoring and onsite security for critical locations I get a very aggitated "so I guess xyz vendor, videos online, and the news articles I read are all lying about its effectiveness?"

As I writed in a comment of this article, the most embarrassing situation is when I need to desagree about customer's video analytics wrong perception of effectiveness. The exaggerated marketing (sometimes almost unreal), creates in the customer's mind a unattainable level of accurance, and the installer needs to achieve it... so, it is a frustrated customers industry.
I'm sure that IVA technology has a huge potential for video surveillance applicantions, and, there are some great applications right now, mainlly in retail (that can tolerates a bit less accurance) and indoor controlled environments. But, I dont fell fine in use it for outdoor security applicantions, yet.
I think when deep learning video analysis, like Camio and Briefcam, who can really 'understand' what is happening, not just see a mass of pixels crossing a line or entering in a forbiden area, start to be viable to real time applincations, we will experience a revolution in the video surveillance market, but, while it does not happen, I keep using non visual systems to detect in outdoor.

I have a 50 acres campus I manage. We're currently thinking of using Perimeter Defender. I was wondering how well it performs today a year later?

How about the other available perimeter VCA options on Axis ACAP? There are quite a few of them besides Perimeter Defender. For example Agent Vi. Is there any experience with these other options, how well they perform against some of the criteria in these tests?

UM4, we have not tested Agent Vi yet but I will queue it up internally for testing.

The only other options we have tested are VMD4 and Guard Suite, which did not perform as well as Perimeter defender, which we noted in the report.

That sounds great, thanks Rob!

If I may, here's a wish-list

AgentVi, savVi (listed on the the AgentVi website, but no longer in the ACAP portal, wonder why)

Digital Barriers, SafeZone-edge (what Perimeter Defender is based on, is it better in original form?)

Jemez Technology, Eagle-i-Edge (I heard Axis was testing this on display in one of their experience centers a while back)

Two other criteria I might submit are

1. VCA + Thermal camera performance (a common combination at perimeters)

2. The option for “burning in” the metadata bounding boxes into the image itself before leaving the camera. This is bad practice in some circles, but does ensure that the alarm and bounding boxes show up at the monitoring station (regardless of PSIM) and they they are in sync – this is still limited.

Read this IPVM report for free.

This article is part of IPVM's 6,536 reports, 881 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Verkada Access Control Tested on Sep 09, 2020
Verkada raised $80 million earlier in 2020, expanding from video into access...
Avigilon Elevated Temperature Detection Camera Tested on Sep 17, 2020
Avigilon has entered the temperature screening market with the release of...
Cast Presents PoE Perimeter Lighting on Apr 28, 2020
Cast Lighting presented its PoE powered Perimeter fence system during the...
Hanwha 8K / 33MP Camera Tested on Sep 14, 2020
Hanwha Techwin has released an 8K / 33MP resolution camera, the TNB-9000 with...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Remote Network Access for Video Surveillance Guide on Jul 27, 2020
Remotely accessing surveillance systems is key in 2020, with more and more...
Axxon Presents VMS 4.4 and AI Behavior Analytics on May 20, 2020
AxxonSoft presented its VMS 4.4 and AI behavior analytics at the April 2020...
SenseB4 Presents Cloud Network Device Monitoring on Jun 09, 2020
SenseB4 presented its cybersecurity and network health monitoring products at...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
FLIR A Series Temperature Screening Cameras Tested on Jun 04, 2020
FLIR is one of the biggest names in thermal and one of the most conservative....
Dedicated Vs Converged IP Video Networks Statistics 2020 on Sep 10, 2020
Running one's video system on a converged network with other devices can save...
Camera Course Summer 2020 - Last Chance on Jul 18, 2020
This is your last chance to register for the Summer 2020 Camera Course. This...
Seek Scan Thermal Temperature Screening System Tested on May 28, 2020
Now that IPVM has tested Dahua, Hikvision, and Sunell, we are returning to...
ZeroEyes Presents Firearm Detection Video Analytics on Jul 09, 2020
ZeroEyes presented its Firearm detection Video Analytics system at the May...
Hanwha Face Mask Detection Tested on Jul 01, 2020
Face mask detection or, more specifically lack-of-face-mask detection, is an...

Recent Reports

Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
New Products Show Fall 2020 Starts Tomorrow! on Sep 27, 2020
Tomorrow, IPVM's sixth online show will feature New Products from over 25...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...