Since those trees are bare now, do you plan on revisiting this test when there are leaves on the trees? I am wondering if the leaves will impact the accuracy.
Axis VMD4 Analytics Tested
Published Apr 17, 2018 19:23 PM
**** ** *** ** *** *** generation ** ***** ****** ********* (***), which **** ***** "* **** ***** analytics ***********." ****** **********, **** **********:
****** ***** ****** ** ********* *** disregarding ****** ********** ******. **** ***** Alarm ********* ******** ** ********** ***** of ******* ******* ***** ****** ** making ** ******** ** ****** ********** object ****** **** ** **********, ******* trees *** ***** *******.
**** ** *** ***** ** * 2018 ****** ** **-***** ****** ********* tests. ****** **, ** **** ** release ***** ** *****, ******, *** Hikvision *********, ** ****.
*******
*******, **** **** ****** **** ****** false ***** ********* **** ****** ******* such ** ********* ******, ****** ******* on/off, ******** ********, ***. **** *** true *********** *** ** *** ***, with ** ******** ******* ********.
********, **** ******** ****** **** ******* branches/foliage, *** *** *********** ** ***** triggers ** ******* *******, **** ** blowing **** ** **** ***** ** cameras' *****.
***** ******* **** **** ** ***** but ***** ** ******* ** ********** by ******** ***** ****** ******** ** VMD4 *****. *******, ***** ******* *** long-range ********* ****** ********* **** ******* carefully, ** ********** ******* ****** **** could ********* ********* ** ***** ******** in *** *** ***** ** ****.
*******, ***** *** *********** *** ******** compared ** ****, **** *****, *******, Milestone, *** ******* ***** ********** *** analytic, **** ******* ****** ** ******** for **** ********** *** (*** ******* level) ** ** ********* ******** **** level ** *********** ** *** ***.
Test ******* ********
** ******** ******* **** *** ******* in **** *****:
************
**** ** ********* ** *** ****** running ******** *.** ** *****, ***** covers *** ******** ** ****' ******* product **** (**%+). *** ****** *** shipped **** **** ********* **** *** factory, ***** ** *** ** ********* via *** *** ********* ****** ****** ********* ******.
*** ***** ***** **** *** **** updated ** **** ********,**** *******.**** ***** *********, ****** **** ******* *********** compared ** ****.
Configuration ********
************* ** **** ** ******* ** ****, with *** **** ******* *** *******/******* zones, *****-***** *******, ***** *******, *** swaying *******.
** ****** ***** ************* ******* ** the ***** *****:
Few ***** ****** *******
*******, **** *** *** ****** **** false ****** ****** ** ******* ***** affect **** ***** ******'* *** *** analytics.
*** *******, ********* ****** *** ******* light ******* (*.*., ****** ********* ***/** in * ****) *** *** ******* any ****** ** *** *****, ******* common ******* ** **** ******** *****.
***** ******* **** ******** ******** *** switch *****, ****** ***** ***** ******* in **** *****, *** *** ******* VMD4, ***** *****.
Outside ***********
********, **** *** *** ***** ** sources **** ** ******* ********/******* ***** commonly ******* ***** ********* ** **** tested.
*******, ***** ******* ** *** ********** of *** ***** ********** ********* ****** (shown *****). *****, *********, *** ******* all ****** ******** ******. ***** ***** be ******* ******** ** ********* ***** animal ********, *** *** **********.
**** **** ***** ****** ******** ****** be ********* *** ** ****** ******** detection ** *******, ** ******* ***** subjects *** ** ******* **** ***** or ***** ******* ** *** **********, and ******* ** *** ********, ******* missed ******.
******, **** *** **** ****** ******* false ******, ** ****. **** *** most ******, ******* ******** ******. ****** from **** ***** ** ******* ** increasing ******* ***** ****, *** ***** object/swaying ****** ******** *** ** ******.
**** *** **** ******, *** ******** on *** *******' ***** ********* ****** alarms, ********** ** ********.
*******, ******* ****** ****** ** *** wind ********* ****** ************, ****** ** a **** ***** **** **** *******/*******.
Camera *********** ***********
** ****** **** ***** ******* ******, ********* low-end * ****** ******, * ******, and * ****** *****. ** *** tests, *** ******* ******** ******** ******** at **-** ***, **** *** ***** varying ********* ** ********** *** *** width (*** ********* ***** *****).
*******, *** ******* ****** ******** ********** IR. ***** ******* ********** ** *** ****** to ******* ***** ** ********* ****** without ******** ** ****** *** ****** too ****.
Detection *****
**** ************ ******** ******** ** ~**-** PPF **** *** *** *****. **** results ** *** ********* ******* ******/*** widths ** ******* ******:
- *****-*** (*** **:*): ~***' **** *****/~***' ********
- *****-*** (*** **:*):~***' **** *****/~**' ********
Improved *********** ******** ** ****
**** ********** ******** **** **** ** the ***** *****, ********* *****, *******, and *********, ** *********** **** ****, which ********** **** ** ******* *** ****' *** ****** ******* ***.
VMS ***********
****'* *********** **** *****, *******, *** Milestone ******* ******** ***** ** ****** recording/alarms *** **** ******, ******* ** complexity, ********* *****. ******* ***** *** released ******* *** **** ** **** 3.2, *** *** *********. ******** **** *** support **** (******, ** ******, ******** supports *** *** *******).
Genetec/Milestone ***********
******* *** ********* *********** ******* ***** to ****** **** ** *** ******'* motion ****** **** *********** ****** **** motion, ******* ** ******** ***:
Exacq *********** *************
*** *** ******* **** **** *** no ***** ****** ****** ***** ********** (1, *.*, *), ***** ********** **** as *** ******* ****** ********* ******.
*** ******* ***** **** ********** ********** with ******* ******* ** ****** *********, users **** ****** *** ****** **** Exacq, ****** *** ***** ****** ***** using ***** ******, **** ****** * VMD4 **** *** **-*** ** *****. Exacq ********* ******* *** **** ****.
Other *****
*** ***** ***** ***** *****, ** *** be ******** ** ******* ********* ** VMD4 ****** ** ********** *** ******'* output ** *** ***** (** *********) and ********** ********* ** ***** **********. It *** **** ** ******** ** trigger ****** ***** ******* ***/**** *******. We ******* **** ** ***** ******* in*** **** ******.
Versions ****
*** ********* ******** ******** **** **** in **** ****:
- **** *****-*** ** **: *.**.*
- **** *****-***: *.**.*.*
Comments (25)
Jon Dillabaugh
Apr 17, 2018
Ethan Ace
Apr 17, 2018We tested Axis and Hikvision together over the past few weeks. Hikvision will be released next. As we're testing others later on, we'll likely do some retesting when leaves are on the trees.
UI
Undisclosed Integrator #2
Apr 19, 2018MM
Michael Miller
Apr 17, 2018I bet this works with Avigilon when you configure Arbitrary Events in ACC.
MM
Michael Miller
Apr 21, 2018I can confirm VMD 4 works with Avigilon ACC 6.8.4.0 using Arbitrary Events. You can use VMD 4 to trigger any alarm or rule in ACC and trigger recording. Tested using Axis P3228-LVE and Q1615-MkII both running firmware 8.10.1
MM
Michael Miller
May 26, 2018Sorry, this took so long. Here is an image of searching VMD4 events in ACC. Nevermind the "Axis VMD3 test" as we were testing with VMD3 and VMD4 but forgot to change the name.
JS
Jason Spielfogel
Apr 17, 2018Is the variable object size detection global to the FoV? Or can ROIs be established that have different thesholds? If yes, then you can overcome some of the challenges of objects getting smaller as the camera to object distance increases.
Ethan Ace
Apr 18, 2018Object size is unique to the profile, which essentially amounts to an ROI. You can only have one detection zone in a profile (but more than one exclude zone). Settings for short lived, small objects, and swaying are configurable independently of other profiles.
JL
Joey Leone
Apr 18, 2018Great , detailed post! For all the related trash Google results out there , this site is the only place you'll find sold, proper reviews/ comparisons like this.
Two other important notes/upgrades with axis VMD4 as compared to vmd3 ;
With 4, you can finally use chrome (and I assume Firefox), to configure your motion Squares/polygons, in VMD 3 you had to use Internet Explorer plus axis s ActiveX component (I think it's called access media control or something similar).
Additionally an idea: during your IPVM video screen grabs, you can add an event (on the cam) with action=overlay text , " Motion detected" , trigger= Any motion detection profile. This will show when md is triggered. Not a big deal, but this event is something We like to add to deployments as it's easy to see on remove streams how often motion detection is being tripped (and it's accompanying high-quality low FPS short record to SD card)
JL
Joey Leone
Apr 20, 2018I Should have added- if u use action=overlay text , The variable you should use on your text overlay settings is #D
(boy did this have me stumped for months.. I was sure it was a bug with the action , as #D isn't very clearly documented)
MD
Mark Davis
Jun 05, 2018RS
Ryan Strange
Apr 18, 2018Generally love this. But on the 1st video, after the lights are out you can see a 'perpetrator' in the doorway. Was that alerted or no? So if someone walked right there, clearly a person, would that have been caught?
The great trick is missing that person when conditions aren't great....when it's raining, dark with lights out, etc.. We've tested 3 good ones (not all from camera manufacturers) and they've missed a guy but been absolutely great 90% of the time.
It's not easy and Axis has a great version going.
Ethan Ace
Apr 18, 2018It didn't alarm on that reflection of the person in the doorway, nor would I think it should, actually. If someone just happens to walk by in the hallway, it's not actual motion in the room, and shouldn't alarm.
As far as detecting in the room, yes, VMD4 triggered very reliably in that scene and all the interior scenes we tested. We will grab a clip of that.
RS
Ryan Strange
Apr 18, 2018That's the great trick. That -is- an actual person, and if that's my warehouse or clubhouse and someone stopped at the door or looked in I'd want to know. It is a real live person. I agree 100% that it generally works great inside, and we find very good outside as well. Like anything else it falls up to the integrator to have it all set right so not to miss that critical event.
Dwayne Cooney
Apr 18, 2018Great review
UM
Undisclosed Manufacturer #1
Apr 18, 2018Are there any motion detection analytics out there in which you can create multiple detection areas with unique min/max pixel size within the same camera profile so you can catch humans far away but not small animals close up?
PD
Paresh Desai
Apr 19, 2018Thank you so much. We just got bunch of new Axis cameras to install. Axis manual is very weak. It's online help in the camera gui does not go in details as you do. Their webinar on Zipstream isn't very good either (refers to web gui help!). Genetec manual on configuring Axis zipstream products is weak too.
This is the best how to I've found so far. Thank you again.
There is one error I am getting that perhaps you can help? When I go in to Axis Video Motion Detection 4, error message below comes up on the top right-hand corner.
"Other Axis video analytic applications appear to be running already. For performance reasons, it is recommended to run only one at a time. Please stop: AXIS Video Motion Detection 1."
Under "Apps" there is only one app that is installed - AVMD 4.
JL
Joey Leone
Apr 20, 2018Seeing as this is a new axis cam , my first guess would be it's your nvr trying to run edge motion detection incorrectly (or other onvif related mess up)?
See if fully removing the cam from your NVR changes anything. Otherwise look into axis plain config menu (for random settings / motion windows(
(or as a last resort , factory reset cam, wo nvr attached)
PD
Paresh Desai
Apr 20, 2018
Fredrik Ahlsen
May 06, 2018Thanks for this report. I hope to see even more tests and reports on Video Analytics here on IPVM. This is a field where its a big gap in the claimed performance/the expectations of the clients and the actual performance of the products.
I wonder, is this really a test of Axis onboard analytics, or just the latest Video Motion Detect from Axis?
Looking at their website it seams like they have analytics packages that could perform a lot better than VMD4:
https://www.axis.com/products/analytics-and-other-applications
https://www.axis.com/products/axis-loitering-guard
https://www.axis.com/products/axis-fence-guard
https://www.axis.com/products/axis-motion-guard
I also really like to see a test of video analytics from VCA Technology.
http://www.vcatechnology.com/
JH
John Honovich
May 06, 2018I wonder, is this really a test of Axis onboard analytics, or just the latest Video Motion Detect from Axis?
Axis calls VMD4 a 'video analytics application'. However, to your point, there are more advanced options. We do plan to test them (e.g., fence guard) but we are starting from the entry-level, free ones to first understand how well or not they work. We'll be doing more video analytics testing over the next few months.
As for VCA, we might test them but that is a lower priority relative to larger companies like (alphabetically) Avigilon, Axis, Dahua, Hanwha, Hikvision, etc.
MD
Mark Davis
Jun 05, 2018Good material here on VMD3 vs. VMD4. Does anyone know what the differences are between motion guard and VMD4? They look pretty similar...Also, note, on a Q3517, I have fence guard, motion guard, VMD4, installed.
I realized digital auto-tracking doesn't work with this cam - not sure why?
-mark
Ethan Ace
Jun 05, 2018I actually just asked Axis for clarity on performance differences between VMD4 and Motion Guard, as we are planning an updated test of that soon. I'll post back when we get a response.
As to Digital Auto Tracking, we asked in the past about some missing models, because several of the high end/high resolution cameras are missing from the compatibility list. According to Axis, the app was unstable on some models, so isn't listed as supported, but this was expected to be improved in later firmwares. I'll see what they say on this topic, too.
MD
Mark Davis
Jun 06, 2018Ethan Ace
Feb 05, 2020Update: We tested Axis' latest VMD4, 4.4.2, released in Axis firmware version 9.60. This test was originally conducted using VMD4 v4.2.
Performance is generally similar. We saw no issues on blowing foliage, similar to our original test, slightly stronger against shadows cast by the trees.
However, it still had issues with animals, such as the large dog shown here:
And it suffered from false alerts caused by headlights outside the field of view, shown here reflecting on the side of the trailer.
As Axis releases new versions we plan to retest periodically and will update here.