Advanced VMD - Axis / Mobotix Tested

Author: Ethan Ace, Published on Aug 26, 2013

Surveillance professionals prefer motion based recording over continuous but the main weakness of motion detection is its inaccuracy. Sure, it saves a lot of storage over recording continuously but it still can be very inefficient, triggering against leaves, trees, shadows, low light noise and more, requiring time consuming optimization that rarely works completely.

Axis and Mobotix Advanced Offerings

Recently, both Axis and Mobitix have released advanced video motion detection offerings. Axis has VMD 2.1 that it bills as having 'easy setup with few false alarms' while Mobotix promotes MxActivitySensor as offering 'unique motion detection in the camera'.

The IPVM Test

We tested both of these offerings to understand how much of an improvement they made over 'traditional' video motion detection plus how accurate they were.

To do so, we bought 2 Axis cameras (same model) and loaded one with traditional and one with VMD 2.1, running them simultaneously.

We started with a simple conference room and performed tests with moving subjects as well as running the cameras 24/7 to measure false positives:

We then moved on to a more complex, larger area to see how the offerings handled this:

Finally, we went outdoors to a very large area with vegetation to see how they would fare in an adverse environment:

Finally, we ran the Mobotix camera through similar conditions to gauge its performance.

Questions Answered

Our testing answers the following key questions:

  • How much of an advantage did advanced VMD provide over traditional?
  • Where was advanced VMD better than traditional and where was it worse?
  • Is it worth using advanced VMD? If so, where?
  • What barrier or issues are there in using 'advanced' VMD?

************ ******************* ****** ***** ********* **** **************** **** ******** ** ****** ********* ** *** **********. ****, it ***** * *** ** ******* **** ********* ************ *** ** still *** ** **** ***********, ********** ******* ******, *****, *******, low ***** ***** *** ****, ************* ********* ************ **** ****** ***** **********.

Axis *** ******* ******** *********

********, **** **** *** ******* **** ******** ******** ***** ****** detection *********. **** ****** *.***** ** ***** ** ****** '**** ***** **** *** ***** alarms' ***** ******* ************************** ******** '****** ****** ********* ** *********'.

The **** ****

** ****** **** ** ***** ********* ** ********** *** **** of ** *********** **** **** **** '***********' ***** ****** ********* plus *** ******** **** ****.

** ** **, ** ****** * **** ******* (**** *****) and ****** *** **** *********** *** *** **** *** *.*, running **** **************.

** ******* **** * ****** ********** **** *** ********* ***** with ****** ******** ** **** ** ******* *** ******* **/* to ******* ***** *********:

** **** ***** ** ** * **** *******, ****** **** to *** *** *** ********* ******* ****:

*******, ** **** ******** ** * **** ***** **** **** vegetation ** *** *** **** ***** **** ** ** ******* environment:

*******, ** *** *** ******* ****** ******* ******* ********** ** gauge *** ***********.

Questions ********

*** ******* ******* *** ********* *** *********:

  • *** **** ** ** ********* *** ******** *** ******* **** traditional?
  • ***** *** ******** *** ****** **** *********** *** ***** *** it *****?
  • ** ** ***** ***** ******** ***? ** **, *****?
  • **** ******* ** ****** *** ***** ** ***** '********' ***?

[***************]

Answer *******

  • *********** ********** ***** ***** ****** **** *** ******* ******** *** over ***********. ****** ***** ****** **** ****** **********.
  • *** **** ********** ** ******** *** *** ** *** **** where **** ***** **** *******. *******, *********** *** *** *** more ****** ** ******** **** ******* ** ***** ****** ** the ****.
  • ***** ******** *** ** ***** ** ** ****** **** *** application. ** **** *****, *********** *** ** ****** ******* ****** so ** ***** ** ****** ** *** ************ ** ********* was ********.
  • *** ******* ** *** **** *****. ***** **** **** *** Mobotix ********* *** **** *** *** ** ****** ***** ** most ** ***** *******, *** ******* ** * *******. ******* only ******** ******* (** ********). **** *** *.* ** ************ only ********* ** ***** *** *** *** *** *******.

Key **** ********

***** *** ******* *** ******** **** *** *****:

  • **** ***** ****** ********* *.* ******** ****** ** **** ********** than ***** ******* ****** *********, **** ****** ********* ***** *** ranges, *** **** *** ***** ******. 
  • *******, ** *** ***** ****** (~* *** *** ***** ** our *****) *** *.* ****** **** *********** **** *******. *** false ***** **** ******** **** ***.
  • ****' ******* ****** ********* *** ****** ********* ** ******* ** light, **** ** *******, ****** ************, *******, ***., ******** ***** ******* ** ***** ****** *** to ***** *******. 
  • **** ** *** ******** ****** **** *** ****** ***********, ******** VMD ****** ***** ****** ******* ***** *** *.* *** ***.
  • *** *********** *** ********** ***** ******* * *** * ****** cameras, ****** * ****** ******* ********* ** ***** ***** ******, where * ****** ******* ******* *********** ** *****.
  • *** *.* ******** ****** ** *****, **** * ****** ********* included *** ******** ******** **** **** ** *********** *************.
  • ******** *** ****** **** ******* (**** ******** *** *******), ****** zones *** ********** ** ****** *********** ******, ******* ** *********, making ******** ** ***-****** ***** **** *********. ***** **** ********* object **** *** **** *********** ** **** *** ****.
  • ******* **************** (********* ** * ***) *** * **** **** detection **** ** ** ***** **' ** **** *****, ********** direction ** ******* *** * ***** *******, ** ****. *******, the ******'* **** *** ***** *********** ******** ** ****** ***% missed ********** ** * *** ** *****. 
  • ****************'* ******* ***** *** **** ****** **** *** ****** *** moving ****** *** ***, **** ** ****** * ******* ** over ***', **. ~**' **** ****** ******/**** **** *** ******.
  • **************** ** **** ****** ****** ** ****** *** ********** ****** caused ** ********** *******, **** ** **** ******** *** ******. Activation ** ***** ** *********** ****** ****.

**** ***** ****** *.* ** ********* ** ***** ******** ******** **** ****. **************** ** ******** ******** ** *** ******* ******* ******* firmware ******* *.*.* *** *****.

***************

*** ************* ******* ******, ***** *** **** *** *.* ****** easier ***** *** ****** *********** **** ****' ******* ****** *********, at ** ********** ****. *** ***** ****** ****** *********** ** VMD *.* ****** ****** ********** ***** ******** ****** ********* ********* a *** ** ***** ******. ********** *********(****** + **********) **** ******** ****** ********* ** ****** ** ideal ********.

*** ***** ***** ****' ******** ****** *********, ********** ****** *********** so **** **********, *******, ** *********** ******* *** *** ** the *** ** *** ****** ***** ***********. ***** ****** ** night *** ** ***** ****** *** ****** ********* *** ********* and ******* ******** ** ****** *********. *******, ****** ** *** 2.1 ***** ******* **** ******* *** ************.

**************** ****** **** ***** *** ***** ***********, ********* *********** **********, with **** ***** ***** ********. ***** ****** ******** ****** ******** and ******* ********* ** ******* **** ********* **, *******, ** its ******** ******** ** **** ******* **** ******* ****** ****** *** FOV.

******** **** *** *.* *** **************** **** **** ******** ********** over **** ************'* ******** ****** *********, *** ******* ******* * key ********.

Axis ************* **********

**** ********** ******* ***** ********* *** **** *********** *** *** VMD *.*, ** **** ** *** *********** ** *************, ******* the ******* ******* ** *********** ** ********:

Indoor ********** ****

** *** ****** ********** ****, ** **** *****, ********* ** a ***** ******* *** ******** ** *** ******, **** **' the ******** ****** *****. **** *** *.* *** ******** *** detected *** ******* ***% ** *** ****.

*** *.* *** **** ** ******* **** ***** *********, *******, such ** *** ****** ***** *** ** *** ****** ****** of **** *****. ******** ***, **** ** **** *********** *** 1% ****** ****, ***** ***.


** *** *****, **** *** *.* *** ******** **** ******** in **** *****, ** ****. *** *.* ****** *** ********** out ** ******** *****, ***** ******** *** *** **** ***.

*******, ** *** *****, ******** *** *** ****** ***** ** false ****** **** ******* ** *****, **** ** *******, ****** being ******** ** ** ***, ******** *******, *** ******* ******* as ****** ***** **** *** *******. *** *.* *** ********** immune ** ***** ** **** *****.

Indoor **** ******

****** *** ******* ** ** **** ****** *****, ***** **' long, **** ***** *********** *** ******** *** **** ****, ** to ***** **'.

****** ****, *** *.* ****** **** *** **********, ***** ******** VMD ****** ****** ***.

** *** *****, *** ******* ****** **** *** ***** ********** both, ****** ******** *** *** **** ********, ******* ** **********. VMD *.* ****** ***** *** ** ** ** **** **** (~83% ********).

*******, ****** ****** *** *** **** **** ** ****, *** 2.1 ***** *********. ******** *** *** ****** ***% ******** ** to ~**', *** ****** *** ********** ****** ****.

** *** *** **** ** *** ********** ****, ******** *** once ***** *** * **** ***** ***** ****, ****** ** changes ** *****.

*******

********, ** ********, ****** ****** (* ****** ***** ** ******** alarms ** *** *** *********) ********* ******** ****** ****** ** both ******** *** *** *.*. ** ******** ***** ***** **** both, ** ** **** ****** ** **** ********* *********.

**** ***** ** ***** **' **** **** ******** *******, *** ***** ***' *** ****** ****. **** * ******* walking ******* *** ***, **** ******* *********. *******, *** *.* picked ** *** ******* ** ~**-**' **** **** *** ******, while ******** *** ********* **** ****** **'.

****** ******** ****** ** ****** ******** ****** ****** ** **** from *** ****** **** ~**', **** ******* **** **** ** detect *** ******* ** ** ****** ****** *** ***** ** view ** ************* **'.

*** *.* ******** **** ** *** ****** **** ****** *** day. ******** *** ******** **** ***** *% ** *** ******** on *** **** ****.

*** *.* *** **** **** ** ****** ****** ** *** distant *******, **** ***' **** *** ******.

** *** *****, ******** ***'* *********** *** ******* ** *******, though***** *** ******** *******, ***** **'. *** *.* *** ****** to ****** *** ******* ** **** ***** ** ***, ******* all ***********.

** *****, *** *.* ******** ***** **% ** ********, ***** standard ******** **** ***** **%.

*************, *** *.* *** ****** **** ** ****** ******** ** the ******* ******* ** *****, ********** *** **** ** ***** trucks, *** **** ** ****.

** *** *** ****, ***** ******* ***'* ************* ** ****. VMD *.* ********* ******, ********* ***** **% ** ******, ********* even * ********* ****** ********** *** *****.

Sensitivity ***********

** ******** ****' ******* *** *********** ******** ** *** ** there *** * "***** ****" ** ***** ***** ****** **** reduced, ******* ********* ********* *****. ** ***** **** *** ******* setting, **%, ********* **** ** *** ****** ** ******. ******** sensitivity ** **% ******** ** ******* ********* ***********, ******* *** decrease ** ***** ******. ***** ****, ****** ********** ****** **** common, ****** ******* ** ***** ***** ****** ***** ******. **********, increasing *********** **** **% **** ********** ******** *********, *** ***** motion *** ** ******* ***** *** ********* ****** ********. 

M ****** ***********

** ***** ** **** *********** ** ***** **** ****** ******, we ********* *** *.* ** *** * ****** **** *********, the ***** *** *****. ** ***** **** *********** ** **** light *** ********** ** *** *****, *** ********* ** *** light *** ********, ***** *** * ****** ******** ****** ** image ** *** ***** ******.

Mobotix *************

******* ************* ** ********** *******, ****** ******** *** ** *******'* standards:

Mobotix ******** ******

** ****** *****, **************** ******** *** ******* ** **' ***** 100% ** *** **** ** **** *****. **** *** ******** of ****** ********* (*** ****) *** ******** ***** (****** ****).

******** *** ********* ********** ** ******* *** ******* ***** ****** the *** ** ****** *** ******. ** **** **** ********* began ** ***** **', **** *** ******* *********** *** ******.

** *** *****, *******, *** ** *** ***'* **** ********* performance, ** *** ****** ** ******* *** ******* ** ***. It *** ********** ****** ** ***** ****** **** *******, *******, and ***** ******* ** *****, *******.

******* ***********

********, **************** ********* ********* ** *******, **** ******** ********* *** to ***** **' **** *** ******* ****** ****** *** ******. Also, *******, *** ***** ********** **** ** *** ***** ** the *** ***** *** ****** ** *** ******, *** *** excluded **** *** ****** ****, *** ** ***** ****** **** triggered.

****** ****** *** ***, *******, ***** *** **** *******. *** camera *** **** ** ****** *** ******* ** **** ***', as ***** ****:

Comments (31)

It's promising to see improvements on video motion detection. It's clearly one of the most fundamentally important aspects of recording (as well as search to have accurate tagging of real motion events).

The downside remains the lack of VMS support. Mobotix is understandable, given their business model but Axis really needs to promote this and work with their VMS partners to get 3rd party support.

Finally, this is the start of an ongoing series of tests we will be doing on motion detection and analytics from 'regular' cameras to 'smart' cameras.

Has VMS integration improved since 9 months ago?

When you say the VMS doesn't support it, does that mean you can't configure it from the VMS, or that it won't help the VMS detect motion better at all?

Hey James, good question. I'll check with Axis.

In the VMSs we used, "not supported" meant that the VMS simply did integrate motion events from VMD 2.1. They use a different API. It's actually surprising that more haven't integrated it.

Apparently Exacq can be made to support VMD 2.1.

The integration is somewhat less than user friendly.

(my submission for understatement of the year).

I see that Axis has now come out with VMD 3.0

What improvements did you see with that?

Rob, do you have a link to Axis VMD3.0? I do not recall any formal announcement of it.

http://www.axis.com/products/video_motion_detection/ - at the bottom:

=====================

Earlier releases

For those products that don’t support VMD 3 AXIS Video Motion Detection 2.1 is still available. AXIS Video Motion Detection 2.1 is based on the same reliable motion detection technology, but does not include False Alarm Filtering and visual configuration support.

===================

John, it is all about signal to noise ratio in those low light scenes. Until you have cameras that have a better SNR in low illumination the software will have trouble with identification. Keep up the good work you are doing your test pictures are worth a thousand words.

Mark, the main camera we tested was an Axis P 'Lightfinder' series, which is one of the best low light, non IR cameras in the market, so that should underscore the difficulties.

We've been considering another small scale implementation of less than 10 cameras. We think VMD is an important component.

We believe that VMD benefits to total ownership costs are much more substantial than the one-time system procurement cost benefit it delivers through reduced storage sizing. When reliable VMD presents non-real-time reviewers with a high percentage of "valid" motion events, this personnel cost driver which extends over the life of the system can be greatly mitigated.

Thanks for another informative review that is relevant to our immediate needs.

This is a nice start, but rather than seeing how much better Axis' advanced VMD is than their basic VMD, I'd rather see how Axis' advanced VMD does say against Sony's DEPA, or Samsung's VMD, or some VMS's advanced VMD looking at the same scene.

And how VideoIQ does against say AgentVI or IOImage looking at the same scene.

Luis, what cameras are claiming advanced VMD? We can easily test against others but are there specific models that are known (via test/field performance) to be highly robust against false positive motion events?

From the sound of it, though I may be wrong, the Axis VMD sounds like something that would be comparable to Sony's DEPA, which I consider to be a step up from basic activity detection, but below Video Analytics (which actually tries to identify objects and object intentions), which I don't have the impression Axis VMD is on the same level. Same for some Samsung cameras. Anything that has vectored, sizable boxes with some options like trip line and directional alerting I consider a step up from activity detection.

Axis VMD2.1 does not support any lines or rules. It's meant to be better motion detection, period.

Sony and Samung are marketed differently, with rules/events. However, the key question is how well the underlying detection works. I have not heard anything positive about that, even from those manufacturers.

Axis has cross line detection which is likely more comparable to Sony DEPA. We are testing Axis cross line and can try it against DEPA (Ethan/Derek)

Does Sony still include DEPA in Gen 6? I thought it was now "VMF" or something like that. It looks like it includes cross line as well as simply "object detected" analytics, according to the manual (page 30).

I admit I'm not sure myself on that one. (DEPA in Gen 6)

Ethan - Sony Gen5-V, Gen6-V and Gen6-E series all have both VMD and VMF. (All other cameras have VMD, but not the VMF menu.) Basically, you can place a Video Motion Filter (VMF) inside any VMD area. This is the DEPA Advanced solution you setup in the camera menu. Many recording platforms can use VMD and/or VMF as event triggers.

Another reason to use lighting to improve analytics in low light levels. There will never be a replacement for good lighting!

I am looking at proposing Mobotix just for this new and improved analytic. What I wish these vendors could provide is some kind of guideline which correlates PPF and analytic performance?!

Yes there are many variables which will affect actual results - however a decent starting reference point assuming 'ideal' conditions would be nice.

Mark, above comment, mentioned SNR in relation to performance. I'd like to understand that more. What exact signal, and what exact noise?

RJ I have used the new MxActivity sensor down to .3 lux in color according the sensor on the camera with no problem using the new M15 series Mobotix cameras. Detection is very acurate. In fact we installed these for the local water management district to self monitor and the detection and notifications have been so good they have turned off thier false alarm prone security systems with perimeter beam detectors. They tell me this will save them thousands in false alarm fines. The test above was taken using the Q24 in 360 mode instead of on the wall in 180 mode which is a better application for the analytics. Also if lighting is a concern the new M15 has much better low light performance than the Q24.

360 is the most common mode for fisheye / panoramic cameras, ergo our test setup.

That said, it's pretty clear that both analytics worked impressively so long as the camera has sufficient lighting. Whether it's a different model that's better in low light or using IR, that should go along way.

Mike,

That is promising! I have scoped the M15 5MP cameras. 1 color lens, 1 b&W lens.

Can you explain the 'fines' they receive for false alarms? So they had a traditional perimeter beam detection system? I looked at that for this application initially

Great article, I would also like to see a VMD 2.1 test on the Axis Q16xx series, considering their WDR plus low light capabilities

Harold, the P3354s we used are indeed Lightfinder. They're not WDR like the Q1604, but they perform similarly in low light. I'll add this to the post, thanks for pointing it out.

We have been using DEPA already since the begingin with cs-50,and then ch-140 and now the ch-180 with milestone to trigger start/stop recordings in an outdoors environment. For us its a huge money and time saver, since we pay per used GB in storage and it gives us the ability to store high quality pictures (16 fps, 2mb/sec, mpeg-4). Timesaver when we go through recordings since i only stores when something moves in a predefined area. It comes with the camera so you dont need to pay any extras, its already there. Not using it (where its aplplicable) seems a waste to me. You just need to set it up and it saves you time and money.

Granted its not "perfect" and we set the parameters so we rather get a little bit more recordings, but still..

It works great for us.

//Snowman

RJ,

They had many false alarms according to the police which resulted in fines year after year. The result of foliage, animals and what I think was a faulty installtion, but they did not ask me to fix it so I offered the video solution, which quite frankly is much better anyway. I have filtered out all external causes, sun blow out, leaves, trees, rain, shadows etc. The only activations they have had have been real movement and they get notified by email within 20 seconds of the event for varification. They already caught one intruder who was a homeless person. If you wish to get further info or setup details you can email me at mike@dfs-group.net.

John,

Thanks for your input, but in our case most of these cameras are setup as 180 on wall set. Most of our customers prefer the 180 view over the 360 view, the ActivitySensor excells in the wide angle applications. We do however use the 360 in retail for the heat map function. I do have to correct a couple if innacuracies in the setup video. 1. In event settings the event dead time is not a how long it takes for the event to stop, but rather how long it will take for an event to retrigger. 2. The activity sensor threshold of 1 thru 99 is not how many seconds of motion before activation, but rather how much activity in the scene it takes to trigger an event.

I wish to ask, since VMD is pretty much on the camera side. Could we balance out the use of VMD versus allowing the VMS to do the recording on motion only. For example, where the network has sufficient bandwidth to handle continuous resolution video, just stream the images to the recorder permanently and let the VMS use pre and post roll setting to record what is important. Then if you have areas where network bandwidth is week, use the a suitable camera with VMD to only push video when it is required.

You can use VMS server side motion detection - a lot of people do. See our camera vs server side motion detection for pros and cons.

Has there been any improvementsuggestions in advanced VMD since this article?

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...
Magos Radar Company Profile on Nov 12, 2018
Magos America General Manager Yaron Zussman admits when he first came across Magos, he asked himself: "What's innovative about radar?" Be that as...
Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...
Axis 2N Intercom Tested on Nov 08, 2018
Axis expanded its video intercom business buying Czech-based 2N in 2016. Despite competing against owner Axis' intercoms, 2N recently registered as...
Kogniz Silicon Valley AI Startup Profile on Nov 07, 2018
Kogniz is a Silicon Valley company that aims to bring AI analytics to security and surveillance, centering on their own smart cameras: We spoke...
Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Avigilon Opens Up Analytics And Cameras on Nov 06, 2018
Avigilon is opening up. The company historically famous for advocating its own end-to-end solutions and making it harder for 3rd parties to...
Worst Products on Nov 03, 2018
Security integrators periodically report on their favorite and worst products to IPVM. These are known integrators who IPVM pays to answer surveys....
Unisight Company Profile on Nov 01, 2018
Hikvision's largest US OEM, LTS has started to carry Unisight, whose products (shown below) look a lot like Hikvision's rival Dahua: Who is...
VMS Camera Management Shootout - Avigilon, Dahua, Exacq, Genetec, Hanwha, Hikvision, Milestone, Network Optix on Oct 29, 2018
Camera setup, configuration and maintenance are the most common tasks when managing a surveillance system. Who does it best and worst? Who offers...

Most Recent Industry Reports

Throughtek P2P/Cloud Solution Profile on Nov 15, 2018
Many IoT manufacturers either do not have the capabilities or the interest to develop their own cloud management software for their devices....
ASIS Offering Custom Research For Manufacturers on Nov 15, 2018
Manufacturers often want to know what industry people think about trends and, in particular, the segments and product they offer.  ASIS and its...
ISC East 2018 Mini-Show Report on Nov 15, 2018
ISC East, by its own admission, is not a national or international show, billed as the "Largest Annual Northeast U.S. Security...
Hikvision Silent on "Bad Architectural Practices" Cybersecurity Report on Nov 14, 2018
A 'significant vulnerability was found in Hikvision cameras' by VDOO, a startup cybersecurity specialist. Hikvision has fixed the specific...
French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...
Integrator Credit Card Alternative Divvy on Nov 13, 2018
Most security integrators are small businesses but large enough that they have various employees that need to be able to expense various charges as...
Directory of Video Intercoms on Nov 13, 2018
Video Intercoms, also known as Video Door-Phones or Video Entry Systems, have been growing in the past decade as more and more IP camera...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...
Magos Radar Company Profile on Nov 12, 2018
Magos America General Manager Yaron Zussman admits when he first came across Magos, he asked himself: "What's innovative about radar?" Be that as...
Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact