Advanced VMD - Axis / Mobotix Tested

By: Ethan Ace, Published on Aug 26, 2013

Surveillance professionals prefer motion based recording over continuous but the main weakness of motion detection is its inaccuracy. Sure, it saves a lot of storage over recording continuously but it still can be very inefficient, triggering against leaves, trees, shadows, low light noise and more, requiring time consuming optimization that rarely works completely.

Axis and Mobotix Advanced Offerings

Recently, both Axis and Mobitix have released advanced video motion detection offerings. Axis has VMD 2.1 that it bills as having 'easy setup with few false alarms' while Mobotix promotes MxActivitySensor as offering 'unique motion detection in the camera'.

The IPVM Test

We tested both of these offerings to understand how much of an improvement they made over 'traditional' video motion detection plus how accurate they were.

To do so, we bought 2 Axis cameras (same model) and loaded one with traditional and one with VMD 2.1, running them simultaneously.

We started with a simple conference room and performed tests with moving subjects as well as running the cameras 24/7 to measure false positives:

We then moved on to a more complex, larger area to see how the offerings handled this:

Finally, we went outdoors to a very large area with vegetation to see how they would fare in an adverse environment:

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Finally, we ran the Mobotix camera through similar conditions to gauge its performance.

Questions Answered

Our testing answers the following key questions:

  • How much of an advantage did advanced VMD provide over traditional?
  • Where was advanced VMD better than traditional and where was it worse?
  • Is it worth using advanced VMD? If so, where?
  • What barrier or issues are there in using 'advanced' VMD?
    • Significant advantages exist using either Axis and Mobotix advanced VMD over traditional. Common false alerts were nearly eliminated.
    • The only limitation of advanced VMD was in the dark where they would miss objects. However, traditional VMD was far more likely to generate huge numbers of false alerts in the dark.
    • Using advanced VMD is worth it in pretty much any application. In dark areas, traditional VMD is fairly useless anyway so it would be better to add illumination if detection was critical.
    • VMS support is the main issue. While both Axis and Mobotix offerings are free and can be easily added to most of their cameras, VMS support is a problem. Mobotix only supports Mobotix (no surprise). Axis VMD 2.1 is surprisingly only supported by their own ACS VMS and Genetec.

    Key Test Findings

    There are several key findings from our tests:

    • Axis Video Motion Detection 2.1 performs better in most conditions than their default motion detection, with better detection rates and ranges, and very few false alarms. 
    • However, in low light scenes (~2 lux and below in our tests) VMD 2.1 missed more activations than default. Its false alarm rate remained very low.
    • Axis' default motion detection was highly sensitive to changes in light, such as flashes, moving car headlghts, shadows, etc., creating large numbers of false alerts due to these effects. 
    • Even at its smallest object size and higher sensitivity, standard VMD missed small moving objects which VMD 2.1 did not.
    • VMD performance was relatively close between P and M series cameras, though P series cameras performed at lower light levels, where M series cameras produce practically no image.
    • VMD 2.1 requires nearly no setup, only a single polygonal included and optional excluded zone with no sensitivity configuration.
    • Standard VMD allows more windows (both included and exclude), though zones are restricted to purely rectangular shapes, instead of polygonal, making coverage of odd-shaped areas more difficult. Users must configure object size for best performance in each VMD zone.
    • Mobotix MxActivitySensor (installed on a Q24) had a very high detection rate up to about 30' in full light, displaying direction of objects via a video overlay, as well. However, the camera's poor low light performance resulted in nearly 100% missed detections at 2 lux or below. 
    • MxActivitySensor's working range was much larger when the object was moving across the FOV, able to detect a subject at over 100', vs. ~30' when moving toward/away from the camera.
    • MxActivitySensor is also nearly immune to lights and repetitive motion caused by stationary objects, such as tree branches and leaves. Activation is based on directional travel only.

    Axis Video Motion 2.1 is available as a free download directly from Axis. MxActivitySensor is included standard in all Mobotix cameras running firmware version 4.1.6 and above.

    Recommendations

    For predominantly daytime scenes, users may find VMD 2.1 offers easier setup and better performance than Axis' default motion detection, at no additional cost. Low light scenes remain problematic as VMD 2.1 misses events frequently while standard motion detection generates a ton of false alerts. Using boost recording (motion + continuous) with advanced motion detection is likely an ideal approach.

    For those using Axis' standard motion detection, optimizing camera positioning so that headlights, flashes, or substantial shadows are out of the FOV is key though often unrealistic. False alerts at night due to these issues can easily eliminate the bandwidth and storage benefits of motion recording. However, moving to VMD 2.1 would rectify this without any optimization.

    MxActivitySensor offers easy setup and solid performance, including directional indication, with high false alert immunity. Users should consider camera location and typical direction of objects when deploying it, however, as its range and accuracy is much greater with objects moving across the FOV.

    Although Axis VMD 2.1 and MxActivitySensor both have distinct advantages over each manufacturer's standard motion detection, VMS support remains a key weakness.

    Axis Configuration Comparison

    This screencast reviews setup procedure for both traditional VMD and VMD 2.1, as well as the differences in configuration, showing the various options in traditional vs advanced:

    Indoor Conference Room

    In our indoor conference room, in full light, detection of a human subject was reliable at all ranges, with 30' the farthest tested range. Both VMD 2.1 and standard VMD detected our subject 100% of the time.

    VMD 2.1 was able to capture very small movements, however, such as the moving chair leg in the bottom corner of this image. Standard VMD, even at high sensitivity and 1% object size, could not.


    In low light, both VMD 2.1 and standard were accurate in this scene, as well. VMD 2.1 missed one activation out of numerous tests, while standard did not miss any.

    However, in low light, standard VMD was highly prone to false alarms from changes in light, such as flashes, lights being switched on or off, computer screens, and shadows created as people moved past the doorway. VMD 2.1 was completely immune to these in this scene.

    Indoor Open Office

    Moving the cameras to an open office scene, about 45' long, full light performance was reliable for both VMDs, up to about 25'.

    Beyond this, VMD 2.1 missed very few detections, while standard VMD missed nearly all.

    In low light, our subject moving down the aisle triggering both, though standard VMD was more accurate, missing no detections. VMD 2.1 missed three out of 18 in this case (~83% accurate).

    However, moving across the FOV from desk to desk, VMD 2.1 never activated. Standard VMD was nearly 100% accurate up to ~15', but missed all detections beyond this.

    As was the case in the conference room, standard VMD once again had a huge false alarm rate, caused by changes in light.

    Outdoor

    Outdoors, in daylight, moving leaves (a common cause of nuisance alarms in VMD and analytics) triggered constant motion alarms on both standard VMD and 2.1. We excluded these areas from both, as we were unable to test detection otherwise.

    This scene is about 25' wide from building to fence, and about 280' the nearby road. With a subject walking through the FOV, both cameras activated. However, VMD 2.1 picked up our subject at ~80-90' away from the camera, while standard VMD triggered only around 45'.

    Though standard failed to detect subjects moving toward or away from the camera past ~45', both cameras were able to detect our subject as he walked across the field of view at approximately 65'.

    VMD 2.1 captured cars on the nearby road during the day. Standard VMD detected only about 5% of the vehicles on the near road.

    VMD 2.1 was also able to detect trucks on the distant highway, over 600' from the camera.

    In low light, standard VMD's performance was similar to daytime, though range was slightly shorter, about 40'. VMD 2.1 was unable to detect our subject in this scene at all, missing all activations.

    At night, VMD 2.1 captured about 75% of vehicles, while standard detected only about 30%.

    Interestingly, VMD 2.1 was better able to detect vehicles on the distant highway at night, triggering not only on large trucks, but also on cars.

    As the sun rose, glare reduced VMD's effectiveness to zero. VMD 2.1 performed better, capturing about 40% of events, including even a groundhog moving throughout the scene.

    Sensitivity Adjustments

    We adjusted Axis' default VMD sensitivity settings to see if there was a "sweet spot" at which false alarms were reduced, without impacting detection rates. We found that the default setting, 90%, performed best in the scenes we tested. Lowering sensitivity to 80% resulted in similar detection performance, without any decrease in false alerts. Below this, missed detections become more common, though changes in light still caused false events. Conversely, increasing sensitivity past 90% only marginally improved detection, but false motion due to digital noise and artifacts became constant. 

    M Series Performance

    In order to test performance on other Axis camera models, we installed VMD 2.1 on two M series Axis minidomes, the M3004 and M3006. We found that performance in full light was comparable to the P3354, but detection in low light was impaired, since the M series produced nearly no image at low light levels.

    Mobotix Configuration

    Mobotix configuration is moderately complex, though probably not by Mobotix's standards:

    Mobotix Activity Sensor

    In indoor tests, MxActivitySensor captured our subject at 30' range 100% of the time in full light. Note the overlays of object direction (top left) and activity graph (bottom left).

    Accuracy was unchanged regardless of whether the subject moved across the FOV or toward the camera. In this case detection began at about 25', with the subject approaching the camera.

    In low light, however, due to the Q24's poor nighttime performance, it was unable to capture our subject at all. It was completely immune to false alarms from flashes, shadows, and other changes in light, however.

    Outdoor Performance

    Outdoors, MxActivitySensor performed similarly to indoors, with reliable detection out to about 30' with the subject moving toward the camera. Also, notably, the large vegetation area to the right of the FOV which was moving in the breeze, was not excluded from the motion zone, yet no false alarms were triggered.

    Moving across the FOV, however, range was much greater. The camera was able to detect our subject at over 100', as shown here:

5 reports cite this report:

Mobotix Thermal Detection Camera Tested on Jun 09, 2020
For years Mobotix has struggled but now sales are surging driven by Mobotix's thermal camera sales as a response to coronavirus, with both their...
Axis VMD4 Analytics Tested on Apr 17, 2018
Axis is now on its 4th generation of video motion detection (VMD), which Axis calls "a free video analytics application." In this generation, Axis...
Axis Releases Their Own Video Analytics on Sep 28, 2015
After years of promoting third party video analytic applications and improving their VMD (see IPVM test results of Axis VMD 3.0 vs Avigilon), Axis...
Axis Digital Autotracking Tested on Sep 16, 2015
As camera resolutions continues to climb, the likelihood that you will ever display any camera at full resolution on a monitor declines. This is...
Axis VMD3.0 Analytics Vs Avigilon Tested on Jan 12, 2015
Axis has released the next generation of their advanced video motion detection application, VMD 3.0. It promises improvements in false alarm rates...
Comments (31) : Members only. Login. or Join.

Related Reports

Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...
NTP / Network Time Guide For Video Surveillance on Jan 10, 2019
Inaccurate time can lead to missing or inadmissible video, yet this topic is often overlooked, with cameras and servers left defaulted,...
Axis Tailgate Detection Tested on Jan 04, 2019
Axis is aiming to tackle tailgating, one of access control's biggest issues, with the Tailgating Detector ACAP application. This camera app claims...
Inputs/Outputs For Video Surveillance Guide on Aug 24, 2018
While many cameras have Input/Output (I/O) ports, few are actually used and most designers do not even consider them. However, a good understanding...
Top Features For Easy Camera Installation (Statistics) on Jun 05, 2018
Camera installation is the most fundamental and common task for video security technicians. Because of this, camera manufacturers market their...
Axis VMD4 Analytics Tested on Apr 17, 2018
Axis is now on its 4th generation of video motion detection (VMD), which Axis calls "a free video analytics application." In this generation, Axis...
Visio For Video Surveillance Design on Feb 20, 2018
Many integrators have standardized on AutoCAD for camera layouts but new users may be overwhelmed by its learning curve. Microsoft's Visio...
$800 Axis Thermal Camera Examined on Jan 02, 2018
Axis is releasing two of the lowest cost thermal IP cameras ever. But will low cost be enough to spur adoption? In this note, we examine the 2 new...
Axis M3106-LVE Mk 4MP Camera Tested on Nov 06, 2017
Axis has released the latest in their low(er) cost M series outdoor cameras, the M3105-LVE Mk II, a 4MP turret model specifying 15m IR, their...
Exacq M Series Low Cost NVR Tested on Oct 12, 2017
With recent cyber security issues hitting NVRs and cameras from low cost leaders Dahua and Hikvision, users are increasingly seeking alternatives...

Most Recent Industry Reports

Access Control Online Show - July 2020 - With 40+ Manufacturers - Register Now on Jul 01, 2020
IPVM is excited to announce our July 2020 Access Control Show. With 40+ companies presenting across 4 days, this is a unique opportunity to hear...
Hanwha Face Mask Detection Tested on Jul 01, 2020
Face mask detection or, more specifically lack-of-face-mask detection, is an expanding offering in the midst of coronavirus. Hanwha in partnership...
UK Government Says Fever Cameras "Unsuitable" on Jul 01, 2020
The UK government's medical device regulator, MHRA, told IPVM that fever-seeking thermal cameras are "unsuitable for this purpose" and recommends...
Camera Course Summer 2020 on Jun 30, 2020
This is the only independent surveillance camera course, based on in-depth product and technology testing. Lots of manufacturer training...
Worst Over But Integrators Still Dealing With Coronavirus Problems (June Statistics) on Jun 30, 2020
While numbers of integrators very impacted by Coronavirus continue to drop, most are still moderately dealing with the pandemic's problems, June...
FLIR Screen-EST Screening Software Tested on Jun 30, 2020
In our FLIR A Series Test, the cameras' biggest drawback was their lack of face detection, requiring manual adjustment when screening each...
Dahua Buenos Aires Bus Screening Violates IEC Standards and Dahua's Own Instructions on Jun 30, 2020
Dahua has promoted Buenos Aires bus deployments as "solutions that facilitate community safety". However, they violate IEC standards and,...
UK Firm Markets False Fever Screening, Hikvision Disavows on Jun 30, 2020
A UK security firm falsely claimed its Hikvision-based thermal solution could be used for "accurately detecting fever in any person", even claiming...
Industry Study: 83% of US Temperature Screening Sellers Falsely Say Not Medical Devices on Jun 29, 2020
83% of US companies selling temperature screening devices, aka 'fever' detectors, claim they are not medical devices, contrary to FDA definition,...
Manufacturers on Virtual 'ISC West' 2020 and Potential ISC West 2021 on Jun 29, 2020
With the 2020 ISC West show now officially canceled, attention turns to Reed's new "ISC West 2020 Virtual Event" planned for October and for the...