Motion Detection Performance Tested

Author: Benros Emata, Published on Sep 05, 2011

Motion detection is an important element of many, if not, most surveillance systems. It plays a central role in both storage search time reduction. Storage is routinely reduced by 30% - 80% by using motion based rather than continuous recording. Likewise, an investigator can often much faster find a relevant event by simply scanning through areas of motion rather than watching through all video.

At the same time there are a number of challenges associated with using motion detection:

  • Scene Conditions: The accuracy of motion detection and the amount of times motion is detected can vary depending on what's in the scene - people, cars, trees, leaves, etc. - and the time of day - night time with lots of noise, sunrise and sunset with direct sunlight into a camera, etc.
  • Performance of Detector: Motion detetion is built into many surveillance products - from DVRs to VMS systems and now IP cameras. As such, how well each one works can vary significantly.

Our Test

In this report, we share our results from a series of tests we performed to better understand motion detection performance.

We did a series of tests in different locations:

  • Indoor well light scene to simulate the simplest scene possible
  • Indoor dark scene (<1 lux) to examine what problems low light caused
  • Outdoor parking lot to see how a complex scene with trees, cars and people would perform
  • Roadway to see how a moderately complex scene with periodic cars would perform

Three IP cameras were used with their motion detection enabled to see differences in performance:

With these tests, we answered the following questions:

  • How can one estimate motion percentage accurately?
  • Does motion estimation vary significantly by scene?
  • How accurate was motion detection in each scene?
  • Did certain cameras exhibit greater false motion detection than others? What scenes or conditions drove those problems?

****** ********* ** ** ********* ******* ** ****, ** ***, most ************ *******. ** ***** * ******* **** ** **** storage ****** **** *********. ******* ** ********* ******* ** **% - **% ** ***** ****** ***** ****** **** ********** *********. Likewise, ** ************ *** ***** **** ****** **** * ******** event ** ****** ******** ******* ***** ** ****** ****** **** watching ******* *** *****.

** *** **** **** ***** *** * ****** ** ********** associated **** ***** ****** *********:

  • ***** **********: *** ******** ** ****** ********* *** *** ****** ** times ****** ** ******** *** **** ********* ** ****'* ** the ***** - ******, ****, *****, ******, ***. - *** the **** ** *** - ***** **** **** **** ** noise, ******* *** ****** **** ****** ******** **** * ******, etc.
  • *********** ** ********: ****** ******** ** ***** **** **** ************ ******** - from **** ** *** ******* *** *** ** *******. ** such, *** **** **** *** ***** *** **** *************.

Our ****

** **** ******, ** ***** *** ******* **** * ****** of ***** ** ********* ** ****** ********** ****** ********* ***********.

** *** * ****** ** ***** ** ********* *********:

  • ****** **** ***** ***** ** ******** *** ******** ***** ********
  • ****** **** ***** (light ******
  • ******* ******* *** ** *** *** * ******* ***** **** trees, **** *** ****** ***** *******
  • ******* ** *** *** * ********** ******* ***** **** ******** cars ***** *******

***** ** ******* **** **** **** ***** ****** ********* ******* to *** *********** ** ***********:

**** ***** *****, ** ******** *** ********* *********:

  • *** *** *** ******** ****** ********** **********?
  • **** ****** ********** **** ************* ** *****?
  • *** ******** *** ****** ********* ** **** *****?
  • *** ******* ******* ******* ******* ***** ****** ********* **** ******? What ****** ** ********** ***** ***** ********?

[***************]

Key ******** *** ***************

**** *** *** *** ********:

  • ** ****** ****** (*.*. **** ******** *** ****** ***), ********** percentage ** ****** ** ********** *************** *** *** * *** margin *** *****.
  • ** ******* ****** (*.*. *******, **** ***, ********* ********, *** vegetation) ********** ********* ** ****** ** ********* *** *** **** greatly.
  • ******** ** *********** ****** ******* ********* ************* ** *** ********** of *** ***** *********.
  • *** ***** ******* ********* ******* (** ***** *********/*********) ** *** very ****** ******* ****** ****
  • ** *** ******* *** **** *** ***** ******* ****** ** record ** ****** ** **** ********* *******, *** ** ********** and ******** *******
  • *** ******* ****** ****** *** *********** ***** ********* ** ***-*****/********* scenes ****** *** ** *****/**** ** **** ** **** *** is ******* **** *** ******'* ***. **** ******** ** **** continuous *********.

** ***** ** ***** ******** *** ********* ** ***********:

  • ****** *** ***** ** **** ******, ****** ********* ******** (*.*. masking, ***********, *** ****** ****) **** ****** **** ** ** optimized ** ***** ** ******* ********** ********
  • *** ***-***** ******, ******** ******** ******* ****. ****, ********** **** different ****** *****/****** ** *********** *** **** ************ ** ***-*****/********* scenarios
  • ** ******* ***** ********** ****** ** ******* ****** ** ***'* estimates *** ** *** ***

Daytime ****** (********** ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** *** *******. * ******* ****** the ***** ** ********* ****** ** ***** ****** ****** ********* during *** *** ****** ****. * ******** **** *** ****** recorded ***** *** ******** ******** ** ******** *****. **** **** on *** ******** '****' ********** ****** ******** ***** *** '****' indicates ** ***** *********.

********* *** ******** ******* **** *** ******* ******** ******** ****** during **** ** *** ***** ******* ******* **** *** *****. Also, **** ** ***********, ** ***** ********* **** ********* ****** times **** *** ******* *** *** ** *** *****. *** findings *** *** ********** ***** *** ********** ** *** *********** (narrow ***, ****** *** ********** ********, ** **********, *** ***** subject/object).

Nighttime ****** (********** ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** *** *******. * ******* ****** the ***** ** ********* ****** ** ***** ****** ****** ********* during *** *** ****** ****. * ******** **** *** ****** recorded ***** *** ******** ******** ** ******** *****. **** **** on *** ******** '****' ********** ****** ******** ***** *** '****' indicates ** ***** *********.

** **** ***-***** ***********, ****** *********/****** ******** *** ****** ********** across *** ***** *******. *** ******* *** ** ***** *** lighting ******* *********** '********' ****** ** ******** *** ** **** effectively ******* ** ********** ******* (**** ***** ******** ****). ** direct ******** *** ********* ***** '********' ***** ** ****** ******* throughout *** *** ****** ******** *** ** * ****** *** produced ** ********* ** *** (**** ***** ******** ****). *** Axis ******** *** **** ** ** *** ** *** ******* indoor *********, ******* ******/***-****** *************.

Daytime ******* (******* ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** ** *******. *** ****** ** organic *** ************** ** * **** ***** ************ ********. * snapshot **** *** ****** ******** ***** *** ******** ******** ** featured *****. **** **** ** *** ******** '****' ********** ****** recorded ***** *** '****' ********* ** ***** *********.

*** ********* ** ****** *********/********* ** **** ** *** ******** is ************ **** *** *** ***** ******* (~** - **% motion). *** **** ******* *********** (*.*., *****, ******* *** ***** lighting *******) ****** ***** * ****** ** ***** ********* ****** the *****. **** **** *** ********* ****** *********** ******** ********** the ** ****** ****, *** **** *** **** *** **** slightly **** ***** *********. *** ******* *** *** ***** ********* among *** ***** *** ***** ************ **** ********* **** *********** just ************** ******** ** ********* ****** (*.*. ***** *** ******* subjects).

24 **** ******* (******* ******)

*** ********* ** * ******** ** **** ******** ********* ** two ******* (******** *** *****) ********** ** ****** ****** ********** a ** **** ******. *** ******* **** *** **** ******* scene **** *** **** ***/**** *****. ***** ********** ******** **** insights **** *********** ** ****** *********/********* ************* ****** ********* ****** makes/models. **** **** *** *** ** **** ** ********** *** motion ********* ******** **** *** ****** *** *** **** ** the *** ********** ********.

**** ********* (*:**** - *:****)

****** *** ~* ***** ** ******** ******** ** *** ******** the ******* ****** ******** ************ ******* *********** **** *** **** camera ******* **** ********* **** *** ******* (*** **********) ****** settings. ** * ******, *** ******* ******** ************ ***** *********, whereas *** **** ** ************* ** ***** * ****** ** false *********.

******* (*:**** - *:****)

*** ******** ** ****** ** ** ** **** ***** ********, as ********* ** *** ******** ** * ******* ******** *** FoV ******** ** *** ****** ********* ******* ******. **** **** how *** ******* ****** ** ****** ************ ****** ***** ****** around *:**** (*** *****), ***** *** **** ***** ** ******** the **** ********* ** ****** *********/*********.

*** **** ***** ******** **** (**** ********** ******) ********* ** the ******* ***** ****** ** ******** *********** ***** **** *** Arecont ******** ******* ******* ** *** ********* ****** ****.

********* (*:**** - **:****)

**** ** *** *** ***** ** *** *******'* ***** *********** and **** ********** ********* ******** ****** *** *********/***-***** *****. *** playback ** ****** ** ** ** ******** ***** **** *** Arecont *** **** ******** ******.

***** ******* (*:**** - *:****)

** **** ******** ********, *** ******* ****** ** ****** **** to * **** ********* ********* ******** ** ******* (*** ****). However, ** ** ***** ******* **** ********* *** ***** ******** considerable ***** ********* *** * ****** ***** **** ***** ** recording ** ***-********* (~*:* ** **%). ** ******** *** **** continues ** ****** ****** ** ******* *** **** ********* ** in ******** **** *******.

Other ******* ****** *********

*** ********* ******** ******** ******* *** ****** *********/********* ******** ** two ******: (*) ***** ******* ***, *** (*) ****** ******. Motion *** *******/******* ** *** * ***** ** *** ******** recording *********** ** **** ******* ************ ******.

***** ******* *** & ****** ****** ****/****** ***** (*:**** - 5:30pm)

*** ******* *** ****** *********/********* ********* ** ******** ** *** timeline *** ********* ******** *** ********* ** ********. **** ********* were ** ********** ***** *** ******* *******. **** **** *** FoV ** ** **** ******** ***** *** ** **** *********** to *** ******* **** ** ********.

** *** ****** ****** *****, *** ******** ** *** ********* were *** ** ********** ***** ********/******.

***********

**** *** *** ***** (*) ******* **** ** *** '****** Based *********' *****:

  • ******* ********(****** $***) - *.*** */*; */*.*" ****; ****-**; *.*/* (*****/**)
  • **** *****(****** $***) - **** */*; */*" ****; **.* ******** ; 0.05 *** (**)
  • ********* **-*****(****** $***) - *.*** */*; */*" ***; **-*****/* ****; *.*/*.** lux (*****/**)

**** *** *** ******** ******** *** **** ** *** *******:

  • ******* ******** - ** *****
  • **** ***** - ** *.**.*
  • ********* **-***** - ** *.**
Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on VMS

Panasonic Unified Surveillance Strategy Analyzed on Nov 17, 2017
Panasonic is now a "Unified Surveillance" offering, as their ASIS 2017 booth proclaimed: Looking to make a comeback in the security industry,...
Hikvision NVR 4.0 Improvements Tested on Nov 14, 2017
Hikvision has released firmware version 4.0 for select NVRs, touting two years of research and development, and claiming "the new generation GUI...
Hikvision 4K IR PTZ Tested (DS-2DF8836IV-AELW) on Nov 10, 2017
The IR PTZ trend continues, now with 4K resolution, with Hikvision releasing its DS-2DF8836IVAEL-W camera, a 4K 1/1.9" PTZ model specifying 200m IR...
Milestone XProtect Essential+ Free VMS Tested on Nov 09, 2017
Milestone continues to expand its aggressive free and low-cost offerings, with this year, Milestone releasing XProtect Essential+, part of their...
ZoneMinder Open Source Profile on Nov 06, 2017
The first, oldest and probably the best known open source VMS is ZoneMinder. But where has it gone and is it still relevant today in a world of...
Top Manufacturers Gaining and Losing 2017 on Nov 03, 2017
3 years ago, IPVM statistics accurately and early identified the rise of Hikvision usage across Western markets (see Top Manufacturers Gaining and...
Avigilon Access Control 2017 Examined on Nov 01, 2017
For more than 4 years, Avigilon has been in the access control business, since their May 2013 acquisition of RedCloud. Since then, Avigilon has...
Hikvision Upgrade Breaks ONVIF VMS Integration on Oct 31, 2017
Hikvision IP cameras using ONVIF for VMS integration will break when upgrading to Hikvision new 5.5 firmware, IPVM testing has verified. This...
ONVIF Wire Free Camera Tested (Netgear FlexPower) on Oct 31, 2017
Totally wire-free cameras are a hot growth market. But they have had one major problem: Proprietary. IPVM has tested Netgear's Arlo and Arlo Go,...
Smart Codec Usage Surges - 2017 Statistics on Oct 25, 2017
Smart codec usage has surged in 2017, new IPVM statistics show. Smart codecs are less than three years old, starting in 2015 with Axis. Now, smart...

Most Recent Industry Reports

Panasonic Unified Surveillance Strategy Analyzed on Nov 17, 2017
Panasonic is now a "Unified Surveillance" offering, as their ASIS 2017 booth proclaimed: Looking to make a comeback in the security industry,...
Amazon Cloud Cam Is Poor (Tested) on Nov 17, 2017
Retail behemoth Amazon has entered the surveillance market with the Amazon Cloud Cam, the eyes of its just-announced Amazon Key delivery...
Nest Secure Alarm System Tested on Nov 16, 2017
Google's expansion continues, this time into home security with their Nest subsidiary's move into alarm systems. They paid more than a...
Dahua Forbes 'Next Web Crisis' Vulnerability Dispute on Nov 16, 2017
The buffer overflow vulnerability in Dahua products is not in dispute, in fact we covered it when it was first published. What is in dispute is...
Isonas Cofounders Split, Launch Partner/Competitor on Nov 16, 2017
Breaking up is hard to do, especially when door access security is at stake. But that is exactly what has happened at Isonas. Senior employees...
Hikvision China Criticizes The WSJ on Nov 15, 2017
Hikvision, through the Chinese government's authoritative news service, has criticized the WSJ investigation into Hikvision. In this...
Axis Commits To Long-Term Firmware Support on Nov 15, 2017
With the rise of cyber security awareness, and a general increase in hardware reliability, "software warranties" may prove more valuable than...
Hikvision NVR 4.0 Improvements Tested on Nov 14, 2017
Hikvision has released firmware version 4.0 for select NVRs, touting two years of research and development, and claiming "the new generation GUI...
Vivotek Remote Stack Overflow Vulnerability on Nov 14, 2017
A stack overflow vulnerability in Vivotek cameras has been discovered by bashis, the security researcher who has also found vulnerabilities in...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact