Motion Detection Performance Tested

Author: Benros Emata, Published on Sep 05, 2011

Motion detection is an important element of many, if not, most surveillance systems. It plays a central role in both storage search time reduction. Storage is routinely reduced by 30% - 80% by using motion based rather than continuous recording. Likewise, an investigator can often much faster find a relevant event by simply scanning through areas of motion rather than watching through all video.

At the same time there are a number of challenges associated with using motion detection:

  • Scene Conditions: The accuracy of motion detection and the amount of times motion is detected can vary depending on what's in the scene - people, cars, trees, leaves, etc. - and the time of day - night time with lots of noise, sunrise and sunset with direct sunlight into a camera, etc.
  • Performance of Detector: Motion detetion is built into many surveillance products - from DVRs to VMS systems and now IP cameras. As such, how well each one works can vary significantly.

Our Test

In this report, we share our results from a series of tests we performed to better understand motion detection performance.

We did a series of tests in different locations:

  • Indoor well light scene to simulate the simplest scene possible
  • Indoor dark scene (<1 lux) to examine what problems low light caused
  • Outdoor parking lot to see how a complex scene with trees, cars and people would perform
  • Roadway to see how a moderately complex scene with periodic cars would perform

Three IP cameras were used with their motion detection enabled to see differences in performance:

With these tests, we answered the following questions:

  • How can one estimate motion percentage accurately?
  • Does motion estimation vary significantly by scene?
  • How accurate was motion detection in each scene?
  • Did certain cameras exhibit greater false motion detection than others? What scenes or conditions drove those problems?

****** ********* ** ** ********* ******* ** ****, ** ***, most ************ *******. ** ***** * ******* **** ** **** storage ****** **** *********. ******* ** ********* ******* ** **% - **% ** ***** ****** ***** ****** **** ********** *********. Likewise, ** ************ *** ***** **** ****** **** * ******** event ** ****** ******** ******* ***** ** ****** ****** **** watching ******* *** *****.

** *** **** **** ***** *** * ****** ** ********** associated **** ***** ****** *********:

  • ***** **********: *** ******** ** ****** ********* *** *** ****** ** times ****** ** ******** *** **** ********* ** ****'* ** the ***** - ******, ****, *****, ******, ***. - *** the **** ** *** - ***** **** **** **** ** noise, ******* *** ****** **** ****** ******** **** * ******, etc.
  • *********** ** ********: ****** ******** ** ***** **** **** ************ ******** - from **** ** *** ******* *** *** ** *******. ** such, *** **** **** *** ***** *** **** *************.

Our ****

** **** ******, ** ***** *** ******* **** * ****** of ***** ** ********* ** ****** ********** ****** ********* ***********.

** *** * ****** ** ***** ** ********* *********:

  • ****** **** ***** ***** ** ******** *** ******** ***** ********
  • ****** **** ***** (light ******
  • ******* ******* *** ** *** *** * ******* ***** **** trees, **** *** ****** ***** *******
  • ******* ** *** *** * ********** ******* ***** **** ******** cars ***** *******

***** ** ******* **** **** **** ***** ****** ********* ******* to *** *********** ** ***********:

**** ***** *****, ** ******** *** ********* *********:

  • *** *** *** ******** ****** ********** **********?
  • **** ****** ********** **** ************* ** *****?
  • *** ******** *** ****** ********* ** **** *****?
  • *** ******* ******* ******* ******* ***** ****** ********* **** ******? What ****** ** ********** ***** ***** ********?

[***************]

Key ******** *** ***************

**** *** *** *** ********:

  • ** ****** ****** (*.*. **** ******** *** ****** ***), ********** percentage ** ****** ** ********** *************** *** *** * *** margin *** *****.
  • ** ******* ****** (*.*. *******, **** ***, ********* ********, *** vegetation) ********** ********* ** ****** ** ********* *** *** **** greatly.
  • ******** ** *********** ****** ******* ********* ************* ** *** ********** of *** ***** *********.
  • *** ***** ******* ********* ******* (** ***** *********/*********) ** *** very ****** ******* ****** ****
  • ** *** ******* *** **** *** ***** ******* ****** ** record ** ****** ** **** ********* *******, *** ** ********** and ******** *******
  • *** ******* ****** ****** *** *********** ***** ********* ** ***-*****/********* scenes ****** *** ** *****/**** ** **** ** **** *** is ******* **** *** ******'* ***. **** ******** ** **** continuous *********.

** ***** ** ***** ******** *** ********* ** ***********:

  • ****** *** ***** ** **** ******, ****** ********* ******** (*.*. masking, ***********, *** ****** ****) **** ****** **** ** ** optimized ** ***** ** ******* ********** ********
  • *** ***-***** ******, ******** ******** ******* ****. ****, ********** **** different ****** *****/****** ** *********** *** **** ************ ** ***-*****/********* scenarios
  • ** ******* ***** ********** ****** ** ******* ****** ** ***'* estimates *** ** *** ***

Daytime ****** (********** ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** *** *******. * ******* ****** the ***** ** ********* ****** ** ***** ****** ****** ********* during *** *** ****** ****. * ******** **** *** ****** recorded ***** *** ******** ******** ** ******** *****. **** **** on *** ******** '****' ********** ****** ******** ***** *** '****' indicates ** ***** *********.

********* *** ******** ******* **** *** ******* ******** ******** ****** during **** ** *** ***** ******* ******* **** *** *****. Also, **** ** ***********, ** ***** ********* **** ********* ****** times **** *** ******* *** *** ** *** *****. *** findings *** *** ********** ***** *** ********** ** *** *********** (narrow ***, ****** *** ********** ********, ** **********, *** ***** subject/object).

Nighttime ****** (********** ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** *** *******. * ******* ****** the ***** ** ********* ****** ** ***** ****** ****** ********* during *** *** ****** ****. * ******** **** *** ****** recorded ***** *** ******** ******** ** ******** *****. **** **** on *** ******** '****' ********** ****** ******** ***** *** '****' indicates ** ***** *********.

** **** ***-***** ***********, ****** *********/****** ******** *** ****** ********** across *** ***** *******. *** ******* *** ** ***** *** lighting ******* *********** '********' ****** ** ******** *** ** **** effectively ******* ** ********** ******* (**** ***** ******** ****). ** direct ******** *** ********* ***** '********' ***** ** ****** ******* throughout *** *** ****** ******** *** ** * ****** *** produced ** ********* ** *** (**** ***** ******** ****). *** Axis ******** *** **** ** ** *** ** *** ******* indoor *********, ******* ******/***-****** *************.

Daytime ******* (******* ******)

** **** ********, ****** ********* ** ********** *** *** *** interface ** *** *******. *** ******* *** **** ** ****** record *** * ****** ** ** *******. *** ****** ** organic *** ************** ** * **** ***** ************ ********. * snapshot **** *** ****** ******** ***** *** ******** ******** ** featured *****. **** **** ** *** ******** '****' ********** ****** recorded ***** *** '****' ********* ** ***** *********.

*** ********* ** ****** *********/********* ** **** ** *** ******** is ************ **** *** *** ***** ******* (~** - **% motion). *** **** ******* *********** (*.*., *****, ******* *** ***** lighting *******) ****** ***** * ****** ** ***** ********* ****** the *****. **** **** *** ********* ****** *********** ******** ********** the ** ****** ****, *** **** *** **** *** **** slightly **** ***** *********. *** ******* *** *** ***** ********* among *** ***** *** ***** ************ **** ********* **** *********** just ************** ******** ** ********* ****** (*.*. ***** *** ******* subjects).

24 **** ******* (******* ******)

*** ********* ** * ******** ** **** ******** ********* ** two ******* (******** *** *****) ********** ** ****** ****** ********** a ** **** ******. *** ******* **** *** **** ******* scene **** *** **** ***/**** *****. ***** ********** ******** **** insights **** *********** ** ****** *********/********* ************* ****** ********* ****** makes/models. **** **** *** *** ** **** ** ********** *** motion ********* ******** **** *** ****** *** *** **** ** the *** ********** ********.

**** ********* (*:**** - *:****)

****** *** ~* ***** ** ******** ******** ** *** ******** the ******* ****** ******** ************ ******* *********** **** *** **** camera ******* **** ********* **** *** ******* (*** **********) ****** settings. ** * ******, *** ******* ******** ************ ***** *********, whereas *** **** ** ************* ** ***** * ****** ** false *********.

******* (*:**** - *:****)

*** ******** ** ****** ** ** ** **** ***** ********, as ********* ** *** ******** ** * ******* ******** *** FoV ******** ** *** ****** ********* ******* ******. **** **** how *** ******* ****** ** ****** ************ ****** ***** ****** around *:**** (*** *****), ***** *** **** ***** ** ******** the **** ********* ** ****** *********/*********.

*** **** ***** ******** **** (**** ********** ******) ********* ** the ******* ***** ****** ** ******** *********** ***** **** *** Arecont ******** ******* ******* ** *** ********* ****** ****.

********* (*:**** - **:****)

**** ** *** *** ***** ** *** *******'* ***** *********** and **** ********** ********* ******** ****** *** *********/***-***** *****. *** playback ** ****** ** ** ** ******** ***** **** *** Arecont *** **** ******** ******.

***** ******* (*:**** - *:****)

** **** ******** ********, *** ******* ****** ** ****** **** to * **** ********* ********* ******** ** ******* (*** ****). However, ** ** ***** ******* **** ********* *** ***** ******** considerable ***** ********* *** * ****** ***** **** ***** ** recording ** ***-********* (~*:* ** **%). ** ******** *** **** continues ** ****** ****** ** ******* *** **** ********* ** in ******** **** *******.

Other ******* ****** *********

*** ********* ******** ******** ******* *** ****** *********/********* ******** ** two ******: (*) ***** ******* ***, *** (*) ****** ******. Motion *** *******/******* ** *** * ***** ** *** ******** recording *********** ** **** ******* ************ ******.

***** ******* *** & ****** ****** ****/****** ***** (*:**** - 5:30pm)

*** ******* *** ****** *********/********* ********* ** ******** ** *** timeline *** ********* ******** *** ********* ** ********. **** ********* were ** ********** ***** *** ******* *******. **** **** *** FoV ** ** **** ******** ***** *** ** **** *********** to *** ******* **** ** ********.

** *** ****** ****** *****, *** ******** ** *** ********* were *** ** ********** ***** ********/******.

***********

**** *** *** ***** (*) ******* **** ** *** '****** Based *********' *****:

  • ******* ********(****** $***) - *.*** */*; */*.*" ****; ****-**; *.*/* (*****/**)
  • **** *****(****** $***) - **** */*; */*" ****; **.* ******** ; 0.05 *** (**)
  • ********* **-*****(****** $***) - *.*** */*; */*" ***; **-*****/* ****; *.*/*.** lux (*****/**)

**** *** *** ******** ******** *** **** ** *** *******:

  • ******* ******** - ** *****
  • **** ***** - ** *.**.*
  • ********* **-***** - ** *.**
Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on VMS

Sports Stadium Security Design Recommendations on Jul 24, 2017
Sports stadiums pose many challenges for designing security systems. The facilities vary from being mostly vacant, to packed with tens of thousands...
Genetec Mission Control Tested on Jul 13, 2017
Genetec continues to move up market with their Mission Control, "Decision Support System", bringing PSIM-like procedures and incident management to...
OnSSI Gets $16 Million Funding on Jul 11, 2017
OnSSI has had a rollercoaster past few years. Between acquiring VMS company Seetec, breaking up with former OEM partner Milestone and a rocky...
ONVIF Widely Used Toolkit gSOAP Vulnerability Discovered on Jul 10, 2017
A vulnerability has been discovered in a toolkit that video surveillance manufacturers widely use for implementing ONVIF. In this report, we...
H.265 / HEVC Codec Tutorial 2017 on Jun 30, 2017
For years, video surveillance professionals have talked about the potential for H.265. Now, in 2017, H.265 is starting to gain mainstream...
Hikvision H.265+ Tested on Jun 27, 2017
Hikvision, which in the past few years released H.264+ (see test results) has now released H.265+, that claims even greater bandwidth savings. We...
Milestone / Canon Launch Cloud Startup Arcus Global on Jun 27, 2017
Milestone has spun off a business, Arcus Global, funded by their parent company Canon. The new company aims to transform the VSaaS market with an...
VMS UI - Light vs Dark Preferences on Jun 16, 2017
Several VMS manufacturers have the ability to choose a user interface with either a light or dark color theme. 150+ integrators told us which they...
Axis 20MP Q1659 Camera Tested on Jun 13, 2017
Axis has joined the super high resolution camera trend with their Q1659, a 20MP model equipped with Canon's APS-C sensor. We tested the Q1659...
Milestone New "+" Claims To "Conquer The Mid-Market" on Jun 07, 2017
Milestone has declared they are going to "Conquer The Mid-Market" with new "+" releases. Will they? In this report, we examine Milestone's "+"...

Most Recent Industry Reports

$28M Drone Detection Startup Examined (Dedrone) on Jul 25, 2017
Dedrone has received ~$28M in funding to build what they call an "automatic anti-drone solution", a system to detect drones, and then automatically...
Dahua Suffers Second Major Vulnerability, Silent on Jul 25, 2017
Less than 3 months ago, Dahua received DHS ICS-CERT's worst score of 10.0 for their backdoor. Now, Dahua has received another 10.0 score for a new...
Hikvision H.265+ Bullet Tested (2035) on Jul 24, 2017
Continuing our tests of Hikvision's new low cost Value Plus line, we bought and tested the 3MP DS-2CD2035FWD-I, now including H.265+. We shot the...
Sports Stadium Security Design Recommendations on Jul 24, 2017
Sports stadiums pose many challenges for designing security systems. The facilities vary from being mostly vacant, to packed with tens of thousands...
Competing Against Convergint on Jul 24, 2017
No integrator is more aggressively expanding than Convergint Technologies. Owned and funded by private equity firm KRG, Convergint has acquired...
Security Robots Are Just Entertainment on Jul 21, 2017
Great entertainment, no real security value.  That is the happy (or sad) state of security robots in 2017. Knightscope robot's drowning, the...
Wireless Burglar Alarm Sensors Guide on Jul 21, 2017
Wireless sensors for burglar alarm sensors are an increasingly common option for the historical labor intensive wired alarm systems. However,...
Competing Against ADT on Jul 20, 2017
ADT is one of the biggest players in the security industry, with ~$4 billion revenue. In 2017, they were acquired / merged with Protection...
Hikvision Launching Deep Learning Recorders on Jul 20, 2017
Hikvision has become a common choice for super low cost NVRs. Now, Hikvision is aiming to move up market, with deep learning NVRs that claim far...
PR Campaign Exploiting Manufacturer Cybersecurity on Jul 20, 2017
Manufacturers increasingly have a bulls-eye on their back. As cyber security solutions providers grow, they realize a great way to get publicity...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact