VMD Camera Shootout

Author: Ethan Ace, Published on Oct 28, 2013

Video motion detection's inaccuracy can have disastrous effects on your VMS system, with recordings due to positives easily consuming far more storage than estimated. On the other hand, optimizing VMD to reject these alarms can decrease detection rates, missing real events.

In order to test whose on-camera VMD performed best, we used cameras from Avigilon, Axis, Bosch, and Sony in multiple scenes, day and night, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

***** ****** *********'* ********** *** **** ********** ******* ** **** *** ******, with ********** *** ** ********* ****** ********* *** **** ******* than *********. ** *** ***** ****, ********** *** ** ****** these ****** *** ******** ********* *****, ******* **** ******.

** ***** ** **** ***** **-****** *** ********* ****, ** used ******* **** ********, ****, *****, *** **** ** ******** scenes, *** *** *****, ******** **** * ****** ****** ********** room:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ********* **** ***** **** *** ******* ***** ** *** tests, **** *** ********* ******** ****** **********:

  • ** ****** ***** ***** ** ***** "****" ** ********* ***** positives, ***** *** ******** ******** *********** **** ********* **********, *** and *****, ** ***** *** **** *****. *** ******** ** 1MP ******** ****** *** ** ******* ** ***** ****** **** others. *** **** ***** *** ********* ** ********* ********** **** than ***** *******. ***** **** ***** *** ******, *********** *** about *****.
  • *** ******* ******** ******** ***** ********* *** ** *** ******** of ********** ** *** *****, *** ** *****, ******* **** continuous *********. ** *** *****, **** **** ***** ** ****** out ******* ********* ***********, ** ** ***** ******** *** ******** in **** ****.
  • *******, ******* ****** ** ****** ******** ****** **** ***** ********* which ***** *** ** ******** *** ****** *****, ***** **** fell ********** *** ****** ********* ****.
  • ** *****, *** ******* **** ********* ** *** ********** ** our *****. *** **** ***** *** ********* ** **** **** when *** **** *** ******** **** *** ****** ****.
  • *******, ***** ******* **** *** ******* ***** ** ***** ******. These **** *** ** ***** *******/******* **** * *** *******, subjects ****** **** *** ****, ** *********** ** ********** **********. The **** ***** ** **** ***** ** ***** ****** ** this *****, ******** ** ***** ***-****, **** *****, *** ******** *.*-**-**. 

*** ********* *** ******** ******* *********** ** ******* **** ****** using * ***** *******:

  • *** ******** *.*-**-** ********* **** ** ****** *** ******* ****** at *** ***** ******, ******* **** **** ***** ** **** (<1lux). *** ****** *** *** ******* ********* ***** ***** ****** cameras *** ** ******, ** ****, ****** ********* ** ****** and ******** ** *** **** **********.  
  • ** ******* ******* *** **** ***** ****** *****, **** *****, Bosch ***-**** *** **** ***-***** ******* ******* ****** ********* *********** in ***** ** ********* ****** *** ***** ***** *****. 
  • ** *** *****, *** *********** ** ***** ***-**** *** **** SNC-VB600 **** **** *******, **** ***** ******** **** ******** ****** detection ******  *** ******** ***** ***** ***** *****.
  • **** *****, ** *** ***** ****, ****** ************* ****** ***** cameras ** *** *****, **** **** ***** ********* ******.

Optimization ***************

***** ** *** *****, ** **** ** *********** ** **** practices **** **** ************, **** *** *** *************** ** *** each ****** *** ** ********* *** **** ***********:

  • *** *** ******** *.*-**-**, ******* ******** ******** ****** *********** ** *** ******, **** ** *********** *******.
  • **** ****' ***** ******** ***, *** ******* ****** **** ******* is *** ***** *** **** ******.  ** ***** ** *** ****** detection ******, *** ****** **** ******* ****** ** ** ******* carefully ** * ***** ******** ** *** *****, ********* * or *****.
  • *** *** ***** ***-****, **** *** *********** *** **** ******** by ***** *** ******* ******** ** *** ****** ** ******. Lowering *** ****** **** ******** ** ************* ****** ***** ****** due ** ******* *** ****. 
  • *** *** **** ***-*****, *** ****** **** ****** ** ******* to *** ******* ***** *** **** ***********. ** *** *******, *********** can **** ** ******** ********* **** *** ******* ******* ** *** a ****** ********* *****. *** ** ****** ***** ***** ***** ** *** *****, ******* *********** ** ***** ** ** **** *********** in ***** **********.

***************

*** ** *************** ***** ****** **** ****** ******, ********, *******, *** ***** variations, ***** ****** ********* ******** ****** ********* *** ******* ******* when ******** ** *** ***** ****** *********. ****** ******* **** from ********** *** ****** ******** **** ******** **** ******* ******* performance, **** ****** ***** ******* ******* ** ***** *****.

******* *** ******** ****** *** ** ******* ******* *** *** cameras ** *** ******. ** **** ***** ***** ******** **** result ** ******** ***** ********* ** ****** **********. ***** ****** plan ** ****** ***** ******** **** ******* *** ** *****, and ******** ****** ** ********* ************ ** ****** *********** ** still***********.

*** ***** ********* ******** ****** ********* ** ****** ****** (>***' during *** **** *** >**' *****-****), *** ******** *.*-**-** ****** out ** *** **** ****** ***** *** ****** *******. *******, since ** ********** **** ***** ******* *** *****, **** **** will *** ******* ****** ****** **** *** ******, ******** *** use ** ***-**-*** ******** *******.

Comparison ** *****-** *********

******** ** *** ******** ****** ****** ********* ****** ****, **** ***** ****** ********* *.* ********* ****** ** **** ******. ****** *********, ********* ** *******, and ***** **** *** ********, *** *** ***** *********** *** reduced ********. ** ********* ** ** **** **** **** ******* whenever ********, *** *** *********** ** ******* *** ** *********** with **** *** **** (**** *** ******* ****).

******** ** ***** *****-** ***, ****, *****, *** **** ****** ********* **** ** ***** **** ********* ******** **** **** ***** ***** ******** *****. **** ** *** to *** **** ****** ********* ***** *** ******** ***** ******** for **********. ***** *** **** ** ******** ***** ********* ******* of ******** *** ***** ********.

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

******** **

**** *****

**** ********** ******************** ** ****' ***. **** **** **** ***** **** ******** configuration ** **** ***** ****** ********* *.*, ***** ** ********* over ******** *** ******** ********. *******, **** ****** ******* **** on *******' ******** ******** ***. 

***** ***-****

**** *** ***

Outdoor ******* 

********, ** ********, ****** **** ******** *** ****** ********* ********** nuisance ****** ** *** *******. ** ******* ***** ***** ***** ******* windows, ** ******* ** ****** ********* *** *** ******** *********.

**** ****** ** ******** *** ********** ** *** *****, *** cameras **** ***** ********* *** ** *** ******** ** ******* in *** *****. ***** ***** ***** *** ** ******** ** they **** ** *** ****** ** *** ****** ****.

*** ***** ***** ***** * ******* ** * ****** *** ** front ** *** ******. *** ******** ** **** *** **** the *** ******* *** ** ** ****** **** ********** ********* for *** *****.

********* *****

*** *** ********* ***** ****, ** **** * **** ***** about **' **** **** ******** ** *****, *** ***** ***' *** ****** ****. *** ******* ********* due ** ** ****** ******* ******* *** *******. *******, ******** 1.0-H3-B2 ****** ** *** ******* **  ~ ***-***' **** **** the ******, ***** **** *****, ***** ***-**** *** **** ***-***** triggered ** *** **-**' *****. **** ****, **** ***** ******** VMD's ****** **** ****** ** ****** **** ** (*******) ** 1 ** ***** ** ******** ********* ***** **** **' ** 45'. ****, *** **** ***-***** ***'* *********** ******* *** ********* to *** **** *** ******* ***, ***** ******** *** ********* range ** ****** **'. ******* ******** ** ****'* *********** ******** in ********** ****** ********* *** ** ***** *********.

******** *.*-**-** **** ******** ******** ********** ** *** ****** **** (~280') ****** *** ***. **** ***-*****, ***** ***-**** *** **** ***** detected **** ***** **%, **%, *** *% ** ********, ************.

******** *.*-**-** *** **** **** ** ****** ****** ** *** distant *******, **** ***' **** *** ******.

 

Outdoor *********

** *** ******* ********* *****, ***** **** *** *** ******** of ***** *********. ** ** *** *******, ******* **** ****** and ********** ********* ******:

****, ******** ** ****** *** *** **** ** ******* ***** factors ** *** **** **********, **** ***-***** **** ***** **** sensitive ** *** ********** *** ** **** ********** ************ **** *** **********.

********* *****

** *** *****, ******** *.*-**-**'* ***** ********* ***** ********* ** about **' *** ***** ******* *** ******* ***** (***** ** ~40', **** ** ~**', *** **** ** ~**'). **** **** we *** *** ******** *** *********** ******* ** **** ***-***** this ****, ***** ** *** **** ******** ** ******** ***** positives *** ** ******* ** *** *****.

**** *** ******* ****** ****** *** *** ** ~**', ******** 1.0-H3-B2 *** ***** ***-**** ******** *** **********. **** ***-***** ****** him ***** **** ** *** ****, ***** **** ***** *** not ******* ** ***.

** **', **** ** *** ******* *********, **** *** ******* simply *** ***** ** ********.

Indoor ********** ****

*** **** ***** *** *** * ***** ***** **** ** 10%-15% **** *** ****** ** *** **********, ***** ***** ********* about *% ** *** ****.

******* *** **** ******* *** ***** ** *** ***** *** ****** the ********* ***** ***** *****: **** **%, **** **%, ***** 20%. 

**** ****** * ********** ********** *** ****, 

** *** ********** **** ** **** *****, *** ****** **** able ** ******** ****** * ***** ******* **  *** ****** up ** **'. **** **** *** **** ***** ***** *** detect *** ******* ** ******* ******** ** ******* ****** **** (15), *** *** ** ** ******* ** * *** ******** detection.

** *** ***** (~***), *** **** ******** *** ****** ** 100% ******** ** ** **' ** * ******* ****** ** the **** ***** ****.

 

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, **** ***** *********** ** *** ******* **** ********. **** again, *** **** *****'* **** ** ******* ** * ** improve ********* *****

** *** *****, *** **** ** *** ****** (~**') *** lightened ** * ***** ********** ******** *****. *** ** ****, all ******* ****** **** ***** ******** *** ****** ** **** as ** ******* *** **** **' ****.

*******, ** *** ****** ***** **** *** ***** ** *** darker ****, **** ***-***** *** ***** ***-**** **** ********* ** ****** **' and **-******** *** ****** ** ***** **'. 

*** **** *****, ** *** ***** ****, ***** **** ****** the ****** ** *' **** **** *** ******. 

Cameras/Firmware ****

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ******** *.*-**-**: *.*.**.*
  • **** *****: *.**.**
  • ***** ***-****: *.**
  • **** ***-*****: *.*.*

 

Comments (7)

**** ****** **** *** **** ** *** ******** *** ** the *** ** *** ******** ** *** *****. **** ** integrator ***** ** **** **** = ***** ** **** ******* the ******* *** ***** ***** *** *** ******** ****** ** that ** ***** ******* *** ***** **** **** * ****** asking *** *** ****** ** **** ***** * *** ** money ** ****** ** *****. * *** **** ********* ** see **** ** *** *** *** ** *** **** *** creating *** **** ***** ********* **** ******** *******.

**** ** *** **** *****!

**** ****** ** **** *** ********** ** ** *********** *** ********.... :)

**** ****, **** **** ******** **** **** ****** *** *********** still *** ******. *******, ***** ** **** *** *********** (****** manufacturers ******** ***++ ** **** ** *** ************* ****** ******* for****' ****.*).

*** *** *** ******** ******* ** ********* ********* ************* *** wide ***/** **** ******? ****'* *** ***** * ******** ***** the **** ******* *** *** ****** ******* *** *** ** the **** ***********.

*** *****, ** *** *** *** ** ***** ******** ******* in **** **** ******* ** ***** **** *********** *** **** modest ******* ** **** *****. * ******* **** **** ** this **** ***** ***** ** ** ****** *********** *** ********** windows, ***, ****** ** * **** *****, ******.

****** *** *** ************* :) * **** ** ***** ********** on **** ******* *** ** ****** ** **** ****.

*****:

****** *** *** ******. *** *** ******** **** ** ******** that **** ** ***** ******* ***** ****** ********* **** ******** outdoors, *******, ********* ** *** ****** ** ********* *** ******* the ***** ** ****** **** ***** **** *****.

*** *** **** **** **** *** *** **** ********** (****** out ****** ****** *** **** ** ******) *** ***** *** best ******** **** ***** **** ****** *********, **** *** *** false ***** **** ** ***** **** * ** **** ****** for **** ***** ** **** **** ****** *** ********?

* ******* ************* ** ****, "*** *** ******** **** ** indicate **** **** ** ***** ******* ***** ****** ********* **** suitable ********"

**** ** ***** **************** ******** *** ******* ******************* **** *** *** ******** ****** *** ** ***** ********** crazy. *******, *** ******* *********, * *** ****** ** ****** detection, ***** ** ***** ********, **** *** ** **** ** there ***** ** ** *** *** *** **** ********/******** (******* *.* *** ******* **** ******* *** **********).

** *** '***** ***** ****', ** *******, *** ********** ** not ** **** ******** ******* *********** - *.*., **** ****** has ** **.*% ***** **** ** ******** ** ********, ******* there *** ****** **** ******** ********* **** * ****** ****** would ** **********.

**** ****, *'** *** ***** ******* ** ****** / ******** of *********** *** **** ******** ** ****** *** ****** *** cars, ***.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Camera Course Summer 2017 on May 25, 2017
Learn video surveillance and get certified. IPVM provides live online classes, recorded videos, personal help, cutting edge education and...
48MP 180 Camera (Digital Watchdog) Test on May 10, 2017
Camera resolution continues to advance, with Digital Watchdog offering the MegaPIX PANO 48MP 180° camera, the highest resolution mainstream camera...
Hanwha 9MP Fisheye Camera Tested (PNF-9010R) on May 09, 2017
12MP sensor fisheye panoramic cameras are becoming increasingly common. We have tested Hikvision's DS-2CD63C2F as well as Panasonic's SFV481 4K...
Axis Lowest Cost Outdoor IR Camera M2025-LE Tested on Apr 24, 2017
Axis has lagged offering low cost IR cameras while their Asian competitors have made IR standard even in their most entry level cameras. Recently,...
Ring Floodlight Cam Tested on Apr 20, 2017
Ring has released their latest entry, the Floodlight Cam, calling it the "Evolution of Outdoor Security", touting motion activated floodlights,...
Hanwha Lowest Cost WiseNet X Camera (XND-6010) Tested on Apr 13, 2017
IPVM bought and tested the lowest-cost WiseNet X model, the indoor 2MP fixed focal XND-6010 dome, continuing our testing of Hanwha's new WiseNet X...
Pelco Surevision 3 Tested on Apr 12, 2017
Pelco has released generation 3 of its Surevision cameras, claiming improved performance in both super low light and WDR performance. We bought...
Hanwha Wisenet X Tested on Mar 27, 2017
Hanwha has released their latest generation, the Wisenet X series, powered by their new Wisenet 5 processor. This new series claims improvements...
SimpliSafe Camera Tested on Mar 07, 2017
SimpliSafe is one of the most controversial companies in the industry, as they have become the symbol of the DIY threat to traditional alarm...
Vivotek 3MP 180 Wall Mount Camera Tested on Feb 28, 2017
Purpose-built wall mount panoramics have become an attractive niche to cover entranceways. In 2013, we bought and tested Vivotek's 1MP...

Most Recent Industry Reports

H.265 / HEVC Codec Tutorial 2017 on May 25, 2017
Since 2013, video surveillance professionals have talked about the potential for H.265. Now, in 2017, H.265 is starting to gain mainstream...
Camera Course Summer 2017 on May 25, 2017
Learn video surveillance and get certified. IPVM provides live online classes, recorded videos, personal help, cutting edge education and...
Most Respected Manufacturer Competitors on May 25, 2017
Manufacturers told IPVM what competitor they most respected. In terms of total revenue, Hikvision, Dahua and Axis are certainly tops but would...
CyPhy 'Unlimited' Flight Time Security Drone Examined on May 25, 2017
Drones face several issues as commercial security platforms - legal restrictions (e.g., in the US, the FAA), costs, and limited flight durations...
Milestone Entry Level Mobile Password Vulnerability Disclosed on May 24, 2017
While many manufacturers have only addressed cybersecurity vulnerabilities after public disclosures were made (or threatened), Milestone has...
How Integrators Use IPVM on May 24, 2017
150 integrators explained how they use IPVM and how it helps them stay informed and improve their business.  The 4 main uses integrators cited for...
Alarm Supervision Guide on May 24, 2017
Burglar alarms can constantly monitor the health of attached circuits, sensors, and devices to ensure that they remain operational. This is known...
Arlo Go Cellular Cloud Camera Tested on May 23, 2017
Totally wireless surveillance cameras are growing but almost all typically depend on a hub and local Internet access. However, many outdoor...
Avigilon New COO James Henderson Profile on May 23, 2017
It has been nearly 2 years since the infamous Bryan Schmode 'resigned' as Avigilon COO. Now, Avigilon once again has a COO, promoting James...
Hikvision Marketer Caught Spamming, Fails at Coverup, Fired on May 23, 2017
A Hikvision marketing employee was caught by IPCamTalk trying to surreptitiously disparage IPVM and IPCamTalk. This is an outgrowth of Hikvision's...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact