VMD Shootout II - Hikvision, Dahua, Samsung

Author: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports:

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** *** ****. ******* ******* ** *** asked *** **** ************* ** ** ******. **** **** ******** 3 *** ************* - *****,************ *******, ******** ** *** ******** ****** **** *******:

** ******** *** **** ******* ******** ** *** ***** **** series, ******** **** * ****** ****** ********** ****:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ****** **** **** ***** ***** **** ********* ***** ************* a ******* **° ********** ***** ** **** **** *** ** the **** *** ******* **** *****,*********, *** *******. ** ********* **** *********** ******* **** ******** models *** **************** *** ***** ** **** ******, *** ** ****** *** be ******* **** *** ******* ** *** ************'* **** ******* similarly ** *** ****** ******.

**** ******* ** *********** *** ********(********, ****, *****, ****) ******* ***** ****** ********* *.*, ***** ***** ************* ********* ** *******:

  • *****'* *********** *** ************* *** **** ** **** (******** ***), Bosch, *** **** ****** *** *** ** **** ***** *** false ********** *********. ** *****, ** ************ **** ******** *** and ****, ********* ***** ***** ** *** ***** ***-****, **** **** *** false ***********.
  • ********************* **** (******** ***), *****, *** **** ****** *** ***, at **' ***** **** *** ***** *********. ********* ***** ** night *** ****** **** *** **** ************* ** *** ******** test, ** **', ******* ******* ***** ******** ******.
  • *******'* ***** (~***' ********) *** ******* **** *** *******, ********* Avigilon (~***'), *** ******** *** *********, **** *** ***** ***********. At *****, ********* ***** *** ******** *** **** ****** (~**' vs. **' *** ********).
  • ******** ** **** *** *.*, *********** ****** ********* ** *** scene. *** ***** ************* ** **** **** ************ **** *** 2.1 ** *** *****, ***** ** ****** ******** ********** ** even ***** *****. ****** *** ***, ******* ************ *** *.* by ~**-**',************ ************* ***** ** ***** (~**-**'), ***** ***** *** ~**' shorter. **** *** *.*'* ***** ******** ********* **** *** ****** perfect, *******, ****** **** *** ****** ** **** ****.

***** *** ******** ******* ********** ****** *********** *** ******:

  • ****** *****'* ***** *** ** *** **** **** ***** *******, and ***** *********** **** *** ** *****, ** ***** ***** motion ********* ** ** *** ***** ********, **** ******. ** failed ** ******** ************ ** ***** ******* *** ***** *** settings ********* *********.
  • *** ******* ***-**** *** *** **** ********* ***** ** **** test, **** ******* *** ***, ** **** ***** *** ****. However, ** *** **** ***** ** ***** *********** ********, **** shadows *** ******* *** ******, ** ******** **** ** *** open ****** **** *****.
  • *********'************ *** **** **** ** ******* ** ******** ******, ** all ***** ****** ******. ********, ********* ***** *** ******* **** Samsung, ****** ****** **** *****. ***** *********** **** ********, **** the ********* ** ******* ****** ** *** *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, ***** *** *** *************** ** *** to **** ******** **** ******:

  • **************** ****** *** *********** * (*******) ** *. ***** ****, valid ****** *** ********** ******, ***** ***** *********** ******** *********** above *.
  • ** ********* ******* *****'* ******* *********** ** **, **** * threshold ** *-*. ********** *********** ***** **** ******* ** ******** false************. ** **** ******, ***** ******** ***** ** ***** *** area, ******* ** * ****** ***** **** ********* ******, *** we *** *** **** ********** ******** ** ** **** **** is **********.
  • *** *******, ** ***** **** ******* *** *********** ** *** default "******" ******* *** *** **** ***** ** **** ********** to ***** ******, *** ******** ** ******* *********** **** ****** directly ****** ********* ***** ** ******** *************** ***** ******.

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

***** *******

***********-*********


******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* ***-**** ** *** **** ****** ** detect *** *******, ****** ** *** ******* ********* ***** ** all *** ******* ******.

** ~**', **************-********* ****** ** ****** *** ******* ************.

*******, ** ~**', *** ***** ******* ** **** ** ****** our *******.

********* ********* *****

*** ** *** ******* ****** *** * ********* ** ********* range, **** *** ********** **** ~**' ** *** ******* ** ~**' ** *****,************** **** ~**' ** ~**', *** ******* ***** ****** *** furthest ********* ***** ** *****, *** ******** **** ~***' ** the *** ** ~**' ***********.

Indoor ********** ****

** *** ********** **** ** **** *****, *** ******* **** able ** ******** ****** * ***** ******* ** *** ****** up ** **'.

** *** ***** (~***), *******'* *** *** *** **** ****** tested ** ******** ****** *** ******* ** *** ****** ** to **' ** *** ********** **** *****. ******************* *** ** **% ******** ****** **** *** ******* ** ~20', *** ***% ********* **** *** ******* *** ~**' ** closer. ***** ******* ********* ****** ** **** *****, ******** **% detection **** *** ******* ~**' ****, *** ******** ***% ********* accuracy **** *** ******* ~**' **** *** ******.

******************* *** * **% *****-***** **** **** * ****** ****** in *** *****, ***** *** ******* ***-**** *** * **% false-alarm ****. **** ***** ******* *** *** *******.

**** ** ***** * ********** ******* *** ****, *** ***** HF3101N *** * **% *****-***** ****, ***** *************** ******* ******* **** **********.

******* *** **** ******* *** ***** ** *** ***** *** created * ***** ***** *****************% *** ******* **%. ***** ******** **********.

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, *** *** ******* ~** **** *** *******, **** ***** performance ************** ******* *** *******, **** ******* ********* *** ******* ** soon ** ** **** ****** *** ******, *** ************ ************ ** *** **** ******* ~**% ** *** ****. **** the ***** *** *** ******** ******* ***** *** ******** ****** our ******* **** **** ********.

*******, **** *** ******* ****** ** **** **** *** *****, all ******* *** **** ** ****** *** *******, **** ********* accuracy *** ****** ** ****** ** *** *******.

** *** **** ***** ** *** *****, *************** ******* ******* ****** ***** ******* ********* ***** ** * full ***** *****, *** ***** ** ****** ** ****** *** subject.

*** ******* ***-**** *** * **** ********* ** ********* ****** provided ** * ******** ***. ***** **** ******* ** ****** every ****. *************** ***** ******* *** *** **** ***** ****** **** *** flashing ***.

Test **********

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ***** *******: *.***.******* **.*.*
  • ***********-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

WDR Tutorial on Jan 11, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Worst Products Tested In Past Year on Jan 09, 2019
IPVM has done over 100 tests in the past year. But which products performed the worst? Which ones should users be most aware of? In this report,...
2019 Video Surveillance Cameras Overview on Jan 07, 2019
Each year, IPVM summarizes the main advances and changes for video surveillance cameras, based on our industry-leading testing and...
IPVM Best New Products 2019 Opened - 70+ Entrants on Jan 07, 2019
The inaugural IPVM Best New Product Awards has been opened - the industry's first and only program where the awards are not pay-to-play and the...
Axis Tailgate Detection Tested on Jan 04, 2019
Axis is aiming to tackle tailgating, one of access control's biggest issues, with the Tailgating Detector ACAP application. This camera app claims...
Camera Course January 2019 on Jan 03, 2019
This is the only independent surveillance camera course, based on in-depth product and technology testing. Lots of manufacturer training exists...
Amazon Rekognition Facial Detection Tested on Dec 03, 2018
Amazon's Rekognition service has announced improvements, that if accurate, would be a significant advance over conventional facial detection. In...
Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...
Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Axxon Face Search Tested on Oct 26, 2018
AxxonSoft has brought facial recognition to their Axxon Next VMS for free with the simply named Face Search, claiming to allow users to find...

Most Recent Industry Reports

Access Control Cabling Tutorial on Jan 15, 2019
Access Control is only as reliable as its cables. While this aspect lacks the sexiness of other components, it remains a vital part of every...
Gorilla Technology AI Provider, Raises $15 Million, Profiled on Jan 15, 2019
Gorilla Technology is a Taiwanese video analytics manufacturer that recently announced a $15 million investment from SBI Group, saying this...
2019 IP Networking Book Released on Jan 14, 2019
The new IP Networking Book 2019 is a 285 page in-depth guide that teaches you how IT and telecom technologies impact modern security...
Arecont Costar Layoffs on Jan 14, 2019
Arecont Vision, a Costar Company, has laid off more than 10% of their workforce in a move the company described to IPVM as a result of "important...
The False SCMP Story on Hikvision NYC AI on Jan 14, 2019
In the past week, one of Asia's largest publications, the South China Morning Post (SCMP), posted an article about "Chinese [facial recognition]...
WDR Tutorial on Jan 11, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Pelco Favorability Results 2019 on Jan 11, 2019
Pelco had a significant favorability problem amongst integrators in our previous study (see 2016 Pelco results). Now, in the first edition of our...
Bad: Dahua Villa Video Doorbell Tested on Jan 11, 2019
Doorbells are one of the hottest segments in the residential market but Dahua's Villa Video Doorbell is the worst we have tested.   We bought and...
Last Chance - Winter 2019 IP Networking Course on Jan 10, 2019
Today is the last day to register for the Winter 2019 IP Networking course. This is the only networking course designed specifically for video...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact