VMD Shootout II - Hikvision, Dahua, Samsung

Author: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports:

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** *** ****. ******* ******* ** *** asked *** **** ************* ** ** ******. **** **** ******** 3 *** ************* - *****,************ *******, ******** ** *** ******** ****** **** *******:

** ******** *** **** ******* ******** ** *** ***** **** series, ******** **** * ****** ****** ********** ****:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ****** **** **** ***** ***** **** ********* ***** ************* a ******* **° ********** ***** ** **** **** *** ** the **** *** ******* **** *****,*********, *** *******. ** ********* **** *********** ******* **** ******** models *** **************** *** ***** ** **** ******, *** ** ****** *** be ******* **** *** ******* ** *** ************'* **** ******* similarly ** *** ****** ******.

**** ******* ** *********** *** ********(********, ****, *****, ****) ******* ***** ****** ********* *.*, ***** ***** ************* ********* ** *******:

  • *****'* *********** *** ************* *** **** ** **** (******** ***), Bosch, *** **** ****** *** *** ** **** ***** *** false ********** *********. ** *****, ** ************ **** ******** *** and ****, ********* ***** ***** ** *** ***** ***-****, **** **** *** false ***********.
  • ********************* **** (******** ***), *****, *** **** ****** *** ***, at **' ***** **** *** ***** *********. ********* ***** ** night *** ****** **** *** **** ************* ** *** ******** test, ** **', ******* ******* ***** ******** ******.
  • *******'* ***** (~***' ********) *** ******* **** *** *******, ********* Avigilon (~***'), *** ******** *** *********, **** *** ***** ***********. At *****, ********* ***** *** ******** *** **** ****** (~**' vs. **' *** ********).
  • ******** ** **** *** *.*, *********** ****** ********* ** *** scene. *** ***** ************* ** **** **** ************ **** *** 2.1 ** *** *****, ***** ** ****** ******** ********** ** even ***** *****. ****** *** ***, ******* ************ *** *.* by ~**-**',************ ************* ***** ** ***** (~**-**'), ***** ***** *** ~**' shorter. **** *** *.*'* ***** ******** ********* **** *** ****** perfect, *******, ****** **** *** ****** ** **** ****.

***** *** ******** ******* ********** ****** *********** *** ******:

  • ****** *****'* ***** *** ** *** **** **** ***** *******, and ***** *********** **** *** ** *****, ** ***** ***** motion ********* ** ** *** ***** ********, **** ******. ** failed ** ******** ************ ** ***** ******* *** ***** *** settings ********* *********.
  • *** ******* ***-**** *** *** **** ********* ***** ** **** test, **** ******* *** ***, ** **** ***** *** ****. However, ** *** **** ***** ** ***** *********** ********, **** shadows *** ******* *** ******, ** ******** **** ** *** open ****** **** *****.
  • *********'************ *** **** **** ** ******* ** ******** ******, ** all ***** ****** ******. ********, ********* ***** *** ******* **** Samsung, ****** ****** **** *****. ***** *********** **** ********, **** the ********* ** ******* ****** ** *** *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, ***** *** *** *************** ** *** to **** ******** **** ******:

  • **************** ****** *** *********** * (*******) ** *. ***** ****, valid ****** *** ********** ******, ***** ***** *********** ******** *********** above *.
  • ** ********* ******* *****'* ******* *********** ** **, **** * threshold ** *-*. ********** *********** ***** **** ******* ** ******** false************. ** **** ******, ***** ******** ***** ** ***** *** area, ******* ** * ****** ***** **** ********* ******, *** we *** *** **** ********** ******** ** ** **** **** is **********.
  • *** *******, ** ***** **** ******* *** *********** ** *** default "******" ******* *** *** **** ***** ** **** ********** to ***** ******, *** ******** ** ******* *********** **** ****** directly ****** ********* ***** ** ******** *************** ***** ******.

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

***** *******

***********-*********


******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* ***-**** ** *** **** ****** ** detect *** *******, ****** ** *** ******* ********* ***** ** all *** ******* ******.

** ~**', **************-********* ****** ** ****** *** ******* ************.

*******, ** ~**', *** ***** ******* ** **** ** ****** our *******.

********* ********* *****

*** ** *** ******* ****** *** * ********* ** ********* range, **** *** ********** **** ~**' ** *** ******* ** ~**' ** *****,************** **** ~**' ** ~**', *** ******* ***** ****** *** furthest ********* ***** ** *****, *** ******** **** ~***' ** the *** ** ~**' ***********.

Indoor ********** ****

** *** ********** **** ** **** *****, *** ******* **** able ** ******** ****** * ***** ******* ** *** ****** up ** **'.

** *** ***** (~***), *******'* *** *** *** **** ****** tested ** ******** ****** *** ******* ** *** ****** ** to **' ** *** ********** **** *****. ******************* *** ** **% ******** ****** **** *** ******* ** ~20', *** ***% ********* **** *** ******* *** ~**' ** closer. ***** ******* ********* ****** ** **** *****, ******** **% detection **** *** ******* ~**' ****, *** ******** ***% ********* accuracy **** *** ******* ~**' **** *** ******.

******************* *** * **% *****-***** **** **** * ****** ****** in *** *****, ***** *** ******* ***-**** *** * **% false-alarm ****. **** ***** ******* *** *** *******.

**** ** ***** * ********** ******* *** ****, *** ***** HF3101N *** * **% *****-***** ****, ***** *************** ******* ******* **** **********.

******* *** **** ******* *** ***** ** *** ***** *** created * ***** ***** *****************% *** ******* **%. ***** ******** **********.

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, *** *** ******* ~** **** *** *******, **** ***** performance ************** ******* *** *******, **** ******* ********* *** ******* ** soon ** ** **** ****** *** ******, *** ************ ************ ** *** **** ******* ~**% ** *** ****. **** the ***** *** *** ******** ******* ***** *** ******** ****** our ******* **** **** ********.

*******, **** *** ******* ****** ** **** **** *** *****, all ******* *** **** ** ****** *** *******, **** ********* accuracy *** ****** ** ****** ** *** *******.

** *** **** ***** ** *** *****, *************** ******* ******* ****** ***** ******* ********* ***** ** * full ***** *****, *** ***** ** ****** ** ****** *** subject.

*** ******* ***-**** *** * **** ********* ** ********* ****** provided ** * ******** ***. ***** **** ******* ** ****** every ****. *************** ***** ******* *** *** **** ***** ****** **** *** flashing ***.

Test **********

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ***** *******: *.***.******* **.*.*
  • ***********-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Covert IP Camera Shootout - Axis, Hanwha, Hikvision, March, Vivotek on Mar 20, 2019
Covert cameras were one of the last holdout areas for analog cameras. However, in the past few years, IP / HD covert cameras have become...
Axis IR Multi Imager Camera Tested (P3717-PLE) on Feb 18, 2019
Axis has released their first IR multi imager, the P3717-PLE, a repositionable model listing 360° IR illumination and flexible positioning,...
Hanwha Smaller Multi Imager Tested (PNM-9000VQ) on Feb 14, 2019
Hanwha's first repositionable multi imager PNM-9081VQ tested well, but was huge, over 12" wide and weighing in at over 10 pounds. Now, they have...
Bandwidth vs Low Light Shootout - Avigilon, Axis, Bosch, Dahua, Geovision, Hanwha, Hikvision, Uniview, Vivotek on Feb 08, 2019
Nighttime bandwidth spikes are a major concern in video surveillance, but do all manufacturers' cameras perform the same? Are some more consistent...
Sony Favorability Results 2019 on Feb 06, 2019
Sony Favorability amongst integrators improved moderately compared to their 2017 favorability results, with a modest net positive...
Camera Course Winter 2019 - Last Chance on Jan 24, 2019
This is the last chance to register for the Winter 2019 Camera Course. This is the only independent surveillance camera course, based on in-depth...
Testing Bandwidth Vs. Low Light on Jan 16, 2019
Nighttime bandwidth spikes are a major concern in video surveillance. Many calculate bandwidth as a single 24/7 number, but bit rates vary...
WDR Tutorial on Jan 11, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Worst Products Tested In Past Year on Jan 09, 2019
IPVM has done over 100 tests in the past year. But which products performed the worst? Which ones should users be most aware of? In this report,...
2019 Video Surveillance Cameras Overview on Jan 07, 2019
Each year, IPVM summarizes the main advances and changes for video surveillance cameras, based on our industry-leading testing and...

Most Recent Industry Reports

Silicon Valley Cybersecurity Insurance Startup Coalition Profile on Mar 20, 2019
Many industry people believe cybersecurity insurance is not worth it, as the voting and debate in our Cybersecurity Insurance For Security...
Covert IP Camera Shootout - Axis, Hanwha, Hikvision, March, Vivotek on Mar 20, 2019
Covert cameras were one of the last holdout areas for analog cameras. However, in the past few years, IP / HD covert cameras have become...
Top Metrics For Ensuring Integrator Profitability - Statistics on Mar 20, 2019
How do integrators ensure the profitability of their projects? As part of our profitability study, 100+ integrators answered the following...
Avigilon Launches 'Renewed Products Program' on Mar 19, 2019
There are lots of 'pre-owned' cars but pre-owned IP cameras? While such programs are common in other industries, in video surveillance, they are...
Hanwha Tax Evasion Probe, Camera Division Implicated on Mar 19, 2019
A Hanwha group subsidiary was raided as part of a tax evasion probe. While a Korean news media report listed the raided entity as 'Hanwha...
Genetec Security Center 5.8 Tested on Mar 19, 2019
Genetec has released Version 5.8. This comes after a wait of more than a year that caused frustrations for many Genetec partners. Our previous...
Retired Mercury President Returns As Open Options President on Mar 18, 2019
Open Options experienced major changes in 2018, including being acquired by ACRE and losing its President and General Manager, John Berman who...
Large US University End-User Video Surveillance Interview on Mar 18, 2019
Schools have become targets in modern days of active shooters and terrorist fears. The need for video and access security is high. Universities...
Hikvision Favorability Results 2019 on Mar 18, 2019
Hikvision favorability results declined significantly in IPVM's 2019 study of 200+ integrators. While in 2017 Hikvision's favorability was...
ONVIF Favorability Results 2019 on Mar 15, 2019
In the past decade, ONVIF has grown from a reaction to the outside Cisco-lead PSIA challenge, to being the de facto video surveillance standard...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact