VMD Shootout II - Hikvision, Dahua, Samsung

Author: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports: 

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** *** ****. ******* ******* ** *** asked *** **** ************* ** ** ******. **** **** ******** 3 *** ************* - *****,************ *******, ******** ** *** ******** ****** **** *******: 

** ******** *** **** ******* ******** ** *** ***** **** series, starting **** * ****** ****** ********** ****:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ****** **** **** ***** ***** **** ********* ***** ************* a ******* **° ********** ***** ** **** **** *** ** the **** *** ******* **** *****,*********, *** *******. ** ********* **** *********** ******* **** ******** models *** **************** *** ***** ** **** ******, *** ** ****** *** be ******* **** *** ******* ** *** ************'* **** ******* similarly ** *** ****** ******.

**** ******* ** *********** *** ******** (********, ****, *****, ****) ******* ***** ****** ********* *.*, ***** ***** ************* ********* ** *******:

  • *****'* *********** *** ************* *** **** ** **** (******** ***), Bosch, *** **** ****** *** *** ** **** ***** *** false ********** *********. ** *****, ** ************ **** ******** *** and ****, ********* ***** ***** ** *** ***** ***-****, **** **** *** false ***********.
  • ********************* **** (******** ***), *****, *** **** ****** *** ***, at **' ***** **** *** ***** *********. ********* ***** ** night *** ****** **** *** **** ************* ** *** ******** test, ** **', ******* ******* ***** ******** ******.
  • *******'* ***** (~***' ********) *** ******* **** *** *******, ********* Avigilon (~***'), *** ******** *** *********, **** *** ***** ***********. At *****, ********* ***** *** ******** *** **** ****** (~**' vs. **' *** ********).
  • ******** ** **** *** *.*, *********** ****** ********* ** *** scene. *** ***** ************* ** **** **** ************ **** *** 2.1 ** *** *****, ***** ** ****** ******** ********** ** even ***** *****. ****** *** ***, ******* ************ *** *.* by ~**-**',************ ************* ***** ** ***** (~**-**'), ***** ***** *** ~**' shorter. **** *** *.*'* ***** ******** ********* **** *** ****** perfect, *******, ****** **** *** ****** ** **** ****.

***** *** ******** ******* ********** ****** *********** *** ******:

  • ****** *****'* ***** *** ** *** **** **** ***** *******, and ***** *********** **** *** ** *****, ** ***** ***** motion ********* ** ** *** ***** ********, **** ******. ** failed ** ******** ************ ** ***** ******* *** ***** *** settings ********* *********. 
  • *** ******* ***-**** *** *** **** ********* ***** ** **** test, **** ******* *** ***, ** **** ***** *** ****. However, ** *** **** ***** ** ***** *********** ********, **** shadows *** ******* *** ******, ** ******** **** ** *** open ****** **** *****.
  • *********'* *********** *** **** **** ** ******* ** ******** ******, ** all ***** ****** ******. ********, ********* ***** *** ******* **** Samsung, ****** ****** **** *****. ***** *********** **** ********, **** the ********* ** ******* ****** ** *** *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, ***** *** *** *************** ** *** to **** ******** **** ******:

  • ********* ******* ****** *** *********** * (*******) ** *. ***** ****, valid ****** *** ********** ******, ***** ***** *********** ******** *********** above *. 
  • ** ********* ******* *****'* ******* *********** ** **, **** * ********* of *-*. ********** *********** ***** **** ******* ** ******** ***** ************. ** **** ******, ***** ******** ***** ** ***** *** area, ******* ** * ****** ***** **** ********* ******, *** we *** *** **** ********** ******** ** ** **** **** is **********. 
  • *** *******, ** ***** **** ******* *** *********** ** *** default "******" ******* *** *** **** ***** ** **** ********** to ***** ******, *** ******** ** ******* *********** **** ****** directly ****** ********* ***** ** ******** *** ********** ** ***** ******.  

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

***** *******

********* **-*********


 

******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* ***-**** ** *** **** ****** ** detect *** *******, ****** ** *** ******* ********* ***** ** all *** ******* ******.

** ~**', *** ********* **-********* ****** ** ****** *** ******* ************.

*******, ** ~**', *** ***** ******* ** **** ** ****** our *******.

********* ********* *****

*** ** *** ******* ****** *** * ********* ** ********* range, **** *** ***** ***** **** ~**' ** *** ******* ** ~**' ** *****, ********* ***** **** ~**' ** ~**', *** ******* ***** ****** *** furthest ********* ***** ** *****, *** ******** **** ~***' ** the *** ** ~**' ****** *****.

Indoor ********** ****

** *** ********** **** ** **** *****, *** ******* **** able ** ******** ****** * ***** ******* ** *** ****** up ** **'.

** *** ***** (~***), *******'* *** *** *** **** ****** tested ** ******** ****** *** ******* ** *** ****** ** to **' ** *** ********** **** *****. *** ********* ******* *** ** **% ******** ****** **** *** ******* ** ~20', *** ***% ********* **** *** ******* *** ~**' ** closer. ***** ******* ********* ****** ** **** *****, ******** **% detection **** *** ******* ~**' ****, *** ******** ***% ********* accuracy **** *** ******* ~**' **** *** ******.

*** ********* ******* *** * **% *****-***** **** **** * ****** ****** in *** *****, ***** *** ******* ***-**** *** * **% false-alarm ****. **** ***** ******* *** *** *******.

**** ** ***** * ********** ******* *** ****, *** ***** HF3101N *** * **% *****-***** ****, ***** *** ********* *** ******* ******* **** **********.

******* *** **** ******* *** ***** ** *** ***** *** ******* a ***** ***** *************** **% *** ******* **%. ***** ******** **********.

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, *** *** ******* ~** **** *** *******, **** ***** performance ** ********* *** ******* *** *******, **** ******* ********* *** ******* ** soon ** ** **** ****** *** ******, *** *** ********* ************ ** *** **** ******* ~**% ** *** ****. **** the ***** *** *** ******** ******* ***** *** ******** ****** our ******* **** **** ********.

*******, **** *** ******* ****** ** **** **** *** *****, all ******* *** **** ** ****** *** *******, **** ********* accuracy *** ****** ** ****** ** *** *******.

** *** **** ***** ** *** *****, *** ********* *** ******* ******* ****** ***** ******* ********* ***** ** * full ***** *****, *** ***** ** ****** ** ****** *** subject.

*** ******* ***-**** *** * **** ********* ** ********* ****** provided ** * ******** ***. ***** **** ******* ** ****** every ****. *** ********* *** ***** ******* *** *** **** ***** ****** **** *** flashing ***.

Test **********

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ***** *******: *.***.******* **.*.*
  • ********* **-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
October 2018 Camera Course on Sep 13, 2018
Today is the last day to save $50 on the October 2018 Camera Course, register now. This is the only independent surveillance camera course,...
Axis First IR PTZ Tested (Q6125-LE) on Aug 21, 2018
Axis is very late in releasing IR PTZs. While competitors such as Hikvision and Dahua have offered them for years, Axis has just released their...
Hikvision PanoVu Mini Tested (Multi-imager + PTZ For ~$500) on Aug 07, 2018
Hikvision has released their first PanoVu Mini multi imager, the PanoVu DS-2PT3326IZ-DE3, with four 1080p imagers, including a PTZ and integrated...
Panasonic 9MP Panoramic Fisheye Tested (WV-X4571L) on Aug 02, 2018
Panasonic has released their latest fisheye camera, the WV-X4571L, with 12MP sensor and 9MP resolution, claiming "extreme image quality" under...
Panoramic Fisheye Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Oncam And Vivotek on Jun 27, 2018
IPVM tested Avigilon, Axis, Dahua, Hanwha, Hikvision, Oncam And Vivotek 12MP panoramic fisheye cameras head to head, as shown in the test setup...
Hikvision 12MP Fisheye Camera Tested (DS-2CD63C2F-IV) on Jun 14, 2018
Hikvision's DS-2CD63C2F-IV is their flagship panoramic camera, with a 12MP imager, 15m integrated IR, smart codec, and more. We tested the 63C2 in...
Introducing Effective PPF (ePPF) - Improving Video Surveillance Designs on Jun 11, 2018
Pixel density (PPF / PPM) is the best metric the industry has to define and project video quality. It allows simple communication of estimated...
Hanwha Low-Cost 4MP Camera Tested (QNV-7010R) on Jun 11, 2018
4MP usage is increasing noticeably, as IPVM 2018 resolution statistics show. And low-cost, fixed focal cameras, are popular for budget...
Hikvision PanoVu 20MP Flexible Camera Tested on Jun 01, 2018
Hikvision has released their first repositionable multi imager cameras with integrated IR included, atypical in competitors. We bought and tested...

Most Recent Industry Reports

Ladders For Installers Guide on Sep 25, 2018
Ladders are one of the most important pieces of worksite equipment for the surveillance technician. Too often, however, even highly experienced...
Favorite Access Control Reader Manufacturer 2018 on Sep 25, 2018
Favorite reader votes are in, and it is not close. A global access giant ran away with the votes in a one-sided contest. But for many, the...
Genetec Takes Aim At 'Untrustworthy' 'Foreign Government-Owned Vendors' on Sep 24, 2018
Genetec is taking aim at 'untrustworthy' 'foreign government-owned vendors'. This is not a new theme for Genetec as nearly 2 years ago, Genetec...
4MP Camera Shootout - Axis, Dahua, DW, Hanwha, Hikvision, Uniview, Vivotek on Sep 24, 2018
4MP usage continues to climb, especially for low cost fixed lens models. To see who was best, we bought and tested seven 4MP models from Axis,...
Alexa Guard Expands Amazon's Security Offerings, Boosts ADT's Stock on Sep 21, 2018
Amazon is expanding their security offerings yet again, this time with Alexa Guard that delivers security audio analytics and a virtual "Fake...
UTC, Owner of Lenel, Acquires S2 on Sep 20, 2018
UTC now owns two of the biggest access control providers, one of integrator's most hated access control platforms, Lenel, and one of their...
BluePoint Aims To Bring Life-Safety Mind-Set To Police Pull Stations on Sep 20, 2018
Fire alarm pull stations are commonplace but police ones are not. A self-funded startup, BluePoint Alert Solutions is aiming to make police pull...
SIA Plays Dumb On OEMs And Hikua Ban on Sep 20, 2018
OEMs widely pretend to be 'manufacturers', deceiving their customers and putting them at risk for cybersecurity attacks and, soon, violation of US...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact