VMD Shootout II - Hikvision, Dahua, Samsung

Author: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports: 

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** *** ****. ******* ******* ** *** asked *** **** ************* ** ** ******. **** **** ******** 3 *** ************* - *****,************ *******, ******** ** *** ******** ****** **** *******: 

** ******** *** **** ******* ******** ** *** ***** **** series, starting **** * ****** ****** ********** ****:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ****** **** **** ***** ***** **** ********* ***** ************* a ******* **° ********** ***** ** **** **** *** ** the **** *** ******* **** *****,*********, *** *******. ** ********* **** *********** ******* **** ******** models *** **************** *** ***** ** **** ******, *** ** ****** *** be ******* **** *** ******* ** *** ************'* **** ******* similarly ** *** ****** ******.

**** ******* ** *********** *** ******** (********, ****, *****, ****) ******* ***** ****** ********* *.*, ***** ***** ************* ********* ** *******:

  • *****'* *********** *** ************* *** **** ** **** (******** ***), Bosch, *** **** ****** *** *** ** **** ***** *** false ********** *********. ** *****, ** ************ **** ******** *** and ****, ********* ***** ***** ** *** ***** ***-****, **** **** *** false ***********.
  • ********************* **** (******** ***), *****, *** **** ****** *** ***, at **' ***** **** *** ***** *********. ********* ***** ** night *** ****** **** *** **** ************* ** *** ******** test, ** **', ******* ******* ***** ******** ******.
  • *******'* ***** (~***' ********) *** ******* **** *** *******, ********* Avigilon (~***'), *** ******** *** *********, **** *** ***** ***********. At *****, ********* ***** *** ******** *** **** ****** (~**' vs. **' *** ********).
  • ******** ** **** *** *.*, *********** ****** ********* ** *** scene. *** ***** ************* ** **** **** ************ **** *** 2.1 ** *** *****, ***** ** ****** ******** ********** ** even ***** *****. ****** *** ***, ******* ************ *** *.* by ~**-**',************ ************* ***** ** ***** (~**-**'), ***** ***** *** ~**' shorter. **** *** *.*'* ***** ******** ********* **** *** ****** perfect, *******, ****** **** *** ****** ** **** ****.

***** *** ******** ******* ********** ****** *********** *** ******:

  • ****** *****'* ***** *** ** *** **** **** ***** *******, and ***** *********** **** *** ** *****, ** ***** ***** motion ********* ** ** *** ***** ********, **** ******. ** failed ** ******** ************ ** ***** ******* *** ***** *** settings ********* *********. 
  • *** ******* ***-**** *** *** **** ********* ***** ** **** test, **** ******* *** ***, ** **** ***** *** ****. However, ** *** **** ***** ** ***** *********** ********, **** shadows *** ******* *** ******, ** ******** **** ** *** open ****** **** *****.
  • *********'* *********** *** **** **** ** ******* ** ******** ******, ** all ***** ****** ******. ********, ********* ***** *** ******* **** Samsung, ****** ****** **** *****. ***** *********** **** ********, **** the ********* ** ******* ****** ** *** *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, ***** *** *** *************** ** *** to **** ******** **** ******:

  • ********* ******* ****** *** *********** * (*******) ** *. ***** ****, valid ****** *** ********** ******, ***** ***** *********** ******** *********** above *. 
  • ** ********* ******* *****'* ******* *********** ** **, **** * ********* of *-*. ********** *********** ***** **** ******* ** ******** ***** ************. ** **** ******, ***** ******** ***** ** ***** *** area, ******* ** * ****** ***** **** ********* ******, *** we *** *** **** ********** ******** ** ** **** **** is **********. 
  • *** *******, ** ***** **** ******* *** *********** ** *** default "******" ******* *** *** **** ***** ** **** ********** to ***** ******, *** ******** ** ******* *********** **** ****** directly ****** ********* ***** ** ******** *** ********** ** ***** ******.  

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

***** *******

********* **-*********


 

******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* ***-**** ** *** **** ****** ** detect *** *******, ****** ** *** ******* ********* ***** ** all *** ******* ******.

** ~**', *** ********* **-********* ****** ** ****** *** ******* ************.

*******, ** ~**', *** ***** ******* ** **** ** ****** our *******.

********* ********* *****

*** ** *** ******* ****** *** * ********* ** ********* range, **** *** ***** ***** **** ~**' ** *** ******* ** ~**' ** *****, ********* ***** **** ~**' ** ~**', *** ******* ***** ****** *** furthest ********* ***** ** *****, *** ******** **** ~***' ** the *** ** ~**' ****** *****.

Indoor ********** ****

** *** ********** **** ** **** *****, *** ******* **** able ** ******** ****** * ***** ******* ** *** ****** up ** **'.

** *** ***** (~***), *******'* *** *** *** **** ****** tested ** ******** ****** *** ******* ** *** ****** ** to **' ** *** ********** **** *****. *** ********* ******* *** ** **% ******** ****** **** *** ******* ** ~20', *** ***% ********* **** *** ******* *** ~**' ** closer. ***** ******* ********* ****** ** **** *****, ******** **% detection **** *** ******* ~**' ****, *** ******** ***% ********* accuracy **** *** ******* ~**' **** *** ******.

*** ********* ******* *** * **% *****-***** **** **** * ****** ****** in *** *****, ***** *** ******* ***-**** *** * **% false-alarm ****. **** ***** ******* *** *** *******.

**** ** ***** * ********** ******* *** ****, *** ***** HF3101N *** * **% *****-***** ****, ***** *** ********* *** ******* ******* **** **********.

******* *** **** ******* *** ***** ** *** ***** *** ******* a ***** ***** *************** **% *** ******* **%. ***** ******** **********.

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, *** *** ******* ~** **** *** *******, **** ***** performance ** ********* *** ******* *** *******, **** ******* ********* *** ******* ** soon ** ** **** ****** *** ******, *** *** ********* ************ ** *** **** ******* ~**% ** *** ****. **** the ***** *** *** ******** ******* ***** *** ******** ****** our ******* **** **** ********.

*******, **** *** ******* ****** ** **** **** *** *****, all ******* *** **** ** ****** *** *******, **** ********* accuracy *** ****** ** ****** ** *** *******.

** *** **** ***** ** *** *****, *** ********* *** ******* ******* ****** ***** ******* ********* ***** ** * full ***** *****, *** ***** ** ****** ** ****** *** subject.

*** ******* ***-**** *** * **** ********* ** ********* ****** provided ** * ******** ***. ***** **** ******* ** ****** every ****. *** ********* *** ***** ******* *** *** **** ***** ****** **** *** flashing ***.

Test **********

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ***** *******: *.***.******* **.*.*
  • ********* **-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Panoramic Fisheye Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Oncam And Vivotek on Jun 27, 2018
IPVM tested Avigilon, Axis, Dahua, Hanwha, Hikvision, Oncam And Vivotek 12MP panoramic fisheye cameras head to head, as shown in the test setup...
Hikvision 12MP Fisheye Camera Tested (DS-2CD63C2F-IV) on Jun 14, 2018
Hikvision's DS-2CD63C2F-IV is their flagship panoramic camera, with a 12MP imager, 15m integrated IR, smart codec, and more. We tested the 63C2 in...
Introducing Effective PPF (ePPF) - Improving Video Surveillance Designs on Jun 11, 2018
Pixel density (PPF / PPM) is the best metric the industry has to define and project video quality. It allows simple communication of estimated...
Hanwha Low-Cost 4MP Camera Tested (QNV-7010R) on Jun 11, 2018
4MP usage is increasing noticeably, as IPVM 2018 resolution statistics show. And low-cost, fixed focal cameras, are popular for budget...
Hikvision PanoVu 20MP Flexible Camera Tested on Jun 01, 2018
Hikvision has released their first repositionable multi imager cameras with integrated IR included, atypical in competitors. We bought and tested...
Stats: Upgrading Cameras Far More Common Than Replacing Failed Cameras on May 30, 2018
The old saying "If It Ain't Broke, Don't Fix It" does not apply here. New IPVM statistics show that 60% of cameras that are replaced still work but...
Oncam 12MP Fisheye Camera Tested on May 29, 2018
Oncam has made their name since the early 2000s as a fisheye specialist, focusing only on panoramic cameras. To see how this specialist stacks up...
Dahua 12MP Fisheye Camera Tested (NK8BR4) on May 16, 2018
Continuing our coverage of 12MP sensor fisheye cameras, we bought and tested the Dahua NK8BR4, examining: Default vs. Optimized...
Vivotek 12MP Fisheye Camera Tested (FE9391-EV) on May 08, 2018
Next in our 12MP fisheye camera evaluation, we bought and tested Vivotek's latest generation FE9391-EV, a new model claiming improved smart IR...
Last Chance - May 2018 Camera Course on May 03, 2018
This is the last chance to register as the course starts next week. This is the only independent surveillance camera course, based on in-depth...

Most Recent Industry Reports

Directory of Video Surveillance Startups on Jul 18, 2018
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known entity...
Ladder Lockdown and Ladder Levelizer Tested on Jul 18, 2018
Ladders are a daily necessity for surveillance and security installers, but working on an unstable surface can be extremely dangerous. In addition...
FST Fails on Jul 17, 2018
FST was one of the hottest startups of the decade, selected as the best new product at ISC West 2011 and backed with tens of millions in...
Axis ~$100 Camera Tested on Jul 17, 2018
Axis has released their lowest cost camera ever, the Companion Eye Mini L, setting their sights on a market dominated by Hikvision and Dahua. Can...
Amazon Ring Alarm System Tested on Jul 16, 2018
Amazon Ring is going to hurt traditional dealers, and especially ADT, new IPVM test results of Ring's Alarm system underscore. IPVM found that...
Hikvision Wins Chinese Government Forced Facial Recognition Project Across 967 Mosques on Jul 16, 2018
Hikvision has won a Chinese government tender which requires that facial recognition cameras be set up at the entrance of every single mosque...
Installing Dome Cameras Indoors Guide on Jul 16, 2018
IPVM is producing the definitive series on installing surveillance cameras. This entry covers one of the most common scenarios - installing dome...
Security Sales Course Summer 2018 on Jul 13, 2018
Based on member's interest, IPVM is offering a security sales course this summer. Register Now - IPVM Security Sales Course Summer 2018 This...
US Tariffs Hit China Video Surveillance on Jul 13, 2018
Chinese video surveillance products avoided tariffs for the first two rounds. Now, in the third round, many video surveillance products will be...
Last Chance - July 2018 IP Networking Course on Jul 12, 2018
Registration ends today, Thursday. Register now. This is the only networking course designed specifically for video surveillance...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact