VMD Shootout II - Hikvision, Dahua, Samsung

Author: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports: 

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** *** ****. ******* ******* ** *** asked *** **** ************* ** ** ******. **** **** ******** 3 *** ************* - *****,************ *******, ******** ** *** ******** ****** **** *******: 

** ******** *** **** ******* ******** ** *** ***** **** series, starting **** * ****** ****** ********** ****:

****** ** ** * **** ******* **** ****** ****:

*** *******, ** ******* **** **** ****** ********** *** ********** on * ****** ****:

*** ***** ****** ** ****** *** ********* *** *********:

  • **** ****** **** ******** ***** ***** *********?
  • ***** *** *** **** ** ********* ***** ******?
  • *** *** ********* ***** **** **** ************ ** ************?
  • *** ******** ** ********* *** ****** ********* ******* ********** ***** alerts *** **** *****?

[***************]

Key ********

***** ****** **** **** ***** ***** **** ********* ***** ************* a ******* **° ********** ***** ** **** **** *** ** the **** *** ******* **** *****,*********, *** *******. ** ********* **** *********** ******* **** ******** models *** **************** *** ***** ** **** ******, *** ** ****** *** be ******* **** *** ******* ** *** ************'* **** ******* similarly ** *** ****** ******.

**** ******* ** *********** *** ******** (********, ****, *****, ****) ******* ***** ****** ********* *.*, ***** ***** ************* ********* ** *******:

  • *****'* *********** *** ************* *** **** ** **** (******** ***), Bosch, *** **** ****** *** *** ** **** ***** *** false ********** *********. ** *****, ** ************ **** ******** *** and ****, ********* ***** ***** ** *** ***** ***-****, **** **** *** false ***********.
  • ********************* **** (******** ***), *****, *** **** ****** *** ***, at **' ***** **** *** ***** *********. ********* ***** ** night *** ****** **** *** **** ************* ** *** ******** test, ** **', ******* ******* ***** ******** ******.
  • *******'* ***** (~***' ********) *** ******* **** *** *******, ********* Avigilon (~***'), *** ******** *** *********, **** *** ***** ***********. At *****, ********* ***** *** ******** *** **** ****** (~**' vs. **' *** ********).
  • ******** ** **** *** *.*, *********** ****** ********* ** *** scene. *** ***** ************* ** **** **** ************ **** *** 2.1 ** *** *****, ***** ** ****** ******** ********** ** even ***** *****. ****** *** ***, ******* ************ *** *.* by ~**-**',************ ************* ***** ** ***** (~**-**'), ***** ***** *** ~**' shorter. **** *** *.*'* ***** ******** ********* **** *** ****** perfect, *******, ****** **** *** ****** ** **** ****.

***** *** ******** ******* ********** ****** *********** *** ******:

  • ****** *****'* ***** *** ** *** **** **** ***** *******, and ***** *********** **** *** ** *****, ** ***** ***** motion ********* ** ** *** ***** ********, **** ******. ** failed ** ******** ************ ** ***** ******* *** ***** *** settings ********* *********. 
  • *** ******* ***-**** *** *** **** ********* ***** ** **** test, **** ******* *** ***, ** **** ***** *** ****. However, ** *** **** ***** ** ***** *********** ********, **** shadows *** ******* *** ******, ** ******** **** ** *** open ****** **** *****.
  • *********'* *********** *** **** **** ** ******* ** ******** ******, ** all ***** ****** ******. ********, ********* ***** *** ******* **** Samsung, ****** ****** **** *****. ***** *********** **** ********, **** the ********* ** ******* ****** ** *** *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, ***** *** *** *************** ** *** to **** ******** **** ******:

  • ********* ******* ****** *** *********** * (*******) ** *. ***** ****, valid ****** *** ********** ******, ***** ***** *********** ******** *********** above *. 
  • ** ********* ******* *****'* ******* *********** ** **, **** * ********* of *-*. ********** *********** ***** **** ******* ** ******** ***** ************. ** **** ******, ***** ******** ***** ** ***** *** area, ******* ** * ****** ***** **** ********* ******, *** we *** *** **** ********** ******** ** ** **** **** is **********. 
  • *** *******, ** ***** **** ******* *** *********** ** *** default "******" ******* *** *** **** ***** ** **** ********** to ***** ******, *** ******** ** ******* *********** **** ****** directly ****** ********* ***** ** ******** *** ********** ** ***** ******.  

*************

*** ********* ****** ****** ************* ** **** ************'* ***.

***** *******

********* **-*********


 

******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* ***-**** ** *** **** ****** ** detect *** *******, ****** ** *** ******* ********* ***** ** all *** ******* ******.

** ~**', *** ********* **-********* ****** ** ****** *** ******* ************.

*******, ** ~**', *** ***** ******* ** **** ** ****** our *******.

********* ********* *****

*** ** *** ******* ****** *** * ********* ** ********* range, **** *** ***** ***** **** ~**' ** *** ******* ** ~**' ** *****, ********* ***** **** ~**' ** ~**', *** ******* ***** ****** *** furthest ********* ***** ** *****, *** ******** **** ~***' ** the *** ** ~**' ****** *****.

Indoor ********** ****

** *** ********** **** ** **** *****, *** ******* **** able ** ******** ****** * ***** ******* ** *** ****** up ** **'.

** *** ***** (~***), *******'* *** *** *** **** ****** tested ** ******** ****** *** ******* ** *** ****** ** to **' ** *** ********** **** *****. *** ********* ******* *** ** **% ******** ****** **** *** ******* ** ~20', *** ***% ********* **** *** ******* *** ~**' ** closer. ***** ******* ********* ****** ** **** *****, ******** **% detection **** *** ******* ~**' ****, *** ******** ***% ********* accuracy **** *** ******* ~**' **** *** ******.

*** ********* ******* *** * **% *****-***** **** **** * ****** ****** in *** *****, ***** *** ******* ***-**** *** * **% false-alarm ****. **** ***** ******* *** *** *******.

**** ** ***** * ********** ******* *** ****, *** ***** HF3101N *** * **% *****-***** ****, ***** *** ********* *** ******* ******* **** **********.

******* *** **** ******* *** ***** ** *** ***** *** ******* a ***** ***** *************** **% *** ******* **%. ***** ******** **********.

Open ******

****** *** ******* ** ** **** ****** *****, ***** **' long, *** *** ******* ~** **** *** *******, **** ***** performance ** ********* *** ******* *** *******, **** ******* ********* *** ******* ** soon ** ** **** ****** *** ******, *** *** ********* ************ ** *** **** ******* ~**% ** *** ****. **** the ***** *** *** ******** ******* ***** *** ******** ****** our ******* **** **** ********.

*******, **** *** ******* ****** ** **** **** *** *****, all ******* *** **** ** ****** *** *******, **** ********* accuracy *** ****** ** ****** ** *** *******.

** *** **** ***** ** *** *****, *** ********* *** ******* ******* ****** ***** ******* ********* ***** ** * full ***** *****, *** ***** ** ****** ** ****** *** subject.

*** ******* ***-**** *** * **** ********* ** ********* ****** provided ** * ******** ***. ***** **** ******* ** ****** every ****. *** ********* *** ***** ******* *** *** **** ***** ****** **** *** flashing ***.

Test **********

*** ********* ******* *** ******** ******** **** **** ** *** test:

  • ***** *******: *.***.******* **.*.*
  • ********* **-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Genetec Privacy Protector Tested on Nov 12, 2018
Genetec has built Kiwi Security's Privacy Protector into Security Center, an analytic which anonymizes individuals in cameras' fields of view...
Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Axxon Face Search Tested on Oct 26, 2018
AxxonSoft has brought facial recognition to their Axxon Next VMS for free with the simply named Face Search, claiming to allow users to find...
Hanwha Dual Imager Dome Camera Tested (PNM-7000VD) on Oct 18, 2018
Hanwha has introduced their first dual-imager model, the PNM-7000VD, a twin 1080p model featuring independently positionable sensors and a snap-in...
Dahua Face Recognition Camera Tested on Oct 15, 2018
Dahua has been one of the industry's most vocal proponents of the value that AI creates: As part of this, Dahua has released a facial...
Last Chance - October 2018 Camera Course on Oct 04, 2018
Today is the last day to register for the October 2018 Camera Course, register now. This is the only independent surveillance camera course,...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Axis First IR PTZ Tested (Q6125-LE) on Aug 21, 2018
Axis is very late in releasing IR PTZs. While competitors such as Hikvision and Dahua have offered them for years, Axis has just released their...
Hikvision PanoVu Mini Tested (Multi-imager + PTZ For ~$500) on Aug 07, 2018
Hikvision has released their first PanoVu Mini multi imager, the PanoVu DS-2PT3326IZ-DE3, with four 1080p imagers, including a PTZ and integrated...
Panasonic 9MP Panoramic Fisheye Tested (WV-X4571L) on Aug 02, 2018
Panasonic has released their latest fisheye camera, the WV-X4571L, with 12MP sensor and 9MP resolution, claiming "extreme image quality" under...

Most Recent Industry Reports

'Sticker' Surveillance Camera Developed (CSEM Witness) on Nov 16, 2018
The Swiss Center for Electronics and Microtechnology (CSEM) has announced what it calls the: world’s first fully autonomous camera that can be...
ISC East 2018 Mini-Show Final Report on Nov 16, 2018
This is our second (updated) and final show report from ISC East. ISC East, by its own admission, is not a national or international show, billed...
Facial Detection Tested on Nov 16, 2018
Facial detection and recognition are increasingly offered by video surveillance manufacturers. Facial detection detects faces in an image/video...
Throughtek P2P/Cloud Solution Profile on Nov 15, 2018
Many IoT manufacturers either do not have the capabilities or the interest to develop their own cloud management software for their devices....
ASIS Offering Custom Research For Manufacturers on Nov 15, 2018
Manufacturers often want to know what industry people think about trends and, in particular, the segments and product they offer.  ASIS and its...
Hikvision Silent on "Bad Architectural Practices" Cybersecurity Report on Nov 14, 2018
A 'significant vulnerability was found in Hikvision cameras' by VDOO, a startup cybersecurity specialist. Hikvision has fixed the specific...
French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...
Integrator Credit Card Alternative Divvy on Nov 13, 2018
Most security integrators are small businesses but large enough that they have various employees that need to be able to expense various charges as...
Directory of Video Intercoms on Nov 13, 2018
Video Intercoms, also known as Video Door-Phones or Video Entry Systems, have been growing in the past decade as more and more IP camera...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact