VMD Shootout II - Hikvision, Dahua, Samsung

By: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports: 

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

*** ******** ****** **************** ********, ****, ***** and ****. ******* ******* it *** ***** *** more ************* ** ** tested. **** **** ******** 3 *** ************* - Dahua,************ *******, ******** ** our ******** ****** **** reports: 

** ******** *** **** testing ******** ** *** first **** ******, ******** **** a ****** ****** ********** room:

****** ** ** * more ******* **** ****** area:

*** *******, ** ******* area **** ****** ********** and ********** ** * nearby ****:

*** ***** ****** ** answer *** ********* *** questions:

  • **** ****** **** ******** cause ***** *********?
  • ***** *** *** **** at ********* ***** ******?
  • *** *** ********* ***** vary **** ************ ** manufacturer?
  • *** ******** ** ********* for ****** ********* ******* increasing ***** ****** *** vice *****?

[***************]

Key ********

***** ****** **** **** these ***** **** ********* using ************* * ******* 60° ********** ***** ** view **** *** ** the **** *** ******* from *****,*********, *** *******. ** performed **** *********** ******* with ******** ****** *** found*********** *** ***** ** most ******, *** ** should *** ** ******* that *** ******* ** the ************'* **** ******* similarly ** *** ****** models.

**** ******* ** *********** *** ******** (********, ****, *****, ****) and**** ***** ****** ********* 2.1, ***** ***** ************* ********* as *******:

  • *****'* *********** *** ************* the **** ** **** (standard ***), *****, *** Sony ****** *** *** in **** ***** *** false ********** *********. ** night, ** ************ **** standard *** *** ****, with***** ***** ***** ** the ***** ***-****, **** very *** ***** ***********.
  • ********************* **** (******** ***), Bosch, *** **** ****** the ***, ** **' range **** *** ***** positives. ********* ***** ** night *** ****** **** all **** ************* ** the ******** ****, ** 60', ******* ******* ***** positive ******.
  • *******'* ***** (~***' ********) was ******* **** *** cameras, ********* ******** (~***'), the ******** *** *********, with *** ***** ***********. At *****, ********* ***** and ******** *** **** better (~**' **. **' for ********).
  • ******** ** **** *** 2.1, *********** ****** ********* on *** *****. *** three ************* ** **** test ************ **** *** 2.1 ** *** *****, where ** ****** ******** detections ** **** ***** range. ****** *** ***, Samsung ************ *** *.* by ~**-**',************ ************* ***** ** range (~**-**'), ***** ***** was ~**' *******. **** VMD *.*'* ***** ******** rejection **** *** ****** perfect, *******, ****** **** any ****** ** **** test.

***** *** ******** ******* individual ****** *********** *** issues:

  • ****** *****'* ***** *** on *** **** **** other *******, *** ***** activations **** *** ** issue, ** ***** ***** motion ********* ** ** the ***** ********, **** quirky. ** ****** ** activate ************ ** ***** despite *** ***** *** settings ********* *********. 
  • *** ******* ***-**** *** the **** ********* ***** in **** ****, **** indoors *** ***, ** full ***** *** ****. However, ** *** **** prone ** ***** *********** outdoors, **** ******* *** passing *** ******, ** flashing **** ** *** open ****** **** *****.
  • *********'* *********** *** **** **** of ******* ** ******** scenes, ** *** ***** levels ******. ********, ********* range *** ******* **** Samsung, ****** ****** **** Dahua. ***** *********** **** uncommon, **** *** ********* of ******* ****** ** the *****, ***** ************ activated ****** *********.

Optimization ***************

***** ** *** *****, these *** *** *************** on *** ** **** optimize **** ******:

  • ********* ******* ****** *** *********** 3 (*******) ** *. Below ****, ***** ****** are ********** ******, ***** false *********** ******** *********** above *. 
  • ** ********* ******* *****'* ******* sensitivity ** **, **** a ********* ** *-*. Increasing *********** ***** **** results ** ******** ***** ************. ** **** ******, using ******** ***** ** cover *** ****, ******* of * ****** ***** zone ********* ******, *** we *** *** **** consistent ******** ** ** when **** ** **********. 
  • *** *******, ** ***** that ******* *** *********** to *** ******* "******" setting *** *** **** ratio ** **** ********** to ***** ******, *** lowering ** ******* *********** will ****** ******** ****** detection ***** ** ******** the ********** ** ***** ******.  

*************

*** ********* ****** ****** configuration ** **** ************'* VMD.

***** *******

********* **-*********


 

******* ***-****


Outdoor *******/*********

******* ********* *****

** ~***', *** ******* SNB-5004 ** *** **** camera ** ****** *** subject, ****** ** *** longest ********* ***** ** all *** ******* ******.

** ~**', *** ********* **-********* ****** ** ****** our ******* ************.

*******, ** ~**', *** Dahua ******* ** **** to ****** *** *******.

********* ********* *****

*** ** *** ******* tested *** * ********* in ********* *****, **** the ***** ***** **** ~**' ** the ******* ** ~**' at *****, ********* ***** **** ~**' ** ~60', *** ******* ***** having *** ******** ********* range ** *****, *** dropping **** ~***' ** the *** ** ~**' during *****.

Indoor ********** ****

** *** ********** **** in **** *****, *** cameras **** **** ** reliably ****** * ***** subject ** *** ****** up ** **'.

** *** ***** (~***), Samsung's *** *** *** only ****** ****** ** reliably ****** *** ******* at *** ****** ** to **' ** *** conference **** *****. *** ********* ******* *** ** **% accuracy ****** **** *** subject ** ~**', *** 100% ********* **** *** subject *** ~**' ** closer. ***** ******* ********* poorly ** **** *****, offering **% ********* **** our ******* ~**' ****, and ******** ***% ********* accuracy **** *** ******* ~12' **** *** ******.

*** ********* ******* *** * **% false-alarm **** **** * shadow ****** ** *** scene, ***** *** ******* SNB-5004 *** * **% false-alarm ****. **** ***** cameras *** *** *******.

**** ** ***** * flashlight ******* *** ****, the ***** ******* *** a **% *****-***** ****, while *** ********* *** ******* ******* **** unaffected.

******* *** **** ******* *** light ** *** ***** and ******* * ***** alarm *************** **% *** ******* **%. Dahua ******** **********.

Open ******

****** *** ******* ** an **** ****** *****, about **' ****, *** our ******* ~** **** the *******, **** ***** performance ** ********* *** ******* *** *******, with ******* ********* *** subject ** **** ** he **** ****** *** corner, *** *** ********* ************ ** *** **** instant ~**% ** *** time. **** *** ***** box *** ******** ******* could *** ******** ****** our ******* **** **** distance.

*******, **** *** ******* begins ** **** **** the *****, *** ******* are **** ** ****** our *******, **** ********* accuracy *** ****** ** walked ** *** *******.

** *** **** ***** at *** *****, *** ********* *** ******* ******* ****** their ******* ********* ***** as * **** ***** scene, *** ***** ** unable ** ****** *** subject.

*** ******* ***-**** *** a **** ********* ** overnight ****** ******** ** a ******** ***. ***** were ******* ** ****** every ****. *** ********* *** ***** ******* *** not **** ***** ****** from *** ******** ***.

Test **********

*** ********* ******* *** firmware ******** **** **** in *** ****:

  • ***** *******: *.***.******* **.*.*
  • ********* **-*********: **.*.*
  • ******* ***-****: *.*********

Comments (5)

Given IP cameras use compressed video where compression artefacts might lead to false positives, I wonder how VMD accuracy would compare between equivalent IP and HDCVI cameras from Dahua? HDCVI sends uncompressed video to the DVR which should be better for VMD analysis except for any analog noise. I wonder if there would be any difference and, if so, whether it would be a little or a lot?

Motion detection is always done on compressed video. Also, compression artifacts, assuming a 'regular' compressed video (not one that has been super compressed for a tiny bit rate), should not be a factor in detection accuracy.

Thanks very much John!

I think this report is due for an update, especially since you are using it in the camera course. Moore's law alone should suggest an update is due to keep the report relivant. Also could you test VMD on panoramic cameras and some American made cameras?

#1, thanks, we will schedule some more VMD testing but, even from what vendors are claiming, Moore's Law has not a big impact on VMD.

There is the deep learning NVR coming from Hikvision (soon) and we definitely will test that. And Axis has VMD4 which they claim has improvements which we will test. However, overall there is not many VMD advance claims.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports on Low Light

Honeywell 30 Series Cameras Tested Vs Dahua and Hikvision on Dec 11, 2019
Honeywell has infamously OEMed Dahua and Hikvision for years, but now they have introduced an NDAA-compliant line, the 30 Series, claiming "lower...
Bosch Budget 3000i Cameras Tested on Dec 05, 2019
Bosch has long had a hole in its lineup for, as it describes, "competitively-priced cameras". Now, Bosch has released its 3000i series cameras...
AVTech ~$70 IP Cameras Tested Vs Dahua and Hikvision on Dec 04, 2019
Taiwanese manufacturer Avtech is taking direct aim at low cost leaders Dahua and Hikvision with ~$70 starlight and white light illuminator...
Budget Covert Cameras Tested on Nov 26, 2019
Covert cameras under $100 are widely available online but are they any good? To see how these models really work in the real world, we bought...
Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
Hikvision Dual Lens Face Recognition Camera Tested on Nov 19, 2019
Hikvision's Dual Lens Facial Recognition camera, claims that it "adopts advanced deep learning algorithm and powerful GPU to realize instant face...
Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low light models from 10 manufacturers: Increasingly, each manufacturer...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Avigilon Appearance Search Tested on Oct 30, 2019
Avigilon Appearance Search claims that it "sorts through hours of video with ease, to quickly locate a specific person or vehicle of interest...
Illustra Pro Gen3 4K Camera Tested on Oct 23, 2019
Johnson Controls has released the latest generation in their Illustra Pro line, the Pro Mini-Dome Gen 3, a non-OEM model claiming to "optimize...

Most Recent Industry Reports

Honeywell 30 Series Cameras Tested Vs Dahua and Hikvision on Dec 11, 2019
Honeywell has infamously OEMed Dahua and Hikvision for years, but now they have introduced an NDAA-compliant line, the 30 Series, claiming "lower...
"Good Market, Bad Business Models" - Residential Security on Dec 11, 2019
Industry banker John Mack, at his company's annual event, took aim squarely at the problems in the residential security...
IP Camera Browser Support: Who's Broken / Who Works on Dec 10, 2019
For many years, IP cameras depended on ActiveX control, whose security flaws have been known for more than a decade. The good news is that this is...
Acquisitions - Winners and Losers on Dec 10, 2019
Most major manufacturers have been acquired over the last decade. But which have been good deals or not? In this report, we analyze the...
IP Camera Installability Shootout 2019 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Dec 09, 2019
What are the best and worst cameras to install? Which manufacturers make it the hardest or easiest to install their cameras? We tested 35 total...
Viisights Raises $10 Million, Behavior Analytics Company Profile on Dec 09, 2019
Viisights, an Israeli AI analytics startup marketing "Behavioral Understanding Systems", announced $10 million Series A funding. We spoke to...
Disruptor Wyze Releases Undisruptive Smartlock on Dec 06, 2019
While Wyze has disrupted the consumer IP camera market with ~$20 cameras, its entrance into smart locks is entirely undisruptive. We have...
Bosch Budget 3000i Cameras Tested on Dec 05, 2019
Bosch has long had a hole in its lineup for, as it describes, "competitively-priced cameras". Now, Bosch has released its 3000i series cameras...
Anixter Resisting Takeover From Competitor on Dec 05, 2019
Mega distributor Anixter is going to be acquired but by whom? Initially, Anixter planned to go private, being bought by a private equity firm....
Security Sales Course 2020 - Last Chance Save $50 on Dec 05, 2019
This sales course is customized for the current needs and challenges specific to professionals selling video surveillance and access control...