VMD Shootout II - Hikvision, Dahua, Samsung

By: Derek Ward, Published on Jan 06, 2014

Our first VMD Camera Shootout included Avigilon, Axis, Bosch and Sony. Members enjoyed it and asked for more manufacturers to be tested. This test includes 3 new manufacturers - Dahua, Hikvision and Samsung, building on our original camera test reports: 

We followed the same testing approach as our first test series, starting with a simple indoor conference room:

Moving on to a more complex open office area:

And finally, an outdoor area with moving vegetation and headlights on a nearby road:

Our tests looked to answer the following key questions:

  • What issues most commonly cause false positives?
  • Whose VMD was best at rejecting these events?
  • How did detection range vary from manufacturer to manufacturer?
  • Can settings be optimized for better detection without increasing false alerts and vice versa?

Key Findings

Users should note that these tests were performed using approximately a typical 60° horizontal field of view with top of the line box cameras from Dahua, Hikvision, and Samsung. We performed some preliminary testing with minidome models and found performance was close in most scenes, but it should not be assumed that all cameras in the manufacturer's line perform similarly to the tested models.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

With respect to our original VMD shootout (Avigilon, Axis, Bosch, Sony) and Axis Video Motion Detection 2.1, these three manufacturers performed as follows:

  • Dahua's performance was approximately the same as Axis (standard VMD), Bosch, and Sony during the day in both range and false activation rejection. At night, it outperformed Axis standard VMD and Sony, with range about equal to the Bosch NBN-733V, with very few false activations.
  • Hikvision outperformed Axis (standard VMD), Bosch, and Sony during the day, at 80' range with few false positives. Detection range at night was better than all four manufacturers in the original test, at 60', without notable false positive issues.
  • Samsung's range (~145' outdoors) was greater than all cameras, including Avigilon (~120'), the previous top performer, with few false activations. At night, detection range and accuracy was also better (~80' vs. 50' for Avigilon).
  • Compared to Axis VMD 2.1, performance varied depending on the scene. All three manufacturers in this test outperformed Axis VMD 2.1 in low light, where it missed numerous detections at even short range. During the day, Samsung outperformed VMD 2.1 by ~30-40', Hikvision was approximately equal in range (~80-90'), while Dahua was ~30' shorter. Axis VMD 2.1's false positive rejection rate was nearly perfect, however, better than any camera in this test.

These key findings reflect individual camera performance and issues:

  • Though Dahua's range was on par with many other cameras, and false activations were not an issue, we found their motion detection to be the least reliable, even quirky. It failed to activate consistently at times despite the scene and settings remaining unchanged. 
  • The Samsung SNB-5004 had the best detection range in this test, both indoors and out, in full light and dark. However, it was most prone to false activations outdoors, from shadows and passing car lights, or flashing LEDs in the open office test scene.
  • Hikvision's performance was near that of Samsung in interior scenes, at all light levels tested. Outdoors, detection range was shorter than Samsung, though better than Dahua. False activations were uncommon, with the exception of shadows moving in the scene, which consistently activated motion detection.

Optimization Recommendations

Based on our tests, these are our recommendations on how to best optimize each camera:

  • Hikvision cameras should use sensitivity 3 (default) or 4. Below this, valid events are frequently missed, while false activations increase drastically above 4. 
  • We recommend keeping Dahua's default sensitivity of 55, with a threshold of 1-5. Increasing sensitivity above this results in numerous false activactions. In some scenes, using multiple zones to cover the area, instead of a single large zone performed better, but we did not find consistent patterns as to when this is preferable. 
  • For Samsung, we found that leaving the sensitivity to the default "normal" setting had the best ratio of true detections to false alerts, and lowering or raising sensitivity will either directly reduce detection range or increase the likelyhood of false alerts.  

Configuration

The following videos review configuration of each manufacturer's VMD.

Dahua HF3101N

Hikvision DS-2CD864FWD


 

Samsung SNB-5004


Outdoor Daytime/Nighttime

Daytime Detection Range

At ~145', the Samsung SNB-5004 is the only camera to detect our subject, giving it the longest detection range of all the cameras tested.

At ~80', the Hikvision DS-2CD864FWD begins to detect our subject consistently.

Finally, at ~55', the Dahua HF3101N is able to detect our subject.

Nighttime Detection Range

All of the cameras tested had a reduction in detection range, with the Dahua going from ~55' in the daytime to ~45' at night, Hikvision going from ~80' to ~60', and Samsung still having the furthest detection range at night, but dropping from ~145' in the day to ~80' during night.

Indoor Conference Room

In our conference room in full light, all cameras were able to reliably detect a human subject at all ranges up to 20'.

In low light (~1lx), Samsung's VMD was the only camera tested to reliably detect our subject at all ranges up to 20' in our conference room scene. The Hikvision cameras had an 85% accuracy rating with our subject at ~20', and 100% detection when our subject was ~18' or closer. Dahua cameras performed poorly in this scene, offering 60% detection with our subject ~20' away, and attained 100% detection accuracy with our subject ~12' from the camera.

The Hikvision cameras had a 75% false-alarm rate with a shadow moving in the scene, while the Samsung SNB-5004 had a 60% false-alarm rate. Both Dahua cameras did not trigger.

When we waved a flashlight through the room, the Dahua HF3101N had a 10% false-alarm rate, while the Hikvision and Samsung cameras were unaffected.

Opening the door changed the light in the scene and created a false alarm rate ofHikvision 75% and Samsung 90%. Dahua remained unaffected.

Open Office

Moving the cameras to an open office scene, about 40' long, and our subject ~40 from the cameras, full light performance of Hikvision and Samsung are nominal, with Samsung detecting our subject as soon as he goes around the corner, and the Hikvision detecting him at the same instant ~75% of the time. Both the Dahua box and minidome cameras could not reliably detect our subject from this distance.

However, once our subject begins to move down the aisle, all cameras are able to detect our subject, with increased accuracy the closer he walked to the cameras.

In the same scene at low light, the Hikvision and Samsung cameras retain their similar detection rates as a full light scene, but Dahua is unable to detect our subject.

The Samsung SNB-5004 had a high frequency of overnight alerts provided by a flashing LED. There were roughly 20 alerts every hour. The Hikvision and Dahua cameras did not have false alerts from the flashing LED.

Test Parameters

The following cameras and firmware versions were used in the test:

  • Dahua HF3101N: 2.210.General 01.0.R
  • Hikvision DS-2CD864FWD: V5.0.2
  • Samsung SNB-5004: 1.11_131011
Comments (5) : Members only. Login. or Join.

Related Reports

Camera Analytics Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jan 22, 2020
Analytics are hot again, thanks to a slew of AI-powered cameras, but whose...
Camect Presents Residential Market Smart NVR with AI Analytics on Aug 19, 2020
Camect presented its AI video analytics enhanced NVR at the May 2020 IPVM...
Dahua, Hikvision, ZKTeco Face Mask Detection Shootout on Jun 19, 2020
Temperature tablets with face mask detection are one of the hottest trends in...
IPVM Opens 12,000 Sqft Testing Facility on Dec 16, 2019
IPVM is proud to announce the opening of the world's first video surveillance...
AVTech ~$70 IP Cameras Tested Vs Dahua and Hikvision on Dec 04, 2019
Taiwanese manufacturer Avtech is taking direct aim at low cost leaders Dahua...
Taiwan Lilin NDAA Compliant Cameras Tested on Aug 13, 2020
Taiwan-based manufacturer Lilin is taking direct aim at Dahua and Hikvision...
Hanwha Presents AI Analytics and First 8K Camera on May 11, 2020
Hanwha presented their AI Analytics and the "Industry's First 8K" camera at...
Defendry Presents AI Active Shooter Security System on Jul 14, 2020
Defendry presented its Active Shooter security system at the May 2020 IPVM...
Asylon Presents All-Weather Automated Security Drones on Jun 18, 2020
Asylon presented its All-Weather Automated Security Drone, the DroneCore, at...
Video Surveillance Cameras 101 on Feb 25, 2020
Cameras come in many shapes, sizes and specifications. This 101 examines the...
2020 Video Surveillance Cameras State Of The Market on Jan 03, 2020
Each year, IPVM explains the main advances and changes for video surveillance...
2020 Camera Book Released on Jan 10, 2020
This is the best, most comprehensive security camera training in the world,...
SenseB4 Presents Cloud Network Device Monitoring on Jun 09, 2020
SenseB4 presented its cybersecurity and network health monitoring products at...
Milestone Presents XProtect On AWS on May 04, 2020
Milestone presented its XProtect on AWS offering at the April 2020 IPVM New...
AndroVideo Presents Edge AI Face Recognition Cameras on Jun 26, 2020
AndroVideo presented its AI at the edge face recognition cameras at the May...

Recent Reports

OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...
China Bems Temperature Measurement Terminal Tested on Sep 22, 2020
Guangzhou Bems (brand Benshi) is the manufacturer behind temperature...
Axis Exports To China Police Criticized By Amnesty International on Sep 21, 2020
Axis Communications and other EU surveillance providers are under fire from...
Milestone XProtect on AWS Tested on Sep 21, 2020
Milestone finally launched multiple cloud solutions in 2020, taking a...