Hikvision DeepinMind 2019 Test

By: Rob Kilpatrick, Published on Jun 06, 2019

In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics, completely missing humans in the scene and more issues.

free-images

Now, after a year of firmware updates, Hikvision claims significant improvements in human detection and more accurate intrusion performance.

We tested the latest firmware on the iDS9632NXI-I8/16S DeepinMind NVR we bought for our original tests to see how it performs, examining:

  • False alert performance: What did and did not cause false alerts?
  • Intrusion detection accuracy: Did it miss valid people or vehicles in the scene in multiple conditions?
  • Ease of setup: How difficult or time-consuming was setup and optimization?
  • Vs. competitive analytics: How did DeepinView compare to Avigilon's self-learning camera analytic cameras?

** ****, *********'* ********** AI *** ********* ********, *********** ********, *******, and ***** ******* ** humans, ************** ************, ********** missing ****** ** *** scene *** **** ******.

free-images

***, ***** * **** of ******** *******, ********* claims *********** ************ ** human ********* *** **** accurate ********* ***********.

** ****** *** ****** firmware ** *** **********-**/*** ********** *** ** ****** *** *** original ***** ** *** how ** ********, *********:

  • ***** ***** ***********: **** did *** *** *** cause ***** ******?
  • ********* ********* ********: *** it **** ***** ****** or ******** ** *** scene ** ******** **********?
  • **** ** *****: *** difficult ** ****-********* *** setup *** ************?
  • **. *********** *********: *** did ********** ******* ** Avigilon's ****-******** ****** ******** cameras?

[***************]

*******

***** ** * ***** of ******* *** ********* thousands ** ******, *** DeepinMind *** *** **** positives:

  • ** ****** **********:** ****** *******/******* ** vehicles ******* ******* *** scene **** ****** ****** a ***** ** ******* in ******* ********** ********* day, *****, *** ***** rain.
  • ** ****** ** *******: ********** *** *** ***** on *** ******* ** our *****, ********* ******* wires, ********, ** ***** objects.
  • ** ****** ** ******* brush:******* *****/******** *** ******* by ********** ********** *******, a ****** ****** ** false ****** ** ********* *********.

*******, **** ******** ***** suffered **** ******** ****** seen ** *** ******** tests ** **********, *********:

  • **** ** **** ******** alerts:***** ******** ******* **** camera ***** ********* ****** during ***** **** *****, light ** *****. ****** **** not ********* ** ********* themselves, **** ********* ** the ****.
  • *********** ******* ******: *********** ** ****** *** outdoor *****/********** ** ***-****** vehicles ***** ********* ***** positives.
  • ************* ****** *** ********:****** *******, ********** ************ misidentified ****** ** ******** and **** *****.
  • *****/***** ******* ******* ****** alert: ******* ****** ** ***** alerts *** ***** *** large ******* ******* ******* the *****, *** ****** would ******** ** ********** as * *****.

**** **** ** ********* to ****** **** ******** as ********* ** ********* technical *******, **** ** threshold (******* **** ****** is ** *****) *** minimum *** ******* **** settings, *** ******* ** these ******* ******** * material ****** ** ***** alerts.

Vs. ********* ********* ********* / ****** ***

******* *** *********** ***** alert ******, ********** ***** outperforms *********'* ******* **-******/*** intrusion ********* ********* (*** *** ****), ***** ********** ******* on ******** *******, **** as *****, *******, *******, light *******, *** **** specs ** **** ** some *****. ** ***** where ******* *** **** will *** ** ******, such ** ******** ************, DeepinMind *** ******* ******** detection ***** ******** ********* may ***.

************, ******** ** ******** VMD, *********** ** *********** better, ** **** ****** side *** ***** ****** alarm ** *** ***** change, ********* *** *** limited ** *** ****** false ***** ******* *****, without ************** ******* ******, vehicles, ** ***** *******.

Vs. ********* **********

** *** *****,*********'* ************** ******** ******** ****** offered ****** ***** ***** performance **** *** ********** NVR, ******** ****** **** rain ** ******** ** shadows *** *****. ************, false ****** **** ***** sources **** **** ******** in *** ********** ******.

**** *********** ********** ** likely *** ** ********** used, ** *** ********** NVR **** * ******, older ********** **** ******** chip *** *** ********, while ********** ******* *** a **** ******** **** for * ****** ******* of *****.

Vs. ******** ****-******** *********

** *** *****, ********** was ********* ********* ** false ***** ******* ***** Avigilon's ** ****-******** ******** cameras ********. ** *** tests, ** ******** ****** in *** **** ****** was *** ********* ** any ******* ****** ******* days ** *******, *** light *******, *******, *******, etc.

Little ********** ** ****** ***********

** *** *****, *** DeepinMind *** ********** ********* regardless ** **** ****** of ********* ****** *** used *** *******. ***** were ********* **** *, 4, *, *** * series ******, **** *********** effectively ******* ******* ****.

Updated ******** ******

**** **** *** ********* using *** ******** ******* of ********** *** ********. However, ******* ** ***** America, ********* *** ******** a****** ********** ** *** DeepinMind *** ******(***** *** **** **** numbers **** * * suffix).

** ***** ********* ***** performance *********** ******* *** first *** ****** ***********, as **** ** ************ of * ******, ** which **** *********:

********* *** *** *** generation, ** *** ******* accuracy ******* ** ***** of ******** **** *** generation ****** ************** ****** rather **** ***** ******...*** 2nd ********** *******, ** plan ** ***** **** in ****** ** *********.

Simple *************

************* ** ********** ** simple, **** ********* ***** to ** ******* ** the *** ****** ***** settings *** "****** ***** Smart ********" ******* ** the ********* ******* ** the ***.

***** ******** **** ** threshold (**** ** ****** in *****) *** *********** can ** ******* *** did *** **** ** impact ** ********* ** our *****.

Rejected ***** ****** ** ***** *** *******

********** *** *** ***** on ******* *****/***** ** the ***** ** **** during *******, **** ** the ***** ** *** left *** ***** *****, one ** *** **** common ***** ****** ** previous ********* *****. ************, shadows **** *****, *****, or ***** ******* **** rejected, * ****** ****** which ********* ***** ********* in **** *****. **** are ***** ***** ******* in *** ****.

No-Alarms-On-Blowing-Branches,-Foliage,-or-Shadows

False ****** ** ****

********** *** ******* ****** with **** ** ******** on *** **** *** heavy ****, ** ***** that******** ****-******** *********,***** ***, *** ************** **************** *** *** ****.

Rain-On-Dome-Causes-False-Alerts

** ******** ** **** on *** ****, *********** in ******* ** *** ground **** ***** **** would ***** ***** ******.

Reflections In Rain Cause False Alerts

False ****** ** ***********

*** ********** ****** **** had ****** ***** ****** on *********** ** ******* of ****.

Reflections-In-Nonmoving-Vehicles-Cause-False-Alerts

False ****** ** *******

*******, ** *** *****, large ******* **** ******** as ****** ** ******** scenes. *** *******, *** dog ***** ******** *********, appearing ** * ******.

Large-Animals-Detected-As-Human

************, ***** ******* ********* triggered ******. *** *******, the **** ***** *** detected ** ***** ******** times ** *** ****.

Small-Animals-Detected-As-Human

Alerts ** ***** *******

*******, ***** ****** **** generated ** ***** ****** in *** ***** ******* changing, **** ** *** sun ****** ****** ******, causing *** ***** ** darken, *****.

Passing-Cloud-Trigger-False-Alert-Due-To-Light-Change

Vehicles ******** ** ****** / **** *****

****** *** ***** ** tested **********, ******** ********** of ****** ********** ** vehicles ** ******** ********** as ****** **** ****.

*** *******, *** ****** walking ******* *** ***** below ** ********** ** a *******. *** ******'* perceived ********** *** ** seen ** *** **** of *** ******** ***, much ***** **** *** person *******.

Human-Detected-As-Vehicle

*********, *** ***** ***** was ************* ** * person ** *** ***, though *** ****** ***** and **** ** ******* different **** * ******.

Vehicle-Detected-As-Human

No ****** ****** ** ******* ******

****** *** *****, ** saw ** ********* ** DeepinMind ******* ****** ******* or ******* ******* *** scene, *** *** ** miss ******** ******* ******* the **** ** ********.

No-Missed-Person-Alerts-During-Day

*** *** *** *** miss ******* **** ******* in ***** ****, *****:

No-Missed-Person-Alerts-During-Night_Heavy-Rain

Demographic **** *******

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*******, **** *********** ** no ****** ********** ***** current ******** (**.*.** ***** 181028) *** **** ******** (v2.8.2.2).

Demographics Removed In New Versions

Version ****

*** ********* ******** **** used ****** *******:

  • ********* ***-*******-**/***: **.*.** ***** 181028

Comments (9)

Undisclosed Integrator #1

06/06/19 07:03pm

***** ******!  * **** you *** **** *** a ****** ** **** out ***** *** ** spectrum ******* **** ***** analytics.  * **** ** real ******* *** *** thermal ******* ********* **** in *********** **** *** optical.

***** ******.

Gary Gibson

06/07/19 12:50am

*** ******* **** *****'* work. **** *** ****:

*****://***.*********.***/**/********/*******-*****-********/**********-******/**********-**-******/***-*******-**/***

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Gary Gibson | 06/07/19 04:01pm

****, ****** *** ******** that ** ** *********, the **** ****** ** working ***.

Undisclosed #2

06/08/19 06:51pm

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*** ***, ** ***** have **** *********** ** see *** *********** **** it **** ** **** on *** **** *** the *****...

Avatar

Ahmet Deveci

CCTV Aware | 06/10/19 07:59pm

*'* *** ** *** a ******** ****** ***** the ********** ***** ** products, ***** ** * shame ****** **** **** is ******** ** ** Hikvision's ****** ** ***** alert ************. *** ***** above ***** **-**** **** been ******* *** ** their ***** ***** ****** and *** **** *** amount ** ***** ****** triggered!

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:02pm

*****, **** ** *******, as ** ********* ** the ******,********** ********* ****** **** ********** and ********** ***** ********* much ****** **** *** conventional ****** /*** *********.

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:07pm

****, *** **** *** look ** * ******* like ******* *** *******, the ******* ** ****** a *****, *** ** animal ** ******** ***** single ****. ** **** the ***** ** ***** 'CCTV' ************* ** *****, hence ** **************.

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:11pm

** ***** **** ** generally ** *** **** - *.*., '********' ********* beating '****' ************* - ******** ** ****** ********* Shootout - ****, ****** / ****, ****** / Ring, ********* / *****

****** ****** ******* **** and **** *** * years ***, ** * ****** speak *** ****. *********, though, ******** ******* **** cloud ************ **** *** advantage ** ***** ***** false ***** ********* ***** has ****** **** (*.*., sent * ********* ***** to *** ***** ***** and *** * ***** / **** ******** ** validate).

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:14pm

****** *** ****, **** informative.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Verkada People And Face Analytics Tested on Aug 16, 2019
This week, Verkada released "People Analytics", including face analytics that they describe is a "game-changing feature" that "pushes the...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they claim their new Analytics+ "algorithms significantly improve accuracy and...
Honeywell Speaks On NDAA Ban, New Non-Banned Cameras and Cybersecurity on Aug 06, 2019
For years, Honeywell has depended on Dahua, a company with a poor cybersecurity track record and now banned by the US NDAA, for the development and...
Hikvision 4K Camera Shootout on Aug 02, 2019
With their latest Smart Series 5 cameras, Hikvision is claiming cameras "fully loaded" with "state-of-the-art technology for high performance and...
History of Video Surveillance on Jul 19, 2019
The video surveillance market has changed significantly since 2000, going from VCRs to ab emerging AI cloud era.  The goal of this history is to...
Wyze AI Analytics Tested - Beats Axis and Hikvision on Jul 17, 2019
$20 camera disruptor Wyze has released free person detection deep learning analytics to all of their users, claiming users will "Only get notified...
Ivideon Russian VSaaS Profile on Jun 27, 2019
Ivideon was an early VSaaS entrant, initially focusing on the consumer market, claiming massive growth to IPVM in 2014. We spoke to Ivideon, to...
Directory of 60 Video Surveillance Startups on Jun 25, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...

Most Recent Industry Reports

TMA Apologizes to Amazon / Ring on Aug 23, 2019
Not only is Amazon / Ring making major incursions into the residential security market, the organization representing the biggest incumbents, The...
China Dahua Replaces Their Software With US Pepper on Aug 22, 2019
What does a US government banned company do to improve its security positioning in the US? Well, Dahua is unveiling a novel solution, partnering...
Security Integrators Outlook On Remaining Integrators In 2025 on Aug 22, 2019
The industry has changed substantially in the last decade, with the rise of IP cameras and the race to the bottom. Indeed, more changes may be...
First GDPR Facial Recognition Fine For Sweden School on Aug 22, 2019
A school in Sweden has been fined $20,000 for using facial recognition to keep attendance in what is Sweden's first GDPR fine. Notably, the fine is...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
JCI Sues Wyze on Aug 21, 2019
The mega manufacturer / integrator JCI has sued the fast-growing $20 camera Seattle startup Wyze. Inside this note: Share the court...
Dahua 4K Camera Shootout on Aug 20, 2019
Dahua's new Pro Series 4K N85CL5Z claims to "deliver superior images in all lighting and environmental conditions", but how does this compare to...
ZK Teco Atlas Access Control Tested on Aug 20, 2019
Who needs access specialists? China-based ZKTeco claims its newest access panel 'makes it very easy for anyone to learn and install access control...
Uniview Beats Intel In Trademark Lawsuit on Aug 19, 2019
Uniview has won a long-running trademark lawsuit brought by Intel, with Beijing's highest court reversing an earlier Intel win, centered on...
Suprema Biometric Mass Leak Examined on Aug 19, 2019
While Suprema is rarely discussed even within the physical security market, the South Korean biometrics manufacturer made global news this past...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact