Hikvision DeepinMind 2019 Test

By: Rob Kilpatrick, Published on Jun 06, 2019

In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics, completely missing humans in the scene and more issues.

free-images

Now, after a year of firmware updates, Hikvision claims significant improvements in human detection and more accurate intrusion performance.

We tested the latest firmware on the iDS9632NXI-I8/16S DeepinMind NVR we bought for our original tests to see how it performs, examining:

  • False alert performance: What did and did not cause false alerts?
  • Intrusion detection accuracy: Did it miss valid people or vehicles in the scene in multiple conditions?
  • Ease of setup: How difficult or time-consuming was setup and optimization?
  • Vs. competitive analytics: How did DeepinView compare to Avigilon's self-learning camera analytic cameras?

** ****, *********'* ********** AI *** ********* ********, *********** ********, *******, and ***** ******* ** humans, ************** ************, ********** missing ****** ** *** scene *** **** ******.

free-images

***, ***** * **** of ******** *******, ********* claims *********** ************ ** human ********* *** **** accurate ********* ***********.

** ****** *** ****** firmware ** *************-**/*** ********** ***** ****** *** *** original ***** ** *** how ** ********, *********:

  • ***** ***** ***********: **** did *** *** *** cause ***** ******?
  • ********* ********* ********: *** it **** ***** ****** or ******** ** *** scene ** ******** **********?
  • **** ** *****: *** difficult ** ****-********* *** setup *** ************?
  • **. *********** *********: *** did ********** ******* ** Avigilon's ****-******** ****** ******** cameras?

[***************]

*******

***** ** * ***** of ******* *** ********* thousands ** ******, *** DeepinMind *** *** **** positives:

  • ** ****** **********:** ****** *******/******* ** vehicles ******* ******* *** scene **** ****** ****** a ***** ** ******* in ******* ********** ********* day, *****, *** ***** rain.
  • ** ****** ** *******:********** *** *** ***** on *** ******* ** our *****, ********* ******* wires, ********, ** ***** objects.
  • ** ****** ** ******* brush:******* *****/******** *** ******* by ********** ********** *******, a ****** ****** ** false ****** ** ********* *********.

*******, **** ******** ***** suffered **** ******** ****** seen ** *** ******** tests ** **********, *********:

  • **** ** **** ******** alerts:***** ******** ******* **** camera ***** ********* ****** during ***** **** *****, light ** *****. ****** were *** ********* ** raindrops **********, **** ********* on *** ****.
  • *********** ******* ******:*********** ** ****** *** outdoor *****/********** ** ***-****** vehicles ***** ********* ***** positives.
  • ************* ****** *** ********:****** *******, ********** ************ misidentified ****** ** ******** and **** *****.
  • *****/***** ******* ******* ****** alert:******* ****** ** ***** alerts *** ***** *** large ******* ******* ******* the *****, *** ****** would ******** ** ********** as * *****.

**** **** ** ********* to ****** **** ******** as ********* ** ********* technical *******, **** ** threshold (******* **** ****** is ** *****) *** minimum *** ******* **** settings, *** ******* ** these ******* ******** * material ****** ** ***** alerts.

Vs. ********* ********* ********* / ****** ***

******* *** *********** ***** alert ******, ********** ***** outperforms *********'* ******* **-******/*** intrusion ********* ********* (*** *** ****), ***** ********** ******* on ******** *******, **** as *****, *******, *******, light *******, *** **** specs ** **** ** some *****. ** ***** where ******* *** **** will *** ** ******, such ** ******** ************, DeepinMind *** ******* ******** detection ***** ******** ********* may ***.

************, ******** ** ******** VMD, *********** ** *********** better, ** **** ****** side *** ***** ****** alarm ** *** ***** change, ********* *** *** limited ** *** ****** false ***** ******* *****, without ************** ******* ******, vehicles, ** ***** *******.

Vs. ********* **********

** *** *****,*********'* ************** ******** ******** ****** offered ****** ***** ***** performance **** *** ********** NVR, ******** ****** **** rain ** ******** ** shadows *** *****. ************, false ****** **** ***** sources **** **** ******** in *** ********** ******.

**** *********** ********** ** likely *** ** ********** used, ** *** ********** NVR **** * ******, older ********** **** ******** chip *** *** ********, while ********** ******* *** a **** ******** **** for * ****** ******* of *****.

Vs. ******** ****-******** *********

** *** *****, ********** was ********* ********* ** false ***** ******* ***** Avigilon's ** ****-******** ******** cameras ********. ** *** tests, ** ******** ****** in *** **** ****** was *** ********* ** any ******* ****** ******* days ** *******, *** light *******, *******, *******, etc.

Little ********** ** ****** ***********

** *** *****, *** DeepinMind *** ********** ********* regardless ** **** ****** of ********* ****** *** used *** *******. ***** were ********* **** *, 4, *, *** * series ******, **** *********** effectively ******* ******* ****.

Updated ******** ******

**** **** *** ********* using *** ******** ******* of ********** *** ********. However, ******* ** ***** America, ********* *** ******** a****** ********** ** *** DeepinMind *** ******(***** *** **** **** numbers **** * * suffix).

** ***** ********* ***** performance *********** ******* *** first *** ****** ***********, as **** ** ************ of * ******, ** which **** *********:

********* *** *** *** generation, ** *** ******* accuracy ******* ** ***** of ******** **** *** generation ****** ************** ****** rather **** ***** ******...*** 2nd ********** *******, ** plan ** ***** **** in ****** ** *********.

Simple *************

************* ** ********** ** simple, **** ********* ***** to ** ******* ** the *** ****** ***** settings *** "****** ***** Smart ********" ******* ** the ********* ******* ** the ***.

***** ******** **** ** threshold (**** ** ****** in *****) *** *********** can ** ******* *** did *** **** ** impact ** ********* ** our *****.

Rejected ***** ****** ** ***** *** *******

********** *** *** ***** on ******* *****/***** ** the ***** ** **** during *******, **** ** the ***** ** *** left *** ***** *****, one ** *** **** common ***** ****** ** previous ********* *****. ************, shadows **** *****, *****, or ***** ******* **** rejected, * ****** ****** which ********* ***** ********* in **** *****. **** are ***** ***** ******* in *** ****.

No-Alarms-On-Blowing-Branches,-Foliage,-or-Shadows

False ****** ** ****

********** *** ******* ****** with **** ** ******** on *** **** *** heavy ****, ** ***** that******** ****-******** *********,***** ***, *** ************** **************** *** *** ****.

Rain-On-Dome-Causes-False-Alerts

** ******** ** **** on *** ****, *********** in ******* ** *** ground **** ***** **** would ***** ***** ******.

Reflections In Rain Cause False Alerts

False ****** ** ***********

*** ********** ****** **** had ****** ***** ****** on *********** ** ******* of ****.

Reflections-In-Nonmoving-Vehicles-Cause-False-Alerts

False ****** ** *******

*******, ** *** *****, large ******* **** ******** as ****** ** ******** scenes. *** *******, *** dog ***** ******** *********, appearing ** * ******.

Large-Animals-Detected-As-Human

************, ***** ******* ********* triggered ******. *** *******, the **** ***** *** detected ** ***** ******** times ** *** ****.

Small-Animals-Detected-As-Human

Alerts ** ***** *******

*******, ***** ****** **** generated ** ***** ****** in *** ***** ******* changing, **** ** *** sun ****** ****** ******, causing *** ***** ** darken, *****.

Passing-Cloud-Trigger-False-Alert-Due-To-Light-Change

Vehicles ******** ** ****** / **** *****

****** *** ***** ** tested **********, ******** ********** of ****** ********** ** vehicles ** ******** ********** as ****** **** ****.

*** *******, *** ****** walking ******* *** ***** below ** ********** ** a *******. *** ******'* perceived ********** *** ** seen ** *** **** of *** ******** ***, much ***** **** *** person *******.

Human-Detected-As-Vehicle

*********, *** ***** ***** was ************* ** * person ** *** ***, though *** ****** ***** and **** ** ******* different **** * ******.

Vehicle-Detected-As-Human

No ****** ****** ** ******* ******

****** *** *****, ** saw ** ********* ** DeepinMind ******* ****** ******* or ******* ******* *** scene, *** *** ** miss ******** ******* ******* the **** ** ********.

No-Missed-Person-Alerts-During-Day

*** *** *** *** miss ******* **** ******* in ***** ****, *****:

No-Missed-Person-Alerts-During-Night_Heavy-Rain

Demographic **** *******

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*******, **** *********** ** no ****** ********** ***** current ******** (**.*.** ***** 181028) *** **** ******** (v2.8.2.2).

Demographics Removed In New Versions

Version ****

*** ********* ******** **** used ****** *******:

  • ********* ***-*******-**/***: **.*.** ***** 181028

Comments (9)

Undisclosed Integrator #1

06/06/19 07:03pm

***** ******!  * **** you *** **** *** a ****** ** **** out ***** *** ** spectrum ******* **** ***** analytics.  * **** ** real ******* *** *** thermal ******* ********* **** in *********** **** *** optical.

***** ******.

Gary Gibson

06/07/19 12:50am

*** ******* **** *****'* work. **** *** ****:

*****://***.*********.***/**/********/*******-*****-********/**********-******/**********-**-******/***-*******-**/***

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Gary Gibson | 06/07/19 04:01pm

****, ****** *** ******** that ** ** *********, the **** ****** ** working ***.

Undisclosed #2

06/08/19 06:51pm

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*** ***, ** ***** have **** *********** ** see *** *********** **** it **** ** **** on *** **** *** the *****...

Avatar

Ahmet Deveci

CCTV Aware | 06/10/19 07:59pm

*'* *** ** *** a ******** ****** ***** the ********** ***** ** products, ***** ** * shame ****** **** **** is ******** ** ** Hikvision's ****** ** ***** alert ************. *** ***** above ***** **-**** **** been ******* *** ** their ***** ***** ****** and *** **** *** amount ** ***** ****** triggered!

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:02pm

*****, **** ** *******, as ** ********* ** the ******,********** ********* ****** **** ********** and ********** ***** ********* much ****** **** *** conventional ****** /*** *********.

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:07pm

****, *** **** *** look ** * ******* like ******* *** *******, the ******* ** ****** a *****, *** ** animal ** ******** ***** single ****. ** **** the ***** ** ***** 'CCTV' ************* ** *****, hence ** **************.

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:11pm

** ***** **** ** generally ** *** **** - *.*., '********' ********* beating '****' ************* - ******** ** ****** ********* Shootout - ****, ****** / ****, ****** / Ring, ********* / *****

****** ****** ******* **** and **** *** * years ***, ** * ****** speak *** ****. *********, though, ******** ******* **** cloud ************ **** *** advantage ** ***** ***** false ***** ********* ***** has ****** **** (*.*., sent * ********* ***** to *** ***** ***** and *** * ***** / **** ******** ** validate).

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:14pm

****** *** ****, **** informative.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

IronYun AI Analytics Tested on Feb 17, 2020
Taiwan / US startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a...
Monitoreal "Completely Autonomous" Home AI Tested on Feb 12, 2020
Monitoreal claims to allow users to "see the things you want (people, vehicles, animals) and ignore the things you don’t”, using AI to distinguish...
Wyze AI Analytics Tested - Beats Axis and Hikvision, Now Improved, Now Being Terminated on Nov 25, 2019
When we originally tested Wyze's free person detection deep learning analytics in July 2019, they performed well, with few false alarms, but a long...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Yi Home Camera 3 AI Analytics Tested on Sep 10, 2019
Yi Technology is claiming "new AI features" in its $50 Home Camera 3 "eliminates 'false positives' caused by flying insects, small pets, or light...
Verkada People And Face Analytics Tested on Aug 16, 2019
This week, Verkada released "People Analytics", including face analytics that they describe is a "game-changing feature" that "pushes the...
Dahua Analytics+ Tested on Aug 07, 2019
Dahua's analytics have performed poorly in past shootouts. But now, they claim their new Analytics+ "algorithms significantly improve accuracy and...
Hikvision DeepinView Camera Analytics Tested on May 08, 2019
Hikvision is expanding its 'deep learning' offerings with a new camera series called 'DeepinView' claiming false alarm reduction and improved...

Most Recent Industry Reports

USA's Feevr Thermal Temperature System Examined on Mar 31, 2020
This US company has burst on to the scene, brashly naming itself 'feevr' and branding itself as a "COVID 19 - AI BASED NON CONTACT THERMAL...
JCI Coronavirus Cuts on Mar 31, 2020
JCI has made coronavirus cuts, the company told employees in an email that IPVM has reviewed. Inside this note, we examine the cuts made, the...
Add Door Operators To Fight Coronavirus on Mar 31, 2020
IPVM recommends that integrators advocate and end-users consider adding door operators to fight the spread of coronavirus. This delivers...
Video Surveillance Business 101 on Mar 30, 2020
This report explains the fundamental elements of the video surveillance business for those new to the industry. This is part of our Video...
FDA Gives Guidance on 'Coronavirus' Thermal Fever Detection Systems on Mar 30, 2020
The US FDA has given IPVM guidance on the use of thermal fever detection systems being marketed for coronavirus, as an explosion of such devices...
Worsen: Integrators Hit Even Harder By Coronavirus on Mar 30, 2020
Integrator's problems have worsened over the past 2 weeks, according to new IPVM survey results. Inside this report, we share statistics and...
Pivot3 Mass Layoffs on Mar 27, 2020
Pivot3 has conducted mass layoffs, the culmination of grand hopes, a quarter of a billion dollars in VC funding, and multiple failures to gain...
Athena CEO Criticizes 'Deplorable' 'Nitpicking', IPVM Refutes on Mar 27, 2020
UPDATE: NBC News Report Cites IPVM On Coronavirus 'Fever Detection' Cameras Athena Security's CEO Lisa Falzone has strongly objected to IPVM's...
Hikvision Admits Sanctions Harming Its Financial Performance on Mar 27, 2020
While Hikvision initially downplayed being sanctioned for human rights abuses, the company is now admitting a significant impact in a new PRC...