Hikvision DeepinMind 2019 Test

By: Rob Kilpatrick, Published on Jun 06, 2019

In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics, completely missing humans in the scene and more issues.

free-images

Now, after a year of firmware updates, Hikvision claims significant improvements in human detection and more accurate intrusion performance.

We tested the latest firmware on the iDS9632NXI-I8/16S DeepinMind NVR we bought for our original tests to see how it performs, examining:

  • False alert performance: What did and did not cause false alerts?
  • Intrusion detection accuracy: Did it miss valid people or vehicles in the scene in multiple conditions?
  • Ease of setup: How difficult or time-consuming was setup and optimization?
  • Vs. competitive analytics: How did DeepinView compare to Avigilon's self-learning camera analytic cameras?

** ****, *********'* ********** AI *** ********* ********, *********** ********, *******, and ***** ******* ** humans, ************** ************, ********** missing ****** ** *** scene *** **** ******.

free-images

***, ***** * **** of ******** *******, ********* claims *********** ************ ** human ********* *** **** accurate ********* ***********.

** ****** *** ****** firmware ** *************-**/*** ********** ***** ****** *** *** original ***** ** *** how ** ********, *********:

  • ***** ***** ***********: **** did *** *** *** cause ***** ******?
  • ********* ********* ********: *** it **** ***** ****** or ******** ** *** scene ** ******** **********?
  • **** ** *****: *** difficult ** ****-********* *** setup *** ************?
  • **. *********** *********: *** did ********** ******* ** Avigilon's ****-******** ****** ******** cameras?

[***************]

*******

***** ** * ***** of ******* *** ********* thousands ** ******, *** DeepinMind *** *** **** positives:

  • ** ****** **********:** ****** *******/******* ** vehicles ******* ******* *** scene **** ****** ****** a ***** ** ******* in ******* ********** ********* day, *****, *** ***** rain.
  • ** ****** ** *******:********** *** *** ***** on *** ******* ** our *****, ********* ******* wires, ********, ** ***** objects.
  • ** ****** ** ******* brush:******* *****/******** *** ******* by ********** ********** *******, a ****** ****** ** false ****** ** ********* *********.

*******, **** ******** ***** suffered **** ******** ****** seen ** *** ******** tests ** **********, *********:

  • **** ** **** ******** alerts:***** ******** ******* **** camera ***** ********* ****** during ***** **** *****, light ** *****. ****** were *** ********* ** raindrops **********, **** ********* on *** ****.
  • *********** ******* ******:*********** ** ****** *** outdoor *****/********** ** ***-****** vehicles ***** ********* ***** positives.
  • ************* ****** *** ********:****** *******, ********** ************ misidentified ****** ** ******** and **** *****.
  • *****/***** ******* ******* ****** alert:******* ****** ** ***** alerts *** ***** *** large ******* ******* ******* the *****, *** ****** would ******** ** ********** as * *****.

**** **** ** ********* to ****** **** ******** as ********* ** ********* technical *******, **** ** threshold (******* **** ****** is ** *****) *** minimum *** ******* **** settings, *** ******* ** these ******* ******** * material ****** ** ***** alerts.

Vs. ********* ********* ********* / ****** ***

******* *** *********** ***** alert ******, ********** ***** outperforms *********'* ******* **-******/*** intrusion ********* ********* (*** *** ****), ***** ********** ******* on ******** *******, **** as *****, *******, *******, light *******, *** **** specs ** **** ** some *****. ** ***** where ******* *** **** will *** ** ******, such ** ******** ************, DeepinMind *** ******* ******** detection ***** ******** ********* may ***.

************, ******** ** ******** VMD, *********** ** *********** better, ** **** ****** side *** ***** ****** alarm ** *** ***** change, ********* *** *** limited ** *** ****** false ***** ******* *****, without ************** ******* ******, vehicles, ** ***** *******.

Vs. ********* **********

** *** *****,*********'* ************** ******** ******** ****** offered ****** ***** ***** performance **** *** ********** NVR, ******** ****** **** rain ** ******** ** shadows *** *****. ************, false ****** **** ***** sources **** **** ******** in *** ********** ******.

**** *********** ********** ** likely *** ** ********** used, ** *** ********** NVR **** * ******, older ********** **** ******** chip *** *** ********, while ********** ******* *** a **** ******** **** for * ****** ******* of *****.

Vs. ******** ****-******** *********

** *** *****, ********** was ********* ********* ** false ***** ******* ***** Avigilon's ** ****-******** ******** cameras ********. ** *** tests, ** ******** ****** in *** **** ****** was *** ********* ** any ******* ****** ******* days ** *******, *** light *******, *******, *******, etc.

Little ********** ** ****** ***********

** *** *****, *** DeepinMind *** ********** ********* regardless ** **** ****** of ********* ****** *** used *** *******. ***** were ********* **** *, 4, *, *** * series ******, **** *********** effectively ******* ******* ****.

Updated ******** ******

**** **** *** ********* using *** ******** ******* of ********** *** ********. However, ******* ** ***** America, ********* *** ******** a****** ********** ** *** DeepinMind *** ******(***** *** **** **** numbers **** * * suffix).

** ***** ********* ***** performance *********** ******* *** first *** ****** ***********, as **** ** ************ of * ******, ** which **** *********:

********* *** *** *** generation, ** *** ******* accuracy ******* ** ***** of ******** **** *** generation ****** ************** ****** rather **** ***** ******...*** 2nd ********** *******, ** plan ** ***** **** in ****** ** *********.

Simple *************

************* ** ********** ** simple, **** ********* ***** to ** ******* ** the *** ****** ***** settings *** "****** ***** Smart ********" ******* ** the ********* ******* ** the ***.

***** ******** **** ** threshold (**** ** ****** in *****) *** *********** can ** ******* *** did *** **** ** impact ** ********* ** our *****.

Rejected ***** ****** ** ***** *** *******

********** *** *** ***** on ******* *****/***** ** the ***** ** **** during *******, **** ** the ***** ** *** left *** ***** *****, one ** *** **** common ***** ****** ** previous ********* *****. ************, shadows **** *****, *****, or ***** ******* **** rejected, * ****** ****** which ********* ***** ********* in **** *****. **** are ***** ***** ******* in *** ****.

No-Alarms-On-Blowing-Branches,-Foliage,-or-Shadows

False ****** ** ****

********** *** ******* ****** with **** ** ******** on *** **** *** heavy ****, ** ***** that******** ****-******** *********,***** ***, *** ************** **************** *** *** ****.

Rain-On-Dome-Causes-False-Alerts

** ******** ** **** on *** ****, *********** in ******* ** *** ground **** ***** **** would ***** ***** ******.

Reflections In Rain Cause False Alerts

False ****** ** ***********

*** ********** ****** **** had ****** ***** ****** on *********** ** ******* of ****.

Reflections-In-Nonmoving-Vehicles-Cause-False-Alerts

False ****** ** *******

*******, ** *** *****, large ******* **** ******** as ****** ** ******** scenes. *** *******, *** dog ***** ******** *********, appearing ** * ******.

Large-Animals-Detected-As-Human

************, ***** ******* ********* triggered ******. *** *******, the **** ***** *** detected ** ***** ******** times ** *** ****.

Small-Animals-Detected-As-Human

Alerts ** ***** *******

*******, ***** ****** **** generated ** ***** ****** in *** ***** ******* changing, **** ** *** sun ****** ****** ******, causing *** ***** ** darken, *****.

Passing-Cloud-Trigger-False-Alert-Due-To-Light-Change

Vehicles ******** ** ****** / **** *****

****** *** ***** ** tested **********, ******** ********** of ****** ********** ** vehicles ** ******** ********** as ****** **** ****.

*** *******, *** ****** walking ******* *** ***** below ** ********** ** a *******. *** ******'* perceived ********** *** ** seen ** *** **** of *** ******** ***, much ***** **** *** person *******.

Human-Detected-As-Vehicle

*********, *** ***** ***** was ************* ** * person ** *** ***, though *** ****** ***** and **** ** ******* different **** * ******.

Vehicle-Detected-As-Human

No ****** ****** ** ******* ******

****** *** *****, ** saw ** ********* ** DeepinMind ******* ****** ******* or ******* ******* *** scene, *** *** ** miss ******** ******* ******* the **** ** ********.

No-Missed-Person-Alerts-During-Day

*** *** *** *** miss ******* **** ******* in ***** ****, *****:

No-Missed-Person-Alerts-During-Night_Heavy-Rain

Demographic **** *******

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*******, **** *********** ** no ****** ********** ***** current ******** (**.*.** ***** 181028) *** **** ******** (v2.8.2.2).

Demographics Removed In New Versions

Version ****

*** ********* ******** **** used ****** *******:

  • ********* ***-*******-**/***: **.*.** ***** 181028

Comments (9)

Undisclosed Integrator #1

06/06/19 07:03pm

***** ******!  * **** you *** **** *** a ****** ** **** out ***** *** ** spectrum ******* **** ***** analytics.  * **** ** real ******* *** *** thermal ******* ********* **** in *********** **** *** optical.

***** ******.

Gary Gibson

06/07/19 12:50am

*** ******* **** *****'* work. **** *** ****:

*****://***.*********.***/**/********/*******-*****-********/**********-******/**********-**-******/***-*******-**/***

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Gary Gibson | 06/07/19 04:01pm

****, ****** *** ******** that ** ** *********, the **** ****** ** working ***.

Undisclosed #2

06/08/19 06:51pm

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*** ***, ** ***** have **** *********** ** see *** *********** **** it **** ** **** on *** **** *** the *****...

Avatar

Ahmet Deveci

CCTV Aware | 06/10/19 07:59pm

*'* *** ** *** a ******** ****** ***** the ********** ***** ** products, ***** ** * shame ****** **** **** is ******** ** ** Hikvision's ****** ** ***** alert ************. *** ***** above ***** **-**** **** been ******* *** ** their ***** ***** ****** and *** **** *** amount ** ***** ****** triggered!

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:02pm

*****, **** ** *******, as ** ********* ** the ******,********** ********* ****** **** ********** and ********** ***** ********* much ****** **** *** conventional ****** /*** *********.

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:07pm

****, *** **** *** look ** * ******* like ******* *** *******, the ******* ** ****** a *****, *** ** animal ** ******** ***** single ****. ** **** the ***** ** ***** 'CCTV' ************* ** *****, hence ** **************.

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:11pm

** ***** **** ** generally ** *** **** - *.*., '********' ********* beating '****' ************* - ******** ** ****** ********* Shootout - ****, ****** / ****, ****** / Ring, ********* / *****

****** ****** ******* **** and **** *** * years ***, ** * ****** speak *** ****. *********, though, ******** ******* **** cloud ************ **** *** advantage ** ***** ***** false ***** ********* ***** has ****** **** (*.*., sent * ********* ***** to *** ***** ***** and *** * ***** / **** ******** ** validate).

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:14pm

****** *** ****, **** informative.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Rhombus Cameras, VMS and Analytics Tested on Nov 06, 2019
Rhombus boasts they have created "the new standard in Enterprise, cloud-managed video security" and told IPVM in January 2019 they offer twice the...
90+ Companies Profile Directory on Nov 05, 2019
While IPVM covers the largest companies in the industry regularly (like Axis, Dahua, Hikvision, etc.), IPVM strives to do a profile post on each...
nFlux AI Startup Profile on Oct 28, 2019
nFlux, an Amazon, Google, and Microsoft funded AI startup told IPVM their mission is to build the most intelligent video analytics platform in the...
RealNetworks SAFR Facial Recognition Profile on Sep 25, 2019
RealNetworks entered the surveillance market by giving away their analytics to schools for free, and is now targeting large commercial users with...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Interlogix Shutting Down on Sep 20, 2019
Interlogix is shutting down, as UTC has confirmed to IPVM in a statement about their "plans to wind down" the once leading brand. Inside this...
Directory of 70 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
AI Video Surveillance (Finally) Goes Mainstream In 2020 on Sep 03, 2019
While video surveillance analytics has been promoted, hyped and lamented for nearly 20 years, next year, 2020, will be the year that it finally...
Scylla AI Video Analytics Company Profile on Aug 29, 2019
Scylla, an AI analytics startup, says they are targeting 1 Billion dollar valuation in 5 years and it "is not rocket science" to detect weapons and...

Most Recent Industry Reports

Hikvision Markets Uyghur Ethnicity Analytics, Now Covers Up on Nov 11, 2019
Hikvision has marketed an AI camera that automatically identifies Uyghurs, on its China website, only covering it up days ago after IPVM questioned...
Open vs End-to-End Systems: Integrator Statistics 2019 on Nov 11, 2019
Preference for open systems is on the decline, according to new IPVM statistics. We asked integrators: For video surveillance systems, do you...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
US Issues Criminal Charges For Fraudulently Selling Hikvision And Other China Products on Nov 07, 2019
The US government has made an unprecedented move on the video surveillance supply chain, charging a US company, Aventura for "having conspired with...
The Access Control Codes Guide: IBC, NFPA 72, 80 & 101 on Nov 07, 2019
For access, there is one basic maxim: Life safety above all else. But how do you know if all applicable codes are being followed? While the...
Rhombus Cameras, VMS and Analytics Tested on Nov 06, 2019
Rhombus boasts they have created "the new standard in Enterprise, cloud-managed video security" and told IPVM in January 2019 they offer twice the...
"Stress in the Residential Market" - Major Lender Exits on Nov 06, 2019
The residential security / 'alarm' market is getting worse, at least for traditional players. Now, one of the biggest lenders in the industry has...
Aiphone Video Intercom Tested (IX Series 2) on Nov 05, 2019
Aiphone was one of integrator's favorite intercom manufacturers but how well do their products work? The company's newest offering, the IX Series 2...
90+ Companies Profile Directory on Nov 05, 2019
While IPVM covers the largest companies in the industry regularly (like Axis, Dahua, Hikvision, etc.), IPVM strives to do a profile post on each...
Hikvision USA Fights LTS on Nov 04, 2019
Hikvision's USA subsidiary is fighting with LTS, having recently quietly dropped LTS as an authorized distributor amidst ongoing face-offs between...

What IPVM Is

The world's leading authority on video surveillance, with 200,000+ visits monthly.

  • Articles on cameras, video analytics, VMS, and trends
  • Tests showing actual performance and problems
  • Courses in surveillance, access control, etc
  • Camera Calculator for designing systems

Dedicated To Independence

We're dedicated to staying independent and objective. We're the only industry source to refuse any and all advertisements, sponsorship, and consulting from manufacturers. Why?