Hikvision DeepinMind 2019 Test

By: Rob Kilpatrick, Published on Jun 06, 2019

In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics, completely missing humans in the scene and more issues.

free-images

Now, after a year of firmware updates, Hikvision claims significant improvements in human detection and more accurate intrusion performance.

We tested the latest firmware on the iDS9632NXI-I8/16S DeepinMind NVR we bought for our original tests to see how it performs, examining:

  • False alert performance: What did and did not cause false alerts?
  • Intrusion detection accuracy: Did it miss valid people or vehicles in the scene in multiple conditions?
  • Ease of setup: How difficult or time-consuming was setup and optimization?
  • Vs. competitive analytics: How did DeepinView compare to Avigilon's self-learning camera analytic cameras?

** ****, *********'* ********** AI *** ********* ********, *********** ********, *******, and ***** ******* ** humans, ************** ************, ********** missing ****** ** *** scene *** **** ******.

free-images

***, ***** * **** of ******** *******, ********* claims *********** ************ ** human ********* *** **** accurate ********* ***********.

** ****** *** ****** firmware ** *************-**/*** ********** ***** ****** *** *** original ***** ** *** how ** ********, *********:

  • ***** ***** ***********: **** did *** *** *** cause ***** ******?
  • ********* ********* ********: *** it **** ***** ****** or ******** ** *** scene ** ******** **********?
  • **** ** *****: *** difficult ** ****-********* *** setup *** ************?
  • **. *********** *********: *** did ********** ******* ** Avigilon's ****-******** ****** ******** cameras?

[***************]

*******

***** ** * ***** of ******* *** ********* thousands ** ******, *** DeepinMind *** *** **** positives:

  • ** ****** **********:** ****** *******/******* ** vehicles ******* ******* *** scene **** ****** ****** a ***** ** ******* in ******* ********** ********* day, *****, *** ***** rain.
  • ** ****** ** *******:********** *** *** ***** on *** ******* ** our *****, ********* ******* wires, ********, ** ***** objects.
  • ** ****** ** ******* brush:******* *****/******** *** ******* by ********** ********** *******, a ****** ****** ** false ****** ** ********* *********.

*******, **** ******** ***** suffered **** ******** ****** seen ** *** ******** tests ** **********, *********:

  • **** ** **** ******** alerts:***** ******** ******* **** camera ***** ********* ****** during ***** **** *****, light ** *****. ****** were *** ********* ** raindrops **********, **** ********* on *** ****.
  • *********** ******* ******:*********** ** ****** *** outdoor *****/********** ** ***-****** vehicles ***** ********* ***** positives.
  • ************* ****** *** ********:****** *******, ********** ************ misidentified ****** ** ******** and **** *****.
  • *****/***** ******* ******* ****** alert:******* ****** ** ***** alerts *** ***** *** large ******* ******* ******* the *****, *** ****** would ******** ** ********** as * *****.

**** **** ** ********* to ****** **** ******** as ********* ** ********* technical *******, **** ** threshold (******* **** ****** is ** *****) *** minimum *** ******* **** settings, *** ******* ** these ******* ******** * material ****** ** ***** alerts.

Vs. ********* ********* ********* / ****** ***

******* *** *********** ***** alert ******, ********** ***** outperforms *********'* ******* **-******/*** intrusion ********* ********* (*** *** ****), ***** ********** ******* on ******** *******, **** as *****, *******, *******, light *******, *** **** specs ** **** ** some *****. ** ***** where ******* *** **** will *** ** ******, such ** ******** ************, DeepinMind *** ******* ******** detection ***** ******** ********* may ***.

************, ******** ** ******** VMD, *********** ** *********** better, ** **** ****** side *** ***** ****** alarm ** *** ***** change, ********* *** *** limited ** *** ****** false ***** ******* *****, without ************** ******* ******, vehicles, ** ***** *******.

Vs. ********* **********

** *** *****,*********'* ************** ******** ******** ****** offered ****** ***** ***** performance **** *** ********** NVR, ******** ****** **** rain ** ******** ** shadows *** *****. ************, false ****** **** ***** sources **** **** ******** in *** ********** ******.

**** *********** ********** ** likely *** ** ********** used, ** *** ********** NVR **** * ******, older ********** **** ******** chip *** *** ********, while ********** ******* *** a **** ******** **** for * ****** ******* of *****.

Vs. ******** ****-******** *********

** *** *****, ********** was ********* ********* ** false ***** ******* ***** Avigilon's ** ****-******** ******** cameras ********. ** *** tests, ** ******** ****** in *** **** ****** was *** ********* ** any ******* ****** ******* days ** *******, *** light *******, *******, *******, etc.

Little ********** ** ****** ***********

** *** *****, *** DeepinMind *** ********** ********* regardless ** **** ****** of ********* ****** *** used *** *******. ***** were ********* **** *, 4, *, *** * series ******, **** *********** effectively ******* ******* ****.

Updated ******** ******

**** **** *** ********* using *** ******** ******* of ********** *** ********. However, ******* ** ***** America, ********* *** ******** a****** ********** ** *** DeepinMind *** ******(***** *** **** **** numbers **** * * suffix).

** ***** ********* ***** performance *********** ******* *** first *** ****** ***********, as **** ** ************ of * ******, ** which **** *********:

********* *** *** *** generation, ** *** ******* accuracy ******* ** ***** of ******** **** *** generation ****** ************** ****** rather **** ***** ******...*** 2nd ********** *******, ** plan ** ***** **** in ****** ** *********.

Simple *************

************* ** ********** ** simple, **** ********* ***** to ** ******* ** the *** ****** ***** settings *** "****** ***** Smart ********" ******* ** the ********* ******* ** the ***.

***** ******** **** ** threshold (**** ** ****** in *****) *** *********** can ** ******* *** did *** **** ** impact ** ********* ** our *****.

Rejected ***** ****** ** ***** *** *******

********** *** *** ***** on ******* *****/***** ** the ***** ** **** during *******, **** ** the ***** ** *** left *** ***** *****, one ** *** **** common ***** ****** ** previous ********* *****. ************, shadows **** *****, *****, or ***** ******* **** rejected, * ****** ****** which ********* ***** ********* in **** *****. **** are ***** ***** ******* in *** ****.

No-Alarms-On-Blowing-Branches,-Foliage,-or-Shadows

False ****** ** ****

********** *** ******* ****** with **** ** ******** on *** **** *** heavy ****, ** ***** that******** ****-******** *********,***** ***, *** ************** **************** *** *** ****.

Rain-On-Dome-Causes-False-Alerts

** ******** ** **** on *** ****, *********** in ******* ** *** ground **** ***** **** would ***** ***** ******.

Reflections In Rain Cause False Alerts

False ****** ** ***********

*** ********** ****** **** had ****** ***** ****** on *********** ** ******* of ****.

Reflections-In-Nonmoving-Vehicles-Cause-False-Alerts

False ****** ** *******

*******, ** *** *****, large ******* **** ******** as ****** ** ******** scenes. *** *******, *** dog ***** ******** *********, appearing ** * ******.

Large-Animals-Detected-As-Human

************, ***** ******* ********* triggered ******. *** *******, the **** ***** *** detected ** ***** ******** times ** *** ****.

Small-Animals-Detected-As-Human

Alerts ** ***** *******

*******, ***** ****** **** generated ** ***** ****** in *** ***** ******* changing, **** ** *** sun ****** ****** ******, causing *** ***** ** darken, *****.

Passing-Cloud-Trigger-False-Alert-Due-To-Light-Change

Vehicles ******** ** ****** / **** *****

****** *** ***** ** tested **********, ******** ********** of ****** ********** ** vehicles ** ******** ********** as ****** **** ****.

*** *******, *** ****** walking ******* *** ***** below ** ********** ** a *******. *** ******'* perceived ********** *** ** seen ** *** **** of *** ******** ***, much ***** **** *** person *******.

Human-Detected-As-Vehicle

*********, *** ***** ***** was ************* ** * person ** *** ***, though *** ****** ***** and **** ** ******* different **** * ******.

Vehicle-Detected-As-Human

No ****** ****** ** ******* ******

****** *** *****, ** saw ** ********* ** DeepinMind ******* ****** ******* or ******* ******* *** scene, *** *** ** miss ******** ******* ******* the **** ** ********.

No-Missed-Person-Alerts-During-Day

*** *** *** *** miss ******* **** ******* in ***** ****, *****:

No-Missed-Person-Alerts-During-Night_Heavy-Rain

Demographic **** *******

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*******, **** *********** ** no ****** ********** ***** current ******** (**.*.** ***** 181028) *** **** ******** (v2.8.2.2).

Demographics Removed In New Versions

Version ****

*** ********* ******** **** used ****** *******:

  • ********* ***-*******-**/***: **.*.** ***** 181028

Comments (9)

Undisclosed Integrator #1

06/06/19 07:03pm

***** ******!  * **** you *** **** *** a ****** ** **** out ***** *** ** spectrum ******* **** ***** analytics.  * **** ** real ******* *** *** thermal ******* ********* **** in *********** **** *** optical.

***** ******.

Gary Gibson

06/07/19 12:50am

*** ******* **** *****'* work. **** *** ****:

*****://***.*********.***/**/********/*******-*****-********/**********-******/**********-**-******/***-*******-**/***

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Gary Gibson | 06/07/19 04:01pm

****, ****** *** ******** that ** ** *********, the **** ****** ** working ***.

Undisclosed #2

06/08/19 06:51pm

******** ********/**** ******** ******* demographic **** ***** *** people ********, **** ** age, ******, *** ******* they *** ******* * backpack ** *******.

*** ***, ** ***** have **** *********** ** see *** *********** **** it **** ** **** on *** **** *** the *****...

Avatar

Ahmet Deveci

CCTV Aware | 06/10/19 07:59pm

*'* *** ** *** a ******** ****** ***** the ********** ***** ** products, ***** ** * shame ****** **** **** is ******** ** ** Hikvision's ****** ** ***** alert ************. *** ***** above ***** **-**** **** been ******* *** ** their ***** ***** ****** and *** **** *** amount ** ***** ****** triggered!

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:02pm

*****, **** ** *******, as ** ********* ** the ******,********** ********* ****** **** ********** and ********** ***** ********* much ****** **** *** conventional ****** /*** *********.

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:07pm

****, *** **** *** look ** * ******* like ******* *** *******, the ******* ** ****** a *****, *** ** animal ** ******** ***** single ****. ** **** the ***** ** ***** 'CCTV' ************* ** *****, hence ** **************.

John Honovich

IPVM | In reply to Ahmet Deveci | 06/10/19 08:11pm

** ***** **** ** generally ** *** **** - *.*., '********' ********* beating '****' ************* - ******** ** ****** ********* Shootout - ****, ****** / ****, ****** / Ring, ********* / *****

****** ****** ******* **** and **** *** * years ***, ** * ****** speak *** ****. *********, though, ******** ******* **** cloud ************ **** *** advantage ** ***** ***** false ***** ********* ***** has ****** **** (*.*., sent * ********* ***** to *** ***** ***** and *** * ***** / **** ******** ** validate).

Avatar

Ahmet Deveci

CCTV Aware | In reply to John Honovich | 06/10/19 08:14pm

****** *** ****, **** informative.

Login to read this IPVM report.

Related Reports

Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
K7 Wall Mounted IR Temp Gun Tested on Jun 26, 2020
The original K3 model was missing a number of important features but the...
Injes Tiny Temperature Terminal Tested on Jul 17, 2020
While temperature terminals have trended bigger, the Injes DFace801 is...
K3 Wall Mounted IR Temperature Gun Tested on Jun 12, 2020
Is this the solution to not spending thousands of dollars on fever...
Dahua Smart Motion Detection Camera Tested on Mar 03, 2020
Dahua has introduced Smart Motion Detection, AI-based VMD, claiming to use an...
Dahua, Hikvision, ZKTeco Face Mask Detection Shootout on Jun 19, 2020
Temperature tablets with face mask detection are one of the hottest trends in...
Vivotek LPR Camera Tested on Apr 15, 2020
Vivotek has historically sold license plate capture cameras but not LPR. Now,...
Integrated IR Camera Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Jan 30, 2020
The best and worst cameras tested in this IPVM shootout showed major...
Spectron IR Thermal Fever Screening System Examined on Apr 14, 2020
Most are quick to avoid "fever screening" and "medical" labels, but...
FLIR A Series Temperature Screening Cameras Tested on Jun 04, 2020
FLIR is one of the biggest names in thermal and one of the most conservative....
Kentix SmartXcan Fever Screening Device Tested on Jun 22, 2020
German manufacturer Kentix has declared "FEVER-SCREENING REINVENTED" with its...
Sunell Panda Cam Body Temperature Measurement Camera Tested on May 14, 2020
Sunell is far less well known than its gargantuan domestic competitors Dahua...
Mobotix Thermal Detection Camera Tested on Jun 09, 2020
For years Mobotix has struggled but now sales are surging driven by Mobotix's...
Dotty "Hot Or Not" Elevated Body Temperature App Tested on Jun 01, 2020
What if you could take an existing phone or tablet and transform it into...
Avigilon Face Mask Detection Tested on Jun 24, 2020
Face mask detection or, more specifically not wearing a face mask, is an...

Recent Reports

Taiwan Lilin NDAA Compliant Cameras Tested on Aug 13, 2020
Taiwan-based manufacturer Lilin is taking direct aim at Dahua and Hikvision...
White House Expands Dahua Hikvision Blacklist To Federal Funding on Aug 13, 2020
The White House is expanding the NDAA to blacklist anyone who "uses" banned...
Actual Coronavirus Testing Options Examined on Aug 13, 2020
Fever cameras have emerged as an indirect and flawed way to test for...
Video Analytics Online Show September 2020 Opened - Axis, Avigilon, Bosch, BriefCam, Genetec, Milestone + 30 More on Aug 12, 2020
IPVM's sixth online show will feature 35+ Video Analytics companies...
The German Company Powering Many China Temperature Tablets (Heimann) on Aug 12, 2020
Many fever tablet suppliers market German-made Heimann thermal sensors while...
Salesforce Drops Dahua and Hikvision on Aug 12, 2020
Salesforce has dropped Dahua and Hikvision as customers, forcing the two mega...
Access Control Course Fall 2020 - Register Now on Aug 12, 2020
IPVM offers the most comprehensive access control course in the industry....
Genetec CEO Declares "We Don't Negotiate Payment With Patent Trolls" on Aug 11, 2020
Are patent trolls like terrorists? Genetec's CEO is coming out strongly...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020
The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...
HID Releases VertX Replacement Aero on Aug 10, 2020
HID is replacing two established and broadly supported types of access...
NDAA Compliant Video Surveillance Whitelist on Aug 10, 2020
This report aggregates video surveillance products that manufacturers have...
Telpo China Temperature Tablets Tested on Aug 10, 2020
The provider for overseas companies ranging from Canon Singapore to US'...
Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...