Hikvision DeepInMind Tested Terribly

By: Ethan Ace, Published on Feb 15, 2018

While Hikvision is heavily marketing deep learning and 'AI' as their next big thing, new IPVM test results of their DeepInMind NVR shows their deep learning works terribly.

We bought (via authorized Hikvision distributor ADI) and tested the iDS-9632NXI-I8/16S DeepInMind NVR for a month. It suffered from serious issues across the board, frequently identifying, e.g., vehicles as women, rabbits as people, missing real intrusions, not analyzing certain demographics at all. Plus, it suffers from usability and tech support problems.

Despite this, Hikvision has taken to ADI's February 2018 flyer to tout its clearly broken DeepInMind offering:

Inside this report, we share video, gifs, and images showing the various problems plus examine how Hikvision can improve the system.

Key Findings

Our testing found many significant issues, including:

  • Vehicles detected as humans
  • Animals detected as humans
  • Shadows detected as humans
  • Frequent complete misses
  • Human demographics incorrect
  • Many demographic categories not analyzed at all
  • Many humans not analyzed at all
  • NVR online help missing deep learning information and manual is outdated and incomplete
  • North American tech support willing but unable and untrained to answer questions
  • Underpowered, older Nvidia chip used

We review key issues in this two-minute video:

Update 02/26/18

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Since our test, the iDS-9632NXI-I8/16S has been pulled from ADI's site. Searching for the model number simply returns no results.

Second, multiple sources from Hikvision and close to Hikvision inform us that new firmware is expected to be available by the end of the quarter (March). We will check performance when this firmware is publicly available.

Finally, speaking with tech support now, unlike our initial conversations, the agent we spoke to was familiar with DeepinMind, asking several questions about configuration when asked about false alerts, and asking if it was windy in our test scene. Support also said that they were not directly familiar with DeepinMind and did not have a unit themselves, but instead used a "virtual" emulation of the GUI.

Update May 2018 - Still Not Shipping

DeepInMind is still not shipping in the US and no further firmware updates have been released. Hikvision corporate says the release is "now planned to happen during the next couple of months" but whether that is June, July or later is unclear.

Firmware Improvements Likely Coming

We tested with the USA production firmware version (V4.1.00 build 170915). However, Hikvision appears to be aware of the various problems and is working on improving. Dave Davies from Hikision distributor DVS UK says they have used a different firmware version (V4.1.03 build 180110) available to them in the last few weeks, noting "on latest firmware it does seem to work, you will still see alarms that we deem as false alarms but compared to a system that would use basic PiR detection then this makes a drastic reduction in false alarms." Europe and North America have different model numbers and different firmware management systems. When and how much of a difference new production firmware remains to be seen. However, it would have to get better than the current production situation where the analytics are essentially broken and unusable.

Pricing And Availability

The iDS-9632NXI-I8/16S is available in North America and other regions now. It sells online for ~$3,000 USD not including hard drives, about 3x the price of typical 9600 32 channel NVRs (~$1,000 online).

Major Issue: Objects Incorrectly Recognized As Human

During testing, the NVR's analytics regularly recognized inanimate objects as human, even assigning them gender, color, and other demographic info. The objects this occurred on varied, but all were common.

For example, the NVR recognized the SUV in this clip as a human male (though it correctly indicates it is not wearing a backpack). Multiple vehicles triggered in this way, varying in size, speed, and position in the FOV.

Second, rabbits triggered alarms, and were analyzed as human males. Birds triggered several alarms, as well.

Finally, in the clip below, foliage and grass trigger can be seen triggering an alarm.

Note that these issues were not uncommon and occurred across all cameras at varying rates. For example, looking at only ten of the parking lot camera's human body search results, 8 of 10 objects shown were misclassified.

Major Issue: Frequent Missed Detections

During testing, the NVR frequently missed detections of humans, despite PPF being high, with subjects starting very near the cameras, as shown below.

The same was true in other scenes with humans moving across the scene, even those dressed in high visibility clothing:

Major Issue: Fails To Analyze Most Human Detection Events

The DeepinMind NVR often failed to analyze humans and provide any demographic information, despite having clear, detailed images of subjects. For example, despite clear images of a human male subject approaching the cameras, no demographic information is provided.

Note: No Learning Period Mentioned By Hikvision

Note that Hikvision does not mention a period required by the NVR to "learn" each camera's scene and differentiate between humans and false alert sources. This is not found in any manual we have seen, nor was it mentioned by Hikvision tech support or multiple dealers we have spoken to over the course of testing.

That being said, testing was conducted over a period of weeks, and the NVR continues to analyze the same cameras shown in this report. If performance should notably improve, we will update accordingly.

Confusing/Vague Demographics

The DeepinMind NVR's age demographic categories were overly granular, with confusing categories such as "Teenage", "Young Adult", and "Youth" and no clear indication of what each means.

While this is confusing, it was ultimately a moot point during our tests, because no human's age was provided by the NVR for any camera.

Frequent False Alerts Without False Alarm Filtering

Although false alerts were common in our testing with false alarm filtering turned on, performance was much worse with it turned off. For example, the image below shows only a few alerts seen with filtering turned off, with false activations from changes in light, shadows, foliage, more animals, etc.

Face Picture Retrieval Not Working

The DeepinMind NVR/iVMS also includes an option to search captured face pictures and playback corresponding video. However, in our tests, pictures were simply displayed, not clickable or searchable, with no related video displayed. Note that this feature works only on Hikvision cameras.

Configuration Confusion

In order to use the DeepinMind NVR's analytics instead of those on board cameras, users must check the "Smart Analysis" option in smart event setup. This may be confusing or unclear to many (especially due to its limited documentation) as these options otherwise appear almost identical to those found on typical Hikvision NVRs/cameras.

Users should be aware of two key options:

  • Enable Smart Analysis: This option enables DeepinMind analytics instead of using those found on cameras. Note that camera analytics can be used and received by the NVR, but deep learning will not be applied.
  • Discard False Alarm: This option ignores alerts from objects which the NVR does not determine to be humans, also referred to as false alarm filtering in some documentation.

Making configuration more confusing is the included minimum and maximum size options, threshold, sensitivity, and percentage controls, more typical of conventional VMD than true deep learning. Note that we do not recommend adjusting these options from default (shown above), as missed alerts increase even more when this is done.

Limited Documentation

The DeepinMind NVR's online help (via the web interface) does not reflect any deep learning features. Users searching help to find information on options such as "Discard False Alarm" or "Smart Analysis" will find no results in the NVR's help files.

Furthermore, there is no user manual included with the NVR, either in print or electronically. A user manual from HQ does exist but is missing numerous functions included in the actual UI / product. Moreover, the UI shown in the manual is different from the one delivered in the shipping product. This could be due to different regions or that the manual is dated (the file name indicates May 2017 publication).

Tech Support Problems

Hikvision USA tech support was willing but unable to assist with the DeepinMind NVR. Multiple technicians were totally unaware of what product we were talking about, with senior technicians providing only basic help ("Adjust sensitivity"). Integrators we have spoken to have told us they received limited tech support as well, with regional reps providing what limited support is available.

Usage As Recorder / With Hikvision VMS

Aside from new analytic features, the DeepinMind NVR functions essentially the same as Hikvision's other 9000 series NVRs, using the same web and local interface. Users should see our test results of Hikvision's NVR 4.0 firmware for more details.

To access deep learning features using iVMS, users must use version 2.7. The NVR is compatible with older versions for live and playback, but human analysis features will not be available. For an overview of iVMS-4200, see our test results.

Physical Overview

On the outside, the DeepinMind NVR's enclosure is nearly identical to standard Hikvision 9000 series NVRs.

On the rear, connector layout is the same with only a slight difference in the power supply.

The front of both NVRs is hinged for access to hard drives, with both holding 8 drives:

Inside / Internal Components

The DeepinMind NVR's internal boards are nearly identical to typical Hikvision 9000 NVRs, with practically the same component layout. After completing a month of test, we then opened up the unit to examine internal components (to ensure that would not impact performance in any way).

However, the DeepinMind NVR contains an additional board containing the Nvidia processor, highlighted here:

Lifting the heatsink of the daughterboard above, we can see the Nvidia chip itself, a TM670D-A2:

This chip is a relatively older, less powerful offering and may contribute to the performance problems the unit is experiencing.

Firmware / Version Used

Testing was performed using the following versions:

  • iDS-9632NXI-I8/16S: V4.1.00 build 170915 — This is the NVR's provided firmware. No newer version is available on Hikvision's USA nor European sites, and none was provided by Hikvision support in multiple calls.
  • iVMS-4200: 2.7.0.6 build 20171212

The following cameras were used for testing:

  • DS-2CD4A26FWD-IZH: 5.4.41
  • DS-2CD6026FHWD-A: 5.4.5
  • DS-2CD2355FWD-I: 5.5.0
  • DS-2CD4585FWD-IZH: 5.4.5
  • Axis P3225-LVE Mk II: 7.40.1.1
  • Avigilon 3.0W-H3A-BO1: 2.6.0.160

24 reports cite this report:

Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...
Hikvision DeepinView Camera Analytics Tested on May 08, 2019
Hikvision is expanding its 'deep learning' offerings with a new camera series called 'DeepinView' claiming false alarm reduction and improved...
Hikvision Chairman Warns Of AI New Entrants Victimizing Customers on Mar 12, 2019
Hikvision chairman Chen Zongnian has warned that customers will become “victims” of AI hype from new industry entrants, even saying such newcomers...
The False SCMP Story on Hikvision NYC AI on Jan 14, 2019
In the past week, one of Asia's largest publications, the South China Morning Post (SCMP), posted an article about "Chinese [facial recognition]...
Worst Products Tested In Past Year on Jan 09, 2019
IPVM has done over 100 tests in the past year. But which products performed the worst? Which ones should users be most aware of? In this report,...
2019 Video Surveillance Cameras Overview on Jan 07, 2019
Each year, IPVM summarizes the main advances and changes for video surveillance cameras, based on our industry-leading testing and...
Hikvision President Addresses AI and USA Challenges on Oct 31, 2018
In frank recent China interviews, Hikvision's President Hu Yangzhong has addressed challenges impacting the video surveillance industry and...
IPVM Launches Best New Product Awards on Oct 25, 2018
IPVM is launching its own Best New Video Surveillance Product Awards in 2019. The goal is to provide the industry with a legitimate program, based...
Huawei Admits AI "Bubble" on Oct 16, 2018
A fascinating article from the Chinese government's Global Times: Huawei’s AI ambition to reshape industries. While the Global Times talks about...
Dahua Face Recognition Camera Tested on Oct 15, 2018
Dahua has been one of the industry's most vocal proponents of the value that AI creates: As part of this, Dahua has released a facial...
ASIS GSX 2018 Show Report on Sep 25, 2018
In the first major US show since the US government ban of Dahua and Hikvision was passed into law, the mega Chinese companies were in retreat and...
Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...
Hikvision Strong Domestically, International Business Struggles on Jul 25, 2018
Hikvision's H1 2018 results are out. Overall revenue growth has sharply dropped, with the company acknowledging their "facing geopolitical...
The Hikvision Smart Classroom Behavior Management System on May 22, 2018
Hikvision's rapidly growing offering of analytics, which we most recently examined with Hikvision's ethnic minority analytics, is now going into...
Hikvision's Minority Analytics on May 08, 2018
Hikvision has developed and is deploying minority analytics inside China, automatically identifying and categorizing individuals as ethnic...
Hikvision VMD And Intrusion Analytics Tested on May 04, 2018
VMD worked poorly on Hikvision cameras, new IPVM testing found. However, Hikvision ships analytics on practically every IP camera, with intrusion...
Correcting Hikvision USA's False Accusations on May 01, 2018
Hikvision USA has falsely accused IPVM's DeepInMind test. The truth, which Hikvision USA knows, despite their statements to the contrary, is...
FLIR Launches Saros on May 01, 2018
Has FLIR solved the video intrusion / remote monitoring problem or have they created an overkill, overly expensive device? FLIR has launched...
VMS New Developments Spring 2018 (Avigilon, Exacqvision, Genetec, Hikvision, Milestone, Network Optix) on Apr 04, 2018
What's new with VMS software? In this report, we examine new features and releases for Spring 2018 to track different areas of potential...
Favorite Video Analytic Manufacturers 2018 on Apr 02, 2018
Video analytics is one of the biggest trends in 2018, driven by marketing for Artificial Intelligence and Deep Learning. But what do integrators...
False Advertising: Hikvision USA Deep Learning on Feb 23, 2018
Hikvision USA is conducting a false advertising marketing campaign for their deep learning system. Hikvision USA's claim violates US FTC Truth In...
Why 3VR Failed on Feb 16, 2018
3VR destroyed transformed ~$65 million in VC funding into a $6.9 million exit. The reason they failed is simple. They bet on analytics. They...
Top ISC West 2018 Booth Moves on Jan 23, 2018
ISC West spending frequently signals market expansion and trend shifts. In 2016, the surge of Chinese exhibitors underscored the race to the...
Directory Of 109 Video Analytics Suppliers on Jan 04, 2018
This directory provides a list of video analytics providers to help you see and research what options are available. Video...
Comments (121) : PRO Members only. Login. or Join.

Related Reports on Video Analytics

History of Video Surveillance on Jul 19, 2019
The video surveillance market has changed significantly since 2000, going from VCRs to emerging into an AI cloud era.  The goal of this history...
Wyze AI Analytics Tested - Beats Axis and Hikvision on Jul 17, 2019
$20 camera disruptor Wyze has released free person detection deep learning analytics to all of their users, claiming users will "Only get notified...
Ivideon Russian VSaaS Profile on Jun 27, 2019
Ivideon was an early VSaaS entrant, initially focusing on the consumer market, claiming massive growth to IPVM in 2014. We spoke to Ivideon, to...
Directory of 60 Video Surveillance Startups on Jun 25, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...
Startup Vaion Launching End-to-End AI Solution Backed with $20 Million Funding on Jun 17, 2019
An EU / USA video surveillance startup, Vaion, founded by ex-Cisco Senior Directors is launching an end-to-end VSaaS platform with $20 million in...
Sighthound Transforms Into Enterprise AI Provider Profile on Jun 14, 2019
Sighthound is now rapidly expanding its R&D team, building an enterprise AI service. This may come as a surprise given their origins 6 years...
Embattled $400 Million China Funded Philippines Surveillance System Proceeds on Jun 13, 2019
An embattled 12,000 camera surveillance system project that will cost ~$400 million will proceed.  The project contract was awarded, had its...
Carnegie Mellon AI Startup Zensors Profile on Jun 11, 2019
Zensors is a startup formed by Carnegie Mellon graduates from a Carnegie Mellon research project, offering customized models per camera that they...
Directory of 30+ VSaaS / Cloud Video Surveillance Providers on Jun 07, 2019
This directory provides a list of VSaaS / cloud video surveillance providers to help you see and research what options are available. 2019 State...

Most Recent Industry Reports

History of Video Surveillance on Jul 19, 2019
The video surveillance market has changed significantly since 2000, going from VCRs to emerging into an AI cloud era.  The goal of this history...
Mobile Access Usage Statistics 2019 on Jul 18, 2019
The ability to use mobile phones as access credentials is one of the biggest trends in a market that historically has been slow in adopting new...
New GDPR Guidelines for Video Surveillance Examined on Jul 18, 2019
The highest-level EU data protection authority has issued a new series of provisional video surveillance guidelines. While GDPR has been in...
Wyze AI Analytics Tested - Beats Axis and Hikvision on Jul 17, 2019
$20 camera disruptor Wyze has released free person detection deep learning analytics to all of their users, claiming users will "Only get notified...
Anyvision Aims For 2022 Revenue of $1 Billion on Jul 17, 2019
Only 3 video surveillance manufacturers do a billion dollars or more in annual revenue - Hikvision, Dahua, and Axis. Now, Anyvision plans to join...
HD Analog vs IP Guide on Jul 16, 2019
For years, HD resolution and single cable signal/power were IP camera advantages, with analog cameras limited to much lower resolution and...
How To Troubleshoot Wiegand Reader Problems - Inverted Wiring on Jul 16, 2019
Wiegand is the dominant method of connecting access readers, but problems can arise for installers. In fact, one of the most difficult reader...
ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
Motorola Acquires Watchguard, Adds to Vigilant And Avigilon on Jul 15, 2019
2 years ago, Motorola had no position nor relevancy to video surveillance. Now, they own major video surveillance, LPR and body camera providers...
Hikvision Global News Reports Directory on Jul 15, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact