Hikvision DeepinView Camera Analytics Tested

Avatar
Rob Kilpatrick
Published May 08, 2019 12:58 PM

********* ** ********* *** '**** ********' offerings **** * *** ****** ****** called '**********' ******** ***** ***** ********* *** improved ********.

IPVM Image

** ****** *********** ***** ****** ****** (**-*********-****)*** ****** ** ******** ****** *** over *** ***** ** *** *** it ******** *********:

  • ***** ***** ***********: **** *** *** did *** ***** ***** ******?
  • ********* ********* ********: *** ** **** valid ****** ** ******** ** *** scene ** ******** **********?
  • **** ********* ***********: *** **** ********* work ******** ** **** ***** *** low ***** ** ******** ******?
  • **** ** *****: *** ********* ** time-consuming *** ***** *** ************?
  • **. *********** *********: *** *** ********** compare ** ****** ********* **** ***** ****** ********* ******** - ********, Axis, *****, *****, ******, *********, *******?
  • **** ********** **** ** ***? *********, Huawei, *****, ******, ******?
  • **** ********** **** ******** ******* ****?

Performance *******

***** ** *** ***** ** *******, reviewing ********* ** ******, *** ********** DS-2CD7A26G0-IZHS *** ******* *********:

  • ** ****** *********:****** ******* *** ****** ******* ** avoid ***** ****** ** ******* ** the ***** **** ******* ********, *****, etc., ****** ** **** ***** ******** cameras.
  • ** ****** ** ****: *** ********** ****** *** *** alert ** ***** **** ** *** scene, *** ** *** **** ****** sources ** ***** ****** ** *** past ********* *****.
  • ** ****** **********:****** *******/******* ******* *** ***** **** not ****** ****** *** ***** ** testing ** ******* **********, ***, *****, and ** ****.
  • **** ********* **** ******** ** **** light:** **** *** ******, **** ********* did *** **** *** *****, **** at ***** **° ******* ** **** partially ********.
  • ****** *************:************* ** *** ******** ******** **** enabling ********* ********* ** **** *********, with *** ****** ********** ** * full ****** ****.

*******, ** ******** **** ***** ****** on ******* ******* *** ******* **** detection *********** ** *** *****:

  • ***** ******* ******* ******** ******:** *** *****, *** ********** ****** regularly ******* ** ***** ******* *****, sheep, *** ****, * *** ***** per ***. ******* ******* **** ** birds, ****, ********* **** ******* ** but **** **********. ** ** ******* if *** ****** *** ***** ******* as ***** ** *******, ** ** does *** ******** *******.
  • ******* ***** *******: ******* ***** ******* **** ** lights ** * **** ******* ** or **** ********* ******** ****** ***** alarms.
  • **** ********* *********** ***** ** ****/*** light:** *** *****/**** ****** **** ** on, **** ********* *********** ****** ************, sometimes ********** ******* ********, ********** **** at ******* ****** ** ******* ****** the *****.
  • ******** ******* *********: *** ********** ****** **** ** testing (****** ******* ** ************) ******* with ******** *.*.*, ***** ********* ***** poorly, **** ***** ****** ** *****, shadows, ****, ***. *** **** ** later ********. ********* ******** ** *.*.**, available ** ***** ******* *** *** yet ** *** *** ****, ****** they *** ** ** ********* ** the ******* ** ***** ********* *** added. *** **** ******* *** ***** on *.*.** *** ** ********* *** users **** ******* ******** ** ******* to ****.

Vs. ******** ****-******** *********

********** *** ********* ********* ** ***** alert ******* ***** ********'* ** ****-******** analytic ******* ********. ** *** *****, an ******** ****** ** *** **** scenes *** *** ********* ** *** animals ****** ******* **** ** *******, nor ***** *******, *******, *******, ***.

Vs. ***** ********* *********/***

********** *********** ** *** ***** ** beyond **** ** **** *********** ********* ** **** ******, ********* **** (********* ******** *** Motion *****), ****** ******* *, *****, and *********'* *** ******** ********* ********* analytics, **** **** ****** ********* ** foliage, *******, ****, *** **** ***** animals.

***** **** ********, *** **** ******** from *** ******** ******** *********** ****** DeepinView ** *****'* ***, ***** ******** animals, ****, *******, *** ****, ****** occasionally *** ****** **** *******. ***** setup ** **** ******* **** *********, however, ********* ******* ***** ** ********* and ******* *********** *** **** ******, instead ** ****** ******** *** ****.

******** ** ******** ***, *********** ** drastically ******, ** **** ****** **** VMD ***** ****** ***** ** *** pixel ******, ********* *** *** ******* to *** ****** ***** ***** ******* above, ******* ************** ******* ******, ********, or ***** *******. *******, ********** ** far **** ********* **** ************ *******.

*******

*** **-*********-**** ***** *** ~$*** *** online. **** ******* ** ********** *******'* ********* **** **(******* ***** *** *****/******** ******), ****** moderately ****** ************'* ******** ******* (~$***-*** ********* ****** *****).

*** ***-** * ****** ********** ** this ****** (**-*********-****) ***** *** ~$*** ******, ****** deep ******** * ~$*** *** **.

Physical ********

*** ********** ****** ** ********** ******* to *********'* ***-**** ******** ****** ******. It ** ******* ** **** *** construction ** ***** **** **** *******, such ** ****** (***** *****), ******** longer, **** ** ******** **** ***.

IPVM Image

** ****** *** ******** ** *** camera ** **** *****:

DeepinView ********

*********** *** ********** ****** ** ******. Users *********** **** **** ** ****** Intrusion ********* (** **** *********). ***** settings *** ** **** ** ******* (full ****** ********* ****, *** *******/******* object **** ********), *** *** * limited ****** ** *********** ** *** tests.

** ****** *** ***** ***** ** this *****:

Rejected ***** ******: ****, *****, *******

*** ********** ****** ******** **** ***** alert ******* **** ******** *********** ** past ********* *****.

*** *******, ********** *** *** ***** on ***** **** ****** *** *******, through ******* ****** *** *** *****. This *** *** ** *** **** common ******* ** ****** ** **** tests, **** ****** ***** ******** ****** frequently ******** ** *********.

No-False-Alerts-In-Heavy-Rain-Wind

*** ****** **** ******** ****** ****** by ******* ********/******* ** **** ** the ******* **** ******, ******* ****** issue ** **** *****.

No False Alerts On Brush Shadows

Regular ***** ****** ** *******

*** ********** ****** *** ******* ****** with ***** ****** ** ***** *******, such ** **** ** *** ******** of *** ***** ** **** *****.

False-Alert-On-Dogs-In-FOV

** **** ******* ** ***** *** sheep (***** *****). ** ** ******* whether *** ****** ********** ***** ******* to ** ****** ** ********, ** it **** *** ******* ************* ** provide ****** ** ****** ********.

False-Alert-On-Sheep-In-FOV

Fewer ****** **** ***** *******

**** **** *** ****** **** ************ alerted ** ***** *******, ********* * few ***** ** *** *******, ****** at * **** ***** **** **** larger *******, ***** ********* ****** ***** time **** **** ** *** *****.

False-Alert-On-Birds-In-FOV

*******, ** ******* *** *** ** the ***** *****, ***** ***** ******** on **** ******* ****.

No-Alert-On-Cat-In-Scene

Alarms ** ***** *******

******* ****** ****** ** ***** ****** was ******* ***** *******. **** ******* in ******** ******, ********* ******** ****** a ************:

Alert After Lightning Flash

No ****** **********

****** * **** ** ******* ** various ******, ****** ** **** **** not ****** **** ******** *** ***** of **** ** *** ****** ******* or *******.

No-Missed-Detections

****** ********* **** ********* **** ** heavy ****, ******** ** *** ****** walking ** *** ***** *** ******** the ****.

People Detection In Heavy Rain

Person/Vehicle ********* ***** ***********

** *** *****, *** ********** ****** was **** ** ******** ****** ****** at ***** ~** *** (~***' ******** using * ~***' ****). **** **** detected ** **** ** **** ********, ~530', ***** *-* ***.

**** ** ********** ****** **** ******** during *** *** (~* ***), ****** lower ** *****, ***** ******** ******** as **** ** ~** *** *** detection. ***** *** ******** *** *** night ** ~*-* *** ** *** tests.

IPVM Image

Face ********* ***********

*** ********** ****** **** ******** **** detection, ***** *** ** ******* ******* of ********* *********, *** *** *** cannot ** **** **************. **** ******* is ******* ** ********* ** ** in *** "*** ********" *** ** basic *************. "***** *****" ****** ** typical ******** ***** **** ** ********* detection *** **** ********.

Smart-Event-Or-Face-Capture,-Not-Both

** *** ******* **** ********* ****** well ** * **** ***** ***** (~200lx), **** ********* *** ******** **** at ******* ******* ** **** (~** degrees) *** ******* ******** ****** *** scene ******** **** **** ** *** face.

Face-Detection-Works-Well-In-Full-Light-Harsh-Angles

** *** *****, **** ** ** or ***, *********** *********, **** *** camera ******* ***** ** ******** ******* across *** *****.

Face-Detection-Misses-In-Low-Light-IR

Movidius ****** * *** ****

*** ********** ****** **** ******* ******** ****** * ****** ********** unit (***), ******** *****.

IPVM Image

******** ** ************* ***, ***** **** * ****** ***** Nvidia ********* *** ** ******** ** intrusion, ********** * ****** * ** a ****** ******* ** ***** ******** much ******* ********** *****. ** ******* move ** *** ***** ****** * in *** **** *** *****, ********** gains *** ******, ** *** ****** X ** ******* **** ******** **** the ****** * (*** *** ****).

Unknown ***

** **** **** * ******* ******* SoC, *** *** ********* ** ********* labeled ***** ********* **** ** ***** cameras:

IPVM Image

* ****** *********** ****** ********* * possible *******:

  • * *********-******** ***, ******* ** ***** the ***** ***** ***** **** **** historically **** ** ***** ******. "**** would **** **** *** ***** ******** they **** ** * ****** ** bargain ******** ******* ****** ********."
  • * ********* *** **** ******* *********, e.g., *********. ***** ***** ********** *****, Hikvision *** ** ***** ***** ** others **** ***** **** ** ****. "It **** *** **** **** **** volume ** ***** ***** **** **** your *** ****** ******** ** ****... so ** ***** ** **** * normal *** *** ***** ********* ****, but **** ********* ********. "

Versions ****

*.*.** ******** *** **** *** *** Hikvision **-*********-**** *** ** *** ***** of *** ********.

** **** ****** *.*.* *** *.*.** (what *** ******* ** ** *** is ***** ****** ** ********* *** as *******), ******** ** ***** ******** was ******* *****, ********** *.*.*, ***** alerted ** *******, *****, ****, *** more ******* ***** ***** ******** *** not. ** *** *** ******* *** examples **** *.*.* ** *.*.**, *** users ****** ** ***** ** *** substantial ********** ** ***********.

Country ** ******

*** **-*********-**** *** **** ** *****.

Comments (15)
U
Undisclosed #1
May 08, 2019

Any data on range/FOV? Eg was the stated performance seen at a range of 100M over a 90degree FOV, or 20M over a 30degree FOV?

Avatar
Ethan Ace
May 08, 2019

In our tests, the DeepinView camera was able to reliably detect people at about ~11 PPF (~160' distance using a ~175' HFoV). Cars were detected at over 3x this distance, ~530', about 3-4 PPF. Those numbers are using a ~60° FOV.

(2)
JH
John Honovich
May 08, 2019
IPVM

Here is some backstory to the test.

Hikvision USA tech support was not helpful with this model (not blaming them, this is a common pattern we see, they are generally not trained on new / advanced products). Tech support verified what was publicly shown in the US that .81 was the latest.

This time, Hikvision management actually provided tech support. We reached out to European contacts who confirmed that .91 was better. To Hikvision's credit, the USA team gave us a direct link to the .91 firmware so we could test.

You will recall last year's disastrous DeepInMind NVR test where Hikvision refused support.

Related to that, we have updated firmware for DeepInMind. However, the USA is only selling the 'A' hardware version currently (which is what we bought) while Europe has the 'B' hardware, which is presumably better. We are trying to navigate through this.

P.S. - please Hikvision, don't ship until you have fully optimized firmware. If you still need to improve, that is what beta is for, production customers (at least in the USA) expect production-ready products.

(1)
U
Undisclosed #2
May 08, 2019

Letting the market test products is common for Chinese manufacturers. In my experience with both dahua and hikvision virtually all first release products have a huge range of bugs and require a a lot of adjustments to the firmware to get them right. Most of the information they use comes from distributors or system integrators who have had the misfortune of buying and installing these types of first release products which  really are just a “beta” style product.

(2)
(2)
Avatar
Vincent Tong
May 09, 2019

But .... where did you get the sheep from ?

(7)
UI
Undisclosed Integrator #3
May 09, 2019

The issue with the sheep goes into GDPR territory. Did anyone seek their permission? Has AI been used without the birds, cats or sheeps knowledge? What's been done with the stored data and do any of the targets form part of an ethnic minority group? I'm not convinced IPVM is taking their data protection responsibilities seriously.

Otherwise a very decent report Ethan. I'm curious though - during the two-week test just how much learning took place and did the false positives improve over time - giving the potential for further improvement?

And slightly off-tangent, given Trumps latest sabre-rattling - how do tariffs affect the Intel product element of the camera? Just curious.....

(1)
(1)
JH
John Honovich
May 09, 2019
IPVM

What's been done with the stored data and do any of the targets form part of an ethnic minority group?

I think you are joking but I don't think it's funny to make use of human rights abuses. Accept that Hikvision is profiting off it, also see The Chinese Surveillance State (Part 1 And 2)

As for Intel, tariffs would not be much of an impact but sanctions against Dahua and Hikvision for their profiting from human rights abuses would.

UI
Undisclosed Integrator #3
May 09, 2019

I put that in there for you John so you could have your fix.....

Disappointing you didn't engage with the technical query though, and just took the opportunity to get the soapbox out.

(2)
(3)
JH
John Honovich
May 09, 2019
IPVM

I did not administer the test. That you think it's funny to joke about human rights abuses says a lot about you.

I'll have Ethan address your question about improvement. In the future, if you want to ask a technical question, ask it without joking about oppressing ethnic minorities.

(3)
UI
Undisclosed Integrator #3
May 10, 2019

I won’t seek to undermine or devalue Ethan’s work by perpetuating your rant and detracting from the report.

(2)
JH
John Honovich
May 10, 2019
IPVM

You have undermined and devalued Hikvision by bringing up their profiting from human rights abuses in a post that had nothing to do with that.

(1)
Avatar
Ethan Ace
May 10, 2019

We saw no improvement over time. It’s pretrained, and may improve from firmware version to firmware version, but it did not stop alerting on branches after several days in the same scene or start ignoring dogs after seeing them in the same area. Also there is no way to mark events as valid or false, so it can’t be manually trained. 

(2)
UI
Undisclosed Integrator #3
May 10, 2019

Thanks Ethan.

UM
Undisclosed Manufacturer #4
May 10, 2019

the unknown SoC should be  "Huawei Hisilicon 3519 V101" 

(2)
JH
John Honovich
May 10, 2019
IPVM

#4, thanks. How did you figure that out? Is there some pattern or practice that allowed you to identify a specific Hisilicon chip?

(1)