The Hikvision Smart Classroom Behavior Management System

Published May 22, 2018 12:53 PM

Hikvision's rapidly growing offering of analytics, which we most recently examined with Hikvision's ethnic minority analytics, is now going into the education market where Hikvision aims to improve scholastic performance with artificial intelligence. This was first covered in the West by Reuters but we found and reviewed the Chinese source report.

IPVM Image

In this note, we examine Hikvision's offering, the potential benefits and drawbacks, including accuracy concerns.

Classroom ******** ********** ****** ********

***** ***** ***** ********:

*** ************* ** ******** ** *** class *** ********** ******* *** **** analysis ** ******* ******** ***********.

**** ******** * *********** ** *** system. *** ** * ****** ** total ****** *********** ** *** ******** throughout *** ***, ** *** ******* below ***** ********* ****** ******* *********** and *** ***** ****:

IPVM Image

*** ****** **** ****** **** ********** of ***** ******** *** *******, ******* their ***** ** ********* ** *** lesson. ** *** ******* *****, ** student *** ******** ******* ***** ****:

IPVM Image

*** ***** ******* ****** *** ** analysis ** *** ****** *****' ***** level, ** *********** / ****** ** student, **** *** **** ** *** right, ** ******, ***** *** **** focused ********:

IPVM Image

********, *** ****** ******** * **** of ******** *** *** *** *******:

IPVM Image

Camera / ******

* ******* ** *** ****** / system ******* ** *** ***** ** the *****:

IPVM Image

Vote / ****

Accuracy ********

**************'* **********'* ********,********* ********* *************** ******* ** ********* ******* ** their *** ********* *****, *********** ******** ** * *******, even **** ** **** ********* *** emotional ***** ** *********. ** ********* cannot ********** ****** **** *********** ****** reliably (**** ** **** * *****, is **** ****** ******* *******), *** risk ** *** ****** **** ********** that *** **** ********* ** ****** by ******* ** ***** (*.*., ** a ****** ***, *****, ********, ** pain, ***.).

Behavior ****** ********

******** ******** ** *** ****** ***** materially ****** *******'* ******** ** **** are ******** *** ****** ** *** the ****** ********** ***** ****** **********, which ***** *** **** ** *************** and ******* ******* (*.*., ******** ************ their *********** ** ******* *** ******).

Hikvision ******** *******

********* ********* ************ *** ******* *** declined *******.

Future *****

**** ****** *** * ***** ** a ****** ** *********'* **** ****. Where **** **** **** **** ** unknown. *********, ** ***** ********* ***** to ************* *** **** ********** ***** analytics ** ******* *******, **** ** applications ***** ******** ******** *** ****.

Update: ***** *****

***** ** *** ***** ****** ****** China ** *** ******. ** ** in ******** **** *** *** ******** above ********* *** **** **:

Comments (28)
JH
John Honovich
May 22, 2018
IPVM

Since we are on Chinese education, the topic of academic performance is likely to come up and the oft-repeated claim that China students are better than US ones.

For a contrary view from a Professor at China's top business school see Bloomberg's China's Top Economic Risk? Education article, key quotes:

headline-grabbing studies showing China's prowess on standardized tests evaluated only kids in rich and unrepresentative areas. When its broader population was included, China's ranking dropped across all subject areas.

According to the 2010 census, less than 9 percent of Chinese had attended school beyond the secondary level. More than 65 percent had gone no further than junior high. From 2008 to 2016, China's total number of graduate students actually decreased by 1 percent. Outside the richest areas, much of China's population lacks even the basic skills required in a high-income economy.

China is famous for requiring rote memorization of its students. But schools are also increasing classwork on communist ideology, Confucian thought and even Traditional Chinese Medicine. 

 

(6)
UI
Undisclosed Integrator #1
May 22, 2018

I wonder how well this tech would function when applied to a variety of people with different facial features than what a typical Chinese person possesses. I remember a facial recognition company a while ago telling us in a training class that they had difficulty training their system to differentiate different asian facial features as opposed to non-asian facial features. I wonder if these guys would face similar issue.

Either way im glad i didnt grow up in an age of video surveillance. How stressful I imagine that would be to be constantly evaluated.

(3)
U
Undisclosed #2
May 22, 2018

I wonder how well this tech would function when applied to a variety of people with different facial features than what a typical Chinese person possesses

 

I am highly skeptical that this works even remotely close to what Hikvision is trying to portray here, so it would probably work equally poorly on students of any ethnicity.

Seriously, Hikvision can't even master basic cyber security concepts that have been well-documented for over a decade, and we are supposed to believe they are providing cutting-edge analytics like this?

I would not be the least bit surprised to learn that the "data" from this system is actually compiled by a subset of Hikvision's massive team of "engineers" manually viewing video and tabulating stats.

 

(2)
(2)
UM
Undisclosed Manufacturer #3
May 22, 2018

I look forward to telling a friend who is a high school vice principal, that now he can evaluate teachers using this tool and recommend firing any teacher whose students don't raise their hands enough, smile enough, or appear to be alert enough. 

(4)
(1)
(1)
Avatar
Sean Nelson
May 22, 2018
Nelly's Security

The image shows all the asian kids being serious and the caucasion kid is goofing off. i am deeply offended by that.... J/K, i think its hilarious.

Back on topic, i dont get excited about all this bleeding edge technology anymore. Normally it simply doesn't work anywhere close to what customers expect. Nonetheless, someone or some company has to start somewhere with it.

(2)
SD
Shannon Davis
May 22, 2018
IPVMU Certified

This will be more added to their "Social Credit" system. 

(1)
Avatar
John Bazyk
May 22, 2018
Command Corporation • IPVMU Certified

I'm with you on this one. When I see it work, I'll believe it works. 

RS
Robert Shih
May 22, 2018
Independent

Very much against this. Don't get me wrong, I'm all for getting some discipline back in schools, but having this going in entirely the wrong direction. Respect and human interaction trumps machine learning by far.

(4)
UI
Undisclosed Integrator #4
May 22, 2018

Nonetheless, someone or some company has to start somewhere with it.

 When you have it, use it.

 

(2)
U
Undisclosed #5
May 22, 2018
IPVMU Certified

...which poses the risk of ... adverse effects (i.e., students manipulating their expressions to appease the system).

“Manipulating your expression to appease” is an essential social skill, practiced everyday starting with your first “Good Morning!”

(1)
JL
Joe LoRe
May 28, 2018

Agreed people will always find a way to adapt against any sort of means of attempted manipulation of them.  So instead of kids using your energy to actually paying attention and focus  in class they will be using their energy to concentrate on how to appear to be focusing on class.  

 

JH
John Honovich
May 22, 2018
IPVM

A picture of the camera / system  from a different Chinese site:

(1)
UM
Undisclosed Manufacturer #6
May 22, 2018

Thankfully GDPR will prevent this to happen in European schools :)

 

(1)
DH
Dirk Hedlund
May 22, 2018

Good luck Hikvision lol. Focus on cyber security and camera MTBF

(1)
(3)
Avatar
Brandon Knutson
May 22, 2018
IPVMU Certified

ASIS should partner with Hikvision and deploy this inside their GSX learning sessions.

(1)
(4)
JH
John Honovich
May 23, 2018
IPVM

Update:

The system also displays a list of students who are not focused:

And we verified the other UI segment ranks students by how focused the system believes they are.

Chinese video clip where this is from here.

CH
Chris Hammond
May 23, 2018

Does it matter if it works? To me what matters is that this use case was thought enough about to attempt it. Now think about all of the other possibilities that can be applied to this type of technology. Innovation comes from these basic beginnings. And sometimes innovation is scary. 

Data is powerful and lucrative. If there is a desire (demand) to identify trends, detect anomalies, etc., someone is going to try and build the solution (supply). Once the behaviors can be measured, they can be predicted. Maybe it won't be Hikvision, but eventually somebody may succeed at this.

Phillip K. Dick's precog psychics may have been a stretch but the idea of predicting behavior is upon us. Call Tom Cruise, reactivate the PreCrime unit.

JH
John Honovich
May 23, 2018
IPVM

Does it matter if it works? 

It matters if it works because there is going to be an increasing public pressure and ill-will if the public views these technologies as harming them and being fundamentally unfair (due to their inaccuracy). For the past few decades, the video surveillance industry has been viewed mostly positively since it overwhelmingly was used to target clear criminal acts and not unfairly targeting regular people. AI, especially applied cavalierly and inaccurately, could change that.

CH
Chris Hammond
May 23, 2018

John, I agree. I am saying this matters even if it does not work. 

U
Undisclosed #2
May 23, 2018

How well it works matters only if hikvision is concerned about their credibility and business ethics. It takes little effort to dream up some neat uses for technology, and only slightly more effort to mock up some demos. 

Any company can put out forward-looking claims like this, and many have in the past. If you present it as a technology demo, that is one thing. If you present it as being close to commercially deployable when it is not, then that is a sign of a company that is not ethically driven or concerned with their corporate image. 

(2)
FM
Frantz Mathias
May 29, 2018

Hi

AI is one of those things that are too useful to discard and too dangerous to take lightly ...

Under the guise of improving scholastic performance we are supposed to be watching a child emotions... to what purpose? Who's watching the watchers ...

As dystopian as it gets, creepy doesn't even begin to qualify it.

(1)
U
Undisclosed #5
Sep 06, 2019
IPVMU Certified
(1)
JH
John Honovich
Sep 06, 2019
IPVM

Thanks! That article cites SupChina's China To Curb Facial Recognition Technology In Schools which cites The Paper China: Department of Science and Technology of the Ministry of Education: Campus promotion of face recognition technology should be cautious, will limit and manage. One notable quote:

The collection of the use of minor information should be approved and authorized by the guardian.

We'll look to see if we can get more information on this.

UI
Undisclosed Integrator #7
Sep 07, 2019

Define “guardian”.

JH
John Honovich
Sep 07, 2019
IPVM

Is there any reason to believe that it isn’t the same definition as it is in the west? A guardian is the parent or other responsible adult of a child.

U
Undisclosed #5
Nov 05, 2019
IPVMU Certified

forget face rec, China goes direct to the source

A headband that claims to monitor children’s brainwaves in order to improve their focus is available for purchase in China, aimed at “Tiger” mothers and fathers who’ll do everything to help their children succeed. But many of its target customers are already creeped out.

The Focus1, or Fu Si, headband, from US-based startup BrainCo, claims it can measure how closely students are paying attention through electrodes that detect electrical activity in kids’ brains and send the data to teachers’ computers or to a mobile app. A light on the headband that gleams red, yellow or blue, also purports to signal how engaged a child is with the task at hand—with red being the highest level of attention.

(1)
UI
Undisclosed Integrator #1
Nov 05, 2019

This could be brilliant or a complete failure. Need i remind anyone of the great “suck cut” debacle in 1992?

UI
Undisclosed Integrator #8
Jan 31, 2023

Use this AI software in the line at Customer service at Walmart. Especially right after Christmas when the return line goes out the door. Great insight.

Sometimes I think they make it miserable on purpose.