Audio Analytics Aggression Tested

By: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

******/***** ************ ********** ******** analytics *** * *********** useful ******** ** ************ systems, ********* ***** ** events ***** *** ********* go *********, ******** ****** fights/altercations ********. 

*******, **** *** *** suitable *** *** *********, and *** **** **** in ******** ***** *****, as ****** ** ******** ******** will ******* ******** ***** alerts, ***** **** ********** noise ****** ****** *********' ******* to *********** ******. 

Key ********

** *** *****, ******'* Aggression ********* *********** ** false *********** **** *** course ** ***** **** in ******* **** ****** area (**** ****** ***** conversations, louder ******* **** *** aisle ** ***** *******, or ***** ***********).

*******, **** ***-********** ****** patterns ****** ***** ****** to ******* *******:

  • *****/***** *****:***** ****** *** ****** triggered **** ******** ***** alerts, ********** ** ***********. Louroe ********** *** ***** aggression ********* ** ***** applications.
  • ****, ***-********** ******: ** some *****, ****** ***-********** speech, ******, ***., ********* alarms. **** *** ******** but ******** * *** times (

********* ******** ********** ******** speech ** ******* *** trigger. ***** ****** ** loud ****** ***** ********* analytics ****** *** *****.

****** ******** ***** *** as **** ** **** microphones *** **** ***********. Internal **** *** *** recommended *** ********* ****** in *** *****, **** high ********** ***** ****** drastically ******** ********* ***********. 

** ****** *** ***** integration. *** ****** ******* or ******* */* *** be ****.

*******

**** *** ******'* ********** detection ** $*** *** channel.

Potential ************

*** **** *** *** these ********** ********* ** in ******** ***** ***** where ********** ****** **** easily ****** *** ******* background *****, ********* *******, hospitals, ****** ********, **********, etc.

***** ********* ***** ** useful ** *******, *** the ********* ****** *** crowd ***** ** ****** areas ******/***** ** ** between ******* **** ****** trigger ******** ***** ******. ***** rules *** ** *** outside ** ***** **** periods, *** **** ***** largely ****** *** ******** of *** ********.

** **** ***** ***** larger ****** *** ******, such ** ********, ***** alerts *** ****** ** be **** ******** *** to ***** *****.

*******, ** **** **** areas **** ** ******* or *****, **** *** ****** unlikely ** ******** ****** speech *** ********** *** to *** ********* ***** and ********** ******, ****** the ********* **********.

************/*************

******'* ********** ******** *** a ****** ************* ******, with **** *** ******** setting: ***********, *********** ** red *****. **** ****** also ***** **** **** audio ******** ** ***** graphs:

  1. ***** ***** ********:*** *** ***** ***** audio ********, **** *** volume ***** ********* ** green, ******* ** ****** when ***** *** ********* threshold, ** ****** **** analyzed, *** ******* *** when ********** ** ********. While ********** ** ******, the ********** **** ******* from ***** ** ***** red.
  2. ***** ***********: *** ****** ***** displays ********* ********, **** higher ******* *********** ********* as *** *** **** energy, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** bottom, ******** ************** ** shown. Colors ***** **** ***** (background ***** ****) ** blue (************), **** ** green *** ***-******** ***** speech, *** ******/******/*** *** increasing ****** ** ******/**********.

** ******** ********* ********** performance *** ********* *********** over *** ****** ** multiple days ** ***** ** properly ***** ***** ******/****** activations. *********** ******** **** will **** ********* ** the ********** ****, **** settings *******, *** ********** noise ******* ** *** time ** ***********.

***** **** ***** ********, users ****** ****** **** and ***** ********. ** review ***** ******* ** more ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* installation *** ************* ** more ******, ********* *********** settings, *** *****, *** more:


*** ***********

******'* ********* *** *** integrate **** *** ** the ***** ******: ********, Genetec, *****, *** ********. Similar ** ***** **** applications, **** *** ** used ** ******* *** notifications ** ***** ******* in *** ******, ***** may ** ******** ********** to *** ***.

** ***** ******* *** not *********, ***** *** also ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** analytic ******** ** ******* applications, **** **** *** from ******** *****.

**** **** ****** ********** clips *** ** **** for configuration ********, ** *** frequency ******** ** *** recording ********** *** ******** playing *** **** **** are ******* *** *** impact ********* ***********. *******, ** used ***** *** ***** examples ****** ** * way ** ********** **** the ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** analysis ** * ***** with * ***** ** spectators. ****** ****** *** high, ***** ** *** large ******* ** ****** in *** ******** ****** and *** *********** ***** in *** ***********. ********** alerts **** ********, *** not ******** ** **** example:

****, ***-********** ******

****, **** ******* ***** loud, *** *** ********** speech. **** **** ******** occurs **** **********, ** the ******** ****** ***** all ******. *******, ******* increased ******, *** ****** is *** ******** ** stressed.

******* ***** *****

*******, **** ******* ***** stadium ***** ***** ** low ***********. **** **** lowered ****** *** ******* sensitivity, ****** *** ****** constant:

Test **********

**** *** ********* ***** an **** ***** **** Louroe ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** were **** ** **** test:

  • ******/***** ************ ********** ********: 2.2.4-Louroe
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Undisclosed #1

IPVMU Certified | 11/21/15 07:46am

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Avatar

Cameron Javdani

Louroe Electronics
11/23/15 09:04pm

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Sal Visone

DWG | IPVMU Certified | 11/26/15 05:37am

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Mark Strange

IPVMU Certified | 11/28/15 03:54am

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

John Honovich

IPVM | In reply to Mark Strange | 11/29/15 08:37pm

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

Undisclosed #1

IPVMU Certified | In reply to John Honovich | 11/29/15 08:49pm

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Matt Alvey

11/30/15 02:09pm

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

John Honovich

IPVM | In reply to Matt Alvey | 11/30/15 02:19pm

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Read this IPVM report for free.

This article is part of IPVM's 6,539 reports, 881 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Seek Scan Thermal Temperature Screening System Tested on May 28, 2020
Now that IPVM has tested Dahua, Hikvision, and Sunell, we are returning to...
Avigilon Social Distancing Analytics Tested on Aug 26, 2020
Avigilon released its social distancing analytics in response to the...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
Dahua Smart Motion Detection Camera Tested on Mar 03, 2020
Dahua has introduced Smart Motion Detection, AI-based VMD, claiming to use an...
Video Surveillance 101 Book Released on Jul 07, 2020
IPVM's unique introduction to video surveillance series is now available as a...
ZKTeco Presents SpeedFace Recognition + Body Temperature Detection on Apr 21, 2020
ZKTeco presented its SF1008+ reader with body temperature and face mask...
U.S. Government Accountability Office Urges Facial Recognition Regulation on Aug 27, 2020
The US Government Accountability Office (GAO) is urging facial recognition...
ZKTeco Body Temperature and Mask Detection Reader Tested on May 26, 2020
While dedicated fever cameras emerged first, now tablet/kiosk fever detectors...
Use Access Control Logs To Constrain Coronavirus on Apr 09, 2020
Access control users have included capabilities that are not commonly used...
USA ICI Elevated Skin Temperature Detectors Examined on Apr 06, 2020
Infrared Cameras, Inc. (ICI) is aiming to help slow the spread of COVID-19...
Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Cisco Meraki Unlocks IP Cameras With RTSP Tested on Jul 06, 2020
Meraki opened up its cameras to 3rd party NVRs/VMSes by offering RTSP...
30 Million Criminal Face Database Tested (Captis Intelligence) on Apr 27, 2020
30 million criminal mugshots are now available for facial recognition...

Recent Reports

New Products Show Fall 2020 continues tomorrow with Genetec, Milestone, Avigilon, Microsoft and more! on Sep 29, 2020
IPVM's sixth online show continues tomorrow and will feature New Products...
Avigilon / Motorola VS Virtual ISC West on Sep 29, 2020
ISC West has historically been so dominant that no player would think of...
Dartmouth College Deploys K3 Temperature Screening on Sep 29, 2020
While Dartmouth College has a $6+ billion endowment, the College has bought...
Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...