Audio Analytics Aggression Tested

By: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start?

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** use **** ** ******* to ****** ****** ****** they *****?

**** ** *** **** of****** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% of ******** ********** *** preceded ** ****** **********", these ********* *** ******** to ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** Detector using **** **** ******** and ******** ***** ** multiple ******, ** *** just *** ***** ********* perform.

**** ** *** *** **** view **** ** **** to ******* *** ******** the ***** *********:

[***************]

*******

******/***** ************ ********** ******** analytics *** * *********** useful ******** ** ************ systems, ********* ***** ** events ***** *** ********* go *********, ******** ****** fights/altercations ********.

*******, **** *** *** suitable *** *** *********, and *** **** **** in ******** ***** *****, as ****** ** ******** ******** will ******* ******** ***** alerts, ***** **** ********** noise ****** ****** *********' ******* to *********** ******.

Key ********

** *** *****, ******'* Aggression ********* *********** ** false *********** **** *** course ** ***** **** in ******* **** ****** area (**** ****** ***** conversations, louder ******* **** *** aisle ** ***** *******, or ***** ***********).

*******, **** ***-********** ****** patterns ****** ***** ****** to ******* *******:

*****/***** *****:***** ****** *** ****** triggered **** ******** ***** alerts, ********** ** ***********. Louroe ********** *** ***** aggression ********* ** ***** applications.
****, ***-********** ******: ** some *****, ****** ***-********** speech, ******, ***., ********* alarms. **** *** ******** but ******** * *** times (

********* ******** ********** ******** speech ** ******* *** trigger. ***** ****** ** loud ****** ***** ********* analytics ****** *** *****.

****** ******** ***** *** as **** ** **** microphones *** **** ***********. Internal **** *** *** recommended *** ********* ****** in *** *****, **** high ********** ***** ****** drastically ******** ********* ***********.

** ****** *** ***** integration. *** ****** ******* or ******* */* *** be ****.

*******

**** *** ******'* ********** detection ** $*** *** channel.

Potential ************

*** **** *** *** these ********** ********* ** in ******** ***** ***** where ********** ****** **** easily ****** *** ******* background *****, ********* *******, hospitals, ****** ********, **********, etc.

***** ********* ***** ** useful ** *******, *** the ********* ****** *** crowd ***** ** ****** areas ******/***** ** ** between ******* **** ****** trigger ******** ***** ******. ***** rules *** ** *** outside ** ***** **** periods, *** **** ***** largely ****** *** ******** of *** ********.

** **** ***** ***** larger ****** *** ******, such ** ********, ***** alerts *** ****** ** be **** ******** *** to ***** *****.

*******, ** **** **** areas **** ** ******* or *****, **** *** ****** unlikely ** ******** ****** speech *** ********** *** to *** ********* ***** and ********** ******, ****** the ********* **********.

************/*************

******'* ********** ******** *** a ****** ************* ******, with **** *** ******** setting: ***********, *********** ** red *****. **** ****** also ***** **** **** audio ******** ** ***** graphs:

***** ***** ********:*** *** ***** ***** audio ********, **** *** volume ***** ********* ** green, ******* ** ****** when ***** *** ********* threshold, ** ****** **** analyzed, *** ******* *** when ********** ** ********. While ********** ** ******, the ********** **** ******* from ***** ** ***** red.
***** ***********: *** ****** ***** displays ********* ********, **** higher ******* *********** ********* as *** *** **** energy, ****** *** ***, and **** *** ***.
**************: *******, ** *** bottom, ******** ************** ** shown. Colors ***** **** ***** (background ***** ****) ** blue (************), **** ** green *** ***-******** ***** speech, *** ******/******/*** *** increasing ****** ** ******/**********.

** ******** ********* ********** performance *** ********* *********** over *** ****** ** multiple days ** ***** ** properly ***** ***** ******/****** activations. *********** ******** **** will **** ********* ** the ********** ****, **** settings *******, *** ********** noise ******* ** *** time ** ***********.

***** **** ***** ********, users ****** ****** **** and ***** ********. ** review ***** ******* ** more ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* installation *** ************* ** more ******, ********* *********** settings, *** *****, *** more:

*** ***********

******'* ********* *** *** integrate **** *** ** the ***** ******: ********, Genetec, *****, *** ********. Similar ** ***** **** applications, **** *** ** used ** ******* *** notifications ** ***** ******* in *** ******, ***** may ** ******** ********** to *** ***.

** ***** ******* *** not *********, ***** *** also ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** analytic ******** ** ******* applications, **** **** *** from ******** *****.

**** **** ****** ********** clips *** ** **** for configuration ********, ** *** frequency ******** ** *** recording ********** *** ******** playing *** **** **** are ******* *** *** impact ********* ***********. *******, ** used ***** *** ***** examples ****** ** * way ** ********** **** the ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** analysis ** * ***** with * ***** ** spectators. ****** ****** *** high, ***** ** *** large ******* ** ****** in *** ******** ****** and *** *********** ***** in *** ***********. ********** alerts **** ********, *** not ******** ** **** example:

****, ***-********** ******

****, **** ******* ***** loud, *** *** ********** speech. **** **** ******** occurs **** **********, ** the ******** ****** ***** all ******. *******, ******* increased ******, *** ****** is *** ******** ** stressed.

******* ***** *****

*******, **** ******* ***** stadium ***** ***** ** low ***********. **** **** lowered ****** *** ******* sensitivity, ****** *** ****** constant:

Test **********

**** *** ********* ***** an **** ***** **** Louroe ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** were **** ** **** test:

******/***** ************ ********** ********: 2.2.4-Louroe
**** *****: *.**.*.*
***********: *.*.*.*****
******* ******** ******: *.*.****.**
********* ********: **** (*.**)

Comments (8)

Undisclosed #1

IPVMU Certified | 11/21/15 07:46am

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Cameron Javdani

Louroe Electronics
11/23/15 09:04pm

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Sal Visone

DWG | IPVMU Certified | 11/26/15 05:37am

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Mark Strange

IPVMU Certified | 11/28/15 03:54am

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

John Honovich

IPVM | In reply to Mark Strange | 11/29/15 08:37pm

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

Undisclosed #1

IPVMU Certified | In reply to John Honovich | 11/29/15 08:49pm

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Matt Alvey

11/30/15 02:09pm

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

John Honovich

IPVM | In reply to Matt Alvey | 11/30/15 02:19pm

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.

Related Reports

Seek Scan Thermal Temperature Screening System Tested on May 28, 2020

Now that IPVM has tested Dahua, Hikvision, and Sunell, we are returning to Seek, the first blackbody system we tested and retested it with our...

IronYun AI Analytics Tested on Feb 17, 2020

Taiwan / US startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a...

Dahua Smart Motion Detection Camera Tested on Mar 03, 2020

Dahua has introduced Smart Motion Detection, AI-based VMD, claiming to use an advanced algorithm to differentiate human and vehicular shapes within...

Cisco Meraki Unlocks IP Cameras With RTSP Tested on Jul 06, 2020

Meraki opened up its cameras to 3rd party NVRs/VMSes by offering RTSP streaming because of "the need to solve a business problem". We tested...

Camera Analytics Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jan 22, 2020

Analytics are hot again, thanks to a slew of AI-powered cameras, but whose analytics really work? And how do these new smart cameras compare to top...

Tiandy Super Starlight Cameras Tested on Apr 30, 2020

Tiandy is taking aim at China competitors Dahua and Hikvision, with a new series of "super starlight" cameras, including white light illumination,...

Use Access Control Logs To Constrain Coronavirus on Apr 09, 2020

Access control users have included capabilities that are not commonly used that can help zero-in and discover potential Coronavirus hotspots in a...

Wyze Smart Door Lock Test on Jan 14, 2020

Wyze's inexpensive cameras have grabbed the attention of many in the consumer market, but can the company's new smart lock get similar...

Video Surveillance Business 101 on Mar 30, 2020

This report explains the fundamental elements of the video surveillance business for those new to the industry. This is part of our Video...

Anyvision Layoffs on Mar 19, 2020

Anyvision has conducted a layoff, citing the impact of coronavirus, joining a growing number of tech companies doing so, but the first within video...

Most Recent Industry Reports

Ban Rules Released: Use Dahua or Hikvision, No Government Contracts on Jul 13, 2020

The US government has released the rules implementing the "Prohibition on Contracting with Entities Using" Dahua, Hikvision, and Huawei based...

JCI Sues Genetec For Patent Infringement on Jul 13, 2020

Surprisingly, security giant JCI has sued their partner, security software developer Genetec, for patent infringement. Inside this note,...

Remove Dahua and Hikvision Equipment "Immediately" Or Else Banned From US Government Contracts on Jul 10, 2020

The US government has directed contractors to remove covered equipment, such as Dahua, Hikvision, and Huawei Hisilicon products, "immediately." If...

ZeroEyes Presents Firearm Detection Video Analytics on Jul 09, 2020

ZeroEyes presented its Firearm detection Video Analytics system at the May 2020 IPVM Startups show. A 30-minute video from ZeroEyes...

Directory of 164 "Fever" Camera Suppliers on Jul 09, 2020

This directory provides a list of "Fever" scanning thermal camera providers to help you see and research what options are available. There are...

Clinton Public View Monitor (PVM) Mask Detection Tested on Jul 09, 2020

Face mask detection, or more specifically not wearing one, is expanding amidst the pandemic. Clinton Electronics has added this capability to their...