Audio Analytics Aggression Tested

By: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** use **** ** ******* to ****** ****** ****** they *****? 

**** ** *** **** of****** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% of ******** ********** *** preceded ** ****** **********", these ********* *** ******** to ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** Detector using **** **** ******** and ******** ***** ** multiple ******, ** *** just *** ***** ********* perform.

**** ** *** *** **** view **** ** **** to ******* *** ******** the ***** *********:

[***************]

*******

******/***** ************ ********** ******** analytics *** * *********** useful ******** ** ************ systems, ********* ***** ** events ***** *** ********* go *********, ******** ****** fights/altercations ********. 

*******, **** *** *** suitable *** *** *********, and *** **** **** in ******** ***** *****, as ****** ** ******** ******** will ******* ******** ***** alerts, ***** **** ********** noise ****** ****** *********' ******* to *********** ******. 

Key ********

** *** *****, ******'* Aggression ********* *********** ** false *********** **** *** course ** ***** **** in ******* **** ****** area (**** ****** ***** conversations, louder ******* **** *** aisle ** ***** *******, or ***** ***********).

*******, **** ***-********** ****** patterns ****** ***** ****** to ******* *******:

  • *****/***** *****:***** ****** *** ****** triggered **** ******** ***** alerts, ********** ** ***********. Louroe ********** *** ***** aggression ********* ** ***** applications.
  • ****, ***-********** ******: ** some *****, ****** ***-********** speech, ******, ***., ********* alarms. **** *** ******** but ******** * *** times (

********* ******** ********** ******** speech ** ******* *** trigger. ***** ****** ** loud ****** ***** ********* analytics ****** *** *****.

****** ******** ***** *** as **** ** **** microphones *** **** ***********. Internal **** *** *** recommended *** ********* ****** in *** *****, **** high ********** ***** ****** drastically ******** ********* ***********. 

** ****** *** ***** integration. *** ****** ******* or ******* */* *** be ****.

*******

**** *** ******'* ********** detection ** $*** *** channel.

Potential ************

*** **** *** *** these ********** ********* ** in ******** ***** ***** where ********** ****** **** easily ****** *** ******* background *****, ********* *******, hospitals, ****** ********, **********, etc.

***** ********* ***** ** useful ** *******, *** the ********* ****** *** crowd ***** ** ****** areas ******/***** ** ** between ******* **** ****** trigger ******** ***** ******. ***** rules *** ** *** outside ** ***** **** periods, *** **** ***** largely ****** *** ******** of *** ********.

** **** ***** ***** larger ****** *** ******, such ** ********, ***** alerts *** ****** ** be **** ******** *** to ***** *****.

*******, ** **** **** areas **** ** ******* or *****, **** *** ****** unlikely ** ******** ****** speech *** ********** *** to *** ********* ***** and ********** ******, ****** the ********* **********.

************/*************

******'* ********** ******** *** a ****** ************* ******, with **** *** ******** setting: ***********, *********** ** red *****. **** ****** also ***** **** **** audio ******** ** ***** graphs:

  1. ***** ***** ********:*** *** ***** ***** audio ********, **** *** volume ***** ********* ** green, ******* ** ****** when ***** *** ********* threshold, ** ****** **** analyzed, *** ******* *** when ********** ** ********. While ********** ** ******, the ********** **** ******* from ***** ** ***** red.
  2. ***** ***********: *** ****** ***** displays ********* ********, **** higher ******* *********** ********* as *** *** **** energy, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** bottom, ******** ************** ** shown. Colors ***** **** ***** (background ***** ****) ** blue (************), **** ** green *** ***-******** ***** speech, *** ******/******/*** *** increasing ****** ** ******/**********.

** ******** ********* ********** performance *** ********* *********** over *** ****** ** multiple days ** ***** ** properly ***** ***** ******/****** activations. *********** ******** **** will **** ********* ** the ********** ****, **** settings *******, *** ********** noise ******* ** *** time ** ***********.

***** **** ***** ********, users ****** ****** **** and ***** ********. ** review ***** ******* ** more ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* installation *** ************* ** more ******, ********* *********** settings, *** *****, *** more:


*** ***********

******'* ********* *** *** integrate **** *** ** the ***** ******: ********, Genetec, *****, *** ********. Similar ** ***** **** applications, **** *** ** used ** ******* *** notifications ** ***** ******* in *** ******, ***** may ** ******** ********** to *** ***.

** ***** ******* *** not *********, ***** *** also ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** analytic ******** ** ******* applications, **** **** *** from ******** *****.

**** **** ****** ********** clips *** ** **** for configuration ********, ** *** frequency ******** ** *** recording ********** *** ******** playing *** **** **** are ******* *** *** impact ********* ***********. *******, ** used ***** *** ***** examples ****** ** * way ** ********** **** the ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** analysis ** * ***** with * ***** ** spectators. ****** ****** *** high, ***** ** *** large ******* ** ****** in *** ******** ****** and *** *********** ***** in *** ***********. ********** alerts **** ********, *** not ******** ** **** example:

****, ***-********** ******

****, **** ******* ***** loud, *** *** ********** speech. **** **** ******** occurs **** **********, ** the ******** ****** ***** all ******. *******, ******* increased ******, *** ****** is *** ******** ** stressed.

******* ***** *****

*******, **** ******* ***** stadium ***** ***** ** low ***********. **** **** lowered ****** *** ******* sensitivity, ****** *** ****** constant:

Test **********

**** *** ********* ***** an **** ***** **** Louroe ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** were **** ** **** test:

  • ******/***** ************ ********** ********: 2.2.4-Louroe
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Undisclosed #1

11/21/15 07:46am

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Avatar

Cameron Javdani

Louroe Electronics | 11/23/15 09:04pm

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Sal Visone

DWG | IPVMU Certified | 11/26/15 05:37am

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Mark Strange

IPVMU Certified | 11/28/15 03:54am

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

John Honovich

IPVM | In reply to Mark Strange | 11/29/15 08:37pm

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

Undisclosed #1

In reply to John Honovich | 11/29/15 08:49pm

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Matt Alvey

11/30/15 02:09pm

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

John Honovich

IPVM | In reply to Matt Alvey | 11/30/15 02:19pm

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...
Milestone XProtect 2019 R1 Tested on May 15, 2019
For the past few years, Milestone has released quarterly software updates XProtect VMS platform. What is new and how much impact do the updates...
China PRC Government New National Video Surveillance Standards on May 14, 2019
The People's Republic of China (PRC) government has released a new set of overarching standards for authorities to follow when they install video...
Bluecherry Open Sources Entire VMS on May 13, 2019
Bluecherry announced they have "released the entire Bluecherry software application open source with a GPL license". We spoke to Bluecherry's...
Mining Company Security Manager Interview on May 10, 2019
First Quantum Minerals Limited (FQML) is a global enterprise with offices on 4 continents and operations in 7 countries with exploratory operations...
Aegis AI Gun Detection Video Analytics Startup on May 07, 2019
Gun detection analytic startups are increasing as the promise of AI and the threats of active shooters grow.  One company, Aegis AI, is being led...
Restaurant Security Manager Interview on May 06, 2019
Wright’s Gourmet House in Tampa, Florida has been around for over 50 years. During most of that time, there were no security measures in place. Now...
Ranking Manufacturer Favorability 2019 on May 06, 2019
24 manufacturer's favorability was ranked based on 170+ integrators feedback. Voting plus in-depth comments revealed insights on which brands were...

Most Recent Industry Reports

Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Amazon Ring Public Subsidy Program Aims To Dominate Residential Security on May 20, 2019
Amazon dominates market after market. Quitely, but increasingly, they are doing so in residential security, through a combination of significant...
LifeSafety Power NetLink Vulnerabilities And Problematic Response on May 20, 2019
'Power supplies' are not devices that many think about when considering vulnerabilities but as more and more devices go 'online', the risks for...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
Inside Look Into Scam Market Research on May 17, 2019
Scam market research has exploded over the last few years becoming the most commonly cited 'statistics' for most industries, despite there clearly...
Maglock Selection Guide on May 16, 2019
One of the most misunderstood yet valuable pieces of electrified hardware is the maglock. Few locks are stronger, but myths and confusion surround...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
Trump Signs 'Huawei Ban' - Executive Order Targeting Foreign Adversary Technology on May 16, 2019
US President Donald Trump has signed an executive order targeting technology provided by 'foreign adversaries', in what is widely being called a...
Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact