Audio Analytics Aggression Tested

By: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** use **** ** ******* to ****** ****** ****** they *****? 

**** ** *** **** of****** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% of ******** ********** *** preceded ** ****** **********", these ********* *** ******** to ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** Detector using **** **** ******** and ******** ***** ** multiple ******, ** *** just *** ***** ********* perform.

**** ** *** *** **** view **** ** **** to ******* *** ******** the ***** *********:

[***************]

*******

******/***** ************ ********** ******** analytics *** * *********** useful ******** ** ************ systems, ********* ***** ** events ***** *** ********* go *********, ******** ****** fights/altercations ********. 

*******, **** *** *** suitable *** *** *********, and *** **** **** in ******** ***** *****, as ****** ** ******** ******** will ******* ******** ***** alerts, ***** **** ********** noise ****** ****** *********' ******* to *********** ******. 

Key ********

** *** *****, ******'* Aggression ********* *********** ** false *********** **** *** course ** ***** **** in ******* **** ****** area (**** ****** ***** conversations, louder ******* **** *** aisle ** ***** *******, or ***** ***********).

*******, **** ***-********** ****** patterns ****** ***** ****** to ******* *******:

  • *****/***** *****:***** ****** *** ****** triggered **** ******** ***** alerts, ********** ** ***********. Louroe ********** *** ***** aggression ********* ** ***** applications.
  • ****, ***-********** ******: ** some *****, ****** ***-********** speech, ******, ***., ********* alarms. **** *** ******** but ******** * *** times (

********* ******** ********** ******** speech ** ******* *** trigger. ***** ****** ** loud ****** ***** ********* analytics ****** *** *****.

****** ******** ***** *** as **** ** **** microphones *** **** ***********. Internal **** *** *** recommended *** ********* ****** in *** *****, **** high ********** ***** ****** drastically ******** ********* ***********. 

** ****** *** ***** integration. *** ****** ******* or ******* */* *** be ****.

*******

**** *** ******'* ********** detection ** $*** *** channel.

Potential ************

*** **** *** *** these ********** ********* ** in ******** ***** ***** where ********** ****** **** easily ****** *** ******* background *****, ********* *******, hospitals, ****** ********, **********, etc.

***** ********* ***** ** useful ** *******, *** the ********* ****** *** crowd ***** ** ****** areas ******/***** ** ** between ******* **** ****** trigger ******** ***** ******. ***** rules *** ** *** outside ** ***** **** periods, *** **** ***** largely ****** *** ******** of *** ********.

** **** ***** ***** larger ****** *** ******, such ** ********, ***** alerts *** ****** ** be **** ******** *** to ***** *****.

*******, ** **** **** areas **** ** ******* or *****, **** *** ****** unlikely ** ******** ****** speech *** ********** *** to *** ********* ***** and ********** ******, ****** the ********* **********.

************/*************

******'* ********** ******** *** a ****** ************* ******, with **** *** ******** setting: ***********, *********** ** red *****. **** ****** also ***** **** **** audio ******** ** ***** graphs:

  1. ***** ***** ********:*** *** ***** ***** audio ********, **** *** volume ***** ********* ** green, ******* ** ****** when ***** *** ********* threshold, ** ****** **** analyzed, *** ******* *** when ********** ** ********. While ********** ** ******, the ********** **** ******* from ***** ** ***** red.
  2. ***** ***********: *** ****** ***** displays ********* ********, **** higher ******* *********** ********* as *** *** **** energy, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** bottom, ******** ************** ** shown. Colors ***** **** ***** (background ***** ****) ** blue (************), **** ** green *** ***-******** ***** speech, *** ******/******/*** *** increasing ****** ** ******/**********.

** ******** ********* ********** performance *** ********* *********** over *** ****** ** multiple days ** ***** ** properly ***** ***** ******/****** activations. *********** ******** **** will **** ********* ** the ********** ****, **** settings *******, *** ********** noise ******* ** *** time ** ***********.

***** **** ***** ********, users ****** ****** **** and ***** ********. ** review ***** ******* ** more ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* installation *** ************* ** more ******, ********* *********** settings, *** *****, *** more:


*** ***********

******'* ********* *** *** integrate **** *** ** the ***** ******: ********, Genetec, *****, *** ********. Similar ** ***** **** applications, **** *** ** used ** ******* *** notifications ** ***** ******* in *** ******, ***** may ** ******** ********** to *** ***.

** ***** ******* *** not *********, ***** *** also ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** analytic ******** ** ******* applications, **** **** *** from ******** *****.

**** **** ****** ********** clips *** ** **** for configuration ********, ** *** frequency ******** ** *** recording ********** *** ******** playing *** **** **** are ******* *** *** impact ********* ***********. *******, ** used ***** *** ***** examples ****** ** * way ** ********** **** the ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** analysis ** * ***** with * ***** ** spectators. ****** ****** *** high, ***** ** *** large ******* ** ****** in *** ******** ****** and *** *********** ***** in *** ***********. ********** alerts **** ********, *** not ******** ** **** example:

****, ***-********** ******

****, **** ******* ***** loud, *** *** ********** speech. **** **** ******** occurs **** **********, ** the ******** ****** ***** all ******. *******, ******* increased ******, *** ****** is *** ******** ** stressed.

******* ***** *****

*******, **** ******* ***** stadium ***** ***** ** low ***********. **** **** lowered ****** *** ******* sensitivity, ****** *** ****** constant:

Test **********

**** *** ********* ***** an **** ***** **** Louroe ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** were **** ** **** test:

  • ******/***** ************ ********** ********: 2.2.4-Louroe
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Undisclosed #1

11/21/15 07:46am

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Avatar

Cameron Javdani

Louroe Electronics | 11/23/15 09:04pm

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Sal Visone

DWG | IPVMU Certified | 11/26/15 05:37am

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Mark Strange

IPVMU Certified | 11/28/15 03:54am

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

John Honovich

IPVM | In reply to Mark Strange | 11/29/15 08:37pm

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

Undisclosed #1

In reply to John Honovich | 11/29/15 08:49pm

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Matt Alvey

11/30/15 02:09pm

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

John Honovich

IPVM | In reply to Matt Alvey | 11/30/15 02:19pm

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
Vivotek Trend Micro Cyber Security Camera App Tested on Jul 15, 2019
Vivotek and Trend Micro are claiming five million blocked attacks on IP cameras, with their jointly developed app for Vivotek cameras. This new...
Axis ARTPEC-7 P1375-E Camera Tested on Jul 12, 2019
Axis claims the new P1375-E box camera with ARTPEC-7 chip delivers "clear, sharp images in any lighting condition." But how well does it do? We...
Network Optix / Hanwha Cloud Access Tested on Jul 02, 2019
Remote cloud access is becoming a bigger differentiator, as cybersecurity issues underscore the problems of port forwarding and many integrators...
FLIR Saros Visible / Thermal Analytic Camera Tested on Jun 26, 2019
FLIR's Saros claims "accurate, actionable alerts" with a combination of 1080p visible and dual thermal sensors along with IR and white light...
Axis Live Privacy Shield Analytics Tested on Jun 25, 2019
Privacy is becoming a bigger factor in video surveillance, driven both by increased public awareness and by GDPR. Now, Axis has released Live...
Directory of 59 Video Surveillance Startups on Jun 25, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Genetec Beats Milestone For IHS #1 on Jun 21, 2019
For years, Milestone has touted that they are the #1 VMS. Now, Genetec has beaten them in IHS rankings. But what is this? Even other manufacturers...
Exacq Remote Cloud Access Tested on Jun 20, 2019
Remote cloud access has been missing from most VMSes (including Exacq and Milestone). Now, Exacq, after releasing Cloud Drive Storage earlier in...
Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...

Most Recent Industry Reports

Wyze Disruptive AI Analytics Tested on Jul 17, 2019
$20 camera disruptor Wyze has released free person detection deep learning analytics to all of their users, claiming users will "Only get notified...
Anyvision Aims For 2022 Revenue of $1 Billion on Jul 17, 2019
Only 3 video surveillance manufacturers do a billion dollars or more in annual revenue - Hikvision, Dahua, and Axis. Now, Anyvision plans to join...
HD Analog vs IP Guide on Jul 16, 2019
For years, HD resolution and single cable signal/power were IP camera advantages, with analog cameras limited to much lower resolution and...
How To Troubleshoot Wiegand Reader Problems - Inverted Wiring on Jul 16, 2019
Wiegand is the dominant method of connecting access readers, but problems can arise for installers. In fact, one of the most difficult reader...
ZeroEyes Gun Detection Startup on Jul 16, 2019
A gun detection video analytics startup, ZeroEyes, is being led by a group of 6 former Navy SEALs, aiming to "save lives" by using AI to assist...
Motorola Acquires Watchguard, Adds to Vigilant And Avigilon on Jul 15, 2019
2 years ago, Motorola had no position nor relevancy to video surveillance. Now, they own major video surveillance, LPR and body camera providers...
Hikvision Global News Reports Directory on Jul 15, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...
Vivotek Trend Micro Cyber Security Camera App Tested on Jul 15, 2019
Vivotek and Trend Micro are claiming five million blocked attacks on IP cameras, with their jointly developed app for Vivotek cameras. This new...
Beware African 50,000 IP Camera Contract Scam on Jul 12, 2019
A “Nigerian Prince” scam for the video surveillance market is going around. You, or at least we, could be lucky enough to be the single bidder for...
Axis ARTPEC-7 P1375-E Camera Tested on Jul 12, 2019
Axis claims the new P1375-E box camera with ARTPEC-7 chip delivers "clear, sharp images in any lighting condition." But how well does it do? We...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact