Audio Analytics Aggression Tested

Author: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** *** **** ** ******* ** ****** fights ****** **** *****? 

**** ** *** **** ******** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% ** ******** ********** *** ******** ** verbal **********", ***** ********* *** ******** ** ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** ******** ***** **** **** ******** *** ******** clips ** ******** ******, ** *** **** *** ***** ********* perform.

**** ** *** *** **** **** **** ** **** ** ******* and ******** *** ***** *********:

[***************]

*******

******/***** ************ ********** ******** ********* *** * *********** ****** ******** to ************ *******, ********* ***** ** ****** ***** *** ********* go *********, ******** ****** ******/************ ********. 

*******, **** *** *** ******** *** *** *********, *** *** best **** ** ******** ***** *****, ** ****** ** ******** ******** will ******* ******** ***** ******, ***** **** ********** ***** ****** reduce analytics' ******* ** *********** ******. 

Key ********

** *** *****, ******'* ********** ********* *********** ** ***** *********** over *** ****** ** ***** **** ** ******* **** ****** area (**** ****** ***** *************, ****** ******* **** *** ***** ** other *******, ** ***** ***********).

*******, **** ***-********** ****** ******** ****** ***** ****** ** ******* degrees:

  • *****/***** *****:***** ****** *** ****** ********* **** ******** ***** ******, ********** of ***********. ****** ********** *** ***** ********** ********* ** ***** applications.
  • ****, ***-********** ******: ** **** *****, ****** ***-********** ******, ******, etc., ********* ******. **** *** ******** *** ******** * *** times (

********* ******** ********** ******** ****** ** ******* *** *******. ***** shouts ** **** ****** ***** ********* ********* ****** *** *****.

****** ******** ***** *** ** **** ** **** *********** *** best ***********. ******** **** *** *** *********** *** ********* ****** in *** *****, **** **** ********** ***** ****** *********** ******** detection ***********. 

** ****** *** ***** ***********. *** ****** ******* ** ******* I/O *** ** ****.

*******

**** *** ******'* ********** ********* ** $*** *** *******.

Potential ************

*** **** *** *** ***** ********** ********* ** ** ******** quiet ***** ***** ********** ****** **** ****** ****** *** ******* background *****, ********* *******, *********, ****** ********, **********, ***.

***** ********* ***** ** ****** ** *******, *** *** ********* volume *** ***** ***** ** ****** ***** ******/***** ** ** between ******* **** ****** ******* ******** ***** ******. ***** ***** *** be *** ******* ** ***** **** *******, *** **** ***** largely ****** *** ******** ** *** ********.

** **** ***** ***** ****** ****** *** ******, **** ** stadiums, ***** ****** *** ****** ** ** **** ******** *** to ***** *****.

*******, ** **** **** ***** **** ** ******* ** *****, **** are ****** ******** ** ******** ****** ****** *** ********** *** to *** ********* ***** *** ********** ******, ****** *** ********* unsuitable.

************/*************

******'* ********** ******** *** * ****** ************* ******, **** **** one ******** *******: ***********, *********** ** *** *****. **** ****** also ***** **** **** ***** ******** ** ***** ******:

  1. ***** ***** ********:*** *** ***** ***** ***** ********, **** *** ****** ***** displayed ** *****, ******* ** ****** **** ***** *** ********* threshold, ** ****** **** ********, *** ******* *** **** ********** is ********. ***** ********** ** ******, *** ********** **** ******* from ***** ** ***** ***.
  2. ***** ***********: *** ****** ***** ******** ********* ********, **** ****** ******* frequencies ********* ** *** *** **** ******, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** ******, ******** ************** ** *****. ****** ***** from ***** (********** ***** ****) ** **** (************), **** ** green *** ***-******** ***** ******, *** ******/******/*** *** ********** ****** of ******/**********.

** ******** ********* ********** *********** *** ********* *********** **** *** course ** ******** **** ** ***** ** ******** ***** ***** ******/****** activations. *********** ******** **** **** **** ********* ** *** ********** used, **** ******** *******, *** ********** ***** ******* ** *** time ** ***********.

***** **** ***** ********, ***** ****** ****** **** *** ***** settings. ** ****** ***** ******* ** **** ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* ************ *** ************* ** **** ******, including *********** ********, *** *****, *** ****:


*** ***********

******'* ********* *** *** ********* **** *** ** *** ***** tested: ********, *******, *****, *** ********. ******* ** ***** **** applications, **** *** ** **** ** ******* *** ************* ** relay ******* ** *** ******, ***** *** ** ******** ********** to *** ***.

** ***** ******* *** *** *********, ***** *** **** ******* email/SMS ******** *** ******.

Audio ******** ********

*** ******** ***** **** ******** ******** ** ******* ************, **** live *** **** ******** *****.

**** **** ****** ********** ***** *** ** **** *** ************* ********, as *** ********* ******** ** *** ********* ********** *** ******** playing *** **** **** *** ******* *** *** ****** ********* performance. However, ** **** ***** *** ***** ******** ****** ** * way ** ********** **** *** ******* ** ******** *******.

**** ***** *** *****

*****, **** ******* ***** ******** ** * ***** **** * crowd ** **********. ****** ****** *** ****, ***** ** *** large ******* ** ****** ** *** ******** ****** *** *** frequencies ***** ** *** ***********. ********** ****** **** ********, *** not ******** ** **** *******:

****, ***-********** ******

****, **** ******* ***** ****, *** *** ********** ******. **** that ******** ****** **** **********, ** *** ******** ****** ***** all ******. *******, ******* ********* ******, *** ****** ** *** analyzed ** ********.

******* ***** *****

*******, **** ******* ***** ******* ***** ***** ** *** ***********. Even **** ******* ****** *** ******* ***********, ****** *** ****** constant:

Test **********

**** *** ********* ***** ** **** ***** **** ****** ******** A *** *** **-* ***** *******.

*** ********* ********/******** ******** **** **** ** **** ****:

  • ******/***** ************ ********** ********: *.*.*-******
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Alexa Guard Expands Amazon's Security Offerings, Boosts ADT's Stock on Sep 21, 2018
Amazon is expanding their security offerings yet again, this time with Alexa Guard that delivers security audio analytics and a virtual "Fake...
Favorite Intercom Manufacturers 2018 on Sep 14, 2018
Intercoms are certainly increasing in popularity, driven by the integration of video and IP networking. But who is the favorite? On the one side,...
VMS Export Shootout - Avigilon, Dahua, Exacq, Genetec, Hikvision, Milestone on Sep 13, 2018
When crimes, accidents or problems occur, exporting video from one's video surveillance system is critical to proving incidents. But who does it...
Dahua Low-Cost 4MP Camera Tested (N44CL52) on Sep 10, 2018
4MP use continues to increase, especially in low-cost models, according to integrators in our 2018 Resolution Usage Statistics. We bought Dahua's...
Directory Of 110+ Video Management Software (VMS) Suppliers on Aug 30, 2018
This directory provides a list of Video Management Software providers to help you see and research what options are available. Listing...
Inputs/Outputs For Video Surveillance Guide on Aug 24, 2018
While many cameras have Input/Output (I/O) ports, few are actually used and most designers do not even consider them. However, a good understanding...
Luxriot VMS Profile on Aug 23, 2018
Luxriot is more popular than Hikvision and Milestone products according to ASMAG which was probably even surprising to Luxriot. The company has...
Synology Surveillance Station VMS Tested on Aug 22, 2018
With so many low-cost NVRs and enterprise VMSes, is there any place in the market for NAS-based VMSes? Recently, IPVM bought a Synology NAS for...
SNMP / Network Monitoring For Surveillance 2018 on Aug 21, 2018
Surveillance systems typically rely on the the VMS to report issues, but this most often just means knowing a camera is "down" with no warning or...
Video Analytics Integration Guide on Aug 16, 2018
Video analytics is hot again (at least conceptually) but integrating video analytics with VMSes can be challenging. This is especially significant...

Most Recent Industry Reports

Alexa Guard Expands Amazon's Security Offerings, Boosts ADT's Stock on Sep 21, 2018
Amazon is expanding their security offerings yet again, this time with Alexa Guard that delivers security audio analytics and a virtual "Fake...
UTC, Owner of Lenel, Acquires S2 on Sep 20, 2018
UTC now owns two of the biggest access control providers, one of integrator's most hated access control platforms, Lenel, and one of their...
BluePoint Aims To Bring Life-Safety Mind-Set To Police Pull Stations on Sep 20, 2018
Fire alarm pull stations are commonplace but police ones are not. A self-funded startup, BluePoint Alert Solutions is aiming to make police pull...
SIA Plays Dumb On OEMs And Hikua Ban on Sep 20, 2018
OEMs widely pretend to be 'manufacturers', deceiving their customers and putting them at risk for cybersecurity attacks and, soon, violation of US...
Axis Vs. Hikvision IR PTZ Shootout on Sep 20, 2018
Hikvision has their high-end dual-sensor DarkfighterX. Axis has their high-end concealed IR Q6125-LE. Which is better? We bought both and tested...
Avigilon Announces AI-Powered H5 Camera Development on Sep 19, 2018
Avigilon will be showcasing "next-generation AI" at next week's ASIS GSX. In an atypical move, the company is not actually releasing these...
Favorite Request-to-Exit (RTE) Manufacturers 2018 on Sep 19, 2018
Request To Exit devices like motion sensors and lock releasing push-buttons are a part of almost every access install, but who makes the equipment...
25% China Tariffs Finalized For 2019, 10% Start Now, Includes Select Video Surveillance on Sep 18, 2018
A surprise move: In July, when the most recent tariff round was first announced, the tariffs were only scheduled for 10%. However, now, the US...
Central Stations Face Off Against NFPA On Fire Monitoring on Sep 18, 2018
Central stations are facing off against the NFPA over what they call anti-competitive language in NFPA 72, the standard that covers fire alarms....
Hikvision USA Starts Layoffs on Sep 18, 2018
Hikvision USA has started layoffs, just weeks after the US government ban was passed into law. Inside this note, we examine: The important...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact