Audio Analytics Aggression Tested

Author: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** *** **** ** ******* ** ****** fights ****** **** *****? 

**** ** *** **** ******** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% ** ******** ********** *** ******** ** verbal **********", ***** ********* *** ******** ** ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** ******** ***** **** **** ******** *** ******** clips ** ******** ******, ** *** **** *** ***** ********* perform.

**** ** *** *** **** **** **** ** **** ** ******* and ******** *** ***** *********:

[***************]

*******

******/***** ************ ********** ******** ********* *** * *********** ****** ******** to ************ *******, ********* ***** ** ****** ***** *** ********* go *********, ******** ****** ******/************ ********. 

*******, **** *** *** ******** *** *** *********, *** *** best **** ** ******** ***** *****, ** ****** ** ******** ******** will ******* ******** ***** ******, ***** **** ********** ***** ****** reduce analytics' ******* ** *********** ******. 

Key ********

** *** *****, ******'* ********** ********* *********** ** ***** *********** over *** ****** ** ***** **** ** ******* **** ****** area (**** ****** ***** *************, ****** ******* **** *** ***** ** other *******, ** ***** ***********).

*******, **** ***-********** ****** ******** ****** ***** ****** ** ******* degrees:

  • *****/***** *****:***** ****** *** ****** ********* **** ******** ***** ******, ********** of ***********. ****** ********** *** ***** ********** ********* ** ***** applications.
  • ****, ***-********** ******: ** **** *****, ****** ***-********** ******, ******, etc., ********* ******. **** *** ******** *** ******** * *** times (

********* ******** ********** ******** ****** ** ******* *** *******. ***** shouts ** **** ****** ***** ********* ********* ****** *** *****.

****** ******** ***** *** ** **** ** **** *********** *** best ***********. ******** **** *** *** *********** *** ********* ****** in *** *****, **** **** ********** ***** ****** *********** ******** detection ***********. 

** ****** *** ***** ***********. *** ****** ******* ** ******* I/O *** ** ****.

*******

**** *** ******'* ********** ********* ** $*** *** *******.

Potential ************

*** **** *** *** ***** ********** ********* ** ** ******** quiet ***** ***** ********** ****** **** ****** ****** *** ******* background *****, ********* *******, *********, ****** ********, **********, ***.

***** ********* ***** ** ****** ** *******, *** *** ********* volume *** ***** ***** ** ****** ***** ******/***** ** ** between ******* **** ****** ******* ******** ***** ******. ***** ***** *** be *** ******* ** ***** **** *******, *** **** ***** largely ****** *** ******** ** *** ********.

** **** ***** ***** ****** ****** *** ******, **** ** stadiums, ***** ****** *** ****** ** ** **** ******** *** to ***** *****.

*******, ** **** **** ***** **** ** ******* ** *****, **** are ****** ******** ** ******** ****** ****** *** ********** *** to *** ********* ***** *** ********** ******, ****** *** ********* unsuitable.

************/*************

******'* ********** ******** *** * ****** ************* ******, **** **** one ******** *******: ***********, *********** ** *** *****. **** ****** also ***** **** **** ***** ******** ** ***** ******:

  1. ***** ***** ********:*** *** ***** ***** ***** ********, **** *** ****** ***** displayed ** *****, ******* ** ****** **** ***** *** ********* threshold, ** ****** **** ********, *** ******* *** **** ********** is ********. ***** ********** ** ******, *** ********** **** ******* from ***** ** ***** ***.
  2. ***** ***********: *** ****** ***** ******** ********* ********, **** ****** ******* frequencies ********* ** *** *** **** ******, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** ******, ******** ************** ** *****. ****** ***** from ***** (********** ***** ****) ** **** (************), **** ** green *** ***-******** ***** ******, *** ******/******/*** *** ********** ****** of ******/**********.

** ******** ********* ********** *********** *** ********* *********** **** *** course ** ******** **** ** ***** ** ******** ***** ***** ******/****** activations. *********** ******** **** **** **** ********* ** *** ********** used, **** ******** *******, *** ********** ***** ******* ** *** time ** ***********.

***** **** ***** ********, ***** ****** ****** **** *** ***** settings. ** ****** ***** ******* ** **** ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* ************ *** ************* ** **** ******, including *********** ********, *** *****, *** ****:


*** ***********

******'* ********* *** *** ********* **** *** ** *** ***** tested: ********, *******, *****, *** ********. ******* ** ***** **** applications, **** *** ** **** ** ******* *** ************* ** relay ******* ** *** ******, ***** *** ** ******** ********** to *** ***.

** ***** ******* *** *** *********, ***** *** **** ******* email/SMS ******** *** ******.

Audio ******** ********

*** ******** ***** **** ******** ******** ** ******* ************, **** live *** **** ******** *****.

**** **** ****** ********** ***** *** ** **** *** ************* ********, as *** ********* ******** ** *** ********* ********** *** ******** playing *** **** **** *** ******* *** *** ****** ********* performance. However, ** **** ***** *** ***** ******** ****** ** * way ** ********** **** *** ******* ** ******** *******.

**** ***** *** *****

*****, **** ******* ***** ******** ** * ***** **** * crowd ** **********. ****** ****** *** ****, ***** ** *** large ******* ** ****** ** *** ******** ****** *** *** frequencies ***** ** *** ***********. ********** ****** **** ********, *** not ******** ** **** *******:

****, ***-********** ******

****, **** ******* ***** ****, *** *** ********** ******. **** that ******** ****** **** **********, ** *** ******** ****** ***** all ******. *******, ******* ********* ******, *** ****** ** *** analyzed ** ********.

******* ***** *****

*******, **** ******* ***** ******* ***** ***** ** *** ***********. Even **** ******* ****** *** ******* ***********, ****** *** ****** constant:

Test **********

**** *** ********* ***** ** **** ***** **** ****** ******** A *** *** **-* ***** *******.

*** ********* ********/******** ******** **** **** ** **** ****:

  • ******/***** ************ ********** ********: *.*.*-******
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Directory of Video Intercoms on Nov 13, 2018
Video Intercoms, also known as Video Door-Phones or Video Entry Systems, have been growing in the past decade as more and more IP camera...
Magos Radar Company Profile on Nov 12, 2018
Magos America General Manager Yaron Zussman admits when he first came across Magos, he asked himself: "What's innovative about radar?" Be that as...
Axis 2N Intercom Tested on Nov 08, 2018
Axis expanded its video intercom business buying Czech-based 2N in 2016. Despite competing against owner Axis' intercoms, 2N recently registered as...
Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Avigilon Opens Up Analytics And Cameras on Nov 06, 2018
Avigilon is opening up. The company historically famous for advocating its own end-to-end solutions and making it harder for 3rd parties to...
Worst Products on Nov 03, 2018
Security integrators periodically report on their favorite and worst products to IPVM. These are known integrators who IPVM pays to answer surveys....
Unisight Company Profile on Nov 01, 2018
Hikvision's largest US OEM, LTS has started to carry Unisight, whose products (shown below) look a lot like Hikvision's rival Dahua: Who is...
VMS Camera Management Shootout - Avigilon, Dahua, Exacq, Genetec, Hanwha, Hikvision, Milestone, Network Optix on Oct 29, 2018
Camera setup, configuration and maintenance are the most common tasks when managing a surveillance system. Who does it best and worst? Who offers...
Axxon Face Search Tested on Oct 26, 2018
AxxonSoft has brought facial recognition to their Axxon Next VMS for free with the simply named Face Search, claiming to allow users to find...
Exacq Co-Founders Return, Start Qumulex on Oct 24, 2018
Exacq co-founders Dan Rittman, Tom Buckley, and David Underwood are back, starting up Qumulex. In 2000, they sold Integral to Andover...

Most Recent Industry Reports

'Sticker' Surveillance Camera Developed (CSEM Witness) on Nov 16, 2018
The Swiss Center for Electronics and Microtechnology (CSEM) has announced what it calls the: world’s first fully autonomous camera that can be...
ISC East 2018 Mini-Show Final Report on Nov 16, 2018
This is our second (updated) and final show report from ISC East. ISC East, by its own admission, is not a national or international show, billed...
Facial Detection Tested on Nov 16, 2018
Facial detection and recognition are increasingly offered by video surveillance manufacturers. Facial detection detects faces in an image/video...
Throughtek P2P/Cloud Solution Profile on Nov 15, 2018
Many IoT manufacturers either do not have the capabilities or the interest to develop their own cloud management software for their devices....
ASIS Offering Custom Research For Manufacturers on Nov 15, 2018
Manufacturers often want to know what industry people think about trends and, in particular, the segments and product they offer.  ASIS and its...
Hikvision Silent on "Bad Architectural Practices" Cybersecurity Report on Nov 14, 2018
A 'significant vulnerability was found in Hikvision cameras' by VDOO, a startup cybersecurity specialist. Hikvision has fixed the specific...
French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...
Integrator Credit Card Alternative Divvy on Nov 13, 2018
Most security integrators are small businesses but large enough that they have various employees that need to be able to expense various charges as...
Directory of Video Intercoms on Nov 13, 2018
Video Intercoms, also known as Video Door-Phones or Video Entry Systems, have been growing in the past decade as more and more IP camera...
Beware Amazon Go Store Hype (Tested) on Nov 13, 2018
IPVM's trip to and testing of Amazon Go's San Francisco store shows a number of significant operational and economic issues that undermine the...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact