Audio Analytics Aggression Tested

Author: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** *** **** ** ******* ** ****** fights ****** **** *****? 

**** ** *** **** ******** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% ** ******** ********** *** ******** ** verbal **********", ***** ********* *** ******** ** ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** ******** ***** **** **** ******** *** ******** clips ** ******** ******, ** *** **** *** ***** ********* perform.

**** ** *** *** **** **** **** ** **** ** ******* and ******** *** ***** *********:

[***************]

*******

******/***** ************ ********** ******** ********* *** * *********** ****** ******** to ************ *******, ********* ***** ** ****** ***** *** ********* go *********, ******** ****** ******/************ ********. 

*******, **** *** *** ******** *** *** *********, *** *** best **** ** ******** ***** *****, ** ****** ** ******** ******** will ******* ******** ***** ******, ***** **** ********** ***** ****** reduce analytics' ******* ** *********** ******. 

Key ********

** *** *****, ******'* ********** ********* *********** ** ***** *********** over *** ****** ** ***** **** ** ******* **** ****** area (**** ****** ***** *************, ****** ******* **** *** ***** ** other *******, ** ***** ***********).

*******, **** ***-********** ****** ******** ****** ***** ****** ** ******* degrees:

  • *****/***** *****:***** ****** *** ****** ********* **** ******** ***** ******, ********** of ***********. ****** ********** *** ***** ********** ********* ** ***** applications.
  • ****, ***-********** ******: ** **** *****, ****** ***-********** ******, ******, etc., ********* ******. **** *** ******** *** ******** * *** times (

********* ******** ********** ******** ****** ** ******* *** *******. ***** shouts ** **** ****** ***** ********* ********* ****** *** *****.

****** ******** ***** *** ** **** ** **** *********** *** best ***********. ******** **** *** *** *********** *** ********* ****** in *** *****, **** **** ********** ***** ****** *********** ******** detection ***********. 

** ****** *** ***** ***********. *** ****** ******* ** ******* I/O *** ** ****.

*******

**** *** ******'* ********** ********* ** $*** *** *******.

Potential ************

*** **** *** *** ***** ********** ********* ** ** ******** quiet ***** ***** ********** ****** **** ****** ****** *** ******* background *****, ********* *******, *********, ****** ********, **********, ***.

***** ********* ***** ** ****** ** *******, *** *** ********* volume *** ***** ***** ** ****** ***** ******/***** ** ** between ******* **** ****** ******* ******** ***** ******. ***** ***** *** be *** ******* ** ***** **** *******, *** **** ***** largely ****** *** ******** ** *** ********.

** **** ***** ***** ****** ****** *** ******, **** ** stadiums, ***** ****** *** ****** ** ** **** ******** *** to ***** *****.

*******, ** **** **** ***** **** ** ******* ** *****, **** are ****** ******** ** ******** ****** ****** *** ********** *** to *** ********* ***** *** ********** ******, ****** *** ********* unsuitable.

************/*************

******'* ********** ******** *** * ****** ************* ******, **** **** one ******** *******: ***********, *********** ** *** *****. **** ****** also ***** **** **** ***** ******** ** ***** ******:

  1. ***** ***** ********:*** *** ***** ***** ***** ********, **** *** ****** ***** displayed ** *****, ******* ** ****** **** ***** *** ********* threshold, ** ****** **** ********, *** ******* *** **** ********** is ********. ***** ********** ** ******, *** ********** **** ******* from ***** ** ***** ***.
  2. ***** ***********: *** ****** ***** ******** ********* ********, **** ****** ******* frequencies ********* ** *** *** **** ******, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** ******, ******** ************** ** *****. ****** ***** from ***** (********** ***** ****) ** **** (************), **** ** green *** ***-******** ***** ******, *** ******/******/*** *** ********** ****** of ******/**********.

** ******** ********* ********** *********** *** ********* *********** **** *** course ** ******** **** ** ***** ** ******** ***** ***** ******/****** activations. *********** ******** **** **** **** ********* ** *** ********** used, **** ******** *******, *** ********** ***** ******* ** *** time ** ***********.

***** **** ***** ********, ***** ****** ****** **** *** ***** settings. ** ****** ***** ******* ** **** ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* ************ *** ************* ** **** ******, including *********** ********, *** *****, *** ****:


*** ***********

******'* ********* *** *** ********* **** *** ** *** ***** tested: ********, *******, *****, *** ********. ******* ** ***** **** applications, **** *** ** **** ** ******* *** ************* ** relay ******* ** *** ******, ***** *** ** ******** ********** to *** ***.

** ***** ******* *** *** *********, ***** *** **** ******* email/SMS ******** *** ******.

Audio ******** ********

*** ******** ***** **** ******** ******** ** ******* ************, **** live *** **** ******** *****.

**** **** ****** ********** ***** *** ** **** *** ************* ********, as *** ********* ******** ** *** ********* ********** *** ******** playing *** **** **** *** ******* *** *** ****** ********* performance. However, ** **** ***** *** ***** ******** ****** ** * way ** ********** **** *** ******* ** ******** *******.

**** ***** *** *****

*****, **** ******* ***** ******** ** * ***** **** * crowd ** **********. ****** ****** *** ****, ***** ** *** large ******* ** ****** ** *** ******** ****** *** *** frequencies ***** ** *** ***********. ********** ****** **** ********, *** not ******** ** **** *******:

****, ***-********** ******

****, **** ******* ***** ****, *** *** ********** ******. **** that ******** ****** **** **********, ** *** ******** ****** ***** all ******. *******, ******* ********* ******, *** ****** ** *** analyzed ** ********.

******* ***** *****

*******, **** ******* ***** ******* ***** ***** ** *** ***********. Even **** ******* ****** *** ******* ***********, ****** *** ****** constant:

Test **********

**** *** ********* ***** ** **** ***** **** ****** ******** A *** *** **-* ***** *******.

*** ********* ********/******** ******** **** **** ** **** ****:

  • ******/***** ************ ********** ********: *.*.*-******
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...
ReconaSense - The AI / Access Control / Analytics / IoT / Video Company Profile on Jun 12, 2018
One company's ISC West booth stood out for displaying a light-up tower of buzzwords. The company, ReconaSense, pledged to be 'making sense of it...
H.265 / HEVC Codec Tutorial on Jun 07, 2018
H.265 support has improved significantly in 2018, with H.265 camera/VMS compatibility increased compared to only a year ago, and more manufacturers...
Bosch IVA Video Analytics And Motion+ VMD Tested on Jun 06, 2018
Bosch's video analytics now ship on nearly every model, from indoor domes to high-end 5MP starlight cameras.  In this test, we evaluate Bosch's...
Hikvision PanoVu 20MP Flexible Camera Tested on Jun 01, 2018
Hikvision has released their first repositionable multi imager cameras with integrated IR included, atypical in competitors. We bought and tested...
Oncam 12MP Fisheye Camera Tested on May 29, 2018
Oncam has made their name since the early 2000s as a fisheye specialist, focusing only on panoramic cameras. To see how this specialist stacks up...
VMS Server Sizing on May 25, 2018
Specifying the right sized PC/server for VMS software is one of the most important yet difficult decisions in IP video surveillance. In the past...
Hanwha Wisenet X Analytics and VMD Test on May 24, 2018
Continuing our updated testing of camera analytics, we tested Hanwha's Wisenet X analytics for over two weeks in multiple scenes, indoors and out,...
Software Only VMS vs NVR Appliances on May 23, 2018
Should you buy your own PC/server and load VMS software on it or get a turnkey appliance (both hardware and software, e.g., NVR, Hybrid DVR) from a...
Dahua Intrusion Analytics And VMD Tested (Poorly) on May 21, 2018
Dahua ships basic analytics on practically all their cameras, ranging from low cost to high end. To see how these analytics work in real world...

Most Recent Industry Reports

IFSEC Show Report Day 2 Report on Jun 20, 2018
IPVM is live from London reporting on the IFSEC show. The Chinese have taken over the UK, centered on Hikvision, flanked by Dahua, Huawei and a...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Cybersecurity Startup VDOO Disclosing 10 Manufacturer Vulnerabilities Starting With Axis And Foscam on Jun 20, 2018
Cybersecurity startup VDOO has uncovered significant vulnerabilities in Axis cameras along with many others not yet disclosed. In this report, we...
July 2018 IP Networking Course on Jun 19, 2018
The last chance to save $50 on registration is this Thursday, June 21st. Register now and save. This is the only networking course designed...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...
IPVM Vulnerability Scanner Released on Jun 18, 2018
IPVM is proud to announce video surveillance's first and only cybersecurity vulnerability scanner. This tool allows quickly and simply...
Hikvision Corrects False Cybersecurity Announcement on Jun 18, 2018
Hikvision has corrected a false cybersecurity announcement that claimed a British government-sponsored program endorsed the cybersecurity of...
The Dumb Ones: PSA's Bozeman On Cybersecurity on Jun 15, 2018
The smart ones are the hundred people who flew to Denver and spent $500+ on a 1.5-day conference featuring Dahua as a 'cyber responsible partner',...
Amazon Ring Launches $10 Monthly Professional Alarm Monitoring on Jun 15, 2018
Amazon's Ring has announced an alarm system with 24/7 professional alarm monitoring for $10 per month, a fraction of the $30+ per month traditional...
Axis Releases First New Access Controller In 5 Years (A1601) on Jun 15, 2018
It has been 5 years since Axis 2013 entry in the physical access control market, with the A1001 (IPVM test). Now, Axis has released its second...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact