Audio Analytics Aggression Tested

By: Ethan Ace, Published on Nov 20, 2015

What if you could use your IP cameras to detect fights before they start? 

That is the goal of Louroe / Sound Intelligence with their recently released Aggression Detector audio analytics. Claiming that "90% of physical aggression are preceded by verbal aggression", these analytics are designed to alert guards before verbal altercations turn physical.

We tested the Aggression Detector using both live subjects and recorded clips of multiple scenes, to see just how these analytics perform.

Here is the app main view that we used to monitor and optimize the audio analytics:

**** ** *** ***** use **** ** ******* to ****** ****** ****** they *****? 

**** ** *** **** of****** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% of ******** ********** *** preceded ** ****** **********", these ********* *** ******** to ***** ****** ****** verbal ************ **** ********.

** ****** *** ********** Detector using **** **** ******** and ******** ***** ** multiple ******, ** *** just *** ***** ********* perform.

**** ** *** *** **** view **** ** **** to ******* *** ******** the ***** *********:

[***************]

*******

******/***** ************ ********** ******** analytics *** * *********** useful ******** ** ************ systems, ********* ***** ** events ***** *** ********* go *********, ******** ****** fights/altercations ********. 

*******, **** *** *** suitable *** *** *********, and *** **** **** in ******** ***** *****, as ****** ** ******** ******** will ******* ******** ***** alerts, ***** **** ********** noise ****** ****** *********' ******* to *********** ******. 

Key ********

** *** *****, ******'* Aggression ********* *********** ** false *********** **** *** course ** ***** **** in ******* **** ****** area (**** ****** ***** conversations, louder ******* **** *** aisle ** ***** *******, or ***** ***********).

*******, **** ***-********** ****** patterns ****** ***** ****** to ******* *******:

  • *****/***** *****:***** ****** *** ****** triggered **** ******** ***** alerts, ********** ** ***********. Louroe ********** *** ***** aggression ********* ** ***** applications.
  • ****, ***-********** ******: ** some *****, ****** ***-********** speech, ******, ***., ********* alarms. **** *** ******** but ******** * *** times (

********* ******** ********** ******** speech ** ******* *** trigger. ***** ****** ** loud ****** ***** ********* analytics ****** *** *****.

****** ******** ***** *** as **** ** **** microphones *** **** ***********. Internal **** *** *** recommended *** ********* ****** in *** *****, **** high ********** ***** ****** drastically ******** ********* ***********. 

** ****** *** ***** integration. *** ****** ******* or ******* */* *** be ****.

*******

**** *** ******'* ********** detection ** $*** *** channel.

Potential ************

*** **** *** *** these ********** ********* ** in ******** ***** ***** where ********** ****** **** easily ****** *** ******* background *****, ********* *******, hospitals, ****** ********, **********, etc.

***** ********* ***** ** useful ** *******, *** the ********* ****** *** crowd ***** ** ****** areas ******/***** ** ** between ******* **** ****** trigger ******** ***** ******. ***** rules *** ** *** outside ** ***** **** periods, *** **** ***** largely ****** *** ******** of *** ********.

** **** ***** ***** larger ****** *** ******, such ** ********, ***** alerts *** ****** ** be **** ******** *** to ***** *****.

*******, ** **** **** areas **** ** ******* or *****, **** *** ****** unlikely ** ******** ****** speech *** ********** *** to *** ********* ***** and ********** ******, ****** the ********* **********.

************/*************

******'* ********** ******** *** a ****** ************* ******, with **** *** ******** setting: ***********, *********** ** red *****. **** ****** also ***** **** **** audio ******** ** ***** graphs:

  1. ***** ***** ********:*** *** ***** ***** audio ********, **** *** volume ***** ********* ** green, ******* ** ****** when ***** *** ********* threshold, ** ****** **** analyzed, *** ******* *** when ********** ** ********. While ********** ** ******, the ********** **** ******* from ***** ** ***** red.
  2. ***** ***********: *** ****** ***** displays ********* ********, **** higher ******* *********** ********* as *** *** **** energy, ****** *** ***, and **** *** ***.
  3. **************: *******, ** *** bottom, ******** ************** ** shown. Colors ***** **** ***** (background ***** ****) ** blue (************), **** ** green *** ***-******** ***** speech, *** ******/******/*** *** increasing ****** ** ******/**********.

** ******** ********* ********** performance *** ********* *********** over *** ****** ** multiple days ** ***** ** properly ***** ***** ******/****** activations. *********** ******** **** will **** ********* ** the ********** ****, **** settings *******, *** ********** noise ******* ** *** time ** ***********.

***** **** ***** ********, users ****** ****** **** and ***** ********. ** review ***** ******* ** more ******, ********* *** specific ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* installation *** ************* ** more ******, ********* *********** settings, *** *****, *** more:


*** ***********

******'* ********* *** *** integrate **** *** ** the ***** ******: ********, Genetec, *****, *** ********. Similar ** ***** **** applications, **** *** ** used ** ******* *** notifications ** ***** ******* in *** ******, ***** may ** ******** ********** to *** ***.

** ***** ******* *** not *********, ***** *** also ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** analytic ******** ** ******* applications, **** **** *** from ******** *****.

**** **** ****** ********** clips *** ** **** for configuration ********, ** *** frequency ******** ** *** recording ********** *** ******** playing *** **** **** are ******* *** *** impact ********* ***********. *******, ** used ***** *** ***** examples ****** ** * way ** ********** **** the ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** analysis ** * ***** with * ***** ** spectators. ****** ****** *** high, ***** ** *** large ******* ** ****** in *** ******** ****** and *** *********** ***** in *** ***********. ********** alerts **** ********, *** not ******** ** **** example:

****, ***-********** ******

****, **** ******* ***** loud, *** *** ********** speech. **** **** ******** occurs **** **********, ** the ******** ****** ***** all ******. *******, ******* increased ******, *** ****** is *** ******** ** stressed.

******* ***** *****

*******, **** ******* ***** stadium ***** ***** ** low ***********. **** **** lowered ****** *** ******* sensitivity, ****** *** ****** constant:

Test **********

**** *** ********* ***** an **** ***** **** Louroe ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** were **** ** **** test:

  • ******/***** ************ ********** ********: 2.2.4-Louroe
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)

Comments (8)

Undisclosed #1

11/21/15 07:46am

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Avatar

Cameron Javdani

Louroe Electronics | 11/23/15 09:04pm

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Sal Visone

DWG | IPVMU Certified | 11/26/15 05:37am

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

Mark Strange

IPVMU Certified | 11/28/15 03:54am

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

John Honovich

IPVM | In reply to Mark Strange | 11/29/15 08:37pm

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

Undisclosed #1

In reply to John Honovich | 11/29/15 08:49pm

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

Matt Alvey

11/30/15 02:09pm

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

John Honovich

IPVM | In reply to Matt Alvey | 11/30/15 02:19pm

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below:

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
Commend ID5 Intercom Tested on Sep 12, 2019
Commend touts the new ID5 intercom as 'timelessly elegant' and the slim body, glass front touchscreen indeed looks better than common, but ugly,...
Genetec Stratocast VSaaS Tested on Sep 05, 2019
The VSaaS market is rapidly expanding in 2019, with Verkada, Meraki, Eagle Eye, Avigilon and numerous startups growing their market share. When we...
Scylla AI Video Analytics Company Profile on Aug 29, 2019
Scylla, an AI analytics startup, says they are targeting 1 Billion dollar valuation in 5 years and it "is not rocket science" to detect weapons and...
Uniview 4K Camera Tested on Aug 29, 2019
In our 8MP / 4K Fixed Lens Camera Shootout, Uniview's low end 8MP was firmly in the middle of the pack. Does their higher end Pro Series 4K camera...
Warning: Windows 7 Update Crashing NVRs on Aug 26, 2019
Windows 7 updates are causing VMS servers to fail to boot. After running the update, impacted systems do not boot as normal, instead display this...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Dahua 4K Camera Shootout on Aug 20, 2019
Dahua's new Pro Series 4K N85CL5Z claims to "deliver superior images in all lighting and environmental conditions", but how does this compare to...
Dahua OEM Directory on Aug 16, 2019
US Government banned Dahua OEMs for dozens of companies. The following directory includes 40+ of those companies with a graphic and links to...
Proactive CCTV "Only Affordable Video Archiving Solution" Profile on Aug 12, 2019
Proactive CCTV is claiming to offer "the only affordable video archiving solution on the market", reducing the storage typically required for H.265...

Most Recent Industry Reports

Schmode is Back, Aims To Turn Boulder AI Into Giant on Sep 16, 2019
One of the most influential and controversial executives in the past decade is back. Bryan Schmode ascended and drove the hypergrowth of Avigilon...
Manufacturers Unhappy With Weak ASIS GSX 2019 And 2020 Shift on Sep 16, 2019
Manufacturers were generally unhappy with ASIS GSX, both for weak 2019 booth traffic and a scheduling shift for the 2020 show, according to a new...
How Cobalt Robotics May Disrupt Security on Sep 13, 2019
While security robots have largely become a joke over the last few years, one organization, Cobalt Robotics, has raised $50+ million from top US...
Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
ASIS GSX 2019 Final Show Report on Sep 12, 2019
IPVM went to Chicago for ASIS GSX 2019, with many exhibitors disappointed about traffic and the exhibitor schedule changing next year. However,...
Installation Course - Last Chance - Register Now on Sep 12, 2019
Last Chance - Register Now - September 2019 Video Surveillance Install Course. Thursday, September 12th is your last chance to register for the...
Commend ID5 Intercom Tested on Sep 12, 2019
Commend touts the new ID5 intercom as 'timelessly elegant' and the slim body, glass front touchscreen indeed looks better than common, but ugly,...
US State Department: "Chinese Tech Giants" "Tools of the Chinese Communist Party" on Sep 12, 2019
The US State Department has called out "Chinese tech giants" for being "tools of the Chinese Communist Party" in a blunt new speech that makes...
Uniview OEM Directory on Sep 11, 2019
This directory lists 20+ companies that OEM products from Uniview, with a graphic and links to company websites below. It does not cover all...
Yi Home Camera 3 AI Analytics Tested on Sep 10, 2019
Yi Technology is claiming "new AI features" in its $50 Home Camera 3 "eliminates 'false positives' caused by flying insects, small pets, or light...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact