Audio Analytics Aggression Tested

Avatar
Ethan Ace
•Published Nov 20, 2015 05:00 AM

**** ** *** ***** *** **** IP ******* ** ****** ****** ****** they *****? 

**** ** *** **** ******** / ***** **************** ***** ******** ****************** ******** ***** *********. ******** **** "**% ** ******** aggression *** ******** ** ****** **********", these ********* *** ******** ** ***** guards ****** ****** ************ **** ********.

** ****** *** ********** ******** ***** **** live ******** *** ******** ***** ** multiple ******, ** *** **** *** these ********* *******.

**** ** *** *** **** **** **** we **** ** ******* *** ******** the ***** *********:

******/***** ************ ********** ******** ********* *** a *********** ****** ******** ** ************ systems, ********* ***** ** ****** ***** may ********* ** *********, ******** ****** fights/altercations ********. 

*******, **** *** *** ******** *** all *********, *** *** **** **** in ******** ***** *****, ** ****** or gathered ******** **** ******* ******** ***** alerts, ***** **** ********** ***** ****** reduce analytics' ******* ** *********** ******. 

Key ********

** *** *****, ******'* ********** ********* experienced ** ***** *********** **** *** course ** ***** **** ** ******* open ****** **** (**** ****** ***** conversations, louder ******* **** *** ***** ** other *******, ** ***** ***********).

*******, **** ***-********** ****** ******** ****** false ****** ** ******* *******:

  • *****/***** *****:***** ****** *** ****** ********* **** constant ***** ******, ********** ** ***********. Louroe ********** *** ***** ********** ********* in ***** ************.
  • ****, ***-********** ******: ** **** *****, louder ***-********** ******, ******, ***., ********* alarms. **** *** ******** *** ******** a *** ***** (

********* ******** ********** ******** ****** ** analyze *** *******. ***** ****** ** loud ****** ***** ********* ********* ****** our *****.

****** ******** ***** *** ** **** as **** *********** *** **** ***********. Internal **** *** *** *********** *** performed ****** ** *** *****, **** high ********** ***** ****** *********** ******** detection ***********. 

** ****** *** ***** ***********. *** serial ******* ** ******* */* *** be ****.

*******

**** *** ******'* ********** ********* ** $550 *** *******.

Potential ************

*** **** *** *** ***** ********** analytics ** ** ******** ***** ***** where ********** ****** **** ****** ****** out ******* ********** *****, ********* *******, hospitals, ****** ********, **********, ***.

***** ********* ***** ** ****** ** schools, *** *** ********* ****** *** crowd ***** ** ****** ***** ******/***** or ** ******* ******* **** ****** trigger ******** ***** ******. ***** ***** *** be *** ******* ** ***** **** periods, *** **** ***** ******* ****** the ******** ** *** ********.

** **** ***** ***** ****** ****** may ******, **** ** ********, ***** alerts *** ****** ** ** **** constant *** ** ***** *****.

*******, ** **** **** ***** **** as ******* ** *****, **** *** ****** unlikely ** ******** ****** ****** *** aggression *** ** *** ********* ***** and ********** ******, ****** *** ********* unsuitable.

************/*************

******'* ********** ******** *** * ****** configuration ******, **** **** *** ******** setting: ***********, *********** ** *** *****. This ****** **** ***** **** **** audio ******** ** ***** ******:

  1. ***** ***** ********:*** *** ***** ***** ***** ********, with *** ****** ***** ********* ** green, ******* ** ****** **** ***** the ********* *********, ** ****** **** analyzed, *** ******* *** **** ********** is ********. ***** ********** ** ******, the ********** **** ******* **** ***** to ***** ***.
  2. ***** ***********: *** ****** ***** ******** ********* analysis, **** ****** ******* *********** ********* as *** *** **** ******, ****** for ***, *** **** *** ***.
  3. **************: *******, ** *** ******, ******** classification ** *****. ****** ***** **** ***** (background ***** ****) ** **** (************), then ** ***** *** ***-******** ***** speech, *** ******/******/*** *** ********** ****** of ******/**********.

** ******** ********* ********** *********** *** adjusting *********** **** *** ****** ** multiple days ** ***** ** ******** ***** false ******/****** ***********. *********** ******** **** will **** ********* ** *** ********** used, **** ******** *******, *** ********** noise ******* ** *** **** ** calibration.

***** **** ***** ********, ***** ****** adjust **** *** ***** ********. ** review ***** ******* ** **** ******, including *** ******** ***********, ** *** ***** ************ *****.

Video ***********

*** ***** ***** ******* ************ *** configuration ** **** ******, ********* *********** settings, *** *****, *** ****:


*** ***********

******'* ********* *** *** ********* **** any ** *** ***** ******: ********, Genetec, *****, *** ********. ******* ** other **** ************, **** *** ** used ** ******* *** ************* ** relay ******* ** *** ******, ***** may ** ******** ********** ** *** VMS.

** ***** ******* *** *** *********, users *** **** ******* *****/*** ******** for ******.

Audio ******** ********

*** ******** ***** **** ******** ******** in ******* ************, **** **** *** from ******** *****.

**** **** ****** ********** ***** *** be **** *** ************* ********, ** *** frequency ******** ** *** ********* ********** and ******** ******* *** **** **** are ******* *** *** ****** ********* performance. However, ** **** ***** *** ***** examples ****** ** * *** ** repeatedly **** *** ******* ** ******** changes.

**** ***** *** *****

*****, **** ******* ***** ******** ** a ***** **** * ***** ** spectators. ****** ****** *** ****, ***** by *** ***** ******* ** ****** in *** ******** ****** *** *** frequencies ***** ** *** ***********. ********** alerts **** ********, *** *** ******** in **** *******:

****, ***-********** ******

****, **** ******* ***** ****, *** not ********** ******. **** **** ******** occurs **** **********, ** *** ******** window ***** *** ******. *******, ******* increased ******, *** ****** ** *** analyzed ** ********.

******* ***** *****

*******, **** ******* ***** ******* ***** noise ** *** ***********. **** **** lowered ****** *** ******* ***********, ****** are ****** ********:

Test **********

**** *** ********* ***** ** **** Q1615 **** ****** ******** * *** via **-* ***** *******.

*** ********* ********/******** ******** **** **** in **** ****:

  • ******/***** ************ ********** ********: *.*.*-******
  • **** *****: *.**.*.*
  • ***********: *.*.*.*****
  • ******* ******** ******: *.*.****.**
  • ********* ********: **** (*.**)
Comments (8)
U
Undisclosed #1
•Nov 21, 2015
IPVMU Certified

Nice thorough review!

Couple questions,

Are those timelines stored somewhere, or once they move off the screen are they gone?

Did you play back the clips thru speakers into the room and bring it thru the back thru the Mic, or just bring the clips straight in thru the line level input?

Considering that broadcast audio normally has its noise floor ducked and frequency response tuned for speech, if you brought it in direct it would, IMHO, perform far better than one could expect in the real world.

I remember a while back reading that the Sound Intelligence could detect swearing. Is that part of this product? If so is it region specific, as colorful speech often has it localized variants.

Finally, you say that there were no false positives in the three days of open office deployment. But were there any false negatives? I know that when I'm troubleshooting a particularly uncooperative camera, I occasionally might indicate my dissatisfaction by sharing an expletive with the device. In rare cases I have even gone so far as to threaten components with a hot soldering iron.

So I guess I'm asking is, did you get a chance to yell in an aggressive manner, for whatever reason, and did it seem to trigger correctly?

Thanks!

Avatar
Cameron Javdani
•Nov 23, 2015
Louroe Electronics

The timeline images are not stored, but you can record the audio that preceded and followed an alarm.

The analytic is designed to use unfiltered audio streams and compression algorithms that don't filter out certain frequencies. So playing an mp3 over a speaker might work to trigger a detection, but isn't as ideal as a couple guys yelling at each other.

Swearing detection is an interesting idea. Certainly if you screamed a swear word you'd get a detection, but that's because of a stressed voice and not the word identification. So as long as people aren't softly whispering swear words at each other you'd still get a detection regardless of language being spoken.

Avatar
Sal Visone
•Nov 26, 2015
DWG • IPVMU Certified

I'd be curious to see if they soon further develop additional audio analytics includes keyword recognition, alerting and searching.

MS
Mark Strange
•Nov 28, 2015
IPVMU Certified

Does this product assume that audio is actually recorded or is it just for live monitoring? In some states audio can't be recorded legally without consent from both parties.

JH
John Honovich
•Nov 29, 2015
IPVM
In reply to Mark Strange

Louroe says: "The analytic isn't listening to words or languages but rather vocal stress and the associated change in frequencies."

That would help reduce the risk / concern. The analytic also does not record audio.

Ultimately, it is a legal issue but it does seem technically different than audio recording.

U
Undisclosed #1
•Nov 29, 2015
IPVMU Certified
In reply to John Honovich

A novel use of this product would be to trigger the recording of audio only after and during detection, as such speech would not be considered interception of a private conversation, and would allow the capture of important audio details.

MA
Matt Alvey
•Nov 30, 2015

Thanks for the review. Regardless of test results, it is an innovative product from Louroe! You say you used an Axis Q1615 in the tests, but I don't understand where you're using the camera? Do you mean that you're just using the Q1615's audio feature?

JH
John Honovich
•Nov 30, 2015
IPVM
In reply to Matt Alvey

Matt, the audio analytics app is running on the Axis camera and the mic is connected to the Axis camera. This is shown in the config video, which I've copied below: