IronYun AI Analytics Tested

By: Rob Kilpatrick, Published on Feb 17, 2020

Taiwan / US startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service (VSaaS) solutions provider." But how good is the product itself?

We tested the product for two weeks including detection of people, backpacks, handbags, guns, animals plus color detection and facial recognition to see what strengths and weaknesses the system had.

****** / ** *********************** **** ** *********** *** "******* ** be *** ******* ********** Intelligence, *** **** ***** software ** * ******* (VSaaS) ********* ********." *** how **** ** *** product ******?

** ****** *** ******* for *** ***** ********* detection ** ******, *********, handbags, ****, ******* **** color ********* *** ****** recognition ** *** **** strengths *** ********** *** system ***.

[***************]

*******

******* ****** **** ****** person ********* *********, ********* backpack *** ****** *********, along **** ***** **** rec ********** ** **** lit ******, **** ** harsh ******.

*******, ** ******** **** some ****************** ** ********* on ******* ***** *** on ***** ******* ***** may ** ** ***** in **** ************.

*******, ***** **** ******** VMSes *** **** *******'* lack ** *** ******/***** integration ** ***** ** operators **** ***** *** use *** ******** *** to *** ***** ********.

Key ********

***** ** *** ***** of *******, ******* ******* several *********** *********:

  • ****** ****** *********:****** ********* *** *** of *******'* ********* *********, detecting ****** ** ****** walking *****, *******, ********, and **********. ****** **** even ******** ******* ******* or **** ****** *** by **********.
  • ***** ******** *** ******* Detection:************, ******* ********** ********** people **** **** ********* or ******* ****, * feature ***** *** *** work ************ ** ***** analytics.
  • *** ********* ********:******* *** **** **** were ******** ********** **** they ***** ** ******** in *******, *.*., ****** or **** ******* ** shooting ******. ********* *** not ********** **** **** were **** ** *** subject's **** ** **** facing *** ****** **** gun ******.
  • ***** ****** *********** ** Well *** ******:** *** *****, *******'* face *** ********** ********** subjects ** **** *** daytime ******, **** **** using ****** ********* (~**°) and ****** ** ********* (~45°).

*******, ***** **** ******* negatives:

  • ***** ****** ** ***** Animals:***** ******* **** ** deer ********* ********* ***** person ******.
  • ***** *************** ** ****:******* ********** ********* ** cameras' ***** ** ******** object *****, ********* ******, airplanes, ****, *** ****.
  • ****** **** ********* **********:******** ** *** ****** edge ** *******' *** (with ***** ***** **** out ** *****) **** often ********** ** *******. People ******** ******* ** full **** ** *** camera **** ********** ****** or ********** ** ****.
  • ******* ***/** ****** *********** Performance:*******'* **** *** ********* failed ** ******* ****** against ****** *********. ********** in ** ****** *** reduced ** ~** ******, causing ******, ** ****.
  • ** ****** *** *******:*******'* ****** (*********, **** rec, ***.) *** ****** are *** ********** ** third ***** ***. ****** events *** ** **** to ***** ***** ****, but **** ************* **** be ********* ********. ******* does ********* ** ***** to ******** ***** (**** and ********) *** ***** is ** ***** ***********.

*******

******* *** ** ********* street ***** ** ~$***-*** USD *** ******* *** live ********* (********* *********, facial ***********, ******** ******, etc.) *** ~$***-*** *** video ******, *** *******.

***** ****** *** ************* lower **** **** ***********, such ***********, ***** ***** *** over $*,*** *** *** channel, ***********, ***** *** * $20,000 ******* ***, ** a *** ******* ******* at $*** *** *******.

Solid ****** *********

** *** *****, ****** detection *** *** ** IronYun's ******* *********, ********* people ** **** ********* scenes, **** ** **** washed *** ** *** headlights:

** **** ** **** partially ********, **** ** outside ** *** ****** below.

** ****** **** ****** when ******* ** ********, either.

Accurate ******* *** ******** *********

************, *******'* ******** *** handbag ********* *** **** accurate **** ***** ********* we **** ****** ***** claim ** ****** ***** objects. ****** ******** *** or *** ***** ** both **** ******** ********.

Person **** *** ********

****** *******, ****** ******* on *** ****** ** crouching **** *** ********** detected *** ********* ********** as *******. ************, ******** were ******** ** ******* when ***** ****** **** was *** ** *** scene *** *** *** half ******** ** *** bottom ** *** ***, shown ****:

Gun ********* ******** ** **** *** ** *****

*** ********* *** ******** during ******* **** *** gun *** *******, *.*., when **** ** ** when *** ******* *** in *** ******** ******. Detection *** *** ******** when ****** ****** *** camera ** *** *** could *** ** **************.

****** **** ******** **** held **** ** *** subject's ****, *** *** as ******** ** **** held **. ******** **** not ******** **** **** down.

False *************** ** *********

********* ** *** **** of * ****** ***** be ******** *** **** of *** ********* *************** that ******* *******, ********* people:

** **** ** *********, bats, *** **** ***** classifications.

***** ****** ***** ** improved, *** *** *******, via ******** *******.

False ****** ** ***** *******

***** ******* ******* ******* the ***** **** ********** classified ** ******. ********** minimum ****** ********** ******* the ********* **** ******** but *** *** *** rid ** *** ***** alerts.

Poor **** *********** *********** ** *** *** **

****** ******* **** *********** performance ******* ** *** scene, ********** ******* ****** walking *******.

** ** ** *****, confidence ********* ******* ~** points ********* ** ****** even ** ***** *********.

Color ******** ** **** *****

********* ****** ** ******** color ***** ******** ** the ***** ******** ** either *** *** ** bottom ** ********, ***** a ****** *** *** correctly ***** ****** ******* red.

******, **** *** ** search ** **, ****** only **** ** ** white, ****, *** *****.

Alert *****

******* ** ** ***** in ******* ***** **** a *** *******. *****, the ******* ****** ** selected (*********, ****** ***********, fall *********, ***.), **** a **** *****. *******, specific ******* *** ******** (e.g. ****** **. ****** vs. ********).

Weak *** *******

******* **** *** ********* its **** ****** ** search ** *** *** out ** *** ***. Users *** ******* ****** in *** *** ***** HTTP, *** **** **** be ********** ********. ******* forensic ****** ** *** available **** *** ***.

**** **** ***** ** support *** ******* **************, ********* ***** *** Milestone, ** **** ** Hikvision *** ***** ****. These ************ ******* ******* from ******* *** ******** in *** **** *******.

Live ******** **

******* *** *** **** types ** **, **** and ******. *** "****" UI ******** * ******'* live **** ***** **** an ***** **** ** whatever **** ** ***** users *** ******* (********* shown *****). ***** *** click *** ***** ** begin ******** *** *** which ******* **** **********.

*******'* ****** ** ****** filtering ** ******* ** type, *****, *** ***** parameters, ** ******** ******* and ** ******** **** ranges, *** ******* ** the ******* ***** **** used ** *** **** analytic **** ***** *****.

***** ** ** ******** video ** *** ******* UI.

Comments (16)

Undisclosed Integrator #1

02/17/20 05:28pm

** **** *** ** age, ***** ****** ** MUCH *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/17/20 09:32am

*** *** *** *********'* for ********* ******* ** pay * ******* *** get *** **** ***** much ******, ** *** test ******* ****. ****** choice, *****?

Undisclosed Integrator #1

In reply to John Honovich | 02/17/20 05:37pm

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

Undisclosed Integrator #3

In reply to Undisclosed Integrator #1 | 02/17/20 04:59pm

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

****, **** ***** ******* is ****** ******* ** the ***! ** ****** all ******* * ***-******.

Undisclosed Integrator #1

In reply to Undisclosed Integrator #3 | 02/17/20 05:17pm

🙄**** ** ** ** that *** **** ********* in * **** ***** situation *** ****, **’* worth **. *** ***** expensive ** ******* ** matter **** **** ***, they’re ********* ** * controlled ***********.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/17/20 05:24pm

*** ***** ********* ** systems ** ****** **** they ***, ****’** ********* in * ********** ***********.

**** ***** ***** *** that *** ***** *** too ****. *** **** point ** **** **** are *** '********* ** a ****-***** *********'?

** ****** ** * 'real-world *********'.

* ** ****** ****** to ********** *** ***** of **** *********. ***** are ****** ** ********* and ** *** ** the ****** *** *****'* also ***** * *** of ********* **** '****-*****' testing.

Avatar

Igor Keel

3dEYE | In reply to Undisclosed Integrator #1 | 02/17/20 10:46am

***** *** ************* ******* alternatives **#*, * ***** it **** ******* ** a **** ** **** basis **** *** **** out ** *** ********.

Undisclosed Integrator #2

02/17/20 01:40pm

** *** * **** unit ** **** *** but ** **** **** it *** *** **** refined. ** **** ******* it **** ** ******** system *** *** *** to **** ********** ** via ****.

Undisclosed #4

02/17/20 11:13pm

** *** *** **** itself ** * **, based ** ***** *******. Perhaps ***** *********, *** just ** ** *****, you **** ** ******* the ******(*), *** *** each ****** *** *** up ** $*** *** "live *********" *** ** to ******* $*** *** "video ******"? *** ***** options ** ****** ***** on ******** ****** ****? The ********* **** ****** later ********, ***? ** "non ****"?

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Undisclosed #4 | 02/18/20 09:22am

** "***** ******" **** mean ***** ****** ****** module (********* ** **+ objects). *** ***** **** not *** ******** ******** to *** ******* ******, it ***** ***** **** an *** ** *** (with * ******** ****** from *******) ** ** there ** * ******** event ** **** **** the **** **** *** NVR/VMS ** *** **** of *** *****. *** analytics *** ********* *** live ****** ** *** camera, *** ********.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | 02/18/20 11:42am

** *******, ******* ***** their ****** "** ***" but ** **** *** function **** ** ***, it **** ***** *** snapshots **** ** ***** and **** *** ****** video ** *** ******. To ******** **** ***** from ** ***** ** needs ** ** ****** with ** *** ** VMS (**** * ******** driver **** *******)

Rob Dupré

In reply to Rob Kilpatrick | 03/31/20 11:33pm

* ****** ** ** depth *******. *** ********, I ** ********** ** find **** ***** *** hardware. *** **** ******** does ***** ** *** support ** **** *** the ******** ************ ** run ** ** **** own ******?

paul sun

In reply to Rob Dupré | 04/01/20 10:41am

** ***,

****** ******* ** *******@*******.***, ** **** ** glad ** ******* ***.

**** ***
*******

Dave Ricci

02/19/20 05:55am

**’** * ******** ********** and **** ********* ******** IronYun ** ******* ********** several ******** ********* ** a **** ****** ***** enterprise ***********. *****, ** did ********* ********* ***** alarm ****** ** **** drops. **** ***** *** easily *** *********** ********* and *** **** ********** eliminated. **’** **** ********** results ** *** ******* situations ** *** **** 90 **********.
******, ******* **** ******* an *** **** ********* to **** ******* *** platforms. ***** ******* **** popular ** ********* ** say **** ********** ******* proved ** ** **** of *****. ** **** them ** *+.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Dave Ricci | 02/19/20 09:08am

****, ******** ** **** first *******. **** ******* did *** **** ** completely ********* *** ***** alerts ** ****? ** found **** **** ********** the ********** ****** ** alarm ** * ****** wouldn't *** *** ** the ***** ******.

paul sun

In reply to Rob Kilpatrick | 02/19/20 01:17pm

**** ** **** **** IronYun. ** ******* *** confidence ********* ** ****** objects ** *.** *** the ******** ******* ***********. I ***** **** ********* used *.** ** *** Person ********** ********* *** that *** ** *** cause ** *** ******** false ******. ** **** seen ****, ****, *** ice ** **** ****** lenses ******* *** ***** alarms *** **** * year.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Monitoreal "Completely Autonomous" Home AI Tested on Feb 12, 2020
Monitoreal claims to allow users to "see the things you want (people, vehicles, animals) and ignore the things you don’t”, using AI to distinguish...
BriefCam Video Analytics Tested on Jan 06, 2020
BriefCam, acquired by Canon in 2018, is one of the most commonly used video analytics offerings in the West. But how well does it work? We...
Avigilon Facial Recognition 'Appearance Alerts' Tested on Dec 18, 2019
Avigilon has released 'Appearance Alerts' in ACC 7.4, which adds real-time facial recognition. To see how this performed, we tested them with...
Avigilon Appearance Search Tested on Oct 30, 2019
Avigilon Appearance Search claims that it "sorts through hours of video with ease, to quickly locate a specific person or vehicle of interest...
Hikvision Acusense Analytics Tested on Sep 23, 2019
Hikvision touts "The Magic Behind It All" in their new Acusense line are 'deep learning algorithms' inside these cameras and recorders. But how...
Axis Perimeter Defender Improves, Yet Worse Than Dahua and Wyze on Sep 19, 2019
While Axis Perimeter Defender analytics improved from our 2018 testing, the market has improved much faster, with much less expensive offerings...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Anyvision Facial Recognition Tested on Aug 21, 2019
Anyvision is aiming for $1 billion in revenue by 2022, backed by $74 million in funding. But does their performance live up to the hype they have...
Verkada People And Face Analytics Tested on Aug 16, 2019
This week, Verkada released "People Analytics", including face analytics that they describe is a "game-changing feature" that "pushes the...
Hikvision DeepinMind 2019 Test on Jun 06, 2019
In 2018, Hikvision's DeepinMind AI NVR performed terribly, recognizing vehicles, animals, and other objects as humans, misclassifying demographics,...

Most Recent Industry Reports

YCombinator AI Startup Visual One Tested on Apr 02, 2020
Startup Visual One, backed by Silicon Valley's powerful Y Combinator, aims to be "Your 24/7 Watchman" with advanced analytics and object...
Free IPVM Memberships For The Unemployed on Apr 02, 2020
IPVM is giving 3-month free memberships (regular price $99) for the unemployed, no questions asked. To get it, just contact us, your request...
Dahua Faked Coronavirus Camera Marketing on Apr 01, 2020
Dahua has conducted a coronavirus camera global marketing campaign centered around a faked detection. Now, Dahua has expanded this to the USA,...
Video Surveillance Trends 101 on Apr 01, 2020
This report examines major industry factors and how they could impact video surveillance in the next 5 - 10 years. This is part of our Video...
USA's Seek Scan Thermal Temperature System Examined on Apr 01, 2020
This US company, Seek, located down the road from FLIR and founded by former FLIR employees is offering a thermal temperature system for the...
Terrible Convergint Coronavirus Thermal Camera Recommendation on Apr 01, 2020
A week after Convergint disclosed falling revenue, pay and job cuts, Convergint is touting 'extensive research' that is either grossly incompetent...
The IPVM New Products Online Show April 2020 Opens With 40+ Manufacturers on Mar 31, 2020
IPVM is excited to announce the first New Products Online show, with 40+ manufacturers, to be held April 14 to the 16th, free to IPVM members,...
USA's Feevr Thermal Temperature System Examined on Mar 31, 2020
This US company has burst on to the scene, brashly naming itself 'feevr' and branding itself as a "COVID 19 - AI BASED NON CONTACT THERMAL...
JCI Coronavirus Cuts on Mar 31, 2020
JCI has made coronavirus cuts, the company told employees in an email that IPVM has reviewed. Inside this note, we examine the cuts made, the...
Add Door Operators To Fight Coronavirus on Mar 31, 2020
IPVM recommends that integrators advocate and end-users consider adding door operators to fight the spread of coronavirus. This delivers...