IronYun AI Analytics Tested

By Rob Kilpatrick, Published on Feb 17, 2020

Taiwan / US startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service (VSaaS) solutions provider." But how good is the product itself?

We tested the product for two weeks including detection of people, backpacks, handbags, guns, animals plus color detection and facial recognition to see what strengths and weaknesses the system had.

*******

******* ****** **** ****** person ********* *********, ********* backpack *** ****** *********, along **** ***** **** rec ********** ** **** lit ******, **** ** harsh ******.

*******, ** ******** **** some ****************** ** ********* on ******* ***** *** on ***** ******* ***** may ** ** ***** in **** ************.

*******, ***** **** ******** VMSes *** **** *******'* lack ** *** ******/***** integration ** ***** ** operators **** ***** *** use *** ******** *** to *** ***** ********.

Key ********

***** ** *** ***** of *******, ******* ******* several *********** *********:

  • ****** ****** *********:****** ********* *** *** of *******'* ********* *********, detecting ****** ** ****** walking *****, *******, ********, and **********. ****** **** even ******** ******* ******* or **** ****** *** by **********.
  • ***** ******** *** ******* Detection:************, ******* ********** ********** people **** **** ********* or ******* ****, * feature ***** *** *** work ************ ** ***** analytics.
  • *** ********* ********:******* *** **** **** were ******** ********** **** they ***** ** ******** in *******, *.*., ****** or **** ******* ** shooting ******. ********* *** not ********** **** **** were **** ** *** subject's **** ** **** facing *** ****** **** gun ******.
  • ***** ****** *********** ** Well *** ******:** *** *****, *******'* face *** ********** ********** subjects ** **** *** daytime ******, **** **** using ****** ********* (~**°) and ****** ** ********* (~45°).

*******, ***** **** ******* negatives:

  • ***** ****** ** ***** Animals:***** ******* **** ** deer ********* ********* ***** person ******.
  • ***** *************** ** ****:******* ********** ********* ** cameras' ***** ** ******** object *****, ********* ******, airplanes, ****, *** ****.
  • ****** **** ********* **********:******** ** *** ****** edge ** *******' *** (with ***** ***** **** out ** *****) **** often ********** ** *******. People ******** ******* ** full **** ** *** camera **** ********** ****** or ********** ** ****.
  • ******* ***/** ****** *********** Performance:*******'* **** *** ********* failed ** ******* ****** against ****** *********. ********** in ** ****** *** reduced ** ~** ******, causing ******, ** ****.
  • ** ****** *** *******:*******'* ****** (*********, **** rec, ***.) *** ****** are *** ********** ** third ***** ***. ****** events *** ** **** to ***** ***** ****, but **** ************* **** be ********* ********. ******* does ********* ** ***** to ******** ***** (**** and ********) *** ***** is ** ***** ***********.

*******

******* *** ** ********* street ***** ** ~$***-*** USD *** ******* *** live ********* (********* *********, facial ***********, ******** ******, etc.) *** ~$***-*** *** video ******, *** *******.

***** ****** *** ************* lower **** **** ***********, such ***********, ***** ***** *** over $*,*** *** *** channel, ***********, ***** *** * $20,000 ******* ***, ** a *** ******* ******* at $*** *** *******.

Solid ****** *********

** *** *****, ****** detection *** *** ** IronYun's ******* *********, ********* people ** **** ********* scenes, **** ** **** washed *** ** *** headlights:

** **** ** **** partially ********, **** ** outside ** *** ****** below.

** ****** **** ****** when ******* ** ********, either.

Accurate ******* *** ******** *********

************, *******'* ******** *** handbag ********* *** **** accurate **** ***** ********* we **** ****** ***** claim ** ****** ***** objects. ****** ******** *** or *** ***** ** both **** ******** ********.

Person **** *** ********

****** *******, ****** ******* on *** ****** ** crouching **** *** ********** detected *** ********* ********** as *******. ************, ******** were ******** ** ******* when ***** ****** **** was *** ** *** scene *** *** *** half ******** ** *** bottom ** *** ***, shown ****:

Gun ********* ******** ** **** *** ** *****

*** ********* *** ******** during ******* **** *** gun *** *******, *.*., when **** ** ** when *** ******* *** in *** ******** ******. Detection *** *** ******** when ****** ****** *** camera ** *** *** could *** ** **************.

****** **** ******** **** held **** ** *** subject's ****, *** *** as ******** ** **** held **. ******** **** not ******** **** **** down.

False *************** ** *********

********* ** *** **** of * ****** ***** be ******** *** **** of *** ********* *************** that ******* *******, ********* people:

** **** ** *********, bats, *** **** ***** classifications.

***** ****** ***** ** improved, *** *** *******, via ******** *******.

False ****** ** ***** *******

***** ******* ******* ******* the ***** **** ********** classified ** ******. ********** minimum ****** ********** ******* the ********* **** ******** but *** *** *** rid ** *** ***** alerts.

Poor **** *********** *********** ** *** *** **

****** ******* **** *********** performance ******* ** *** scene, ********** ******* ****** walking *******.

** ** ** *****, confidence ********* ******* ~** points ********* ** ****** even ** ***** *********.

Color ******** ** **** *****

********* ****** ** ******** color ***** ******** ** the ***** ******** ** either *** *** ** bottom ** ********, ***** a ****** *** *** correctly ***** ****** ******* red.

******, **** *** ** search ** **, ****** only **** ** ** white, ****, *** *****.

Alert *****

******* ** ** ***** in ******* ***** **** a *** *******. *****, the ******* ****** ** selected (*********, ****** ***********, fall *********, ***.), **** a **** *****. *******, specific ******* *** ******** (e.g. ****** **. ****** vs. ********).

Weak *** *******

******* **** *** ********* its **** ****** ** search ** *** *** out ** *** ***. Users *** ******* ****** in *** *** ***** HTTP, *** **** **** be ********** ********. ******* forensic ****** ** *** available **** *** ***.

**** **** ***** ** support *** ******* **************, ********* ***** *** Milestone, ** **** ** Hikvision *** ***** ****. These ************ ******* ******* from ******* *** ******** in *** **** *******.

Live ******** **

******* *** *** **** types ** **, **** and ******. *** "****" UI ******** * ******'* live **** ***** **** an ***** **** ** whatever **** ** ***** users *** ******* (********* shown *****). ***** *** click *** ***** ** begin ******** *** *** which ******* **** **********.

*******'* ****** ** ****** filtering ** ******* ** type, *****, *** ***** parameters, ** ******** ******* and ** ******** **** ranges, *** ******* ** the ******* ***** **** used ** *** **** analytic **** ***** *****.

***** ** ** ******** video ** *** ******* UI.

Comments (16)

Undisclosed Integrator #1

02/17/20 05:28pm

** **** *** ** age, ***** ****** ** MUCH *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/17/20 05:32pm

*** *** *** *********'* for ********* ******* ** pay * ******* *** get *** **** ***** much ******, ** *** test ******* ****. ****** choice, *****?

Undisclosed Integrator #1

In reply to John Honovich | 02/17/20 05:37pm

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

Undisclosed #3

In reply to Undisclosed Integrator #1 | 02/18/20 12:59am

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

****, **** ***** ******* is ****** ******* ** the ***! ** ****** all ******* * ***-******.

Undisclosed Integrator #1

In reply to Undisclosed #3 | 02/18/20 01:17am

🙄**** ** ** ** that *** **** ********* in * **** ***** situation *** ****, **’* worth **. *** ***** expensive ** ******* ** matter **** **** ***, they’re ********* ** * controlled ***********.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/18/20 01:24am

*** ***** ********* ** systems ** ****** **** they ***, ****’** ********* in * ********** ***********.

**** ***** ***** *** that *** ***** *** too ****. *** **** point ** **** **** are *** '********* ** a ****-***** *********'?

** ****** ** * 'real-world *********'.

* ** ****** ****** to ********** *** ***** of **** *********. ***** are ****** ** ********* and ** *** ** the ****** *** *****'* also ***** * *** of ********* **** '****-*****' testing.

Avatar

Igor Keel

3dEYE | In reply to Undisclosed Integrator #1 | 02/17/20 06:46pm

***** *** ************* ******* alternatives **#*, * ***** it **** ******* ** a **** ** **** basis **** *** **** out ** *** ********.

Undisclosed Integrator #2

02/17/20 09:40pm

** *** * **** unit ** **** *** but ** **** **** it *** *** **** refined. ** **** ******* it **** ** ******** system *** *** *** to **** ********** ** via ****.

Undisclosed #4

02/18/20 07:13am

** *** *** **** itself ** * **, based ** ***** *******. Perhaps ***** *********, *** just ** ** *****, you **** ** ******* the ******(*), *** *** each ****** *** *** up ** $*** *** "live *********" *** ** to ******* $*** *** "video ******"? *** ***** options ** ****** ***** on ******** ****** ****? The ********* **** ****** later ********, ***? ** "non ****"?

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Undisclosed #4 | 02/18/20 05:22pm

** "***** ******" **** mean ***** ****** ****** module (********* ** **+ objects). *** ***** **** not *** ******** ******** to *** ******* ******, it ***** ***** **** an *** ** *** (with * ******** ****** from *******) ** ** there ** * ******** event ** **** **** the **** **** *** NVR/VMS ** *** **** of *** *****. *** analytics *** ********* *** live ****** ** *** camera, *** ********.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | 02/18/20 07:42pm

** *******, ******* ***** their ****** "** ***" but ** **** *** function **** ** ***, it **** ***** *** snapshots **** ** ***** and **** *** ****** video ** *** ******. To ******** **** ***** from ** ***** ** needs ** ** ****** with ** *** ** VMS (**** * ******** driver **** *******)

Rob Dupré

In reply to Rob Kilpatrick | 04/01/20 06:33am

* ****** ** ** depth *******. *** ********, I ** ********** ** find **** ***** *** hardware. *** **** ******** does ***** ** *** support ** **** *** the ******** ************ ** run ** ** **** own ******?

paul sun

In reply to Rob Dupré | 04/01/20 05:41pm

** ***,

****** ******* ** *******@*******.***, ** **** ** glad ** ******* ***.

**** ***
*******

Dave Ricci

02/19/20 01:55pm

**’** * ******** ********** and **** ********* ******** IronYun ** ******* ********** several ******** ********* ** a **** ****** ***** enterprise ***********. *****, ** did ********* ********* ***** alarm ****** ** **** drops. **** ***** *** easily *** *********** ********* and *** **** ********** eliminated. **’** **** ********** results ** *** ******* situations ** *** **** 90 **********.
******, ******* **** ******* an *** **** ********* to **** ******* *** platforms. ***** ******* **** popular ** ********* ** say **** ********** ******* proved ** ** **** of *****. ** **** them ** *+.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Dave Ricci | 02/19/20 05:08pm

****, ******** ** **** first *******. **** ******* did *** **** ** completely ********* *** ***** alerts ** ****? ** found **** **** ********** the ********** ****** ** alarm ** * ****** wouldn't *** *** ** the ***** ******.

paul sun

In reply to Rob Kilpatrick | 02/19/20 09:17pm

**** ** **** **** IronYun. ** ******* *** confidence ********* ** ****** objects ** *.** *** the ******** ******* ***********. I ***** **** ********* used *.** ** *** Person ********** ********* *** that *** ** *** cause ** *** ******** false ******. ** **** seen ****, ****, *** ice ** **** ****** lenses ******* *** ***** alarms *** **** * year.

Read this IPVM report for free.

This article is part of IPVM's 6,599 reports, 889 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Verkada Video Analytics Tested 2020 on Oct 08, 2020
In 2019, Verkada released people and face analytics but our testing then...
Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Face Detection Shootout - Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jul 30, 2020
Face detection analytics are available from a number of manufactures...
Injes Tiny Temperature Terminal Tested on Jul 17, 2020
While temperature terminals have trended bigger, the Injes DFace801 is...
Verkada 2020 Cameras Image Quality Test on Oct 06, 2020
Verkada's first-generation cameras suffered from numerous video quality...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Exacq "Facial Matching" Facial Recognition Tested on Sep 03, 2020
Exacq is claiming "Accurate Recall of Every Noteworthy Person of Interest"...
Security And Safety Things (S&ST) Tested on Oct 22, 2020
S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...
FaceFirst Problems And Layoff on Oct 01, 2020
FaceFirst, a US company and one of the oldest ongoing facial recognition...
Anixter Runs Fake Coronavirus Marketing Using Shutterstock Watermarked Images on Jul 24, 2020
Coronavirus faked marketing is regrettably commonplace right now but Anixter...
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...
Meridian & Goodview (BEMS Relabeller) Temperature Screening Tested on Oct 13, 2020
A lot of temperature tablets look exactly alike and that is because they use...
Startup Monitoreal Presents Home Object Detection AI on Aug 24, 2020
Monitoreal presented its on-premise only object detection AI at the 2020 IPVM...
Avigilon Elevated Temperature Detection Camera Tested on Sep 17, 2020
Avigilon has entered the temperature screening market with the release of...

Recent Reports

Bedside Cough and Sneeze Detector (Sound Intelligence and CLB) on Oct 28, 2020
Coronavirus has increased interest in detecting symptoms such as fever and...
Fever Tablet Thermal Sensors Examined (Melexis) on Oct 28, 2020
Fever tablet suppliers heavily rely on the accuracy and specs of...
Verkada Fires 3 on Oct 28, 2020
Verkada has fired three employees over an incident where female colleagues...
Recruiters Online Show LIVE Thursday! on Oct 27, 2020
IPVM's 7th online show resumes Thursday with 12 recruiters presenting...
Eagle Eye Networks Raises $40 Million on Oct 27, 2020
Eagle Eye has raised $40 million aiming to "reinvent video...
Hikvision Q3 2020 Global Revenue Rises, US Revenue Falls on Oct 27, 2020
While Hikvision's global revenue rises driven by domestic recovery, its US...
VICE Investigates Verkada's Harassing "RawVerkadawgz" on Oct 26, 2020
This month, IPVM investigated Verkada's sexism, discrimination, and cultural...
Six Flags' FDA Violating Outdoor Dahua Fever Cameras on Oct 26, 2020
As Six Flags scrambled to reopen parks amid plummeting revenues caused by the...
ISC Brasil Digital Experience 2020 Report on Oct 23, 2020
ISC Brasil 2020 rebranded itself to ISC Digital Experience and, like its...
Top Video Surveillance Service Call Problems 2020 on Oct 23, 2020
3 primary and 4 secondary issues stood out as causing the most problems when...
GDPR Impact On Temperature / Fever Screening Explained on Oct 22, 2020
What impact does GDPR have on temperature screening? Do you risk a GDPR fine...
Security And Safety Things (S&ST) Tested on Oct 22, 2020
S&ST, a Bosch spinout, is spending tens of millions of dollars aiming to...
Nokia Fever Screening Claims To "Advance Fight Against COVID-19" on Oct 22, 2020
First IBM, then briefly Clorox, and now Nokia becomes the latest Fortune 500...
Deceptive Meridian Temperature Tablets Endanger Public Safety on Oct 21, 2020
IPVM's testing of and investigation into Meridian Kiosk's temperature...
Honeywell 30 Series and Vivotek NVRs Tested on Oct 21, 2020
The NDAA ban has driven many users to look for low-cost NVRs not made by...