IronYun AI Analytics Tested

By: Rob Kilpatrick, Published on Feb 17, 2020

Taiwan / US startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service (VSaaS) solutions provider." But how good is the product itself?

We tested the product for two weeks including detection of people, backpacks, handbags, guns, animals plus color detection and facial recognition to see what strengths and weaknesses the system had.

****** / ** *********************** **** ** *********** *** "******* ** be *** ******* ********** Intelligence, *** **** ***** software ** * ******* (VSaaS) ********* ********." *** how **** ** *** product ******?

** ****** *** ******* for *** ***** ********* detection ** ******, *********, handbags, ****, ******* **** color ********* *** ****** recognition ** *** **** strengths *** ********** *** system ***.

[***************]

*******

******* ****** **** ****** person ********* *********, ********* backpack *** ****** *********, along **** ***** **** rec ********** ** **** lit ******, **** ** harsh ******.

*******, ** ******** **** some ****************** ** ********* on ******* ***** *** on ***** ******* ***** may ** ** ***** in **** ************.

*******, ***** **** ******** VMSes *** **** *******'* lack ** *** ******/***** integration ** ***** ** operators **** ***** *** use *** ******** *** to *** ***** ********.

Key ********

***** ** *** ***** of *******, ******* ******* several *********** *********:

  • ****** ****** *********:****** ********* *** *** of *******'* ********* *********, detecting ****** ** ****** walking *****, *******, ********, and **********. ****** **** even ******** ******* ******* or **** ****** *** by **********.
  • ***** ******** *** ******* Detection:************, ******* ********** ********** people **** **** ********* or ******* ****, * feature ***** *** *** work ************ ** ***** analytics.
  • *** ********* ********:******* *** **** **** were ******** ********** **** they ***** ** ******** in *******, *.*., ****** or **** ******* ** shooting ******. ********* *** not ********** **** **** were **** ** *** subject's **** ** **** facing *** ****** **** gun ******.
  • ***** ****** *********** ** Well *** ******:** *** *****, *******'* face *** ********** ********** subjects ** **** *** daytime ******, **** **** using ****** ********* (~**°) and ****** ** ********* (~45°).

*******, ***** **** ******* negatives:

  • ***** ****** ** ***** Animals:***** ******* **** ** deer ********* ********* ***** person ******.
  • ***** *************** ** ****:******* ********** ********* ** cameras' ***** ** ******** object *****, ********* ******, airplanes, ****, *** ****.
  • ****** **** ********* **********:******** ** *** ****** edge ** *******' *** (with ***** ***** **** out ** *****) **** often ********** ** *******. People ******** ******* ** full **** ** *** camera **** ********** ****** or ********** ** ****.
  • ******* ***/** ****** *********** Performance:*******'* **** *** ********* failed ** ******* ****** against ****** *********. ********** in ** ****** *** reduced ** ~** ******, causing ******, ** ****.
  • ** ****** *** *******:*******'* ****** (*********, **** rec, ***.) *** ****** are *** ********** ** third ***** ***. ****** events *** ** **** to ***** ***** ****, but **** ************* **** be ********* ********. ******* does ********* ** ***** to ******** ***** (**** and ********) *** ***** is ** ***** ***********.

*******

******* *** ** ********* street ***** ** ~$***-*** USD *** ******* *** live ********* (********* *********, facial ***********, ******** ******, etc.) *** ~$***-*** *** video ******, *** *******.

***** ****** *** ************* lower **** **** ***********, such ***********, ***** ***** *** over $*,*** *** *** channel, ***********, ***** *** * $20,000 ******* ***, ** a *** ******* ******* at $*** *** *******.

Solid ****** *********

** *** *****, ****** detection *** *** ** IronYun's ******* *********, ********* people ** **** ********* scenes, **** ** **** washed *** ** *** headlights:

** **** ** **** partially ********, **** ** outside ** *** ****** below.

** ****** **** ****** when ******* ** ********, either.

Accurate ******* *** ******** *********

************, *******'* ******** *** handbag ********* *** **** accurate **** ***** ********* we **** ****** ***** claim ** ****** ***** objects. ****** ******** *** or *** ***** ** both **** ******** ********.

Person **** *** ********

****** *******, ****** ******* on *** ****** ** crouching **** *** ********** detected *** ********* ********** as *******. ************, ******** were ******** ** ******* when ***** ****** **** was *** ** *** scene *** *** *** half ******** ** *** bottom ** *** ***, shown ****:

Gun ********* ******** ** **** *** ** *****

*** ********* *** ******** during ******* **** *** gun *** *******, *.*., when **** ** ** when *** ******* *** in *** ******** ******. Detection *** *** ******** when ****** ****** *** camera ** *** *** could *** ** **************.

****** **** ******** **** held **** ** *** subject's ****, *** *** as ******** ** **** held **. ******** **** not ******** **** **** down.

False *************** ** *********

********* ** *** **** of * ****** ***** be ******** *** **** of *** ********* *************** that ******* *******, ********* people:

** **** ** *********, bats, *** **** ***** classifications.

***** ****** ***** ** improved, *** *** *******, via ******** *******.

False ****** ** ***** *******

***** ******* ******* ******* the ***** **** ********** classified ** ******. ********** minimum ****** ********** ******* the ********* **** ******** but *** *** *** rid ** *** ***** alerts.

Poor **** *********** *********** ** *** *** **

****** ******* **** *********** performance ******* ** *** scene, ********** ******* ****** walking *******.

** ** ** *****, confidence ********* ******* ~** points ********* ** ****** even ** ***** *********.

Color ******** ** **** *****

********* ****** ** ******** color ***** ******** ** the ***** ******** ** either *** *** ** bottom ** ********, ***** a ****** *** *** correctly ***** ****** ******* red.

******, **** *** ** search ** **, ****** only **** ** ** white, ****, *** *****.

Alert *****

******* ** ** ***** in ******* ***** **** a *** *******. *****, the ******* ****** ** selected (*********, ****** ***********, fall *********, ***.), **** a **** *****. *******, specific ******* *** ******** (e.g. ****** **. ****** vs. ********).

Weak *** *******

******* **** *** ********* its **** ****** ** search ** *** *** out ** *** ***. Users *** ******* ****** in *** *** ***** HTTP, *** **** **** be ********** ********. ******* forensic ****** ** *** available **** *** ***.

**** **** ***** ** support *** ******* **************, ********* ***** *** Milestone, ** **** ** Hikvision *** ***** ****. These ************ ******* ******* from ******* *** ******** in *** **** *******.

Live ******** **

******* *** *** **** types ** **, **** and ******. *** "****" UI ******** * ******'* live **** ***** **** an ***** **** ** whatever **** ** ***** users *** ******* (********* shown *****). ***** *** click *** ***** ** begin ******** *** *** which ******* **** **********.

*******'* ****** ** ****** filtering ** ******* ** type, *****, *** ***** parameters, ** ******** ******* and ** ******** **** ranges, *** ******* ** the ******* ***** **** used ** *** **** analytic **** ***** *****.

***** ** ** ******** video ** *** ******* UI.

Comments (16)

Undisclosed Integrator #1

02/17/20 05:28pm

** **** *** ** age, ***** ****** ** MUCH *****.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/17/20 05:32pm

*** *** *** *********'* for ********* ******* ** pay * ******* *** get *** **** ***** much ******, ** *** test ******* ****. ****** choice, *****?

Undisclosed Integrator #1

In reply to John Honovich | 02/17/20 05:37pm

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

Undisclosed Integrator #3

In reply to Undisclosed Integrator #1 | 02/18/20 12:59am

****** ******, *** **'* be *********** ** *** a **** ** *** bottom **** **.

****, **** ***** ******* is ****** ******* ** the ***! ** ****** all ******* * ***-******.

Undisclosed Integrator #1

In reply to Undisclosed Integrator #3 | 02/18/20 01:17am

🙄**** ** ** ** that *** **** ********* in * **** ***** situation *** ****, **’* worth **. *** ***** expensive ** ******* ** matter **** **** ***, they’re ********* ** * controlled ***********.

John Honovich

IPVM | In reply to Undisclosed Integrator #1 | 02/18/20 01:24am

*** ***** ********* ** systems ** ****** **** they ***, ****’** ********* in * ********** ***********.

**** ***** ***** *** that *** ***** *** too ****. *** **** point ** **** **** are *** '********* ** a ****-***** *********'?

** ****** ** * 'real-world *********'.

* ** ****** ****** to ********** *** ***** of **** *********. ***** are ****** ** ********* and ** *** ** the ****** *** *****'* also ***** * *** of ********* **** '****-*****' testing.

Avatar

Igor Keel

3dEYE | In reply to Undisclosed Integrator #1 | 02/17/20 06:46pm

***** *** ************* ******* alternatives **#*, * ***** it **** ******* ** a **** ** **** basis **** *** **** out ** *** ********.

Undisclosed Integrator #2

02/17/20 09:40pm

** *** * **** unit ** **** *** but ** **** **** it *** *** **** refined. ** **** ******* it **** ** ******** system *** *** *** to **** ********** ** via ****.

Undisclosed #4

02/18/20 07:13am

** *** *** **** itself ** * **, based ** ***** *******. Perhaps ***** *********, *** just ** ** *****, you **** ** ******* the ******(*), *** *** each ****** *** *** up ** $*** *** "live *********" *** ** to ******* $*** *** "video ******"? *** ***** options ** ****** ***** on ******** ****** ****? The ********* **** ****** later ********, ***? ** "non ****"?

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Undisclosed #4 | 02/18/20 05:22pm

** "***** ******" **** mean ***** ****** ****** module (********* ** **+ objects). *** ***** **** not *** ******** ******** to *** ******* ******, it ***** ***** **** an *** ** *** (with * ******** ****** from *******) ** ** there ** * ******** event ** **** **** the **** **** *** NVR/VMS ** *** **** of *** *****. *** analytics *** ********* *** live ****** ** *** camera, *** ********.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | 02/18/20 07:42pm

** *******, ******* ***** their ****** "** ***" but ** **** *** function **** ** ***, it **** ***** *** snapshots **** ** ***** and **** *** ****** video ** *** ******. To ******** **** ***** from ** ***** ** needs ** ** ****** with ** *** ** VMS (**** * ******** driver **** *******)

Rob Dupré

In reply to Rob Kilpatrick | 04/01/20 06:33am

* ****** ** ** depth *******. *** ********, I ** ********** ** find **** ***** *** hardware. *** **** ******** does ***** ** *** support ** **** *** the ******** ************ ** run ** ** **** own ******?

paul sun

In reply to Rob Dupré | 04/01/20 05:41pm

** ***,

****** ******* ** *******@*******.***, ** **** ** glad ** ******* ***.

**** ***
*******

Dave Ricci

02/19/20 01:55pm

**’** * ******** ********** and **** ********* ******** IronYun ** ******* ********** several ******** ********* ** a **** ****** ***** enterprise ***********. *****, ** did ********* ********* ***** alarm ****** ** **** drops. **** ***** *** easily *** *********** ********* and *** **** ********** eliminated. **’** **** ********** results ** *** ******* situations ** *** **** 90 **********.
******, ******* **** ******* an *** **** ********* to **** ******* *** platforms. ***** ******* **** popular ** ********* ** say **** ********** ******* proved ** ** **** of *****. ** **** them ** *+.

Avatar

Rob Kilpatrick

IPVM | IPVMU Certified | In reply to Dave Ricci | 02/19/20 05:08pm

****, ******** ** **** first *******. **** ******* did *** **** ** completely ********* *** ***** alerts ** ****? ** found **** **** ********** the ********** ****** ** alarm ** * ****** wouldn't *** *** ** the ***** ******.

paul sun

In reply to Rob Kilpatrick | 02/19/20 09:17pm

**** ** **** **** IronYun. ** ******* *** confidence ********* ** ****** objects ** *.** *** the ******** ******* ***********. I ***** **** ********* used *.** ** *** Person ********** ********* *** that *** ** *** cause ** *** ******** false ******. ** **** seen ****, ****, *** ice ** **** ****** lenses ******* *** ***** alarms *** **** * year.

Read this IPVM report for free.

This article is part of IPVM's 6,441 reports, 866 tests and is only available to members. To get a one-time preview of our work, enter your work email to access the full article.

Already a member? Login here | Join now

Related Reports

Hikvision and Uniview Entry Level Thermal Handheld Cameras Tested on Jun 05, 2020
While most screening systems cost $10,000 or more, manufacturers such as...
Integrated IR Camera Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Jan 30, 2020
The best and worst cameras tested in this IPVM shootout showed major...
Dahua, Hikvision, ZKTeco Face Mask Detection Shootout on Jun 19, 2020
Temperature tablets with face mask detection are one of the hottest trends in...
TVT / InVid Facial Recognition Tested on Mar 25, 2020
Facial recognition is frequently sold for thousands of dollars per channel...
Injes Tiny Temperature Terminal Tested on Jul 17, 2020
While temperature terminals have trended bigger, the Injes DFace801 is...
ZKTeco Body Temperature and Mask Detection Reader Tested on May 26, 2020
While dedicated fever cameras emerged first, now tablet/kiosk fever detectors...
Bias In Facial Recognition Varies By Country, NIST Report Shows on Jul 15, 2020
While many argue that face recognition is inherently racist, results from one...
Tiandy Super Starlight Cameras Tested on Apr 30, 2020
Tiandy is taking aim at China competitors Dahua and Hikvision, with a new...
TVT / InVid White Light Camera Tested Vs Hikvision ColorVu on Mar 18, 2020
With mega China manufacturers Dahua and Hikvision facing both bans and human...
Cheap Camera Problems at Night on Feb 19, 2020
Cheap cameras generally have problems at night, despite the common perception...
TVT Temperature Measurement Terminal Tested on Jul 23, 2020
While Dahua and Hikvision get the most attention for China temp products,...
Mobotix Thermal Detection Camera Tested on Jun 09, 2020
For years Mobotix has struggled but now sales are surging driven by Mobotix's...
Dotty "Hot Or Not" Elevated Body Temperature App Tested on Jun 01, 2020
What if you could take an existing phone or tablet and transform it into...
Dahua Temperature Measurement Station Tested on Jun 17, 2020
Dahua hit the market hard with its original 'fever' camera (tested here)....
Uniview Deep Learning Camera Tested on Jul 14, 2020
Uniview's intrusion analytics have performed poorly in our shootouts. Now,...

Recent Reports

Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
"Grand Slam" For Pelco's PE Firm, A Risk For Motorola on Aug 07, 2020
The word "Pelco" and "grand slam" have not been said together for many years....
FLIR Stock Falls, Admits 'Decelerating' Demand For Temperature Screening on Aug 07, 2020
Is the boom going to bust for temperature screening? FLIR disappointed...
VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...
Dogs For Coronavirus Screening Examined on Aug 06, 2020
While thermal temperature screening is the surveillance industry's most...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
AHJ / Authority Having Jurisdiction Tutorial on Aug 06, 2020
One of the most powerful yet often underappreciated characters in all of the...
SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...
ADI Returns To Growth, Back To 'Pre-COVID Levels' on Aug 05, 2020
While ADI was hit hard in April, with revenue declining 21%, the company's...
Exposing Fever Tablet Suppliers and 40+ Relabelers on Aug 05, 2020
IPVM has found 40+ USA and EU companies relabeling fever tablets designed,...
Indian Government Restricts PRC Manufacturers From Public Projects on Aug 04, 2020
In a move that mirrors the U.S. government’s ban on Dahua and Hikvision...
Directory of 201 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Face Masks Increase Face Recognition Errors Says NIST on Aug 04, 2020
COVID-19 has led to widespread facemask use, which as IPVM testing has shown...
Dahua Loses Australian Medical Device Approval on Aug 04, 2020
Dahua has cancelled its medical device registration after "discussions" with...
Google Invests in ADT, ADT Stock Soars on Aug 03, 2020
Google has announced a $450 million investment in the Florida-based security...