IronYun AI Analytics Tested

By Rob Kilpatrick, Published Feb 17, 2020, 11:43am EST (Research)

****** / ** *********************** **** ** *********** *** "******* ** ** *** leading ********** ************, *** **** ***** software ** * ******* (*****) ********* provider." *** *** **** ** *** product ******?

IPVM Image

** ****** *** ******* *** *** weeks ********* ********* ** ******, *********, handbags, ****, ******* **** ***** ********* and ****** *********** ** *** **** strengths *** ********** *** ****** ***.

*******

******* ****** **** ****** ****** ********* analytics, ********* ******** *** ****** *********, along **** ***** **** *** ********** in **** *** ******, **** ** harsh ******.

*******, ** ******** **** **** ****************** on ********* ** ******* ***** *** on ***** ******* ***** *** ** an ***** ** **** ************.

*******, ***** **** ******** ***** *** find *******'* **** ** *** ******/***** integration ** ***** ** ********* **** learn *** *** *** ******** *** to *** ***** ********.

Key ********

***** ** *** ***** ** *******, IronYun ******* ******* *********** *********:

  • ****** ****** *********:****** ********* *** *** ** *******'* strongest *********, ********* ****** ** ****** walking *****, *******, ********, *** **********. People **** **** ******** ******* ******* or **** ****** *** ** **********.
  • ***** ******** *** ******* *********:************, ******* ********** ********** ****** **** worn ********* ** ******* ****, * feature ***** *** *** **** ************ in ***** *********.
  • *** ********* ********:******* *** **** **** **** ******** accurately **** **** ***** ** ******** in *******, *.*., ****** ** **** subject ** ******** ******. ********* *** not ********** **** **** **** **** at *** *******'* **** ** **** facing *** ****** **** *** ******.
  • ***** ****** *********** ** **** *** Scenes:** *** *****, *******'* **** *** accurately ********** ******** ** **** *** daytime ******, **** **** ***** ****** downtilts (~**°) *** ****** ** ********* (~45°).

*******, ***** **** ******* *********:

  • ***** ****** ** ***** *******:***** ******* **** ** **** ********* triggered ***** ****** ******.
  • ***** *************** ** ****:******* ********** ********* ** *******' ***** as ******** ****** *****, ********* ******, airplanes, ****, *** ****.
  • ****** **** ********* **********:******** ** *** ****** **** ** cameras' *** (**** ***** ***** **** out ** *****) **** ***** ********** as *******. ****** ******** ******* ** full **** ** *** ****** **** frequently ****** ** ********** ** ****.
  • ******* ***/** ****** *********** ***********:*******'* **** *** ********* ****** ** capture ****** ******* ****** *********. ********** in ** ****** *** ******* ** ~20 ******, ******* ******, ** ****.
  • ** ****** *** *******:*******'* ****** (*********, **** ***, ***.) and ****** *** *** ********** ** third ***** ***. ****** ****** *** be **** ** ***** ***** ****, but **** ************* **** ** ********* manually. ******* **** ********* ** ***** to ******** ***** (**** *** ********) but ***** ** ** ***** ***********.

*******

******* *** ** ********* ****** ***** of ~$***-*** *** *** ******* *** live ********* (********* *********, ****** ***********, abnormal ******, ***.) *** ~$***-*** *** video ******, *** *******.

***** ****** *** ************* ***** **** some ***********, **** ***********, ***** ***** *** **** $*,*** USD *** *******, ***********, ***** *** * $**,*** ******* kit, ** * *** ******* ******* at $*** *** *******.

Solid ****** *********

** *** *****, ****** ********* *** one ** *******'* ******* *********, ********* people ** **** ********* ******, **** as **** ****** *** ** *** headlights:

IPVM Image

** **** ** **** ********* ********, such ** ******* ** *** ****** below.

IPVM Image

** ****** **** ****** **** ******* or ********, ******.

IPVM Image

Accurate ******* *** ******** *********

************, *******'* ******** *** ******* ********* was **** ******** **** ***** ********* we **** ****** ***** ***** ** detect ***** *******. ****** ******** *** or *** ***** ** **** **** reliably ********.

IPVM Image

Person **** *** ********

****** *******, ****** ******* ** *** ground ** ********* **** *** ********** detected *** ********* ********** ** *******. Additionally, ******** **** ******** ** ******* when ***** ****** **** *** *** of *** ***** *** *** *** half ******** ** *** ****** ** the ***, ***** ****:

IPVM Image

Gun ********* ******** ** **** *** ** *****

*** ********* *** ******** ****** ******* when *** *** *** *******, *.*., when **** ** ** **** *** subject *** ** *** ******** ******. Detection *** *** ******** **** ****** toward *** ****** ** *** *** could *** ** **************.

IPVM Image

****** **** ******** **** **** **** at *** *******'* ****, *** *** as ******** ** **** **** **. Handguns **** *** ******** **** **** down.

IPVM Image

False *************** ** *********

********* ** *** **** ** * camera ***** ** ******** *** **** of *** ********* *************** **** ******* detects, ********* ******:

IPVM Image

** **** ** *********, ****, *** many ***** ***************.

IPVM Image

***** ****** ***** ** ********, *** not *******, *** ******** *******.

False ****** ** ***** *******

***** ******* ******* ******* *** ***** were ********** ********** ** ******. ********** minimum ****** ********** ******* *** ********* this ******** *** *** *** *** rid ** *** ***** ******.

IPVM Image

Poor **** *********** *********** ** *** *** **

****** ******* **** *********** *********** ******* in *** *****, ********** ******* ****** walking *******.

IPVM Image

** ** ** *****, ********** ********* dropped ~** ****** ********* ** ****** even ** ***** *********.

IPVM Image

Color ******** ** **** *****

********* ****** ** ******** ***** ***** resulted ** *** ***** ******** ** either *** *** ** ****** ** clothing, ***** * ****** *** *** correctly ***** ****** ******* ***.

IPVM Image

******, **** *** ** ****** ** IR, ****** **** **** ** ** white, ****, *** *****.

IPVM Image

Alert *****

******* ** ** ***** ** ******* takes **** * *** *******. *****, the ******* ****** ** ******** (*********, facial ***********, **** *********, ***.), **** a **** *****. *******, ******** ******* are ******** (*.*. ****** **. ****** vs. ********).

Weak *** *******

******* **** *** ********* *** **** events ** ****** ** *** *** out ** *** ***. ***** *** trigger ****** ** *** *** ***** HTTP, *** **** **** ** ********** manually. ******* ******** ****** ** *** available **** *** ***.

**** **** ***** ** ******* *** pulling **************, ********* ***** *** *********, ** well ** ********* *** ***** ****. These ************ ******* ******* **** ******* not ******** ** *** **** *******.

Live ******** **

******* *** *** **** ***** ** UI, **** *** ******. *** "****" UI ******** * ******'* **** **** along **** ** ***** **** ** whatever **** ** ***** ***** *** viewing (********* ***** *****). ***** *** click *** ***** ** ***** ******** and *** ***** ******* **** **********.

IPVM Image

*******'* ****** ** ****** ********* ** objects ** ****, *****, *** ***** parameters, ** ******** ******* *** ** specific **** ******, *** ******* ** the ******* ***** **** **** ** the **** ******** **** ***** *****.

IPVM Image

***** ** ** ******** ***** ** the ******* **.

Comments (16)

At this day in age, price should be MUCH LOWER.

Agree: 4
Disagree: 2
Informative: 1
Unhelpful
Funny

You can buy Hikvision's for virtually nothing or pay a premium and get one that works much better, as our test results show. Market choice, right?

Agree: 4
Disagree
Informative
Unhelpful
Funny

Market choice, but it'd be interesting to see a race to the bottom with AI.

Agree
Disagree: 4
Informative
Unhelpful
Funny

Market choice, but it'd be interesting to see a race to the bottom with AI.

Yeah, that pesky revenue is always getting in the way! We should all operate a non-profit.

Agree
Disagree
Informative
Unhelpful
Funny: 4

🙄Give me an AI that has been developed in a real world situation and sure, it’s worth it. But these expensive AI systems no matter what they say, they’re developed in a controlled environment.

Agree: 1
Disagree
Informative
Unhelpful
Funny

But these expensive AI systems no matter what they say, they’re developed in a controlled environment.

Your first point was that the price was too high. How your point is that they are not 'developed in a real-world situation'?

We tested it a 'real-world situation'.

I am really trying to understand the basis of your criticism. There are things to criticize and we did in the report but there's also quite a lot of positives from 'real-world' testing.

Agree: 7
Disagree
Informative
Unhelpful
Funny

There are significantly cheaper alternatives UI#1, I guess it just depends on a case by case basis what you need out of the solution.

Agree
Disagree
Informative
Unhelpful: 1
Funny

We got a demo unit of iron yun but it felt like it was not very refined. We were testing it with an Avigilon system and the had to pull everything in via rtsp.

Agree
Disagree
Informative: 6
Unhelpful
Funny

So the NVR unit itself is a PC, based on their website. Perhaps silly questions, but just to be clear, you have to provide the camera(s), and for each camera you pay up to $800 for "live analytics" and up to another $400 for "video search"? Are there options to record based on specific events only? The analytics work during later playback, yes? So "non live"?

Agree
Disagree
Informative
Unhelpful
Funny

By "video search" they mean their object search module (detection of 50+ objects). The video does not get recorded directly to the Ironyun device, it pulls video from an NVR or VMS (with a specific driver from Ironyun) so if there is a specific event it will grab the clip from the NVR/VMS at the time of the event. The analytics are analyzing the live stream of the camera, not playback.

Agree
Disagree
Informative
Unhelpful
Funny

To clarify, Ironyun calls their device "AI NVR" but it does not function like an NVR, it only saves the snapshots from an event and does not record video to the device. To actually view video from an event it needs to be paired with an NVR or VMS (with a specific driver from Ironyun)

Agree
Disagree
Informative
Unhelpful
Funny

A useful an in depth article. One question, I am struggling to find info about the hardware. How many channels does their AI NVR support or what are the hardware requirements to run it on your own system?

Agree
Disagree
Informative
Unhelpful
Funny

Hi Rob,

Please contact us at sales@IronYun.com , we will be glad to support you.

Paul Sun
IronYun

Agree
Disagree
Informative
Unhelpful
Funny

We’re a security integrator and have installed multiple IronYun AI servers supporting several featured analytics in a high camera count enterprise environment. First, we did initially encounter false alarm issues on rain drops. This issue was easily and permanently corrected and has been completely eliminated. We’ve seen consistent results in all weather situations in the high 90 percentile.
Second, IronYun does provide an end user interface to many popular VMS platforms. After testing many popular AI solutions we say with confidence IronYun proved to be best of class. We give them an A+.

Agree
Disagree
Informative
Unhelpful
Funny

Dave, congrats on your first comment. What changes did you make to completely eliminate the false alerts on rain? We found that even increasing the confidence needed to alarm on a person wouldn't get rid of the false alarms.

Agree
Disagree
Informative
Unhelpful
Funny

This is Dave from IronYun. We changed the confidence threshold on Person objects to 0.85 and the raindrop problem disappeared. I think IPVM initially used 0.50 as the Person confidence threshold and that may be the cause of the raindrop false alarms. We have seen rain, snow, and ice on many camera lenses without any false alarms for over a year.

Agree
Disagree
Informative: 3
Unhelpful
Funny: 1
Subscribe to IPVM Research to read the full report.
Why do I need to subscribe?
The IPVM Research Service includes products tests and shootouts plus competitive and financial analysis, helping decision-makers better evaluate purchasing, partnering, developing, and/or competing against companies in physical security.
Already have an account?
Loading Related Reports