Consumer IP Camera Analytics Shootout - Arlo, Google / Nest, Amazon / Ring, Hikvision / Ezviz

By: IPVM Team, Published on Aug 27, 2018

Consumer IP camera usage is growing significantly driven by large companies including Google (with Nest), Amazon (with Ring), Netgear (with Arlo) and Hikvision (with Ezviz). Plus, analytics are an increasingly standard component of such systems but how well do they perform?

IPVM has already shot out professional IP camera analytics including Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, and Uniview. Now we turn to their consumer counterparts, as we purchased and tested outdoor offerings from:

How well would their analytics perform? And would the significant cost savings of the Hikvision Ezviz provide just as good quality as the much more expensive alternatives?

In this report, we share our results including:

  • Analytic performance rankings
  • False alert resistance versus foliage, shadows, animals, rain, lights, and more
  • Fast moving vs. normal speed object detection
  • Detection distances/PPF levels
  • Configuration/zone creation for each
  • How pricing compares, for cameras and cloud service

Camera Selection

For this test, we bought the newest and highest performance outdoor models as specified by each manufacturer. Arlo and Nest offer person detection analytics, while Ezviz and Ring offer motion detection (though Ring calls theirs "Advanced Motion Detection"). The Ezviz EzGuard camera is notably less expensive than others, detailed below, but is their current highest performance model.

Summary

Our testing demonstrated three tiers:

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

  • Top Performers: During testing, Nest performed the best using its person detection analytic, avoiding false alerts on all common sources such as swaying brush/foliage, small animals, shadows, and rain. Nest did have some shortcomings though, missing people detection when subjects ran through the scene (though subjects at normal walking speed were detected without issue). Also note that Nest's motion detection (non-people) suffered from many false triggers which person detection avoided.
  • Middle Performers: Ring and Arlo performance was solid, managing to avoid false alerts on all common sources noted above although Ring alarmed constantly during heavy rain and Arlo's detection distance was half of all other cameras tested. Ring and Arlo also had trouble detecting the subject running through the scene, while walking subjects were reliably detected.
  • Low Performers: Ezviz was the lowest performer in the test, alerting on all sources listed above, although it did not miss the subject running through the scene like the other consumer offerings. Reducing sensitivity decreased the severity of false alerts, but also resulted in missed detection of subjects at close range moving at normal walking speed, not seen in any other model.

Results Overview

The chart below shows a summary of key differentiators of tested cameras/analytics:

We look at these factors in more detail below.

Arlo, Nest, Ring: Solid False Alert Resistance

In our testing, Nest, Ring, and Arlo consistently performed well outdoors, avoiding common false alerts such as swaying brush, shadows, small animals, and lights which frequently triggered many commercial analytics in our testing.

Nest Motion Poor Performance Vs. Nest Person Detection

While Nest's person detection performance is strong, with no false alerts during our tests, their generic motion detection triggered frequently on various objects, such as foliage, animals, and rain (discussed below) which person detection ignored.

Because of this, users desiring alerts for more than just people (such as vehicles or animals) are likely to experience a considerable number of nuisance alerts.

Ring/Nest (Motion) Rain Issues

In our tests, while Ring did not alert on common sources like brush or animals, it had significant issues during rain storms, alerting almost constantly during heavy rain. By contrast, Arlo and Ezviz did not alarm on rain at all. Nest person detection did not trigger at all in rain. However, motion detection triggered frequently, similar to Ring.

Running Subjects Not Detected: Arlo, Nest, Ring

Unlike commercial models, all cameras except Ezviz and Nest motion detection (but not person detection) failed to detect subjects running through the scene, even at close range, on repeated attempts. Note that Nest's motion detection triggered on the subject, but those receiving person alerts only would miss these events.

This is shown below, with the subject running from ~100' directly past the cameras. By contrast, cameras did not fail to detect subjects at normal walking speeds, day or night.

Hikvision/Ezviz: Frequent False Alerts From Common Sources

Unlike Arlo, Nest, and Ring, the EzGuard camera frequently alerted on nearly every source in the scene, including foliage, bugs, and light changes, when set to default sensitivity.

Turning sensitivity down nearly eliminated false alerts, but drastically reduced detection, as well, with the camera failing to capture even slow moving subjects at close range.

Detection Distances

The cameras consistently detected at the following PPF levels:

Note that Arlo detection is triggered by its built-in PIR, which has a specified range of 23', so PPF does not change day or night, while others use only video for detection/VMD.

Compared to commercial analytics, these PPF requirements are average (Ring/Nest) to high (Arlo), with high performing analytics such as Bosch and Avigilon requiring 5-6 PPF for daytime detection, and most averaging closer to 12-15.

Cloud Versus Local Processing

Of the cameras tested, Arlo and Nest send video to the cloud for analytic processing prior to alerting the user. Ezviz and Ring perform processing locally on the camera.

Both Arlo and Nest warn users that processing may take longer when using person detection, though we saw little difference in time between event and notification on all cameras tested, with all taking 1-2 seconds to notify users of detection.

Note that all platforms tested require cloud connectivity for alerts, with none sending push notifications over the local network.

Motion/Analytic Configuration Differences

Analytic/motion configuration varies between cameras tested, but is limited to a zone (if full screen is not desired) and sensitivity settings in Arlo, Ezviz, and Ring.

Nest includes zone setup, but no sensitivity, with only options for detecting people vs. general motion, but no specific sensitivity.

Zone shape was flexible in all cameras except Arlo, which used only rectangles, making it difficult to fit to odd shaped scenes without overlapping undesired areas.

By contrast, Nest and Ring use eight sized polygons, while Ezviz uses a more flexible grid style zone setup.

Camera/Service Pricing

All the cameras except Hikvision/Ezviz require a monthly subscription in order to receive analytic/event alerts and/or view alert video, ranging from ~$3 USD per month per camera for Arlo Smart through $5/month per camera for Nest Aware. Pricing is detailed below:

  • Arlo Smart: Arlo person detection analytics require a subscription to Arlo Smart, starting at $2.99 per camera, including 7 days storage, and up to $14.99 for 60 days storage. Arlo cameras and base station start at $179 for the original 720p Arlo to $300 for the 1080p Arlo 2 tested here.
  • Nest Person Alerts: Nest's person detection analytics do not require a subscription to receive alerts. However, alert video playback is unavailable without a Nest Aware subscription, ranging from $5/month per camera (5 days) through $30/month for 30 days. The Nest Outdoor IQ is available directly from Nest for $349.
  • Ring Advanced Motion Detection: Ring's "advanced motion detection" motion detection does not require a subscription for motion alerts, although a subscription is needed to view recorded video starting at $3 per month. Ring Spotlight Cam retails for $199 and can be purchased from the Ring website.
  • Hikvision/Ezviz EzGuard: Ezviz motion detection does not require a monthly subscription, it is available for free on the camera. Ezviz does not require a subscription to receive alerts, with recording direct to local SD card. Cloud subscriptions (called CloudPlay) start at $5.99 per month per camera. Hikvision's Ezviz EzGuard camera retails for $109, significantly less than competitive cameras and can be purchased from the Ezviz website.

Country of Manufacture

The following list shows each cameras country of manufacture:

  • Arlo Pro 2: Made in Vietnam
  • EZVIZ ezGuard: Made in China
  • Nest Outdoor IQ: Made in China
  • Ring Spotlight Cam: Made in China

4 reports cite this report:

Worst Products Tested In Past Year on Jan 09, 2019
IPVM has done over 100 tests in the past year. But which products performed the worst? Which ones should users be most aware of? In this report,...
The Battle For The VSaaS Market Begins 2019 - Alarm.com, Arcules, Eagle Eye, OpenEye, Qumulex, Verkada, More on Jan 02, 2019
2019 will be the year that VSaaS finally becomes a real factor for professional video surveillance. While Video Surveillance as a Service (VSaaS)...
Imperial Capital Security Investor Conference 2018 Review - ADT, Resideo, Alarm.com, Arlo, Eagle Eye, ACRE, More on Dec 14, 2018
Imperial Capital Security Investor Conference is an event matching industry executives with financiers that frequently leads to future funding...
Amazon Ring Spotlight Cam Tested on Sep 17, 2018
Amazon's Ring has released their latest camera entry, the Spotlight Cam, which we bought and tested in our Consumer IP Camera Analytics...
Comments (35) : PRO Members only. Login. or Join.

Related Reports

Dahua USA Celebrates 5 Years of Errors on May 21, 2019
Dahua USA is, in their own words, 'celebrating' 5 years in North America or as trade magazine SSN declared: Dahua Technology finds success in...
Trump Signs 'Huawei Ban' - Executive Order Targeting Foreign Adversary Technology on May 16, 2019
US President Donald Trump has signed an executive order targeting technology provided by 'foreign adversaries', in what is widely being called a...
China PRC Government New National Video Surveillance Standards on May 14, 2019
The People's Republic of China (PRC) government has released a new set of overarching standards for authorities to follow when they install video...
Vivotek Talks About Taiwan, China, Bans, AI And Business Development on May 10, 2019
Vivotek, Taiwan's biggest manufacturer by revenue, did not have a booth at Taiwan's Secutech 2019 (which we are covering). However,...
10 Facial Recognition Providers Review (Secutech) on May 09, 2019
Adding to our 19 Facial Recognition Providers Profiled report from ISC West, IPVM focused on facial recognition technology for our Day 2 coverage...
Secutech Taipei 2019 Show Report, Impacted By Expected Hikua Ban on May 08, 2019
IPVM is in Taipei attending SecuTech 2019: The most significant new development at the show is Dahua and Hikvision pulling out after many years...
Hikvision DeepinView Camera Analytics Tested on May 08, 2019
Hikvision is expanding its 'deep learning' offerings with a new camera series called 'DeepinView' claiming false alarm reduction and improved...
ADT's Top Dealer "The Defenders" Sued 20+ Times on May 07, 2019
ADT's largest authorized dealer, The Defenders, has been sued more than 20 times since 2012, IPVM has verified through analyzing legal...
Dahua and Hikvision Products Illegally Sold To US Government GSA on May 06, 2019
Dahua and Hikvision products are being widely and illegally sold to the US government GSA. The sellers are falsely claiming these China products to...
Hikvision Global News Report Directory on Apr 30, 2019
Hikvision has received the most global news reporting of any video surveillance company, ever, ranging from the WSJ, the Financial Times, Reuters,...

Most Recent Industry Reports

Access Control Job Walk Guide on May 22, 2019
Significant money can be saved and problems avoided with an access control job walk if you know what to look for and what to ask. By inviting...
ASCMA / Monitronics Declares Chapter 11 Bankruptcy on May 22, 2019
Monitronics is entering into Chapter 11 bankruptcy. The company, also called Ascent Capital Group Inc., aka ASCMA, aka Brinks Home Security,...
US Considers Sanctions Against Hikvision and Dahua on May 22, 2019
The US government is considering blacklisting "up to 5" PRC surveillance firms, including Hikvision and Dahua, Bloomberg reported, with human...
Dahua USA Celebrates 5 Years of Errors on May 21, 2019
Dahua USA is, in their own words, 'celebrating' 5 years in North America or as trade magazine SSN declared: Dahua Technology finds success in...
Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Amazon Ring Public Subsidy Program Aims To Dominate Residential Security on May 20, 2019
Amazon dominates market after market. Quitely, but increasingly, they are doing so in residential security, through a combination of significant...
LifeSafety Power NetLink Vulnerabilities And Problematic Response on May 20, 2019
'Power supplies' are not devices that many think about when considering vulnerabilities but as more and more devices go 'online', the risks for...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
Inside Look Into Scam Market Research on May 17, 2019
Scam market research has exploded over the last few years becoming the most commonly cited 'statistics' for most industries, despite there clearly...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact