IP Camera - 15 Year Shootout

By: Ethan Ace, Published on May 22, 2017

How far have IP cameras come?

We bought and tested 4 cameras across the past 15 years to understand how much and where performance has improved.

For consistency across the long time frame, we bought these 4 Axis cameras:

[Note: if there is interest, we can do other combinations, different manufacturers across time, etc. Leave ideas in the comments.]

We shot these 4 cameras out in full light, low light, and WDR scenes to see the differences in performance.

Summary

Despite their age, Axis' VGA 2100 and 210 cameras still produced reliable subject details in well lit narrow fields of view (~10-15'), though notably less clear than more modern megapixel models (e.g., the P1344 and Q1615).

However, in anything other than well lit scenes, details of VGA models were poor, dim and/or noisy at night with extreme motion blur in the 2100 (with no exposure controls). The 1MP P1344 handled low light better, though still with more noise and fewer details than the Q1615. Additionally, even moderately bright backlight causing a drastic drop in details in WDR scenes in all cameras but the Q1615.

Finally, advances in CODECs, including smart codecs (e.g. Zipstream) are clearly demonstrated when comparing older, lower resolution models to the Q1615, which had far lower bitrates in this test, despite having the highest resolution.

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

Daytime Images

First, we shot cameras outside on a bright but overcast day, without significant sun glare, to see how they performed in well lit scenes (shown here from the 2100). Cameras were set to match the field of view of the fixed lens 2100 (4mm lens, ~48° AoV).

Despite their low resolution and dated imagers, the 15 year old 2100 and 10 year old 210 captured recognizable subject details in this scene due to high PPF levels. However, details were much more clear in higher resolution models.

However, moving to only 20' distance, recognition becomes difficult in the VGA models, with only 2 lines of text legible in the 210 and only the top line in the 2100.

At 40' distance, only the Q1615 provides solid recognition details, with the subject's face more pixelated in the P1344. Both the 210 and 2100 provide detection only.

Nighttime Performance

At night, performance differences become more significant, with the Q1615 and P1344 providing clear details of the subject and chart, while the 210 displays more noise and artifacting and no details of the background beyond the subject. The 2100, while much brighter than the 210, overexposes the subject and chart, providing few details, and exhibits significant slow shutter blur (below).

The 2100's bright images are due to long exposures, which are not controllable via its web interface. For example, this clip shows the camera in the same scene, with the subject walking across the FOV. Frames are dropped and the subject blurred across 5-6 feet, totally unrecognizable. No other cameras exhibited slow shutter blur.

Moving further from the cameras, differences become even more clear, with the Q1615 clearly displaying the subject while others provide few details. The 210 produces surprisingly clear images of the test chart to line 2, but no subject details.

Finally, even further (~40'), the subject is nearly impossible to discern in the VGA models, while the P1344 provides detection and rough details. The Q1615 produces some facial detail and multiple legible lines of the test chart.

Wide Dynamic Range

WDR performance on the 2100 and 210 was very poor, with subjects practically washed out with any backlight in the scene. The P1344 performed moderately better, with some facial details (with Dynamic Contrast on), though it still fails to adjust quickly as the door opens and closes and the subject moves through the scene.

Bitrate Comparison

The Axis 2100's bandwidth was by far the highest during the day, nearly 5 Mb/s, due to its use of MJPEG only. At night, its bandwidth dropped to 800 Kb/s, but so did its framerate, dropping to less than 1 FPS (seen above in slow shutter clip). Because of this, the chart below shows its extrapolated bitrate, ~8 Mb/s, to show a fair comparison against the other cameras which did not drop frames.

Because of its use of Zipstream, the Q1615's bitrates are far lower than either the 210 or P1344.

VMS Support

While the 210, P1344, and Q1615 use Axis' VAPIX API, the 2100 uses HTTP streaming, which is not supported by many VMSes. In our tests, Genetec and Milestone both functioned properly, with Axis 2100 drivers. DW Spectrum/Network Optix was also able to view the camera's stream as it supports HTTP streams. We were unable to view the camera in Avigilon or Exacq.

Versions Used

The following firmware versions were used in our tests. Note that firmware is still available for all cameras on Axis' website, except for the 2100.

  • Axis 2100: 2.43
  • Axis 210: 4.40.2
  • Axis P1344: 5.40.9.10
  • Axis Q1615: 6.50.1.1
Comments (30) : PRO Members only. Login. or Join.

Related Reports

Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
Bank Security Manager Interview on May 15, 2019
Bank security contends with many significant threats - from fraudsters to robbers and more. In this interview, IPVM spoke with bank security...
Milestone XProtect 2019 R1 Tested on May 15, 2019
For the past few years, Milestone has released quarterly software updates XProtect VMS platform. What is new and how much impact do the updates...
Bluecherry Open Sources Entire VMS on May 13, 2019
Bluecherry announced they have "released the entire Bluecherry software application open source with a GPL license". We spoke to Bluecherry's...
Mining Company Security Manager Interview on May 10, 2019
First Quantum Minerals Limited (FQML) is a global enterprise with offices on 4 continents and operations in 7 countries with exploratory operations...
Aegis AI Gun Detection Video Analytics Startup on May 07, 2019
Gun detection analytic startups are increasing as the promise of AI and the threats of active shooters grow.  One company, Aegis AI, is being led...
Restaurant Security Manager Interview on May 06, 2019
Wright’s Gourmet House in Tampa, Florida has been around for over 50 years. During most of that time, there were no security measures in place. Now...
Ranking Manufacturer Favorability 2019 on May 06, 2019
24 manufacturer's favorability was ranked based on 170+ integrators feedback. Voting plus in-depth comments revealed insights on which brands were...
Verkada Cloud VMS/Cameras Tested on May 02, 2019
Verkada is arguably the most ambitious video surveillance startup in many years. The company is developing their own cameras, their own VMS, their...

Most Recent Industry Reports

Access Control Job Walk Guide on May 22, 2019
Significant money can be saved and problems avoided with an access control job walk if you know what to look for and what to ask. By inviting...
ASCMA / Monitronics Declares Chapter 11 Bankruptcy on May 22, 2019
Monitronics is entering into Chapter 11 bankruptcy. The company, also called Ascent Capital Group Inc., aka ASCMA, aka Brinks Home Security,...
US Considers Sanctions Against Hikvision and Dahua on May 22, 2019
The US government is considering blacklisting "up to 5" PRC surveillance firms, including Hikvision and Dahua, Bloomberg reported, with human...
Dahua USA Celebrates 5 Years of Errors on May 21, 2019
Dahua USA is, in their own words, 'celebrating' 5 years in North America or as trade magazine SSN declared: Dahua Technology finds success in...
Axis ~$150 Outdoor Camera Tested on May 21, 2019
Axis has released the latest in their Companion camera line, the outdoor Companion Dome Mini LE, a 1080p integrated IR model aiming to compete with...
Covert Facial Recognition Using Axis and Amazon By NYTimes on May 20, 2019
What if you took a 33MP Axis camera covering one of the busiest parks in the US and ran Amazon Facial Recognition against it? That is what the...
Amazon Ring Public Subsidy Program Aims To Dominate Residential Security on May 20, 2019
Amazon dominates market after market. Quitely, but increasingly, they are doing so in residential security, through a combination of significant...
LifeSafety Power NetLink Vulnerabilities And Problematic Response on May 20, 2019
'Power supplies' are not devices that many think about when considering vulnerabilities but as more and more devices go 'online', the risks for...
Facial Recognition Systems Fail Simple Liveness Detection Test on May 17, 2019
Facial recognition is being widely promoted as a solution to physical access control but we were able to simply spoof 3 systems because they had no...
Inside Look Into Scam Market Research on May 17, 2019
Scam market research has exploded over the last few years becoming the most commonly cited 'statistics' for most industries, despite there clearly...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact