IP Camera - 15 Year Shootout

By: Ethan Ace, Published on May 22, 2017

How far have IP cameras come?

We bought and tested 4 cameras across the past 15 years to understand how much and where performance has improved.

For consistency across the long time frame, we bought these 4 Axis cameras:

[Note: if there is interest, we can do other combinations, different manufacturers across time, etc. Leave ideas in the comments.]

We shot these 4 cameras out in full light, low light, and WDR scenes to see the differences in performance.

Summary

Despite their age, Axis' VGA 2100 and 210 cameras still produced reliable subject details in well lit narrow fields of view (~10-15'), though notably less clear than more modern megapixel models (e.g., the P1344 and Q1615).

However, in anything other than well lit scenes, details of VGA models were poor, dim and/or noisy at night with extreme motion blur in the 2100 (with no exposure controls). The 1MP P1344 handled low light better, though still with more noise and fewer details than the Q1615. Additionally, even moderately bright backlight causing a drastic drop in details in WDR scenes in all cameras but the Q1615.

Finally, advances in CODECs, including smart codecs (e.g. Zipstream) are clearly demonstrated when comparing older, lower resolution models to the Q1615, which had far lower bitrates in this test, despite having the highest resolution.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Daytime Images

First, we shot cameras outside on a bright but overcast day, without significant sun glare, to see how they performed in well lit scenes (shown here from the 2100). Cameras were set to match the field of view of the fixed lens 2100 (4mm lens, ~48° AoV).

Despite their low resolution and dated imagers, the 15 year old 2100 and 10 year old 210 captured recognizable subject details in this scene due to high PPF levels. However, details were much more clear in higher resolution models.

However, moving to only 20' distance, recognition becomes difficult in the VGA models, with only 2 lines of text legible in the 210 and only the top line in the 2100.

At 40' distance, only the Q1615 provides solid recognition details, with the subject's face more pixelated in the P1344. Both the 210 and 2100 provide detection only.

Nighttime Performance

At night, performance differences become more significant, with the Q1615 and P1344 providing clear details of the subject and chart, while the 210 displays more noise and artifacting and no details of the background beyond the subject. The 2100, while much brighter than the 210, overexposes the subject and chart, providing few details, and exhibits significant slow shutter blur (below).

The 2100's bright images are due to long exposures, which are not controllable via its web interface. For example, this clip shows the camera in the same scene, with the subject walking across the FOV. Frames are dropped and the subject blurred across 5-6 feet, totally unrecognizable. No other cameras exhibited slow shutter blur.

Moving further from the cameras, differences become even more clear, with the Q1615 clearly displaying the subject while others provide few details. The 210 produces surprisingly clear images of the test chart to line 2, but no subject details.

Finally, even further (~40'), the subject is nearly impossible to discern in the VGA models, while the P1344 provides detection and rough details. The Q1615 produces some facial detail and multiple legible lines of the test chart.

Wide Dynamic Range

WDR performance on the 2100 and 210 was very poor, with subjects practically washed out with any backlight in the scene. The P1344 performed moderately better, with some facial details (with Dynamic Contrast on), though it still fails to adjust quickly as the door opens and closes and the subject moves through the scene.

Bitrate Comparison

The Axis 2100's bandwidth was by far the highest during the day, nearly 5 Mb/s, due to its use of MJPEG only. At night, its bandwidth dropped to 800 Kb/s, but so did its framerate, dropping to less than 1 FPS (seen above in slow shutter clip). Because of this, the chart below shows its extrapolated bitrate, ~8 Mb/s, to show a fair comparison against the other cameras which did not drop frames.

Because of its use of Zipstream, the Q1615's bitrates are far lower than either the 210 or P1344.

VMS Support

While the 210, P1344, and Q1615 use Axis' VAPIX API, the 2100 uses HTTP streaming, which is not supported by many VMSes. In our tests, Genetec and Milestone both functioned properly, with Axis 2100 drivers. DW Spectrum/Network Optix was also able to view the camera's stream as it supports HTTP streams. We were unable to view the camera in Avigilon or Exacq.

Versions Used

The following firmware versions were used in our tests. Note that firmware is still available for all cameras on Axis' website, except for the 2100.

  • Axis 2100: 2.43
  • Axis 210: 4.40.2
  • Axis P1344: 5.40.9.10
  • Axis Q1615: 6.50.1.1
Comments (30) : Members only. Login. or Join.

Related Reports

Hanwha 8K / 33MP Camera Tested on Sep 14, 2020
Hanwha Techwin has released an 8K / 33MP resolution camera, the TNB-9000 with...
Tiandy Super Starlight Cameras Tested on Apr 30, 2020
Tiandy is taking aim at China competitors Dahua and Hikvision, with a new...
Remote Network Access for Video Surveillance Guide on Jul 27, 2020
Remotely accessing surveillance systems is key in 2020, with more and more...
Avigilon Elevated Temperature Detection Camera Tested on Sep 17, 2020
Avigilon has entered the temperature screening market with the release of...
Dedicated Vs Converged IP Video Networks Statistics 2020 on Sep 10, 2020
Running one's video system on a converged network with other devices can save...
Quantum Dots Potential for Surveillance Cameras Explained on Sep 08, 2020
Quantum dots are starting to be used in TVs for better images, but how will...
Multi-Imagers Added to IPVM Camera Calculator on Jun 15, 2020
IPVM has added multi-imager cameras to the Camera Calculator, supporting this...
JCI "Fever Camera" Partners With China TVT on May 19, 2020
Johnson Controls (JCI) is the next big player to get into the 'fever camera'...
Camera Course Summer 2020 - Last Chance on Jul 18, 2020
This is your last chance to register for the Summer 2020 Camera Course. This...
Directory of 206 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Access Control Online Show July 2020 - On-Demand Recording of 45+ Manufacturers Presentations on Jul 30, 2020
The show featured 48 Access Control presentations, all now recorded and...
Favorite Access Control Credentials 2020 on Sep 15, 2020
Credential choice is more debated than ever, with hacking risk for 125kHz and...
Seek Scan Thermal Temperature Screening System Tested on May 28, 2020
Now that IPVM has tested Dahua, Hikvision, and Sunell, we are returning to...
Hikvision Returns To Growth Driven By Overseas Fever Cameras on Jul 29, 2020
While Hikvision's revenue fell in Q1 2020, it rebounded in Q2 attributed to...
Mobotix Thermal Detection Camera Tested on Jun 09, 2020
For years Mobotix has struggled but now sales are surging driven by Mobotix's...

Recent Reports

Hanwha AI Object Detection Tested on Sep 28, 2020
Hanwha has added detection and classification of people, cars, clothing...
Favorite Access Control Manufacturers 2020 on Sep 28, 2020
200+ Integrators told IPVM "What is your favorite access control management...
New Products Show Fall 2020 Starts Tomorrow! on Sep 27, 2020
Tomorrow, IPVM's sixth online show will feature New Products from over 25...
OnTech Smart Services Partners With Google and Amazon To Compete With Integrators on Sep 25, 2020
A pain point for many homeowners to use consumer security and surveillance is...
The Future of Metalens For Video Surveillance Cameras - MIT / UMass / Immervision on Sep 25, 2020
Panoramic cameras using 'fisheye' lens have become commonplace in video...
Hikvision Sues Over Brazilian Airport Loss on Sep 24, 2020
Hikvision was excluded from a Brazilian airport project because it is owned...
China General Chamber of Commerce Calls Out US Politics on Sep 24, 2020
While US-China relations are at an all-time low, optimism about relations...
Verkada Disruptive Embedded Live Help on Sep 24, 2020
Call up your integrator? Have someone come by the next day? Verkada is...
IP Networking Course Fall 2020 - Last Chance - Register Now on Sep 23, 2020
Today is the last chance to register for the only IP networking course...
Drain Wire For Access Control Reader Tutorial on Sep 23, 2020
An easy-to-miss cabling specification plays a key role in access control, yet...
Norway Council of Ethics Finds Hikvision Human Rights Abuses "Ongoing" on Sep 23, 2020
Hikvision's involvement in "serious human rights abuse" in Xinjiang is...
IPVM Camera Calculator User Manual / Guide on Sep 23, 2020
Learn how to use the IPVM Camera Calculator (updated for Version 3.1). The...
Installation Course Fall 2020 - Save $50 - Last Chance on Sep 22, 2020
This is a unique installation course in a market where little practical...
SimpliSafe Business Security Launched Examined on Sep 22, 2020
SimpliSafe has launched "SimpliSafe Business Security" that the company...
FLIR CEO: Many New Fever Entrants "Making Claims That The Science Just Won't Support" on Sep 22, 2020
FLIR's CEO joins a growing number calling out risks with fever / screening...