IP Camera - 15 Year Shootout

By: Ethan Ace, Published on May 22, 2017

How far have IP cameras come?

We bought and tested 4 cameras across the past 15 years to understand how much and where performance has improved.

For consistency across the long time frame, we bought these 4 Axis cameras:

[Note: if there is interest, we can do other combinations, different manufacturers across time, etc. Leave ideas in the comments.]

We shot these 4 cameras out in full light, low light, and WDR scenes to see the differences in performance.

Summary

Despite their age, Axis' VGA 2100 and 210 cameras still produced reliable subject details in well lit narrow fields of view (~10-15'), though notably less clear than more modern megapixel models (e.g., the P1344 and Q1615).

However, in anything other than well lit scenes, details of VGA models were poor, dim and/or noisy at night with extreme motion blur in the 2100 (with no exposure controls). The 1MP P1344 handled low light better, though still with more noise and fewer details than the Q1615. Additionally, even moderately bright backlight causing a drastic drop in details in WDR scenes in all cameras but the Q1615.

Finally, advances in CODECs, including smart codecs (e.g. Zipstream) are clearly demonstrated when comparing older, lower resolution models to the Q1615, which had far lower bitrates in this test, despite having the highest resolution.

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Daytime Images

First, we shot cameras outside on a bright but overcast day, without significant sun glare, to see how they performed in well lit scenes (shown here from the 2100). Cameras were set to match the field of view of the fixed lens 2100 (4mm lens, ~48° AoV).

Despite their low resolution and dated imagers, the 15 year old 2100 and 10 year old 210 captured recognizable subject details in this scene due to high PPF levels. However, details were much more clear in higher resolution models.

However, moving to only 20' distance, recognition becomes difficult in the VGA models, with only 2 lines of text legible in the 210 and only the top line in the 2100.

At 40' distance, only the Q1615 provides solid recognition details, with the subject's face more pixelated in the P1344. Both the 210 and 2100 provide detection only.

Nighttime Performance

At night, performance differences become more significant, with the Q1615 and P1344 providing clear details of the subject and chart, while the 210 displays more noise and artifacting and no details of the background beyond the subject. The 2100, while much brighter than the 210, overexposes the subject and chart, providing few details, and exhibits significant slow shutter blur (below).

The 2100's bright images are due to long exposures, which are not controllable via its web interface. For example, this clip shows the camera in the same scene, with the subject walking across the FOV. Frames are dropped and the subject blurred across 5-6 feet, totally unrecognizable. No other cameras exhibited slow shutter blur.

Moving further from the cameras, differences become even more clear, with the Q1615 clearly displaying the subject while others provide few details. The 210 produces surprisingly clear images of the test chart to line 2, but no subject details.

Finally, even further (~40'), the subject is nearly impossible to discern in the VGA models, while the P1344 provides detection and rough details. The Q1615 produces some facial detail and multiple legible lines of the test chart.

Wide Dynamic Range

WDR performance on the 2100 and 210 was very poor, with subjects practically washed out with any backlight in the scene. The P1344 performed moderately better, with some facial details (with Dynamic Contrast on), though it still fails to adjust quickly as the door opens and closes and the subject moves through the scene. 

Bitrate Comparison

The Axis 2100's bandwidth was by far the highest during the day, nearly 5 Mb/s, due to its use of MJPEG only. At night, its bandwidth dropped to 800 Kb/s, but so did its framerate, dropping to less than 1 FPS (seen above in slow shutter clip). Because of this, the chart below shows its extrapolated bitrate, ~8 Mb/s, to show a fair comparison against the other cameras which did not drop frames.

Because of its use of Zipstream, the Q1615's bitrates are far lower than either the 210 or P1344.

VMS Support

While the 210, P1344, and Q1615 use Axis' VAPIX API, the 2100 uses HTTP streaming, which is not supported by many VMSes. In our tests, Genetec and Milestone both functioned properly, with Axis 2100 drivers. DW Spectrum/Network Optix was also able to view the camera's stream as it supports HTTP streams. We were unable to view the camera in Avigilon or Exacq.

Versions Used

The following firmware versions were used in our tests. Note that firmware is still available for all cameras on Axis' website, except for the 2100.

  • Axis 2100: 2.43
  • Axis 210: 4.40.2
  • Axis P1344: 5.40.9.10
  • Axis Q1615: 6.50.1.1

 

Comments (30) : PRO Members only. Login. or Join.

Related Reports

Speco Ultra Intensifier Tested on Apr 22, 2019
While ISC West 2019 named Speco's Ultra Intensifier the best new "Video Surveillance Cameras IP", IPVM testing shows the camera suffers from...
Hikvision ColorVu Camera Tested on Jun 24, 2019
Hikvision says their new ColorVu line captures "vivid chromatic images in darkness", with unconventional white light illuminations whereas most...
Bosch Starlight 8000i Cameras Tested on Jul 23, 2019
Bosch has released their new Flexidome IP Starlight 8000i cameras, claiming "exceptional detail even in extreme low-light situations." To see...
WDR Camera Mega Shootout 2019 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Sep 04, 2019
This is the biggest WDR Shootout ever, with 23 cameras from 8 manufacturers: We included true multi-exposure WDR and non-WDR models, ranging...
Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
Wide Dynamic Range (WDR) Guide on Oct 01, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low light models from 10 manufacturers: Increasingly, each manufacturer...
Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
AVTech ~$70 IP Cameras Tested Vs Dahua and Hikvision on Dec 04, 2019
Taiwanese manufacturer Avtech is taking direct aim at low cost leaders Dahua and Hikvision with ~$70 starlight and white light illuminator...
Uniview Color Low Light Camera Tested Vs Hikvision ColorVu on Jan 07, 2020
Hikvision has been marketing ColorVu aggressively. Now, Hikvision domestic rival Uniview (UNV) is offering aggressive pricing for their new rival...

Most Recent Industry Reports

Axis and Genetec Drop IFSEC 2020 on Jan 23, 2020
Two of the best-known video surveillance manufacturers are dropping IFSEC International 2020, joining Milestone who dropped IFSEC in 2019. The...
Multipoint Door Lock Tutorial on Jan 23, 2020
Despite widespread use, locked doors are notoriously weak at stopping entry, and thousands can be misspent on locks that leave doors quite...
Avigilon Shifts Cloud Strategy - Merges Blue and ACC on Jan 23, 2020
Avigilon is shifting its cloud strategy, phasing out its Blue web-managed surveillance platform as a stand-alone brand and merging it with its ACC...
Verkada Paying $100 For Referrals Just To Demo on Jan 22, 2020
Some companies pay for referrals when the referral becomes a customer. Verkada is taking it to the next level - paying $100 referrals fees simply...
Camera Analytics Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Uniview, Vivotek on Jan 22, 2020
Analytics are hot again, thanks to a slew of AI-powered cameras, but whose analytics really work? And how do these new smart cameras compare to top...
Intersec 2020 Final Show Report on Jan 21, 2020
IPVM spent all 3 days at the Intersec 2020 show interviewing various companies and finding key trends. We cover: Middle East Enterprise...
Vehicle & Long Range Access Reader Tutorial on Jan 21, 2020
One of the classic challenges for access control are parking lots and garages, where the user's credential is far from the reader. With modern...
Clearview AI Alarm - NY Times Report Says "Might End Privacy" on Jan 20, 2020
Over the weekend, the NY Times released a report titled "The Secretive Company That Might End Privacy as We Know It" about a company named...
Favorite Camera Manufacturers 2020 on Jan 20, 2020
The past 2 years of US bans and sanctions have shaken the video surveillance industry but what impact would this have on integrators' favorite...