Testing The Real Resolution of MP Cameras (Line Count)

By: Ethan Ace, Published on Dec 11, 2013

Resolution has problems.

IP cameras equate resolution with pixels, ignoring that pixels are simply mechanical components of a camera, not the full performance of said camera. Indeed, it has gotten so bad, we have recommended that we Ban Resolution.

Classic Resolution Metric

With analog cameras, resolution was always defined by line counts (aka TV line counts or horizontal TV lines), which measured the actual details that the full camera could deliver.

In fairness, line counts were far from perfect. They only considered ideal lighting conditions and ignored digital recording. Plus, manufacturers went crazy with them, leading to analog insanity of spiraling, but pointless, TV line counts of 600 to 700 to 800 to 900 to 1000.

However, at least line counts attempted to measure real world performance, not just count parts on a chip (i.e., number of pixels = resolution).

The IP TV Line Test

IPVM is bringing back the TV line test and introducing it to IP / MP cameras.

The setup is an ISO 12233 chart with a camera positioned to capture the area of the chart. The image below shows an IP camera being tested:

We then measured the number of TV lines different cameras delivered in various conditions. Here is an example of two test charts:

Get Notified of Video Surveillance Breaking News
Get Notified of Video Surveillance Breaking News

Notice that in chart 1, the number of TV lines visible is ~450-500 while chart 2 on the right is much higher, 1,000-1,200.

Questions Answered

This test answers the following key questions:

  • How does pixel count relate to line count?
  • How much are line counts reduced in lower light?
  • How much does compression impact line count?
  • What other factors impact line count?

Key Findings

Here are our key findings from this test:

  • Pixel count had the largest effect on TV lines captured, an increase of hundreds of TVL for each jump in resolution (720p to 1080p, 1080p to 5MP, etc.).
  • Lowering lights significantly impacted cameras at all resolutions, on the order of hundreds of TVL when lights were dimmed to 3 lux and below 1 lux.
  • Compression surprisingly had no practical effect. Edges of large objects of the chart suffered artifacting but the fine lines used to measure TVL were still distinguishable even at maximum compression.
  • Lens selection had substantial impact, with differences of 100-200 TVL possible moving from SD to megapixel to multimegapixel lenses.
  • Adjusting sharpness had minor effect, typically only reducing TVL count when lowering it to minimum levels. Increasing above defaults had no practical effect.
  • Other image adjustments such as contrast and saturation had minimal effect, with no difference in TVL captured.

Readers should note that we have included ranges of TVL in this report, as opposed to exact measurements, since interpretation of these results may be subjective and vary somewhat from person to person.

Test Setup

This short video reviews our physical setup of the test and use of the chart.

Summary Findings

This chart lists the TVL we found for each camera in different lighting conditions:

Based on the above numbers, pixel count relates to TVL in a ratio of approximately 1:0.41 in full light. So for example, given a 5MP camera with a horizontal resolution of 2560, we can estimate TVL captured to be ~1,049 (2560*0.41=1,049). 

Pixel Count Comparison

As a baseline, we set up our cameras in a brightly lit room beneath indirect lighting. Cameras were tested one at a time to properly adjust FOV and mounting angle to the chart, and default settings were used.

As seen in the comparison below, TVL varied from ~450-550 in 720p to ~1,400-1,600 in the 10MP camera.

(click for full size version)

Lowering Light

Next, we lowered the lights to 3 lux to test effective TVL captured as light dims. Cameras were standardized to 1/30s exposure in these low light scenes.

TVL dropped substantially in all cameras. The 1080p camera best maintained performance in this scene due to a combination of low light performance and resolution. 

(click for for full size version)

With the lights off, the light level drops to about 0.1 lux. Only the 720p and 1080p cameras produce usable images at this level, again at a reduced performance level, with the 720p camera dropping to ~200-300 TVL, and 1080p camera to ~550-600. 

(click for full size version)

Compression

In order to test compression's effects on TVL captured, we varied settings from minimum to maximum (0-100, with a default of 30 in the Axis camera seen below). These changes had little effect on TVL. More compression artifacts were seen on the edges of some larger objects on the chart, but the fine lines used to measure TVL remained mostly unchanged regardless of compression.

Further, we checked for differences between H.264 and MJPEG, which also had no practical effect, further proof that H.264 is inherently not lower quality than MJPEG.

Lens Type

In order to see what effect lens selection had on TVL captured, we ran the test using a 720p camera with four different lenses: one standard definition, two megapixel rated, and one "ultra high definition" multi-megapixel rated lens. We found that lens selection had the second largest impact on TVL captured, after pixel count, with a variance of 300+ TVL possible moving from standard definition lenses to multi-megapixel. Additionally, even our two megapixel rated lenses (Computar and Fujinon) resulted in different TVL ratings (450-550 vs. 500-600). 

(click for full size version)

Lenses used were (L-R):

Image Settings

Finally, we checked the impact of image adjustments such as contrast, sharpness, and saturation on TVL.

Among these, only sharpness had noticeable effect, slightly reducing TVL when it is lowered to minimum from default. Increasing from default to maximum provided no gain in TVL.

 

Contrast and saturation, on the other hand, had no noticeable effect regardless of setting.

1 report cite this report:

Resolution Tutorial on Dec 28, 2017
Understanding video surveillance resolution can be surprisingly difficult and complex. While the word 'resolution' seems self-explanatory, its use...
Comments (25) : Members only. Login. or Join.

Related Reports

Startup Spectral Edge RGB+IR Claims "Unique Low Light Performance Tech" on Apr 03, 2019
This UK startup, born out of university research, is boldly proclaiming that they deliver "Unique low light performance tech for video surveillance...
Speco Ultra Intensifier Tested on Apr 22, 2019
While ISC West 2019 named Speco's Ultra Intensifier the best new "Video Surveillance Cameras IP", IPVM testing shows the camera suffers from...
Lens Focal Length Tutorial on Jul 10, 2019
3mm, 6mm, 2.8 - 9mm, 5 - 50mm, etc. Camera specifications often list lens lengths but what do they mean? These metrics are important in...
Lens Iris Tutorial on Aug 08, 2019
Cameras, like humans, have irises, controlling the light which hits the imager and impacting image details. However, cameras have multiple types of...
Camera Field of View (FoV) Guide on Nov 13, 2019
Field of View (FoV) and Angle of View (AoV), are deceptively complex. At their most basic, they simply describe what the camera can "see" and seem...
Wide Dynamic Range (WDR) Guide on Oct 01, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Hikvision ColorVu is Smart Marketing on Oct 03, 2019
Hikvision ColorVu (see IPVM test results) is smart marketing, a lesson to be learned by competitors and a rising trend. Inside this note, we...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Budget Covert Cameras Tested on Nov 26, 2019
Covert cameras under $100 are widely available online but are they any good? To see how these models really work in the real world, we bought...

Most Recent Industry Reports

Milestone Launches Multiple Cloud Solutions on Feb 18, 2020
Milestone is going to the cloud, becoming one of the last prominent VMSes to do so. Milestone is clearly late but how competitive do these new...
Video Surveillance 101 Course - Last Chance Thursday on Feb 18, 2020
IPVM's first Video Surveillance 101 course starts this month, designed to help those new to the industry to quickly understand the most important...
Video Surveillance Architecture 101 on Feb 18, 2020
Video surveillance can be designed and deployed in a number of ways. This 101 examines the most common options and architectures used in...
UK Stands Behind Hikvision But Controversy Continues on Feb 18, 2020
Hikvision is exhibiting at a UK government conference for law enforcement, provoking controversy from the press, politicians, and activists due to...
IronYun AI Analytics Tested on Feb 17, 2020
Taiwan startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service...
Access Control ADA and Disability Laws Tutorial on Feb 17, 2020
Safe access control is paramount, especially for those with disabilities. Most countries have codes to mandate safe building access for those...
ISC West 2020 Removes China Pavilion, No Plans To Cancel Or Postpone on Feb 17, 2020
ISC West plans to go on next month, amidst concerns over coronavirus. However, the Asia / China Pavilion has been removed, show organizers...
Hanwha Wisenet X Plus PTRZ Tested on Feb 14, 2020
Hanwha has released their PTRZ camera, the Wisenet X Plus XNV-6081Z, claiming the "modular design allows for easy installation". We bought and...
PRC Warns Against China Video Surveillance Hacks, Hikvision Targeted on Feb 14, 2020
Hackers are targeting China video surveillance manufacturers and systems, according to the PRC's main cyber threat monitoring body. The hackers...
IPVM Conference 2020 on Feb 13, 2020
IPVM is excited to announce our 2020 conference. This is the first and only industry event that will be 100% sponsor-free. Like IPVM online, the...