Analog vs HD Night Shootout

Author: Benros Emata, Published on Mar 26, 2011

The whole point of megapixel is better image quality but what if megapixel was actually worse than analog at night? In the consumer world, maybe this is acceptable but in surveillance, most cameras need to 'see' 24 / 7.

[WARNING: This report is OUT OF DATE and should only be used for historical review. Megapixel / HD camera low light performance has improved significantly since 2011. See: Ranking IP Camera Low Light Performance]

In this report, we share our test results of head to head comparisons between analog, SD IP and Megapixel cameras. We asked a number of analog centric integrators, including the folks at CCTVForum.com, for their recommendations on their favorite analog cameras for use in low light scenes. Based on their recommendations, we bought a Bosch Dinion and CNB Mona Lisa and set them up side by side with megapixel cameras from our previous tests. We then tested them in a series of real world scenes.

Here is a preview of our test :

Inside the Pro section, we dig through the tradeoffs and key findings revealed in the tests. For background, make sure you understand the issues in exposure setting adjustments that we explained in detail in our 'How Exposure Impacts Low Light Surveillance.'

In the next few months, we will add more tests in these series including 'Color vs Black/White Image Quality Testing' and 'Advanced Analog vs Megapixel Low Light Testing'.

[UPDATE 2013: New IP cameras in the past few years, including HD IP have gotten far better and now equal or beat the analog cameras in this test. For instance, the see the Axis Q1602 and the Bosch Starlight cameras.]

Key Findings

We note 3 key findings:

Get Video Surveillance News In Your Inbox
Get Video Surveillance News In Your Inbox

  • In a parking lot lit with street lamps (3 to 5 lux), megapixel cameras provided only minimal improvements in image detail over analog - far less than the number of pixels would expect to provide.
  • In a field with no direct street lamps and only ambient light (~0.5 lux), analog cameras provided far more detail than the megapixel ones. The analog cameras provided outlines of human subjects at a 32 ft width FoV while the megapixel cameras were so dark that it was almost impossible to make out the human subjects.
  • In under 1 lux scenes, the only way the megapixel cameras could provide similar image detail as the analog cameras was to significantly lengthen the exposure setting. However, of course, this increase motion blur - a major negative tradeoff.

In the video below, we show the key findings by analyzing the recorded test samples:

Recommendations

With these key findings recognized, here are our recommendations:

  • Using megapixel in an outdoor scene with street lighting is likely still superior to analog (or SD IP). At night, minimal benefits are gained and during the day, significant benefits can be achieved. However, at night, megapixel cameras essentially waste bandwidth. If possible with one's VMS system, consider dropping the resolution level during the night.
  • Using megapixel in a scene with no direct lighting at night is problematic. If the scene must be surveilled in these conditions, either (1) lengthen the shutter, (2) add IR illumination or (3) use SD instead of megapixel. All of these have important drawbacks. Do not lengthen the shutter beyond 1/8s if you need to capture clear details of moving subjects (i.e., if you are not confident that an intruder will stop in the scene). Use integrated IR only if the subject is close to the camera (less than 40 feet). Otherwise, use add on IR (though expect to pay an additional $300+). [Note: for more, see our IR comparison report.] Finally, use SD only if you can accept less detail or the use of more cameras during the day.

Video Clips Download (ZIP File)

Review our Analog vs Megapixel Sample videos zip file (~230 MB) containing all the video clips and images generated during our testing. The clips are embedded inside an ExacqVision player and simply needs to be double clicked to view. In the Exacq player's Options menu we recommend enabling 'Show Camera Names' to show the names of the cameras on-screen.

The clips and images are from our Outdoor test (presented in this report) and Indoor (preliminary) tests as well as alternative setting tests.

Methodology

Three (3) Standard Definition, and two (2) Megapixel cameras are included in our low-light performance testing.

Standard Definition Cameras:

  • CNB BBM-24F - 1/3" CCD; F1.0 Computar; 600TVL (650TVL B/W); 0.005 Lux (B/W); online $120
  • Bosch LTC0498 - 1/3" CCD; F1.0 Computar; 540TVL; 0.98 Lux (100 IRE, B/W); online $400
  • Bosch NBN-498-21P - 1/3" CCD; F1.3 Bosch, 4CIF (704x480); 0.98 Lux (100 IRE, B/W); online $700

Megapixel Cameras (IP):

  • Sanyo HD4000 - 1/2.5" CMOS; F1.8 integrated lens; 1920x1080; 0.1 Lux (F1.8, b/w, gain: High); online $950
  • Pelco Sarix IXE20DN - 1/3" CMOS; F1.2 Pelco; 1280x720; 0.25 Lux (Mono, 33 ms); online $1,300

All SD cameras were analog, except for the Bosch NBN-498. A Sony SNTEP104 encoder was used to stream the analog cameras to our ExacqVision VMS. During testing default settings were used on the Sony encoder including a 720x480 resolution. The two MP cameras were configured for 720p resolution during all tests.

 

Here are the key default settings relevant to low light performance for each camera:

  • CNB BBM-24F - 1/60s shutter; AGC on '15'
  • Bosch LTC0498 - 1/60s shutter; SensUp 4x; AGC on '15'
  • Bosch NBN-498-21P -  1/60s shutter; SensUp 4x; AGC on '15'
  • Sanyo HD4000 - 1/30s shutter; AGC on 'normal'
  • Pelco Sarix IXE20DN - 1/8s shutter; (no gain setting in interface)

In the video below we examine each camera's admin interface focusing on exposure and gain settings, showing the defaults and available ranges for these low-light optimizations.

Scenarios/Applications

Two (2) nighttime/low-light test scenarios were devised that correspond to 'real-world' video surveillance applications:

  • Artificially Lit Area (Parking Lot); 3 to 5 Lux
  • No Light (Open Field) Area; ~0.5 Lux

In both primary scenarios two human subjects provide various examples of motion. The human subjects are positioned at a location within scene corresponding to a 32 foot wide FoV. As such the SD cameras provided roughly 20 pixels/ft. and the MP cameras provided roughly double the SD or 40 pix/ft. at the human subjects.

Tests

In the first Parking Lot scenario two (2) key tests were performed:

  • All 5 test cameras at default shutter and gain settings. This meant that the SD cameras had either 1/30s or 1/60s shutter speeds, the MP Sanyo had 1/30s and the MP Pelco had 1/8s shutter speeds.
  • MP Pelco camera configured for 1/30s shutter speed to normalize with the default 1/30s or 1/60s shutter speeds of the SD cameras.

The Open Field scenario featured four (4) key tests:

  • All 5 test cameras at default shutter and gain settings. This meant that the SD cameras had either 1/30s or 1/60s shutter speeds, the MP Sanyo had 1/30s and the MP Pelco had 1/8s shutter speeds.
  • MP Pelco camera configured for 1/30s shutter speed to normalize with the default 1/30s or 1/60s shutter speeds of the SD cameras.
  • MP Pelco camera configured for 1/250s shutter speed
  • MP Pelco camera configured for 1/500s shutter speed

We considered other MP cameras as well. For example, we considered the Axis 5MP P1347, and the Sony HD CH140. Due to various technical issues we decided to exclude them from our main study. However, it is key to note that their low-light performance levels were similar to the Sanyo and Pelco MP cameras included in the 'main' study.

Testing Issues

The Sanyo HD4000 featured in this report presented several issues during our testing and analysis. The first issue involved an inability to set the correct time on the camera. This became an issue when searching its archived video on our Exacqvision VMS. According to Exacq this is a potential problem when cameras and VMSes are not synced up, since the VMS will try to 'honor' the camera's time setting.  Because of this issue we could not export clips from Sanyo along with the other cameras in synchronous mode.

Another issue we faced with the Sanyo HD4000 was the inability to configure a slow shutter setting. Sanyo calls this a 'long' shutter, and it is a feature of the HD4000. However, we had difficulty in configuring the 'long' shutter setting reliably and excluded it from the study. Thus, the default setting of 1/30s was used throughout all tests.

If cameras shipped with lenses we used them in testing as it represents what users are likely to use in real world scenarios. The three IP cameras shipped with lenses, while the two analog cameras not coming with lenses were fitted with separately purchased Computar (F1.0, AI, varifocal) lenses.

5 reports cite this report:

Multi-Megapixel Deployment Statistics on Jan 01, 2012
Megapixel camera resolution increases regularly, with manufacturers pushing higher and higher resolutions all the time. 2011 saw the introduction...
Directory of Camera Shootout Series on Dec 27, 2011
The following directory lists all of our camera shootouts. These shootouts pit 4 - 8 different surveillance cameras in simultaneous tests on real...
CNB Network Camera Review on Sep 08, 2011
Korean surveillance manufacturer CNB has historically been one of the more popular analog brands for budget / low cost appliations, viewed as a...
ACTi's 4MP Price/Performance Analysis on Aug 30, 2011
Over the past year, Taiwanese megapixel manufacturer ACTi released a line of four-megapixel cameras, while discontinuing most of the standard...
Color Versus Day/Night Shootout on Apr 16, 2011
Most people prefer color over black and white but when it gets dark out, almost all surveillance experts agree that black and white video provides...
Comments : PRO Members only. Login. or Join.

Related Reports

Hikvision ColorVu Integrated Visible Light Cameras Examined on Jun 22, 2018
When it comes to low light, infrared light has become the defacto standard in surveillance. But IR is limited to monochrome images, making colors...
Most Wanted Improvements In Manufacturer Technical Support (Statistics) on Jun 21, 2018
5 key areas of improvement and 1 clear wanted support feature were voiced by 140+ integrator responses to: What improvement in manufacturer...
IFSEC 2018 Final Show Report on Jun 20, 2018
IPVM attended the IFSEC show for the first time this year. The Chinese took over the show, centered on Hikvision, flanked by Dahua, Huawei and a...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...
Hikvision 12MP Fisheye Camera Tested (DS-2CD63C2F-IV) on Jun 14, 2018
Hikvision's DS-2CD63C2F-IV is their flagship panoramic camera, with a 12MP imager, 15m integrated IR, smart codec, and more. We tested the 63C2 in...
Avigilon H4 Multi-Sensor Adds 32MP, H.265, Analytics on Jun 13, 2018
Avigilon has announced the H4 Multisensor, the successor to their repositionable multi imager line, adding features like H.265, integrated IR,...
ReconaSense - The AI / Access Control / Analytics / IoT / Video Company Profile on Jun 12, 2018
One company's ISC West booth stood out for displaying a light-up tower of buzzwords. The company, ReconaSense, pledged to be 'making sense of it...
Introducing Effective PPF (ePPF) - Improving Video Surveillance Designs on Jun 11, 2018
Pixel density (PPF / PPM) is the best metric the industry has to define and project video quality. It allows simple communication of estimated...
Hanwha Low-Cost 4MP Camera Tested (QNV-7010R) on Jun 11, 2018
4MP usage is increasing noticeably, as IPVM 2018 resolution statistics show. And low-cost, fixed focal cameras, are popular for budget...

Most Recent Industry Reports

July 2018 IP Networking Course on Jun 22, 2018
  This is the only networking course designed specifically for video surveillance professionals. Register now. Lots of network training exists...
Installation Hardware for Video Surveillance - Indoor Fasteners on Jun 22, 2018
As part of our Installation for Video Surveillance series, in this note, we cover drywall anchors. A key part of installing security hardware is...
Hikvision ColorVu Integrated Visible Light Cameras Examined on Jun 22, 2018
When it comes to low light, infrared light has become the defacto standard in surveillance. But IR is limited to monochrome images, making colors...
'Secure Channel' OSDP Access Control Examined on Jun 21, 2018
Despite claiming to be better than Wiegand, OSDP's initial releases did not address the lack of encryption between reader and controller, leaving...
Most Wanted Improvements In Manufacturer Technical Support (Statistics) on Jun 21, 2018
5 key areas of improvement and 1 clear wanted support feature were voiced by 140+ integrator responses to: What improvement in manufacturer...
GDPR / ICO Complaint Filed Against IFSEC Show Facial Recognition on Jun 20, 2018
IPVM has filed a complaint against IFSEC’s parent company UBM based on our concern that the conference violates core GDPR principles on...
IFSEC 2018 Final Show Report on Jun 20, 2018
IPVM attended the IFSEC show for the first time this year. The Chinese took over the show, centered on Hikvision, flanked by Dahua, Huawei and a...
Mobotix Releases 'Move' Into 21st Century on Jun 20, 2018
For years, Mobotix stood resolutely against, well, every other manufacturer, selling it as a virtue: MOBOTIX equipment is designed with no...
Cybersecurity Startup VDOO Disclosing 10 Manufacturer Vulnerabilities Starting With Axis And Foscam on Jun 20, 2018
Cybersecurity startup VDOO has uncovered significant vulnerabilities in Axis cameras along with many others not yet disclosed. In this report, we...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact