MP Camera Low Light Shootoutby John Honovich, IPVM posted on Dec 05, 2011 About John Contact John
With the market sharply moving to megapixel cameras, an increasingly important question is: what MP cameras offer the best low light performance? In this report, we answer this question based on months of field testing. We then take the best performing megapixel cameras and test them against a top SD camera to see how big and what type of performance gap exists between the best low light megapixel cameras and SD cameras.
Fair Tests and Manufacturer Tricks
If you take megapixel cameras out of the box and test them for low light performance, the results will be badly skewed - guaranteed. The reason is that manufacturer's default maximum shutter speed vary widely. This is critical because shutter speed determines how long light is captured by the camera. Some manufacturers default to 1/30s, others as low as 1/6s. A camera with a 1/6s default shutter gets 500% more light than the camera with the 1/30s exposure (all things being equal). There is no fundamental difference or technology superiority, just a choice for default.
We strongly recommend that all camera tests use normalized shutter speed to make sure that no camera has an unfair advantage based simply on how aggressive their default settings are. And remember, longer shutters can have very bad side affects - specifically motion blur / ghosting. We normalize all cameras to 1/30s shutter for our tests as this matches the normal top frame rate (30fps) for surveillance cameras. You could certainly choose a different level - all images would be brighter (or darker) depending on the level but the relative performance would remain the same.
Secondly, it is imperative that cameras be tested simultaneously and under recorded light levels. It is very easy to mistake one camera as being better than another when testing cameras at different times. Most frequently, the problem we see in industry reviews is that the light levels change between tests and the tester/reviewer is unknowingly comparing Camera A's performance at 1 lux with Camera's B performance at 2 lux, drawing erroneous conclusions.
Over the last few months, we have done numerous tests - indoors in a dark environment and outdoors at night to determine relative performance. We've tested Arecont, ACTi, Avigilon, Axis, Bosch, Pelco, Panasonic, Sony, Vivotek, etc.
UPDATE: We've taken the top performers of this test and did a shootout against Axis's new Lightfinder camera / Q1602.
Here is a sample of the format we use inside to contrast image results and demonstrate differences:
Inside, we examine the results, show image comparisons and then compare to SD.
Most Recent Industry Reports
Testing the Resolution of the Human Eye on Dec 04, 2013
All sorts of wild guesses and theoretical calculations exist about what the resolution of the human eye is, with 576MP a common claim. No one we can find has ever actually tested it . . . until no...
Hikvision Cameras Tested on Dec 02, 2013
Hikvision claims to be the #1 surveillance manufacturer in the world. That's, well, debatable. What's not in dispute is that they have become huge, fueled by the massive Chinese market, with ...
Testing New Dropcam Pro Camera on Nov 25, 2013
VSaaS, overall, has been a disaster with nearly every provider, including gorilla Axis, struggling to make it big. The one clear exception has been Dropcam. It's end to end solution, targeted for ...
Bosch Flexidome Micro Shootout on Nov 22, 2013
Minidomes are very popular, likely the most popular of all IP camera form factors, due to their relative low cost and small size. Earlier this year, we tested 3 Axis M30 minidomes. Now, we are test...
10MP vs 5MP vs HD Shootout on Nov 20, 2013
HD cameras are commonplace. Everyone offers 1080p. The big question now is how much better is 5MP or 10MP? Is a 10MP camera 5 times better than 1080p as pixel count proponents claim? In this repor...
VMS Mobile Apps Guide on Nov 19, 2013
Every VMS supplier has mobile app clients now, even if many are still not using them. However, significant differences can exist across VMS implementations. In this guide, we review 15 key feature...
Samsung Wisenet III Camera Shootout on Nov 18, 2013
Samsung has never been a serious player in IP cameras, despite their success in other markets. Now, Samsung is pushing their Wisenet III release as their breakthrough offering. Is it really? We b...
Camera Selection Guide on Nov 14, 2013
Entrances, hallways, rooms and parking lots are perhaps the 4 most common areas where surveillance is deployed. But what is the best type of camera for each? What resolution, form factors and FoV a...
Winners & Losers Fall 2013 on Nov 04, 2013
New product releases were terrible this fall. The biggest news was the debatable entry of Axis and Milestone into access control. But the biggest gains might be for Chinese manufacturers who are an...