Don't Trust Lux Ratingsby John Honovich, IPVM posted on Jan 09, 2013 About John Contact John
Do not trust lux ratings. Do not use lux ratings to specify cameras. Period.
Lux ratings are widely, and unfortunately, used to define low light performance, with the lower the lux rating, the stronger low light performance. Here's what this commonly looks like on manfacturer specifications:
For instance, a camera with 0.02 lux is supposedly 'better' in low light than a camera with 0.05 lux. (Background - See our Lux / Lux Meter Tutorial).
However, they are so riddled with fundamental problems that lux ratings must be abandoned.
In regular IPVM assessments, we find easily half of surveillance professionals believe and use lux ratings as a viable metric for assessing low light performance.
More importantly, lux ratings are overwhelmingly used in RFPs to require specific low light performance. Cameras that do not meet the RFPs lux ratings specification are rejected.
The Fundamental Problems
Here are the fundamental problems:
- Unrealistic numbers
- No standard process
- No revelation of what image looks like
- Failure to disclose camera settings
- Gradual image quality decline
Most manufacturers have lux ratings that are incredibly unrealistic, with ratings of .001 lux or lower common. However, that is incredibly dark. Almost any camera truly in such conditions in the real world would capture nothing or be so dark and noisy as to be practically useless.
No Standard Process
Each manufacturer measures on their own, by themselves and with whatever 'standards' that they like. As such, it is impossible to compare the results of two manufacturers without more knowledge or testing of one's own.
No Revelation of What Images Look Like
No manufacturer ever releases images of what their cameras look like at their claimed lux ratings. Almost certainly, the images would be terrible.
Failure to Disclose Camera Settings
Many manufacturers use tricky settings such as using super slow shutters and fostering tricks like 'sens up'. Often they will obscure this in their specification, resulting in seemingly eye popping low lux ratings like 0.000001 lux.
Gradual Image Quality Degradation
The image quality of all cameras gradually declines as light levels fall below 50 lux, with falling signal to noise ratios, and increasing gain control levels. There is no magical point where quality turns from good to bad.
The lion's share of the blame goes to consultants who regularly specify cameras based on minimum illumination specifications though they rarely if ever test to verify that the ratings are accurate.
This creates an ugly system where even the most ethical and responsible manufacturers are trapped. The first manufacturer to 'tell the truth' about their low light performance will be disqualified from many large projects. Because of this, no one can afford to do so.
Worse, it rewards the most unscrupulous vendors who realize that they are rarely, if ever, called on their specs.
What To Do?
The best way is to test cameras head to head in the same conditions with the same fundamental settings (especially shutter speed). For example, see our MP low light shootout. Take your finalists and place them for an evening in your desired deployment location. I can almost guarantee that the results will not match what the lux ratings suggest.
Short of that, a few specifications do deliver:
- F Stop: While small differences in F numbers (1.2 vs 1.4) have limited practical impact, going from F1.2 vs 2.4 typically has a major impact on low light quality.
- True Day/Night: Cameras with mechanical cut filters consistently deliver notable increases in low light performance.
- Adding IR: If a scene is quite dark and you want to ensure maximum illumination, consider adding IR either through integrated IR or add-on illuminators.
There is no magic number. Unfortunately, lux ratings are voodoo, more smoke and mirrors than reality. Let's move past them and focus on better metrics for reliably specifying high quality low light performance.
Most Recent Industry Reports
Testing the Real Resolution of MP Cameras on Dec 11, 2013
Resolution has become ridiculous. IP cameras equate resolution with pixels, ignoring that pixels are simply mechanical components of a camera, not the full performance of said camera. Indeed, it h...
Testing the Resolution of the Human Eye on Dec 04, 2013
All sorts of wild guesses and theoretical calculations exist about what the resolution of the human eye is, with 576MP a common claim. No one we can find has ever actually tested it . . . until no...
Hikvision Cameras Tested on Dec 02, 2013
Hikvision claims to be the #1 surveillance manufacturer in the world. That's, well, debatable. What's not in dispute is that they have become huge, fueled by the massive Chinese market, with ...
Testing New Dropcam Pro Camera on Nov 25, 2013
VSaaS, overall, has been a disaster with nearly every provider, including gorilla Axis, struggling to make it big. The one clear exception has been Dropcam. It's end to end solution, targeted for ...
Bosch Flexidome Micro Shootout on Nov 22, 2013
Minidomes are very popular, likely the most popular of all IP camera form factors, due to their relative low cost and small size. Earlier this year, we tested 3 Axis M30 minidomes. Now, we are test...
10MP vs 5MP vs HD Shootout on Nov 20, 2013
HD cameras are commonplace. Everyone offers 1080p. The big question now is how much better is 5MP or 10MP? Is a 10MP camera 5 times better than 1080p as pixel count proponents claim? In this repor...
VMS Mobile Apps Guide on Nov 19, 2013
Every VMS supplier has mobile app clients now, even if many are still not using them. However, significant differences can exist across VMS implementations. In this guide, we review 15 key feature...
Samsung Wisenet III Camera Shootout on Nov 18, 2013
Samsung has never been a serious player in IP cameras, despite their success in other markets. Now, Samsung is pushing their Wisenet III release as their breakthrough offering. Is it really? We b...
Camera Selection Guide on Nov 14, 2013
Entrances, hallways, rooms and parking lots are perhaps the 4 most common areas where surveillance is deployed. But what is the best type of camera for each? What resolution, form factors and FoV a...