Don't Trust Lux Ratingsby John Honovich, IPVM posted on Jan 09, 2013 About John Contact John
Do not trust lux ratings. Do not use lux ratings to specify cameras. Period.
Lux ratings are widely, and unfortunately, used to define low light performance, with the lower the lux rating, the stronger low light performance. Here's what this commonly looks like on manfacturer specifications:
For instance, a camera with 0.02 lux is supposedly 'better' in low light than a camera with 0.05 lux. (Background - See our Lux / Lux Meter Tutorial).
However, they are so riddled with fundamental problems that lux ratings must be abandoned.
In regular IPVM assessments, we find easily half of surveillance professionals believe and use lux ratings as a viable metric for assessing low light performance.
More importantly, lux ratings are overwhelmingly used in RFPs to require specific low light performance. Cameras that do not meet the RFPs lux ratings specification are rejected.
The Fundamental Problems
Here are the fundamental problems:
- Unrealistic numbers
- No standard process
- No revelation of what image looks like
- Failure to disclose camera settings
- Gradual image quality decline
Most manufacturers have lux ratings that are incredibly unrealistic, with ratings of .001 lux or lower common. However, that is incredibly dark. Almost any camera truly in such conditions in the real world would capture nothing or be so dark and noisy as to be practically useless.
No Standard Process
Each manufacturer measures on their own, by themselves and with whatever 'standards' that they like. As such, it is impossible to compare the results of two manufacturers without more knowledge or testing of one's own.
No Revelation of What Images Look Like
No manufacturer ever releases images of what their cameras look like at their claimed lux ratings. Almost certainly, the images would be terrible.
Failure to Disclose Camera Settings
Many manufacturers use tricky settings such as using super slow shutters and fostering tricks like 'sens up'. Often they will obscure this in their specification, resulting in seemingly eye popping low lux ratings like 0.000001 lux.
Gradual Image Quality Degradation
The image quality of all cameras gradually declines as light levels fall below 50 lux, with falling signal to noise ratios, and increasing gain control levels. There is no magical point where quality turns from good to bad.
The lion's share of the blame goes to consultants who regularly specify cameras based on minimum illumination specifications though they rarely if ever test to verify that the ratings are accurate.
This creates an ugly system where even the most ethical and responsible manufacturers are trapped. The first manufacturer to 'tell the truth' about their low light performance will be disqualified from many large projects. Because of this, no one can afford to do so.
Worse, it rewards the most unscrupulous vendors who realize that they are rarely, if ever, called on their specs.
What To Do?
The best way is to test cameras head to head in the same conditions with the same fundamental settings (especially shutter speed). For example, see our MP low light shootout. Take your finalists and place them for an evening in your desired deployment location. I can almost guarantee that the results will not match what the lux ratings suggest.
Short of that, a few specifications do deliver:
- F Stop: While small differences in F numbers (1.2 vs 1.4) have limited practical impact, going from F1.2 vs 2.4 typically has a major impact on low light quality.
- True Day/Night: Cameras with mechanical cut filters consistently deliver notable increases in low light performance.
- Adding IR: If a scene is quite dark and you want to ensure maximum illumination, consider adding IR either through integrated IR or add-on illuminators.
There is no magic number. Unfortunately, lux ratings are voodoo, more smoke and mirrors than reality. Let's move past them and focus on better metrics for reliably specifying high quality low light performance.
Most Recent Industry Reports
Testing Scallop Panoramic Cameras on Dec 19, 2014
For years, Arecont Vision's SurroundVideo line has been practically the only multi-imager option, but with their poor reputation, multi-imager cameras are still not widely used. Scallop Imaging ai...
Avigilon Acquires All ObjectVideo Patents on Dec 18, 2014
Wow. You thought Object Video played hardball suing large manufacturers like Bosch, Samsung, Sony, Pelco, etc. Now, Avigilon has acquired all of OV's patents for $80.3 million, and all of th...
Best & Worst Places to Buy Surveillance on Dec 17, 2014
Stores, distributors, manufacturers, the Internet, Chinese spam emails? Today, there are more options to buy surveillance than ever. But what are the best and worst places to buy? IPVM surveyed ...
2015 IP Camera Book on Dec 15, 2014
This is the best, most comprehensive IP camera training in the world, based on our unprecedented testing. Now, all IPVM PRO Members can get it in a single 300+ page ebook, downloadable inside. T...
Tested: Quality Worse Dome Bubble On? on Dec 11, 2014
Often, industry professionals will warn about three problems with using domes: The dome bubble degrades image quality The degradation is worse with megapixel cameras The degradation is worse t...
Hikvision HDTVI VS Dahua HDCVI on Dec 10, 2014
With super low cost and full HD video, Analog HD has the most potential to disrupt the surveillance market of any new technology in years. With 1080p HD IR cameras, routinely being priced at ~$100...
Testing Day vs Night With IR on Dec 09, 2014
IR illumination helps. When it gets dark, especially real dark, with no nearby artifical lighting, pretty much every surveillance camera (even 'super' ones) are going to deliver signific...
Major Moves - Security Manufacturer 2014 on Dec 08, 2014
This guide summarizes the biggest moves of security manufacturers in 2014, concentrating on acquisitions, fund raising, significant stock price shifts and major new product lines introduced. ...
HD Analog DVRs With VMS Software Tested on Dec 05, 2014
New HD analog offerings from Dahua and Hikvision have proven to deliver HD video at radically lower prices (see IPVM test results - Dahua HDCVI 1.0, Dahua HDCVI 2.0, Hikvision HDTVI). However...
Manufacturer Sales Pitches Revealed on Dec 02, 2014
IPVM sent a 'secret shopper' to ISC East 2014 to talk to manufacturer sales reps at their booths. We wanted to understand and contrast how they pitched to a prototypical end user. Would they fol...