Testing Autofocus Accuracy

By: Derek Ward, Published on Dec 17, 2013

Integrators love autofocus.

It takes the pain out of getting precise focus manually, especially important for hard to reach cameras. However, some question the accuracy of autofocusing versus manual where a human can carefully determine and verify best focus.

Autofocus Comparisons

We tested 6 cameras in multiple scenes, starting indoors at full light (~160 lux), then in the dark (~2 lux), and then outside in the daytime.  The cameras used for testing were:

  • Avigilon 1.0-H3-B2 (720p)
  • Axis P3354 (1.3MP)
  • Bosch NBN-733V (720p)
  • Bosch NBN-932V (1080p)
  • Samsung SNB-5004 (720p)
  • Sony SNC-VB600 (720p)
  • Here are our key findings from this test:

    • Autofocus was generally accurate in well lit scenes, regardless of what was in the FOV at the time, indoors or out. Only one camera had issues focusing against a blank wall, the Sony SNC-VB600.
    • Introducing a test chart in the middle of the FOV solved the Sony camera's focus issues. Other cameras were unchanged.
    • In low light (~2 lux) in an empty scene, multiple cameras had severe focus issues. Adding a chart improved autofocus performance, allowing all cameras to focus accurately. Since some cameras automatically refocus when switching to monochrome mode, users should be careful to double check focus at night.
    • Resolution of the cameras tested did not impact the overall "clarity" and "focus" of an image, but a camera with higher resolution made it easier to discern whether or not an image was in focus with the human eye.
    • Proper focus may be occasionally difficult to determine due to vast differences in sharpness between models.

    Recommendations

    In general, autofocus performs well and may be trusted, potentially saving substantial time in installation. We also found this to be true regardless of what objects are in the scene (subjects, test charts, etc.).

    However, there are two key caveats to this:

    • When using cameras which automatically refocus after switching from day to night mode, users must confirm that the camera properly autofocuses. This is by far the greatest risk when using autofocus cameras, and should be periodically checked.
    • Autofocus is a software function, and as such, varies grealy between manufacturers and even models within a single line. We have seen multiple issues with autofocusing across manufacturers, often fixed in firmware updates, so users should expect their performance may vary.

    Test Comparisons

    Indoors Blank Wall

    Get Notified of Video Surveillance Breaking News
    Get Notified of Video Surveillance Breaking News

    First, we started indoors in our conference room scene in at full light (~160 lux) with cameras pointed at a blank wall. Below is a focused FOV image of the scene.

    The Sony SNC-VB600 was the only camera that did not fully focus properly, and this can be seen by looking at the plant on the right side of the image.

    With Test Chart In Scene

    Next, we tested autofocus with an eye chart in the center of the FOV to see if inclusion of an object in the center of the FOV changed focus performance.

    With the chart included in the FOV, no cameras had any trouble focusing, including the Sony VB600, which had difficulty with the blank wall.

    Indoor Dark

    In the same scene as our full light indoor testing, we tested the cameras in a low-light (~2 lux) environment. All cameras were set to night mode, with a 1/30 exposure. We are not testing the cameras low light performance, only how well they did focusing on a low light scene.

    Blank Wall

    This was the hardest scene for camera autofocusing, with nothing in the FOV.

    The Avigilon 1.0-H3-B2, Bosch NBN-932V, and Samsung SNB-5004 cameras were the worst performers in this scene, unable to produce a usable, focused image, and required multiple manual focusing attempts to get the correct focus. Below is an image showing these three cameras after autofocusing.

    With Chart In Scene

    With one chart in the scene, all cameras were able to produce a clear, focused image.

    Outdoor

    We tested in an outdoor parking lot to see what effects a more complex scene with a deep field of view had, with multiple objects in the foreground and background, including moving cars.

    We started with no charts or defined focal points, and simply had the cameras autofocus on the scene. The FOV of the scene is presented below.

    All cameras were seemingly able to focus accurately in this scene. However, we then shot the same scene with the same charts we used from inside. Below is the FOV.

    Placing these charts in the scene did not change the cameras' autofocus performance in any way. However, close inspection of the eye chart reveals the effects of sharpness on cameras' apparent focus.

    For example, though all three of the cameras below are at their optimal focus point, varying levels of sharpness make the chart appear very different, so much so that the softest chart may look out of focus to some. Users should be careful to account for this when focusing and recognize the difference between soft and out of focus cameras.

     

2 reports cite this report:

Testing EF Lenses On IP Camera on Nov 23, 2016
Glass. IP cameras are often characterized as using lower quality 'glass' and...
Video Surveillance Commissioning / Install Checklist on Feb 08, 2016
This 60+ point checklist helps end users, integrators and consultants verify...
Comments (2) : Members only. Login. or Join.

Related Reports

FLIR A Series Temperature Screening Cameras Tested on Jun 04, 2020
FLIR is one of the biggest names in thermal and one of the most conservative....
HLC Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Mar 02, 2020
Highlight Compensation (HLC) claims to reduce the effects of strong light...
Seek Scan Thermal Temperature Screening System Tested on May 28, 2020
Now that IPVM has tested Dahua, Hikvision, and Sunell, we are returning to...
New Axis M30 Cameras Tested on Mar 26, 2020
Axis has released a new generation of, for them, relatively low cost M30...
Facial Recognition 101 on Mar 18, 2020
Facial recognition interest, use and fear is increasing. This guide aims to...
FLIR Screen-EST Screening Software Tested on Jun 30, 2020
In our FLIR A Series Test, the cameras' biggest drawback was their lack of...
TVT / InVid White Light Camera Tested Vs Hikvision ColorVu on Mar 18, 2020
With mega China manufacturers Dahua and Hikvision facing both bans and human...
IronYun AI Analytics Tested on Feb 17, 2020
Taiwan / US startup IronYun has raised tens of millions for its "mission to...
Mobotix Thermal Detection Camera Tested on Jun 09, 2020
For years Mobotix has struggled but now sales are surging driven by Mobotix's...
Directory of 201 "Fever" Camera Suppliers on Aug 04, 2020
This directory provides a list of "Fever" scanning thermal camera providers...
Spectron IR Thermal Fever Screening System Examined on Apr 14, 2020
Most are quick to avoid "fever screening" and "medical" labels, but...
Use Access Control Logs To Constrain Coronavirus on Apr 09, 2020
Access control users have included capabilities that are not commonly used...
Hazardous & Explosion Proof Access Control Tutorial on Feb 27, 2020
Controlling access to hazardous environments requires equipment meeting...
Emitted Energy TempScan Thermal Screening System Examined on Apr 28, 2020
Emitted Energy has specialized in temperature measurement using FLIR cameras...
Remote Network Access for Video Surveillance Guide on Jul 27, 2020
Remotely accessing surveillance systems is key in 2020, with more and more...

Recent Reports

Genetec CEO Declares "We Don't Negotiate Payment With Patent Trolls" on Aug 11, 2020
Are patent trolls like terrorists? Genetec's CEO is coming out strongly...
Hanwha AI Analytics Camera Tested on Aug 11, 2020
Hanwha has released their Wisenet P AI camera, adding person and vehicle...
Alabama Schools Million Dollar Hikvision Fever Camera Deal on Aug 11, 2020
The Baldwin County, Alabama public schools purchased a $1 million, 144-camera...
Dahua Taunts Australian Government, Continues To Sell Illegal Fever Cameras on Aug 10, 2020
Dahua is effectively taunting the Australian government by continuing to sell...
HID Releases VertX Replacement Aero on Aug 10, 2020
HID is replacing two established and broadly supported types of access...
NDAA Compliant Video Surveillance Whitelist on Aug 10, 2020
This report aggregates video surveillance products that manufacturers have...
Telpo China Temperature Tablets Tested on Aug 10, 2020
The provider for overseas companies ranging from Canon Singapore to US'...
Dangerous Hikvision Fever Camera Showcased by Chilean City on Aug 07, 2020
Deploying a fever camera outdoors, in the rain, with no black body, is...
"Grand Slam" For Pelco's PE Firm, A Risk For Motorola on Aug 07, 2020
The word "Pelco" and "grand slam" have not been said together for many years....
FLIR Stock Falls, Admits 'Decelerating' Demand For Temperature Screening on Aug 07, 2020
Is the boom going to bust for temperature screening? FLIR disappointed...
VSaaS Will Hurt Integrators on Aug 06, 2020
VSaaS will hurt integrators, there is no question about that. How much...
Dogs For Coronavirus Screening Examined on Aug 06, 2020
While thermal temperature screening is the surveillance industry's most...
ADT Slides Back, Disappointing Results, Poor Commercial Performance on Aug 06, 2020
While ADT had an incredible start to the week, driven by the Google...
AHJ / Authority Having Jurisdiction Tutorial on Aug 06, 2020
One of the most powerful yet often underappreciated characters in all...
SIA Coaches Sellers on NDAA 889B Blacklist Workarounds on Aug 05, 2020
Last month SIA demanded that NDAA 899B "must be delayed". Now that they have...