Testing Autofocus Accuracy

By: Derek Ward, Published on Dec 17, 2013

Integrators love autofocus.

It takes the pain out of getting precise focus manually, especially important for hard to reach cameras. However, some question the accuracy of autofocusing versus manual where a human can carefully determine and verify best focus.

Autofocus Comparisons

We tested 6 cameras in multiple scenes, starting indoors at full light (~160 lux), then in the dark (~2 lux), and then outside in the daytime.  The cameras used for testing were:

  • Avigilon 1.0-H3-B2 (720p)
  • Axis P3354 (1.3MP)
  • Bosch NBN-733V (720p)
  • Bosch NBN-932V (1080p)
  • Samsung SNB-5004 (720p)
  • Sony SNC-VB600 (720p)
  • Here are our key findings from this test:

    • Autofocus was generally accurate in well lit scenes, regardless of what was in the FOV at the time, indoors or out. Only one camera had issues focusing against a blank wall, the Sony SNC-VB600.
    • Introducing a test chart in the middle of the FOV solved the Sony camera's focus issues. Other cameras were unchanged.
    • In low light (~2 lux) in an empty scene, multiple cameras had severe focus issues. Adding a chart improved autofocus performance, allowing all cameras to focus accurately. Since some cameras automatically refocus when switching to monochrome mode, users should be careful to double check focus at night.
    • Resolution of the cameras tested did not impact the overall "clarity" and "focus" of an image, but a camera with higher resolution made it easier to discern whether or not an image was in focus with the human eye.
    • Proper focus may be occasionally difficult to determine due to vast differences in sharpness between models.

    Recommendations

    In general, autofocus performs well and may be trusted, potentially saving substantial time in installation. We also found this to be true regardless of what objects are in the scene (subjects, test charts, etc.).

    However, there are two key caveats to this:

    • When using cameras which automatically refocus after switching from day to night mode, users must confirm that the camera properly autofocuses. This is by far the greatest risk when using autofocus cameras, and should be periodically checked.
    • Autofocus is a software function, and as such, varies grealy between manufacturers and even models within a single line. We have seen multiple issues with autofocusing across manufacturers, often fixed in firmware updates, so users should expect their performance may vary.

    Test Comparisons

    Indoors Blank Wall

    Get Notified of Video Surveillance Breaking News
    Get Notified of Video Surveillance Breaking News

    First, we started indoors in our conference room scene in at full light (~160 lux) with cameras pointed at a blank wall. Below is a focused FOV image of the scene.

    The Sony SNC-VB600 was the only camera that did not fully focus properly, and this can be seen by looking at the plant on the right side of the image.

    With Test Chart In Scene

    Next, we tested autofocus with an eye chart in the center of the FOV to see if inclusion of an object in the center of the FOV changed focus performance.

    With the chart included in the FOV, no cameras had any trouble focusing, including the Sony VB600, which had difficulty with the blank wall.

    Indoor Dark

    In the same scene as our full light indoor testing, we tested the cameras in a low-light (~2 lux) environment. All cameras were set to night mode, with a 1/30 exposure. We are not testing the cameras low light performance, only how well they did focusing on a low light scene.

    Blank Wall

    This was the hardest scene for camera autofocusing, with nothing in the FOV.

    The Avigilon 1.0-H3-B2, Bosch NBN-932V, and Samsung SNB-5004 cameras were the worst performers in this scene, unable to produce a usable, focused image, and required multiple manual focusing attempts to get the correct focus. Below is an image showing these three cameras after autofocusing.

    With Chart In Scene

    With one chart in the scene, all cameras were able to produce a clear, focused image.

    Outdoor

    We tested in an outdoor parking lot to see what effects a more complex scene with a deep field of view had, with multiple objects in the foreground and background, including moving cars.

    We started with no charts or defined focal points, and simply had the cameras autofocus on the scene. The FOV of the scene is presented below.

    All cameras were seemingly able to focus accurately in this scene. However, we then shot the same scene with the same charts we used from inside. Below is the FOV.

    Placing these charts in the scene did not change the cameras' autofocus performance in any way. However, close inspection of the eye chart reveals the effects of sharpness on cameras' apparent focus.

    For example, though all three of the cameras below are at their optimal focus point, varying levels of sharpness make the chart appear very different, so much so that the softest chart may look out of focus to some. Users should be careful to account for this when focusing and recognize the difference between soft and out of focus cameras.

     

2 reports cite this report:

Testing EF Lenses On IP Camera on Nov 23, 2016
Glass. IP cameras are often characterized as using lower quality 'glass' and that those lenses reduce image quality. By contrast, Canon EF lenses...
Video Surveillance Commissioning / Install Checklist on Feb 08, 2016
This 60+ point checklist helps end users, integrators and consultants verify that video surveillance installation is complete. It covers the...
Comments (2) : Members only. Login. or Join.

Related Reports

IR Surveillance Camera Guide on Feb 06, 2020
Integrated infrared (IR) cameras are everywhere in 2020, but not all IR is created equal, with many differences in coverage, overexposure,...
Integrated IR Camera Shootout 2020 - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Uniview, Vivotek on Jan 30, 2020
The best and worst cameras tested in this IPVM shootout showed major differences in quality and performance. While many view IR as being a...
Color Low Light Mega Camera Shootout - Avigilon, Axis, Bosch, Dahua, Hanwha, Hikvision, Panasonic, Speco, Sony, Vivotek on Nov 12, 2019
This is the biggest color low light shootout ever, testing 20+ super low light models from 10 manufacturers: Increasingly, each manufacturer...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Wide Dynamic Range (WDR) Guide on Oct 01, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Repositionable Multi-Imager Camera Shootout - Avigilon, Axis, Dahua, Hanwha, Hikvision, Panasonic, Vivotek on Jun 19, 2019
Repositionable multi-imager cameras are one of the fastest growing segments in video surveillance, with a slew of new offerings being recently...
Avigilon 32MP and 12MP H4 Multisensor Cameras Tested on Jun 11, 2019
Avigilon has released their H4 Multi-Sensor line of cameras claiming "broad scene coverage and high image detail" We bought and tested the...
Vivotek 20MP Multi-Imager Tested on May 30, 2019
Vivotek has released their latest repositionable multi-imager camera, the MA9321-EHTV, a 20 MP model claiming "Supreme Night Visibility", "Optimal...
Panasonic 32MP Multi Imager Camera Tested (WV-X8570N) on May 16, 2019
Panasonic has released their first multi imager models including the 32MP (4x4K) WV-X8570N, claiming "Extreme image quality for evidence capturing...
Dahua Repositionable IR Multi-Imager Camera Tested on Apr 16, 2019
Dahua has released their first repositionable multi-imager camera, the Multi-Flex 4x2MP, claiming integrated IR, true WDR, and flexible...

Most Recent Industry Reports

EyePark Presents Mobile Driver Authentication on Jun 05, 2020
EyePark presented its long-range QR code parking verification platform at the May 2020 IPVM Startups show. A 30-minute video from EyePark...
Bleenco "Under The Tongue" Temperature Detection Examined on Jun 05, 2020
"Say aah", says Bleenco, a PPE detection video analytics company, offering a different method for measuring body temperature with a thermal...
Hikvision and Uniview Entry Level Thermal Handheld Cameras Tested on Jun 05, 2020
While most screening systems cost $10,000 or more, manufacturers such as Hikvision and Uniview have now released handheld models for $1,000 or...
Sequr Presents HID based Cloud Access Control on Jun 04, 2020
Sequr presented HID based Cloud Access Control at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from Sequr...
VergeSense Presents People Tracking Sensor on Jun 04, 2020
VergeSense presented its people tracking sensor and social distancing insights at the May 2020 IPVM Startups show. A 30-minute video from...
FLIR A Series Temperature Screening Cameras Tested on Jun 04, 2020
FLIR is one of the biggest names in thermal and one of the most conservative. While rivals have marketed fever detection, FLIR has stuck to EST...
"Fever Camera" Show On-Demand Watch Now on Jun 03, 2020
IPVM has successfully completed the world's first "Fever Camera" show. Recordings from Both days are posted at the end of this report for on-demand...
Cobalt Robotics Presents Indoor Security and Access Robots on Jun 03, 2020
Cobalt Robotics presented indoor security robots at the May 2020 IPVM Startups show. Inside this report: A 30-minute video from Cobalt...
Dahua Sues Ex-North American President, Says Legal Typo on Jun 03, 2020
Dahua's former North American President Frank Zhang claims he is owed almost $11 million but Dahua counter claims it is just a "scrivener's error",...
Smart Entry Systems Presents Cloud Multi-Tenant Access Control on Jun 02, 2020
Smart Entry Systems presented Cloud Multi-Tenant Access Control at the May 2020 IPVM Startups show. Inside this report: A 30-minute video...