Testing Autofocus Accuracy

By: Derek Ward, Published on Dec 17, 2013

Integrators love autofocus.

It takes the pain out of getting precise focus manually, especially important for hard to reach cameras. However, some question the accuracy of autofocusing versus manual where a human can carefully determine and verify best focus.

Autofocus Comparisons

We tested 6 cameras in multiple scenes, starting indoors at full light (~160 lux), then in the dark (~2 lux), and then outside in the daytime.  The cameras used for testing were:

  • Avigilon 1.0-H3-B2 (720p)
  • Axis P3354 (1.3MP)
  • Bosch NBN-733V (720p)
  • Bosch NBN-932V (1080p)
  • Samsung SNB-5004 (720p)
  • Sony SNC-VB600 (720p)
  • Here are our key findings from this test:

    • Autofocus was generally accurate in well lit scenes, regardless of what was in the FOV at the time, indoors or out. Only one camera had issues focusing against a blank wall, the Sony SNC-VB600.
    • Introducing a test chart in the middle of the FOV solved the Sony camera's focus issues. Other cameras were unchanged.
    • In low light (~2 lux) in an empty scene, multiple cameras had severe focus issues. Adding a chart improved autofocus performance, allowing all cameras to focus accurately. Since some cameras automatically refocus when switching to monochrome mode, users should be careful to double check focus at night.
    • Resolution of the cameras tested did not impact the overall "clarity" and "focus" of an image, but a camera with higher resolution made it easier to discern whether or not an image was in focus with the human eye.
    • Proper focus may be occasionally difficult to determine due to vast differences in sharpness between models.

    Recommendations

    In general, autofocus performs well and may be trusted, potentially saving substantial time in installation. We also found this to be true regardless of what objects are in the scene (subjects, test charts, etc.).

    However, there are two key caveats to this:

    • When using cameras which automatically refocus after switching from day to night mode, users must confirm that the camera properly autofocuses. This is by far the greatest risk when using autofocus cameras, and should be periodically checked.
    • Autofocus is a software function, and as such, varies grealy between manufacturers and even models within a single line. We have seen multiple issues with autofocusing across manufacturers, often fixed in firmware updates, so users should expect their performance may vary.

    Test Comparisons

    Indoors Blank Wall

    Get Notified of Video Surveillance Breaking News
    Get Notified of Video Surveillance Breaking News

    First, we started indoors in our conference room scene in at full light (~160 lux) with cameras pointed at a blank wall. Below is a focused FOV image of the scene.

    The Sony SNC-VB600 was the only camera that did not fully focus properly, and this can be seen by looking at the plant on the right side of the image.

    With Test Chart In Scene

    Next, we tested autofocus with an eye chart in the center of the FOV to see if inclusion of an object in the center of the FOV changed focus performance.

    With the chart included in the FOV, no cameras had any trouble focusing, including the Sony VB600, which had difficulty with the blank wall.

    Indoor Dark

    In the same scene as our full light indoor testing, we tested the cameras in a low-light (~2 lux) environment. All cameras were set to night mode, with a 1/30 exposure. We are not testing the cameras low light performance, only how well they did focusing on a low light scene.

    Blank Wall

    This was the hardest scene for camera autofocusing, with nothing in the FOV.

    The Avigilon 1.0-H3-B2, Bosch NBN-932V, and Samsung SNB-5004 cameras were the worst performers in this scene, unable to produce a usable, focused image, and required multiple manual focusing attempts to get the correct focus. Below is an image showing these three cameras after autofocusing.

    With Chart In Scene

    With one chart in the scene, all cameras were able to produce a clear, focused image.

    Outdoor

    We tested in an outdoor parking lot to see what effects a more complex scene with a deep field of view had, with multiple objects in the foreground and background, including moving cars.

    We started with no charts or defined focal points, and simply had the cameras autofocus on the scene. The FOV of the scene is presented below.

    All cameras were seemingly able to focus accurately in this scene. However, we then shot the same scene with the same charts we used from inside. Below is the FOV.

    Placing these charts in the scene did not change the cameras' autofocus performance in any way. However, close inspection of the eye chart reveals the effects of sharpness on cameras' apparent focus.

    For example, though all three of the cameras below are at their optimal focus point, varying levels of sharpness make the chart appear very different, so much so that the softest chart may look out of focus to some. Users should be careful to account for this when focusing and recognize the difference between soft and out of focus cameras.

     

2 reports cite this report:

Testing EF Lenses On IP Camera on Nov 23, 2016
Glass. IP cameras are often characterized as using lower quality 'glass' and that those lenses reduce image quality. By contrast, Canon EF lenses...
Video Surveillance Commissioning / Install Checklist on Feb 08, 2016
This 60+ point checklist helps end users, integrators and consultants verify that video surveillance installation is complete. It covers the...
Comments (2) : Members only. Login. or Join.

Related Reports

Startup Spectral Edge RGB+IR Claims "Unique Low Light Performance Tech" on Apr 03, 2019
This UK startup, born out of university research, is boldly proclaiming that they deliver "Unique low light performance tech for video surveillance...
Speco Ultra Intensifier Tested on Apr 22, 2019
While ISC West 2019 named Speco's Ultra Intensifier the best new "Video Surveillance Cameras IP", IPVM testing shows the camera suffers from...
Hikvision ColorVu Camera Tested on Jun 24, 2019
Hikvision says their new ColorVu line captures "vivid chromatic images in darkness", with unconventional white light illuminations whereas most...
Lens Iris Tutorial on Aug 08, 2019
Cameras, like humans, have irises, controlling the light which hits the imager and impacting image details. However, cameras have multiple types of...
Wide Dynamic Range (WDR) Guide on Oct 01, 2019
Understanding wide dynamic range (WDR) is critical to capturing high quality images in demanding conditions. However, with no real standards, any...
Hikvision ColorVu is Smart Marketing on Oct 03, 2019
Hikvision ColorVu (see IPVM test results) is smart marketing, a lesson to be learned by competitors and a rising trend. Inside this note, we...
Integrated IR Camera Usage Statistics 2019 on Oct 21, 2019
Virtually every IP camera now comes with integrated IR but how many actually make use of IR or choose 'super' low light cameras without IR? In...
Biggest Low Light Problems 2019 on Nov 08, 2019
Over 150 integrators responded to our survey question: "What are the biggest problems you face getting good low-light images?" Inside, we share...
Axis "Best Of The Best" 4K Camera Tested (Q1798-LE) on Nov 21, 2019
Axis has released their "best of the best" Q1798-LE bullet camera, touting "4K without compromise" with a large Micro 4/3" image sensor, custom...
Budget Covert Cameras Tested on Nov 26, 2019
Covert cameras under $100 are widely available online but are they any good? To see how these models really work in the real world, we bought...

Most Recent Industry Reports

Every VMS Will Become a VSaaS on Feb 21, 2020
VMS is ending. Soon every VMS will be a VSaaS. Competitive dynamics will be redrawn. What does this mean? VMS Historically...
Video Surveillance 101 Course - Last Chance on Feb 20, 2020
This is the last chance to join IPVM's first Video Surveillance 101 course, designed to help those new to the industry to quickly understand the...
Vulnerability Directory For Access Credentials on Feb 20, 2020
Knowing which access credentials are insecure can be difficult to see, especially because most look and feel the same. Even insecure 125 kHz...
AI/Smart Camera Tutorial on Feb 20, 2020
Cameras with video analytics, sometimes called 'Smart' camera or 'AI' cameras, etc. are one of the most promising growth areas of video...
China Manufacturer Suffers Coronavirus Scare on Feb 20, 2020
Uniview suffered a significant health scare last week after one of its employees reported a fever and initially tested positive for coronavirus....
Cheap Camera Problems at Night on Feb 19, 2020
Cheap cameras generally have problems at night, despite the common perception that integrated IR makes cameras mostly the same, according to new...
Milestone Launches Multiple Cloud Solutions on Feb 18, 2020
Milestone is going to the cloud, becoming one of the last prominent VMSes to do so. Milestone is clearly late but how competitive do these new...
Video Surveillance Architecture 101 on Feb 18, 2020
Video surveillance can be designed and deployed in a number of ways. This 101 examines the most common options and architectures used in...
UK Stands Behind Hikvision But Controversy Continues on Feb 18, 2020
Hikvision is exhibiting at a UK government conference for law enforcement, provoking controversy from the press, politicians, and activists due to...
IronYun AI Analytics Tested on Feb 17, 2020
Taiwan startup IronYun has raised tens of millions for its "mission to be the leading Artificial Intelligence, big data video software as a service...