Smart Codec Guide

By: IPVM Team, Published on Feb 01, 2018

In 2019, smart codecs are now mainstream. Once seemingly a marketing buzzword, now the majority of manufacturers offer smart codecs on at least some of their cameras.

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.264+', 'Smart Stream II', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our: 

'Normal' codecs, like 'regular' H.264, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

** ****, ***** ****** are *** **********. **** seemingly * ********* ********, now *** ******** ** manufacturers ***** ***** ****** on ** ***** **** of ***** *******.

***** ********* ***** ****, including 'Zipstream', '***** ******', '*.***+', 'Smart ****** **', *** others, *** **********, ***** implementations *** ********* ******* vary ************.

** **** *****, ** explain **** ***** ****** ******* to ** *** *** most ****** ***************, ********:

  • ******** ****** ***********, *-***** interval, *** *** **********
  • ***** ***** *****
  • ******* ***********
  • ******* *-***** ********/***
  • ******* ***
  • ****** *********** *******
  • *********** ***
  • ***/*** *************
  • ************ *******
  • **** **** ***************
  • ********* *****
  • ***** ***** *******

** ********** ****, *** must **** * **** understanding ** ******, *********** and ********* **********. ****** first ****** ***: 

'******' ******, **** '*******' H.264, *** *** *********** level, *** * ***** interval, *** *** ***** rate. '*****' ****** ****** ***, two, ** *** ** *****, reviewed ******.

[***************]

"Normal" Codec ******

** ****** ******, ***** key ********** *** ********* set ** ***** ******:

  • *********** ***** (********* ****** quality ** ************)
  • * ***** ******** (********* called *** ** ***)
  • ***** **** (***)

**** ** *** *** not ***** ** *****, they ***** **** ************* making ***** *** ********* on *** ******** (*.*., see ** ****** ************ *********** Comparison).

Fixed *********** *******

'******' ****** *** * single *********** ***** *** the ****** *****, ********** of **** ** ***** displayed. *** *******, ** ** look ** * ***** of * *******, **** the ****** ******* ** well ** *** ****** walls, *****, ****, *** other ********** ***** **** be ********** ** *** same ***** ** **** frame:

Fixed *-***** ******** *******

*** **** *********** ********** between *****'* ****** (*.***/*.***) and ******* ****** **** MJPEG ** **** **** do *** **** *** 'same' ***** **** *** over *****. *******, * single **** ***** ** sent (****** ** '*-*****'), followed ** **** ***** updates ** *** ***** of *** ***** ***** have *******, ****** '*-******.' In ******** ******, *** *-***** ******** is *****. **** ***** that *** ****** **** always ******** ** * frame ************, **** ******** 1 ******. ** **** scenario, ** *** ****** is ** ***, ** will **** * *-***** followed ** ** *-****** and **** ******.

*** ******** ** * fixed *-***** ******** ** that *** ******** ** the ***** *** ****. Sometimes * ******* *** be ***** *** ** hour. ****** *** '*****' time, ******* ** * frame **** *** ****** is ********. ******** **** * frames ******* *** **** bandwidth **** * ******, often ** *** ***** of *** ****.

*** **** *** ***** of ****** **** *******, I ***** ******** ****** be ********* ** ****** artifacts *** ***** ****** (see****: *.*** * ** P ***** ******). 

 

Smart ***** **********:

****** ******* ******, ***** codecs dynamically ****** ***** **********, ***** a *********** ** ***** techniques:

  • ******* ***********:******* *********** ** ******* areas ** *** ***** instead ** *** ****** frame.
  • ******* *-***** ********:******* *-***** ******** ********* on ****** ** *** scene.
  • ******* *********:******* *** ********* ** motion ** *** *****.

** **** ** ***** in **** ****** *****.

******* ***********

*** ***** ********* **** is ******* ***********, ***** adjusts ************ ***** *** different ***** ** *** scene ***** ** ********. For *******, ******* ** setting *********** ** '******' for *** ***** *****, as ***** ** *** hallway ***** *****, *** camera ******* *********** ** the ****** ******* ** low (****** *******), ** maximize ******* *******, *** increases *********** ** ****** background *****.

** ********* *********** ****** for ***** ** *** scene, ** ** ******** to **** ****** ******* bandwidth ******** *** ********* quality ** ***** ***** matter ** **** ************* assigning *********** ****** ** relevant ***** ** *** scene.

Dynamic *-***** ********

******, ***** ****** *** adjust *-***** ******** ***** on ******** ** ******** in * *****. ** long ** *** ***** has ****** ** ******, the ****** *** **** ** I-frame ************ (*.*., ***** 5 ** ** ** 20 *******), *** ** soon ** *********** ******** is ********, ** *-***** is *********, **** *** interval **** ***** ** long ** ******** *********.

*** ***** ***** ***** analysis ** * ******** H.264 ****** ****** *** ***** dynamic *-***** ******** (***). While *** ******** ***** remains ***** ** ** interval ** **, *** dynamic *** ******, ********** to **** ** **** there ** ** ****** in *** *****. **** that **** ******* ***** below **** ** ***.

***** ******* *-***** ******** **** not ******* *******, ******* ****** remain *********** *** ****, while ************* ******** *********. In *** *****, ******* GOP ** *** ******* driver ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** included ******* ***, ****** '****** ***** *********' *** ******* *****, its ************ ** ** cameras ** **** ******. Like *-***** ********, ******* FPS ******* ******* ** simply ******* ***** ****** when ***** ** ** activity ** *** *****. 

***** **** *** *********** reduce ******* (********* ***** 10 **/* *** ******** in *** *****), ***** should ****** ** ******** frame **** ** **** moving ******* *** ** missed ** **** *****, such ** ******** ** highway *****, ******* ******** in ***** *****, ***. Additionally, ** **** ***** regulations *** ******** **** frame **** *********.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** to *** ***** ***** as ********** *** **********. This *** ****** ******* in **** ***** *** introduces ********** ***** ******** to ***** ******:

  • ************* **** ***********:** ******* *** *** carefully *** ***** ** actual *** ** *** area ***** ********, ****** objects *** **** **** higher *********** "**********" *****, potentially ****** ****** *******.
  • ******** ******** ** ********** change: ** *** ***** *******, users **** ******** ****** their ****** ******* ** properly ******* *** ** the *****. ** ********** is ******** **** ***** smart ******.

Related ***** **********: ***** *********

****** ****** **** ******* with ******* *****, ****** in *** ***** ******. This ***** '*****' ****** the ****** *** ********* tricks ******** **** ******** it ** **** ********. Because *** ****** ******** it ** ********, ** takes **** ********* (***** a *** **** *********). See **** / *** *** Video ************ *****

************ ******* *** ****** intelligence ** *********** ******* real ******** (* ****** walking, * *** *******, etc.) *** ******* ***** which *** ****** ********* significantly. *** ****, *** our ****** *** (******* ***** Reduction) *****.

Works **** ******** *****/****

******* ***** ****** **** within *** ******** ********* of *.***/*.***, ********** ******* is ********* *** ******** by ***** *** ****, in ******** ** **** specialized ****** ***** ***** to ****** ********* (**** as******* ***** ** ******* ********' *******) *** ******* ****** integration.

**** ***** *** ********** issues **** ***** ******** or ******* *** *******, but **** *** ********** have ******** ******* ***** smart ******' ************ *** removed ***** ******.

Manufacturer ****** *******

******* *********, **** ******* a ****** ****** *** ******* compression ******, **** *** mean ** ******* **** it ****** *** ***** I-frame ********* ** ******* FPS. **** ******* **** support *** ** *** three (**** ******** ******* compression), ***** ****** ******* all *****.

*** ***** ***** ******* which ************* ******* ***** smart ***** ********:

Manufacturer *********** ******

**** *** ****** * number ** ***** *************** including:

**** *****, ** **** found * *** *** points:

  • ***** * ***** ******** had *** ******* ******, with **%+ ******* ******, simply ******* **** ************ scenes *** ****** *** long **** *******, ******** great ******* **** **** I ******.
  • ******* ***** *********** *** the **** ******* ******, though ** **** ***** bandwidth *******.
  • ***** ***** *********** *** the ***** ******, ***** at **** **-**% *******, because ** ****** ** what ***** ** ******.

Bandwidth ***** ** **** ****** ******

****** ***** ****** *** greatly ****** ********** *******, ***** ****** ****** **** calculating ********* ***** ** high ****** ****** *** see ****** ** ** savings **** ***** ******** codecs. *** *******, ** a **** ****** ******* scene, ******** ** ****, Panasonic, *** ********* ******* were **** ***** **** with ***** ****** ******** during ******* ** **** motion, *.*., ***** *******:

*******, ** *******, ********** for **** ***** ******* and **** ******* ******* across ******* *******, ******* were ***** ** **% on *** *******.

******* ***** ****** *** have ****** ****** ** high ****** *******, ********* needs **** ** ********** for ***** **** ********, *** *******, ******** ***** ***** savings. ******* ** ** so ***** ************ *** drop ******** ** ***** links ** ******** *******.

Smart ***** *******

** ****, ****** *** major ************* ******* ***** codecs ** ** ***** some ** ***** *******, with **** ************ **** in *** ******** ** their ****. ***** ******* them, ** ***** ***** techniques (**** ** ********* DNR ** ******** ***** *****) will ** ** * significant ************ ****** *******.

******* ****** ********** ***** will ******** ** ********, and ******* *** ********* benefits are so ***********, ** ****** ******** to ***** ***** ****** and ** ******* *** intelligence ** ***** ********* for ******* *******, *** combine **** **** *.*** as *** ***** ***** mainstream **********.

Comments (19)

Undisclosed #1

07/23/15 12:25pm

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

John Honovich

IPVM | In reply to Undisclosed #1 | 07/23/15 01:19pm

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

John Honovich

IPVM | 09/29/15 12:14am

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

Undisclosed #2

08/24/16 06:51pm

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

Undisclosed Manufacturer #3

In reply to Undisclosed #2 | 08/24/16 08:01pm

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

Undisclosed #2

In reply to Undisclosed Manufacturer #3 | 08/24/16 08:48pm

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

Undisclosed Integrator #4

12/21/16 01:53am

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

 

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

Avatar

Ethan Ace

IPVM | In reply to Undisclosed Integrator #4 | 12/21/16 02:08am

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

Undisclosed Integrator #4

In reply to Ethan Ace | 12/21/16 02:37am

its one of the Top 5 VMS's, Cam side VMD.

Undisclosed #2

In reply to Undisclosed Integrator #4 | 12/21/16 02:43am

If its Cam side VMD then it's not the VMSes fault, right?

Undisclosed Integrator #4

In reply to Undisclosed #2 | 12/21/16 02:52am

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare. 

 

The more it's discussed the more questions arise on the technicalities. 

I am trying bench test a similar cam but have. It had a chance to do so. 

Undisclosed #2

In reply to Undisclosed Integrator #4 | 12/21/16 03:01am

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in?  What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

Undisclosed Integrator #4

In reply to Undisclosed #2 | 12/21/16 03:05am

We believe that is precisely what happened. GOP  length was get to ~300.

I think pre/Post was set to 15 Seconds

Undisclosed End User #5

05/20/18 03:59pm

Good write-up.

Undisclosed End User #5

05/27/18 02:50pm

A great write-up.

Undisclosed #6

11/19/18 11:28am

Good to know about the CODEC guide.

Avatar

Juan Banda

07/30/19 05:58am

The Surveillance Codec Guide link mentioned above in this page doesn't work.

Sorry, but the page you were trying to view does not exist.

It looks like this was the result of either:

  • a mistyped address
  • an out-of-date link
Avatar

John Scanlan

IPVM | IPVMU Certified | In reply to Juan Banda | 07/30/19 01:16pm

Thanks for the heads up Juan.  The link to the Surveillance Codec Guide is now working.

Avatar

Juan Banda

07/30/19 06:16am

I highly enjoyed the Smart Codec Guide material presented here.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Installation Course - Last Chance - Register Now on Sep 12, 2019
Last Chance - Register Now - September 2019 Video Surveillance Install Course. Thursday, September 12th is your last chance to register for the...
Fingerprints for Access Control Guide on Sep 09, 2019
Users can lose badges, but they never misplace a finger, right? The most common biometric used in access are fingerprints, and it has become one...
Genetec Stratocast VSaaS Tested on Sep 05, 2019
The VSaaS market is rapidly expanding in 2019, with Verkada, Meraki, Eagle Eye, Avigilon and numerous startups growing their market share. When we...
Mobotix First CNPP CCTV Cybersecurity Certification Examined on Sep 05, 2019
Mobotix recently became the first video surveillance manufacturer to receive the CNPP cybsersecurity certification for its cameras, in which they...
Register Now - October 2019 IP Networking Course on Aug 28, 2019
Register now for the Fall 2019 IP Networking Course. This is the only networking course designed specifically for video surveillance...
Mobile Access Control Guide on Aug 28, 2019
One of the biggest trends in access for the last few years has been the marriage of mobile phones and access cards. But how does this...
UK Facewatch GDPR Compliance Questioned on Aug 27, 2019
Even as the GDPR strictly regulates biometrics, a UK company called Facewatch is selling anti-shoplifter facial recognition systems to hundreds of...
Dahua 4K Camera Shootout on Aug 20, 2019
Dahua's new Pro Series 4K N85CL5Z claims to "deliver superior images in all lighting and environmental conditions", but how does this compare to...
Biometrics Usage Statistics 2019 on Aug 13, 2019
Biometrics are commonly used in phones, but how frequently are they used for access? 150+ integrators told us how often they use biometrics,...

Most Recent Industry Reports

Directory of 68 Video Surveillance Startups on Sep 18, 2019
This directory provides a list of video surveillance startups to help you see and research what companies are new or not yet broadly known. 2019...
Uniview Prime Series 4K Camera Tested on Sep 18, 2019
Is the new Uniview 'Prime' better than the more expensive existing Uniview 'Pro'? In August, IPVM tested Uniview 4K 'Pro' but members advocated...
US Army Base To Buy Banned Honeywell Surveillance on Sep 17, 2019
The U.S. Army's Fort Gordon, home to their Cyber Center of Excellence, has issued a solicitation to purchase Honeywell products that are US...
Vivotek "Neural Network-Powered Detection Engine" Analytics Tested on Sep 17, 2019
Vivotek has released "a neural network-powered detection engine", named Smart Motion Detection, claiming that "swaying vegetation, vehicles passing...
Schmode is Back, Aims To Turn Boulder AI Into Giant on Sep 16, 2019
One of the most influential and controversial executives in the past decade is back. Bryan Schmode ascended and drove the hypergrowth of Avigilon...
Manufacturers Unhappy With Weak ASIS GSX 2019 And 2020 Shift on Sep 16, 2019
Manufacturers were generally unhappy with ASIS GSX, both for weak 2019 booth traffic and a scheduling shift for the 2020 show, according to a new...
How Cobalt Robotics May Disrupt Security on Sep 13, 2019
While security robots have largely become a joke over the last few years, one organization, Cobalt Robotics, has raised $50+ million from top US...
Panasonic 4K Camera Tested (WV-S2570L) on Sep 13, 2019
Panasonic has released their latest generation 4K dome, the WV-S2570L, claiming "Extreme image quality allows evidence to be captured even under...
ASIS GSX 2019 Final Show Report on Sep 12, 2019
IPVM went to Chicago for ASIS GSX 2019, with many exhibitors disappointed about traffic and the exhibitor schedule changing next year. However,...
Installation Course - Last Chance - Register Now on Sep 12, 2019
Last Chance - Register Now - September 2019 Video Surveillance Install Course. Thursday, September 12th is your last chance to register for the...

What IPVM Is

The world's leading authority on video surveillance, with 200,000+ visits monthly.

  • Articles on cameras, video analytics, VMS, and trends
  • Tests showing actual performance and problems
  • Courses in surveillance, access control, etc
  • Camera Calculator for designing systems

Dedicated To Independence

We're dedicated to staying independent and objective. We're the only industry source to refuse any and all advertisements, sponsorship, and consulting from manufacturers. Why?