Smart Codec Guide

Last Updated Dec 13, 2022 19:10 PM

"Smart Codec" was once seemingly a marketing buzzword, but in 2023, almost all new camera models include this technology.

IPVM Image

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.265+', 'Smart Stream III', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our:

'Normal' codecs, like 'regular' H.265, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

"Normal" ***** ******

** ****** ******, ***** *** ********** are ********* *** ** ***** ******:

  • *********** ***** (********* ****** ******* ** quantization)
  • * ***** ******** (********* ****** *** or ***)
  • ***** **** (***)

**** ** *** *** *** ***** of *****, **** ***** **** ************* making ***** *** ********* ** *** defaults (*.*., ***** ****** ************ *********** **********).

Fixed *********** *******

'******' ****** *** * ****** *********** level *** *** ****** *****, ********** of **** ** ***** *********. *** example, ** ** **** ** * scene ** * *******, **** *** moving ******* ** **** ** *** static *****, *****, ****, *** ***** background ***** **** ** ********** ** the **** ***** ** **** *****:

IPVM Image

Fixed *-***** ******** *******

*** **** *********** ********** ******* *****'* codecs (*.***/*.***) *** ******* ****** **** MJPEG ** **** **** ** *** send *** '****' ***** **** *** over *****. *******, * ****** **** frame ** **** (****** ** '*-*****'), followed ** **** ***** ******* ** the ***** ** *** ***** ***** have *******, ****** '*-******.' ** ******** codecs, *** *-***** ******** ** *****. This ***** **** *** ****** **** always ******** ** * ***** ************, most ******** * ******. ** **** scenario, ** *** ****** ** ** FPS, ** **** **** * *-***** followed ** ** *-****** *** **** repeat.

*** ******** ** * ***** *-***** interval ** **** *** ******** ** the ***** *** ****. ********* * hallway *** ** ***** *** ** hour. ****** *** '*****' ****, ******* an * ***** **** *** ****** is ********. ******** **** * ****** consume *** **** ********* **** * frames, ***** ** *** ***** ** 10x ****. *** **** ****** **** through, * ***** ******** ****** ** short ** ****** ********* *** ***** issues (*******: *.*** * ** * ***** Impact).

IPVM Image

Smart ***** **********:

****** ******* ******, ***** ****** *********** adjust ***** **********, ***** * *********** of ***** **********:

  • ******* ***********:******* *********** ** ******* ***** ** the ***** ******* ** *** ****** frame.
  • ******* *-***** ********:******* *-***** ******** ********* ** ****** in *** *****.
  • ******* *********:******* *** ********* ** ****** ** the *****.

** **** ** ***** ** **** detail *****.

Dynamic ***********

*** ***** ********* **** ** ******* compression, ***** ******* ************ ***** *** different ***** ** *** ***** ***** on ********. *** *******, ******* ** setting *********** ** '******' *** *** whole *****, ** ***** ** *** hallway ***** *****, *** ****** ******* compression ** *** ****** ******* ** low (****** *******), ** ******** ******* quality, *** ********* *********** ** ****** background *****.

IPVM Image

** ********* *********** ****** *** ***** of *** *****, ** ** ******** to **** ****** ******* ********* ******** and ********* ******* ** ***** ***** matter ** **** ************* ********* *********** levels ** ******** ***** ** *** scene.

Dynamic *-***** ********

******, ***** ****** *** ****** *-***** interval ***** ** ******** ** ******** in * *****. ** **** ** the ***** *** ****** ** ******, the ****** *** **** ** *-***** infrequently (*.*., ***** * ** ** or ** *******), *** ** **** as *********** ******** ** ********, ** I-frame ** *********, **** *** ******** kept ***** ** **** ** ******** continues.

*** ***** ***** ***** ******** ** a ******** *.*** ****** ****** *** using ******* *-***** ******** (***). ***** the ******** ***** ******* ***** ** an ******** ** **, *** ******* GOP ******, ********** ** **** ** when ***** ** ** ****** ** the *****. **** **** **** ******* shown ***** **** ** ***.

IPVM Image

***** ******* *-***** ******** **** *** improve *******, ******* ****** ****** *********** the ****, ***** ************* ******** *********. In *** *****, ******* *** ** the ******* ****** ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** ******** ******* FPS, ****** '****** ***** *********' *** ******* *****, *** ************ in ** ******* ** **** ******. Like *-***** ********, ******* *** ******* bitrate ** ****** ******* ***** ****** when ***** ** ** ******** ** the *****.

IPVM Image

***** **** *** *********** ****** ******* (bandwidth ***** ** **/* *** ******** in *** *****), ***** ****** ****** of ******** ***** **** ** **** moving ******* *** ** ****** ** rare *****, **** ** ******** ** highway *****, ******* ******** ** ***** areas, ***. ************, ** **** ***** regulations *** ******** **** ***** **** reduction.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** ** *** fixed ***** ** ********** *** **********. This *** ****** ******* ** **** cases *** ********** ********** ***** ******** to ***** ******:

  • ************* **** ***********:** ******* *** *** ********* *** based ** ****** *** ** *** area ***** ********, ****** ******* *** move **** ****** *********** "**********" *****, potentially ****** ****** *******.
  • ******** ******** ** ********** ******:** *** ***** *******, ***** **** manually ****** ***** ****** ******* ** properly ******* *** ** *** *****. No ********** ** ******** **** ***** smart ******.

Related ***** **********: ***** *********

****** ****** **** ******* **** ******* noise, ****** ** *** ***** ******. This ***** '*****' ****** *** ****** and ********* ****** ******** **** ******** it ** **** ********. ******* *** camera ******** ** ** ********, ** takes **** ********* (***** * *** more *********). ******* / *** *** ***** ************ Guide

************ ******* *** ****** ************ ** distinguish ******* **** ******** (* ****** walking, * *** *******, ***.) *** visible ***** ***** *** ****** ********* significantly. *** ****, *** ********* *** (******* ***** *********) *****.

Works **** ******** *****/****

******* ***** ****** **** ****** *** standard ********* ** *.***/*.***, ********** ******* is ********* *** ******** ** ***** and ****, ** ******** ** **** specialized ****** ***** ***** ** ****** bandwidth (**** ********* ************** ********' *******) *** ******* ****** ***********.

**** ***** *** ********** ****** **** jumpy ******** ** ******* *** *******, but **** *** ********** **** ******** support ***** ***** ******' ************ *** removed ***** ******.

Manufacturer ****** *******

******* *********, **** ******* * ****** allows *** ******* *********** ******, **** not **** ** ******* **** ** allows *** ***** *-***** ********* ** dynamic ***. **** ******* **** ******* one ** *** ***** (**** ******** dynamic ***********), ***** ****** ******* *** three.

*** ***** ***** ******* ***** ************* support ***** ***** ***** ********:

IPVM Image

Manufacturer *********** ******

**** *** ****** * ****** ** these *************** *********:

**** *****, ** **** ***** * few *** ******:

  • ***** * ***** ******** *** *** biggest ******, **** **%+ ******* ******, simply ******* **** ************ ****** *** static *** **** **** *******, ******** great ******* **** **** * ******.
  • ******* ***** *********** *** *** **** biggest ******, ****** ** **** ***** bandwidth *******.
  • ***** ***** *********** *** *** ***** impact, ***** ** **** **-**% *******, because ** ****** ** **** ***** to ******.

Bandwidth ***** ** ****-****** ******

****** ***** ****** *** ******* ****** bitrates** *******, ***** ****** ****** **** *********** ********* needs ** ****-****** ****** *** *** little ** ** ******* **** ***** advanced ******. *** *******, ** * high-motion ******* *****, ******** ** ****, Panasonic, *** ********* ******* **** **** those **** **** ***** ****** ******** during ******* ** **** ******, *.*., heavy *******:

IPVM Image

*******, ** *******, ********** *** **** still ******* *** **** ******* ******* across ******* *******, ******* **** ***** to **% ** *** *******.

IPVM Image

******* ***** ****** *** **** ****** effect ** **** ****** *******, ********* needs **** ** ********** *** *****-**** bitrates,*** *******, ******** ***** ***** *******. ******* to ** ** ***** ************ *** drop ******** ** ***** ***** ** overload ******* *** *******.

Smart ***** *******

** ****, ****** *** ***** ************* include ***** ****** ** ** ***** some ** ***** *******, **** **** implementing **** ** *** ******** ** their ****. ***** ******* ****, ** using ***** ********** ** ****** ********* (such ** ********* *** ** ******** color *****) **** ** ** * significant ************ ****** *******.

******* ** **** **** ************, ********** usage *** ******. ** *** ****** surveys, *********** ********* **** **%+ ** new ******* *** ***** ******, **** slightly ***** *** ***** **** ******, but ***** * ***** ******** ** cameras:

*** *** *********** ***** ***** ************* *******.

Comments (21)
U
Undisclosed #1
Jul 23, 2015

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

JH
John Honovich
Jul 23, 2015
IPVM

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

JH
John Honovich
Sep 29, 2015
IPVM

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

U
Undisclosed #2
Aug 24, 2016
IPVMU Certified

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

UM
Undisclosed Manufacturer #3
Aug 24, 2016

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

U
Undisclosed #2
Aug 24, 2016
IPVMU Certified

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

UI
Undisclosed Integrator #4
Dec 21, 2016

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

 

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

Avatar
Ethan Ace
Dec 21, 2016

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

UI
Undisclosed Integrator #4
Dec 21, 2016

its one of the Top 5 VMS's, Cam side VMD.

U
Undisclosed #2
Dec 21, 2016
IPVMU Certified

If its Cam side VMD then it's not the VMSes fault, right?

UI
Undisclosed Integrator #4
Dec 21, 2016

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare. 

 

The more it's discussed the more questions arise on the technicalities. 

I am trying bench test a similar cam but have. It had a chance to do so. 

U
Undisclosed #2
Dec 21, 2016
IPVMU Certified

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in?  What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

UI
Undisclosed Integrator #4
Dec 21, 2016

We believe that is precisely what happened. GOP  length was get to ~300.

I think pre/Post was set to 15 Seconds

UE
Undisclosed End User #5
May 20, 2018

Good write-up.

UE
Undisclosed End User #5
May 27, 2018

A great write-up.

U
Undisclosed #6
Nov 19, 2018

Good to know about the CODEC guide.

Avatar
Juan Banda
Jul 30, 2019
IPVMU Certified

The Surveillance Codec Guide link mentioned above in this page doesn't work.

Sorry, but the page you were trying to view does not exist.

It looks like this was the result of either:

  • a mistyped address
  • an out-of-date link
(1)
Avatar
John Scanlan
Jul 30, 2019
IPVM • IPVMU Certified

Thanks for the heads up Juan.  The link to the Surveillance Codec Guide is now working.

Avatar
Juan Banda
Jul 30, 2019
IPVMU Certified

I highly enjoyed the Smart Codec Guide material presented here.

AS
Amitkumar Sirjusingh
Jan 04, 2021

Just like proper gain control smart codecs is another 'smart' initiative meant to reduce network traffic while optimizing video streaming. Hopefully, as the technology matures cameras will be able to decipher noise from movement to reduce unneeded bandwidth consumption.

AS
Amitkumar Sirjusingh
Jan 22, 2021

Do smart codecs work as intended in 'high traffic' environments such as highways and malls? or is the hype by manufacturers unrealistic?