Smart Codec Guide

Author: IPVM Team, Published on Nov 29, 2016

In 2018, smart codecs are now mainstream. Once seemingly a marketing buzzword, now the majority of manufacturers offer smart codecs on at least some of their cameras.

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.264+', 'Smart Stream II', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our:

'Normal' codecs, like 'regular' H.264, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

** ****, ***** ****** *** *** **********. **** ********* * marketing ********, *** *** ******** ** ************* ***** ***** ****** on ** ***** **** ** ***** *******.

***** ********* ***** ****, ********* '*********', '***** ******', '*.***+', '***** Stream **', *** ******, *** **********, ***** *************** *** ********* savings **** ************.

** **** *****, ** ******* **** ***** ****** ******* ** do *** *** **** ****** ***************, ********:

  • ******** ****** ***********, *-***** ********, *** *** **********
  • ***** ***** *****
  • ******* ***********
  • ******* *-***** ********/***
  • ******* ***
  • ****** *********** *******
  • *********** ***
  • ***/*** *************
  • ************ *******
  • **** **** ***************
  • ********* *****
  • ***** ***** *******

** ********** ****, *** **** **** * **** ************* ** codecs, *********** *** ********* **********. ****** ***** ****** ***:

'******' ******, **** '*******' *.***, *** *** *********** *****, *** I ***** ********, *** *** ***** ****. '*****' ****** ****** one, ***, ** *** ** *****, ******** ******.

[***************]

"Normal" ***** ******

** ****** ******, ***** *** ********** *** ********* *** ** fixed ******:

  • *********** ***** (********* ****** ******* ** ************)
  • * ***** ******** (********* ****** *** ** ***)
  • ***** **** (***)

**** ** *** *** *** ***** ** *****, **** ***** with ************* ****** ***** *** ********* ** *** ******** (*.*., see** ****** ************ *********** **********).

Fixed *********** *******

'******' ****** *** * ****** *********** ***** *** *** ****** video, ********** ** **** ** ***** *********. *** *******, ** we **** ** * ***** ** * *******, **** *** moving ******* ** **** ** *** ****** *****, *****, ****, and ***** ********** ***** **** ** ********** ** *** **** level ** **** *****:

Fixed *-***** ******** *******

*** **** *********** ********** ******* *****'* ****** (*.***/*.***) *** ******* codecs **** ***** ** **** **** ** *** **** *** 'same' ***** **** *** **** *****. *******, * ****** **** frame ** **** (****** ** '*-*****'), ******** ** **** ***** updates ** *** ***** ** *** ***** ***** **** *******, called '*-******.' ** ******** ******, *** *-***** ******** ** *****. This ***** **** *** ****** **** ****** ******** ** * frame ************, **** ******** * ******. ** **** ********, ** the ****** ** ** ***, ** **** **** * *-***** followed ** ** *-****** *** **** ******.

*** ******** ** * ***** *-***** ******** ** **** *** activity ** *** ***** *** ****. ********* * ******* *** be ***** *** ** ****. ****** *** '*****' ****, ******* an * ***** **** *** ****** ** ********. ******** **** I ****** ******* *** **** ********* **** * ******, ***** on *** ***** ** *** ****.

*** **** *** ***** ** ****** **** *******, * ***** interval ****** ** ********* ** ****** ********* *** ***** ****** (see****: *.*** * ** * ***** ******).

Smart ***** **********:

****** ******* ******, ***** ****** *********** ****** ***** **********, ***** a *********** ** ***** **********:

  • ******* ***********:******* *********** ** ******* ***** ** *** ***** ******* ** the ****** *****.
  • ******* *-***** ********:******* *-***** ******** ********* ** ****** ** *** *****.
  • ******* *********:******* *** ********* ** ****** ** *** *****.

** **** ** ***** ** **** ****** *****.

Dynamic ***********

*** ***** ********* **** ** ******* ***********, ***** ******* ************ level *** ********* ***** ** *** ***** ***** ** ********. For *******, ******* ** ******* *********** ** '******' *** *** whole *****, ** ***** ** *** ******* ***** *****, *** camera ******* *********** ** *** ****** ******* ** *** (****** quality), ** ******** ******* *******, *** ********* *********** ** ****** background *****.

** ********* *********** ****** *** ***** ** *** *****, ** is ******** ** **** ****** ******* ********* ******** *** ********* quality ** ***** ***** ****** ** **** ************* ********* *********** levels ** ******** ***** ** *** *****.

Dynamic *-***** ********

******, ***** ****** *** ****** *-***** ******** ***** ** ******** of ******** ** * *****. ** **** ** *** ***** has ****** ** ******, *** ****** *** **** ** *-***** infrequently (*.*., ***** * ** ** ** ** *******), *** as **** ** *********** ******** ** ********, ** *-***** ** generated, **** *** ******** **** ***** ** **** ** ******** continues.

*** ***** ***** ***** ******** ** * ******** *.*** ****** versus *** ***** ******* *-***** ******** (***). ***** *** ******** codec ******* ***** ** ** ******** ** **, *** ******* GOP ******, ********** ** **** ** **** ***** ** ** motion ** *** *****. **** **** **** ******* ***** ***** were ** ***.

***** ******* *-***** ******** **** *** ******* *******, ******* ****** remain *********** *** ****, ***** ************* ******** *********. ** *** tests, ******* *** ** *** ******* ****** ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** ******** ******* ***, ****** '****** ***** *********' *** ******* *****, *** ************ ** ** ******* ** more ******. **** *-***** ********, ******* *** ******* ******* ** simply ******* ***** ****** **** ***** ** ** ******** ** the *****.

***** **** *** *********** ****** ******* (********* ***** ** **/* was ******** ** *** *****), ***** ****** ****** ** ******** frame **** ** **** ****** ******* *** ** ****** ** rare *****, **** ** ******** ** ******* *****, ******* ******** in ***** *****, ***. ************, ** **** ***** *********** *** prohibit **** ***** **** *********.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** ** *** ***** ***** ** ********** and **********. **** *** ****** ******* ** **** ***** *** introduces ********** ***** ******** ** ***** ******:

  • ************* **** ***********:** ******* *** *** ********* *** ***** ** ****** *** of *** **** ***** ********, ****** ******* *** **** **** higher *********** "**********" *****, *********** ****** ****** *******.
  • ******** ******** ** ********** ******:** *** ***** *******, ***** **** ******** ****** ***** ****** regions ** ******** ******* *** ** *** *****. ** ********** is ******** **** ***** ***** ******.

Related ***** **********: ***** *********

****** ****** **** ******* **** ******* *****, ****** ** *** light ******. **** ***** '*****' ****** *** ****** *** ********* tricks ******** **** ******** ** ** **** ********. ******* *** camera ******** ** ** ********, ** ***** **** ********* (***** a *** **** *********). ******* / *** *** ***** ************ *****

************ ******* *** ****** ************ ** *********** ******* **** ******** (a ****** *******, * *** *******, ***.) *** ******* ***** which *** ****** ********* *************. *** ****, *** ********* *** (******* ***** *********) *****.

Works **** ******** *****/****

******* ***** ****** **** ****** *** ******** ********* ** *.***/*.***, additional ******* ** ********* *** ******** ** ***** *** ****, in ******** ** **** *********** ****** ***** ***** ** ****** bandwidth (**** ********* ************** ********' *******) *** ******* ****** ***********.

**** ***** *** ********** ****** **** ***** ******** ** ******* not *******, *** **** *** ********** **** ******** ******* ***** smart ******' ************ *** ******* ***** ******.

Manufacturer ****** *******

******* *********, **** ******* * ****** ****** *** ******* *********** levels, **** *** **** ** ******* **** ** ****** *** smart *-***** ********* ** ******* ***. **** ******* **** ******* one ** *** ***** (**** ******** ******* ***********), ***** ****** support *** *****.

*** ***** ***** ******* ***** ************* ******* ***** ***** ***** features:

Manufacturer *********** ******

**** *** ****** * ****** ** ***** *************** *********:

**** *****, ** **** ***** * *** *** ******:

  • ***** * ***** ******** *** *** ******* ******, **** **%+ savings ******, ****** ******* **** ************ ****** *** ****** *** long **** *******, ******** ***** ******* **** **** * ******.
  • ******* ***** *********** *** *** **** ******* ******, ****** ** much ***** ********* *******.
  • ***** ***** *********** *** *** ***** ******, ***** ** **** 10-20% *******, ******* ** ****** ** **** ***** ** ******.

Bandwidth ***** ** **** ****** ******

****** ***** ****** *** ******* ****** ********** *******, ***** ****** ****** **** *********** ********* ***** ** **** ****** scenes *** *** ****** ** ** ******* **** ***** ******** codecs. *** *******, ** * **** ****** ******* *****, ******** of ****, *********, *** ********* ******* **** **** ***** **** with ***** ****** ******** ****** ******* ** **** ******, *.*., heavy *******:

*******, ** *******, ********** *** **** ***** ******* *** **** traffic ******* ****** ******* *******, ******* **** ***** ** **% on *** *******.

******* ***** ****** *** **** ****** ****** ** **** ****** periods, ********* ***** **** ** ********** *** ***** **** ********,*** *******, ******** ***** ***** *******. ******* ** ** ** ***** oversaturate *** **** ******** ** ***** ***** ** ******** *******.

Smart ***** *******

** ****, ****** *** ***** ************* ******* ***** ****** ** at ***** **** ** ***** *******, **** **** ************ **** in *** ******** ** ***** ****. ***** ******* ****, ** using ***** ********** (**** ** ********* *** ** ******** ***** depth) **** ** ** * *********** ************ ****** *******.

******* ****** ********** ***** **** ******** ** ********, *** ******* the ********* ******** *** ** ***********, ** ****** ******** ** offer ***** ****** *** ** ******* *** ************ ** ***** processes *** ******* *******, *** ******* **** **** *.*** ** the ***** ***** ********** **********.

Comments (13)

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

its one of the Top 5 VMS's, Cam side VMD.

If its Cam side VMD then it's not the VMSes fault, right?

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

The more it's discussed the more questions arise on the technicalities.

I am trying bench test a similar cam but have. It had a chance to do so.

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in? What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

We believe that is precisely what happened. GOP length was get to ~300.

I think pre/Post was set to 15 Seconds

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

May 2018 Camera Course on Apr 20, 2018
Save $50 on early registration until this Thursday, the 26th. Register now (save $50) for the Spring 2018 Camera Course This is the only...
April 2018 IP Networking Course on Apr 19, 2018
This is the last chance to register for our IP Networking course. Register now. NEW - 2 sessions per class, 'day' and 'night' to give you double...
Rare Video Surveillance Fundraising - Verkada $15 Million on Apr 19, 2018
Fundraising in video surveillance (and the broader physical security market) has been poor recently. Highlights are few and far in between...
Key Control For Access Control Tutorial on Apr 16, 2018
End users spend thousands on advanced systems to keep themselves secure, but regularly neglect one of the lest expensive yet most important aspects...
GDPR For Video Surveillance Guide on Apr 12, 2018
The European Union’s General Data Protection Regulation (GDPR) comes into force on May 25, but there is much confusion and no clear guidelines on...
Axis Launches ~$100 HD Camera on Apr 11, 2018
Chinese manufacturers, led by Hikvision, have come to dominate the low end of the Western market, driven by ~$100 cameras. While Axis has...
ISC West 2018 Access Control Rundown on Apr 06, 2018
For ISC West 2018, what is new and interesting in access control?  This rundown will bring you up to speed on the exhibitors, what they are...
Forced Door Alarms For Access Control Tutorial on Apr 04, 2018
One of the most important access control alarms is also often ignored. "Forced Door" provides a vital and even critical notification against...
The 5 Major Lock Profiles Guide - Euro, Oval, KIK, Interchangeable Core, Mortise on Apr 03, 2018
Locks are used everywhere, but they are not all the same. In fact, even the shape of the lock changes, sometimes for no other reason than...
Wireless Networking For Video Surveillance Guide on Mar 29, 2018
Wireless networking is a niche in video surveillance applications, but it can be a difficult one to understand with proper wireless design,...

Most Recent Industry Reports

The Yolo Bro And The Death of Journalism on Apr 24, 2018
There's an old quote: The job of the newspaper is to comfort the afflicted and afflict the comfortable Unfortunately, the opposite is more...
DMP Adds Ring Video Doorbell Integration on Apr 24, 2018
Video doorbells have become one of the hottest items for security systems. After several years with no doorbell, DMP has announced integration with...
Milestone 2017 Financials Examined on Apr 24, 2018
For ISC West 2018, Milestone released ... their financials, touting "strong revenue growth in 2017". However, there were discrepancies with the...
Chinese Manufacturer Kickstarter Campaign Huge Success (EverCam) on Apr 23, 2018
In a week, a Chinese manufacturer's expertly done Kickstarter campaign has received $1.4 million in pledges, an incredible amount for a video...
Favorite Biometrics 2018 on Apr 23, 2018
Biometrics are on the rise, or at least integrator opposition to them is declining, according to new IPVM integrator statistics.   Almost half of...
Dahua and Hikvision Win Over $1 Billion In Government-Backed Projects In Xinjiang on Apr 23, 2018
Dahua and Hikvision have won well over $1 billion worth of government-backed surveillance projects in China’s restive Xinjiang province since 2016,...
May 2018 Camera Course on Apr 20, 2018
Save $50 on early registration until this Thursday, the 26th. Register now (save $50) for the Spring 2018 Camera Course This is the only...
Global Real-Time Video Surveillance - EarthNow on Apr 20, 2018
A new company, EarthNow, with backing from Bill Gates, Airbus and more, is claiming that: Users will be able to see places on Earth with a delay...
Dedicated Vs Converged Access Control Networks (Statistics) on Apr 20, 2018
Running one's access control system on a converged network, with one's computers and phones, can save money. On the other hand, hand, doing so can...
April 2018 IP Networking Course on Apr 19, 2018
This is the last chance to register for our IP Networking course. Register now. NEW - 2 sessions per class, 'day' and 'night' to give you double...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact