Smart Codec Guide

Author: IPVM Team, Published on Feb 01, 2018

In 2018, smart codecs are now mainstream. Once seemingly a marketing buzzword, now the majority of manufacturers offer smart codecs on at least some of their cameras.

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.264+', 'Smart Stream II', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our:

'Normal' codecs, like 'regular' H.264, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

** ****, ***** ****** *** *** **********. **** ********* * marketing ********, *** *** ******** ** ************* ***** ***** ****** on ** ***** **** ** ***** *******.

***** ********* ***** ****, ********* '*********', '***** ******', '*.***+', '***** Stream **', *** ******, *** **********, ***** *************** *** ********* savings **** ************.

** **** *****, ** ******* **** ***** ****** ******* ** do *** *** **** ****** ***************, ********:

  • ******** ****** ***********, *-***** ********, *** *** **********
  • ***** ***** *****
  • ******* ***********
  • ******* *-***** ********/***
  • ******* ***
  • ****** *********** *******
  • *********** ***
  • ***/*** *************
  • ************ *******
  • **** **** ***************
  • ********* *****
  • ***** ***** *******

** ********** ****, *** **** **** * **** ************* ** codecs, *********** *** ********* **********. ****** ***** ****** ***:

'******' ******, **** '*******' *.***, *** *** *********** *****, *** I ***** ********, *** *** ***** ****. '*****' ****** ****** one, ***, ** *** ** *****, ******** ******.

[***************]

"Normal" ***** ******

** ****** ******, ***** *** ********** *** ********* *** ** fixed ******:

  • *********** ***** (********* ****** ******* ** ************)
  • * ***** ******** (********* ****** *** ** ***)
  • ***** **** (***)

**** ** *** *** *** ***** ** *****, **** ***** with ************* ****** ***** *** ********* ** *** ******** (*.*., see** ****** ************ *********** **********).

Fixed *********** *******

'******' ****** *** * ****** *********** ***** *** *** ****** video, ********** ** **** ** ***** *********. *** *******, ** we **** ** * ***** ** * *******, **** *** moving ******* ** **** ** *** ****** *****, *****, ****, and ***** ********** ***** **** ** ********** ** *** **** level ** **** *****:

Fixed *-***** ******** *******

*** **** *********** ********** ******* *****'* ****** (*.***/*.***) *** ******* codecs **** ***** ** **** **** ** *** **** *** 'same' ***** **** *** **** *****. *******, * ****** **** frame ** **** (****** ** '*-*****'), ******** ** **** ***** updates ** *** ***** ** *** ***** ***** **** *******, called '*-******.' ** ******** ******, *** *-***** ******** ** *****. This ***** **** *** ****** **** ****** ******** ** * frame ************, **** ******** * ******. ** **** ********, ** the ****** ** ** ***, ** **** **** * *-***** followed ** ** *-****** *** **** ******.

*** ******** ** * ***** *-***** ******** ** **** *** activity ** *** ***** *** ****. ********* * ******* *** be ***** *** ** ****. ****** *** '*****' ****, ******* an * ***** **** *** ****** ** ********. ******** **** I ****** ******* *** **** ********* **** * ******, ***** on *** ***** ** *** ****.

*** **** *** ***** ** ****** **** *******, * ***** interval ****** ** ********* ** ****** ********* *** ***** ****** (see****: *.*** * ** * ***** ******).

Smart ***** **********:

****** ******* ******, ***** ****** *********** ****** ***** **********, ***** a *********** ** ***** **********:

  • ******* ***********:******* *********** ** ******* ***** ** *** ***** ******* ** the ****** *****.
  • ******* *-***** ********:******* *-***** ******** ********* ** ****** ** *** *****.
  • ******* *********:******* *** ********* ** ****** ** *** *****.

** **** ** ***** ** **** ****** *****.

Dynamic ***********

*** ***** ********* **** ** ******* ***********, ***** ******* ************ level *** ********* ***** ** *** ***** ***** ** ********. For *******, ******* ** ******* *********** ** '******' *** *** whole *****, ** ***** ** *** ******* ***** *****, *** camera ******* *********** ** *** ****** ******* ** *** (****** quality), ** ******** ******* *******, *** ********* *********** ** ****** background *****.

** ********* *********** ****** *** ***** ** *** *****, ** is ******** ** **** ****** ******* ********* ******** *** ********* quality ** ***** ***** ****** ** **** ************* ********* *********** levels ** ******** ***** ** *** *****.

Dynamic *-***** ********

******, ***** ****** *** ****** *-***** ******** ***** ** ******** of ******** ** * *****. ** **** ** *** ***** has ****** ** ******, *** ****** *** **** ** *-***** infrequently (*.*., ***** * ** ** ** ** *******), *** as **** ** *********** ******** ** ********, ** *-***** ** generated, **** *** ******** **** ***** ** **** ** ******** continues.

*** ***** ***** ***** ******** ** * ******** *.*** ****** versus *** ***** ******* *-***** ******** (***). ***** *** ******** codec ******* ***** ** ** ******** ** **, *** ******* GOP ******, ********** ** **** ** **** ***** ** ** motion ** *** *****. **** **** **** ******* ***** ***** were ** ***.

***** ******* *-***** ******** **** *** ******* *******, ******* ****** remain *********** *** ****, ***** ************* ******** *********. ** *** tests, ******* *** ** *** ******* ****** ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** ******** ******* ***, ****** '****** ***** *********' *** ******* *****, *** ************ ** ** ******* ** more ******. **** *-***** ********, ******* *** ******* ******* ** simply ******* ***** ****** **** ***** ** ** ******** ** the *****.

***** **** *** *********** ****** ******* (********* ***** ** **/* was ******** ** *** *****), ***** ****** ****** ** ******** frame **** ** **** ****** ******* *** ** ****** ** rare *****, **** ** ******** ** ******* *****, ******* ******** in ***** *****, ***. ************, ** **** ***** *********** *** prohibit **** ***** **** *********.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** ** *** ***** ***** ** ********** and **********. **** *** ****** ******* ** **** ***** *** introduces ********** ***** ******** ** ***** ******:

  • ************* **** ***********:** ******* *** *** ********* *** ***** ** ****** *** of *** **** ***** ********, ****** ******* *** **** **** higher *********** "**********" *****, *********** ****** ****** *******.
  • ******** ******** ** ********** ******:** *** ***** *******, ***** **** ******** ****** ***** ****** regions ** ******** ******* *** ** *** *****. ** ********** is ******** **** ***** ***** ******.

Related ***** **********: ***** *********

****** ****** **** ******* **** ******* *****, ****** ** *** light ******. **** ***** '*****' ****** *** ****** *** ********* tricks ******** **** ******** ** ** **** ********. ******* *** camera ******** ** ** ********, ** ***** **** ********* (***** a *** **** *********). ******* / *** *** ***** ************ *****

************ ******* *** ****** ************ ** *********** ******* **** ******** (a ****** *******, * *** *******, ***.) *** ******* ***** which *** ****** ********* *************. *** ****, *** ********* *** (******* ***** *********) *****.

Works **** ******** *****/****

******* ***** ****** **** ****** *** ******** ********* ** *.***/*.***, additional ******* ** ********* *** ******** ** ***** *** ****, in ******** ** **** *********** ****** ***** ***** ** ****** bandwidth (**** ********* ************** ********' *******) *** ******* ****** ***********.

**** ***** *** ********** ****** **** ***** ******** ** ******* not *******, *** **** *** ********** **** ******** ******* ***** smart ******' ************ *** ******* ***** ******.

Manufacturer ****** *******

******* *********, **** ******* * ****** ****** *** ******* *********** levels, **** *** **** ** ******* **** ** ****** *** smart *-***** ********* ** ******* ***. **** ******* **** ******* one ** *** ***** (**** ******** ******* ***********), ***** ****** support *** *****.

*** ***** ***** ******* ***** ************* ******* ***** ***** ***** features:

Manufacturer *********** ******

**** *** ****** * ****** ** ***** *************** *********:

**** *****, ** **** ***** * *** *** ******:

  • ***** * ***** ******** *** *** ******* ******, **** **%+ savings ******, ****** ******* **** ************ ****** *** ****** *** long **** *******, ******** ***** ******* **** **** * ******.
  • ******* ***** *********** *** *** **** ******* ******, ****** ** much ***** ********* *******.
  • ***** ***** *********** *** *** ***** ******, ***** ** **** 10-20% *******, ******* ** ****** ** **** ***** ** ******.

Bandwidth ***** ** **** ****** ******

****** ***** ****** *** ******* ****** ********** *******, ***** ****** ****** **** *********** ********* ***** ** **** ****** scenes *** *** ****** ** ** ******* **** ***** ******** codecs. *** *******, ** * **** ****** ******* *****, ******** of ****, *********, *** ********* ******* **** **** ***** **** with ***** ****** ******** ****** ******* ** **** ******, *.*., heavy *******:

*******, ** *******, ********** *** **** ***** ******* *** **** traffic ******* ****** ******* *******, ******* **** ***** ** **% on *** *******.

******* ***** ****** *** **** ****** ****** ** **** ****** periods, ********* ***** **** ** ********** *** ***** **** ********,*** *******, ******** ***** ***** *******. ******* ** ** ** ***** oversaturate *** **** ******** ** ***** ***** ** ******** *******.

Smart ***** *******

** ****, ****** *** ***** ************* ******* ***** ****** ** at ***** **** ** ***** *******, **** **** ************ **** in *** ******** ** ***** ****. ***** ******* ****, ** using ***** ********** (**** ** ********* *** ** ******** ***** depth) **** ** ** * *********** ************ ****** *******.

******* ****** ********** ***** **** ******** ** ********, *** ******* the ********* ******** *** ** ***********, ** ****** ******** ** offer ***** ****** *** ** ******* *** ************ ** ***** processes *** ******* *******, *** ******* **** **** *.*** ** the ***** ***** ********** **********.

Comments (16)

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

its one of the Top 5 VMS's, Cam side VMD.

If its Cam side VMD then it's not the VMSes fault, right?

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

The more it's discussed the more questions arise on the technicalities.

I am trying bench test a similar cam but have. It had a chance to do so.

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in? What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

We believe that is precisely what happened. GOP length was get to ~300.

I think pre/Post was set to 15 Seconds

Good write-up.

A great write-up.

Good to know about the CODEC guide.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Mobile Surveillance Trailers Guide on Jan 17, 2019
Putting cameras in a place for temporary surveillance where power and communications are not readily available can be complicated and expensive....
Testing Bandwidth Vs. Low Light on Jan 16, 2019
Nighttime bandwidth spikes are a major concern in video surveillance. Many calculate bandwidth as a single 24/7 number, but bit rates vary...
Access Control Records Maintenance Guide on Jan 16, 2019
Weeding out old entries, turning off unused credentials, and updating who carries which credentials is as important as to maintaining security as...
Winter 2019 IP Networking Course on Jan 10, 2019
Today is the last day to register for the Winter 2019 IP Networking course. This is the only networking course designed specifically for video...
NTP / Network Time Guide For Video Surveillance on Jan 10, 2019
Inaccurate time can lead to missing or inadmissible video, yet this topic is often overlooked, with cameras and servers left defaulted,...
Managed Video Services UL 827B Examined on Jan 09, 2019
Historically, UL listings for central stations have been important, with UL 827 having widespread support. However, few central stations have...
UK: Private Video Surveillance Complaints Down Since GDPR on Jan 09, 2019
The arrival of the GDPR on May 25, 2018, brought fears the law would spark a massive increase in privacy complaints about security camera use....
H.265 / HEVC Codec Tutorial on Jan 08, 2019
H.265 support improved significantly in 2018, with H.265 camera/VMS compatibility increased compared to only a year ago, and most manufacturers...
2019 Video Surveillance Cameras Overview on Jan 07, 2019
Each year, IPVM summarizes the main advances and changes for video surveillance cameras, based on our industry-leading testing and...
Surveillance Codec Guide on Jan 03, 2019
Codecs are core to surveillance, with names like H.264, H.265, and MJPEG commonly cited. How do they work? Why should you use them? What issues may...

Most Recent Industry Reports

Cable Trenching for Surveillance on Jan 21, 2019
Trenching cable for surveillance is surprisingly complex. While using shovels, picks, and hoes is not advanced technology, the proper planning,...
Milestone Favorability Results 2019 on Jan 21, 2019
Milestone's favorability moderately strengthed, in new IPVM integrator statistics over their results from 2016. While the industry has been...
Intersec 2019 Live Day 1 - Massive China Presence on Jan 21, 2019
There’s a massive presence from Chinese or China-focused video surveillance firms, chiefly Hikvision, Dahua, Huawei, and Infinova, at...
The IP Camera Lock-In Trend: Meraki and Verkada on Jan 18, 2019
Open systems and interoperability have not only been big buzzwords over the past decade, but they have also become core features of video...
NYPD Refutes False SCMP Hikvision Story on Jan 18, 2019
The NYPD has refuted the SCMP Hikvision story, the Voice of America has reported. On January 11, 2018, the SCMP alleged that the NYPD was using...
Mobile Surveillance Trailers Guide on Jan 17, 2019
Putting cameras in a place for temporary surveillance where power and communications are not readily available can be complicated and expensive....
Exacq Favorability Results 2019 on Jan 17, 2019
Exacq favorability amongst integrators has declined sharply, in new IPVM statistics, compared to 2017 IPVM statistics for Exacq. Now, over 5 since...
Testing Bandwidth Vs. Low Light on Jan 16, 2019
Nighttime bandwidth spikes are a major concern in video surveillance. Many calculate bandwidth as a single 24/7 number, but bit rates vary...
Access Control Records Maintenance Guide on Jan 16, 2019
Weeding out old entries, turning off unused credentials, and updating who carries which credentials is as important as to maintaining security as...
UK Fines Security Firms For Illegal Direct Marketing on Jan 16, 2019
Two UK security firms have paid over $200,000 in fines for illegally making hundreds of thousands of calls to people registered on a government...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact