Smart Codec Guide

Author: IPVM Team, Published on Nov 29, 2016

In 2018, smart codecs are now mainstream. Once seemingly a marketing buzzword, now the majority of manufacturers offer smart codecs on at least some of their cameras.

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.264+', 'Smart Stream II', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our:

'Normal' codecs, like 'regular' H.264, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

** ****, ***** ****** *** *** **********. **** ********* * marketing ********, *** *** ******** ** ************* ***** ***** ****** on ** ***** **** ** ***** *******.

***** ********* ***** ****, ********* '*********', '***** ******', '*.***+', '***** Stream **', *** ******, *** **********, ***** *************** *** ********* savings **** ************.

** **** *****, ** ******* **** ***** ****** ******* ** do *** *** **** ****** ***************, ********:

  • ******** ****** ***********, *-***** ********, *** *** **********
  • ***** ***** *****
  • ******* ***********
  • ******* *-***** ********/***
  • ******* ***
  • ****** *********** *******
  • *********** ***
  • ***/*** *************
  • ************ *******
  • **** **** ***************
  • ********* *****
  • ***** ***** *******

** ********** ****, *** **** **** * **** ************* ** codecs, *********** *** ********* **********. ****** ***** ****** ***:

'******' ******, **** '*******' *.***, *** *** *********** *****, *** I ***** ********, *** *** ***** ****. '*****' ****** ****** one, ***, ** *** ** *****, ******** ******.

[***************]

"Normal" ***** ******

** ****** ******, ***** *** ********** *** ********* *** ** fixed ******:

  • *********** ***** (********* ****** ******* ** ************)
  • * ***** ******** (********* ****** *** ** ***)
  • ***** **** (***)

**** ** *** *** *** ***** ** *****, **** ***** with ************* ****** ***** *** ********* ** *** ******** (*.*., see** ****** ************ *********** **********).

Fixed *********** *******

'******' ****** *** * ****** *********** ***** *** *** ****** video, ********** ** **** ** ***** *********. *** *******, ** we **** ** * ***** ** * *******, **** *** moving ******* ** **** ** *** ****** *****, *****, ****, and ***** ********** ***** **** ** ********** ** *** **** level ** **** *****:

Fixed *-***** ******** *******

*** **** *********** ********** ******* *****'* ****** (*.***/*.***) *** ******* codecs **** ***** ** **** **** ** *** **** *** 'same' ***** **** *** **** *****. *******, * ****** **** frame ** **** (****** ** '*-*****'), ******** ** **** ***** updates ** *** ***** ** *** ***** ***** **** *******, called '*-******.' ** ******** ******, *** *-***** ******** ** *****. This ***** **** *** ****** **** ****** ******** ** * frame ************, **** ******** * ******. ** **** ********, ** the ****** ** ** ***, ** **** **** * *-***** followed ** ** *-****** *** **** ******.

*** ******** ** * ***** *-***** ******** ** **** *** activity ** *** ***** *** ****. ********* * ******* *** be ***** *** ** ****. ****** *** '*****' ****, ******* an * ***** **** *** ****** ** ********. ******** **** I ****** ******* *** **** ********* **** * ******, ***** on *** ***** ** *** ****.

*** **** *** ***** ** ****** **** *******, * ***** interval ****** ** ********* ** ****** ********* *** ***** ****** (see****: *.*** * ** * ***** ******).

Smart ***** **********:

****** ******* ******, ***** ****** *********** ****** ***** **********, ***** a *********** ** ***** **********:

  • ******* ***********:******* *********** ** ******* ***** ** *** ***** ******* ** the ****** *****.
  • ******* *-***** ********:******* *-***** ******** ********* ** ****** ** *** *****.
  • ******* *********:******* *** ********* ** ****** ** *** *****.

** **** ** ***** ** **** ****** *****.

Dynamic ***********

*** ***** ********* **** ** ******* ***********, ***** ******* ************ level *** ********* ***** ** *** ***** ***** ** ********. For *******, ******* ** ******* *********** ** '******' *** *** whole *****, ** ***** ** *** ******* ***** *****, *** camera ******* *********** ** *** ****** ******* ** *** (****** quality), ** ******** ******* *******, *** ********* *********** ** ****** background *****.

** ********* *********** ****** *** ***** ** *** *****, ** is ******** ** **** ****** ******* ********* ******** *** ********* quality ** ***** ***** ****** ** **** ************* ********* *********** levels ** ******** ***** ** *** *****.

Dynamic *-***** ********

******, ***** ****** *** ****** *-***** ******** ***** ** ******** of ******** ** * *****. ** **** ** *** ***** has ****** ** ******, *** ****** *** **** ** *-***** infrequently (*.*., ***** * ** ** ** ** *******), *** as **** ** *********** ******** ** ********, ** *-***** ** generated, **** *** ******** **** ***** ** **** ** ******** continues.

*** ***** ***** ***** ******** ** * ******** *.*** ****** versus *** ***** ******* *-***** ******** (***). ***** *** ******** codec ******* ***** ** ** ******** ** **, *** ******* GOP ******, ********** ** **** ** **** ***** ** ** motion ** *** *****. **** **** **** ******* ***** ***** were ** ***.

***** ******* *-***** ******** **** *** ******* *******, ******* ****** remain *********** *** ****, ***** ************* ******** *********. ** *** tests, ******* *** ** *** ******* ****** ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** ******** ******* ***, ****** '****** ***** *********' *** ******* *****, *** ************ ** ** ******* ** more ******. **** *-***** ********, ******* *** ******* ******* ** simply ******* ***** ****** **** ***** ** ** ******** ** the *****.

***** **** *** *********** ****** ******* (********* ***** ** **/* was ******** ** *** *****), ***** ****** ****** ** ******** frame **** ** **** ****** ******* *** ** ****** ** rare *****, **** ** ******** ** ******* *****, ******* ******** in ***** *****, ***. ************, ** **** ***** *********** *** prohibit **** ***** **** *********.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** ** *** ***** ***** ** ********** and **********. **** *** ****** ******* ** **** ***** *** introduces ********** ***** ******** ** ***** ******:

  • ************* **** ***********:** ******* *** *** ********* *** ***** ** ****** *** of *** **** ***** ********, ****** ******* *** **** **** higher *********** "**********" *****, *********** ****** ****** *******.
  • ******** ******** ** ********** ******:** *** ***** *******, ***** **** ******** ****** ***** ****** regions ** ******** ******* *** ** *** *****. ** ********** is ******** **** ***** ***** ******.

Related ***** **********: ***** *********

****** ****** **** ******* **** ******* *****, ****** ** *** light ******. **** ***** '*****' ****** *** ****** *** ********* tricks ******** **** ******** ** ** **** ********. ******* *** camera ******** ** ** ********, ** ***** **** ********* (***** a *** **** *********). ******* / *** *** ***** ************ *****

************ ******* *** ****** ************ ** *********** ******* **** ******** (a ****** *******, * *** *******, ***.) *** ******* ***** which *** ****** ********* *************. *** ****, *** ********* *** (******* ***** *********) *****.

Works **** ******** *****/****

******* ***** ****** **** ****** *** ******** ********* ** *.***/*.***, additional ******* ** ********* *** ******** ** ***** *** ****, in ******** ** **** *********** ****** ***** ***** ** ****** bandwidth (**** ********* ************** ********' *******) *** ******* ****** ***********.

**** ***** *** ********** ****** **** ***** ******** ** ******* not *******, *** **** *** ********** **** ******** ******* ***** smart ******' ************ *** ******* ***** ******.

Manufacturer ****** *******

******* *********, **** ******* * ****** ****** *** ******* *********** levels, **** *** **** ** ******* **** ** ****** *** smart *-***** ********* ** ******* ***. **** ******* **** ******* one ** *** ***** (**** ******** ******* ***********), ***** ****** support *** *****.

*** ***** ***** ******* ***** ************* ******* ***** ***** ***** features:

Manufacturer *********** ******

**** *** ****** * ****** ** ***** *************** *********:

**** *****, ** **** ***** * *** *** ******:

  • ***** * ***** ******** *** *** ******* ******, **** **%+ savings ******, ****** ******* **** ************ ****** *** ****** *** long **** *******, ******** ***** ******* **** **** * ******.
  • ******* ***** *********** *** *** **** ******* ******, ****** ** much ***** ********* *******.
  • ***** ***** *********** *** *** ***** ******, ***** ** **** 10-20% *******, ******* ** ****** ** **** ***** ** ******.

Bandwidth ***** ** **** ****** ******

****** ***** ****** *** ******* ****** ********** *******, ***** ****** ****** **** *********** ********* ***** ** **** ****** scenes *** *** ****** ** ** ******* **** ***** ******** codecs. *** *******, ** * **** ****** ******* *****, ******** of ****, *********, *** ********* ******* **** **** ***** **** with ***** ****** ******** ****** ******* ** **** ******, *.*., heavy *******:

*******, ** *******, ********** *** **** ***** ******* *** **** traffic ******* ****** ******* *******, ******* **** ***** ** **% on *** *******.

******* ***** ****** *** **** ****** ****** ** **** ****** periods, ********* ***** **** ** ********** *** ***** **** ********,*** *******, ******** ***** ***** *******. ******* ** ** ** ***** oversaturate *** **** ******** ** ***** ***** ** ******** *******.

Smart ***** *******

** ****, ****** *** ***** ************* ******* ***** ****** ** at ***** **** ** ***** *******, **** **** ************ **** in *** ******** ** ***** ****. ***** ******* ****, ** using ***** ********** (**** ** ********* *** ** ******** ***** depth) **** ** ** * *********** ************ ****** *******.

******* ****** ********** ***** **** ******** ** ********, *** ******* the ********* ******** *** ** ***********, ** ****** ******** ** offer ***** ****** *** ** ******* *** ************ ** ***** processes *** ******* *******, *** ******* **** **** *.*** ** the ***** ***** ********** **********.

Comments (15)

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

its one of the Top 5 VMS's, Cam side VMD.

If its Cam side VMD then it's not the VMSes fault, right?

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

The more it's discussed the more questions arise on the technicalities.

I am trying bench test a similar cam but have. It had a chance to do so.

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in? What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

We believe that is precisely what happened. GOP length was get to ~300.

I think pre/Post was set to 15 Seconds

Good write-up.

A great write-up.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

Installing Dome Cameras Indoors Guide on Jul 16, 2018
IPVM is producing the definitive series on installing surveillance cameras. This entry covers one of the most common scenarios - installing dome...
Last Chance - July 2018 IP Networking Course on Jul 12, 2018
Registration ends today, Thursday. Register now. This is the only networking course designed specifically for video surveillance...
UK VSaaS Startup Ocucon on Jul 03, 2018
Decreasing exposure to fraudulent slip-and-fall insurance claims and lawsuits is one of the oldest selling points of video surveillance for retail....
GDPR For Access Control Guide on Jul 03, 2018
Electronic access control is common in businesses plus organizations are increasingly considering biometrics for access control. With GDPR coming...
Replacing / Switching Access Control Systems Guide on Jun 28, 2018
Ripping out and replacing access control systems is hard for important reasons. Because users typically hold on to access control systems for as...
2018 Mid-Year Surveillance Industry Guide on Jun 28, 2018
2018 has been an explosive year for the video surveillance industry, with the industry becoming a global political issue, with the expansion of...
OpenEye Apex VMS Tested on Jun 26, 2018
OpenEye is a US company, founded nearly 20 years ago. In the past few years, OpenEye has been one of a few VMS providers that have pivoted to being...
Installation Hardware for Video Surveillance - Indoor Fasteners on Jun 22, 2018
As part of our Installation for Video Surveillance series, in this note, we cover drywall anchors. A key part of installing security hardware is...
Axis Guardian - Cloud VMS And Alarm Monitoring - Released on Jun 19, 2018
Axis has struggled to deliver a cloud-based managed service video platform. Video service providers have utilized AVHS for over a decade, and have...
Four Major Outdoor Camera Install Problems on Jun 14, 2018
Over 140 integrators told us the top four camera installation mistakes that lead to unexpected problems and failures. Their comments often...

Most Recent Industry Reports

Amazon Ring Alarm System Tested on Jul 16, 2018
Amazon Ring is going to hurt traditional dealers, and especially ADT, new IPVM test results of Ring's Alarm system underscore. IPVM found that...
Hikvision Wins Chinese Government Forced Facial Recognition Project Across 967 Mosques on Jul 16, 2018
Hikvision has won a Chinese government tender which requires that facial recognition cameras be set up at the entrance of every single mosque...
Installing Dome Cameras Indoors Guide on Jul 16, 2018
IPVM is producing the definitive series on installing surveillance cameras. This entry covers one of the most common scenarios - installing dome...
Security Sales Course Summer 2018 on Jul 13, 2018
Based on member's interest, IPVM is offering a security sales course this summer. Register Now - IPVM Security Sales Course Summer 2018 This...
US Tariffs Hit China Video Surveillance on Jul 13, 2018
Chinese video surveillance products avoided tariffs for the first two rounds. Now, in the third round, many video surveillance products will be...
Last Chance - July 2018 IP Networking Course on Jul 12, 2018
Registration ends today, Thursday. Register now. This is the only networking course designed specifically for video surveillance...
4 Most Difficult Camera Installs (Statistics) on Jul 12, 2018
Heavy housings, cumbersome brackets, heavy ladders required, and tricky field of view requirements will cause difficulties no matter the camera...
Axis Perimeter Defender Video Analytics Tested on Jul 12, 2018
Axis 'high security' video analytics offering is Perimeter Defender, OEMed / developed with Digital Barriers. But how good is Perimeter Defender?...
Hikvision Fights Ban - Claims 'Red Scare', Hires 14 Term Ex-Congressman on Jul 11, 2018
Hikvision is fighting back against the House Bill Ban of their products. Hikvision has hired one of the biggest lobbying firms, led by a 14 term...
Arecont Acquisition By Costar on Jul 11, 2018
Arecont Vision acquisition by Costar Technologies has been approved by the court, concluding the bankruptcy process triggered by Arecont's...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact