Smart Codec Guide

Author: IPVM Team, Published on Feb 01, 2018

In 2018, smart codecs are now mainstream. Once seemingly a marketing buzzword, now the majority of manufacturers offer smart codecs on at least some of their cameras.

These marketing names vary, including 'Zipstream', 'Smart Coding', 'H.264+', 'Smart Stream II', and others, and critically, these implementations and bandwidth savings vary dramatically.

In this Guide, we explain what smart codecs attempt to do and the most common implementations, covering:

  • Historic static compression, I-frame interval, and FPS techniques
  • Smart codec basic
  • Dynamic compression
  • Dynamic I-frame interval/GOP
  • Dynamic FPS
  • Static compression regions
  • Intelligent DNR
  • VMS/NVR compatibility
  • Manufacturer support
  • IPVM test recommendations
  • Bandwidth risks
  • Smart codec outlook

To understand this, you must have a good understanding of codecs, compression and bandwidth variations. Please first review our:

'Normal' codecs, like 'regular' H.264, set one compression level, one I frame interval, and one frame rate. 'Smart' codecs change one, two, or all of those, reviewed inside.

** ****, ***** ****** *** *** **********. **** ********* * marketing ********, *** *** ******** ** ************* ***** ***** ****** on ** ***** **** ** ***** *******.

***** ********* ***** ****, ********* '*********', '***** ******', '*.***+', '***** Stream **', *** ******, *** **********, ***** *************** *** ********* savings **** ************.

** **** *****, ** ******* **** ***** ****** ******* ** do *** *** **** ****** ***************, ********:

  • ******** ****** ***********, *-***** ********, *** *** **********
  • ***** ***** *****
  • ******* ***********
  • ******* *-***** ********/***
  • ******* ***
  • ****** *********** *******
  • *********** ***
  • ***/*** *************
  • ************ *******
  • **** **** ***************
  • ********* *****
  • ***** ***** *******

** ********** ****, *** **** **** * **** ************* ** codecs, *********** *** ********* **********. ****** ***** ****** ***:

'******' ******, **** '*******' *.***, *** *** *********** *****, *** I ***** ********, *** *** ***** ****. '*****' ****** ****** one, ***, ** *** ** *****, ******** ******.

[***************]

"Normal" ***** ******

** ****** ******, ***** *** ********** *** ********* *** ** fixed ******:

  • *********** ***** (********* ****** ******* ** ************)
  • * ***** ******** (********* ****** *** ** ***)
  • ***** **** (***)

**** ** *** *** *** ***** ** *****, **** ***** with ************* ****** ***** *** ********* ** *** ******** (*.*., see** ****** ************ *********** **********).

Fixed *********** *******

'******' ****** *** * ****** *********** ***** *** *** ****** video, ********** ** **** ** ***** *********. *** *******, ** we **** ** * ***** ** * *******, **** *** moving ******* ** **** ** *** ****** *****, *****, ****, and ***** ********** ***** **** ** ********** ** *** **** level ** **** *****:

Fixed *-***** ******** *******

*** **** *********** ********** ******* *****'* ****** (*.***/*.***) *** ******* codecs **** ***** ** **** **** ** *** **** *** 'same' ***** **** *** **** *****. *******, * ****** **** frame ** **** (****** ** '*-*****'), ******** ** **** ***** updates ** *** ***** ** *** ***** ***** **** *******, called '*-******.' ** ******** ******, *** *-***** ******** ** *****. This ***** **** *** ****** **** ****** ******** ** * frame ************, **** ******** * ******. ** **** ********, ** the ****** ** ** ***, ** **** **** * *-***** followed ** ** *-****** *** **** ******.

*** ******** ** * ***** *-***** ******** ** **** *** activity ** *** ***** *** ****. ********* * ******* *** be ***** *** ** ****. ****** *** '*****' ****, ******* an * ***** **** *** ****** ** ********. ******** **** I ****** ******* *** **** ********* **** * ******, ***** on *** ***** ** *** ****.

*** **** *** ***** ** ****** **** *******, * ***** interval ****** ** ********* ** ****** ********* *** ***** ****** (see****: *.*** * ** * ***** ******).

Smart ***** **********:

****** ******* ******, ***** ****** *********** ****** ***** **********, ***** a *********** ** ***** **********:

  • ******* ***********:******* *********** ** ******* ***** ** *** ***** ******* ** the ****** *****.
  • ******* *-***** ********:******* *-***** ******** ********* ** ****** ** *** *****.
  • ******* *********:******* *** ********* ** ****** ** *** *****.

** **** ** ***** ** **** ****** *****.

Dynamic ***********

*** ***** ********* **** ** ******* ***********, ***** ******* ************ level *** ********* ***** ** *** ***** ***** ** ********. For *******, ******* ** ******* *********** ** '******' *** *** whole *****, ** ***** ** *** ******* ***** *****, *** camera ******* *********** ** *** ****** ******* ** *** (****** quality), ** ******** ******* *******, *** ********* *********** ** ****** background *****.

** ********* *********** ****** *** ***** ** *** *****, ** is ******** ** **** ****** ******* ********* ******** *** ********* quality ** ***** ***** ****** ** **** ************* ********* *********** levels ** ******** ***** ** *** *****.

Dynamic *-***** ********

******, ***** ****** *** ****** *-***** ******** ***** ** ******** of ******** ** * *****. ** **** ** *** ***** has ****** ** ******, *** ****** *** **** ** *-***** infrequently (*.*., ***** * ** ** ** ** *******), *** as **** ** *********** ******** ** ********, ** *-***** ** generated, **** *** ******** **** ***** ** **** ** ******** continues.

*** ***** ***** ***** ******** ** * ******** *.*** ****** versus *** ***** ******* *-***** ******** (***). ***** *** ******** codec ******* ***** ** ** ******** ** **, *** ******* GOP ******, ********** ** **** ** **** ***** ** ** motion ** *** *****. **** **** **** ******* ***** ***** were ** ***.

***** ******* *-***** ******** **** *** ******* *******, ******* ****** remain *********** *** ****, ***** ************* ******** *********. ** *** tests, ******* *** ** *** ******* ****** ** ********* ******* in ***** ******.

Dynamic ***

****** **** *****/**** **** ******** ******* ***, ****** '****** ***** *********' *** ******* *****, *** ************ ** ** ******* ** more ******. **** *-***** ********, ******* *** ******* ******* ** simply ******* ***** ****** **** ***** ** ** ******** ** the *****.

***** **** *** *********** ****** ******* (********* ***** ** **/* was ******** ** *** *****), ***** ****** ****** ** ******** frame **** ** **** ****** ******* *** ** ****** ** rare *****, **** ** ******** ** ******* *****, ******* ******** in ***** *****, ***. ************, ** **** ***** *********** *** prohibit **** ***** **** *********.

Not-So-Smart: ****** *********** *******

**** ******* ***** ***** ** *** ***** ***** ** ********** and **********. **** *** ****** ******* ** **** ***** *** introduces ********** ***** ******** ** ***** ******:

  • ************* **** ***********:** ******* *** *** ********* *** ***** ** ****** *** of *** **** ***** ********, ****** ******* *** **** **** higher *********** "**********" *****, *********** ****** ****** *******.
  • ******** ******** ** ********** ******:** *** ***** *******, ***** **** ******** ****** ***** ****** regions ** ******** ******* *** ** *** *****. ** ********** is ******** **** ***** ***** ******.

Related ***** **********: ***** *********

****** ****** **** ******* **** ******* *****, ****** ** *** light ******. **** ***** '*****' ****** *** ****** *** ********* tricks ******** **** ******** ** ** **** ********. ******* *** camera ******** ** ** ********, ** ***** **** ********* (***** a *** **** *********). ******* / *** *** ***** ************ *****

************ ******* *** ****** ************ ** *********** ******* **** ******** (a ****** *******, * *** *******, ***.) *** ******* ***** which *** ****** ********* *************. *** ****, *** ********* *** (******* ***** *********) *****.

Works **** ******** *****/****

******* ***** ****** **** ****** *** ******** ********* ** *.***/*.***, additional ******* ** ********* *** ******** ** ***** *** ****, in ******** ** **** *********** ****** ***** ***** ** ****** bandwidth (**** ********* ************** ********' *******) *** ******* ****** ***********.

**** ***** *** ********** ****** **** ***** ******** ** ******* not *******, *** **** *** ********** **** ******** ******* ***** smart ******' ************ *** ******* ***** ******.

Manufacturer ****** *******

******* *********, **** ******* * ****** ****** *** ******* *********** levels, **** *** **** ** ******* **** ** ****** *** smart *-***** ********* ** ******* ***. **** ******* **** ******* one ** *** ***** (**** ******** ******* ***********), ***** ****** support *** *****.

*** ***** ***** ******* ***** ************* ******* ***** ***** ***** features:

Manufacturer *********** ******

**** *** ****** * ****** ** ***** *************** *********:

**** *****, ** **** ***** * *** *** ******:

  • ***** * ***** ******** *** *** ******* ******, **** **%+ savings ******, ****** ******* **** ************ ****** *** ****** *** long **** *******, ******** ***** ******* **** **** * ******.
  • ******* ***** *********** *** *** **** ******* ******, ****** ** much ***** ********* *******.
  • ***** ***** *********** *** *** ***** ******, ***** ** **** 10-20% *******, ******* ** ****** ** **** ***** ** ******.

Bandwidth ***** ** **** ****** ******

****** ***** ****** *** ******* ****** ********** *******, ***** ****** ****** **** *********** ********* ***** ** **** ****** scenes *** *** ****** ** ** ******* **** ***** ******** codecs. *** *******, ** * **** ****** ******* *****, ******** of ****, *********, *** ********* ******* **** **** ***** **** with ***** ****** ******** ****** ******* ** **** ******, *.*., heavy *******:

*******, ** *******, ********** *** **** ***** ******* *** **** traffic ******* ****** ******* *******, ******* **** ***** ** **% on *** *******.

******* ***** ****** *** **** ****** ****** ** **** ****** periods, ********* ***** **** ** ********** *** ***** **** ********,*** *******, ******** ***** ***** *******. ******* ** ** ** ***** oversaturate *** **** ******** ** ***** ***** ** ******** *******.

Smart ***** *******

** ****, ****** *** ***** ************* ******* ***** ****** ** at ***** **** ** ***** *******, **** **** ************ **** in *** ******** ** ***** ****. ***** ******* ****, ** using ***** ********** (**** ** ********* *** ** ******** ***** depth) **** ** ** * *********** ************ ****** *******.

******* ****** ********** ***** **** ******** ** ********, *** ******* the ********* ******** *** ** ***********, ** ****** ******** ** offer ***** ****** *** ** ******* *** ************ ** ***** processes *** ******* *******, *** ******* **** **** *.*** ** the ***** ***** ********** **********.

Comments (16)

What’s the impact of new smart CODECs on existing surveillance systems? Is the enhanced compression transparent to existing VMSs?

We have not seen any issues integrating with VMSes to date. The changes are primarily on the encoding / camera side with decoding remaining the same for the VMS.

Panasonic is now announcing 'smart coding technology'. Here is how they describe it:

"Smart Coding Technology that modifies the encoding compression algorithm in standard H.264 video streams, yielding up to 70 percent improvement in bandwidth reduction to reduce bandwidth has been released.
Available as a free firmware upgrade to all new Panasonic 3, 5 and 6 Series Models, the technology offers significant decreased overall bandwidth usage to effectively lessen the amount of storage needed for recorded images.
Smart Coding technology encoding deploys Group of Picture (GOP) Control; Frequency Divided Filter (FDF); and 3-D Multi-Process Noise Reduction (3D-MNR) to achieve a lower bit rate for recorded images without degrading the captured and transmitted video stream. Combined, these features can effectively provide a substantial bit rate reduction (the number of bits per second that can be transmitted along a digital network) in the recorded video."

We expect to see more and more manufacturers to do similar as the bandwidth benefits are obvious and significant.

Undiclosed Manufactuter brings up an interesting point here about switching between streams with a high GOP ratio:

To decode the current frame, the Client UI would have to decode the previous I-frame and all the subsequent p/b frames, and if the gap between I-frames is 5 to 8 seconds, this could be between 50 to 200 frames depending on the frame rate. I doubt the VMS would send these previous frames to reduce the delay, and will just expect the client to wait. Keep in mind that traditionally, I-frames are every second or two so the wait is not normally that long. Again, smart codecs can cause the delay to be much longer in some cases - it is the price you pay for increased storage...

When using a VMS to switch between streams have you noticed any unusually long delays? If UM is right, one might be waiting 20 seconds before seeing a live picture, which might be considered unacceptable by many.

Some Cameras & VMS allow for I-Frame insertion request to be sent to demand an I-Frame immediately. This can mitigate waiting 200+ frames for the next regularly scheduled I-Frame.

Is this an out-of-band request that operates on an existing RTSP stream, or is this made when creating a new socket?

We had a site where we installed a brand new Q6000 + Q60 PTZ and decided to try Dynamic GOP on the VMS. We leaned the hard way that VMD does not work when your I-frame interval is too high, we had an incident and no video because there where not enough frames to compare for VMD to kick off recording.

Dynamic GOP is great for continuous recording but be very careful on motion based recording.

That's a terrible side effect! What VMS were you using? Server side or camera side VMD?

its one of the Top 5 VMS's, Cam side VMD.

If its Cam side VMD then it's not the VMSes fault, right?

It's hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

The more it's discussed the more questions arise on the technicalities.

I am trying bench test a similar cam but have. It had a chance to do so.

Its hard to say. Because the cam is doing the detection but the VMS is getting the metadata to tell it to records. It still needs to get enough frames to compare.

so maybe the I-frame associated with the P-frames that have motion in them has already been discarded by the VMS when the meta-data comes in? What was the pre-record amount set to?

Maybe you can set that to a large enough value to cover the GOP length.

We believe that is precisely what happened. GOP length was get to ~300.

I think pre/Post was set to 15 Seconds

Good write-up.

A great write-up.

Good to know about the CODEC guide.

Login to read this IPVM report.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

Related Reports

French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...
Video Surveillance Hard Drive Size Statistics 2018 on Nov 08, 2018
What is the most common hard drive size for video surveillance? 150+ integrators answered: What size hard drive do you most commonly use? What...
Kogniz Silicon Valley AI Startup Profile on Nov 07, 2018
Kogniz is a Silicon Valley company that aims to bring AI analytics to security and surveillance, centering on their own smart cameras: We spoke...
Dahua Dual Imager Dome Camera Tested (HDBW4231FN-E2-M) on Nov 07, 2018
Dahua has introduced a dual-imager dome model, the HDBW4231FN-E2-M, with two independently positionable sensors including integrated IR, not found...
Favorite Video Surveillance Hard Drive Manufacturer 2018 on Nov 06, 2018
Who is the favorite hard drive for video surveillance use? 150+ integrators answered: What is your preferred brand/model of hard drive for...
Winter 2019 IP Networking Course on Nov 05, 2018
This is the only networking course designed specifically for video surveillance professionals.  Lots of network training exists but none of it...
HID: Stop Selling Cracked 125 kHz Credentials on Nov 05, 2018
HID should stop selling cracked 125 kHz access control credentials, that have been long cracked and can easily be copied by cheap cloners sold on...
Video Surveillance Hard Drive Failure Statistics 2018 on Nov 02, 2018
Hard drive failures can be significant service problems but how common of an issue are they in video surveillance? How long do drives last when...
Building Occupancy Codes and Access Control Tutorial on Nov 01, 2018
A building or room's classification can greatly impact which building codes must be followed. In terms of access control, these 'occupancy codes'...
Cloud Video Storage Usage 2018 on Oct 31, 2018
Storing email and documents in the cloud have long been common, with on-site email or file servers increasingly eliminated. However, what about...

Most Recent Industry Reports

Milestone Disrupts Milestone With Arcules on Nov 19, 2018
Milestone is now competing against... Milestone's own spinout Arcules New IPVM testing shows that Arcules has incorporated a substantial amount of...
Pressure Mounts Against Dahua and Hikvision Xinjiang Business on Nov 19, 2018
Pressure is mounting against Hikvision, Dahua, and other companies operating in Xinjiang as an international outcry brews against the Chinese...
Arcules Cloud VMS Tested on Nov 19, 2018
Arcules is a big bet, or as they describe themselves a 'bold company', spun out and backed by Milestone and Canon.  But how good is Arcules cloud...
'Sticker' Surveillance Camera Developed (CSEM Witness) on Nov 16, 2018
The Swiss Center for Electronics and Microtechnology (CSEM) has announced what it calls the: world’s first fully autonomous camera that can be...
ISC East 2018 Mini-Show Final Report on Nov 16, 2018
This is our second (updated) and final show report from ISC East. ISC East, by its own admission, is not a national or international show, billed...
Facial Detection Tested on Nov 16, 2018
Facial detection and recognition are increasingly offered by video surveillance manufacturers. Facial detection detects faces in an image/video...
Throughtek P2P/Cloud Solution Profile on Nov 15, 2018
Many IoT manufacturers either do not have the capabilities or the interest to develop their own cloud management software for their devices....
ASIS Offering Custom Research For Manufacturers on Nov 15, 2018
Manufacturers often want to know what industry people think about trends and, in particular, the segments and product they offer.  ASIS and its...
Hikvision Silent on "Bad Architectural Practices" Cybersecurity Report on Nov 14, 2018
A 'significant vulnerability was found in Hikvision cameras' by VDOO, a startup cybersecurity specialist. Hikvision has fixed the specific...
French Government Threatens School with $1.7M Fine For “Excessive Video Surveillance” on Nov 14, 2018
The French government has notified a high-profile Paris coding academy that it risks a fine of up to 1.5 million euros (about $1.7m) if it...

The world's leading video surveillance information source, IPVM provides the best reporting, testing and training for 10,000+ members globally. Dedicated to independent and objective information, we uniquely refuse any and all advertisements, sponsorship and consulting from manufacturers.

About | FAQ | Contact