Great report! Can you elaborate on the impact of altering P frame interval (or some say, I frame interval or keyframe interval)? Is there any significant relationship between keyframe interval and quantization? Clearly the shorter the time between P frames, the higher the bandwidth but what are the other impacts on the video? It's another opportunity for confusion on which way the scale goes and its impact on quality and bandwidth. Thanks!
IP Camera Manufacturer Compression Comparison
Published Nov 27, 2017 17:07 PM
******* *** *** ** *********-***** ***** *********** (H.264/H.265), *** ***** **** **** ******* ***** quality ******** *** ********* ************* **** widely, **** ** ********* *** *********** or ***** ****. **** *** ****** in *** ******* **** *** **** resolution ******** ** *** ********* ************* ********* widely ********* ***-**-***-*** *******.
** **** ***** **** *********, **** has ******** ******* **** ** ************* *** answered ***** *** *********:
- **** ** *** **** *.*** ***/** H265 ************ ***** *** **** ****** manufacturer's ******* ********? *** ** **** vary? *** ******** *** ****** *** highest?
- ** ********* *** *.***/*.*** ************ ****** so **** **** ************ *** *** same ***********, **** ****** ******** ****** be ****?
- **** ** *** ****** ** ********* as *.***/*.*** ************/*********** ****** *** ****** for ********* *************?
- **** ****** ** ***** ****** **** ** ***** ********?
**** ** **** ** ***** *** ******* settings **** ***** *************, ******* ************ **** the ******* ******* *********** (*****), **% higher **** *** ************ **** *** lowest ******* *********** (*******):
** *** ****** **** ***** ***** quality *** ********** ********* / ******* use, **** ** * ******** ******.
Key ********
**** *** *** *** ******** **** this ****:
- ******* ******* ************:***** ** *** *****, ******* ******* quantization ** ~**, **** ******* ******* widely, **** ~** ** **.
- *.*** ************ ****** ******* ** *.***:******* ******** *************' *.*** *******, ** found **** ************ *** ************* ******* when ***** *.*** *** *.***, ****** bandwidth *** ******* ***** ***** *.***.
- ****** ********* ******: ** * **** ** *****, ***** from ****** ********** *** ** **** average *** ******** ** * **-** bandwidth ********, ******* ** ************. *** to *** *** * ******* **-*** increase.
- ** *********** ******* *************:** *** ** ************* ******, **** used *** **** ****** *********** *** scale, *** *** ******* ***** (**** as "******") ****** ** ******* ************ levels.
Video *********** ********
************* ***********, *** *** ************* *** to **** ****** ************ ***** ********, is **** *********. ******************* *** *********, *********** ** ******** and *** ** * ****** ****** -**** *** ******* *** *********.
*** ************ ***** ** **********, ********** of **********. ***, **** ** *** cameras **** *** **** **********, ***** compression ****** *** ** **** ********* (see *** ***** ******* / *********** ******** *** **** **********).
**********, *********** ** *.*** *** *.*** is ************ ** * ***** ** 0 ** **, ****** ************, ** shown ** *** ***** *****:
*******, ****** ************* ****** ***** ******** what ************ ****** ***** ******* ***. Instead, **** *** * ******* ** scales *** ****** *******. *** *******, **** is **** ** ************* ***** ** their *********** ******** **:
** * ******, *** *************' ******* ***** **** the **** ********** *** ************* ********* compression ******, *** ********* ******* ***** quality *** ********* ***********.
Average ******* ************: ~**
***** ** ****** ******** ** **+ cameras **** ***** ** *************, ** found ******** ***** ** *** ***** below.
- ******* ******* ************ ***** *** ** with * ***** ** ** ** **.
- ******* ******* ********* ** *** ****** quantization ** *** ******* ****** ** Q20, **** ********* *** ******* ***** at **.
- *** ******* ******* ************ *** *****, approximately *** ** *******.
Terminology ***********
**** ** *** ************* ****** **** terminology ** ****** ***** ****** *** directly ********** ** ***** *************. **** may ***** ********* **** ****** ** standardize ******** ******* ** *** ************ level.
*******, ****** *** **** ********* ****** depending ** *** ************, ****** ******** even **** *********. *** *******, ******* all ***** * ********* *****, ***** and **** **** **** * ******/***** quality **** *********** ** *** ** "1", ***** ********, ****, *** *****, have *** * ******/****** ******* **** compression *** ****** ** "*".
Normalizing ***********
** **** ********** **** ******'* *********** settings ** ******* * ************ ** ~28. **** *** ** ****** *** users ******* ** ********* *********** ******** on ***** *** *******, ****** ** a ***** *** ******* ****** **** the **** ************.
**** **** ***** *** **** ******** of ******* ***** ***** ** ******** adjust *********** ********, ***** *** **** exceptions. For *******, *** ********** ****** *** Sony ******* **** ******* * ***-******** VBR ************** ***** **** *** *** compression *** ******* **** **** * bitrate ****** ***/** ***, **** *********** and ******* **** *******. *** *** report **** *** ******* ******** ***.
Quantization ************* ******* ***** *.***
***** ** *** ***** ** ******** manufacturers' *******, ******* *** ************ ************ ****** were ************* ******* **** ***** **** H.264 *** *.***, ******** ******** **** notably ***** ** *.*** *******, ********* 30-40%. ******* ****** *** *** *.*** / **** ***** ******** **** *** **** ***********.
Compression ****** ** *********
********* ** ******** ******** ** ************ level. ** *********** ****, **** ******** quantization **** * ******** ** *** (highly **********) ** * **** ******* Q28, ******** ** * ***** *********** Q22.
***** ** ***** *****, ** *****:
- Q35 ** ***: Changing quantization from Q34 to Q28 resulted in a 3x-5x bandwidth increase on cameras tested (Axis, Dahua, Hikvision, Panasonic).
- Q36 ** ***: Changing from Q35 to Q22 resulted in drastic increases, ranging from about 5x to 11x, depending on manufacturer.
Smart ***** ******
*** **************** ********* ***** ***** **** when ***** ****** *** ****** *** or *** *********. ** ******, ***** they ****** ************ *********** ***** ** objects ** *** ***** ******* ** adjusting ** ** *** ****** *****, smart ****** *** **** *********, ** not **********, ** ***********.
************, ************ ****** ** ***** ***** cameras *** ********* **** ****, **+, since **** ** **** ****** ** regarded ** ****** ********** *** ********* more ****** **********, **** **** ****** objects ********* ******* ** ***** ***********.
*** *******, ****, *****, *** ******* ********* to ***** ****** ******* ** *** tests, *** *** ***** ******** ** or ****** ************:
******* ****** *** *** ***** ***** ***** *** **** ******* ** ***** ******** and ******* ******.
Setting *********** *** ********* *******
***** ** **** *********** ******** *** each *************' *******, **** ***** ********* defaults *** *************.
*******
******* ** *** ** *** ************* to ******** *** *** ************ ***** in ***** *** *********. ************ ** adjustable **** ** ** **, ********** to **.
********
********'* *********** ******** *** ** ******* under *** *********** *** ***** **** tab ** ***** *** **, *** it **** * ******* ****** ** "1" (****** ***********) ** "**" (******* compression). Quality ******** ** "*", ***** ** quantization.
****
**** ********* **** *** ********* *** interfaces, ** **** ** ***** ******* have *** *** ************ ** ******** ***** ***** **. **** *** *** *** *** UIs ******* ** *** **** ********: ** compression. *** *** *** ********* **** a ******/****** *****:
***** *** *** ********* ****** ****** free *****:
*****
*****'* ***** ***** ***** ************ ** P-frames, **** *-****** ******* ** **** by * ******** ****** ("*/*-***** ***** QP" *****). ** *********** ** ******* 28Q, ***** ****** *** "***. *-***** QP" ** **, *** *** */*-***** delta ** *.
*****
*****'* *********** ******** *** ***** ** the ***** ***, *** *** "*******" can ** *** ******* "*" (**** compression) ** "*" (***** ***********), **** 2 ******** ** ~** ************ ** most models ******.
*********
*********'* *********** ******** *** ***** *** video/audio ***, ** * ***** ** "******" (**** compression) ** "*******" (***** ***********), ********** to "******." ***** ** *** ***** of ******** ********* ******, "******" ******* to ~***.
******/*******
*** ***** ****** ******* ** *** include *** *** ** *** *********** of *** ******, **** **** ******* and ************ *******. *** **** *******, see *** ****** **** *** ******* ******** ***.
***** ****** (******* ***/****) ******* *********** on * ***** **** "**** (*)" (***** compressed) ** "***** (**)" (**** **********), defaulting ** *. ***** ****** ****** be *** ** ~** ** **** scale *** ******* ** ************.
*********
** ***** ** ****** ***** ******* of ********* ******, ***** ****** *** transmission ******** ** *** (******** ** Frame ****). ***** ******* ** ******** on * ***** ** *-* (***** Fine ** ***), ********** ** * (Normal), **** * ******* ************ **.
**** **** ** ******* ******, *********'* new ******* ****** **** *** **** models ***** ********* ** *.***, ***** below.
****
** **** ***/*** *** ***** ***** ********, *********** ** *** ** *** "Image ******* *: ******** ****, ***** ranges **** "*" (**** **********) ** "10" (**** **********), ********** ** * (roughly ***).
**** **** ******* ** ******, ****'* 7th *** ******* ** *** ***** compression ** ** ***** ** * set *****. *** **** *** ******* ******** *** *** **** *******.
*******
******* ******* **** ***** ******* ** a ****** ******* **** ****** "*******" to "*** ****", **** ** ****** to ******** ***** * *****. *** slider ****** ** *** ** ~*/* of *** *** ****** *** **** for ~***.
*******
*******'* *********** ******* ** ***** "****** Quality", ***** *****, **** * ***** of "******" (*****) ** "*********" (****). "Good" ****** ** **** *** ************ ~28.
Test ********
***** ******* **** ******, *** ****** be **** ** ****** *** * ********* ** **** quiz.
[****: **** ****** *** ********** ********* in **** *** ************* ******* ** 2017]
Comments (14)
UM
Undisclosed Manufacturer #1
Nov 27, 2017Ethan Ace
Nov 27, 2017We have a report on P-frame/I-frame impact here.
In general, P and I frames don't directly impact quantization levels. They will impact the visual artifacts in video, though. So when I-frame interval is long, you'll see trails form behind moving objects, and additional noise throughout the image until the next I-frame. Conversely, when I-frames are close, you'll see less of this issue, but there is generally not much of a practical improvement from intervals shorter than a second.
This video from our test shows I-frame intervals varying from long to short.
UM
Undisclosed Manufacturer #2
Nov 27, 2017Hi Guys
You've used the term "artifacting" - but it looks more like motion blur. Did you have the shutter speed at default (usually 1/30 or 1/60 sec)? This is probably not a fast enough shutter speed to stop motion blur - even in this scenario.
By the way - really enjoy reading your reviews, commentary on the industry, etc. - keep up the good work.
Cheers
Ethan Ace
Nov 27, 2017There is definitely some blur present in those videos, yes, but we specifically are calling out issues with artifacts.
We show the trails of compression artifacts behind the train, e.g.:
Sergey Bystrov
Nov 27, 2017Besides quantization levels, final image quality would depend on:
- spatial filter
- temporal filter
- motion vectors search( a type of macroblocks)
- motion vectors search( accuracy: pixel, half a pixel, quarter pixel etc )
- macroblocks type selection
- CBAC vs CAVLC
- bitrate control( how well does it handle changes)
- etc
Quantization parameters is a small part of the overall equation, and making some conclusions based on it is likely misleading.
If I would explore how advanced codecs are from different vendors, I would analyze other parameters as well: so you can see that this vendor uses macroblocks of such type, motion vectors of such accuracy etc... I know nobody would be interested in reading:-)
But only real criteria of image quality/bitrate is subjective "I like it more" or "I like it less", not quantization by itself.
AS
Ashley Schofield
Nov 28, 2017Great report, but curious to know the firmware versions tested of each camera.
Cheers
Franky Lam
Nov 28, 2017Details report and end-user must always care about the bandwidth and storage issue. But Chinese Band Distributor always hidden this issue to the end-user.
Thank you, IPVM.
U
Undisclosed #3
Nov 28, 2017But Chinese Band Distributor always hidden this issue to the end-user.
Like which ones?
Franky Lam
Nov 28, 2017If you would like to know, and do use your REAL identity. I don't talk with stranger...:-P
U
Undisclosed #3
Nov 28, 2017...and do use your REAL identity. I don't talk with stranger...
No problem, I wouldn’t want you to compromise your principles, “Franky”.
Franky Lam
Nov 28, 2017Haha, I don't know WHY, and I had the feeling I know you, "Mr. Undisclosed #3"
UE
Undisclosed End User #4
Nov 29, 2017Thank you for another great report IPVM. Question, how did you measure image quality? Did you use some type of tool or did you just manually review the video? Also what tool did you use to watch the video? The viewer inside the camera, another third party tool (ie- VMS)? These details can affect the perceived quality, hence I'm asking. Thanks!!!
Ethan Ace
Dec 04, 2017Do you mean "image quality" as in visible image quality? Or as in compression?
Compression was measured using AVInaptic, as well as Elecard StreamEye for H.265 streams.
If you mean image quality as in visible image quality, we visually compare cameras. There are software tools that measure "image quality", but I would not trust software measurements to determine what is or is not a usable image.
We view video multiple ways. Practically every cameras in this test was viewed using Exacq, VLC Player, and the camera's web interface. We don't rely on just one, but that being said, rarely are there practical differences between one VMS and another or between the web interface and a VMS, etc.
UI
Undisclosed Integrator #5
Nov 18, 2018Well done as usual.