Samsung Rigs Tests

This is funny in light of the recent uproar about the Samsung's salesguy's camera testing 'process'. Also, kind of stunning.

Here's what they did:

"If the [Samsung tablet] system detects that one of a hard-coded list of apps is running, it turbo-charges the graphics processing unit (GPU), yielding that 20% boost. Then when the test is over, it scales it right back, because turbo-charging uses up the battery."

So Samsung knew what was going to be on the test and then cheated to game the test when a list of apps on the test list was used.

The tester caught them:

"To prove this, the Ars team took the code from a benchmark called Geekbench and tweaked how it would present itself to the system. "Stealthbench", as they christened it, was the same benchmarking code, yet the Note 3's GPU didn't turbo-charge. No 20% boost – just the same performance as the LG."

However, Samsung denied it but could not explain the discrepancy in performance by simply changing the app's name.

Oh and Anandtech has a table of test cheaters - Samsung gets highest scores!

This is another example why accurate tests must be as independent from the manufacturer as possible. Unfortunately, surveillance users often do crazy things like let the manufacturer set their own cameras up for the test. Manufacturers will routinely try to get an extra edge, even if it is unfair or skews the test.

Good job Samsung! Thanks for proving my point.

Login to read this IPVM discussion.
Why do I need to log in?
IPVM conducts unique testing and research funded by member's payments enabling us to offer the most independent, accurate and in-depth information.

*** **** ******** ********-**** **** ***** ******* ** **** ***** phones *** *******? ** **** **** ***** *** ******?

***** ********* *** *** ****** / *******. * ***'* **** about *******.

****'* **************** ********************* **** ******* *** *****:

"******* *** [***********] **** ** * *** ****** *** ******* at ******* ****** ... ******* ** **** ******** ** ** hard ***** ********/********** *** ******* ************. *** ****** "****************" ** a ************ ******* ***."

** ******* ********* ***** * ****** ******* ** ***** *********** for ******** ********* ************. ****** ****.

* ***'* *** * ******* ******* *** ******* ** ***** phone ***** *** ****** ***** ***** **** *** **** ** the **** ******* *** *** **** ** ****** **** ******* business ********* ****** *********, *** * ***** ** ***** **** been **** *********** ** ** ** * ****** ** *** title ** *** *******, ** ** ***** ***** ** ** the ******* ** ********* *** ***** ** ******** **** ***** their ***** *** ****** *******. ********* ** ***** ** *** impression ** ************ ******** ***** ******** *******.

* ***** ** ******** ********* ** ****** ** *** *********.

******. *** * ***** **'* * ****** **** ****. ****** interesting ******* **** ****** **** **** ** ****** ******.

** ** ******* **** ********* ***** ********/******** *** ***** ****** and ******* ** ******** *********** *** ********* ****. **'* ******** pretty ****** ** * ******* **** ********* **** **** ** way. **** ******* ***** **** *** ***** ***** ****-***** ****** pay **** ********* ** ***** ***** **** *********** * ***** phone ********? ******** ***. *'** *** ** **, *** * would ****** *** ** ** ** * ********* ** * needed ******* *****, **** *********** ***** *** ******** **. * still **** *** ** ***** **** *******, * **** * would **** ****** ** *** *** ** ***** ******* ** my ****.

**** ** *****...

**** ***** ******* **** ******* ** * ****** ***** * am **** ***** *** ******. * **** ***** ********* ************'* cameras *** ** *** *** *** *** **** ** **** by **** ******* ******** *** ** *** ******* ******** *** some **** **** ****** **** ******, *** **** *** **** at *** ***** ********, *********, ***** **** *** **** ************ has ********* **** **** ********* ******* ********. **** ** *** max ***** *******, ****** ***** ********* *** **** **** * balanced ********. ** **** * *** *****?

***, **** **** * **** ***** *** **** "**** *** much ****** **** ** *** ** *** ***" ***** *** alluded ** ** *** ******* ***** *** **** ** ** seedy *** *****. ****** ******, ** **** ********. ** ***** their ********* *** ***** **** *** ******* *** ** ****, give **** ****** *** ****, **'* **** **** **. **'* a *** *** *** *****, *** *** ***** **** *** a *** ** ***** ******. **** ** *** * ****** insisted ** **** ************* **** ******* ** ****** **** ** *** *** ****** purchasing ****, *** *** ***** ***** ** ***** ** ** default **** ** ***** *** *** ******. ** *** ************* were ********-** ****** ***** **********, **** ***** **** ****** ** write *****.

** ***** ** **** ** *** ************* ******** ***** ******* to ******* ****** **** ***'* ******* ** ******* ****** ****** with ***** ******* *** ****** ** ******.