Almost all Android makers cheat on benchmarks

mercurial

MyBB Legend
Joined
Jun 12, 2007
Messages
40,900
Reaction score
2,693
Location
/\/¯¯¯¯¯\/\
Cheating on benchmarks – everyone is doing it as it turns out, not just Samsung. AnandTech has done some extensive digging and it turns out that virtually all Android vendors cheat on at least a couple of tests, save for Motorola.

Samsung’s list of benchmarks seems longer than the rest and the company does it across three chipsets – Snapdragon, Exynos and Atom.

Here’s the tablet that AnandTech prepared that shows which device cheats on which test (yes, with that title):

Capture.PNG

NVIDIA doesn’t make phones but it’s still a pleasant surprise to see the company didn’t boost the Tegra 4 chipset in the Shield handheld console, even though it needs to show a win with the new chipset.

Sony wasn’t included as the company doesn’t send review samples to AnandTech.

Note that this cheating doesn’t actually involve boosting the CPU or GPU speed – all it does is disable the lower clock speeds and sleep modes on all CPU cores. Here’s a graph of what that looks like – when the device detects a benchmark on its list, all CPU cores are locked at their max frequency, while if the benchmark is renamed (so that the device doesn’t detect it), there are natural drops in CPU frequency varying with the load.

gsmarena_002.jpg

There doesn’t seem to be any fiddling going on with the GPU, but he boosted CPU still results in a small (3-10%) boost in scores for 3D benchmarks.

You can read Anand’s extensive article on about benchmark cheats here.

Source
 
Surprising how this had no comments.
But then again, maybe not so surprising
 
Isn't it strange about the frequency of disagreements over smartphone performance on this forum, yet with clear proof of deception, it's simply brushed aside as just another thing all manufacturers do.

Fortunately Google / Motorola and Apple don't appear to be known for this.
 
Top
Sign up to the MyBroadband newsletter
X