By Joe Levi | October 13, 2010 7:00 PM
Just how much of a difference does Android 2.2 make in the Quadrant benchmark results? Not as much as you’d think!
I took a lot of flack from comparing the Samsung Epic 4G to the T-Mobile G2. So before we get into all that again let me take a minute and describe what benchmarking means to me, and why it exists at all.
“Benchmark”, according to Define.com, means “a test or series of tests designed to compare the qualities or performance of different devices of the same type. Certain sets of computer programs are much used as benchmarks for comparing the performance of different computers, especially by comparing the time it takes to complete a test.
It wouldn’t make any sense to compare a benchmarking result obtained by running a series of tests on two identical phones (a G2 versus a G2, for example). Yet some of you think that comparing “different devices” is somehow “unfair”. Please know that I’m not trying to be biased or unfair, by using the same benchmarking tool to test each device we’re able to compare the speeds of different devices. Ultimately, this helps us know the speed of a device when compared to another device.
That having been said, I performed the same benchmarking tests against an AT&T Samsung Captivate and a T-Mobile G2. These devices have different processors, different clock-speeds, and a whole bunch of other differences.
When I first ran Quadrant, the defacto benchmarking app for Android, against the stock Captivate (running Android 2.1, without the infamous “lag fix”) the device scored 909 points. The stock G2 scored in the 1,500 range.
After rooting the Captivate and installing the Cognition ROM, which is a Froyo (Android 2.2) ROM, the device scored 989 points — not much of an improvement.
When the “one-click lag fix” was applied to the Cognition ROM, the benchmarking scored jumped to an amazing 1,985 points! That’s more than double the speed just by “fixing” the non-standard file-system that Samsung has used on every Galaxy S series phone.
Come take a look at the results of running a rooted Captivate running the Cognition ROM and lag fix.