Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a7db3cb257ff6396481f44427bccd0ca5abf4d63 (+ 376 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Os-build/9/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0009 (llvmorg-17-init-01548-ga7db3cb257ff) 2023-02-05T11:43:11 0:00:00
Previous 0008 (llvmorg-17-init-01172-gb3ab26b4aa2f) 2023-02-02T02:49:47 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 62 112
Performance Improvements 63 26
Unchanged Tests 655 642
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 21.14% 11928.000 14450.000 - 20.43% -
458.sjeng 6.08% 16388.000 17384.000 - 5.96% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 139.13% 0.460 1.100 - 92.98% -
450.soplex (max) (percentage) 136.96% 0.460 1.090 - 91.23% -
450.soplex (unexplained diff vs previous) 136.36% 66.000 156.000 - 90.24% -
450.soplex (max) 133.33% 66.000 154.000 - 87.80% -
429.mcf 80.38% 260.000 469.000 - 784.91% -
429.mcf (avg) 80.38% 260.000 469.000 - 784.91% -
429.mcf (avg) (percentage) 49.08% 2.180 3.250 - 622.22% -
429.mcf (max) 46.90% 2079.000 3054.000 - 4458.21% -
462.libquantum (avg) (percentage) 39.42% 1.370 1.910 - 1173.33% -
458.sjeng 36.92% 195.000 267.000 - 181.05% -
458.sjeng (avg) 36.92% 195.000 267.000 - 181.05% -
456.hmmer (avg) (percentage) 36.24% 2.180 2.970 - 725.00% -
401.bzip2 (avg) (percentage) 34.29% 0.700 0.940 - 327.27% -
483.xalancbmk (avg) (percentage) 34.08% 3.580 4.800 - 860.00% -
464.h264ref (avg) (percentage) 33.88% 1.210 1.620 - 390.91% -
473.astar (avg) (percentage) 30.46% 1.740 2.270 - 354.00% -
458.sjeng (avg) (percentage) 29.41% 1.190 1.540 - 165.52% -
401.bzip2 29.36% 109.000 141.000 - 314.71% -
401.bzip2 (avg) 29.36% 109.000 141.000 - 314.71% -
447.dealII (unexplained diff vs previous) (percentage) 28.93% 1.210 1.560 - 5.41% -
445.gobmk (avg) (percentage) 28.21% 0.780 1.000 - 455.56% -
447.dealII (unexplained diff vs previous) 26.80% 97.000 123.000 - 1.65% -
445.gobmk 24.47% 94.000 117.000 - 431.82% -
445.gobmk (avg) 24.47% 94.000 117.000 - 431.82% -
462.libquantum 23.89% 180.000 223.000 - 1073.68% -
462.libquantum (avg) 23.89% 180.000 223.000 - 1073.68% -
483.xalancbmk (unexplained diff vs previous) (percentage) 23.51% 17.140 21.170 - 3156.92% -
464.h264ref 22.99% 187.000 230.000 - 350.98% -
464.h264ref (avg) 22.99% 187.000 230.000 - 350.98% -
471.omnetpp (avg) (percentage) 22.83% 2.190 2.690 - 244.87% -
429.mcf (max) (percentage) 21.29% 17.430 21.140 - 3675.00% -
456.hmmer (unexplained diff vs previous) (percentage) 21.03% 12.270 14.850 - 21114.29% -
456.hmmer 18.43% 293.000 347.000 - 622.92% -
456.hmmer (avg) 18.43% 293.000 347.000 - 622.92% -
473.astar 17.74% 248.000 292.000 - 311.27% -
473.astar (avg) 17.74% 248.000 292.000 - 311.27% -
462.libquantum (unexplained diff vs previous) (percentage) 14.69% 10.620 12.180 - 10050.00% -
450.soplex 12.50% 48.000 54.000 - 5.88% -
450.soplex (avg) 12.50% 48.000 54.000 - 5.88% -
450.soplex (avg) (percentage) 11.76% 0.340 0.380 - 5.56% -
471.omnetpp (unexplained diff vs previous) (percentage) 11.54% 11.870 13.240 - 1439.53% -
470.lbm (unexplained diff vs previous) (percentage) 11.22% 11.050 12.290 - 243.30% -
470.lbm (avg) (percentage) 10.92% 3.570 3.960 - 70.69% -
483.xalancbmk 10.48% 334.000 369.000 - 685.11% -
483.xalancbmk (avg) 10.48% 334.000 369.000 - 685.11% -
473.astar (unexplained diff vs previous) (percentage) 10.39% 9.910 10.940 - 1339.47% -
458.sjeng (max) 8.53% 973.000 1056.000 - 1524.62% -
471.omnetpp 8.37% 239.000 259.000 - 212.05% -
471.omnetpp (avg) 8.37% 239.000 259.000 - 212.05% -
433.milc (avg) (percentage) 7.92% 1.010 1.090 - 7.92% -
401.bzip2 (unexplained diff vs previous) (percentage) 6.14% 4.070 4.320 - 1293.55% -
456.hmmer (unexplained diff vs previous) 5.39% 1651.000 1740.000 - 19233.33% -
433.milc 5.19% 135.000 142.000 - 4.41% -
433.milc (avg) 5.19% 135.000 142.000 - 4.41% -
464.h264ref (unexplained diff vs previous) (percentage) 3.33% 8.700 8.990 - 2205.13% -
447.dealII (avg) (percentage) 2.36% 1.270 1.300 - -11.56% -
458.sjeng (max) (percentage) 2.36% 5.940 6.080 - 1420.00% -
462.libquantum (unexplained diff vs previous) 2.22% 1396.000 1427.000 - 8818.75% -
483.xalancbmk (unexplained diff vs previous) 1.94% 1600.000 1631.000 - 2573.77% -
401.bzip2 (unexplained diff vs previous) 1.72% 638.000 649.000 - 1224.49% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -17.47% 9337.000 7706.000 - -18.26% -
456.hmmer -12.93% 13456.000 11716.000 - -12.34% -
471.omnetpp -11.69% 10922.000 9645.000 - -10.25% -
470.lbm -10.94% 13724.000 12222.000 - -11.96% -
462.libquantum -10.86% 13140.000 11713.000 - -10.76% -
473.astar -9.86% 14273.000 12865.000 - -9.80% -
464.h264ref -8.25% 15535.000 14253.000 - -8.00% -
482.sphinx3 -7.03% 26340.000 24487.000 - -6.93% -
401.bzip2 -4.14% 15673.000 15024.000 - -4.20% -
445.gobmk -3.84% 12170.000 11703.000 - -5.62% -
444.namd -3.61% 12653.000 12196.000 - -9.63% -
403.gcc -2.63% 9121.000 8881.000 - -2.40% -
433.milc -2.48% 13387.000 13055.000 - -3.17% -
447.dealII -1.54% 7999.000 7876.000 - -3.90% -
450.soplex -1.09% 14367.000 14211.000 - -1.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -63.23% 1243.000 457.000 - -44.81% -
444.namd (unexplained diff vs previous) (percentage) -61.81% 9.820 3.750 - -38.93% -
433.milc (unexplained diff vs previous) -34.77% 509.000 332.000 - 82.42% -
433.milc (unexplained diff vs previous) (percentage) -33.16% 3.800 2.540 - 88.15% -
433.milc (max) -26.89% 528.000 386.000 - 109.78% -
433.milc (max) (percentage) -25.06% 3.950 2.960 - 116.06% -
483.xalancbmk (max) -22.07% 1930.000 1504.000 - 2365.57% -
471.omnetpp (max) -20.54% 1470.000 1168.000 - 517.99% -
470.lbm (max) -19.84% 1704.000 1366.000 - 77.63% -
464.h264ref (max) -19.73% 1480.000 1188.000 - 1880.00% -
456.hmmer (max) -19.55% 1882.000 1514.000 - 3685.00% -
473.astar (max) -18.92% 1570.000 1273.000 - 1016.67% -
462.libquantum (max) -18.57% 1562.000 1272.000 - 4792.31% -
429.mcf (unexplained diff vs previous) (percentage) -17.34% 21.110 17.450 - 3016.07% -
444.namd (max) -15.61% 1377.000 1162.000 - 31.75% -
444.namd (max) (percentage) -12.49% 10.890 9.530 - 45.72% -
464.h264ref (max) (percentage) -12.49% 9.530 8.340 - 2038.46% -
482.sphinx3 (max) -12.14% 2051.000 1802.000 - 106.41% -
445.gobmk (max) -11.09% 505.000 449.000 - 1448.28% -
471.omnetpp (max) (percentage) -10.03% 13.460 12.110 - 588.07% -
473.astar (max) (percentage) -10.00% 11.000 9.900 - 1137.50% -
470.lbm (max) (percentage) -9.98% 12.420 11.180 - 101.81% -
458.sjeng (unexplained diff vs previous) (percentage) -9.19% 6.310 5.730 - 2192.00% -
462.libquantum (max) (percentage) -8.66% 11.890 10.860 - 5330.00% -
456.hmmer (max) (percentage) -7.58% 13.990 12.930 - 4210.00% -
445.gobmk (max) (percentage) -7.47% 4.150 3.840 - 1500.00% -
482.sphinx3 -6.95% 676.000 629.000 - 28.63% -
482.sphinx3 (avg) -6.95% 676.000 629.000 - 28.63% -
403.gcc (max) -6.75% 237.000 221.000 - 550.00% -
401.bzip2 (max) -6.48% 664.000 621.000 - 1193.75% -
483.xalancbmk (max) (percentage) -5.56% 20.680 19.530 - 2904.62% -
482.sphinx3 (max) (percentage) -5.52% 7.790 7.360 - 121.69% -
464.h264ref (unexplained diff vs previous) -5.18% 1352.000 1282.000 - 2036.67% -
444.namd -5.08% 571.000 542.000 - 5.45% -
444.namd (avg) -5.08% 571.000 542.000 - 5.45% -
403.gcc (max) (percentage) -4.23% 2.600 2.490 - 555.26% -
453.povray (max) (percentage) -4.05% 1.730 1.660 - -13.99% -
445.gobmk (unexplained diff vs previous) -3.71% 485.000 467.000 - 1456.67% -
458.sjeng (unexplained diff vs previous) -3.68% 1034.000 996.000 - 2329.27% -
453.povray (max) -3.48% 115.000 111.000 - -15.91% -
403.gcc -2.70% 74.000 72.000 - 67.44% -
403.gcc (avg) -2.70% 74.000 72.000 - 67.44% -
447.dealII (max) -2.40% 167.000 163.000 - 26.36% -
401.bzip2 (max) (percentage) -2.36% 4.240 4.140 - 1235.48% -
444.namd (avg) (percentage) -1.55% 4.520 4.450 - 16.80% -
471.omnetpp (unexplained diff vs previous) -1.47% 1296.000 1277.000 - 1288.04% -
470.lbm -1.23% 489.000 483.000 - 50.00% -
470.lbm (avg) -1.23% 489.000 483.000 - 50.00% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 20.43% 11999.000 14450.000 - 21.14% -
458.sjeng 5.96% 16406.000 17384.000 - 6.08% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (unexplained diff vs previous) (percentage) 21114.29% 0.070 14.850 - 21.03% -
456.hmmer (unexplained diff vs previous) 19233.33% 9.000 1740.000 - 5.39% -
462.libquantum (unexplained diff vs previous) (percentage) 10050.00% 0.120 12.180 - 14.69% -
462.libquantum (unexplained diff vs previous) 8818.75% 16.000 1427.000 - 2.22% -
462.libquantum (max) (percentage) 5330.00% 0.200 10.860 - -8.66% -
462.libquantum (max) 4792.31% 26.000 1272.000 - -18.57% -
429.mcf (max) 4458.21% 67.000 3054.000 - 46.90% -
456.hmmer (max) (percentage) 4210.00% 0.300 12.930 - -7.58% -
456.hmmer (max) 3685.00% 40.000 1514.000 - -19.55% -
429.mcf (max) (percentage) 3675.00% 0.560 21.140 - 21.29% -
429.mcf (unexplained diff vs previous) 3664.18% 67.000 2522.000 - 0.16% -
483.xalancbmk (unexplained diff vs previous) (percentage) 3156.92% 0.650 21.170 - 23.51% -
429.mcf (unexplained diff vs previous) (percentage) 3016.07% 0.560 17.450 - -17.34% -
483.xalancbmk (max) (percentage) 2904.62% 0.650 19.530 - -5.56% -
483.xalancbmk (unexplained diff vs previous) 2573.77% 61.000 1631.000 - 1.94% -
483.xalancbmk (max) 2365.57% 61.000 1504.000 - -22.07% -
458.sjeng (unexplained diff vs previous) 2329.27% 41.000 996.000 - -3.68% -
464.h264ref (unexplained diff vs previous) (percentage) 2205.13% 0.390 8.990 - 3.33% -
458.sjeng (unexplained diff vs previous) (percentage) 2192.00% 0.250 5.730 - -9.19% -
464.h264ref (max) (percentage) 2038.46% 0.390 8.340 - -12.49% -
464.h264ref (unexplained diff vs previous) 2036.67% 60.000 1282.000 - -5.18% -
464.h264ref (max) 1880.00% 60.000 1188.000 - -19.73% -
445.gobmk (unexplained diff vs previous) (percentage) 1562.50% 0.240 3.990 - 0.00% -
458.sjeng (max) 1524.62% 65.000 1056.000 - 8.53% -
445.gobmk (max) (percentage) 1500.00% 0.240 3.840 - -7.47% -
445.gobmk (unexplained diff vs previous) 1456.67% 30.000 467.000 - -3.71% -
445.gobmk (max) 1448.28% 29.000 449.000 - -11.09% -
471.omnetpp (unexplained diff vs previous) (percentage) 1439.53% 0.860 13.240 - 11.54% -
458.sjeng (max) (percentage) 1420.00% 0.400 6.080 - 2.36% -
473.astar (unexplained diff vs previous) (percentage) 1339.47% 0.760 10.940 - 10.39% -
401.bzip2 (unexplained diff vs previous) (percentage) 1293.55% 0.310 4.320 - 6.14% -
471.omnetpp (unexplained diff vs previous) 1288.04% 92.000 1277.000 - -1.47% -
401.bzip2 (max) (percentage) 1235.48% 0.310 4.140 - -2.36% -
401.bzip2 (unexplained diff vs previous) 1224.49% 49.000 649.000 - 1.72% -
473.astar (unexplained diff vs previous) 1203.70% 108.000 1408.000 - -0.42% -
401.bzip2 (max) 1193.75% 48.000 621.000 - -6.48% -
462.libquantum (avg) (percentage) 1173.33% 0.150 1.910 - 39.42% -
473.astar (max) (percentage) 1137.50% 0.800 9.900 - -10.00% -
462.libquantum 1073.68% 19.000 223.000 - 23.89% -
462.libquantum (avg) 1073.68% 19.000 223.000 - 23.89% -
473.astar (max) 1016.67% 114.000 1273.000 - -18.92% -
483.xalancbmk (avg) (percentage) 860.00% 0.500 4.800 - 34.08% -
429.mcf 784.91% 53.000 469.000 - 80.38% -
429.mcf (avg) 784.91% 53.000 469.000 - 80.38% -
456.hmmer (avg) (percentage) 725.00% 0.360 2.970 - 36.24% -
483.xalancbmk 685.11% 47.000 369.000 - 10.48% -
483.xalancbmk (avg) 685.11% 47.000 369.000 - 10.48% -
456.hmmer 622.92% 48.000 347.000 - 18.43% -
456.hmmer (avg) 622.92% 48.000 347.000 - 18.43% -
429.mcf (avg) (percentage) 622.22% 0.450 3.250 - 49.08% -
471.omnetpp (max) (percentage) 588.07% 1.760 12.110 - -10.03% -
403.gcc (max) (percentage) 555.26% 0.380 2.490 - -4.23% -
403.gcc (max) 550.00% 34.000 221.000 - -6.75% -
471.omnetpp (max) 517.99% 189.000 1168.000 - -20.54% -
445.gobmk (avg) (percentage) 455.56% 0.180 1.000 - 28.21% -
445.gobmk 431.82% 22.000 117.000 - 24.47% -
445.gobmk (avg) 431.82% 22.000 117.000 - 24.47% -
464.h264ref (avg) (percentage) 390.91% 0.330 1.620 - 33.88% -
473.astar (avg) (percentage) 354.00% 0.500 2.270 - 30.46% -
464.h264ref 350.98% 51.000 230.000 - 22.99% -
464.h264ref (avg) 350.98% 51.000 230.000 - 22.99% -
401.bzip2 (avg) (percentage) 327.27% 0.220 0.940 - 34.29% -
401.bzip2 314.71% 34.000 141.000 - 29.36% -
401.bzip2 (avg) 314.71% 34.000 141.000 - 29.36% -
473.astar 311.27% 71.000 292.000 - 17.74% -
473.astar (avg) 311.27% 71.000 292.000 - 17.74% -
471.omnetpp (avg) (percentage) 244.87% 0.780 2.690 - 22.83% -
470.lbm (unexplained diff vs previous) (percentage) 243.30% 3.580 12.290 - 11.22% -
471.omnetpp 212.05% 83.000 259.000 - 8.37% -
471.omnetpp (avg) 212.05% 83.000 259.000 - 8.37% -
470.lbm (unexplained diff vs previous) 202.21% 497.000 1502.000 - -0.92% -
458.sjeng 181.05% 95.000 267.000 - 36.92% -
458.sjeng (avg) 181.05% 95.000 267.000 - 36.92% -
458.sjeng (avg) (percentage) 165.52% 0.580 1.540 - 29.41% -
482.sphinx3 (max) (percentage) 121.69% 3.320 7.360 - -5.52% -
433.milc (max) (percentage) 116.06% 1.370 2.960 - -25.06% -
433.milc (max) 109.78% 184.000 386.000 - -26.89% -
482.sphinx3 (max) 106.41% 873.000 1802.000 - -12.14% -
470.lbm (max) (percentage) 101.81% 5.540 11.180 - -9.98% -
450.soplex (unexplained diff vs previous) (percentage) 92.98% 0.570 1.100 - 139.13% -
450.soplex (max) (percentage) 91.23% 0.570 1.090 - 136.96% -
450.soplex (unexplained diff vs previous) 90.24% 82.000 156.000 - 136.36% -
433.milc (unexplained diff vs previous) (percentage) 88.15% 1.350 2.540 - -33.16% -
450.soplex (max) 87.80% 82.000 154.000 - 133.33% -
433.milc (unexplained diff vs previous) 82.42% 182.000 332.000 - -34.77% -
470.lbm (max) 77.63% 769.000 1366.000 - -19.84% -
403.gcc (avg) (percentage) 70.83% 0.480 0.820 - 0.00% -
470.lbm (avg) (percentage) 70.69% 2.320 3.960 - 10.92% -
403.gcc 67.44% 43.000 72.000 - -2.70% -
403.gcc (avg) 67.44% 43.000 72.000 - -2.70% -
470.lbm 50.00% 322.000 483.000 - -1.23% -
470.lbm (avg) 50.00% 322.000 483.000 - -1.23% -
444.namd (max) (percentage) 45.72% 6.540 9.530 - -12.49% -
482.sphinx3 (avg) (percentage) 38.17% 1.860 2.570 - 0.00% -
444.namd (max) 31.75% 882.000 1162.000 - -15.61% -
447.dealII (max) (percentage) 31.65% 1.580 2.080 - -0.95% -
482.sphinx3 28.63% 489.000 629.000 - -6.95% -
482.sphinx3 (avg) 28.63% 489.000 629.000 - -6.95% -
447.dealII (max) 26.36% 129.000 163.000 - -2.40% -
444.namd (avg) (percentage) 16.80% 3.810 4.450 - -1.55% -
433.milc (avg) (percentage) 7.92% 1.010 1.090 - 7.92% -
450.soplex 5.88% 51.000 54.000 - 12.50% -
450.soplex (avg) 5.88% 51.000 54.000 - 12.50% -
450.soplex (avg) (percentage) 5.56% 0.360 0.380 - 11.76% -
444.namd 5.45% 514.000 542.000 - -5.08% -
444.namd (avg) 5.45% 514.000 542.000 - -5.08% -
447.dealII (unexplained diff vs previous) (percentage) 5.41% 1.480 1.560 - 28.93% -
433.milc 4.41% 136.000 142.000 - 5.19% -
433.milc (avg) 4.41% 136.000 142.000 - 5.19% -
447.dealII (unexplained diff vs previous) 1.65% 121.000 123.000 - 26.80% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk -18.26% 9427.000 7706.000 - -17.47% -
456.hmmer -12.34% 13365.000 11716.000 - -12.93% -
470.lbm -11.96% 13882.000 12222.000 - -10.94% -
462.libquantum -10.76% 13126.000 11713.000 - -10.86% -
471.omnetpp -10.25% 10746.000 9645.000 - -11.69% -
473.astar -9.80% 14262.000 12865.000 - -9.86% -
444.namd -9.63% 13495.000 12196.000 - -3.61% -
464.h264ref -8.00% 15493.000 14253.000 - -8.25% -
482.sphinx3 -6.93% 26310.000 24487.000 - -7.03% -
445.gobmk -5.62% 12400.000 11703.000 - -3.84% -
401.bzip2 -4.20% 15683.000 15024.000 - -4.14% -
447.dealII -3.90% 8196.000 7876.000 - -1.54% -
433.milc -3.17% 13482.000 13055.000 - -2.48% -
403.gcc -2.40% 9099.000 8881.000 - -2.63% -
453.povray -2.35% 6857.000 6696.000 - -0.01% -
450.soplex -1.51% 14429.000 14211.000 - -1.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -44.81% 828.000 457.000 - -63.23% -
444.namd (unexplained diff vs previous) (percentage) -38.93% 6.140 3.750 - -61.81% -
453.povray (max) -15.91% 132.000 111.000 - -3.48% -
447.dealII -15.00% 120.000 102.000 - 0.99% -
447.dealII (avg) -15.00% 120.000 102.000 - 0.99% -
453.povray (max) (percentage) -13.99% 1.930 1.660 - -4.05% -
453.povray -13.98% 93.000 80.000 - 0.00% -
453.povray (avg) -13.98% 93.000 80.000 - 0.00% -
453.povray (avg) (percentage) -12.41% 1.370 1.200 - 0.00% -
447.dealII (avg) (percentage) -11.56% 1.470 1.300 - 2.36% -

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 15024.000 -4.14%
403.gcc 8881.000 -2.63%
429.mcf 14450.000 21.14%
433.milc 13055.000 -2.48%
444.namd 12196.000 -3.61%
445.gobmk 11703.000 -3.84%
447.dealII 7876.000 -1.54%
450.soplex 14211.000 -1.09%
453.povray 6696.000 -
456.hmmer 11716.000 -12.93%
458.sjeng 17384.000 6.08%
462.libquantum 11713.000 -10.86%
464.h264ref 14253.000 -8.25%
470.lbm 12222.000 -10.94%
471.omnetpp 9645.000 -11.69%
473.astar 12865.000 -9.86%
482.sphinx3 24487.000 -7.03%
483.xalancbmk 7706.000 -17.47%
Geometric Mean 11989.279 -4.85%
Code Size (bytes)
Name Current %
401.bzip2 39458.000 -
403.gcc 1959914.000 -
429.mcf 7915.000 -
433.milc 74971.000 -
444.namd 175160.000 -
445.gobmk 1312180.000 -
447.dealII 1778640.000 -
450.soplex 198708.000 -
453.povray 593169.000 -
456.hmmer 168088.000 -
458.sjeng 97694.000 -
462.libquantum 26756.000 -
464.h264ref 354530.000 -
470.lbm 9723.000 -
471.omnetpp 373571.000 -
473.astar 23216.000 -
482.sphinx3 115768.000 -
483.xalancbmk 2287109.000 -
Geometric Mean 164393.878 -
sample variability
Name Current %
401.bzip2 141.000 29.36%
401.bzip2 (avg) 141.000 29.36%
401.bzip2 (avg) (percentage) 0.940 34.29%
401.bzip2 (max) 621.000 -6.48%
401.bzip2 (max) (percentage) 4.140 -2.36%
401.bzip2 (unexplained diff vs previous) 649.000 1.72%
401.bzip2 (unexplained diff vs previous) (percentage) 4.320 6.14%
403.gcc 72.000 -2.70%
403.gcc (avg) 72.000 -2.70%
403.gcc (avg) (percentage) 0.820 -
403.gcc (max) 221.000 -6.75%
403.gcc (max) (percentage) 2.490 -4.23%
429.mcf 469.000 80.38%
429.mcf (avg) 469.000 80.38%
429.mcf (avg) (percentage) 3.250 49.08%
429.mcf (max) 3054.000 46.90%
429.mcf (max) (percentage) 21.140 21.29%
429.mcf (unexplained diff vs previous) 2522.000 -
429.mcf (unexplained diff vs previous) (percentage) 17.450 -17.34%
433.milc 142.000 5.19%
433.milc (avg) 142.000 5.19%
433.milc (avg) (percentage) 1.090 7.92%
433.milc (max) 386.000 -26.89%
433.milc (max) (percentage) 2.960 -25.06%
433.milc (unexplained diff vs previous) 332.000 -34.77%
433.milc (unexplained diff vs previous) (percentage) 2.540 -33.16%
444.namd 542.000 -5.08%
444.namd (avg) 542.000 -5.08%
444.namd (avg) (percentage) 4.450 -1.55%
444.namd (max) 1162.000 -15.61%
444.namd (max) (percentage) 9.530 -12.49%
444.namd (unexplained diff vs previous) 457.000 -63.23%
444.namd (unexplained diff vs previous) (percentage) 3.750 -61.81%
445.gobmk 117.000 24.47%
445.gobmk (avg) 117.000 24.47%
445.gobmk (avg) (percentage) 1.000 28.21%
445.gobmk (max) 449.000 -11.09%
445.gobmk (max) (percentage) 3.840 -7.47%
445.gobmk (unexplained diff vs previous) 467.000 -3.71%
445.gobmk (unexplained diff vs previous) (percentage) 3.990 -
447.dealII 102.000 -
447.dealII (avg) 102.000 -
447.dealII (avg) (percentage) 1.300 2.36%
447.dealII (max) 163.000 -2.40%
447.dealII (max) (percentage) 2.080 -
447.dealII (unexplained diff vs previous) 123.000 26.80%
447.dealII (unexplained diff vs previous) (percentage) 1.560 28.93%
450.soplex 54.000 12.50%
450.soplex (avg) 54.000 12.50%
450.soplex (avg) (percentage) 0.380 11.76%
450.soplex (max) 154.000 133.33%
450.soplex (max) (percentage) 1.090 136.96%
450.soplex (unexplained diff vs previous) 156.000 136.36%
450.soplex (unexplained diff vs previous) (percentage) 1.100 139.13%
453.povray 80.000 -
453.povray (avg) 80.000 -
453.povray (avg) (percentage) 1.200 -
453.povray (max) 111.000 -3.48%
453.povray (max) (percentage) 1.660 -4.05%
456.hmmer 347.000 18.43%
456.hmmer (avg) 347.000 18.43%
456.hmmer (avg) (percentage) 2.970 36.24%
456.hmmer (max) 1514.000 -19.55%
456.hmmer (max) (percentage) 12.930 -7.58%
456.hmmer (unexplained diff vs previous) 1740.000 5.39%
456.hmmer (unexplained diff vs previous) (percentage) 14.850 21.03%
458.sjeng 267.000 36.92%
458.sjeng (avg) 267.000 36.92%
458.sjeng (avg) (percentage) 1.540 29.41%
458.sjeng (max) 1056.000 8.53%
458.sjeng (max) (percentage) 6.080 2.36%
458.sjeng (unexplained diff vs previous) 996.000 -3.68%
458.sjeng (unexplained diff vs previous) (percentage) 5.730 -9.19%
462.libquantum 223.000 23.89%
462.libquantum (avg) 223.000 23.89%
462.libquantum (avg) (percentage) 1.910 39.42%
462.libquantum (max) 1272.000 -18.57%
462.libquantum (max) (percentage) 10.860 -8.66%
462.libquantum (unexplained diff vs previous) 1427.000 2.22%
462.libquantum (unexplained diff vs previous) (percentage) 12.180 14.69%
464.h264ref 230.000 22.99%
464.h264ref (avg) 230.000 22.99%
464.h264ref (avg) (percentage) 1.620 33.88%
464.h264ref (max) 1188.000 -19.73%
464.h264ref (max) (percentage) 8.340 -12.49%
464.h264ref (unexplained diff vs previous) 1282.000 -5.18%
464.h264ref (unexplained diff vs previous) (percentage) 8.990 3.33%
470.lbm 483.000 -1.23%
470.lbm (avg) 483.000 -1.23%
470.lbm (avg) (percentage) 3.960 10.92%
470.lbm (max) 1366.000 -19.84%
470.lbm (max) (percentage) 11.180 -9.98%
470.lbm (unexplained diff vs previous) 1502.000 -
470.lbm (unexplained diff vs previous) (percentage) 12.290 11.22%
471.omnetpp 259.000 8.37%
471.omnetpp (avg) 259.000 8.37%
471.omnetpp (avg) (percentage) 2.690 22.83%
471.omnetpp (max) 1168.000 -20.54%
471.omnetpp (max) (percentage) 12.110 -10.03%
471.omnetpp (unexplained diff vs previous) 1277.000 -1.47%
471.omnetpp (unexplained diff vs previous) (percentage) 13.240 11.54%
473.astar 292.000 17.74%
473.astar (avg) 292.000 17.74%
473.astar (avg) (percentage) 2.270 30.46%
473.astar (max) 1273.000 -18.92%
473.astar (max) (percentage) 9.900 -10.00%
473.astar (unexplained diff vs previous) 1408.000 -
473.astar (unexplained diff vs previous) (percentage) 10.940 10.39%
482.sphinx3 629.000 -6.95%
482.sphinx3 (avg) 629.000 -6.95%
482.sphinx3 (avg) (percentage) 2.570 -
482.sphinx3 (max) 1802.000 -12.14%
482.sphinx3 (max) (percentage) 7.360 -5.52%
483.xalancbmk 369.000 10.48%
483.xalancbmk (avg) 369.000 10.48%
483.xalancbmk (avg) (percentage) 4.800 34.08%
483.xalancbmk (max) 1504.000 -22.07%
483.xalancbmk (max) (percentage) 19.530 -5.56%
483.xalancbmk (unexplained diff vs previous) 1631.000 1.94%
483.xalancbmk (unexplained diff vs previous) (percentage) 21.170 23.51%
Geometric Mean 55.759 5.53%