Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=82d23ca811ab365217fdc9bda215e23adb5e4a30 (+ 77 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/637e3668fdc17c4e226538fb14f9fab225433d01 (+ 142 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=264db94040c463d9bc356101595d89335586875e (+ 25 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7c38e9d294b9de3d49422cf0f263f1779822956f (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-arm-spec2k6-Os_LTO/165/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0165 (3-changed-components) 2022-10-05T15:37:46 0:00:00
Previous 0161 (3-changed-components) 2024-03-23T05:24:45 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 161 139
Performance Improvements 71 76
Added Tests 7 0
Unchanged Tests 997 1021
Total Tests 1236

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm 6.11% 10221.000 10845.000 - 0.00% -
434.zeusmp 3.68% 139198.000 144324.000 - 2.31% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 47582.54% 63.000 30040.000 - -7.54% -
403.gcc 14713.11% 61.000 9036.000 - 1.64% -
462.libquantum 8127.67% 206.000 16949.000 - -0.33% -
482.sphinx3 4055.14% 905.000 37604.000 - 2.78% -
450.soplex 2539.86% 592.000 15628.000 - -0.52% -
444.namd 1595.20% 896.000 15189.000 - -4.81% -
453.povray 1295.04% 544.000 7589.000 - 2.62% -
429.mcf 1150.32% 942.000 11778.000 - 0.43% -
433.milc 1149.59% 1101.000 13758.000 - 0.66% -
436.cactusADM 793.20% 2603.000 23250.000 - -4.70% -
434.zeusmp 639.91% 2781.000 20577.000 - -1.70% -
400.perlbench 581.88% 1661.000 11326.000 - 0.99% -
401.bzip2 475.76% 2946.000 16962.000 - -0.05% -
447.dealII 384.94% 1866.000 9049.000 - -0.57% -
470.lbm 357.46% 3749.000 17150.000 - 5.14% -
456.hmmer 335.44% 4543.000 19782.000 - 4.14% -
459.GemsFDTD 262.50% 7176.000 26013.000 - 2.56% -
481.wrf 257.76% 6418.000 22961.000 - 4.41% -
471.omnetpp 227.74% 2819.000 9239.000 - -0.28% -
473.astar 167.41% 4830.000 12916.000 - -0.52% -
410.bwaves 147.58% 5931.000 14684.000 - -0.41% -
445.gobmk 143.73% 5102.000 12435.000 - 0.31% -
464.h264ref 142.23% 6213.000 15050.000 - -1.04% -
435.gromacs 117.57% 7621.000 16581.000 - -1.61% -
458.sjeng 104.28% 7872.000 16081.000 - 0.39% -
416.gamess 92.45% 14805.000 28492.000 - -3.12% -
437.leslie3d 46.01% 12152.000 17743.000 - -1.81% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix 80850.00% 2.000 1619.000 - 145.68% -
454.calculix (avg) 80850.00% 2.000 1619.000 - 145.68% -
454.calculix (max) 57466.67% 3.000 1727.000 - 534.93% -
453.povray (unexplained diff vs previous) 21900.00% 1.000 220.000 - 30.18% -
482.sphinx3 (unexplained diff vs previous) 16037.50% 8.000 1291.000 - 15.47% -
482.sphinx3 (max) 12063.64% 11.000 1338.000 - 16.15% -
481.wrf (unexplained diff vs previous) 11155.56% 9.000 1013.000 - 13.31% -
433.milc (unexplained diff vs previous) 9700.00% 2.000 196.000 - 104.17% -
444.namd (max) 9666.67% 6.000 586.000 - -33.33% -
436.cactusADM (max) 8988.89% 9.000 818.000 - -33.55% -
482.sphinx3 7970.59% 17.000 1372.000 - 59.72% -
482.sphinx3 (avg) 7970.59% 17.000 1372.000 - 59.72% -
403.gcc 7400.00% 1.000 75.000 - 97.37% -
403.gcc (avg) 7400.00% 1.000 75.000 - 97.37% -
433.milc (max) 6533.33% 3.000 199.000 - 105.15% -
470.lbm (unexplained diff vs previous) 6323.08% 13.000 835.000 - 1.58% -
481.wrf (max) 4718.18% 22.000 1060.000 - 15.97% -
434.zeusmp (unexplained diff vs previous) 4400.00% 2.000 90.000 - -80.85% -
470.lbm (max) 4329.17% 24.000 1063.000 - 19.04% -
444.namd 4000.00% 13.000 533.000 - 28.74% -
444.namd (avg) 4000.00% 13.000 533.000 - 28.74% -
481.wrf (unexplained diff vs previous) (percentage) 3050.00% 0.140 4.410 - 8.35% -
416.gamess (max) 2952.00% 25.000 763.000 - -17.33% -
453.povray (max) 2725.00% 8.000 226.000 - 18.32% -
459.GemsFDTD (unexplained diff vs previous) 2488.00% 25.000 647.000 - 10.79% -
462.libquantum (max) 2400.00% 1.000 25.000 - 92.31% -
453.povray 2100.00% 9.000 198.000 - 75.22% -
453.povray (avg) 2100.00% 9.000 198.000 - 75.22% -
403.gcc (max) 1960.00% 5.000 103.000 - 98.08% -
436.cactusADM 1845.71% 35.000 681.000 - 16.41% -
436.cactusADM (avg) 1845.71% 35.000 681.000 - 16.41% -
434.zeusmp (max) 1720.00% 20.000 364.000 - -24.32% -
462.libquantum 1633.33% 3.000 52.000 - 62.50% -
462.libquantum (avg) 1633.33% 3.000 52.000 - 62.50% -
410.bwaves (unexplained diff vs previous) 1600.00% 15.000 255.000 - -0.78% -
464.h264ref (unexplained diff vs previous) 1600.00% 1.000 17.000 - -70.69% -
459.GemsFDTD (max) 1517.07% 41.000 663.000 - 14.71% -
453.povray (unexplained diff vs previous) (percentage) 1511.11% 0.180 2.900 - 26.64% -
416.gamess (max) (percentage) 1476.47% 0.170 2.680 - -14.65% -
470.lbm 1309.84% 61.000 860.000 - 41.45% -
470.lbm (avg) 1309.84% 61.000 860.000 - 41.45% -
470.lbm (unexplained diff vs previous) (percentage) 1291.43% 0.350 4.870 - -3.37% -
481.wrf (max) (percentage) 1220.00% 0.350 4.620 - 11.06% -
436.cactusADM (unexplained diff vs previous) 900.00% 1.000 10.000 - -99.15% -
444.namd (unexplained diff vs previous) 900.00% 3.000 30.000 - -96.40% -
470.lbm (max) (percentage) 839.39% 0.660 6.200 - 13.14% -
436.cactusADM (max) (percentage) 826.32% 0.380 3.520 - -30.30% -
450.soplex (max) 814.29% 7.000 64.000 - -7.25% -
433.milc 744.44% 18.000 152.000 - 61.70% -
433.milc (avg) 744.44% 18.000 152.000 - 61.70% -
481.wrf 716.95% 118.000 964.000 - 70.62% -
481.wrf (avg) 716.95% 118.000 964.000 - 70.62% -
433.milc (unexplained diff vs previous) (percentage) 688.89% 0.180 1.420 - 102.86% -
458.sjeng (max) 685.42% 48.000 377.000 - 685.42% -
471.omnetpp (unexplained diff vs previous) 657.14% 7.000 53.000 - -14.52% -
410.bwaves (max) 611.63% 43.000 306.000 - 17.69% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 611.43% 0.350 2.490 - 8.26% -
434.zeusmp 607.50% 40.000 283.000 - 10.98% -
434.zeusmp (avg) 607.50% 40.000 283.000 - 10.98% -
410.bwaves (unexplained diff vs previous) (percentage) 596.00% 0.250 1.740 - 0.00% -
450.soplex (unexplained diff vs previous) 575.00% 4.000 27.000 - -60.87% -
434.zeusmp (unexplained diff vs previous) (percentage) 528.57% 0.070 0.440 - -80.44% -
456.hmmer (max) 510.00% 10.000 61.000 - -37.76% -
444.namd (max) (percentage) 476.12% 0.670 3.860 - -29.95% -
459.GemsFDTD 471.93% 114.000 652.000 - 85.23% -
459.GemsFDTD (avg) 471.93% 114.000 652.000 - 85.23% -
465.tonto (unexplained diff vs previous) (percentage) 456.82% 0.440 2.450 - 116.81% -
464.h264ref (unexplained diff vs previous) (percentage) 450.00% 0.020 0.110 - -71.05% -
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 - -64.29% -
465.tonto (max) (percentage) 392.16% 0.510 2.510 - 46.78% -
433.milc (max) (percentage) 383.33% 0.300 1.450 - 104.23% -
416.gamess 351.20% 125.000 564.000 - 16.29% -
416.gamess (avg) 351.20% 125.000 564.000 - 16.29% -
459.GemsFDTD (max) (percentage) 339.66% 0.580 2.550 - 11.84% -
465.tonto (unexplained diff vs previous) 334.48% 58.000 252.000 - 70.27% -
465.tonto (max) 290.91% 66.000 258.000 - 15.70% -
482.sphinx3 (unexplained diff vs previous) (percentage) 289.77% 0.880 3.430 - 12.09% -
458.sjeng (max) (percentage) 279.03% 0.620 2.350 - 683.33% -
450.soplex 227.78% 18.000 59.000 - 59.46% -
450.soplex (avg) 227.78% 18.000 59.000 - 59.46% -
410.bwaves 221.52% 79.000 254.000 - -12.11% -
410.bwaves (avg) 221.52% 79.000 254.000 - -12.11% -
429.mcf (unexplained diff vs previous) 218.18% 11.000 35.000 - 250.00% -
470.lbm (avg) (percentage) 206.10% 1.640 5.020 - 34.58% -
471.omnetpp 190.74% 54.000 157.000 - 44.04% -
471.omnetpp (avg) 190.74% 54.000 157.000 - 44.04% -
429.mcf 189.09% 55.000 159.000 - 183.93% -
429.mcf (avg) 189.09% 55.000 159.000 - 183.93% -
471.omnetpp (max) 188.57% 35.000 101.000 - -41.28% -
410.bwaves (max) (percentage) 186.30% 0.730 2.090 - 18.08% -
482.sphinx3 (max) (percentage) 175.97% 1.290 3.560 - 13.02% -
447.dealII (unexplained diff vs previous) 166.67% 3.000 8.000 - -88.24% -
447.dealII (max) 159.26% 27.000 70.000 - -53.33% -
456.hmmer (unexplained diff vs previous) 145.45% 11.000 27.000 - -72.45% -
434.zeusmp (max) (percentage) 142.47% 0.730 1.770 - -23.04% -
435.gromacs (max) 137.23% 94.000 223.000 - -24.66% -
416.gamess (avg) (percentage) 132.94% 0.850 1.980 - 20.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 128.00% 0.250 0.570 - -14.93% -
481.wrf (avg) (percentage) 127.03% 1.850 4.200 - 63.42% -
444.namd (avg) (percentage) 126.45% 1.550 3.510 - 35.00% -
464.h264ref (max) 121.43% 14.000 31.000 - -47.46% -
436.cactusADM (avg) (percentage) 113.87% 1.370 2.930 - 22.08% -
447.dealII 113.51% 37.000 79.000 - 0.00% -
447.dealII (avg) 113.51% 37.000 79.000 - 0.00% -
456.hmmer 113.51% 37.000 79.000 - 41.07% -
456.hmmer (avg) 113.51% 37.000 79.000 - 41.07% -
453.povray (max) (percentage) 99.33% 1.500 2.990 - 15.44% -
482.sphinx3 (avg) (percentage) 87.18% 1.950 3.650 - 55.32% -
473.astar (unexplained diff vs previous) 81.82% 33.000 60.000 - -1.64% -
464.h264ref 74.63% 67.000 117.000 - 98.31% -
464.h264ref (avg) 74.63% 67.000 117.000 - 98.31% -
465.tonto (avg) (percentage) 72.41% 0.870 1.500 - 31.58% -
435.gromacs 63.58% 151.000 247.000 - 54.37% -
435.gromacs (avg) 63.58% 151.000 247.000 - 54.37% -
459.GemsFDTD (avg) (percentage) 56.87% 1.600 2.510 - 80.58% -
454.calculix (avg) (percentage) 56.69% 3.440 5.390 - 165.52% -
453.povray (avg) (percentage) 48.02% 1.770 2.620 - 71.24% -
400.perlbench (max) 46.94% 49.000 72.000 - -19.10% -
400.perlbench 40.62% 32.000 45.000 - 4.65% -
400.perlbench (avg) 40.62% 32.000 45.000 - 4.65% -
465.tonto 36.28% 113.000 154.000 - 4.05% -
465.tonto (avg) 36.28% 113.000 154.000 - 4.05% -
473.astar (max) 34.09% 44.000 59.000 - -3.28% -
456.hmmer (max) (percentage) 29.17% 0.240 0.310 - -40.38% -
410.bwaves (avg) (percentage) 29.10% 1.340 1.730 - -11.73% -
401.bzip2 28.36% 67.000 86.000 - 91.11% -
401.bzip2 (avg) 28.36% 67.000 86.000 - 91.11% -
458.sjeng 27.40% 73.000 93.000 - 158.33% -
458.sjeng (avg) 27.40% 73.000 93.000 - 158.33% -
454.calculix (max) (percentage) 13.19% 5.080 5.750 - 584.52% -
435.gromacs (max) (percentage) 8.87% 1.240 1.350 - -23.30% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -3.33% 30.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.01% 49564.000 48073.000 - 0.15% -
453.povray -2.01% 499105.000 489087.000 - 0.02% -
416.gamess -1.67% 4631717.000 4554456.000 - -0.01% -
473.astar -1.47% 15781.000 15549.000 - 0.00% -
403.gcc -1.14% 1603710.000 1585361.000 - -0.30% -
447.dealII -1.07% 193202.000 191138.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto -21.48% 13094.000 10281.000 - -21.18% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) -96.61% 0.590 0.020 - -86.67% -
437.leslie3d (unexplained diff vs previous) (percentage) -96.55% 2.900 0.100 - -90.29% -
429.mcf (max) (percentage) -95.13% 9.860 0.480 - 50.00% -
437.leslie3d (unexplained diff vs previous) -94.89% 352.000 18.000 - -90.37% -
462.libquantum (unexplained diff vs previous) (percentage) -93.88% 0.490 0.030 - -62.50% -
445.gobmk (unexplained diff vs previous) -93.33% 30.000 2.000 - -88.89% -
401.bzip2 (unexplained diff vs previous) (percentage) -93.10% 0.580 0.040 - -90.24% -
401.bzip2 (max) (percentage) -92.42% 1.980 0.150 - -62.50% -
450.soplex (avg) (percentage) -87.82% 3.120 0.380 - 58.33% -
403.gcc (max) (percentage) -87.49% 9.190 1.150 - 94.92% -
435.gromacs (unexplained diff vs previous) (percentage) -86.89% 1.220 0.160 - -90.75% -
400.perlbench (unexplained diff vs previous) (percentage) -85.81% 2.890 0.410 - 32.26% -
445.gobmk (avg) (percentage) -83.90% 1.180 0.190 - -13.64% -
462.libquantum (avg) (percentage) -81.44% 1.670 0.310 - 63.16% -
416.gamess (unexplained diff vs previous) (percentage) -80.00% 0.050 0.010 - -99.67% -
400.perlbench (avg) (percentage) -79.80% 1.980 0.400 - 2.56% -
400.perlbench (max) (percentage) -78.52% 2.980 0.640 - -20.00% -
401.bzip2 (avg) (percentage) -77.63% 2.280 0.510 - 88.89% -
429.mcf (avg) (percentage) -77.27% 5.940 1.350 - 181.25% -
450.soplex (unexplained diff vs previous) (percentage) -75.00% 0.680 0.170 - -61.36% -
429.mcf (unexplained diff vs previous) (percentage) -74.36% 1.170 0.300 - 233.33% -
435.gromacs (unexplained diff vs previous) -70.97% 93.000 27.000 - -90.75% -
450.soplex (max) (percentage) -69.63% 1.350 0.410 - -6.82% -
462.libquantum (max) (percentage) -69.39% 0.490 0.150 - 87.50% -
445.gobmk (max) (percentage) -67.74% 0.620 0.200 - -25.93% -
473.astar (avg) (percentage) -67.40% 1.810 0.590 - 47.50% -
403.gcc (avg) (percentage) -64.56% 2.370 0.840 - 95.35% -
416.gamess (unexplained diff vs previous) -62.50% 8.000 3.000 - -99.67% -
445.gobmk -61.67% 60.000 23.000 - -14.81% -
445.gobmk (avg) -61.67% 60.000 23.000 - -14.81% -
483.xalancbmk (max) (percentage) -60.00% 1.550 0.620 - -32.61% -
401.bzip2 (unexplained diff vs previous) -58.82% 17.000 7.000 - -89.86% -
401.bzip2 (max) -56.90% 58.000 25.000 - -62.69% -
447.dealII (avg) (percentage) -55.78% 1.990 0.880 - 1.15% -
458.sjeng (unexplained diff vs previous) (percentage) -54.55% 0.110 0.050 - -83.33% -
456.hmmer (avg) (percentage) -51.22% 0.820 0.400 - 33.33% -
473.astar (max) (percentage) -50.54% 0.930 0.460 - -2.13% -
437.leslie3d (max) (percentage) -49.14% 9.300 4.730 - 52.58% -
447.dealII (max) (percentage) -47.65% 1.490 0.780 - -52.73% -
437.leslie3d (avg) (percentage) -45.22% 4.180 2.290 - 37.13% -
447.dealII (unexplained diff vs previous) (percentage) -43.75% 0.160 0.090 - -88.00% -
456.hmmer (unexplained diff vs previous) (percentage) -41.67% 0.240 0.140 - -73.08% -
444.namd (unexplained diff vs previous) (percentage) -39.39% 0.330 0.200 - -96.18% -
429.mcf (max) -39.13% 92.000 56.000 - 51.35% -
458.sjeng (avg) (percentage) -37.63% 0.930 0.580 - 152.17% -
433.milc (avg) (percentage) -34.32% 1.690 1.110 - 60.87% -
473.astar (unexplained diff vs previous) (percentage) -32.35% 0.680 0.460 - -2.13% -
464.h264ref (avg) (percentage) -27.78% 1.080 0.780 - 100.00% -
437.leslie3d (max) -25.75% 1130.000 839.000 - 49.82% -
435.gromacs (avg) (percentage) -25.13% 1.990 1.490 - 56.84% -
445.gobmk (max) -22.58% 31.000 24.000 - -27.27% -
437.leslie3d -19.92% 507.000 406.000 - 34.88% -
437.leslie3d (avg) -19.92% 507.000 406.000 - 34.88% -
471.omnetpp (max) (percentage) -13.39% 1.270 1.100 - -40.86% -
471.omnetpp (avg) (percentage) -12.82% 1.950 1.700 - 44.07% -
473.astar -12.64% 87.000 76.000 - 49.02% -
473.astar (avg) -12.64% 87.000 76.000 - 49.02% -
464.h264ref (max) (percentage) -12.50% 0.240 0.210 - -46.15% -
458.sjeng (unexplained diff vs previous) -11.11% 9.000 8.000 - -83.33% -
483.xalancbmk (avg) (percentage) -7.89% 1.140 1.050 - 87.50% -
434.zeusmp (avg) (percentage) -4.17% 1.440 1.380 - 13.11% -
400.perlbench (unexplained diff vs previous) -2.08% 48.000 47.000 - 34.29% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 3.57% 28.000 29.000 - 0.00% -
nb_execution_successful 3.57% 28.000 29.000 - 0.00% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 2.31% 141060.000 144324.000 - 3.68% -
450.soplex 1.10% 135596.000 137094.000 - 0.06% -
459.GemsFDTD 1.07% 195766.000 197862.000 - -0.37% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
470.lbm 5.14% 16312.000 17150.000 - 357.46% -
481.wrf 4.41% 21991.000 22961.000 - 257.76% -
456.hmmer 4.14% 18995.000 19782.000 - 335.44% -
482.sphinx3 2.78% 36586.000 37604.000 - 4055.14% -
453.povray 2.62% 7395.000 7589.000 - 1295.04% -
459.GemsFDTD 2.56% 25364.000 26013.000 - 262.50% -
403.gcc 1.64% 8890.000 9036.000 - 14713.11% -
483.xalancbmk 1.48% 8027.000 8146.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (max) 685.42% 48.000 377.000 - 685.42% -
458.sjeng (max) (percentage) 683.33% 0.300 2.350 - 279.03% -
454.calculix (unexplained diff vs previous) (percentage) 625.33% 0.750 5.440 - 0.00% -
454.calculix (max) (percentage) 584.52% 0.840 5.750 - 13.19% -
454.calculix (unexplained diff vs previous) 569.26% 244.000 1633.000 - 0.00% -
454.calculix (max) 534.93% 272.000 1727.000 - 57466.67% -
429.mcf (unexplained diff vs previous) 250.00% 10.000 35.000 - 218.18% -
429.mcf (unexplained diff vs previous) (percentage) 233.33% 0.090 0.300 - -74.36% -
429.mcf 183.93% 56.000 159.000 - 189.09% -
429.mcf (avg) 183.93% 56.000 159.000 - 189.09% -
429.mcf (avg) (percentage) 181.25% 0.480 1.350 - -77.27% -
454.calculix (avg) (percentage) 165.52% 2.030 5.390 - 56.69% -
458.sjeng 158.33% 36.000 93.000 - 27.40% -
458.sjeng (avg) 158.33% 36.000 93.000 - 27.40% -
458.sjeng (avg) (percentage) 152.17% 0.230 0.580 - -37.63% -
454.calculix 145.68% 659.000 1619.000 - 80850.00% -
454.calculix (avg) 145.68% 659.000 1619.000 - 80850.00% -
465.tonto (unexplained diff vs previous) (percentage) 116.81% 1.130 2.450 - 456.82% -
433.milc (max) 105.15% 97.000 199.000 - 6533.33% -
433.milc (max) (percentage) 104.23% 0.710 1.450 - 383.33% -
433.milc (unexplained diff vs previous) 104.17% 96.000 196.000 - 9700.00% -
433.milc (unexplained diff vs previous) (percentage) 102.86% 0.700 1.420 - 688.89% -
464.h264ref (avg) (percentage) 100.00% 0.390 0.780 - -27.78% -
464.h264ref 98.31% 59.000 117.000 - 74.63% -
464.h264ref (avg) 98.31% 59.000 117.000 - 74.63% -
403.gcc (max) 98.08% 52.000 103.000 - 1960.00% -
403.gcc (unexplained diff vs previous) 98.08% 52.000 103.000 - 0.00% -
403.gcc 97.37% 38.000 75.000 - 7400.00% -
403.gcc (avg) 97.37% 38.000 75.000 - 7400.00% -
403.gcc (unexplained diff vs previous) (percentage) 96.55% 0.580 1.140 - 0.00% -
403.gcc (avg) (percentage) 95.35% 0.430 0.840 - -64.56% -
403.gcc (max) (percentage) 94.92% 0.590 1.150 - -87.49% -
483.xalancbmk 93.18% 44.000 85.000 - 0.00% -
483.xalancbmk (avg) 93.18% 44.000 85.000 - 0.00% -
462.libquantum (max) 92.31% 13.000 25.000 - 2400.00% -
401.bzip2 91.11% 45.000 86.000 - 28.36% -
401.bzip2 (avg) 91.11% 45.000 86.000 - 28.36% -
401.bzip2 (avg) (percentage) 88.89% 0.270 0.510 - -77.63% -
462.libquantum (max) (percentage) 87.50% 0.080 0.150 - -69.39% -
483.xalancbmk (avg) (percentage) 87.50% 0.560 1.050 - -7.89% -
459.GemsFDTD 85.23% 352.000 652.000 - 471.93% -
459.GemsFDTD (avg) 85.23% 352.000 652.000 - 471.93% -
459.GemsFDTD (avg) (percentage) 80.58% 1.390 2.510 - 56.87% -
453.povray 75.22% 113.000 198.000 - 2100.00% -
453.povray (avg) 75.22% 113.000 198.000 - 2100.00% -
453.povray (avg) (percentage) 71.24% 1.530 2.620 - 48.02% -
481.wrf 70.62% 565.000 964.000 - 716.95% -
481.wrf (avg) 70.62% 565.000 964.000 - 716.95% -
465.tonto (unexplained diff vs previous) 70.27% 148.000 252.000 - 334.48% -
481.wrf (avg) (percentage) 63.42% 2.570 4.200 - 127.03% -
462.libquantum (avg) (percentage) 63.16% 0.190 0.310 - -81.44% -
462.libquantum 62.50% 32.000 52.000 - 1633.33% -
462.libquantum (avg) 62.50% 32.000 52.000 - 1633.33% -
433.milc 61.70% 94.000 152.000 - 744.44% -
433.milc (avg) 61.70% 94.000 152.000 - 744.44% -
433.milc (avg) (percentage) 60.87% 0.690 1.110 - -34.32% -
482.sphinx3 59.72% 859.000 1372.000 - 7970.59% -
482.sphinx3 (avg) 59.72% 859.000 1372.000 - 7970.59% -
450.soplex 59.46% 37.000 59.000 - 227.78% -
450.soplex (avg) 59.46% 37.000 59.000 - 227.78% -
450.soplex (avg) (percentage) 58.33% 0.240 0.380 - -87.82% -
435.gromacs (avg) (percentage) 56.84% 0.950 1.490 - -25.13% -
482.sphinx3 (avg) (percentage) 55.32% 2.350 3.650 - 87.18% -
435.gromacs 54.37% 160.000 247.000 - 63.58% -
435.gromacs (avg) 54.37% 160.000 247.000 - 63.58% -
437.leslie3d (max) (percentage) 52.58% 3.100 4.730 - -49.14% -
429.mcf (max) 51.35% 37.000 56.000 - -39.13% -
429.mcf (max) (percentage) 50.00% 0.320 0.480 - -95.13% -
437.leslie3d (max) 49.82% 560.000 839.000 - -25.75% -
473.astar 49.02% 51.000 76.000 - -12.64% -
473.astar (avg) 49.02% 51.000 76.000 - -12.64% -
473.astar (avg) (percentage) 47.50% 0.400 0.590 - -67.40% -
465.tonto (max) (percentage) 46.78% 1.710 2.510 - 392.16% -
471.omnetpp (avg) (percentage) 44.07% 1.180 1.700 - -12.82% -
471.omnetpp 44.04% 109.000 157.000 - 190.74% -
471.omnetpp (avg) 44.04% 109.000 157.000 - 190.74% -
470.lbm 41.45% 608.000 860.000 - 1309.84% -
470.lbm (avg) 41.45% 608.000 860.000 - 1309.84% -
456.hmmer 41.07% 56.000 79.000 - 113.51% -
456.hmmer (avg) 41.07% 56.000 79.000 - 113.51% -
437.leslie3d (avg) (percentage) 37.13% 1.670 2.290 - -45.22% -
444.namd (avg) (percentage) 35.00% 2.600 3.510 - 126.45% -
437.leslie3d 34.88% 301.000 406.000 - -19.92% -
437.leslie3d (avg) 34.88% 301.000 406.000 - -19.92% -
470.lbm (avg) (percentage) 34.58% 3.730 5.020 - 206.10% -
400.perlbench (unexplained diff vs previous) 34.29% 35.000 47.000 - -2.08% -
456.hmmer (avg) (percentage) 33.33% 0.300 0.400 - -51.22% -
400.perlbench (unexplained diff vs previous) (percentage) 32.26% 0.310 0.410 - -85.81% -
465.tonto (avg) (percentage) 31.58% 1.140 1.500 - 72.41% -
453.povray (unexplained diff vs previous) 30.18% 169.000 220.000 - 21900.00% -
444.namd 28.74% 414.000 533.000 - 4000.00% -
444.namd (avg) 28.74% 414.000 533.000 - 4000.00% -
453.povray (unexplained diff vs previous) (percentage) 26.64% 2.290 2.900 - 1511.11% -
436.cactusADM (avg) (percentage) 22.08% 2.400 2.930 - 113.87% -
416.gamess (avg) (percentage) 20.00% 1.650 1.980 - 132.94% -
470.lbm (max) 19.04% 893.000 1063.000 - 4329.17% -
453.povray (max) 18.32% 191.000 226.000 - 2725.00% -
410.bwaves (max) (percentage) 18.08% 1.770 2.090 - 186.30% -
410.bwaves (max) 17.69% 260.000 306.000 - 611.63% -
436.cactusADM 16.41% 585.000 681.000 - 1845.71% -
436.cactusADM (avg) 16.41% 585.000 681.000 - 1845.71% -
416.gamess 16.29% 485.000 564.000 - 351.20% -
416.gamess (avg) 16.29% 485.000 564.000 - 351.20% -
482.sphinx3 (max) 16.15% 1152.000 1338.000 - 12063.64% -
481.wrf (max) 15.97% 914.000 1060.000 - 4718.18% -
465.tonto (max) 15.70% 223.000 258.000 - 290.91% -
482.sphinx3 (unexplained diff vs previous) 15.47% 1118.000 1291.000 - 16037.50% -
453.povray (max) (percentage) 15.44% 2.590 2.990 - 99.33% -
459.GemsFDTD (max) 14.71% 578.000 663.000 - 1517.07% -
481.wrf (unexplained diff vs previous) 13.31% 894.000 1013.000 - 11155.56% -
470.lbm (max) (percentage) 13.14% 5.480 6.200 - 839.39% -
434.zeusmp (avg) (percentage) 13.11% 1.220 1.380 - -4.17% -
482.sphinx3 (max) (percentage) 13.02% 3.150 3.560 - 175.97% -
482.sphinx3 (unexplained diff vs previous) (percentage) 12.09% 3.060 3.430 - 289.77% -
459.GemsFDTD (max) (percentage) 11.84% 2.280 2.550 - 339.66% -
481.wrf (max) (percentage) 11.06% 4.160 4.620 - 1220.00% -
434.zeusmp 10.98% 255.000 283.000 - 607.50% -
434.zeusmp (avg) 10.98% 255.000 283.000 - 607.50% -
459.GemsFDTD (unexplained diff vs previous) 10.79% 584.000 647.000 - 2488.00% -
481.wrf (unexplained diff vs previous) (percentage) 8.35% 4.070 4.410 - 3050.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 8.26% 2.300 2.490 - 611.43% -
400.perlbench 4.65% 43.000 45.000 - 40.62% -
400.perlbench (avg) 4.65% 43.000 45.000 - 40.62% -
465.tonto 4.05% 148.000 154.000 - 36.28% -
465.tonto (avg) 4.05% 148.000 154.000 - 36.28% -
400.perlbench (avg) (percentage) 2.56% 0.390 0.400 - -79.80% -
470.lbm (unexplained diff vs previous) 1.58% 822.000 835.000 - 6323.08% -
447.dealII (avg) (percentage) 1.15% 0.870 0.880 - -55.78% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -21.18% 13044.000 10281.000 - -21.48% -
454.calculix -7.54% 32491.000 30040.000 - 47582.54% -
444.namd -4.81% 15957.000 15189.000 - 1595.20% -
436.cactusADM -4.70% 24396.000 23250.000 - 793.20% -
416.gamess -3.12% 29409.000 28492.000 - 92.45% -
437.leslie3d -1.81% 18070.000 17743.000 - 46.01% -
434.zeusmp -1.70% 20932.000 20577.000 - 639.91% -
435.gromacs -1.61% 16853.000 16581.000 - 117.57% -
464.h264ref -1.04% 15208.000 15050.000 - 142.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
416.gamess (unexplained diff vs previous) (percentage) -99.67% 3.050 0.010 - -80.00% -
416.gamess (unexplained diff vs previous) -99.67% 896.000 3.000 - -62.50% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.17% 4.810 0.040 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.15% 1173.000 10.000 - 900.00% -
444.namd (unexplained diff vs previous) -96.40% 834.000 30.000 - 900.00% -
444.namd (unexplained diff vs previous) (percentage) -96.18% 5.230 0.200 - -39.39% -
435.gromacs (unexplained diff vs previous) -90.75% 292.000 27.000 - -70.97% -
435.gromacs (unexplained diff vs previous) (percentage) -90.75% 1.730 0.160 - -86.89% -
437.leslie3d (unexplained diff vs previous) -90.37% 187.000 18.000 - -94.89% -
437.leslie3d (unexplained diff vs previous) (percentage) -90.29% 1.030 0.100 - -96.55% -
401.bzip2 (unexplained diff vs previous) (percentage) -90.24% 0.410 0.040 - -93.10% -
401.bzip2 (unexplained diff vs previous) -89.86% 69.000 7.000 - -58.82% -
445.gobmk (unexplained diff vs previous) -88.89% 18.000 2.000 - -93.33% -
447.dealII (unexplained diff vs previous) -88.24% 68.000 8.000 - 166.67% -
447.dealII (unexplained diff vs previous) (percentage) -88.00% 0.750 0.090 - -43.75% -
445.gobmk (unexplained diff vs previous) (percentage) -86.67% 0.150 0.020 - -96.61% -
458.sjeng (unexplained diff vs previous) -83.33% 48.000 8.000 - -11.11% -
458.sjeng (unexplained diff vs previous) (percentage) -83.33% 0.300 0.050 - -54.55% -
434.zeusmp (unexplained diff vs previous) -80.85% 470.000 90.000 - 4400.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -80.44% 2.250 0.440 - 528.57% -
456.hmmer (unexplained diff vs previous) (percentage) -73.08% 0.520 0.140 - -41.67% -
456.hmmer (unexplained diff vs previous) -72.45% 98.000 27.000 - 145.45% -
464.h264ref (unexplained diff vs previous) (percentage) -71.05% 0.380 0.110 - 450.00% -
464.h264ref (unexplained diff vs previous) -70.69% 58.000 17.000 - 1600.00% -
462.libquantum (unexplained diff vs previous) -64.29% 14.000 5.000 - 400.00% -
401.bzip2 (max) -62.69% 67.000 25.000 - -56.90% -
401.bzip2 (max) (percentage) -62.50% 0.400 0.150 - -92.42% -
462.libquantum (unexplained diff vs previous) (percentage) -62.50% 0.080 0.030 - -93.88% -
450.soplex (unexplained diff vs previous) (percentage) -61.36% 0.440 0.170 - -75.00% -
450.soplex (unexplained diff vs previous) -60.87% 69.000 27.000 - 575.00% -
447.dealII (max) -53.33% 150.000 70.000 - 159.26% -
447.dealII (max) (percentage) -52.73% 1.650 0.780 - -47.65% -
464.h264ref (max) -47.46% 59.000 31.000 - 121.43% -
464.h264ref (max) (percentage) -46.15% 0.390 0.210 - -12.50% -
471.omnetpp (max) -41.28% 172.000 101.000 - 188.57% -
471.omnetpp (max) (percentage) -40.86% 1.860 1.100 - -13.39% -
456.hmmer (max) (percentage) -40.38% 0.520 0.310 - 29.17% -
456.hmmer (max) -37.76% 98.000 61.000 - 510.00% -
436.cactusADM (max) -33.55% 1231.000 818.000 - 8988.89% -
444.namd (max) -33.33% 879.000 586.000 - 9666.67% -
483.xalancbmk (max) (percentage) -32.61% 0.920 0.620 - -60.00% -
483.xalancbmk (max) -31.51% 73.000 50.000 - 0.00% -
436.cactusADM (max) (percentage) -30.30% 5.050 3.520 - 826.32% -
444.namd (max) (percentage) -29.95% 5.510 3.860 - 476.12% -
445.gobmk (max) -27.27% 33.000 24.000 - -22.58% -
445.gobmk (max) (percentage) -25.93% 0.270 0.200 - -67.74% -
435.gromacs (max) -24.66% 296.000 223.000 - 137.23% -
434.zeusmp (max) -24.32% 481.000 364.000 - 1720.00% -
435.gromacs (max) (percentage) -23.30% 1.760 1.350 - 8.87% -
434.zeusmp (max) (percentage) -23.04% 2.300 1.770 - 142.47% -
400.perlbench (max) (percentage) -20.00% 0.800 0.640 - -78.52% -
400.perlbench (max) -19.10% 89.000 72.000 - 46.94% -
416.gamess (max) -17.33% 923.000 763.000 - 2952.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -14.93% 0.670 0.570 - 128.00% -
445.gobmk -14.81% 27.000 23.000 - -61.67% -
445.gobmk (avg) -14.81% 27.000 23.000 - -61.67% -
416.gamess (max) (percentage) -14.65% 3.140 2.680 - 1476.47% -
471.omnetpp (unexplained diff vs previous) -14.52% 62.000 53.000 - 657.14% -
445.gobmk (avg) (percentage) -13.64% 0.220 0.190 - -83.90% -
410.bwaves -12.11% 289.000 254.000 - 221.52% -
410.bwaves (avg) -12.11% 289.000 254.000 - 221.52% -
410.bwaves (avg) (percentage) -11.73% 1.960 1.730 - 29.10% -
450.soplex (max) -7.25% 69.000 64.000 - 814.29% -
450.soplex (max) (percentage) -6.82% 0.440 0.410 - -69.63% -
470.lbm (unexplained diff vs previous) (percentage) -3.37% 5.040 4.870 - 1291.43% -
473.astar (max) -3.28% 61.000 59.000 - 34.09% -
473.astar (unexplained diff vs previous) -1.64% 61.000 60.000 - 81.82% -


Report Time: 0.39s
Name Current %
400.perlbench 11326.000 581.88%
401.bzip2 16962.000 475.76%
403.gcc 9036.000 14713.11%
410.bwaves 14684.000 147.58%
416.gamess 28492.000 92.45%
429.mcf 11778.000 1150.32%
433.milc 13758.000 1149.59%
434.zeusmp 20577.000 639.91%
435.gromacs 16581.000 117.57%
436.cactusADM 23250.000 793.20%
437.leslie3d 17743.000 46.01%
444.namd 15189.000 1595.20%
445.gobmk 12435.000 143.73%
447.dealII 9049.000 384.94%
450.soplex 15628.000 2539.86%
453.povray 7589.000 1295.04%
454.calculix 30040.000 47582.54%
456.hmmer 19782.000 335.44%
458.sjeng 16081.000 104.28%
459.GemsFDTD 26013.000 262.50%
462.libquantum 16949.000 8127.67%
464.h264ref 15050.000 142.23%
465.tonto 10281.000 -21.48%
470.lbm 17150.000 357.46%
471.omnetpp 9239.000 227.74%
473.astar 12916.000 167.41%
481.wrf 22961.000 257.76%
482.sphinx3 37604.000 4055.14%
483.xalancbmk 8146.000 -
Geometric Mean 15473.915 602.40%
Name Current %
400.perlbench 563607.000 -
401.bzip2 33660.000 -
403.gcc 1585361.000 -1.14%
410.bwaves 14714.000 -
416.gamess 4554456.000 -1.67%
429.mcf 7709.000 -
433.milc 47497.000 -
434.zeusmp 144324.000 3.68%
435.gromacs 395282.000 -
436.cactusADM 256992.000 -
437.leslie3d 48073.000 -3.01%
444.namd 162762.000 -
445.gobmk 1088288.000 -
447.dealII 191138.000 -1.07%
450.soplex 137094.000 -
453.povray 489087.000 -2.01%
454.calculix 682043.000 -
456.hmmer 74993.000 -
458.sjeng 81137.000 -
459.GemsFDTD 197862.000 -
462.libquantum 13106.000 -
464.h264ref 301288.000 -
465.tonto 1437933.000 -
470.lbm 10845.000 6.11%
471.omnetpp 297260.000 -
473.astar 15549.000 -1.47%
481.wrf 1540771.000 -
482.sphinx3 80002.000 -
483.xalancbmk 1460034.000 -
Geometric Mean 170175.850 7.72%
Name Current %
nb_compile_successful 29.000 3.57%
nb_execution_successful 29.000 3.57%
nb_total_tests 29.000 -3.33%
Geometric Mean 29.000 1.22%
Name Current %
400.perlbench 45.000 40.62%
400.perlbench (avg) 45.000 40.62%
400.perlbench (avg) (percentage) 0.400 -79.80%
400.perlbench (max) 72.000 46.94%
400.perlbench (max) (percentage) 0.640 -78.52%
400.perlbench (unexplained diff vs previous) 47.000 -2.08%
400.perlbench (unexplained diff vs previous) (percentage) 0.410 -85.81%
401.bzip2 86.000 28.36%
401.bzip2 (avg) 86.000 28.36%
401.bzip2 (avg) (percentage) 0.510 -77.63%
401.bzip2 (max) 25.000 -56.90%
401.bzip2 (max) (percentage) 0.150 -92.42%
401.bzip2 (unexplained diff vs previous) 7.000 -58.82%
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -93.10%
403.gcc 75.000 7400.00%
403.gcc (avg) 75.000 7400.00%
403.gcc (avg) (percentage) 0.840 -64.56%
403.gcc (max) 103.000 1960.00%
403.gcc (max) (percentage) 1.150 -87.49%
403.gcc (unexplained diff vs previous) 103.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.140 -
410.bwaves 254.000 221.52%
410.bwaves (avg) 254.000 221.52%
410.bwaves (avg) (percentage) 1.730 29.10%
410.bwaves (max) 306.000 611.63%
410.bwaves (max) (percentage) 2.090 186.30%
410.bwaves (unexplained diff vs previous) 255.000 1600.00%
410.bwaves (unexplained diff vs previous) (percentage) 1.740 596.00%
416.gamess 564.000 351.20%
416.gamess (avg) 564.000 351.20%
416.gamess (avg) (percentage) 1.980 132.94%
416.gamess (max) 763.000 2952.00%
416.gamess (max) (percentage) 2.680 1476.47%
416.gamess (unexplained diff vs previous) 3.000 -62.50%
416.gamess (unexplained diff vs previous) (percentage) 0.010 -80.00%
429.mcf 159.000 189.09%
429.mcf (avg) 159.000 189.09%
429.mcf (avg) (percentage) 1.350 -77.27%
429.mcf (max) 56.000 -39.13%
429.mcf (max) (percentage) 0.480 -95.13%
429.mcf (unexplained diff vs previous) 35.000 218.18%
429.mcf (unexplained diff vs previous) (percentage) 0.300 -74.36%
433.milc 152.000 744.44%
433.milc (avg) 152.000 744.44%
433.milc (avg) (percentage) 1.110 -34.32%
433.milc (max) 199.000 6533.33%
433.milc (max) (percentage) 1.450 383.33%
433.milc (unexplained diff vs previous) 196.000 9700.00%
433.milc (unexplained diff vs previous) (percentage) 1.420 688.89%
434.zeusmp 283.000 607.50%
434.zeusmp (avg) 283.000 607.50%
434.zeusmp (avg) (percentage) 1.380 -4.17%
434.zeusmp (max) 364.000 1720.00%
434.zeusmp (max) (percentage) 1.770 142.47%
434.zeusmp (unexplained diff vs previous) 90.000 4400.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.440 528.57%
435.gromacs 247.000 63.58%
435.gromacs (avg) 247.000 63.58%
435.gromacs (avg) (percentage) 1.490 -25.13%
435.gromacs (max) 223.000 137.23%
435.gromacs (max) (percentage) 1.350 8.87%
435.gromacs (unexplained diff vs previous) 27.000 -70.97%
435.gromacs (unexplained diff vs previous) (percentage) 0.160 -86.89%
436.cactusADM 681.000 1845.71%
436.cactusADM (avg) 681.000 1845.71%
436.cactusADM (avg) (percentage) 2.930 113.87%
436.cactusADM (max) 818.000 8988.89%
436.cactusADM (max) (percentage) 3.520 826.32%
436.cactusADM (unexplained diff vs previous) 10.000 900.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.040 -
437.leslie3d 406.000 -19.92%
437.leslie3d (avg) 406.000 -19.92%
437.leslie3d (avg) (percentage) 2.290 -45.22%
437.leslie3d (max) 839.000 -25.75%
437.leslie3d (max) (percentage) 4.730 -49.14%
437.leslie3d (unexplained diff vs previous) 18.000 -94.89%
437.leslie3d (unexplained diff vs previous) (percentage) 0.100 -96.55%
444.namd 533.000 4000.00%
444.namd (avg) 533.000 4000.00%
444.namd (avg) (percentage) 3.510 126.45%
444.namd (max) 586.000 9666.67%
444.namd (max) (percentage) 3.860 476.12%
444.namd (unexplained diff vs previous) 30.000 900.00%
444.namd (unexplained diff vs previous) (percentage) 0.200 -39.39%
445.gobmk 23.000 -61.67%
445.gobmk (avg) 23.000 -61.67%
445.gobmk (avg) (percentage) 0.190 -83.90%
445.gobmk (max) 24.000 -22.58%
445.gobmk (max) (percentage) 0.200 -67.74%
445.gobmk (unexplained diff vs previous) 2.000 -93.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -96.61%
447.dealII 79.000 113.51%
447.dealII (avg) 79.000 113.51%
447.dealII (avg) (percentage) 0.880 -55.78%
447.dealII (max) 70.000 159.26%
447.dealII (max) (percentage) 0.780 -47.65%
447.dealII (unexplained diff vs previous) 8.000 166.67%
447.dealII (unexplained diff vs previous) (percentage) 0.090 -43.75%
450.soplex 59.000 227.78%
450.soplex (avg) 59.000 227.78%
450.soplex (avg) (percentage) 0.380 -87.82%
450.soplex (max) 64.000 814.29%
450.soplex (max) (percentage) 0.410 -69.63%
450.soplex (unexplained diff vs previous) 27.000 575.00%
450.soplex (unexplained diff vs previous) (percentage) 0.170 -75.00%
453.povray 198.000 2100.00%
453.povray (avg) 198.000 2100.00%
453.povray (avg) (percentage) 2.620 48.02%
453.povray (max) 226.000 2725.00%
453.povray (max) (percentage) 2.990 99.33%
453.povray (unexplained diff vs previous) 220.000 21900.00%
453.povray (unexplained diff vs previous) (percentage) 2.900 1511.11%
454.calculix 1619.000 80850.00%
454.calculix (avg) 1619.000 80850.00%
454.calculix (avg) (percentage) 5.390 56.69%
454.calculix (max) 1727.000 57466.67%
454.calculix (max) (percentage) 5.750 13.19%
454.calculix (unexplained diff vs previous) 1633.000 -
454.calculix (unexplained diff vs previous) (percentage) 5.440 -
456.hmmer 79.000 113.51%
456.hmmer (avg) 79.000 113.51%
456.hmmer (avg) (percentage) 0.400 -51.22%
456.hmmer (max) 61.000 510.00%
456.hmmer (max) (percentage) 0.310 29.17%
456.hmmer (unexplained diff vs previous) 27.000 145.45%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -41.67%
458.sjeng 93.000 27.40%
458.sjeng (avg) 93.000 27.40%
458.sjeng (avg) (percentage) 0.580 -37.63%
458.sjeng (max) 377.000 685.42%
458.sjeng (max) (percentage) 2.350 279.03%
458.sjeng (unexplained diff vs previous) 8.000 -11.11%
458.sjeng (unexplained diff vs previous) (percentage) 0.050 -54.55%
459.GemsFDTD 652.000 471.93%
459.GemsFDTD (avg) 652.000 471.93%
459.GemsFDTD (avg) (percentage) 2.510 56.87%
459.GemsFDTD (max) 663.000 1517.07%
459.GemsFDTD (max) (percentage) 2.550 339.66%
459.GemsFDTD (unexplained diff vs previous) 647.000 2488.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.490 611.43%
462.libquantum 52.000 1633.33%
462.libquantum (avg) 52.000 1633.33%
462.libquantum (avg) (percentage) 0.310 -81.44%
462.libquantum (max) 25.000 2400.00%
462.libquantum (max) (percentage) 0.150 -69.39%
462.libquantum (unexplained diff vs previous) 5.000 400.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.030 -93.88%
464.h264ref 117.000 74.63%
464.h264ref (avg) 117.000 74.63%
464.h264ref (avg) (percentage) 0.780 -27.78%
464.h264ref (max) 31.000 121.43%
464.h264ref (max) (percentage) 0.210 -12.50%
464.h264ref (unexplained diff vs previous) 17.000 1600.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.110 450.00%
465.tonto 154.000 36.28%
465.tonto (avg) 154.000 36.28%
465.tonto (avg) (percentage) 1.500 72.41%
465.tonto (max) 258.000 290.91%
465.tonto (max) (percentage) 2.510 392.16%
465.tonto (unexplained diff vs previous) 252.000 334.48%
465.tonto (unexplained diff vs previous) (percentage) 2.450 456.82%
470.lbm 860.000 1309.84%
470.lbm (avg) 860.000 1309.84%
470.lbm (avg) (percentage) 5.020 206.10%
470.lbm (max) 1063.000 4329.17%
470.lbm (max) (percentage) 6.200 839.39%
470.lbm (unexplained diff vs previous) 835.000 6323.08%
470.lbm (unexplained diff vs previous) (percentage) 4.870 1291.43%
471.omnetpp 157.000 190.74%
471.omnetpp (avg) 157.000 190.74%
471.omnetpp (avg) (percentage) 1.700 -12.82%
471.omnetpp (max) 101.000 188.57%
471.omnetpp (max) (percentage) 1.100 -13.39%
471.omnetpp (unexplained diff vs previous) 53.000 657.14%
471.omnetpp (unexplained diff vs previous) (percentage) 0.570 128.00%
473.astar 76.000 -12.64%
473.astar (avg) 76.000 -12.64%
473.astar (avg) (percentage) 0.590 -67.40%
473.astar (max) 59.000 34.09%
473.astar (max) (percentage) 0.460 -50.54%
473.astar (unexplained diff vs previous) 60.000 81.82%
473.astar (unexplained diff vs previous) (percentage) 0.460 -32.35%
481.wrf 964.000 716.95%
481.wrf (avg) 964.000 716.95%
481.wrf (avg) (percentage) 4.200 127.03%
481.wrf (max) 1060.000 4718.18%
481.wrf (max) (percentage) 4.620 1220.00%
481.wrf (unexplained diff vs previous) 1013.000 11155.56%
481.wrf (unexplained diff vs previous) (percentage) 4.410 3050.00%
482.sphinx3 1372.000 7970.59%
482.sphinx3 (avg) 1372.000 7970.59%
482.sphinx3 (avg) (percentage) 3.650 87.18%
482.sphinx3 (max) 1338.000 12063.64%
482.sphinx3 (max) (percentage) 3.560 175.97%
482.sphinx3 (unexplained diff vs previous) 1291.000 16037.50%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.430 289.77%
483.xalancbmk 85.000 -
483.xalancbmk (avg) 85.000 -
483.xalancbmk (avg) (percentage) 1.050 -7.89%
483.xalancbmk (max) 50.000 -
483.xalancbmk (max) (percentage) 0.620 -60.00%
Geometric Mean 15.533 217.55%