Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=27c22a4c76f753a68c11db22c92931166c9aa634 (+ 74 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f158bd511df1f55ebbbc0df3dee52c4400291984 (+ 136 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b7f8b6b64b135e6dba5083d688675874d6809c91 (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/151/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0151 (3-changed-components) 2023-11-13T11:37:50 0:00:00
Previous 0150 (2-changed-components) 2023-11-10T15:42:23 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 55 10
Performance Improvements 66 155
Unchanged Tests 1115 1071
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 26.23% 1426.000 1800.000 - 26.40% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 7570.00% 0.100 7.670 - -97.92% -
401.bzip2 (unexplained diff vs previous) 6933.33% 3.000 211.000 - -98.05% -
471.omnetpp (unexplained diff vs previous) (percentage) 2100.00% 0.110 2.420 - -99.38% -
471.omnetpp (unexplained diff vs previous) 2033.33% 3.000 64.000 - -99.40% -
429.mcf (max) 1585.71% 28.000 472.000 - -64.30% -
470.lbm (unexplained diff vs previous) 1533.33% 3.000 49.000 - -99.51% -
470.lbm (unexplained diff vs previous) (percentage) 1525.00% 0.080 1.300 - -99.51% -
429.mcf (unexplained diff vs previous) 1235.71% 28.000 374.000 - -97.99% -
429.mcf (max) (percentage) 1211.50% 2.000 26.230 - -71.76% -
429.mcf (unexplained diff vs previous) (percentage) 960.20% 1.960 20.780 - -98.41% -
473.astar (unexplained diff vs previous) (percentage) 545.45% 0.770 4.970 - -97.49% -
433.milc (unexplained diff vs previous) (percentage) 523.53% 0.170 1.060 - -99.89% -
473.astar (unexplained diff vs previous) 512.50% 40.000 245.000 - -97.59% -
433.milc (unexplained diff vs previous) 500.00% 2.000 12.000 - -99.89% -
401.bzip2 (max) (percentage) 286.96% 1.840 7.120 - -90.95% -
458.sjeng (unexplained diff vs previous) (percentage) 268.97% 0.290 1.070 - -98.82% -
401.bzip2 (max) 261.11% 54.000 195.000 - -91.57% -
458.sjeng (unexplained diff vs previous) 259.09% 22.000 79.000 - -98.85% -
458.sjeng (max) 239.13% 23.000 78.000 - -97.83% -
458.sjeng (max) (percentage) 231.25% 0.320 1.060 - -97.77% -
473.astar (max) (percentage) 180.47% 1.690 4.740 - -92.86% -
456.hmmer (unexplained diff vs previous) 175.00% 8.000 22.000 - -99.73% -
456.hmmer (unexplained diff vs previous) (percentage) 171.43% 0.280 0.760 - -99.73% -
473.astar (max) 167.82% 87.000 233.000 - -93.16% -
464.h264ref (max) 121.21% 33.000 73.000 - -97.67% -
464.h264ref (max) (percentage) 120.34% 0.590 1.300 - -97.61% -
464.h264ref (unexplained diff vs previous) (percentage) 120.00% 0.600 1.320 - -98.89% -
464.h264ref (unexplained diff vs previous) 117.65% 34.000 74.000 - -98.92% -
445.gobmk (max) (percentage) 113.43% 0.670 1.430 - -97.28% -
445.gobmk (unexplained diff vs previous) (percentage) 113.24% 0.680 1.450 - -98.69% -
445.gobmk (max) 112.12% 33.000 70.000 - -97.35% -
445.gobmk (unexplained diff vs previous) 111.76% 34.000 72.000 - -98.71% -
433.milc (max) (percentage) 90.91% 0.550 1.050 - -98.84% -
433.milc (max) 83.33% 6.000 11.000 - -98.95% -
482.sphinx3 (unexplained diff vs previous) (percentage) 82.02% 1.780 3.240 - -99.88% -
482.sphinx3 (unexplained diff vs previous) 76.47% 17.000 30.000 - -99.88% -
400.perlbench (unexplained diff vs previous) (percentage) 64.65% 2.150 3.540 - -99.33% -
447.dealII (unexplained diff vs previous) (percentage) 63.16% 0.570 0.930 - -99.77% -
447.dealII (unexplained diff vs previous) 60.00% 10.000 16.000 - -99.77% -
400.perlbench (unexplained diff vs previous) 58.82% 34.000 54.000 - -99.38% -
456.hmmer (max) (percentage) 52.00% 0.500 0.760 - -98.97% -
456.hmmer (max) 50.00% 14.000 21.000 - -99.01% -
429.mcf 32.99% 97.000 129.000 - 18.35% -
429.mcf (avg) 32.99% 97.000 129.000 - 18.35% -
471.omnetpp (max) (percentage) 19.19% 1.980 2.360 - -97.04% -
471.omnetpp (max) 16.98% 53.000 62.000 - -97.14% -
400.perlbench (max) (percentage) 6.54% 3.210 3.420 - -95.93% -
401.bzip2 (avg) (percentage) 5.50% 2.000 2.110 - -61.50% -
429.mcf (avg) (percentage) 5.41% 6.840 7.210 - -6.00% -
400.perlbench (max) 4.00% 50.000 52.000 - -96.28% -
473.astar (avg) (percentage) 2.38% 2.100 2.150 - -48.32% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -35.71% 28.000 18.000 - -37.93% -
nb_execution_successful -35.71% 28.000 18.000 - -37.93% -
nb_total_tests -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -7.94% 63.000 58.000 - 3.57% -
401.bzip2 -7.12% 2963.000 2752.000 - -6.43% -
473.astar -4.74% 5171.000 4926.000 - -3.94% -
400.perlbench -3.42% 1580.000 1526.000 - -8.24% -
482.sphinx3 -3.14% 955.000 925.000 - -2.12% -
471.omnetpp -2.36% 2711.000 2647.000 - -2.83% -
445.gobmk -1.43% 5022.000 4950.000 - -1.45% -
464.h264ref -1.30% 5700.000 5626.000 - -2.34% -
470.lbm -1.28% 3823.000 3774.000 - -0.37% -
450.soplex -1.20% 585.000 578.000 - 1.94% -
458.sjeng -1.06% 7474.000 7395.000 - -2.27% -
433.milc -1.05% 1143.000 1131.000 - -1.74% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) (percentage) -71.65% 1.270 0.360 - -99.97% -
453.povray (unexplained diff vs previous) -71.43% 7.000 2.000 - -99.96% -
444.namd (unexplained diff vs previous) -61.54% 13.000 5.000 - -99.94% -
444.namd (unexplained diff vs previous) (percentage) -61.36% 1.760 0.680 - -99.94% -
453.povray (max) (percentage) -45.51% 1.780 0.970 - -98.94% -
453.povray (max) -44.44% 9.000 5.000 - -99.00% -
403.gcc -33.33% 3.000 2.000 - -50.00% -
403.gcc (avg) -33.33% 3.000 2.000 - -50.00% -
403.gcc (max) -20.00% 5.000 4.000 - -92.73% -
450.soplex (max) -9.09% 22.000 20.000 - -96.33% -
444.namd (max) -8.33% 12.000 11.000 - -98.39% -
444.namd (max) (percentage) -8.09% 1.730 1.590 - -98.27% -
436.cactusADM (max) (percentage) -7.50% 0.800 0.740 - -99.17% -
459.GemsFDTD (max) (percentage) -7.46% 0.670 0.620 - -99.13% -
454.calculix (max) (percentage) -7.37% 6.920 6.410 - -93.57% -
410.bwaves (max) (percentage) -6.36% 1.100 1.030 - -98.22% -
450.soplex (max) (percentage) -6.27% 3.830 3.590 - -96.27% -
450.soplex -5.56% 18.000 17.000 - -52.78% -
450.soplex (avg) -5.56% 18.000 17.000 - -52.78% -
435.gromacs (max) (percentage) -5.30% 1.320 1.250 - -97.46% -
482.sphinx3 (max) -4.92% 61.000 58.000 - -93.63% -
437.leslie3d (max) (percentage) -4.48% 10.260 9.800 - -40.89% -
447.dealII (max) -4.35% 23.000 22.000 - -98.41% -
482.sphinx3 -4.17% 24.000 23.000 - -68.92% -
482.sphinx3 (avg) -4.17% 24.000 23.000 - -68.92% -
462.libquantum (max) (percentage) -3.85% 1.040 1.000 - -98.99% -
447.dealII (max) (percentage) -3.70% 1.350 1.300 - -98.38% -
447.dealII -3.12% 32.000 31.000 - -68.69% -
447.dealII (avg) -3.12% 32.000 31.000 - -68.69% -
473.astar -2.78% 108.000 105.000 - -50.70% -
473.astar (avg) -2.78% 108.000 105.000 - -50.70% -
471.omnetpp -2.74% 73.000 71.000 - -68.16% -
471.omnetpp (avg) -2.74% 73.000 71.000 - -68.16% -
400.perlbench -2.38% 42.000 41.000 - -60.95% -
400.perlbench (avg) -2.38% 42.000 41.000 - -60.95% -
403.gcc (max) (percentage) -2.30% 8.260 8.070 - -91.88% -
453.povray (avg) (percentage) -1.85% 2.160 2.120 - -72.86% -
401.bzip2 -1.69% 59.000 58.000 - -63.98% -
401.bzip2 (avg) -1.69% 59.000 58.000 - -63.98% -
470.lbm -1.61% 62.000 61.000 - -74.48% -
470.lbm (avg) -1.61% 62.000 61.000 - -74.48% -
445.gobmk -1.54% 65.000 64.000 - -67.35% -
445.gobmk (avg) -1.54% 65.000 64.000 - -67.35% -
462.libquantum (avg) (percentage) -1.44% 2.080 2.050 - -73.24% -
482.sphinx3 (max) (percentage) -1.40% 6.440 6.350 - -93.42% -
458.sjeng -1.35% 74.000 73.000 - -69.71% -
458.sjeng (avg) -1.35% 74.000 73.000 - -69.71% -
470.lbm (max) -1.33% 75.000 74.000 - -97.31% -
444.namd (avg) (percentage) -1.33% 2.260 2.230 - -75.81% -
450.soplex (avg) (percentage) -1.29% 3.100 3.060 - -52.41% -
464.h264ref -1.22% 82.000 81.000 - -72.35% -
464.h264ref (avg) -1.22% 82.000 81.000 - -72.35% -
465.tonto (max) (percentage) -1.13% 2.650 2.620 - -86.43% -
447.dealII (avg) (percentage) -1.09% 1.840 1.820 - -68.46% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.62% 893848.000 908307.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 26.40% 1424.000 1800.000 - 26.23% -
403.gcc 3.57% 56.000 58.000 - -7.94% -
450.soplex 1.94% 567.000 578.000 - -1.20% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 72.46% 3.050 5.260 - 0.00% -
429.mcf 18.35% 109.000 129.000 - 32.99% -
429.mcf (avg) 18.35% 109.000 129.000 - 32.99% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -37.93% 29.000 18.000 - -35.71% -
nb_execution_successful -37.93% 29.000 18.000 - -35.71% -
nb_total_tests -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.52% 387748.000 381840.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench -8.24% 1663.000 1526.000 - -3.42% -
401.bzip2 -6.43% 2941.000 2752.000 - -7.12% -
473.astar -3.94% 5128.000 4926.000 - -4.74% -
471.omnetpp -2.83% 2724.000 2647.000 - -2.36% -
464.h264ref -2.34% 5761.000 5626.000 - -1.30% -
458.sjeng -2.27% 7567.000 7395.000 - -1.06% -
482.sphinx3 -2.12% 945.000 925.000 - -3.14% -
444.namd -1.74% 747.000 734.000 - -0.68% -
433.milc -1.74% 1151.000 1131.000 - -1.05% -
445.gobmk -1.45% 5023.000 4950.000 - -1.43% -
462.libquantum -1.43% 140.000 138.000 - -0.72% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.97% 1043.330 0.360 - -71.65% -
453.povray (unexplained diff vs previous) -99.96% 5707.000 2.000 - -71.43% -
450.soplex (unexplained diff vs previous) (percentage) -99.95% 2557.320 1.210 - 0.00% -
450.soplex (unexplained diff vs previous) -99.95% 14500.000 7.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 - -61.54% -
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.680 - -61.36% -
433.milc (unexplained diff vs previous) -99.89% 11289.000 12.000 - 500.00% -
433.milc (unexplained diff vs previous) (percentage) -99.89% 980.800 1.060 - 523.53% -
482.sphinx3 (unexplained diff vs previous) -99.88% 26073.000 30.000 - 76.47% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.88% 2759.050 3.240 - 82.02% -
447.dealII (unexplained diff vs previous) -99.77% 7017.000 16.000 - 60.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.77% 407.020 0.930 - 63.16% -
456.hmmer (unexplained diff vs previous) (percentage) -99.73% 278.630 0.760 - 171.43% -
456.hmmer (unexplained diff vs previous) -99.73% 8030.000 22.000 - 175.00% -
416.gamess (max) (percentage) -99.66% 38.550 0.130 - 0.00% -
470.lbm (unexplained diff vs previous) -99.51% 9990.000 49.000 - 1533.33% -
470.lbm (unexplained diff vs previous) (percentage) -99.51% 263.730 1.300 - 1525.00% -
471.omnetpp (unexplained diff vs previous) -99.40% 10659.000 64.000 - 2033.33% -
400.perlbench (unexplained diff vs previous) -99.38% 8772.000 54.000 - 58.82% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.38% 391.300 2.420 - 2100.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.33% 527.480 3.540 - 64.65% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
436.cactusADM (max) (percentage) -99.17% 88.730 0.740 - -7.50% -
434.zeusmp (max) (percentage) -99.16% 81.770 0.690 - 0.00% -
459.GemsFDTD (max) (percentage) -99.13% 71.460 0.620 - -7.46% -
456.hmmer (max) -99.01% 2120.000 21.000 - 50.00% -
453.povray (max) -99.00% 499.000 5.000 - -44.44% -
462.libquantum (max) (percentage) -98.99% 98.970 1.000 - -3.85% -
456.hmmer (max) (percentage) -98.97% 73.590 0.760 - 52.00% -
433.milc (max) -98.95% 1044.000 11.000 - 83.33% -
453.povray (max) (percentage) -98.94% 91.250 0.970 - -45.51% -
464.h264ref (unexplained diff vs previous) -98.92% 6843.000 74.000 - 117.65% -
464.h264ref (unexplained diff vs previous) (percentage) -98.89% 118.780 1.320 - 120.00% -
458.sjeng (unexplained diff vs previous) -98.85% 6876.000 79.000 - 259.09% -
433.milc (max) (percentage) -98.84% 90.750 1.050 - 90.91% -
458.sjeng (unexplained diff vs previous) (percentage) -98.82% 90.870 1.070 - 268.97% -
445.gobmk (unexplained diff vs previous) -98.71% 5581.000 72.000 - 111.76% -
445.gobmk (unexplained diff vs previous) (percentage) -98.69% 111.110 1.450 - 113.24% -
447.dealII (max) -98.41% 1384.000 22.000 - -4.35% -
429.mcf (unexplained diff vs previous) (percentage) -98.41% 1305.690 20.780 - 960.20% -
444.namd (max) -98.39% 685.000 11.000 - -8.33% -
447.dealII (max) (percentage) -98.38% 80.280 1.300 - -3.70% -
444.namd (max) (percentage) -98.27% 91.790 1.590 - -8.09% -
410.bwaves (max) (percentage) -98.22% 57.970 1.030 - -6.36% -
401.bzip2 (unexplained diff vs previous) -98.05% 10833.000 211.000 - 6933.33% -
481.wrf (max) (percentage) -97.99% 68.700 1.380 - 0.00% -
429.mcf (unexplained diff vs previous) -97.99% 18593.000 374.000 - 1235.71% -
401.bzip2 (unexplained diff vs previous) (percentage) -97.92% 368.340 7.670 - 7570.00% -
458.sjeng (max) -97.83% 3602.000 78.000 - 239.13% -
458.sjeng (max) (percentage) -97.77% 47.610 1.060 - 231.25% -
464.h264ref (max) -97.67% 3127.000 73.000 - 121.21% -
464.h264ref (max) (percentage) -97.61% 54.290 1.300 - 120.34% -
473.astar (unexplained diff vs previous) -97.59% 10146.000 245.000 - 512.50% -
473.astar (unexplained diff vs previous) (percentage) -97.49% 197.850 4.970 - 545.45% -
435.gromacs (max) (percentage) -97.46% 49.160 1.250 - -5.30% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
445.gobmk (max) -97.35% 2643.000 70.000 - 112.12% -
470.lbm (max) -97.31% 2746.000 74.000 - -1.33% -
445.gobmk (max) (percentage) -97.28% 52.630 1.430 - 113.43% -
470.lbm (max) (percentage) -97.27% 72.510 1.980 - 0.00% -
471.omnetpp (max) -97.14% 2169.000 62.000 - 16.98% -
471.omnetpp (max) (percentage) -97.04% 79.650 2.360 - 19.19% -
450.soplex (max) -96.33% 545.000 20.000 - -9.09% -
400.perlbench (max) -96.28% 1397.000 52.000 - 4.00% -
450.soplex (max) (percentage) -96.27% 96.240 3.590 - -6.27% -
400.perlbench (max) (percentage) -95.93% 84.060 3.420 - 6.54% -
482.sphinx3 (max) -93.63% 911.000 58.000 - -4.92% -
454.calculix (max) (percentage) -93.57% 99.730 6.410 - -7.37% -
482.sphinx3 (max) (percentage) -93.42% 96.500 6.350 - -1.40% -
473.astar (max) -93.16% 3406.000 233.000 - 167.82% -
473.astar (max) (percentage) -92.86% 66.430 4.740 - 180.47% -
403.gcc (max) -92.73% 55.000 4.000 - -20.00% -
403.gcc (max) (percentage) -91.88% 99.360 8.070 - -2.30% -
401.bzip2 (max) -91.57% 2313.000 195.000 - 261.11% -
401.bzip2 (max) (percentage) -90.95% 78.650 7.120 - 286.96% -
465.tonto (max) (percentage) -86.43% 19.310 2.620 - -1.13% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
456.hmmer -77.17% 127.000 29.000 - 0.00% -
456.hmmer (avg) -77.17% 127.000 29.000 - 0.00% -
456.hmmer (avg) (percentage) -76.64% 4.410 1.030 - 0.00% -
444.namd -76.47% 68.000 16.000 - 0.00% -
444.namd (avg) -76.47% 68.000 16.000 - 0.00% -
416.gamess (avg) (percentage) -76.02% 4.420 1.060 - 0.00% -
444.namd (avg) (percentage) -75.81% 9.220 2.230 - -1.33% -
470.lbm -74.48% 239.000 61.000 - -1.61% -
470.lbm (avg) -74.48% 239.000 61.000 - -1.61% -
470.lbm (avg) (percentage) -74.09% 6.330 1.640 - 0.00% -
453.povray -73.81% 42.000 11.000 - 0.00% -
453.povray (avg) -73.81% 42.000 11.000 - 0.00% -
462.libquantum (avg) (percentage) -73.24% 7.660 2.050 - -1.44% -
453.povray (avg) (percentage) -72.86% 7.810 2.120 - -1.85% -
434.zeusmp (avg) (percentage) -72.48% 5.850 1.610 - 0.00% -
464.h264ref -72.35% 293.000 81.000 - -1.22% -
464.h264ref (avg) -72.35% 293.000 81.000 - -1.22% -
429.mcf (max) (percentage) -71.76% 92.890 26.230 - 1211.50% -
464.h264ref (avg) (percentage) -71.71% 5.090 1.440 - -0.69% -
458.sjeng -69.71% 241.000 73.000 - -1.35% -
458.sjeng (avg) -69.71% 241.000 73.000 - -1.35% -
459.GemsFDTD (avg) (percentage) -69.18% 5.840 1.800 - 0.00% -
482.sphinx3 -68.92% 74.000 23.000 - -4.17% -
482.sphinx3 (avg) -68.92% 74.000 23.000 - -4.17% -
436.cactusADM (avg) (percentage) -68.73% 5.980 1.870 - 0.00% -
447.dealII -68.69% 99.000 31.000 - -3.12% -
447.dealII (avg) -68.69% 99.000 31.000 - -3.12% -
458.sjeng (avg) (percentage) -68.65% 3.190 1.000 - 0.00% -
410.bwaves (avg) (percentage) -68.48% 4.410 1.390 - 0.00% -
447.dealII (avg) (percentage) -68.46% 5.770 1.820 - -1.09% -
471.omnetpp -68.16% 223.000 71.000 - -2.74% -
471.omnetpp (avg) -68.16% 223.000 71.000 - -2.74% -
433.milc -68.12% 69.000 22.000 - 0.00% -
433.milc (avg) -68.12% 69.000 22.000 - 0.00% -
482.sphinx3 (avg) (percentage) -67.97% 7.930 2.540 - 0.79% -
481.wrf (avg) (percentage) -67.79% 6.240 2.010 - 0.00% -
445.gobmk -67.35% 196.000 64.000 - -1.54% -
445.gobmk (avg) -67.35% 196.000 64.000 - -1.54% -
433.milc (avg) (percentage) -67.11% 6.050 1.990 - -1.00% -
471.omnetpp (avg) (percentage) -66.95% 8.200 2.710 - 0.00% -
445.gobmk (avg) (percentage) -66.50% 3.910 1.310 - 0.00% -
429.mcf (max) -64.30% 1322.000 472.000 - 1585.71% -
401.bzip2 -63.98% 161.000 58.000 - -1.69% -
401.bzip2 (avg) -63.98% 161.000 58.000 - -1.69% -
401.bzip2 (avg) (percentage) -61.50% 5.480 2.110 - 5.50% -
400.perlbench -60.95% 105.000 41.000 - -2.38% -
400.perlbench (avg) -60.95% 105.000 41.000 - -2.38% -
400.perlbench (avg) (percentage) -57.48% 6.350 2.700 - 0.75% -
435.gromacs (avg) (percentage) -55.93% 5.060 2.230 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto (avg) (percentage) -53.29% 3.340 1.560 - 0.00% -
450.soplex -52.78% 36.000 17.000 - -5.56% -
450.soplex (avg) -52.78% 36.000 17.000 - -5.56% -
450.soplex (avg) (percentage) -52.41% 6.430 3.060 - -1.29% -
473.astar -50.70% 213.000 105.000 - -2.78% -
473.astar (avg) -50.70% 213.000 105.000 - -2.78% -
403.gcc -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) -50.00% 4.000 2.000 - -33.33% -
454.calculix (avg) (percentage) -50.00% 8.020 4.010 - 0.00% -
473.astar (avg) (percentage) -48.32% 4.160 2.150 - 2.38% -
437.leslie3d (max) (percentage) -40.89% 16.580 9.800 - -4.48% -
403.gcc (avg) (percentage) -32.38% 7.320 4.950 - 0.00% -
429.mcf (avg) (percentage) -6.00% 7.670 7.210 - 5.41% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1526.000 -3.42%
401.bzip2 2752.000 -7.12%
403.gcc 58.000 -7.94%
429.mcf 1800.000 26.23%
433.milc 1131.000 -1.05%
444.namd 734.000 -
445.gobmk 4950.000 -1.43%
447.dealII 1727.000 -
450.soplex 578.000 -1.20%
453.povray 549.000 -
456.hmmer 2881.000 -
458.sjeng 7395.000 -1.06%
462.libquantum 138.000 -
464.h264ref 5626.000 -1.30%
470.lbm 3774.000 -1.28%
471.omnetpp 2647.000 -2.36%
473.astar 4926.000 -4.74%
482.sphinx3 925.000 -3.14%
Geometric Mean 1443.816 -
Code Size (bytes)
Name Current %
400.perlbench 908307.000 -
401.bzip2 44031.000 -
403.gcc 2452575.000 -
429.mcf 9119.000 -
433.milc 61125.000 -
444.namd 188096.000 -
445.gobmk 1378310.000 -
447.dealII 311358.000 -
450.soplex 204302.000 -
453.povray 657825.000 -
456.hmmer 108287.000 -
458.sjeng 103652.000 -
462.libquantum 16053.000 -
464.h264ref 381840.000 -
470.lbm 9707.000 -
471.omnetpp 480704.000 -
473.astar 22920.000 -
482.sphinx3 112775.000 -
Geometric Mean 141111.637 -
Score
Name Current %
nb_compile_successful 18.000 -35.71%
nb_execution_successful 18.000 -35.71%
nb_total_tests 20.000 -31.03%
Geometric Mean 18.643 -34.19%
sample variability
Name Current %
400.perlbench 41.000 -2.38%
400.perlbench (avg) 41.000 -2.38%
400.perlbench (avg) (percentage) 2.700 -
400.perlbench (max) 52.000 4.00%
400.perlbench (max) (percentage) 3.420 6.54%
400.perlbench (unexplained diff vs previous) 54.000 58.82%
400.perlbench (unexplained diff vs previous) (percentage) 3.540 64.65%
401.bzip2 58.000 -1.69%
401.bzip2 (avg) 58.000 -1.69%
401.bzip2 (avg) (percentage) 2.110 5.50%
401.bzip2 (max) 195.000 261.11%
401.bzip2 (max) (percentage) 7.120 286.96%
401.bzip2 (unexplained diff vs previous) 211.000 6933.33%
401.bzip2 (unexplained diff vs previous) (percentage) 7.670 7570.00%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 4.950 -
403.gcc (max) 4.000 -20.00%
403.gcc (max) (percentage) 8.070 -2.30%
410.bwaves (avg) (percentage) 1.390 -
410.bwaves (max) (percentage) 1.030 -6.36%
416.gamess (avg) (percentage) 1.060 -
416.gamess (max) (percentage) 0.130 -
429.mcf 129.000 32.99%
429.mcf (avg) 129.000 32.99%
429.mcf (avg) (percentage) 7.210 5.41%
429.mcf (max) 472.000 1585.71%
429.mcf (max) (percentage) 26.230 1211.50%
429.mcf (unexplained diff vs previous) 374.000 1235.71%
429.mcf (unexplained diff vs previous) (percentage) 20.780 960.20%
433.milc 22.000 -
433.milc (avg) 22.000 -
433.milc (avg) (percentage) 1.990 -
433.milc (max) 11.000 83.33%
433.milc (max) (percentage) 1.050 90.91%
433.milc (unexplained diff vs previous) 12.000 500.00%
433.milc (unexplained diff vs previous) (percentage) 1.060 523.53%
434.zeusmp (avg) (percentage) 1.610 -
434.zeusmp (max) (percentage) 0.690 -
435.gromacs (avg) (percentage) 2.230 -
435.gromacs (max) (percentage) 1.250 -5.30%
436.cactusADM (avg) (percentage) 1.870 -
436.cactusADM (max) (percentage) 0.740 -7.50%
437.leslie3d (avg) (percentage) 5.260 -
437.leslie3d (max) (percentage) 9.800 -4.48%
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 2.230 -1.33%
444.namd (max) 11.000 -8.33%
444.namd (max) (percentage) 1.590 -8.09%
444.namd (unexplained diff vs previous) 5.000 -61.54%
444.namd (unexplained diff vs previous) (percentage) 0.680 -61.36%
445.gobmk 64.000 -1.54%
445.gobmk (avg) 64.000 -1.54%
445.gobmk (avg) (percentage) 1.310 -
445.gobmk (max) 70.000 112.12%
445.gobmk (max) (percentage) 1.430 113.43%
445.gobmk (unexplained diff vs previous) 72.000 111.76%
445.gobmk (unexplained diff vs previous) (percentage) 1.450 113.24%
447.dealII 31.000 -3.12%
447.dealII (avg) 31.000 -3.12%
447.dealII (avg) (percentage) 1.820 -1.09%
447.dealII (max) 22.000 -4.35%
447.dealII (max) (percentage) 1.300 -3.70%
447.dealII (unexplained diff vs previous) 16.000 60.00%
447.dealII (unexplained diff vs previous) (percentage) 0.930 63.16%
450.soplex 17.000 -5.56%
450.soplex (avg) 17.000 -5.56%
450.soplex (avg) (percentage) 3.060 -1.29%
450.soplex (max) 20.000 -9.09%
450.soplex (max) (percentage) 3.590 -6.27%
450.soplex (unexplained diff vs previous) 7.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.210 -
453.povray 11.000 -
453.povray (avg) 11.000 -
453.povray (avg) (percentage) 2.120 -1.85%
453.povray (max) 5.000 -44.44%
453.povray (max) (percentage) 0.970 -45.51%
453.povray (unexplained diff vs previous) 2.000 -71.43%
453.povray (unexplained diff vs previous) (percentage) 0.360 -71.65%
454.calculix (avg) (percentage) 4.010 -
454.calculix (max) (percentage) 6.410 -7.37%
456.hmmer 29.000 -
456.hmmer (avg) 29.000 -
456.hmmer (avg) (percentage) 1.030 -
456.hmmer (max) 21.000 50.00%
456.hmmer (max) (percentage) 0.760 52.00%
456.hmmer (unexplained diff vs previous) 22.000 175.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.760 171.43%
458.sjeng 73.000 -1.35%
458.sjeng (avg) 73.000 -1.35%
458.sjeng (avg) (percentage) 1.000 -
458.sjeng (max) 78.000 239.13%
458.sjeng (max) (percentage) 1.060 231.25%
458.sjeng (unexplained diff vs previous) 79.000 259.09%
458.sjeng (unexplained diff vs previous) (percentage) 1.070 268.97%
459.GemsFDTD (avg) (percentage) 1.800 -
459.GemsFDTD (max) (percentage) 0.620 -7.46%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.050 -1.44%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.000 -3.85%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -
464.h264ref 81.000 -1.22%
464.h264ref (avg) 81.000 -1.22%
464.h264ref (avg) (percentage) 1.440 -
464.h264ref (max) 73.000 121.21%
464.h264ref (max) (percentage) 1.300 120.34%
464.h264ref (unexplained diff vs previous) 74.000 117.65%
464.h264ref (unexplained diff vs previous) (percentage) 1.320 120.00%
465.tonto (avg) (percentage) 1.560 -
465.tonto (max) (percentage) 2.620 -1.13%
470.lbm 61.000 -1.61%
470.lbm (avg) 61.000 -1.61%
470.lbm (avg) (percentage) 1.640 -
470.lbm (max) 74.000 -1.33%
470.lbm (max) (percentage) 1.980 -
470.lbm (unexplained diff vs previous) 49.000 1533.33%
470.lbm (unexplained diff vs previous) (percentage) 1.300 1525.00%
471.omnetpp 71.000 -2.74%
471.omnetpp (avg) 71.000 -2.74%
471.omnetpp (avg) (percentage) 2.710 -
471.omnetpp (max) 62.000 16.98%
471.omnetpp (max) (percentage) 2.360 19.19%
471.omnetpp (unexplained diff vs previous) 64.000 2033.33%
471.omnetpp (unexplained diff vs previous) (percentage) 2.420 2100.00%
473.astar 105.000 -2.78%
473.astar (avg) 105.000 -2.78%
473.astar (avg) (percentage) 2.150 2.38%
473.astar (max) 233.000 167.82%
473.astar (max) (percentage) 4.740 180.47%
473.astar (unexplained diff vs previous) 245.000 512.50%
473.astar (unexplained diff vs previous) (percentage) 4.970 545.45%
481.wrf (avg) (percentage) 2.010 -
481.wrf (max) (percentage) 1.380 -
482.sphinx3 23.000 -4.17%
482.sphinx3 (avg) 23.000 -4.17%
482.sphinx3 (avg) (percentage) 2.540 -
482.sphinx3 (max) 58.000 -4.92%
482.sphinx3 (max) (percentage) 6.350 -1.40%
482.sphinx3 (unexplained diff vs previous) 30.000 76.47%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.240 82.02%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 7.434 88.43%