Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=328e01595436e937a0cc00cc8451f17beda26799 (+ 27 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/e0787da263322fc18dfff55218b12129765f7bd3 (+ 106 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d1dcb565a1fb5829f9476a1438c30eccc4027d04 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/108/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0108 (2-changed-components) 2023-11-08T15:14:05 0:00:00
Previous 0107 (3-changed-components) 2023-11-05T06:27:59 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 39 75
Performance Improvements 107 147
Added Tests 2 2
Unchanged Tests 1088 1012
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.76% 1647.000 1676.000 - -85.06% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) 700.00% 6.000 48.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 662.50% 0.080 0.610 - 103.33% -
464.h264ref (unexplained diff vs previous) (percentage) 193.75% 0.160 0.470 - 23.68% -
464.h264ref (unexplained diff vs previous) 190.00% 10.000 29.000 - -50.00% -
458.sjeng (max) 166.67% 18.000 48.000 - 0.00% -
458.sjeng (max) (percentage) 165.22% 0.230 0.610 - 103.33% -
400.perlbench (unexplained diff vs previous) 141.67% 12.000 29.000 - -17.14% -
416.gamess (unexplained diff vs previous) (percentage) 140.00% 0.050 0.120 - -96.07% -
400.perlbench (unexplained diff vs previous) (percentage) 136.99% 0.730 1.730 - 458.06% -
416.gamess (unexplained diff vs previous) 112.50% 8.000 17.000 - -98.10% -
400.perlbench (max) 107.14% 14.000 29.000 - -67.42% -
454.calculix (unexplained diff vs previous) (percentage) 105.84% 1.540 3.170 - 322.67% -
471.omnetpp (unexplained diff vs previous) (percentage) 104.76% 0.210 0.430 - -35.82% -
454.calculix (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.18% -
471.omnetpp (unexplained diff vs previous) 100.00% 6.000 12.000 - -80.65% -
400.perlbench (max) (percentage) 97.75% 0.890 1.760 - 120.00% -
410.bwaves (max) 64.52% 31.000 51.000 - -80.38% -
410.bwaves (unexplained diff vs previous) 59.38% 32.000 51.000 - -80.16% -
410.bwaves (max) (percentage) 59.26% 0.540 0.860 - -51.41% -
410.bwaves (unexplained diff vs previous) (percentage) 59.26% 0.540 0.860 - -50.57% -
437.leslie3d (unexplained diff vs previous) (percentage) 23.46% 13.470 16.630 - 1514.56% -
459.GemsFDTD (max) 21.82% 55.000 67.000 - -88.41% -
459.GemsFDTD (max) (percentage) 20.51% 0.780 0.940 - -58.77% -
429.mcf (unexplained diff vs previous) 20.00% 5.000 6.000 - -40.00% -
459.GemsFDTD (unexplained diff vs previous) 19.64% 56.000 67.000 - -88.53% -
429.mcf (unexplained diff vs previous) (percentage) 18.87% 0.530 0.630 - 600.00% -
465.tonto (unexplained diff vs previous) (percentage) 18.26% 1.150 1.360 - 20.35% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 17.72% 0.790 0.930 - -59.57% -
465.tonto (unexplained diff vs previous) 16.45% 152.000 177.000 - 19.59% -
465.tonto (max) (percentage) 14.53% 1.170 1.340 - -21.64% -
465.tonto (max) 12.99% 154.000 174.000 - -21.97% -
437.leslie3d (avg) (percentage) 6.30% 3.970 4.220 - 152.69% -
437.leslie3d (unexplained diff vs previous) 5.92% 1792.000 1898.000 - 914.97% -
400.perlbench 2.94% 34.000 35.000 - -18.60% -
400.perlbench (avg) 2.94% 34.000 35.000 - -18.60% -
410.bwaves 1.08% 93.000 94.000 - -67.47% -
410.bwaves (avg) 1.08% 93.000 94.000 - -67.47% -
465.tonto (avg) (percentage) 1.04% 0.960 0.970 - -14.91% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -14.26% 13308.000 11410.000 - -36.86% -
403.gcc -3.39% 59.000 57.000 - -99.36% -
454.calculix -3.08% 65.000 63.000 - -99.81% -
473.astar -1.46% 4944.000 4872.000 - -62.47% -
465.tonto -1.34% 13177.000 13000.000 - -0.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) -85.71% 0.770 0.110 - -97.90% -
444.namd (unexplained diff vs previous) -85.71% 7.000 1.000 - -99.88% -
445.gobmk (unexplained diff vs previous) (percentage) -84.88% 2.050 0.310 - 106.67% -
445.gobmk (unexplained diff vs previous) -84.62% 104.000 16.000 - -11.11% -
450.soplex (unexplained diff vs previous) (percentage) -71.55% 2.320 0.660 - 50.00% -
450.soplex (unexplained diff vs previous) -71.43% 14.000 4.000 - -94.20% -
436.cactusADM (max) -70.00% 20.000 6.000 - -99.51% -
456.hmmer (unexplained diff vs previous) (percentage) -67.65% 0.340 0.110 - -78.85% -
456.hmmer (unexplained diff vs previous) -66.67% 15.000 5.000 - -94.90% -
436.cactusADM (max) (percentage) -66.25% 0.800 0.270 - -94.65% -
470.lbm (unexplained diff vs previous) -59.38% 32.000 13.000 - -98.42% -
470.lbm (unexplained diff vs previous) (percentage) -58.82% 0.850 0.350 - -93.06% -
435.gromacs (max) (percentage) -56.84% 2.340 1.010 - -42.61% -
435.gromacs (max) -56.82% 176.000 76.000 - -74.32% -
453.povray (unexplained diff vs previous) -50.00% 6.000 3.000 - -98.22% -
453.povray (unexplained diff vs previous) (percentage) -50.00% 1.100 0.550 - -75.98% -
436.cactusADM (unexplained diff vs previous) (percentage) -38.71% 0.310 0.190 - -96.05% -
436.cactusADM (unexplained diff vs previous) -37.50% 8.000 5.000 - -99.57% -
401.bzip2 (unexplained diff vs previous) (percentage) -34.00% 1.000 0.660 - 60.98% -
401.bzip2 (unexplained diff vs previous) -33.33% 30.000 20.000 - -71.01% -
454.calculix (max) -33.33% 3.000 2.000 - -99.26% -
482.sphinx3 (max) (percentage) -28.30% 1.060 0.760 - -75.87% -
433.milc (unexplained diff vs previous) -25.00% 4.000 3.000 - -96.88% -
433.milc (unexplained diff vs previous) (percentage) -25.00% 0.360 0.270 - -61.43% -
401.bzip2 (max) -23.53% 34.000 26.000 - -61.19% -
401.bzip2 (max) (percentage) -23.28% 1.160 0.890 - 122.50% -
482.sphinx3 (max) -22.22% 9.000 7.000 - -99.39% -
437.leslie3d (max) -21.40% 2070.000 1627.000 - 190.54% -
444.namd (max) -14.29% 7.000 6.000 - -99.32% -
450.soplex (max) -14.29% 14.000 12.000 - -82.61% -
482.sphinx3 (unexplained diff vs previous) (percentage) -13.79% 0.870 0.750 - -75.49% -
456.hmmer (max) -13.33% 15.000 13.000 - -86.73% -
453.povray (max) (percentage) -12.84% 1.090 0.950 - -63.32% -
470.lbm (max) (percentage) -12.79% 0.860 0.750 - -86.31% -
445.gobmk (max) (percentage) -12.50% 2.000 1.750 - 548.15% -
470.lbm (max) -12.50% 32.000 28.000 - -96.86% -
482.sphinx3 (unexplained diff vs previous) -12.50% 8.000 7.000 - -99.37% -
445.gobmk (max) -11.88% 101.000 89.000 - 169.70% -
456.hmmer (max) (percentage) -11.76% 0.340 0.300 - -42.31% -
433.milc (max) (percentage) -11.11% 0.360 0.320 - -54.93% -
473.astar (max) -10.13% 79.000 71.000 - 16.39% -
450.soplex (max) (percentage) -10.08% 2.380 2.140 - 386.36% -
437.leslie3d -8.90% 528.000 481.000 - 59.80% -
437.leslie3d (avg) -8.90% 528.000 481.000 - 59.80% -
473.astar (max) (percentage) -8.75% 1.600 1.460 - 210.64% -
437.leslie3d (max) (percentage) -8.35% 15.560 14.260 - 360.00% -
462.libquantum (max) (percentage) -8.24% 0.850 0.780 - 875.00% -
444.namd (max) (percentage) -7.69% 0.780 0.720 - -86.93% -
473.astar (unexplained diff vs previous) -7.69% 78.000 72.000 - 18.03% -
473.astar (unexplained diff vs previous) (percentage) -6.33% 1.580 1.480 - 214.89% -
464.h264ref (max) -5.88% 34.000 32.000 - -45.76% -
464.h264ref (max) (percentage) -5.45% 0.550 0.520 - 33.33% -
481.wrf (max) (percentage) -4.65% 1.720 1.640 - -60.58% -
481.wrf (max) -4.55% 110.000 105.000 - -88.51% -
435.gromacs (unexplained diff vs previous) (percentage) -3.66% 0.820 0.790 - -54.34% -
471.omnetpp (max) (percentage) -3.57% 1.120 1.080 - -41.94% -
429.mcf (max) (percentage) -3.45% 1.160 1.120 - 250.00% -
447.dealII (max) -3.33% 30.000 29.000 - -80.67% -
435.gromacs (unexplained diff vs previous) -3.23% 62.000 60.000 - -79.45% -
471.omnetpp (max) -3.23% 31.000 30.000 - -82.56% -
447.dealII (max) (percentage) -3.09% 1.620 1.570 - -4.85% -
416.gamess (avg) (percentage) -2.63% 1.140 1.110 - -32.73% -
454.calculix (max) (percentage) -2.52% 4.760 4.640 - 452.38% -
462.libquantum (avg) (percentage) -2.44% 2.050 2.000 - 952.63% -
416.gamess -2.38% 168.000 164.000 - -66.19% -
416.gamess (avg) -2.38% 168.000 164.000 - -66.19% -
436.cactusADM -2.27% 44.000 43.000 - -92.65% -
436.cactusADM (avg) -2.27% 44.000 43.000 - -92.65% -
456.hmmer -2.17% 46.000 45.000 - -19.64% -
456.hmmer (avg) -2.17% 46.000 45.000 - -19.64% -
445.gobmk (avg) (percentage) -2.13% 1.410 1.380 - 527.27% -
444.namd (avg) (percentage) -2.08% 1.920 1.880 - -27.69% -
473.astar -2.08% 96.000 94.000 - 84.31% -
473.astar (avg) -2.08% 96.000 94.000 - 84.31% -
435.gromacs (avg) (percentage) -2.08% 2.400 2.350 - 147.37% -
429.mcf (avg) (percentage) -2.03% 6.410 6.280 - 1208.33% -
433.milc (avg) (percentage) -1.95% 2.050 2.010 - 191.30% -
453.povray (avg) (percentage) -1.94% 2.060 2.020 - 32.03% -
456.hmmer (avg) (percentage) -1.92% 1.040 1.020 - 240.00% -
401.bzip2 (avg) (percentage) -1.87% 2.670 2.620 - 870.37% -
450.soplex (avg) (percentage) -1.83% 3.280 3.220 - 1241.67% -
436.cactusADM (avg) (percentage) -1.74% 1.720 1.690 - -29.58% -
482.sphinx3 (avg) (percentage) -1.72% 2.320 2.280 - -2.98% -
434.zeusmp (max) (percentage) -1.67% 0.600 0.590 - -74.35% -
429.mcf -1.67% 60.000 59.000 - 5.36% -
429.mcf (avg) -1.67% 60.000 59.000 - 5.36% -
471.omnetpp -1.59% 63.000 62.000 - -43.12% -
471.omnetpp (avg) -1.59% 63.000 62.000 - -43.12% -
459.GemsFDTD (avg) (percentage) -1.54% 1.950 1.920 - 38.13% -
464.h264ref (avg) (percentage) -1.49% 1.340 1.320 - 238.46% -
470.lbm (avg) (percentage) -1.46% 2.050 2.020 - -45.84% -
445.gobmk -1.41% 71.000 70.000 - 159.26% -
445.gobmk (avg) -1.41% 71.000 70.000 - 159.26% -
471.omnetpp (avg) (percentage) -1.32% 2.270 2.240 - 89.83% -
470.lbm -1.32% 76.000 75.000 - -87.66% -
470.lbm (avg) -1.32% 76.000 75.000 - -87.66% -
401.bzip2 -1.27% 79.000 78.000 - 73.33% -
401.bzip2 (avg) -1.27% 79.000 78.000 - 73.33% -
458.sjeng -1.20% 83.000 82.000 - 127.78% -
458.sjeng (avg) -1.20% 83.000 82.000 - 127.78% -
435.gromacs -1.11% 180.000 178.000 - 11.25% -
435.gromacs (avg) -1.11% 180.000 178.000 - 11.25% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 3.16% 48001.000 49520.000 - 0.00% -
453.povray 1.79% 489013.000 497781.000 - 0.00% -
416.gamess 1.62% 4554728.000 4628484.000 - 0.00% -
459.GemsFDTD 1.38% 195766.000 198470.000 - 0.00% -
471.omnetpp 1.29% 295652.000 299471.000 - 0.00% -
462.libquantum 1.13% 13066.000 13214.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (unexplained diff vs previous) (percentage) 1514.56% 1.030 16.630 - 23.46% -
450.soplex (avg) (percentage) 1241.67% 0.240 3.220 - -1.83% -
429.mcf (avg) (percentage) 1208.33% 0.480 6.280 - -2.03% -
462.libquantum (avg) (percentage) 952.63% 0.190 2.000 - -2.44% -
437.leslie3d (unexplained diff vs previous) 914.97% 187.000 1898.000 - 5.92% -
462.libquantum (max) (percentage) 875.00% 0.080 0.780 - -8.24% -
401.bzip2 (avg) (percentage) 870.37% 0.270 2.620 - -1.87% -
429.mcf (unexplained diff vs previous) (percentage) 600.00% 0.090 0.630 - 18.87% -
445.gobmk (max) (percentage) 548.15% 0.270 1.750 - -12.50% -
445.gobmk (avg) (percentage) 527.27% 0.220 1.380 - -2.13% -
403.gcc (max) (percentage) 464.41% 0.590 3.330 - -0.60% -
400.perlbench (unexplained diff vs previous) (percentage) 458.06% 0.310 1.730 - 136.99% -
454.calculix (max) (percentage) 452.38% 0.840 4.640 - -2.52% -
400.perlbench (avg) (percentage) 435.90% 0.390 2.090 - -0.48% -
450.soplex (max) (percentage) 386.36% 0.440 2.140 - -10.08% -
473.astar (avg) (percentage) 385.00% 0.400 1.940 - -0.51% -
437.leslie3d (max) (percentage) 360.00% 3.100 14.260 - -8.35% -
458.sjeng (avg) (percentage) 356.52% 0.230 1.050 - -0.94% -
403.gcc (avg) (percentage) 325.58% 0.430 1.830 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) 322.67% 0.750 3.170 - 105.84% -
429.mcf (max) (percentage) 250.00% 0.320 1.120 - -3.45% -
456.hmmer (avg) (percentage) 240.00% 0.300 1.020 - -1.92% -
464.h264ref (avg) (percentage) 238.46% 0.390 1.320 - -1.49% -
473.astar (unexplained diff vs previous) (percentage) 214.89% 0.470 1.480 - -6.33% -
473.astar (max) (percentage) 210.64% 0.470 1.460 - -8.75% -
433.milc (avg) (percentage) 191.30% 0.690 2.010 - -1.95% -
437.leslie3d (max) 190.54% 560.000 1627.000 - -21.40% -
445.gobmk (max) 169.70% 33.000 89.000 - -11.88% -
445.gobmk 159.26% 27.000 70.000 - -1.41% -
445.gobmk (avg) 159.26% 27.000 70.000 - -1.41% -
447.dealII (avg) (percentage) 157.47% 0.870 2.240 - 0.00% -
437.leslie3d (avg) (percentage) 152.69% 1.670 4.220 - 6.30% -
435.gromacs (avg) (percentage) 147.37% 0.950 2.350 - -2.08% -
458.sjeng 127.78% 36.000 82.000 - -1.20% -
458.sjeng (avg) 127.78% 36.000 82.000 - -1.20% -
401.bzip2 (max) (percentage) 122.50% 0.400 0.890 - -23.28% -
400.perlbench (max) (percentage) 120.00% 0.800 1.760 - 97.75% -
445.gobmk (unexplained diff vs previous) (percentage) 106.67% 0.150 0.310 - -84.88% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
458.sjeng (max) (percentage) 103.33% 0.300 0.610 - 165.22% -
458.sjeng (unexplained diff vs previous) (percentage) 103.33% 0.300 0.610 - 662.50% -
454.calculix (avg) (percentage) 93.10% 2.030 3.920 - -0.76% -
471.omnetpp (avg) (percentage) 89.83% 1.180 2.240 - -1.32% -
473.astar 84.31% 51.000 94.000 - -2.08% -
473.astar (avg) 84.31% 51.000 94.000 - -2.08% -
401.bzip2 73.33% 45.000 78.000 - -1.27% -
401.bzip2 (avg) 73.33% 45.000 78.000 - -1.27% -
483.xalancbmk (max) (percentage) 70.65% 0.920 1.570 - -0.63% -
401.bzip2 (unexplained diff vs previous) (percentage) 60.98% 0.410 0.660 - -34.00% -
437.leslie3d 59.80% 301.000 481.000 - -8.90% -
437.leslie3d (avg) 59.80% 301.000 481.000 - -8.90% -
450.soplex (unexplained diff vs previous) (percentage) 50.00% 0.440 0.660 - -71.55% -
434.zeusmp (avg) (percentage) 45.90% 1.220 1.780 - 0.00% -
464.h264ref 38.98% 59.000 82.000 - 0.00% -
464.h264ref (avg) 38.98% 59.000 82.000 - 0.00% -
459.GemsFDTD (avg) (percentage) 38.13% 1.390 1.920 - -1.54% -
464.h264ref (max) (percentage) 33.33% 0.390 0.520 - -5.45% -
453.povray (avg) (percentage) 32.03% 1.530 2.020 - -1.94% -
464.h264ref (unexplained diff vs previous) (percentage) 23.68% 0.380 0.470 - 193.75% -
465.tonto (unexplained diff vs previous) (percentage) 20.35% 1.130 1.360 - 18.26% -
465.tonto (unexplained diff vs previous) 19.59% 148.000 177.000 - 16.45% -
473.astar (unexplained diff vs previous) 18.03% 61.000 72.000 - -7.69% -
473.astar (max) 16.39% 61.000 71.000 - -10.13% -
435.gromacs 11.25% 160.000 178.000 - -1.11% -
435.gromacs (avg) 11.25% 160.000 178.000 - -1.11% -
429.mcf 5.36% 56.000 59.000 - -1.67% -
429.mcf (avg) 5.36% 56.000 59.000 - -1.67% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.32% 141060.000 139198.000 - -0.98% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 63.000 - -3.08% -
403.gcc -99.36% 8890.000 57.000 - -3.39% -
462.libquantum -98.78% 17005.000 207.000 - 0.00% -
482.sphinx3 -97.46% 36586.000 929.000 - 0.76% -
450.soplex -96.14% 15709.000 607.000 - 0.66% -
444.namd -94.33% 15957.000 905.000 - 0.11% -
453.povray -92.60% 7395.000 547.000 - 0.55% -
429.mcf -91.94% 11727.000 945.000 - 0.64% -
433.milc -91.94% 13668.000 1102.000 - -0.27% -
436.cactusADM -89.39% 24396.000 2589.000 - 0.19% -
434.zeusmp -86.70% 20932.000 2783.000 - -0.25% -
400.perlbench -85.06% 11215.000 1676.000 - 1.76% -
401.bzip2 -82.26% 16971.000 3011.000 - 0.67% -
447.dealII -79.33% 9101.000 1881.000 - -0.21% -
470.lbm -77.07% 16312.000 3741.000 - -0.35% -
456.hmmer -76.49% 18995.000 4466.000 - -0.11% -
459.GemsFDTD -71.64% 25364.000 7192.000 - 0.94% -
481.wrf -70.70% 21991.000 6443.000 - 0.14% -
471.omnetpp -69.91% 9265.000 2788.000 - -0.43% -
473.astar -62.47% 12983.000 4872.000 - -1.46% -
410.bwaves -59.57% 14745.000 5962.000 - 0.86% -
464.h264ref -59.13% 15208.000 6215.000 - 0.47% -
445.gobmk -58.85% 12396.000 5101.000 - 0.31% -
435.gromacs -54.93% 16853.000 7596.000 - 0.80% -
458.sjeng -50.66% 16018.000 7903.000 - 0.61% -
416.gamess -49.75% 29409.000 14779.000 - -0.11% -
437.leslie3d -36.86% 18070.000 11410.000 - -14.26% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.88% 834.000 1.000 - -85.71% -
454.calculix -99.70% 659.000 2.000 - 0.00% -
454.calculix (avg) -99.70% 659.000 2.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.57% 1173.000 5.000 - -37.50% -
436.cactusADM (max) -99.51% 1231.000 6.000 - -70.00% -
482.sphinx3 (max) -99.39% 1152.000 7.000 - -22.22% -
482.sphinx3 (unexplained diff vs previous) -99.37% 1118.000 7.000 - -12.50% -
444.namd (max) -99.32% 879.000 6.000 - -14.29% -
454.calculix (max) -99.26% 272.000 2.000 - -33.33% -
454.calculix (unexplained diff vs previous) -99.18% 244.000 2.000 - 100.00% -
470.lbm (unexplained diff vs previous) -98.42% 822.000 13.000 - -59.38% -
453.povray (unexplained diff vs previous) -98.22% 169.000 3.000 - -50.00% -
416.gamess (unexplained diff vs previous) -98.10% 896.000 17.000 - 112.50% -
403.gcc (max) -98.08% 52.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -97.90% 5.230 0.110 - -85.71% -
482.sphinx3 -97.56% 859.000 21.000 - 0.00% -
482.sphinx3 (avg) -97.56% 859.000 21.000 - 0.00% -
453.povray (max) -97.38% 191.000 5.000 - 0.00% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
433.milc (max) -96.91% 97.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -96.88% 96.000 3.000 - -25.00% -
470.lbm (max) -96.86% 893.000 28.000 - -12.50% -
434.zeusmp (max) -96.67% 481.000 16.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -96.07% 3.050 0.120 - 140.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -96.05% 4.810 0.190 - -38.71% -
444.namd -95.89% 414.000 17.000 - 0.00% -
444.namd (avg) -95.89% 414.000 17.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -94.90% 98.000 5.000 - -66.67% -
436.cactusADM (max) (percentage) -94.65% 5.050 0.270 - -66.25% -
450.soplex (unexplained diff vs previous) -94.20% 69.000 4.000 - -71.43% -
416.gamess (max) -93.50% 923.000 60.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -93.06% 5.040 0.350 - -58.82% -
436.cactusADM -92.65% 585.000 43.000 - -2.27% -
436.cactusADM (avg) -92.65% 585.000 43.000 - -2.27% -
462.libquantum (max) -92.31% 13.000 1.000 - 0.00% -
453.povray -90.27% 113.000 11.000 - 0.00% -
453.povray (avg) -90.27% 113.000 11.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -88.53% 584.000 67.000 - 19.64% -
481.wrf (max) -88.51% 914.000 105.000 - -4.55% -
459.GemsFDTD (max) -88.41% 578.000 67.000 - 21.82% -
470.lbm -87.66% 608.000 75.000 - -1.32% -
470.lbm (avg) -87.66% 608.000 75.000 - -1.32% -
462.libquantum -87.50% 32.000 4.000 - 0.00% -
462.libquantum (avg) -87.50% 32.000 4.000 - 0.00% -
416.gamess (max) (percentage) -86.94% 3.140 0.410 - 0.00% -
444.namd (max) (percentage) -86.93% 5.510 0.720 - -7.69% -
456.hmmer (max) -86.73% 98.000 13.000 - -13.33% -
470.lbm (max) (percentage) -86.31% 5.480 0.750 - -12.79% -
450.soplex (max) -82.61% 69.000 12.000 - -14.29% -
471.omnetpp (max) -82.56% 172.000 30.000 - -3.23% -
434.zeusmp -80.78% 255.000 49.000 - 0.00% -
434.zeusmp (avg) -80.78% 255.000 49.000 - 0.00% -
447.dealII (max) -80.67% 150.000 29.000 - -3.33% -
471.omnetpp (unexplained diff vs previous) -80.65% 62.000 12.000 - 100.00% -
410.bwaves (max) -80.38% 260.000 51.000 - 64.52% -
410.bwaves (unexplained diff vs previous) -80.16% 257.000 51.000 - 59.38% -
435.gromacs (unexplained diff vs previous) -79.45% 292.000 60.000 - -3.23% -
456.hmmer (unexplained diff vs previous) (percentage) -78.85% 0.520 0.110 - -67.65% -
433.milc -76.60% 94.000 22.000 - 0.00% -
433.milc (avg) -76.60% 94.000 22.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -75.98% 2.290 0.550 - -50.00% -
482.sphinx3 (max) (percentage) -75.87% 3.150 0.760 - -28.30% -
482.sphinx3 (unexplained diff vs previous) (percentage) -75.49% 3.060 0.750 - -13.79% -
434.zeusmp (max) (percentage) -74.35% 2.300 0.590 - -1.67% -
435.gromacs (max) -74.32% 296.000 76.000 - -56.82% -
481.wrf -73.45% 565.000 150.000 - 0.00% -
481.wrf (avg) -73.45% 565.000 150.000 - 0.00% -
429.mcf (max) -72.97% 37.000 10.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -71.01% 69.000 20.000 - -33.33% -
410.bwaves -67.47% 289.000 94.000 - 1.08% -
410.bwaves (avg) -67.47% 289.000 94.000 - 1.08% -
400.perlbench (max) -67.42% 89.000 29.000 - 107.14% -
416.gamess -66.19% 485.000 164.000 - -2.38% -
416.gamess (avg) -66.19% 485.000 164.000 - -2.38% -
453.povray (max) (percentage) -63.32% 2.590 0.950 - -12.84% -
433.milc (unexplained diff vs previous) (percentage) -61.43% 0.700 0.270 - -25.00% -
401.bzip2 (max) -61.19% 67.000 26.000 - -23.53% -
459.GemsFDTD -60.80% 352.000 138.000 - 0.00% -
459.GemsFDTD (avg) -60.80% 352.000 138.000 - 0.00% -
481.wrf (max) (percentage) -60.58% 4.160 1.640 - -4.65% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -59.57% 2.300 0.930 - 17.72% -
459.GemsFDTD (max) (percentage) -58.77% 2.280 0.940 - 20.51% -
433.milc (max) (percentage) -54.93% 0.710 0.320 - -11.11% -
435.gromacs (unexplained diff vs previous) (percentage) -54.34% 1.730 0.790 - -3.66% -
410.bwaves (max) (percentage) -51.41% 1.770 0.860 - 59.26% -
410.bwaves (unexplained diff vs previous) (percentage) -50.57% 1.740 0.860 - 59.26% -
464.h264ref (unexplained diff vs previous) -50.00% 58.000 29.000 - 190.00% -
450.soplex -48.65% 37.000 19.000 - 0.00% -
450.soplex (avg) -48.65% 37.000 19.000 - 0.00% -
447.dealII -46.84% 79.000 42.000 - 0.00% -
447.dealII (avg) -46.84% 79.000 42.000 - 0.00% -
470.lbm (avg) (percentage) -45.84% 3.730 2.020 - -1.46% -
464.h264ref (max) -45.76% 59.000 32.000 - -5.88% -
471.omnetpp -43.12% 109.000 62.000 - -1.59% -
471.omnetpp (avg) -43.12% 109.000 62.000 - -1.59% -
435.gromacs (max) (percentage) -42.61% 1.760 1.010 - -56.84% -
456.hmmer (max) (percentage) -42.31% 0.520 0.300 - -11.76% -
471.omnetpp (max) (percentage) -41.94% 1.860 1.080 - -3.57% -
429.mcf (unexplained diff vs previous) -40.00% 10.000 6.000 - 20.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -35.82% 0.670 0.430 - 104.76% -
416.gamess (avg) (percentage) -32.73% 1.650 1.110 - -2.63% -
436.cactusADM (avg) (percentage) -29.58% 2.400 1.690 - -1.74% -
444.namd (avg) (percentage) -27.69% 2.600 1.880 - -2.08% -
465.tonto (max) -21.97% 223.000 174.000 - 12.99% -
465.tonto (max) (percentage) -21.64% 1.710 1.340 - 14.53% -
456.hmmer -19.64% 56.000 45.000 - -2.17% -
456.hmmer (avg) -19.64% 56.000 45.000 - -2.17% -
410.bwaves (avg) (percentage) -19.39% 1.960 1.580 - -0.63% -
400.perlbench -18.60% 43.000 35.000 - 2.94% -
400.perlbench (avg) -18.60% 43.000 35.000 - 2.94% -
400.perlbench (unexplained diff vs previous) -17.14% 35.000 29.000 - 141.67% -
465.tonto (avg) (percentage) -14.91% 1.140 0.970 - 1.04% -
465.tonto -14.86% 148.000 126.000 - 0.00% -
465.tonto (avg) -14.86% 148.000 126.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -11.11% 18.000 16.000 - -84.62% -
481.wrf (avg) (percentage) -8.95% 2.570 2.340 - 0.00% -
447.dealII (max) (percentage) -4.85% 1.650 1.570 - -3.09% -
482.sphinx3 (avg) (percentage) -2.98% 2.350 2.280 - -1.72% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1676.000 1.76%
401.bzip2 3011.000 -
403.gcc 57.000 -3.39%
410.bwaves 5962.000 -
416.gamess 14779.000 -
429.mcf 945.000 -
433.milc 1102.000 -
434.zeusmp 2783.000 -
435.gromacs 7596.000 -
436.cactusADM 2589.000 -
437.leslie3d 11410.000 -14.26%
444.namd 905.000 -
445.gobmk 5101.000 -
447.dealII 1881.000 -
450.soplex 607.000 -
453.povray 547.000 -
454.calculix 63.000 -3.08%
456.hmmer 4466.000 -
458.sjeng 7903.000 -
459.GemsFDTD 7192.000 -
462.libquantum 207.000 -
464.h264ref 6215.000 -
465.tonto 13000.000 -1.34%
470.lbm 3741.000 -
471.omnetpp 2788.000 -
473.astar 4872.000 -1.46%
481.wrf 6443.000 -
482.sphinx3 929.000 -
Geometric Mean 2199.893 -
Code Size (bytes)
Name Current %
400.perlbench 567014.000 -
401.bzip2 33646.000 -
403.gcc 1603038.000 -
410.bwaves 14762.000 -
416.gamess 4628484.000 -
429.mcf 7701.000 -
433.milc 47885.000 -
434.zeusmp 139198.000 -
435.gromacs 395094.000 -
436.cactusADM 258134.000 -
437.leslie3d 49520.000 -
444.namd 162891.000 -
445.gobmk 1089880.000 -
447.dealII 192682.000 -
450.soplex 136752.000 -
453.povray 497781.000 -
454.calculix 687531.000 -
456.hmmer 74925.000 -
458.sjeng 81781.000 -
459.GemsFDTD 198470.000 -
462.libquantum 13214.000 -
464.h264ref 301922.000 -
465.tonto 1446404.000 -
470.lbm 10853.000 -
471.omnetpp 299471.000 -
473.astar 15677.000 -
481.wrf 1537232.000 -
482.sphinx3 80162.000 -
Geometric Mean 158257.629 -
sample variability
Name Current %
400.perlbench 35.000 2.94%
400.perlbench (avg) 35.000 2.94%
400.perlbench (avg) (percentage) 2.090 -
400.perlbench (max) 29.000 107.14%
400.perlbench (max) (percentage) 1.760 97.75%
400.perlbench (unexplained diff vs previous) 29.000 141.67%
400.perlbench (unexplained diff vs previous) (percentage) 1.730 136.99%
401.bzip2 78.000 -1.27%
401.bzip2 (avg) 78.000 -1.27%
401.bzip2 (avg) (percentage) 2.620 -1.87%
401.bzip2 (max) 26.000 -23.53%
401.bzip2 (max) (percentage) 0.890 -23.28%
401.bzip2 (unexplained diff vs previous) 20.000 -33.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.660 -34.00%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 1.830 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 3.330 -
410.bwaves 94.000 1.08%
410.bwaves (avg) 94.000 1.08%
410.bwaves (avg) (percentage) 1.580 -
410.bwaves (max) 51.000 64.52%
410.bwaves (max) (percentage) 0.860 59.26%
410.bwaves (unexplained diff vs previous) 51.000 59.38%
410.bwaves (unexplained diff vs previous) (percentage) 0.860 59.26%
416.gamess 164.000 -2.38%
416.gamess (avg) 164.000 -2.38%
416.gamess (avg) (percentage) 1.110 -2.63%
416.gamess (max) 60.000 -
416.gamess (max) (percentage) 0.410 -
416.gamess (unexplained diff vs previous) 17.000 112.50%
416.gamess (unexplained diff vs previous) (percentage) 0.120 140.00%
429.mcf 59.000 -1.67%
429.mcf (avg) 59.000 -1.67%
429.mcf (avg) (percentage) 6.280 -2.03%
429.mcf (max) 10.000 -
429.mcf (max) (percentage) 1.120 -3.45%
429.mcf (unexplained diff vs previous) 6.000 20.00%
429.mcf (unexplained diff vs previous) (percentage) 0.630 18.87%
433.milc 22.000 -
433.milc (avg) 22.000 -
433.milc (avg) (percentage) 2.010 -1.95%
433.milc (max) 3.000 -
433.milc (max) (percentage) 0.320 -11.11%
433.milc (unexplained diff vs previous) 3.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.270 -25.00%
434.zeusmp 49.000 -
434.zeusmp (avg) 49.000 -
434.zeusmp (avg) (percentage) 1.780 -
434.zeusmp (max) 16.000 -
434.zeusmp (max) (percentage) 0.590 -1.67%
435.gromacs 178.000 -1.11%
435.gromacs (avg) 178.000 -1.11%
435.gromacs (avg) (percentage) 2.350 -2.08%
435.gromacs (max) 76.000 -56.82%
435.gromacs (max) (percentage) 1.010 -56.84%
435.gromacs (unexplained diff vs previous) 60.000 -3.23%
435.gromacs (unexplained diff vs previous) (percentage) 0.790 -3.66%
436.cactusADM 43.000 -2.27%
436.cactusADM (avg) 43.000 -2.27%
436.cactusADM (avg) (percentage) 1.690 -1.74%
436.cactusADM (max) 6.000 -70.00%
436.cactusADM (max) (percentage) 0.270 -66.25%
436.cactusADM (unexplained diff vs previous) 5.000 -37.50%
436.cactusADM (unexplained diff vs previous) (percentage) 0.190 -38.71%
437.leslie3d 481.000 -8.90%
437.leslie3d (avg) 481.000 -8.90%
437.leslie3d (avg) (percentage) 4.220 6.30%
437.leslie3d (max) 1627.000 -21.40%
437.leslie3d (max) (percentage) 14.260 -8.35%
437.leslie3d (unexplained diff vs previous) 1898.000 5.92%
437.leslie3d (unexplained diff vs previous) (percentage) 16.630 23.46%
444.namd 17.000 -
444.namd (avg) 17.000 -
444.namd (avg) (percentage) 1.880 -2.08%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.720 -7.69%
444.namd (unexplained diff vs previous) 1.000 -85.71%
444.namd (unexplained diff vs previous) (percentage) 0.110 -85.71%
445.gobmk 70.000 -1.41%
445.gobmk (avg) 70.000 -1.41%
445.gobmk (avg) (percentage) 1.380 -2.13%
445.gobmk (max) 89.000 -11.88%
445.gobmk (max) (percentage) 1.750 -12.50%
445.gobmk (unexplained diff vs previous) 16.000 -84.62%
445.gobmk (unexplained diff vs previous) (percentage) 0.310 -84.88%
447.dealII 42.000 -
447.dealII (avg) 42.000 -
447.dealII (avg) (percentage) 2.240 -
447.dealII (max) 29.000 -3.33%
447.dealII (max) (percentage) 1.570 -3.09%
450.soplex 19.000 -
450.soplex (avg) 19.000 -
450.soplex (avg) (percentage) 3.220 -1.83%
450.soplex (max) 12.000 -14.29%
450.soplex (max) (percentage) 2.140 -10.08%
450.soplex (unexplained diff vs previous) 4.000 -71.43%
450.soplex (unexplained diff vs previous) (percentage) 0.660 -71.55%
453.povray 11.000 -
453.povray (avg) 11.000 -
453.povray (avg) (percentage) 2.020 -1.94%
453.povray (max) 5.000 -
453.povray (max) (percentage) 0.950 -12.84%
453.povray (unexplained diff vs previous) 3.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.550 -50.00%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.920 -
454.calculix (max) 2.000 -33.33%
454.calculix (max) (percentage) 4.640 -2.52%
454.calculix (unexplained diff vs previous) 2.000 100.00%
454.calculix (unexplained diff vs previous) (percentage) 3.170 105.84%
456.hmmer 45.000 -2.17%
456.hmmer (avg) 45.000 -2.17%
456.hmmer (avg) (percentage) 1.020 -1.92%
456.hmmer (max) 13.000 -13.33%
456.hmmer (max) (percentage) 0.300 -11.76%
456.hmmer (unexplained diff vs previous) 5.000 -66.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -67.65%
458.sjeng 82.000 -1.20%
458.sjeng (avg) 82.000 -1.20%
458.sjeng (avg) (percentage) 1.050 -
458.sjeng (max) 48.000 166.67%
458.sjeng (max) (percentage) 0.610 165.22%
458.sjeng (unexplained diff vs previous) 48.000 700.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.610 662.50%
459.GemsFDTD 138.000 -
459.GemsFDTD (avg) 138.000 -
459.GemsFDTD (avg) (percentage) 1.920 -1.54%
459.GemsFDTD (max) 67.000 21.82%
459.GemsFDTD (max) (percentage) 0.940 20.51%
459.GemsFDTD (unexplained diff vs previous) 67.000 19.64%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.930 17.72%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 2.000 -2.44%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.780 -8.24%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 82.000 -
464.h264ref (avg) 82.000 -
464.h264ref (avg) (percentage) 1.320 -1.49%
464.h264ref (max) 32.000 -5.88%
464.h264ref (max) (percentage) 0.520 -5.45%
464.h264ref (unexplained diff vs previous) 29.000 190.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.470 193.75%
465.tonto 126.000 -
465.tonto (avg) 126.000 -
465.tonto (avg) (percentage) 0.970 1.04%
465.tonto (max) 174.000 12.99%
465.tonto (max) (percentage) 1.340 14.53%
465.tonto (unexplained diff vs previous) 177.000 16.45%
465.tonto (unexplained diff vs previous) (percentage) 1.360 18.26%
470.lbm 75.000 -1.32%
470.lbm (avg) 75.000 -1.32%
470.lbm (avg) (percentage) 2.020 -1.46%
470.lbm (max) 28.000 -12.50%
470.lbm (max) (percentage) 0.750 -12.79%
470.lbm (unexplained diff vs previous) 13.000 -59.38%
470.lbm (unexplained diff vs previous) (percentage) 0.350 -58.82%
471.omnetpp 62.000 -1.59%
471.omnetpp (avg) 62.000 -1.59%
471.omnetpp (avg) (percentage) 2.240 -1.32%
471.omnetpp (max) 30.000 -3.23%
471.omnetpp (max) (percentage) 1.080 -3.57%
471.omnetpp (unexplained diff vs previous) 12.000 100.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.430 104.76%
473.astar 94.000 -2.08%
473.astar (avg) 94.000 -2.08%
473.astar (avg) (percentage) 1.940 -
473.astar (max) 71.000 -10.13%
473.astar (max) (percentage) 1.460 -8.75%
473.astar (unexplained diff vs previous) 72.000 -7.69%
473.astar (unexplained diff vs previous) (percentage) 1.480 -6.33%
481.wrf 150.000 -
481.wrf (avg) 150.000 -
481.wrf (avg) (percentage) 2.340 -
481.wrf (max) 105.000 -4.55%
481.wrf (max) (percentage) 1.640 -4.65%
482.sphinx3 21.000 -
482.sphinx3 (avg) 21.000 -
482.sphinx3 (avg) (percentage) 2.280 -1.72%
482.sphinx3 (max) 7.000 -22.22%
482.sphinx3 (max) (percentage) 0.760 -28.30%
482.sphinx3 (unexplained diff vs previous) 7.000 -12.50%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.750 -13.79%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.570 -
Geometric Mean 6.402 -14.64%