Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d1bd9787f9ad8c49fb463d8d53411aeb5f9c179b (+ 14 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/71b1efd910d47362558defc31b92fc4cc80c0ec6 (+ 56 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5dd3bda59c2d9da138f0d98808d087cdb95cdc17 (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/148/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0148 (3-changed-components) 2023-11-05T15:05:19 0:00:00
Previous 0147 (basepoints/gcc-14-05127-g53010f6ff6d) 2023-11-03T22:16:46 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 52 16
Performance Improvements 101 193
Added Tests 2 2
Unchanged Tests 1081 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 4.84% 62.000 65.000 - 4.84% -
437.leslie3d 3.48% 10545.000 10912.000 - -6.25% -
453.povray 2.23% 537.000 549.000 - 0.37% -
447.dealII 1.50% 1731.000 1757.000 - 1.91% -
401.bzip2 1.17% 2998.000 3033.000 - 3.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (unexplained diff vs previous) 600.00% 2.000 14.000 - -99.21% -
465.tonto (unexplained diff vs previous) (percentage) 550.00% 0.020 0.130 - -99.20% -
434.zeusmp (unexplained diff vs previous) 500.00% 2.000 12.000 - -99.89% -
434.zeusmp (unexplained diff vs previous) (percentage) 487.50% 0.080 0.470 - -99.90% -
433.milc (unexplained diff vs previous) 400.00% 1.000 5.000 - -99.96% -
433.milc (unexplained diff vs previous) (percentage) 388.89% 0.090 0.440 - -99.96% -
464.h264ref (unexplained diff vs previous) 150.00% 8.000 20.000 - -99.71% -
464.h264ref (unexplained diff vs previous) (percentage) 150.00% 0.140 0.350 - -99.71% -
471.omnetpp (unexplained diff vs previous) 112.50% 8.000 17.000 - -99.84% -
471.omnetpp (unexplained diff vs previous) (percentage) 110.34% 0.290 0.610 - -99.84% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 102.00% 0.500 1.010 - -99.60% -
459.GemsFDTD (max) (percentage) 100.00% 0.500 1.000 - -98.60% -
459.GemsFDTD (unexplained diff vs previous) 100.00% 31.000 62.000 - -99.60% -
459.GemsFDTD (max) 96.77% 31.000 61.000 - -98.62% -
447.dealII (unexplained diff vs previous) 73.33% 15.000 26.000 - -99.63% -
453.povray (max) 71.43% 7.000 12.000 - -97.60% -
447.dealII (unexplained diff vs previous) (percentage) 70.11% 0.870 1.480 - -99.64% -
482.sphinx3 (unexplained diff vs previous) 66.67% 3.000 5.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) (percentage) 65.62% 0.320 0.530 - -99.98% -
453.povray (max) (percentage) 51.70% 1.470 2.230 - -97.56% -
453.povray (unexplained diff vs previous) 50.00% 8.000 12.000 - -99.79% -
453.povray (unexplained diff vs previous) (percentage) 46.98% 1.490 2.190 - -99.79% -
450.soplex (unexplained diff vs previous) (percentage) 44.96% 3.470 5.030 - -99.80% -
458.sjeng (unexplained diff vs previous) 40.91% 22.000 31.000 - -99.55% -
450.soplex (unexplained diff vs previous) 38.10% 21.000 29.000 - -99.80% -
458.sjeng (unexplained diff vs previous) (percentage) 36.67% 0.300 0.410 - -99.55% -
401.bzip2 (unexplained diff vs previous) 34.62% 26.000 35.000 - -99.68% -
450.soplex (max) (percentage) 33.06% 3.600 4.790 - -95.02% -
401.bzip2 (unexplained diff vs previous) (percentage) 32.18% 0.870 1.150 - -99.69% -
445.gobmk (unexplained diff vs previous) 32.00% 25.000 33.000 - -99.41% -
445.gobmk (unexplained diff vs previous) (percentage) 30.00% 0.500 0.650 - -99.41% -
450.soplex (max) 28.57% 21.000 27.000 - -95.05% -
401.bzip2 (max) 25.00% 28.000 35.000 - -98.49% -
401.bzip2 (max) (percentage) 24.47% 0.940 1.170 - -98.51% -
410.bwaves (unexplained diff vs previous) (percentage) 20.16% 1.240 1.490 - -98.92% -
410.bwaves (unexplained diff vs previous) 18.31% 71.000 84.000 - -98.92% -
410.bwaves (max) (percentage) 16.67% 1.260 1.470 - -97.46% -
410.bwaves (max) 13.89% 72.000 82.000 - -97.50% -
445.gobmk (max) (percentage) 13.79% 0.580 0.660 - -98.75% -
445.gobmk (max) 13.79% 29.000 33.000 - -98.75% -
453.povray 9.09% 11.000 12.000 - -71.43% -
453.povray (avg) 9.09% 11.000 12.000 - -71.43% -
447.dealII 3.12% 32.000 33.000 - -66.67% -
447.dealII (avg) 3.12% 32.000 33.000 - -66.67% -
437.leslie3d 2.79% 574.000 590.000 - 66.20% -
437.leslie3d (avg) 2.79% 574.000 590.000 - 66.20% -
450.soplex (avg) (percentage) 1.26% 3.170 3.210 - -50.08% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -4.79% 605.000 576.000 - 1.59% -
400.perlbench -2.39% 1592.000 1554.000 - -6.55% -
403.gcc -1.67% 60.000 59.000 - 5.36% -
410.bwaves -1.47% 5723.000 5639.000 - -0.23% -
429.mcf -1.27% 1416.000 1398.000 - -1.83% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) -94.44% 18.000 1.000 - -99.99% -
416.gamess (unexplained diff vs previous) (percentage) -92.86% 0.140 0.010 - -99.98% -
429.mcf (max) -86.21% 145.000 20.000 - -98.49% -
429.mcf (max) (percentage) -85.77% 10.260 1.460 - -98.43% -
437.leslie3d (unexplained diff vs previous) (percentage) -77.63% 15.020 3.360 - -83.10% -
437.leslie3d (unexplained diff vs previous) -76.83% 1584.000 367.000 - -84.14% -
400.perlbench (unexplained diff vs previous) -35.59% 59.000 38.000 - -99.57% -
400.perlbench (unexplained diff vs previous) (percentage) -33.96% 3.710 2.450 - -99.54% -
456.hmmer (unexplained diff vs previous) (percentage) -28.77% 0.730 0.520 - -99.81% -
456.hmmer (unexplained diff vs previous) -28.57% 21.000 15.000 - -99.81% -
436.cactusADM (unexplained diff vs previous) (percentage) -26.67% 0.900 0.660 - -99.92% -
436.cactusADM (unexplained diff vs previous) -26.32% 19.000 14.000 - -99.91% -
429.mcf (unexplained diff vs previous) -25.00% 24.000 18.000 - -99.90% -
473.astar (unexplained diff vs previous) (percentage) -24.00% 0.250 0.190 - -99.90% -
429.mcf (unexplained diff vs previous) (percentage) -23.67% 1.690 1.290 - -99.90% -
473.astar (unexplained diff vs previous) -23.08% 13.000 10.000 - -99.90% -
456.hmmer (max) (percentage) -16.67% 0.720 0.600 - -99.18% -
436.cactusADM (max) -15.79% 19.000 16.000 - -99.13% -
400.perlbench (max) -15.38% 65.000 55.000 - -96.06% -
481.wrf (unexplained diff vs previous) -15.38% 26.000 22.000 - -99.82% -
456.hmmer (max) -15.00% 20.000 17.000 - -99.20% -
481.wrf (unexplained diff vs previous) (percentage) -14.89% 0.470 0.400 - -99.82% -
400.perlbench (max) (percentage) -12.47% 4.090 3.580 - -95.74% -
436.cactusADM (max) (percentage) -12.22% 0.900 0.790 - -99.11% -
437.leslie3d (max) (percentage) -10.03% 13.060 11.750 - -29.13% -
462.libquantum (max) (percentage) -8.66% 1.270 1.160 - -98.83% -
435.gromacs (max) -8.47% 59.000 54.000 - -98.49% -
444.namd (max) -7.69% 13.000 12.000 - -98.25% -
473.astar (max) (percentage) -7.43% 2.020 1.870 - -97.19% -
435.gromacs (max) (percentage) -7.32% 0.820 0.760 - -98.45% -
437.leslie3d (max) -6.90% 1377.000 1282.000 - -33.54% -
473.astar (max) -6.73% 104.000 97.000 - -97.15% -
471.omnetpp (max) -6.25% 32.000 30.000 - -98.62% -
444.namd (max) (percentage) -5.52% 1.810 1.710 - -98.14% -
450.soplex -5.26% 19.000 18.000 - -50.00% -
450.soplex (avg) -5.26% 19.000 18.000 - -50.00% -
471.omnetpp (max) (percentage) -5.13% 1.170 1.110 - -98.61% -
400.perlbench -4.55% 44.000 42.000 - -60.00% -
400.perlbench (avg) -4.55% 44.000 42.000 - -60.00% -
433.milc -4.17% 24.000 23.000 - -66.67% -
433.milc (avg) -4.17% 24.000 23.000 - -66.67% -
482.sphinx3 -4.17% 24.000 23.000 - -68.92% -
482.sphinx3 (avg) -4.17% 24.000 23.000 - -68.92% -
454.calculix (max) (percentage) -4.03% 2.730 2.620 - -97.37% -
464.h264ref (max) -3.57% 28.000 27.000 - -99.14% -
416.gamess -3.52% 142.000 137.000 - -75.09% -
416.gamess (avg) -3.52% 142.000 137.000 - -75.09% -
416.gamess (avg) (percentage) -3.51% 1.140 1.100 - -75.11% -
456.hmmer -3.23% 31.000 30.000 - -76.38% -
456.hmmer (avg) -3.23% 31.000 30.000 - -76.38% -
482.sphinx3 (max) -3.12% 64.000 62.000 - -93.19% -
465.tonto (avg) (percentage) -3.07% 1.630 1.580 - -52.69% -
465.tonto -2.76% 181.000 176.000 - -51.78% -
465.tonto (avg) -2.76% 181.000 176.000 - -51.78% -
434.zeusmp (max) (percentage) -2.74% 0.730 0.710 - -99.13% -
481.wrf -2.56% 117.000 114.000 - -66.96% -
481.wrf (avg) -2.56% 117.000 114.000 - -66.96% -
436.cactusADM -2.44% 41.000 40.000 - -67.74% -
436.cactusADM (avg) -2.44% 41.000 40.000 - -67.74% -
403.gcc (max) (percentage) -2.38% 4.630 4.520 - -95.45% -
481.wrf (avg) (percentage) -2.37% 2.110 2.060 - -66.99% -
464.h264ref -2.30% 87.000 85.000 - -70.99% -
464.h264ref (avg) -2.30% 87.000 85.000 - -70.99% -
447.dealII (max) (percentage) -2.07% 1.930 1.890 - -97.65% -
429.mcf -2.02% 99.000 97.000 - -11.01% -
429.mcf (avg) -2.02% 99.000 97.000 - -11.01% -
464.h264ref (max) (percentage) -2.00% 0.500 0.490 - -99.10% -
464.h264ref (avg) (percentage) -1.96% 1.530 1.500 - -70.53% -
470.lbm (max) (percentage) -1.95% 2.570 2.520 - -96.52% -
482.sphinx3 (max) (percentage) -1.91% 6.790 6.660 - -93.10% -
434.zeusmp (avg) (percentage) -1.83% 1.640 1.610 - -72.48% -
462.libquantum (avg) (percentage) -1.82% 2.200 2.160 - -71.80% -
473.astar (avg) (percentage) -1.82% 2.200 2.160 - -48.08% -
465.tonto (max) (percentage) -1.80% 2.780 2.730 - -85.86% -
473.astar -1.75% 114.000 112.000 - -47.42% -
473.astar (avg) -1.75% 114.000 112.000 - -47.42% -
459.GemsFDTD -1.72% 116.000 114.000 - -68.33% -
459.GemsFDTD (avg) -1.72% 116.000 114.000 - -68.33% -
465.tonto (max) -1.61% 310.000 305.000 - -85.56% -
429.mcf (avg) (percentage) -1.56% 7.050 6.940 - -9.52% -
482.sphinx3 (avg) (percentage) -1.55% 2.580 2.540 - -67.97% -
470.lbm -1.54% 65.000 64.000 - -73.22% -
470.lbm (avg) -1.54% 65.000 64.000 - -73.22% -
445.gobmk (avg) (percentage) -1.46% 1.370 1.350 - -65.47% -
433.milc (avg) (percentage) -1.43% 2.100 2.070 - -65.79% -
471.omnetpp (avg) (percentage) -1.42% 2.810 2.770 - -66.22% -
471.omnetpp -1.30% 77.000 76.000 - -65.92% -
471.omnetpp (avg) -1.30% 77.000 76.000 - -65.92% -
458.sjeng -1.28% 78.000 77.000 - -68.05% -
458.sjeng (avg) -1.28% 78.000 77.000 - -68.05% -
410.bwaves -1.22% 82.000 81.000 - -67.47% -
410.bwaves (avg) -1.22% 82.000 81.000 - -67.47% -
470.lbm (avg) (percentage) -1.16% 1.720 1.700 - -73.14% -
459.GemsFDTD (avg) (percentage) -1.06% 1.880 1.860 - -68.15% -
436.cactusADM (avg) (percentage) -1.03% 1.940 1.920 - -67.89% -
470.lbm (max) -1.03% 97.000 96.000 - -96.50% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.62% 893848.000 908307.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - -1.67% -
454.calculix 4.84% 62.000 65.000 - 4.84% -
401.bzip2 3.13% 2941.000 3033.000 - 1.17% -
465.tonto 2.17% 10941.000 11178.000 - 0.13% -
434.zeusmp 1.99% 2514.000 2564.000 - 0.47% -
447.dealII 1.91% 1724.000 1757.000 - 1.50% -
471.omnetpp 1.65% 2724.000 2769.000 - 0.62% -
450.soplex 1.59% 567.000 576.000 - -4.79% -
473.astar 1.25% 5128.000 5192.000 - 0.19% -
436.cactusADM 1.15% 2083.000 2107.000 - -0.66% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 77.38% 3.050 5.410 - -0.73% -
437.leslie3d 66.20% 355.000 590.000 - 2.79% -
437.leslie3d (avg) 66.20% 355.000 590.000 - 2.79% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.82% 152037.000 149275.000 - 0.00% -
464.h264ref -1.52% 387748.000 381840.000 - 0.00% -
459.GemsFDTD -1.27% 244728.000 241628.000 - 0.00% -
437.leslie3d -1.04% 59479.000 58862.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench -6.55% 1663.000 1554.000 - -2.39% -
437.leslie3d -6.25% 11640.000 10912.000 - 3.48% -
429.mcf -1.83% 1424.000 1398.000 - -1.27% -
458.sjeng -1.10% 7567.000 7484.000 - 0.42% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
416.gamess (unexplained diff vs previous) -99.99% 7819.000 1.000 - -94.44% -
416.gamess (unexplained diff vs previous) (percentage) -99.98% 62.730 0.010 - -92.86% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 5.000 - 66.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.530 - 65.62% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 5.000 - 400.00% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.440 - 388.89% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.92% 787.130 0.660 - -26.67% -
436.cactusADM (unexplained diff vs previous) -99.91% 16396.000 14.000 - -26.32% -
473.astar (unexplained diff vs previous) (percentage) -99.90% 197.850 0.190 - -24.00% -
429.mcf (unexplained diff vs previous) -99.90% 18593.000 18.000 - -25.00% -
473.astar (unexplained diff vs previous) -99.90% 10146.000 10.000 - -23.08% -
429.mcf (unexplained diff vs previous) (percentage) -99.90% 1305.690 1.290 - -23.67% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.90% 448.690 0.470 - 487.50% -
434.zeusmp (unexplained diff vs previous) -99.89% 11280.000 12.000 - 500.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.84% 391.300 0.610 - 110.34% -
471.omnetpp (unexplained diff vs previous) -99.84% 10659.000 17.000 - 112.50% -
481.wrf (unexplained diff vs previous) -99.82% 12149.000 22.000 - -15.38% -
481.wrf (unexplained diff vs previous) (percentage) -99.82% 219.530 0.400 - -14.89% -
456.hmmer (unexplained diff vs previous) (percentage) -99.81% 278.630 0.520 - -28.77% -
456.hmmer (unexplained diff vs previous) -99.81% 8030.000 15.000 - -28.57% -
450.soplex (unexplained diff vs previous) (percentage) -99.80% 2557.320 5.030 - 44.96% -
450.soplex (unexplained diff vs previous) -99.80% 14500.000 29.000 - 38.10% -
453.povray (unexplained diff vs previous) (percentage) -99.79% 1043.330 2.190 - 46.98% -
453.povray (unexplained diff vs previous) -99.79% 5707.000 12.000 - 50.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.76% 263.730 0.630 - 0.00% -
470.lbm (unexplained diff vs previous) -99.76% 9990.000 24.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.71% 6843.000 20.000 - 150.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.71% 118.780 0.350 - 150.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.69% 368.340 1.150 - 32.18% -
401.bzip2 (unexplained diff vs previous) -99.68% 10833.000 35.000 - 34.62% -
416.gamess (max) -99.65% 4805.000 17.000 - 0.00% -
416.gamess (max) (percentage) -99.64% 38.550 0.140 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.64% 407.020 1.480 - 70.11% -
447.dealII (unexplained diff vs previous) -99.63% 7017.000 26.000 - 73.33% -
459.GemsFDTD (unexplained diff vs previous) -99.60% 15458.000 62.000 - 100.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.60% 250.410 1.010 - 102.00% -
400.perlbench (unexplained diff vs previous) -99.57% 8772.000 38.000 - -35.59% -
458.sjeng (unexplained diff vs previous) -99.55% 6876.000 31.000 - 40.91% -
458.sjeng (unexplained diff vs previous) (percentage) -99.55% 90.870 0.410 - 36.67% -
400.perlbench (unexplained diff vs previous) (percentage) -99.54% 527.480 2.450 - -33.96% -
445.gobmk (unexplained diff vs previous) (percentage) -99.41% 111.110 0.650 - 30.00% -
445.gobmk (unexplained diff vs previous) -99.41% 5581.000 33.000 - 32.00% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
465.tonto (unexplained diff vs previous) -99.21% 1771.000 14.000 - 600.00% -
456.hmmer (max) -99.20% 2120.000 17.000 - -15.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.20% 16.190 0.130 - 550.00% -
456.hmmer (max) (percentage) -99.18% 73.590 0.600 - -16.67% -
464.h264ref (max) -99.14% 3127.000 27.000 - -3.57% -
436.cactusADM (max) -99.13% 1848.000 16.000 - -15.79% -
434.zeusmp (max) (percentage) -99.13% 81.770 0.710 - -2.74% -
434.zeusmp (max) -99.12% 2055.000 18.000 - 0.00% -
436.cactusADM (max) (percentage) -99.11% 88.730 0.790 - -12.22% -
464.h264ref (max) (percentage) -99.10% 54.290 0.490 - -2.00% -
410.bwaves (unexplained diff vs previous) -98.92% 7794.000 84.000 - 18.31% -
410.bwaves (unexplained diff vs previous) (percentage) -98.92% 137.900 1.490 - 20.16% -
458.sjeng (max) -98.86% 3602.000 41.000 - 0.00% -
462.libquantum (max) (percentage) -98.83% 98.970 1.160 - -8.66% -
458.sjeng (max) (percentage) -98.82% 47.610 0.560 - 0.00% -
445.gobmk (max) -98.75% 2643.000 33.000 - 13.79% -
445.gobmk (max) (percentage) -98.75% 52.630 0.660 - 13.79% -
459.GemsFDTD (max) -98.62% 4411.000 61.000 - 96.77% -
471.omnetpp (max) -98.62% 2169.000 30.000 - -6.25% -
471.omnetpp (max) (percentage) -98.61% 79.650 1.110 - -5.13% -
459.GemsFDTD (max) (percentage) -98.60% 71.460 1.000 - 100.00% -
401.bzip2 (max) (percentage) -98.51% 78.650 1.170 - 24.47% -
435.gromacs (max) -98.49% 3573.000 54.000 - -8.47% -
429.mcf (max) -98.49% 1322.000 20.000 - -86.21% -
401.bzip2 (max) -98.49% 2313.000 35.000 - 25.00% -
435.gromacs (max) (percentage) -98.45% 49.160 0.760 - -7.32% -
429.mcf (max) (percentage) -98.43% 92.890 1.460 - -85.77% -
454.calculix (max) -98.36% 61.000 1.000 - 0.00% -
444.namd (max) -98.25% 685.000 12.000 - -7.69% -
444.namd (max) (percentage) -98.14% 91.790 1.710 - -5.52% -
481.wrf (max) -98.00% 3801.000 76.000 - 0.00% -
481.wrf (max) (percentage) -97.99% 68.700 1.380 - 0.00% -
447.dealII (max) (percentage) -97.65% 80.280 1.890 - -2.07% -
447.dealII (max) -97.62% 1384.000 33.000 - 0.00% -
453.povray (max) -97.60% 499.000 12.000 - 71.43% -
453.povray (max) (percentage) -97.56% 91.250 2.230 - 51.70% -
410.bwaves (max) -97.50% 3276.000 82.000 - 13.89% -
410.bwaves (max) (percentage) -97.46% 57.970 1.470 - 16.67% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
454.calculix (max) (percentage) -97.37% 99.730 2.620 - -4.03% -
473.astar (max) (percentage) -97.19% 66.430 1.870 - -7.43% -
473.astar (max) -97.15% 3406.000 97.000 - -6.73% -
470.lbm (max) (percentage) -96.52% 72.510 2.520 - -1.95% -
470.lbm (max) -96.50% 2746.000 96.000 - -1.03% -
403.gcc (max) -96.36% 55.000 2.000 - 0.00% -
433.milc (max) -96.07% 1044.000 41.000 - 0.00% -
400.perlbench (max) -96.06% 1397.000 55.000 - -15.38% -
433.milc (max) (percentage) -96.03% 90.750 3.600 - 0.00% -
400.perlbench (max) (percentage) -95.74% 84.060 3.580 - -12.47% -
403.gcc (max) (percentage) -95.45% 99.360 4.520 - -2.38% -
450.soplex (max) -95.05% 545.000 27.000 - 28.57% -
450.soplex (max) (percentage) -95.02% 96.240 4.790 - 33.06% -
482.sphinx3 (max) -93.19% 911.000 62.000 - -3.12% -
482.sphinx3 (max) (percentage) -93.10% 96.500 6.660 - -1.91% -
465.tonto (max) (percentage) -85.86% 19.310 2.730 - -1.80% -
465.tonto (max) -85.56% 2112.000 305.000 - -1.61% -
437.leslie3d (unexplained diff vs previous) -84.14% 2314.000 367.000 - -76.83% -
437.leslie3d (unexplained diff vs previous) (percentage) -83.10% 19.880 3.360 - -77.63% -
444.namd -76.47% 68.000 16.000 - 0.00% -
444.namd (avg) -76.47% 68.000 16.000 - 0.00% -
456.hmmer -76.38% 127.000 30.000 - -3.23% -
456.hmmer (avg) -76.38% 127.000 30.000 - -3.23% -
456.hmmer (avg) (percentage) -75.74% 4.410 1.070 - -0.93% -
444.namd (avg) (percentage) -75.38% 9.220 2.270 - 0.00% -
416.gamess (avg) (percentage) -75.11% 4.420 1.100 - -3.51% -
416.gamess -75.09% 550.000 137.000 - -3.52% -
416.gamess (avg) -75.09% 550.000 137.000 - -3.52% -
470.lbm -73.22% 239.000 64.000 - -1.54% -
470.lbm (avg) -73.22% 239.000 64.000 - -1.54% -
470.lbm (avg) (percentage) -73.14% 6.330 1.700 - -1.16% -
434.zeusmp (avg) (percentage) -72.48% 5.850 1.610 - -1.83% -
434.zeusmp -72.11% 147.000 41.000 - 0.00% -
434.zeusmp (avg) -72.11% 147.000 41.000 - 0.00% -
462.libquantum (avg) (percentage) -71.80% 7.660 2.160 - -1.82% -
453.povray (avg) (percentage) -71.70% 7.810 2.210 - 0.00% -
453.povray -71.43% 42.000 12.000 - 9.09% -
453.povray (avg) -71.43% 42.000 12.000 - 9.09% -
464.h264ref -70.99% 293.000 85.000 - -2.30% -
464.h264ref (avg) -70.99% 293.000 85.000 - -2.30% -
464.h264ref (avg) (percentage) -70.53% 5.090 1.500 - -1.96% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
482.sphinx3 -68.92% 74.000 23.000 - -4.17% -
482.sphinx3 (avg) -68.92% 74.000 23.000 - -4.17% -
459.GemsFDTD -68.33% 360.000 114.000 - -1.72% -
459.GemsFDTD (avg) -68.33% 360.000 114.000 - -1.72% -
459.GemsFDTD (avg) (percentage) -68.15% 5.840 1.860 - -1.06% -
458.sjeng -68.05% 241.000 77.000 - -1.28% -
458.sjeng (avg) -68.05% 241.000 77.000 - -1.28% -
482.sphinx3 (avg) (percentage) -67.97% 7.930 2.540 - -1.55% -
436.cactusADM (avg) (percentage) -67.89% 5.980 1.920 - -1.03% -
436.cactusADM -67.74% 124.000 40.000 - -2.44% -
436.cactusADM (avg) -67.74% 124.000 40.000 - -2.44% -
410.bwaves -67.47% 249.000 81.000 - -1.22% -
410.bwaves (avg) -67.47% 249.000 81.000 - -1.22% -
447.dealII (avg) (percentage) -67.42% 5.770 1.880 - -0.53% -
458.sjeng (avg) (percentage) -67.40% 3.190 1.040 - -0.95% -
410.bwaves (avg) (percentage) -67.35% 4.410 1.440 - 0.00% -
481.wrf (avg) (percentage) -66.99% 6.240 2.060 - -2.37% -
481.wrf -66.96% 345.000 114.000 - -2.56% -
481.wrf (avg) -66.96% 345.000 114.000 - -2.56% -
433.milc -66.67% 69.000 23.000 - -4.17% -
433.milc (avg) -66.67% 69.000 23.000 - -4.17% -
447.dealII -66.67% 99.000 33.000 - 3.12% -
447.dealII (avg) -66.67% 99.000 33.000 - 3.12% -
471.omnetpp (avg) (percentage) -66.22% 8.200 2.770 - -1.42% -
471.omnetpp -65.92% 223.000 76.000 - -1.30% -
471.omnetpp (avg) -65.92% 223.000 76.000 - -1.30% -
433.milc (avg) (percentage) -65.79% 6.050 2.070 - -1.43% -
445.gobmk (avg) (percentage) -65.47% 3.910 1.350 - -1.46% -
445.gobmk -65.31% 196.000 68.000 - 0.00% -
445.gobmk (avg) -65.31% 196.000 68.000 - 0.00% -
401.bzip2 (avg) (percentage) -62.77% 5.480 2.040 - -0.97% -
401.bzip2 -62.11% 161.000 61.000 - 0.00% -
401.bzip2 (avg) -62.11% 161.000 61.000 - 0.00% -
400.perlbench -60.00% 105.000 42.000 - -4.55% -
400.perlbench (avg) -60.00% 105.000 42.000 - -4.55% -
400.perlbench (avg) (percentage) -56.69% 6.350 2.750 - -0.72% -
435.gromacs -55.31% 367.000 164.000 - -0.61% -
435.gromacs (avg) -55.31% 367.000 164.000 - -0.61% -
435.gromacs (avg) (percentage) -54.94% 5.060 2.280 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto (avg) (percentage) -52.69% 3.340 1.580 - -3.07% -
465.tonto -51.78% 365.000 176.000 - -2.76% -
465.tonto (avg) -51.78% 365.000 176.000 - -2.76% -
450.soplex (avg) (percentage) -50.08% 6.430 3.210 - 1.26% -
403.gcc -50.00% 4.000 2.000 - 0.00% -
403.gcc (avg) -50.00% 4.000 2.000 - 0.00% -
450.soplex -50.00% 36.000 18.000 - -5.26% -
450.soplex (avg) -50.00% 36.000 18.000 - -5.26% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) (percentage) -49.88% 8.020 4.020 - 0.00% -
473.astar (avg) (percentage) -48.08% 4.160 2.160 - -1.82% -
473.astar -47.42% 213.000 112.000 - -1.75% -
473.astar (avg) -47.42% 213.000 112.000 - -1.75% -
403.gcc (avg) (percentage) -34.84% 7.320 4.770 - 0.00% -
437.leslie3d (max) -33.54% 1929.000 1282.000 - -6.90% -
437.leslie3d (max) (percentage) -29.13% 16.580 11.750 - -10.03% -
429.mcf -11.01% 109.000 97.000 - -2.02% -
429.mcf (avg) -11.01% 109.000 97.000 - -2.02% -
429.mcf (avg) (percentage) -9.52% 7.670 6.940 - -1.56% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1554.000 -2.39%
401.bzip2 3033.000 1.17%
403.gcc 59.000 -1.67%
410.bwaves 5639.000 -1.47%
416.gamess 12463.000 -
429.mcf 1398.000 -1.27%
433.milc 1148.000 -
434.zeusmp 2564.000 -
435.gromacs 7206.000 -
436.cactusADM 2107.000 -
437.leslie3d 10912.000 3.48%
444.namd 741.000 -
445.gobmk 5063.000 -
447.dealII 1757.000 1.50%
450.soplex 576.000 -4.79%
453.povray 549.000 2.23%
454.calculix 65.000 4.84%
456.hmmer 2896.000 -
458.sjeng 7484.000 -
459.GemsFDTD 6160.000 -
462.libquantum 139.000 -
464.h264ref 5713.000 -
465.tonto 11178.000 -
470.lbm 3819.000 -
471.omnetpp 2769.000 -
473.astar 5192.000 -
481.wrf 5568.000 -
482.sphinx3 944.000 -
Geometric Mean 2060.388 -
Code Size (bytes)
Name Current %
400.perlbench 908307.000 -
401.bzip2 44031.000 -
403.gcc 2452575.000 -
410.bwaves 16604.000 -
416.gamess 5722065.000 -
429.mcf 9119.000 -
433.milc 61125.000 -
434.zeusmp 149275.000 -
435.gromacs 498325.000 -
436.cactusADM 350969.000 -
437.leslie3d 58862.000 -
444.namd 188104.000 -
445.gobmk 1378310.000 -
447.dealII 311118.000 -
450.soplex 204302.000 -
453.povray 657825.000 -
454.calculix 840362.000 -
456.hmmer 108287.000 -
458.sjeng 103652.000 -
459.GemsFDTD 241628.000 -
462.libquantum 16053.000 -
464.h264ref 381840.000 -
465.tonto 1952158.000 -
470.lbm 9707.000 -
471.omnetpp 480712.000 -
473.astar 22920.000 -
481.wrf 1945622.000 -
482.sphinx3 112775.000 -
Geometric Mean 205240.704 -
sample variability
Name Current %
400.perlbench 42.000 -4.55%
400.perlbench (avg) 42.000 -4.55%
400.perlbench (avg) (percentage) 2.750 -
400.perlbench (max) 55.000 -15.38%
400.perlbench (max) (percentage) 3.580 -12.47%
400.perlbench (unexplained diff vs previous) 38.000 -35.59%
400.perlbench (unexplained diff vs previous) (percentage) 2.450 -33.96%
401.bzip2 61.000 -
401.bzip2 (avg) 61.000 -
401.bzip2 (avg) (percentage) 2.040 -
401.bzip2 (max) 35.000 25.00%
401.bzip2 (max) (percentage) 1.170 24.47%
401.bzip2 (unexplained diff vs previous) 35.000 34.62%
401.bzip2 (unexplained diff vs previous) (percentage) 1.150 32.18%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 4.770 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.520 -2.38%
410.bwaves 81.000 -1.22%
410.bwaves (avg) 81.000 -1.22%
410.bwaves (avg) (percentage) 1.440 -
410.bwaves (max) 82.000 13.89%
410.bwaves (max) (percentage) 1.470 16.67%
410.bwaves (unexplained diff vs previous) 84.000 18.31%
410.bwaves (unexplained diff vs previous) (percentage) 1.490 20.16%
416.gamess 137.000 -3.52%
416.gamess (avg) 137.000 -3.52%
416.gamess (avg) (percentage) 1.100 -3.51%
416.gamess (max) 17.000 -
416.gamess (max) (percentage) 0.140 -
416.gamess (unexplained diff vs previous) 1.000 -94.44%
416.gamess (unexplained diff vs previous) (percentage) 0.010 -92.86%
429.mcf 97.000 -2.02%
429.mcf (avg) 97.000 -2.02%
429.mcf (avg) (percentage) 6.940 -1.56%
429.mcf (max) 20.000 -86.21%
429.mcf (max) (percentage) 1.460 -85.77%
429.mcf (unexplained diff vs previous) 18.000 -25.00%
429.mcf (unexplained diff vs previous) (percentage) 1.290 -23.67%
433.milc 23.000 -4.17%
433.milc (avg) 23.000 -4.17%
433.milc (avg) (percentage) 2.070 -1.43%
433.milc (max) 41.000 -
433.milc (max) (percentage) 3.600 -
433.milc (unexplained diff vs previous) 5.000 400.00%
433.milc (unexplained diff vs previous) (percentage) 0.440 388.89%
434.zeusmp 41.000 -
434.zeusmp (avg) 41.000 -
434.zeusmp (avg) (percentage) 1.610 -1.83%
434.zeusmp (max) 18.000 -
434.zeusmp (max) (percentage) 0.710 -2.74%
434.zeusmp (unexplained diff vs previous) 12.000 500.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.470 487.50%
435.gromacs 164.000 -
435.gromacs (avg) 164.000 -
435.gromacs (avg) (percentage) 2.280 -
435.gromacs (max) 54.000 -8.47%
435.gromacs (max) (percentage) 0.760 -7.32%
436.cactusADM 40.000 -2.44%
436.cactusADM (avg) 40.000 -2.44%
436.cactusADM (avg) (percentage) 1.920 -1.03%
436.cactusADM (max) 16.000 -15.79%
436.cactusADM (max) (percentage) 0.790 -12.22%
436.cactusADM (unexplained diff vs previous) 14.000 -26.32%
436.cactusADM (unexplained diff vs previous) (percentage) 0.660 -26.67%
437.leslie3d 590.000 2.79%
437.leslie3d (avg) 590.000 2.79%
437.leslie3d (avg) (percentage) 5.410 -
437.leslie3d (max) 1282.000 -6.90%
437.leslie3d (max) (percentage) 11.750 -10.03%
437.leslie3d (unexplained diff vs previous) 367.000 -76.83%
437.leslie3d (unexplained diff vs previous) (percentage) 3.360 -77.63%
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 2.270 -
444.namd (max) 12.000 -7.69%
444.namd (max) (percentage) 1.710 -5.52%
445.gobmk 68.000 -
445.gobmk (avg) 68.000 -
445.gobmk (avg) (percentage) 1.350 -1.46%
445.gobmk (max) 33.000 13.79%
445.gobmk (max) (percentage) 0.660 13.79%
445.gobmk (unexplained diff vs previous) 33.000 32.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.650 30.00%
447.dealII 33.000 3.12%
447.dealII (avg) 33.000 3.12%
447.dealII (avg) (percentage) 1.880 -
447.dealII (max) 33.000 -
447.dealII (max) (percentage) 1.890 -2.07%
447.dealII (unexplained diff vs previous) 26.000 73.33%
447.dealII (unexplained diff vs previous) (percentage) 1.480 70.11%
450.soplex 18.000 -5.26%
450.soplex (avg) 18.000 -5.26%
450.soplex (avg) (percentage) 3.210 1.26%
450.soplex (max) 27.000 28.57%
450.soplex (max) (percentage) 4.790 33.06%
450.soplex (unexplained diff vs previous) 29.000 38.10%
450.soplex (unexplained diff vs previous) (percentage) 5.030 44.96%
453.povray 12.000 9.09%
453.povray (avg) 12.000 9.09%
453.povray (avg) (percentage) 2.210 -
453.povray (max) 12.000 71.43%
453.povray (max) (percentage) 2.230 51.70%
453.povray (unexplained diff vs previous) 12.000 50.00%
453.povray (unexplained diff vs previous) (percentage) 2.190 46.98%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.020 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.620 -4.03%
456.hmmer 30.000 -3.23%
456.hmmer (avg) 30.000 -3.23%
456.hmmer (avg) (percentage) 1.070 -
456.hmmer (max) 17.000 -15.00%
456.hmmer (max) (percentage) 0.600 -16.67%
456.hmmer (unexplained diff vs previous) 15.000 -28.57%
456.hmmer (unexplained diff vs previous) (percentage) 0.520 -28.77%
458.sjeng 77.000 -1.28%
458.sjeng (avg) 77.000 -1.28%
458.sjeng (avg) (percentage) 1.040 -
458.sjeng (max) 41.000 -
458.sjeng (max) (percentage) 0.560 -
458.sjeng (unexplained diff vs previous) 31.000 40.91%
458.sjeng (unexplained diff vs previous) (percentage) 0.410 36.67%
459.GemsFDTD 114.000 -1.72%
459.GemsFDTD (avg) 114.000 -1.72%
459.GemsFDTD (avg) (percentage) 1.860 -1.06%
459.GemsFDTD (max) 61.000 96.77%
459.GemsFDTD (max) (percentage) 1.000 100.00%
459.GemsFDTD (unexplained diff vs previous) 62.000 100.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.010 102.00%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.160 -1.82%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.160 -8.66%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 85.000 -2.30%
464.h264ref (avg) 85.000 -2.30%
464.h264ref (avg) (percentage) 1.500 -1.96%
464.h264ref (max) 27.000 -3.57%
464.h264ref (max) (percentage) 0.490 -2.00%
464.h264ref (unexplained diff vs previous) 20.000 150.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.350 150.00%
465.tonto 176.000 -2.76%
465.tonto (avg) 176.000 -2.76%
465.tonto (avg) (percentage) 1.580 -3.07%
465.tonto (max) 305.000 -1.61%
465.tonto (max) (percentage) 2.730 -1.80%
465.tonto (unexplained diff vs previous) 14.000 600.00%
465.tonto (unexplained diff vs previous) (percentage) 0.130 550.00%
470.lbm 64.000 -1.54%
470.lbm (avg) 64.000 -1.54%
470.lbm (avg) (percentage) 1.700 -1.16%
470.lbm (max) 96.000 -1.03%
470.lbm (max) (percentage) 2.520 -1.95%
470.lbm (unexplained diff vs previous) 24.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.630 -
471.omnetpp 76.000 -1.30%
471.omnetpp (avg) 76.000 -1.30%
471.omnetpp (avg) (percentage) 2.770 -1.42%
471.omnetpp (max) 30.000 -6.25%
471.omnetpp (max) (percentage) 1.110 -5.13%
471.omnetpp (unexplained diff vs previous) 17.000 112.50%
471.omnetpp (unexplained diff vs previous) (percentage) 0.610 110.34%
473.astar 112.000 -1.75%
473.astar (avg) 112.000 -1.75%
473.astar (avg) (percentage) 2.160 -1.82%
473.astar (max) 97.000 -6.73%
473.astar (max) (percentage) 1.870 -7.43%
473.astar (unexplained diff vs previous) 10.000 -23.08%
473.astar (unexplained diff vs previous) (percentage) 0.190 -24.00%
481.wrf 114.000 -2.56%
481.wrf (avg) 114.000 -2.56%
481.wrf (avg) (percentage) 2.060 -2.37%
481.wrf (max) 76.000 -
481.wrf (max) (percentage) 1.380 -
481.wrf (unexplained diff vs previous) 22.000 -15.38%
481.wrf (unexplained diff vs previous) (percentage) 0.400 -14.89%
482.sphinx3 23.000 -4.17%
482.sphinx3 (avg) 23.000 -4.17%
482.sphinx3 (avg) (percentage) 2.540 -1.55%
482.sphinx3 (max) 62.000 -3.12%
482.sphinx3 (max) (percentage) 6.660 -1.91%
482.sphinx3 (unexplained diff vs previous) 5.000 66.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.530 65.62%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 7.418 -8.45%