Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=93203eebe2abf35d94d738541e4c62472a4102b8 (+ 41 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/7f9083ffe262cb14c49d042fc6363514badea6cb (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb5bbc20702981c287aa3e44640e7d2f2b9a28cf (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (+ 16213 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/112/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0112 (3-changed-components) 2023-09-12T06:52:43 0:00:00
Previous 0107 (3-changed-components) 2023-09-08T07:08:24 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 38 12
Performance Improvements 126 192
Added Tests 9 7
Unchanged Tests 1063 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.51% 57.000 59.000 - 5.36% -
400.perlbench 3.02% 1620.000 1669.000 - 0.36% -
473.astar 2.04% 5159.000 5264.000 - 2.65% -
481.wrf 1.58% 5520.000 5607.000 - 1.32% -
437.leslie3d 1.27% 10637.000 10772.000 - -7.46% -
453.povray 1.11% 541.000 547.000 - 0.00% -
435.gromacs 1.07% 7256.000 7334.000 - 0.89% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 3466.67% 0.030 1.070 - -99.71% -
401.bzip2 (unexplained diff vs previous) 3100.00% 1.000 32.000 - -99.70% -
471.omnetpp (unexplained diff vs previous) (percentage) 560.00% 0.400 2.640 - -99.33% -
471.omnetpp (unexplained diff vs previous) 545.45% 11.000 71.000 - -99.33% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 484.62% 0.130 0.760 - -99.70% -
459.GemsFDTD (unexplained diff vs previous) 475.00% 8.000 46.000 - -99.70% -
401.bzip2 (max) 342.86% 7.000 31.000 - -98.66% -
401.bzip2 (max) (percentage) 337.50% 0.240 1.050 - -98.66% -
436.cactusADM (unexplained diff vs previous) 275.00% 4.000 15.000 - -99.91% -
436.cactusADM (unexplained diff vs previous) (percentage) 273.68% 0.190 0.710 - -99.91% -
400.perlbench (unexplained diff vs previous) 206.25% 16.000 49.000 - -99.44% -
400.perlbench (unexplained diff vs previous) (percentage) 196.97% 0.990 2.940 - -99.44% -
465.tonto (unexplained diff vs previous) (percentage) 193.75% 0.160 0.470 - -97.10% -
465.tonto (unexplained diff vs previous) 183.33% 18.000 51.000 - -97.12% -
471.omnetpp (max) 155.56% 27.000 69.000 - -96.82% -
471.omnetpp (max) (percentage) 154.46% 1.010 2.570 - -96.77% -
400.perlbench (max) 66.67% 30.000 50.000 - -96.42% -
400.perlbench (max) (percentage) 60.64% 1.880 3.020 - -96.41% -
444.namd (unexplained diff vs previous) 50.00% 4.000 6.000 - -99.93% -
444.namd (unexplained diff vs previous) (percentage) 50.00% 0.540 0.810 - -99.93% -
481.wrf (unexplained diff vs previous) 42.62% 61.000 87.000 - -99.28% -
483.xalancbmk (unexplained diff vs previous) 40.00% 5.000 7.000 - -99.92% -
481.wrf (unexplained diff vs previous) (percentage) 39.64% 1.110 1.550 - -99.29% -
483.xalancbmk (unexplained diff vs previous) (percentage) 38.46% 0.130 0.180 - -99.92% -
459.GemsFDTD (max) (percentage) 33.93% 0.560 0.750 - -98.95% -
459.GemsFDTD (max) 32.35% 34.000 45.000 - -98.98% -
400.perlbench 2.22% 45.000 46.000 - -56.19% -
400.perlbench (avg) 2.22% 45.000 46.000 - -56.19% -
473.astar 1.90% 105.000 107.000 - -49.77% -
473.astar (avg) 1.90% 105.000 107.000 - -49.77% -
454.calculix (unexplained diff vs previous) (percentage) 1.26% 1.590 1.610 - -100.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -2.57% 2764.000 2693.000 - -1.14% -
454.calculix -1.59% 63.000 62.000 - 0.00% -
445.gobmk -1.26% 5093.000 5029.000 - 0.12% -
401.bzip2 -1.05% 3036.000 3004.000 - 2.14% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) -92.68% 0.410 0.030 - -99.99% -
456.hmmer (unexplained diff vs previous) -91.67% 12.000 1.000 - -99.99% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.92% 12.400 1.250 - -93.71% -
437.leslie3d (unexplained diff vs previous) -89.76% 1319.000 135.000 - -94.17% -
464.h264ref (unexplained diff vs previous) (percentage) -82.14% 0.280 0.050 - -99.96% -
464.h264ref (unexplained diff vs previous) -81.25% 16.000 3.000 - -99.96% -
447.dealII (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.99% -
447.dealII (unexplained diff vs previous) (percentage) -79.31% 0.290 0.060 - -99.99% -
434.zeusmp (max) -78.57% 14.000 3.000 - -99.85% -
434.zeusmp (max) (percentage) -76.79% 0.560 0.130 - -99.84% -
433.milc (unexplained diff vs previous) (percentage) -75.71% 0.700 0.170 - -99.98% -
433.milc (unexplained diff vs previous) -75.00% 8.000 2.000 - -99.98% -
458.sjeng (unexplained diff vs previous) -53.85% 13.000 6.000 - -99.91% -
458.sjeng (unexplained diff vs previous) (percentage) -52.94% 0.170 0.080 - -99.91% -
450.soplex (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.98% -
450.soplex (unexplained diff vs previous) (percentage) -40.00% 0.850 0.510 - -99.98% -
470.lbm (unexplained diff vs previous) (percentage) -38.10% 0.420 0.260 - -99.90% -
462.libquantum (max) (percentage) -37.62% 1.010 0.630 - -99.36% -
433.milc (max) -37.50% 8.000 5.000 - -99.52% -
470.lbm (unexplained diff vs previous) -37.50% 16.000 10.000 - -99.90% -
482.sphinx3 (unexplained diff vs previous) (percentage) -34.38% 0.320 0.210 - -99.99% -
482.sphinx3 (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.99% -
435.gromacs (unexplained diff vs previous) (percentage) -27.40% 1.460 1.060 - -98.90% -
435.gromacs (unexplained diff vs previous) -26.42% 106.000 78.000 - -98.89% -
433.milc (max) (percentage) -25.71% 0.700 0.520 - -99.43% -
435.gromacs (max) (percentage) -25.00% 1.440 1.080 - -97.80% -
435.gromacs (max) -24.04% 104.000 79.000 - -97.79% -
473.astar (unexplained diff vs previous) (percentage) -19.11% 2.460 1.990 - -98.99% -
453.povray (max) -18.18% 11.000 9.000 - -98.20% -
445.gobmk (unexplained diff vs previous) -17.95% 78.000 64.000 - -98.85% -
473.astar (unexplained diff vs previous) -17.32% 127.000 105.000 - -98.97% -
445.gobmk (unexplained diff vs previous) (percentage) -16.99% 1.530 1.270 - -98.86% -
444.namd (max) -16.67% 6.000 5.000 - -99.27% -
473.astar (max) (percentage) -15.00% 2.400 2.040 - -96.93% -
410.bwaves (unexplained diff vs previous) (percentage) -14.06% 0.640 0.550 - -99.60% -
410.bwaves (unexplained diff vs previous) -13.89% 36.000 31.000 - -99.60% -
473.astar (max) -13.01% 123.000 107.000 - -96.86% -
410.bwaves (max) (percentage) -12.70% 0.630 0.550 - -99.05% -
453.povray (max) (percentage) -12.08% 2.070 1.820 - -98.01% -
410.bwaves (max) -11.43% 35.000 31.000 - -99.05% -
456.hmmer (max) (percentage) -11.36% 0.440 0.390 - -99.47% -
450.soplex (max) -11.11% 9.000 8.000 - -98.53% -
482.sphinx3 (max) (percentage) -10.40% 1.250 1.120 - -98.84% -
445.gobmk (max) -10.13% 79.000 71.000 - -97.31% -
444.namd (max) (percentage) -10.00% 0.900 0.810 - -99.12% -
437.leslie3d (max) (percentage) -9.98% 11.820 10.640 - -35.83% -
458.sjeng (max) (percentage) -9.09% 0.330 0.300 - -99.37% -
482.sphinx3 (max) -9.09% 11.000 10.000 - -98.90% -
436.cactusADM (max) (percentage) -8.97% 0.780 0.710 - -99.20% -
437.leslie3d (max) -8.83% 1257.000 1146.000 - -40.59% -
445.gobmk (max) (percentage) -8.33% 1.560 1.430 - -97.28% -
447.dealII (max) -8.33% 12.000 11.000 - -99.21% -
456.hmmer (max) -8.33% 12.000 11.000 - -99.48% -
458.sjeng (max) -8.33% 24.000 22.000 - -99.39% -
465.tonto (max) -7.23% 83.000 77.000 - -96.35% -
464.h264ref (max) (percentage) -6.67% 0.450 0.420 - -99.23% -
465.tonto (max) (percentage) -6.58% 0.760 0.710 - -96.32% -
450.soplex (max) (percentage) -6.25% 1.600 1.500 - -98.44% -
436.cactusADM (max) -6.25% 16.000 15.000 - -99.19% -
429.mcf (max) (percentage) -6.12% 0.980 0.920 - -99.01% -
470.lbm (max) (percentage) -5.88% 0.680 0.640 - -99.12% -
481.wrf (max) (percentage) -4.23% 1.890 1.810 - -97.37% -
433.milc -4.17% 24.000 23.000 - -66.67% -
433.milc (avg) -4.17% 24.000 23.000 - -66.67% -
464.h264ref (max) -4.00% 25.000 24.000 - -99.23% -
470.lbm (max) -4.00% 25.000 24.000 - -99.13% -
482.sphinx3 -4.00% 25.000 24.000 - -67.57% -
482.sphinx3 (avg) -4.00% 25.000 24.000 - -67.57% -
458.sjeng -3.49% 86.000 83.000 - -65.56% -
458.sjeng (avg) -3.49% 86.000 83.000 - -65.56% -
483.xalancbmk -3.36% 119.000 115.000 - -53.63% -
483.xalancbmk (avg) -3.36% 119.000 115.000 - -53.63% -
483.xalancbmk (avg) (percentage) -3.27% 3.060 2.960 - -54.46% -
456.hmmer (avg) (percentage) -2.94% 1.360 1.320 - -70.07% -
465.tonto -2.94% 170.000 165.000 - -54.79% -
465.tonto (avg) -2.94% 170.000 165.000 - -54.79% -
481.wrf (max) -2.88% 104.000 101.000 - -97.34% -
447.dealII (max) (percentage) -2.86% 0.700 0.680 - -99.15% -
447.dealII (avg) (percentage) -2.83% 2.120 2.060 - -64.30% -
447.dealII -2.78% 36.000 35.000 - -64.65% -
447.dealII (avg) -2.78% 36.000 35.000 - -64.65% -
470.lbm -2.74% 73.000 71.000 - -70.29% -
470.lbm (avg) -2.74% 73.000 71.000 - -70.29% -
445.gobmk -2.70% 74.000 72.000 - -63.27% -
445.gobmk (avg) -2.70% 74.000 72.000 - -63.27% -
458.sjeng (avg) (percentage) -2.61% 1.150 1.120 - -64.89% -
465.tonto (avg) (percentage) -2.58% 1.550 1.510 - -54.79% -
456.hmmer -2.56% 39.000 38.000 - -70.08% -
456.hmmer (avg) -2.56% 39.000 38.000 - -70.08% -
454.calculix (max) (percentage) -2.52% 2.380 2.320 - -97.67% -
459.GemsFDTD -2.50% 120.000 117.000 - -67.50% -
459.GemsFDTD (avg) -2.50% 120.000 117.000 - -67.50% -
429.mcf -2.44% 82.000 80.000 - -26.61% -
429.mcf (avg) -2.44% 82.000 80.000 - -26.61% -
471.omnetpp -2.38% 84.000 82.000 - -63.23% -
471.omnetpp (avg) -2.38% 84.000 82.000 - -63.23% -
464.h264ref (avg) (percentage) -2.30% 1.740 1.700 - -66.60% -
482.sphinx3 (avg) (percentage) -2.25% 2.670 2.610 - -67.09% -
429.mcf (avg) (percentage) -2.24% 5.810 5.680 - -25.95% -
434.zeusmp -2.13% 47.000 46.000 - -68.71% -
434.zeusmp (avg) -2.13% 47.000 46.000 - -68.71% -
434.zeusmp (avg) (percentage) -2.13% 1.880 1.840 - -68.55% -
470.lbm (avg) (percentage) -2.07% 1.930 1.890 - -70.14% -
464.h264ref -2.00% 100.000 98.000 - -66.55% -
464.h264ref (avg) -2.00% 100.000 98.000 - -66.55% -
462.libquantum (avg) (percentage) -1.96% 2.550 2.500 - -67.36% -
454.calculix (avg) (percentage) -1.90% 4.200 4.120 - -48.63% -
433.milc (avg) (percentage) -1.89% 2.120 2.080 - -65.62% -
450.soplex (avg) (percentage) -1.87% 2.680 2.630 - -59.10% -
403.gcc (max) (percentage) -1.86% 6.450 6.330 - -93.63% -
435.gromacs (avg) (percentage) -1.69% 2.360 2.320 - -54.15% -
401.bzip2 -1.64% 61.000 60.000 - -62.73% -
401.bzip2 (avg) -1.64% 61.000 60.000 - -62.73% -
437.leslie3d (avg) (percentage) -1.59% 5.040 4.960 - 62.62% -
453.povray (avg) (percentage) -1.58% 2.530 2.490 - -68.12% -
459.GemsFDTD (avg) (percentage) -1.52% 1.970 1.940 - -66.78% -
444.namd (avg) (percentage) -1.52% 2.630 2.590 - -71.91% -
401.bzip2 (avg) (percentage) -1.47% 2.040 2.010 - -63.32% -
436.cactusADM (avg) (percentage) -1.32% 2.280 2.250 - -62.37% -
410.bwaves (avg) (percentage) -1.29% 1.550 1.530 - -65.31% -
410.bwaves -1.15% 87.000 86.000 - -65.46% -
410.bwaves (avg) -1.15% 87.000 86.000 - -65.46% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
462.libquantum (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - 3.51% -
450.soplex 3.70% 567.000 588.000 - 0.51% -
473.astar 2.65% 5128.000 5264.000 - 2.04% -
483.xalancbmk 2.36% 3818.000 3908.000 - 0.18% -
401.bzip2 2.14% 2941.000 3004.000 - -1.05% -
456.hmmer 1.80% 2882.000 2934.000 - -0.03% -
436.cactusADM 1.68% 2083.000 2118.000 - 0.71% -
481.wrf 1.32% 5534.000 5607.000 - 1.58% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 62.62% 3.050 4.960 - -1.59% -
437.leslie3d 50.42% 355.000 534.000 - -0.37% -
437.leslie3d (avg) 50.42% 355.000 534.000 - -0.37% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.41% 244728.000 241268.000 - 0.00% -
453.povray -1.20% 661389.000 653437.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.46% 11640.000 10772.000 - 1.27% -
459.GemsFDTD -1.54% 6173.000 6078.000 - -0.75% -
444.namd -1.20% 747.000 738.000 - -0.81% -
471.omnetpp -1.14% 2724.000 2693.000 - -2.57% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 1.610 - 1.26% -
454.calculix (unexplained diff vs previous) -100.00% 22953.000 1.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.210 - -34.38% -
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 2.000 - -33.33% -
456.hmmer (unexplained diff vs previous) (percentage) -99.99% 278.630 0.030 - -92.68% -
456.hmmer (unexplained diff vs previous) -99.99% 8030.000 1.000 - -91.67% -
447.dealII (unexplained diff vs previous) -99.99% 7017.000 1.000 - -80.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.99% 407.020 0.060 - -79.31% -
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 - -75.71% -
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 - -75.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.98% 2557.320 0.510 - -40.00% -
450.soplex (unexplained diff vs previous) -99.98% 14500.000 3.000 - -40.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.96% 118.780 0.050 - -82.14% -
464.h264ref (unexplained diff vs previous) -99.96% 6843.000 3.000 - -81.25% -
444.namd (unexplained diff vs previous) -99.93% 8356.000 6.000 - 50.00% -
444.namd (unexplained diff vs previous) (percentage) -99.93% 1118.610 0.810 - 50.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.92% 219.170 0.180 - 38.46% -
483.xalancbmk (unexplained diff vs previous) -99.92% 8368.000 7.000 - 40.00% -
458.sjeng (unexplained diff vs previous) -99.91% 6876.000 6.000 - -53.85% -
458.sjeng (unexplained diff vs previous) (percentage) -99.91% 90.870 0.080 - -52.94% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.91% 787.130 0.710 - 273.68% -
436.cactusADM (unexplained diff vs previous) -99.91% 16396.000 15.000 - 275.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.90% 263.730 0.260 - -38.10% -
470.lbm (unexplained diff vs previous) -99.90% 9990.000 10.000 - -37.50% -
453.povray (unexplained diff vs previous) -99.89% 5707.000 6.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.89% 1043.330 1.100 - 0.00% -
434.zeusmp (max) -99.85% 2055.000 3.000 - -78.57% -
434.zeusmp (max) (percentage) -99.84% 81.770 0.130 - -76.79% -
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.71% 368.340 1.070 - 3466.67% -
401.bzip2 (unexplained diff vs previous) -99.70% 10833.000 32.000 - 3100.00% -
459.GemsFDTD (unexplained diff vs previous) -99.70% 15458.000 46.000 - 475.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.70% 250.410 0.760 - 484.62% -
410.bwaves (unexplained diff vs previous) -99.60% 7794.000 31.000 - -13.89% -
410.bwaves (unexplained diff vs previous) (percentage) -99.60% 137.900 0.550 - -14.06% -
433.milc (max) -99.52% 1044.000 5.000 - -37.50% -
456.hmmer (max) -99.48% 2120.000 11.000 - -8.33% -
456.hmmer (max) (percentage) -99.47% 73.590 0.390 - -11.36% -
400.perlbench (unexplained diff vs previous) (percentage) -99.44% 527.480 2.940 - 196.97% -
400.perlbench (unexplained diff vs previous) -99.44% 8772.000 49.000 - 206.25% -
433.milc (max) (percentage) -99.43% 90.750 0.520 - -25.71% -
458.sjeng (max) -99.39% 3602.000 22.000 - -8.33% -
458.sjeng (max) (percentage) -99.37% 47.610 0.300 - -9.09% -
462.libquantum (max) (percentage) -99.36% 98.970 0.630 - -37.62% -
471.omnetpp (unexplained diff vs previous) -99.33% 10659.000 71.000 - 545.45% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.33% 391.300 2.640 - 560.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.29% 219.530 1.550 - 39.64% -
481.wrf (unexplained diff vs previous) -99.28% 12149.000 87.000 - 42.62% -
444.namd (max) -99.27% 685.000 5.000 - -16.67% -
464.h264ref (max) -99.23% 3127.000 24.000 - -4.00% -
464.h264ref (max) (percentage) -99.23% 54.290 0.420 - -6.67% -
447.dealII (max) -99.21% 1384.000 11.000 - -8.33% -
436.cactusADM (max) (percentage) -99.20% 88.730 0.710 - -8.97% -
436.cactusADM (max) -99.19% 1848.000 15.000 - -6.25% -
447.dealII (max) (percentage) -99.15% 80.280 0.680 - -2.86% -
470.lbm (max) -99.13% 2746.000 24.000 - -4.00% -
444.namd (max) (percentage) -99.12% 91.790 0.810 - -10.00% -
470.lbm (max) (percentage) -99.12% 72.510 0.640 - -5.88% -
410.bwaves (max) -99.05% 3276.000 31.000 - -11.43% -
410.bwaves (max) (percentage) -99.05% 57.970 0.550 - -12.70% -
429.mcf (max) -99.02% 1322.000 13.000 - 0.00% -
429.mcf (max) (percentage) -99.01% 92.890 0.920 - -6.12% -
473.astar (unexplained diff vs previous) (percentage) -98.99% 197.850 1.990 - -19.11% -
459.GemsFDTD (max) -98.98% 4411.000 45.000 - 32.35% -
473.astar (unexplained diff vs previous) -98.97% 10146.000 105.000 - -17.32% -
459.GemsFDTD (max) (percentage) -98.95% 71.460 0.750 - 33.93% -
435.gromacs (unexplained diff vs previous) (percentage) -98.90% 96.680 1.060 - -27.40% -
482.sphinx3 (max) -98.90% 911.000 10.000 - -9.09% -
435.gromacs (unexplained diff vs previous) -98.89% 7028.000 78.000 - -26.42% -
445.gobmk (unexplained diff vs previous) (percentage) -98.86% 111.110 1.270 - -16.99% -
445.gobmk (unexplained diff vs previous) -98.85% 5581.000 64.000 - -17.95% -
482.sphinx3 (max) (percentage) -98.84% 96.500 1.120 - -10.40% -
401.bzip2 (max) (percentage) -98.66% 78.650 1.050 - 337.50% -
401.bzip2 (max) -98.66% 2313.000 31.000 - 342.86% -
450.soplex (max) -98.53% 545.000 8.000 - -11.11% -
450.soplex (max) (percentage) -98.44% 96.240 1.500 - -6.25% -
454.calculix (max) -98.36% 61.000 1.000 - 0.00% -
453.povray (max) -98.20% 499.000 9.000 - -18.18% -
453.povray (max) (percentage) -98.01% 91.250 1.820 - -12.08% -
435.gromacs (max) (percentage) -97.80% 49.160 1.080 - -25.00% -
435.gromacs (max) -97.79% 3573.000 79.000 - -24.04% -
454.calculix (max) (percentage) -97.67% 99.730 2.320 - -2.52% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
483.xalancbmk (max) -97.37% 2621.000 69.000 - 0.00% -
481.wrf (max) (percentage) -97.37% 68.700 1.810 - -4.23% -
481.wrf (max) -97.34% 3801.000 101.000 - -2.88% -
445.gobmk (max) -97.31% 2643.000 71.000 - -10.13% -
445.gobmk (max) (percentage) -97.28% 52.630 1.430 - -8.33% -
465.tonto (unexplained diff vs previous) -97.12% 1771.000 51.000 - 183.33% -
465.tonto (unexplained diff vs previous) (percentage) -97.10% 16.190 0.470 - 193.75% -
473.astar (max) (percentage) -96.93% 66.430 2.040 - -15.00% -
473.astar (max) -96.86% 3406.000 107.000 - -13.01% -
471.omnetpp (max) -96.82% 2169.000 69.000 - 155.56% -
471.omnetpp (max) (percentage) -96.77% 79.650 2.570 - 154.46% -
400.perlbench (max) -96.42% 1397.000 50.000 - 66.67% -
400.perlbench (max) (percentage) -96.41% 84.060 3.020 - 60.64% -
465.tonto (max) -96.35% 2112.000 77.000 - -7.23% -
465.tonto (max) (percentage) -96.32% 19.310 0.710 - -6.58% -
403.gcc (max) -94.55% 55.000 3.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -94.17% 2314.000 135.000 - -89.76% -
437.leslie3d (unexplained diff vs previous) (percentage) -93.71% 19.880 1.250 - -89.92% -
403.gcc (max) (percentage) -93.63% 99.360 6.330 - -1.86% -
444.namd -72.06% 68.000 19.000 - 0.00% -
444.namd (avg) -72.06% 68.000 19.000 - 0.00% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
444.namd (avg) (percentage) -71.91% 9.220 2.590 - -1.52% -
470.lbm -70.29% 239.000 71.000 - -2.74% -
470.lbm (avg) -70.29% 239.000 71.000 - -2.74% -
470.lbm (avg) (percentage) -70.14% 6.330 1.890 - -2.07% -
456.hmmer -70.08% 127.000 38.000 - -2.56% -
456.hmmer (avg) -70.08% 127.000 38.000 - -2.56% -
456.hmmer (avg) (percentage) -70.07% 4.410 1.320 - -2.94% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
453.povray -69.05% 42.000 13.000 - 0.00% -
453.povray (avg) -69.05% 42.000 13.000 - 0.00% -
434.zeusmp -68.71% 147.000 46.000 - -2.13% -
434.zeusmp (avg) -68.71% 147.000 46.000 - -2.13% -
434.zeusmp (avg) (percentage) -68.55% 5.850 1.840 - -2.13% -
453.povray (avg) (percentage) -68.12% 7.810 2.490 - -1.58% -
482.sphinx3 -67.57% 74.000 24.000 - -4.00% -
482.sphinx3 (avg) -67.57% 74.000 24.000 - -4.00% -
459.GemsFDTD -67.50% 360.000 117.000 - -2.50% -
459.GemsFDTD (avg) -67.50% 360.000 117.000 - -2.50% -
462.libquantum (avg) (percentage) -67.36% 7.660 2.500 - -1.96% -
482.sphinx3 (avg) (percentage) -67.09% 7.930 2.610 - -2.25% -
459.GemsFDTD (avg) (percentage) -66.78% 5.840 1.940 - -1.52% -
433.milc -66.67% 69.000 23.000 - -4.17% -
433.milc (avg) -66.67% 69.000 23.000 - -4.17% -
464.h264ref (avg) (percentage) -66.60% 5.090 1.700 - -2.30% -
464.h264ref -66.55% 293.000 98.000 - -2.00% -
464.h264ref (avg) -66.55% 293.000 98.000 - -2.00% -
433.milc (avg) (percentage) -65.62% 6.050 2.080 - -1.89% -
458.sjeng -65.56% 241.000 83.000 - -3.49% -
458.sjeng (avg) -65.56% 241.000 83.000 - -3.49% -
410.bwaves -65.46% 249.000 86.000 - -1.15% -
410.bwaves (avg) -65.46% 249.000 86.000 - -1.15% -
410.bwaves (avg) (percentage) -65.31% 4.410 1.530 - -1.29% -
458.sjeng (avg) (percentage) -64.89% 3.190 1.120 - -2.61% -
447.dealII -64.65% 99.000 35.000 - -2.78% -
447.dealII (avg) -64.65% 99.000 35.000 - -2.78% -
447.dealII (avg) (percentage) -64.30% 5.770 2.060 - -2.83% -
481.wrf (avg) (percentage) -64.26% 6.240 2.230 - -0.89% -
481.wrf -63.77% 345.000 125.000 - 0.81% -
481.wrf (avg) -63.77% 345.000 125.000 - 0.81% -
401.bzip2 (avg) (percentage) -63.32% 5.480 2.010 - -1.47% -
445.gobmk -63.27% 196.000 72.000 - -2.70% -
445.gobmk (avg) -63.27% 196.000 72.000 - -2.70% -
471.omnetpp -63.23% 223.000 82.000 - -2.38% -
471.omnetpp (avg) -63.23% 223.000 82.000 - -2.38% -
445.gobmk (avg) (percentage) -62.92% 3.910 1.450 - -0.68% -
471.omnetpp (avg) (percentage) -62.80% 8.200 3.050 - -0.33% -
401.bzip2 -62.73% 161.000 60.000 - -1.64% -
401.bzip2 (avg) -62.73% 161.000 60.000 - -1.64% -
436.cactusADM (avg) (percentage) -62.37% 5.980 2.250 - -1.32% -
436.cactusADM -62.10% 124.000 47.000 - 0.00% -
436.cactusADM (avg) -62.10% 124.000 47.000 - 0.00% -
450.soplex (avg) (percentage) -59.10% 6.430 2.630 - -1.87% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
400.perlbench (avg) (percentage) -56.22% 6.350 2.780 - 0.00% -
400.perlbench -56.19% 105.000 46.000 - 2.22% -
400.perlbench (avg) -56.19% 105.000 46.000 - 2.22% -
465.tonto -54.79% 365.000 165.000 - -2.94% -
465.tonto (avg) -54.79% 365.000 165.000 - -2.94% -
465.tonto (avg) (percentage) -54.79% 3.340 1.510 - -2.58% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - -3.27% -
435.gromacs (avg) (percentage) -54.15% 5.060 2.320 - -1.69% -
435.gromacs -53.68% 367.000 170.000 - -0.58% -
435.gromacs (avg) -53.68% 367.000 170.000 - -0.58% -
483.xalancbmk -53.63% 248.000 115.000 - -3.36% -
483.xalancbmk (avg) -53.63% 248.000 115.000 - -3.36% -
473.astar (avg) (percentage) -50.72% 4.160 2.050 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
473.astar -49.77% 213.000 107.000 - 1.90% -
473.astar (avg) -49.77% 213.000 107.000 - 1.90% -
454.calculix (avg) (percentage) -48.63% 8.020 4.120 - -1.90% -
437.leslie3d (max) -40.59% 1929.000 1146.000 - -8.83% -
437.leslie3d (max) (percentage) -35.83% 16.580 10.640 - -9.98% -
429.mcf -26.61% 109.000 80.000 - -2.44% -
429.mcf (avg) -26.61% 109.000 80.000 - -2.44% -
429.mcf (avg) (percentage) -25.95% 7.670 5.680 - -2.24% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -24.59% 7.320 5.520 - 0.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
462.libquantum (max)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1669.000 3.02%
401.bzip2 3004.000 -1.05%
403.gcc 59.000 3.51%
410.bwaves 5680.000 -
429.mcf 1417.000 -
433.milc 1149.000 -
434.zeusmp 2511.000 -
435.gromacs 7334.000 1.07%
436.cactusADM 2118.000 -
437.leslie3d 10772.000 1.27%
444.namd 738.000 -
445.gobmk 5029.000 -1.26%
447.dealII 1729.000 -
450.soplex 588.000 -
453.povray 547.000 1.11%
454.calculix 62.000 -1.59%
456.hmmer 2934.000 -
458.sjeng 7499.000 -
459.GemsFDTD 6078.000 -
462.libquantum 140.000 -
464.h264ref 5780.000 -
465.tonto 10951.000 -
470.lbm 3796.000 -
471.omnetpp 2693.000 -2.57%
473.astar 5264.000 2.04%
481.wrf 5607.000 1.58%
482.sphinx3 944.000 -
483.xalancbmk 3908.000 -
Geometric Mean 1976.940 -
Code Size (bytes)
Name Current %
400.perlbench 900219.000 -
401.bzip2 44201.000 -
403.gcc 2449083.000 -
410.bwaves 16720.000 -
429.mcf 9119.000 -
433.milc 61338.000 -
434.zeusmp 152069.000 -
435.gromacs 498301.000 -
436.cactusADM 352955.000 -
437.leslie3d 59347.000 -
444.namd 188116.000 -
445.gobmk 1378202.000 -
447.dealII 311150.000 -
450.soplex 204341.000 -
453.povray 653437.000 -
454.calculix 838474.000 -
456.hmmer 108331.000 -
458.sjeng 103580.000 -
459.GemsFDTD 241268.000 -
462.libquantum 16077.000 -
464.h264ref 390608.000 -
465.tonto 1935386.000 -
470.lbm 9707.000 -
471.omnetpp 480764.000 -
473.astar 22916.000 -
481.wrf 1966726.000 -
482.sphinx3 112735.000 -
483.xalancbmk 2334688.000 -
Geometric Mean 199141.572 -
sample variability
Name Current %
400.perlbench 46.000 2.22%
400.perlbench (avg) 46.000 2.22%
400.perlbench (avg) (percentage) 2.780 -
400.perlbench (max) 50.000 66.67%
400.perlbench (max) (percentage) 3.020 60.64%
400.perlbench (unexplained diff vs previous) 49.000 206.25%
400.perlbench (unexplained diff vs previous) (percentage) 2.940 196.97%
401.bzip2 60.000 -1.64%
401.bzip2 (avg) 60.000 -1.64%
401.bzip2 (avg) (percentage) 2.010 -1.47%
401.bzip2 (max) 31.000 342.86%
401.bzip2 (max) (percentage) 1.050 337.50%
401.bzip2 (unexplained diff vs previous) 32.000 3100.00%
401.bzip2 (unexplained diff vs previous) (percentage) 1.070 3466.67%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.520 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 6.330 -1.86%
410.bwaves 86.000 -1.15%
410.bwaves (avg) 86.000 -1.15%
410.bwaves (avg) (percentage) 1.530 -1.29%
410.bwaves (max) 31.000 -11.43%
410.bwaves (max) (percentage) 0.550 -12.70%
410.bwaves (unexplained diff vs previous) 31.000 -13.89%
410.bwaves (unexplained diff vs previous) (percentage) 0.550 -14.06%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.100 -
429.mcf 80.000 -2.44%
429.mcf (avg) 80.000 -2.44%
429.mcf (avg) (percentage) 5.680 -2.24%
429.mcf (max) 13.000 -
429.mcf (max) (percentage) 0.920 -6.12%
429.mcf (unexplained diff vs previous) 0.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.000 -
433.milc 23.000 -4.17%
433.milc (avg) 23.000 -4.17%
433.milc (avg) (percentage) 2.080 -1.89%
433.milc (max) 5.000 -37.50%
433.milc (max) (percentage) 0.520 -25.71%
433.milc (unexplained diff vs previous) 2.000 -75.00%
433.milc (unexplained diff vs previous) (percentage) 0.170 -75.71%
434.zeusmp 46.000 -2.13%
434.zeusmp (avg) 46.000 -2.13%
434.zeusmp (avg) (percentage) 1.840 -2.13%
434.zeusmp (max) 3.000 -78.57%
434.zeusmp (max) (percentage) 0.130 -76.79%
434.zeusmp (unexplained diff vs previous) 0.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.000 -
435.gromacs 170.000 -
435.gromacs (avg) 170.000 -
435.gromacs (avg) (percentage) 2.320 -1.69%
435.gromacs (max) 79.000 -24.04%
435.gromacs (max) (percentage) 1.080 -25.00%
435.gromacs (unexplained diff vs previous) 78.000 -26.42%
435.gromacs (unexplained diff vs previous) (percentage) 1.060 -27.40%
436.cactusADM 47.000 -
436.cactusADM (avg) 47.000 -
436.cactusADM (avg) (percentage) 2.250 -1.32%
436.cactusADM (max) 15.000 -6.25%
436.cactusADM (max) (percentage) 0.710 -8.97%
436.cactusADM (unexplained diff vs previous) 15.000 275.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.710 273.68%
437.leslie3d 534.000 -
437.leslie3d (avg) 534.000 -
437.leslie3d (avg) (percentage) 4.960 -1.59%
437.leslie3d (max) 1146.000 -8.83%
437.leslie3d (max) (percentage) 10.640 -9.98%
437.leslie3d (unexplained diff vs previous) 135.000 -89.76%
437.leslie3d (unexplained diff vs previous) (percentage) 1.250 -89.92%
444.namd 19.000 -
444.namd (avg) 19.000 -
444.namd (avg) (percentage) 2.590 -1.52%
444.namd (max) 5.000 -16.67%
444.namd (max) (percentage) 0.810 -10.00%
444.namd (unexplained diff vs previous) 6.000 50.00%
444.namd (unexplained diff vs previous) (percentage) 0.810 50.00%
445.gobmk 72.000 -2.70%
445.gobmk (avg) 72.000 -2.70%
445.gobmk (avg) (percentage) 1.450 -
445.gobmk (max) 71.000 -10.13%
445.gobmk (max) (percentage) 1.430 -8.33%
445.gobmk (unexplained diff vs previous) 64.000 -17.95%
445.gobmk (unexplained diff vs previous) (percentage) 1.270 -16.99%
447.dealII 35.000 -2.78%
447.dealII (avg) 35.000 -2.78%
447.dealII (avg) (percentage) 2.060 -2.83%
447.dealII (max) 11.000 -8.33%
447.dealII (max) (percentage) 0.680 -2.86%
447.dealII (unexplained diff vs previous) 1.000 -80.00%
447.dealII (unexplained diff vs previous) (percentage) 0.060 -79.31%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.630 -1.87%
450.soplex (max) 8.000 -11.11%
450.soplex (max) (percentage) 1.500 -6.25%
450.soplex (unexplained diff vs previous) 3.000 -40.00%
450.soplex (unexplained diff vs previous) (percentage) 0.510 -40.00%
453.povray 13.000 -
453.povray (avg) 13.000 -
453.povray (avg) (percentage) 2.490 -1.58%
453.povray (max) 9.000 -18.18%
453.povray (max) (percentage) 1.820 -12.08%
453.povray (unexplained diff vs previous) 6.000 -
453.povray (unexplained diff vs previous) (percentage) 1.100 -
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.120 -1.90%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.320 -2.52%
454.calculix (unexplained diff vs previous) 1.000 -
454.calculix (unexplained diff vs previous) (percentage) 1.610 1.26%
456.hmmer 38.000 -2.56%
456.hmmer (avg) 38.000 -2.56%
456.hmmer (avg) (percentage) 1.320 -2.94%
456.hmmer (max) 11.000 -8.33%
456.hmmer (max) (percentage) 0.390 -11.36%
456.hmmer (unexplained diff vs previous) 1.000 -91.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -92.68%
458.sjeng 83.000 -3.49%
458.sjeng (avg) 83.000 -3.49%
458.sjeng (avg) (percentage) 1.120 -2.61%
458.sjeng (max) 22.000 -8.33%
458.sjeng (max) (percentage) 0.300 -9.09%
458.sjeng (unexplained diff vs previous) 6.000 -53.85%
458.sjeng (unexplained diff vs previous) (percentage) 0.080 -52.94%
459.GemsFDTD 117.000 -2.50%
459.GemsFDTD (avg) 117.000 -2.50%
459.GemsFDTD (avg) (percentage) 1.940 -1.52%
459.GemsFDTD (max) 45.000 32.35%
459.GemsFDTD (max) (percentage) 0.750 33.93%
459.GemsFDTD (unexplained diff vs previous) 46.000 475.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.760 484.62%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.500 -1.96%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.630 -37.62%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 98.000 -2.00%
464.h264ref (avg) 98.000 -2.00%
464.h264ref (avg) (percentage) 1.700 -2.30%
464.h264ref (max) 24.000 -4.00%
464.h264ref (max) (percentage) 0.420 -6.67%
464.h264ref (unexplained diff vs previous) 3.000 -81.25%
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -82.14%
465.tonto 165.000 -2.94%
465.tonto (avg) 165.000 -2.94%
465.tonto (avg) (percentage) 1.510 -2.58%
465.tonto (max) 77.000 -7.23%
465.tonto (max) (percentage) 0.710 -6.58%
465.tonto (unexplained diff vs previous) 51.000 183.33%
465.tonto (unexplained diff vs previous) (percentage) 0.470 193.75%
470.lbm 71.000 -2.74%
470.lbm (avg) 71.000 -2.74%
470.lbm (avg) (percentage) 1.890 -2.07%
470.lbm (max) 24.000 -4.00%
470.lbm (max) (percentage) 0.640 -5.88%
470.lbm (unexplained diff vs previous) 10.000 -37.50%
470.lbm (unexplained diff vs previous) (percentage) 0.260 -38.10%
471.omnetpp 82.000 -2.38%
471.omnetpp (avg) 82.000 -2.38%
471.omnetpp (avg) (percentage) 3.050 -
471.omnetpp (max) 69.000 155.56%
471.omnetpp (max) (percentage) 2.570 154.46%
471.omnetpp (unexplained diff vs previous) 71.000 545.45%
471.omnetpp (unexplained diff vs previous) (percentage) 2.640 560.00%
473.astar 107.000 1.90%
473.astar (avg) 107.000 1.90%
473.astar (avg) (percentage) 2.050 -
473.astar (max) 107.000 -13.01%
473.astar (max) (percentage) 2.040 -15.00%
473.astar (unexplained diff vs previous) 105.000 -17.32%
473.astar (unexplained diff vs previous) (percentage) 1.990 -19.11%
481.wrf 125.000 -
481.wrf (avg) 125.000 -
481.wrf (avg) (percentage) 2.230 -
481.wrf (max) 101.000 -2.88%
481.wrf (max) (percentage) 1.810 -4.23%
481.wrf (unexplained diff vs previous) 87.000 42.62%
481.wrf (unexplained diff vs previous) (percentage) 1.550 39.64%
482.sphinx3 24.000 -4.00%
482.sphinx3 (avg) 24.000 -4.00%
482.sphinx3 (avg) (percentage) 2.610 -2.25%
482.sphinx3 (max) 10.000 -9.09%
482.sphinx3 (max) (percentage) 1.120 -10.40%
482.sphinx3 (unexplained diff vs previous) 2.000 -33.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.210 -34.38%
483.xalancbmk 115.000 -3.36%
483.xalancbmk (avg) 115.000 -3.36%
483.xalancbmk (avg) (percentage) 2.960 -3.27%
483.xalancbmk (max) 69.000 -
483.xalancbmk (max) (percentage) 1.770 -
483.xalancbmk (unexplained diff vs previous) 7.000 40.00%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.180 38.46%
Geometric Mean 4.630 -35.10%