Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=56756c571eb6d33eb8035cf0deb37e472597af6b (+ 38 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f7884f7673444b8a2c10ea0981d480f2e82dd16a (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=42e48e720c78ab75eb8def9e866da52b0ac278df (+ 14 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f13102b78850c48082dca7202b8402d9dd6745b5 (+ 13 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/211/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0211 (3-changed-components) 2024-03-29T08:27:09 0:00:00
Previous 0208 (3-changed-components) 2024-03-18T04:27:16 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 57 78
Performance Improvements 100 152
Unchanged Tests 1079 1006
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 4.35% 10468.000 10923.000 - -27.20% -
454.calculix 1.64% 61.000 62.000 - -99.73% -
471.omnetpp 1.52% 2892.000 2936.000 - -72.66% -
482.sphinx3 1.50% 931.000 945.000 - -96.84% -
447.dealII 1.23% 1947.000 1971.000 - -79.79% -
465.tonto 1.04% 11480.000 11599.000 - 41.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) 604.76% 0.210 1.480 - 138.71% -
482.sphinx3 (unexplained diff vs previous) 600.00% 2.000 14.000 - -92.47% -
456.hmmer (unexplained diff vs previous) (percentage) 466.67% 0.030 0.170 - -77.33% -
464.h264ref (unexplained diff vs previous) (percentage) 450.00% 0.080 0.440 - 340.00% -
464.h264ref (unexplained diff vs previous) 420.00% 5.000 26.000 - 73.33% -
456.hmmer (unexplained diff vs previous) 400.00% 1.000 5.000 - -93.98% -
416.gamess (unexplained diff vs previous) (percentage) 350.00% 0.020 0.090 - -96.98% -
416.gamess (unexplained diff vs previous) 266.67% 3.000 11.000 - -98.37% -
481.wrf (unexplained diff vs previous) (percentage) 185.42% 0.480 1.370 - 104.48% -
481.wrf (unexplained diff vs previous) 181.48% 27.000 76.000 - -32.14% -
470.lbm (unexplained diff vs previous) 150.00% 4.000 10.000 - -28.57% -
470.lbm (unexplained diff vs previous) (percentage) 145.45% 0.110 0.270 - 145.45% -
482.sphinx3 (max) 133.33% 6.000 14.000 - -96.81% -
482.sphinx3 (max) (percentage) 117.39% 0.690 1.500 - 2.04% -
462.libquantum (unexplained diff vs previous) (percentage) 102.78% 0.720 1.460 - 14500.00% -
433.milc (unexplained diff vs previous) 100.00% 5.000 10.000 - -97.65% -
444.namd (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.71% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - 100.00% -
433.milc (unexplained diff vs previous) (percentage) 97.67% 0.430 0.850 - -74.09% -
444.namd (unexplained diff vs previous) (percentage) 92.86% 0.140 0.270 - -96.51% -
464.h264ref (max) 73.33% 15.000 26.000 - -58.06% -
447.dealII (unexplained diff vs previous) 71.43% 14.000 24.000 - -68.42% -
447.dealII (unexplained diff vs previous) (percentage) 69.44% 0.720 1.220 - 56.41% -
464.h264ref (max) (percentage) 69.23% 0.260 0.440 - 2.33% -
465.tonto (max) 64.38% 73.000 120.000 - -59.04% -
434.zeusmp (unexplained diff vs previous) (percentage) 63.16% 0.190 0.310 - -86.70% -
465.tonto (unexplained diff vs previous) 63.01% 73.000 119.000 - 88.89% -
465.tonto (max) (percentage) 62.50% 0.640 1.040 - -70.95% -
465.tonto (unexplained diff vs previous) (percentage) 60.94% 0.640 1.030 - 33.77% -
434.zeusmp (unexplained diff vs previous) 60.00% 5.000 8.000 - -97.40% -
445.gobmk (unexplained diff vs previous) 56.25% 16.000 25.000 - -86.56% -
445.gobmk (unexplained diff vs previous) (percentage) 54.84% 0.310 0.480 - -69.03% -
473.astar (unexplained diff vs previous) 46.15% 13.000 19.000 - 533.33% -
473.astar (unexplained diff vs previous) (percentage) 45.45% 0.220 0.320 - 1500.00% -
410.bwaves (max) 44.44% 27.000 39.000 - 30.00% -
433.milc (max) 42.86% 7.000 10.000 - -97.57% -
410.bwaves (max) (percentage) 41.30% 0.460 0.650 - 209.52% -
410.bwaves (unexplained diff vs previous) 39.29% 28.000 39.000 - 160.00% -
410.bwaves (unexplained diff vs previous) (percentage) 39.13% 0.460 0.640 - 540.00% -
435.gromacs (unexplained diff vs previous) (percentage) 37.42% 1.630 2.240 - 8.74% -
435.gromacs (unexplained diff vs previous) 34.45% 119.000 160.000 - -49.69% -
433.milc (max) (percentage) 34.37% 0.640 0.860 - -72.87% -
435.gromacs (max) (percentage) 32.73% 1.650 2.190 - 8.42% -
435.gromacs (max) 30.00% 120.000 156.000 - -49.84% -
429.mcf (unexplained diff vs previous) (percentage) 13.21% 0.530 0.600 - 11.11% -
429.mcf (unexplained diff vs previous) 12.50% 8.000 9.000 - -90.32% -
454.calculix (max) (percentage) 12.33% 1.460 1.640 - -65.11% -
437.leslie3d 4.20% 452.000 471.000 - 31.93% -
437.leslie3d (avg) 4.20% 452.000 471.000 - 31.93% -
471.omnetpp 1.45% 69.000 70.000 - -58.82% -
471.omnetpp (avg) 1.45% 69.000 70.000 - -58.82% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -9.38% 64.000 58.000 - -99.36% -
435.gromacs -2.19% 7313.000 7153.000 - -53.61% -
450.soplex -1.53% 588.000 579.000 - -96.26% -
462.libquantum -1.44% 139.000 137.000 - -98.82% -
481.wrf -1.35% 5613.000 5537.000 - -67.11% -
400.perlbench -1.30% 1617.000 1596.000 - -85.01% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -74.10% 1.390 0.360 - -58.62% -
401.bzip2 (unexplained diff vs previous) -73.81% 42.000 11.000 - -91.67% -
400.perlbench (unexplained diff vs previous) -65.00% 60.000 21.000 - -94.12% -
400.perlbench (unexplained diff vs previous) (percentage) -64.42% 3.710 1.320 - -60.60% -
453.povray (unexplained diff vs previous) -63.64% 11.000 4.000 - 300.00% -
453.povray (unexplained diff vs previous) (percentage) -63.35% 2.210 0.810 - 3950.00% -
436.cactusADM (max) -53.33% 15.000 7.000 - -98.73% -
459.GemsFDTD (unexplained diff vs previous) -53.06% 49.000 23.000 - -52.08% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -52.50% 0.800 0.380 - 80.95% -
436.cactusADM (max) (percentage) -50.00% 0.720 0.360 - -88.57% -
450.soplex (max) -50.00% 22.000 11.000 - -96.38% -
462.libquantum (max) -50.00% 2.000 1.000 - -98.65% -
458.sjeng (max) -49.06% 53.000 27.000 - -12.90% -
458.sjeng (max) (percentage) -48.57% 0.700 0.360 - 63.64% -
450.soplex (max) (percentage) -48.15% 3.780 1.960 - -0.51% -
471.omnetpp (unexplained diff vs previous) (percentage) -40.48% 2.520 1.500 - 525.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -40.43% 0.470 0.280 - -91.38% -
436.cactusADM (unexplained diff vs previous) -40.00% 10.000 6.000 - -98.95% -
450.soplex (unexplained diff vs previous) -40.00% 15.000 9.000 - -97.11% -
471.omnetpp (unexplained diff vs previous) -39.73% 73.000 44.000 - 69.23% -
450.soplex (unexplained diff vs previous) (percentage) -39.22% 2.550 1.550 - -22.89% -
471.omnetpp (max) (percentage) -38.99% 3.360 2.050 - -66.77% -
471.omnetpp (max) -38.14% 97.000 60.000 - -90.94% -
444.namd (max) -25.00% 4.000 3.000 - -99.54% -
437.leslie3d (unexplained diff vs previous) (percentage) -19.81% 5.200 4.170 - 82.10% -
453.povray (max) -18.18% 11.000 9.000 - -94.55% -
400.perlbench (max) -17.74% 62.000 51.000 - -85.22% -
403.gcc (max) -16.67% 6.000 5.000 - -92.19% -
400.perlbench (max) (percentage) -16.62% 3.850 3.210 - -0.93% -
437.leslie3d (unexplained diff vs previous) -16.36% 544.000 455.000 - 32.65% -
401.bzip2 (max) -14.29% 42.000 36.000 - -72.93% -
473.astar (max) -14.29% 21.000 18.000 - -10.00% -
401.bzip2 (max) (percentage) -12.86% 1.400 1.220 - 38.64% -
459.GemsFDTD (max) (percentage) -12.50% 0.800 0.700 - 16.67% -
459.GemsFDTD (max) -12.50% 48.000 42.000 - -70.00% -
453.povray (max) (percentage) -12.39% 2.260 1.980 - -21.74% -
437.leslie3d (max) (percentage) -11.94% 4.940 4.350 - 85.90% -
416.gamess (max) (percentage) -11.11% 0.180 0.160 - -94.46% -
473.astar (max) (percentage) -11.11% 0.360 0.320 - 128.57% -
447.dealII (max) (percentage) -10.05% 1.990 1.790 - 62.73% -
458.sjeng (unexplained diff vs previous) (percentage) -10.00% 0.400 0.360 - 500.00% -
458.sjeng (unexplained diff vs previous) -9.68% 31.000 28.000 - 211.11% -
416.gamess (max) -9.09% 22.000 20.000 - -96.95% -
437.leslie3d (max) -8.12% 517.000 475.000 - 35.33% -
447.dealII (max) -7.89% 38.000 35.000 - -67.29% -
456.hmmer (max) -7.69% 13.000 12.000 - -91.43% -
444.namd (max) (percentage) -7.27% 0.550 0.510 - -92.90% -
434.zeusmp (max) -5.88% 17.000 16.000 - -94.68% -
434.zeusmp (max) (percentage) -4.35% 0.690 0.660 - -71.05% -
456.hmmer -4.00% 25.000 24.000 - -68.00% -
456.hmmer (avg) -4.00% 25.000 24.000 - -68.00% -
470.lbm (max) (percentage) -3.57% 0.280 0.270 - -94.71% -
481.wrf (max) -3.57% 112.000 108.000 - -79.62% -
400.perlbench -2.94% 34.000 33.000 - -78.85% -
400.perlbench (avg) -2.94% 34.000 33.000 - -78.85% -
462.libquantum (max) (percentage) -2.70% 1.480 1.440 - 125.00% -
403.gcc (max) (percentage) -2.68% 10.460 10.180 - 1313.89% -
434.zeusmp -2.56% 39.000 38.000 - -80.51% -
434.zeusmp (avg) -2.56% 39.000 38.000 - -80.51% -
416.gamess (avg) (percentage) -2.33% 0.860 0.840 - -61.29% -
456.hmmer (max) (percentage) -2.22% 0.450 0.440 - -65.35% -
481.wrf -2.15% 93.000 91.000 - -71.38% -
481.wrf (avg) -2.15% 93.000 91.000 - -71.38% -
435.gromacs -2.13% 141.000 138.000 - -48.12% -
435.gromacs (avg) -2.13% 141.000 138.000 - -48.12% -
481.wrf (max) (percentage) -2.00% 2.000 1.960 - -37.78% -
434.zeusmp (avg) (percentage) -1.96% 1.530 1.500 - 1.35% -
401.bzip2 (avg) (percentage) -1.88% 2.130 2.090 - 375.00% -
416.gamess -1.87% 107.000 105.000 - -78.66% -
416.gamess (avg) -1.87% 107.000 105.000 - -78.66% -
445.gobmk -1.72% 58.000 57.000 - -38.04% -
445.gobmk (avg) -1.72% 58.000 57.000 - -38.04% -
458.sjeng -1.64% 61.000 60.000 - 27.66% -
458.sjeng (avg) -1.64% 61.000 60.000 - 27.66% -
453.povray (avg) (percentage) -1.56% 1.920 1.890 - 51.20% -
401.bzip2 -1.56% 64.000 63.000 - -4.55% -
401.bzip2 (avg) -1.56% 64.000 63.000 - -4.55% -
429.mcf (avg) (percentage) -1.43% 5.610 5.530 - 943.40% -
436.cactusADM (avg) (percentage) -1.42% 1.410 1.390 - -16.27% -
410.bwaves -1.41% 71.000 70.000 - -56.25% -
410.bwaves (avg) -1.41% 71.000 70.000 - -56.25% -
459.GemsFDTD (avg) (percentage) -1.38% 1.450 1.430 - 58.89% -
454.calculix (avg) (percentage) -1.29% 3.100 3.060 - 52.24% -
458.sjeng (avg) (percentage) -1.25% 0.800 0.790 - 139.39% -
473.astar (avg) (percentage) -1.20% 1.670 1.650 - 768.42% -
429.mcf -1.19% 84.000 83.000 - -7.78% -
429.mcf (avg) -1.19% 84.000 83.000 - -7.78% -
456.hmmer (avg) (percentage) -1.16% 0.860 0.850 - 25.00% -
444.namd (avg) (percentage) -1.15% 1.740 1.720 - -56.23% -
459.GemsFDTD -1.14% 88.000 87.000 - -58.57% -
459.GemsFDTD (avg) -1.14% 88.000 87.000 - -58.57% -
464.h264ref (avg) (percentage) -1.08% 0.930 0.920 - 70.37% -
473.astar -1.02% 98.000 97.000 - 246.43% -
473.astar (avg) -1.02% 98.000 97.000 - 246.43% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
433.milc 4.00% 95873.000 99705.000 - 0.00% -
456.hmmer 1.42% 231209.000 234488.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 41.37% 8205.000 11599.000 - 1.04% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 14500.00% 0.010 1.460 - 102.78% -
454.calculix (unexplained diff vs previous) (percentage) 7950.00% 0.020 1.610 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 3950.00% 0.020 0.810 - -63.35% -
429.mcf (max) (percentage) 1729.63% 0.540 9.880 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 1500.00% 0.020 0.320 - 45.45% -
403.gcc (max) (percentage) 1313.89% 0.720 10.180 - -2.68% -
483.xalancbmk (max) (percentage) 1302.44% 0.410 5.750 - 0.00% -
429.mcf (avg) (percentage) 943.40% 0.530 5.530 - -1.43% -
403.gcc (avg) (percentage) 913.11% 0.610 6.180 - 0.00% -
473.astar (avg) (percentage) 768.42% 0.190 1.650 - -1.20% -
410.bwaves (unexplained diff vs previous) (percentage) 540.00% 0.100 0.640 - 39.13% -
473.astar (unexplained diff vs previous) 533.33% 3.000 19.000 - 46.15% -
471.omnetpp (unexplained diff vs previous) (percentage) 525.00% 0.240 1.500 - -40.48% -
458.sjeng (unexplained diff vs previous) (percentage) 500.00% 0.060 0.360 - -10.00% -
401.bzip2 (avg) (percentage) 375.00% 0.440 2.090 - -1.88% -
464.h264ref (unexplained diff vs previous) (percentage) 340.00% 0.100 0.440 - 450.00% -
453.povray (unexplained diff vs previous) 300.00% 1.000 4.000 - -63.64% -
473.astar 246.43% 28.000 97.000 - -1.02% -
473.astar (avg) 246.43% 28.000 97.000 - -1.02% -
458.sjeng (unexplained diff vs previous) 211.11% 9.000 28.000 - -9.68% -
410.bwaves (max) (percentage) 209.52% 0.210 0.650 - 41.30% -
462.libquantum (avg) (percentage) 173.85% 0.650 1.780 - 0.00% -
410.bwaves (unexplained diff vs previous) 160.00% 15.000 39.000 - 39.29% -
470.lbm (unexplained diff vs previous) (percentage) 145.45% 0.110 0.270 - 145.45% -
458.sjeng (avg) (percentage) 139.39% 0.330 0.790 - -1.25% -
450.soplex (avg) (percentage) 138.71% 1.240 2.960 - -0.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) 138.71% 0.620 1.480 - 604.76% -
473.astar (max) (percentage) 128.57% 0.140 0.320 - -11.11% -
462.libquantum (max) (percentage) 125.00% 0.640 1.440 - -2.70% -
481.wrf (unexplained diff vs previous) (percentage) 104.48% 0.670 1.370 - 185.42% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - 100.00% -
465.tonto (unexplained diff vs previous) 88.89% 63.000 119.000 - 63.01% -
437.leslie3d (max) (percentage) 85.90% 2.340 4.350 - -11.94% -
437.leslie3d (unexplained diff vs previous) (percentage) 82.10% 2.290 4.170 - -19.81% -
437.leslie3d (avg) (percentage) 81.51% 2.380 4.320 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 80.95% 0.210 0.380 - -52.50% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
464.h264ref (unexplained diff vs previous) 73.33% 15.000 26.000 - 420.00% -
464.h264ref (avg) (percentage) 70.37% 0.540 0.920 - -1.08% -
471.omnetpp (unexplained diff vs previous) 69.23% 26.000 44.000 - -39.73% -
458.sjeng (max) (percentage) 63.64% 0.220 0.360 - -48.57% -
447.dealII (max) (percentage) 62.73% 1.100 1.790 - -10.05% -
429.mcf (max) 60.87% 92.000 148.000 - -0.67% -
459.GemsFDTD (avg) (percentage) 58.89% 0.900 1.430 - -1.38% -
447.dealII (unexplained diff vs previous) (percentage) 56.41% 0.780 1.220 - 69.44% -
454.calculix (avg) (percentage) 52.24% 2.010 3.060 - -1.29% -
471.omnetpp (avg) (percentage) 51.57% 1.590 2.410 - -0.41% -
453.povray (avg) (percentage) 51.20% 1.250 1.890 - -1.56% -
445.gobmk (avg) (percentage) 44.16% 0.770 1.110 - -0.89% -
400.perlbench (avg) (percentage) 42.18% 1.470 2.090 - -0.95% -
401.bzip2 (max) (percentage) 38.64% 0.880 1.220 - -12.86% -
447.dealII (avg) (percentage) 37.38% 1.070 1.470 - 0.00% -
437.leslie3d (max) 35.33% 351.000 475.000 - -8.12% -
465.tonto (unexplained diff vs previous) (percentage) 33.77% 0.770 1.030 - 60.94% -
437.leslie3d (unexplained diff vs previous) 32.65% 343.000 455.000 - -16.36% -
437.leslie3d 31.93% 357.000 471.000 - 4.20% -
437.leslie3d (avg) 31.93% 357.000 471.000 - 4.20% -
410.bwaves (max) 30.00% 30.000 39.000 - 44.44% -
482.sphinx3 (avg) (percentage) 29.45% 1.460 1.890 - -0.53% -
458.sjeng 27.66% 47.000 60.000 - -1.64% -
458.sjeng (avg) 27.66% 47.000 60.000 - -1.64% -
456.hmmer (avg) (percentage) 25.00% 0.680 0.850 - -1.16% -
459.GemsFDTD (max) (percentage) 16.67% 0.600 0.700 - -12.50% -
435.gromacs (avg) (percentage) 12.14% 1.730 1.940 - 0.52% -
429.mcf (unexplained diff vs previous) (percentage) 11.11% 0.540 0.600 - 13.21% -
435.gromacs (unexplained diff vs previous) (percentage) 8.74% 2.060 2.240 - 37.42% -
435.gromacs (max) (percentage) 8.42% 2.020 2.190 - 32.73% -
410.bwaves (avg) (percentage) 7.34% 1.090 1.170 - -0.85% -
465.tonto 4.38% 137.000 143.000 - 0.00% -
465.tonto (avg) 4.38% 137.000 143.000 - 0.00% -
464.h264ref (max) (percentage) 2.33% 0.430 0.440 - 69.23% -
482.sphinx3 (max) (percentage) 2.04% 1.470 1.500 - 117.39% -
434.zeusmp (avg) (percentage) 1.35% 1.480 1.500 - -1.96% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -2.43% 428364.000 417968.000 - 0.00% -
434.zeusmp -1.73% 165699.000 162829.000 - 0.00% -
410.bwaves -1.34% 17880.000 17640.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - 1.64% -
403.gcc -99.36% 9010.000 58.000 - -9.38% -
462.libquantum -98.82% 11614.000 137.000 - -1.44% -
482.sphinx3 -96.84% 29928.000 945.000 - 1.50% -
450.soplex -96.26% 15466.000 579.000 - -1.53% -
453.povray -92.47% 6544.000 493.000 - -0.80% -
444.namd -91.89% 9050.000 734.000 - -0.27% -
429.mcf -91.23% 17158.000 1504.000 - -0.59% -
433.milc -90.94% 12976.000 1176.000 - 0.86% -
436.cactusADM -87.94% 17544.000 2116.000 - 0.28% -
400.perlbench -85.01% 10650.000 1596.000 - -1.30% -
434.zeusmp -80.53% 13211.000 2572.000 - -0.31% -
401.bzip2 -80.11% 15185.000 3021.000 - -0.36% -
447.dealII -79.79% 9751.000 1971.000 - 1.23% -
459.GemsFDTD -73.78% 23356.000 6123.000 - 0.38% -
456.hmmer -73.53% 11046.000 2924.000 - -0.17% -
471.omnetpp -72.66% 10739.000 2936.000 - 1.52% -
470.lbm -70.75% 12819.000 3750.000 - 0.27% -
481.wrf -67.11% 16834.000 5537.000 - -1.35% -
473.astar -60.38% 14932.000 5916.000 - 0.32% -
464.h264ref -59.20% 14556.000 5939.000 - 0.44% -
410.bwaves -58.88% 14755.000 6067.000 - 0.65% -
445.gobmk -56.58% 11995.000 5208.000 - -0.48% -
435.gromacs -53.61% 15419.000 7153.000 - -2.19% -
458.sjeng -46.01% 14275.000 7707.000 - 0.36% -
416.gamess -44.74% 22704.000 12547.000 - -0.09% -
437.leslie3d -27.20% 15005.000 10923.000 - 4.35% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.91% 1074.000 1.000 - 0.00% -
454.calculix -99.78% 459.000 1.000 - 0.00% -
454.calculix (avg) -99.78% 459.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.71% 700.000 2.000 - 100.00% -
444.namd (max) -99.54% 649.000 3.000 - -25.00% -
436.cactusADM (unexplained diff vs previous) -98.95% 570.000 6.000 - -40.00% -
436.cactusADM (max) -98.73% 552.000 7.000 - -53.33% -
462.libquantum (max) -98.65% 74.000 1.000 - -50.00% -
470.lbm (max) -98.47% 653.000 10.000 - 0.00% -
416.gamess (unexplained diff vs previous) -98.37% 676.000 11.000 - 266.67% -
433.milc (unexplained diff vs previous) -97.65% 425.000 10.000 - 100.00% -
433.milc (max) -97.57% 411.000 10.000 - 42.86% -
434.zeusmp (unexplained diff vs previous) -97.40% 308.000 8.000 - 60.00% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
450.soplex (unexplained diff vs previous) -97.11% 311.000 9.000 - -40.00% -
416.gamess (unexplained diff vs previous) (percentage) -96.98% 2.980 0.090 - 350.00% -
416.gamess (max) -96.95% 656.000 20.000 - -9.09% -
482.sphinx3 (max) -96.81% 439.000 14.000 - 133.33% -
444.namd -96.62% 355.000 12.000 - 0.00% -
444.namd (avg) -96.62% 355.000 12.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -96.51% 7.730 0.270 - 92.86% -
450.soplex (max) -96.38% 304.000 11.000 - -50.00% -
482.sphinx3 -96.10% 436.000 17.000 - 0.00% -
482.sphinx3 (avg) -96.10% 436.000 17.000 - 0.00% -
470.lbm (max) (percentage) -94.71% 5.100 0.270 - -3.57% -
434.zeusmp (max) -94.68% 301.000 16.000 - -5.88% -
453.povray (max) -94.55% 165.000 9.000 - -18.18% -
416.gamess (max) (percentage) -94.46% 2.890 0.160 - -11.11% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -94.12% 357.000 21.000 - -65.00% -
456.hmmer (unexplained diff vs previous) -93.98% 83.000 5.000 - 400.00% -
444.namd (max) (percentage) -92.90% 7.180 0.510 - -7.27% -
482.sphinx3 (unexplained diff vs previous) -92.47% 186.000 14.000 - 600.00% -
403.gcc (max) -92.19% 64.000 5.000 - -16.67% -
433.milc -91.82% 220.000 18.000 - 0.00% -
433.milc (avg) -91.82% 220.000 18.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -91.67% 132.000 11.000 - -73.81% -
456.hmmer (max) -91.43% 140.000 12.000 - -7.69% -
436.cactusADM (unexplained diff vs previous) (percentage) -91.38% 3.250 0.280 - -40.43% -
450.soplex -91.10% 191.000 17.000 - 0.00% -
450.soplex (avg) -91.10% 191.000 17.000 - 0.00% -
471.omnetpp (max) -90.94% 662.000 60.000 - -38.14% -
429.mcf (unexplained diff vs previous) -90.32% 93.000 9.000 - 12.50% -
436.cactusADM -90.03% 291.000 29.000 - 0.00% -
436.cactusADM (avg) -90.03% 291.000 29.000 - 0.00% -
453.povray -88.89% 81.000 9.000 - 0.00% -
453.povray (avg) -88.89% 81.000 9.000 - 0.00% -
436.cactusADM (max) (percentage) -88.57% 3.150 0.360 - -50.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -86.70% 2.330 0.310 - 63.16% -
445.gobmk (unexplained diff vs previous) -86.56% 186.000 25.000 - 56.25% -
470.lbm -85.48% 303.000 44.000 - 0.00% -
470.lbm (avg) -85.48% 303.000 44.000 - 0.00% -
400.perlbench (max) -85.22% 345.000 51.000 - -17.74% -
445.gobmk (max) -81.42% 183.000 34.000 - 0.00% -
434.zeusmp -80.51% 195.000 38.000 - -2.56% -
434.zeusmp (avg) -80.51% 195.000 38.000 - -2.56% -
454.calculix (unexplained diff vs previous) -80.00% 5.000 1.000 - 0.00% -
481.wrf (max) -79.62% 530.000 108.000 - -3.57% -
400.perlbench -78.85% 156.000 33.000 - -2.94% -
400.perlbench (avg) -78.85% 156.000 33.000 - -2.94% -
416.gamess -78.66% 492.000 105.000 - -1.87% -
416.gamess (avg) -78.66% 492.000 105.000 - -1.87% -
456.hmmer (unexplained diff vs previous) (percentage) -77.33% 0.750 0.170 - 466.67% -
433.milc (unexplained diff vs previous) (percentage) -74.09% 3.280 0.850 - 97.67% -
447.dealII -73.08% 104.000 28.000 - 0.00% -
447.dealII (avg) -73.08% 104.000 28.000 - 0.00% -
401.bzip2 (max) -72.93% 133.000 36.000 - -14.29% -
433.milc (max) (percentage) -72.87% 3.170 0.860 - 34.37% -
481.wrf -71.38% 318.000 91.000 - -2.15% -
481.wrf (avg) -71.38% 318.000 91.000 - -2.15% -
434.zeusmp (max) (percentage) -71.05% 2.280 0.660 - -4.35% -
465.tonto (max) (percentage) -70.95% 3.580 1.040 - 62.50% -
459.GemsFDTD (max) -70.00% 140.000 42.000 - -12.50% -
445.gobmk (unexplained diff vs previous) (percentage) -69.03% 1.550 0.480 - 54.84% -
447.dealII (unexplained diff vs previous) -68.42% 76.000 24.000 - 71.43% -
456.hmmer -68.00% 75.000 24.000 - -4.00% -
456.hmmer (avg) -68.00% 75.000 24.000 - -4.00% -
447.dealII (max) -67.29% 107.000 35.000 - -7.89% -
471.omnetpp (max) (percentage) -66.77% 6.170 2.050 - -38.99% -
456.hmmer (max) (percentage) -65.35% 1.270 0.440 - -2.22% -
454.calculix (max) (percentage) -65.11% 4.700 1.640 - 12.33% -
416.gamess (avg) (percentage) -61.29% 2.170 0.840 - -2.33% -
400.perlbench (unexplained diff vs previous) (percentage) -60.60% 3.350 1.320 - -64.42% -
465.tonto (max) -59.04% 293.000 120.000 - 64.38% -
471.omnetpp -58.82% 170.000 70.000 - 1.45% -
471.omnetpp (avg) -58.82% 170.000 70.000 - 1.45% -
401.bzip2 (unexplained diff vs previous) (percentage) -58.62% 0.870 0.360 - -74.10% -
459.GemsFDTD -58.57% 210.000 87.000 - -1.14% -
459.GemsFDTD (avg) -58.57% 210.000 87.000 - -1.14% -
464.h264ref (max) -58.06% 62.000 26.000 - 73.33% -
445.gobmk (max) (percentage) -56.86% 1.530 0.660 - 0.00% -
410.bwaves -56.25% 160.000 70.000 - -1.41% -
410.bwaves (avg) -56.25% 160.000 70.000 - -1.41% -
444.namd (avg) (percentage) -56.23% 3.930 1.720 - -1.15% -
459.GemsFDTD (unexplained diff vs previous) -52.08% 48.000 23.000 - -53.06% -
435.gromacs (max) -49.84% 311.000 156.000 - 30.00% -
470.lbm (avg) (percentage) -49.79% 2.370 1.190 - -0.83% -
435.gromacs (unexplained diff vs previous) -49.69% 318.000 160.000 - 34.45% -
435.gromacs -48.12% 266.000 138.000 - -2.13% -
435.gromacs (avg) -48.12% 266.000 138.000 - -2.13% -
445.gobmk -38.04% 92.000 57.000 - -1.72% -
445.gobmk (avg) -38.04% 92.000 57.000 - -1.72% -
481.wrf (max) (percentage) -37.78% 3.150 1.960 - -2.00% -
481.wrf (unexplained diff vs previous) -32.14% 112.000 76.000 - 181.48% -
464.h264ref -30.77% 78.000 54.000 - 0.00% -
464.h264ref (avg) -30.77% 78.000 54.000 - 0.00% -
470.lbm (unexplained diff vs previous) -28.57% 14.000 10.000 - 150.00% -
465.tonto (avg) (percentage) -25.75% 1.670 1.240 - -0.80% -
450.soplex (unexplained diff vs previous) (percentage) -22.89% 2.010 1.550 - -39.22% -
453.povray (max) (percentage) -21.74% 2.530 1.980 - -12.39% -
436.cactusADM (avg) (percentage) -16.27% 1.660 1.390 - -1.42% -
458.sjeng (max) -12.90% 31.000 27.000 - -49.06% -
481.wrf (avg) (percentage) -12.17% 1.890 1.660 - 0.00% -
473.astar (max) -10.00% 20.000 18.000 - -14.29% -
429.mcf -7.78% 90.000 83.000 - -1.19% -
429.mcf (avg) -7.78% 90.000 83.000 - -1.19% -
433.milc (avg) (percentage) -7.06% 1.700 1.580 - -0.63% -
401.bzip2 -4.55% 66.000 63.000 - -1.56% -
401.bzip2 (avg) -4.55% 66.000 63.000 - -1.56% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.45% 29.000 30.000 - 0.00% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1596.000 -1.30%
401.bzip2 3021.000 -
403.gcc 58.000 -9.38%
410.bwaves 6067.000 -
416.gamess 12547.000 -
429.mcf 1504.000 -
433.milc 1176.000 -
434.zeusmp 2572.000 -
435.gromacs 7153.000 -2.19%
436.cactusADM 2116.000 -
437.leslie3d 10923.000 4.35%
444.namd 734.000 -
445.gobmk 5208.000 -
447.dealII 1971.000 1.23%
450.soplex 579.000 -1.53%
453.povray 493.000 -
454.calculix 62.000 1.64%
456.hmmer 2924.000 -
458.sjeng 7707.000 -
459.GemsFDTD 6123.000 -
462.libquantum 137.000 -1.44%
464.h264ref 5939.000 -
465.tonto 11599.000 1.04%
470.lbm 3750.000 -
471.omnetpp 2936.000 1.52%
473.astar 5916.000 -
481.wrf 5537.000 -1.35%
482.sphinx3 945.000 1.50%
Geometric Mean 2092.146 -
Code Size (bytes)
Name Current %
400.perlbench 929250.000 -
401.bzip2 49690.000 -
403.gcc 2683613.000 -
410.bwaves 17640.000 -
416.gamess 6251075.000 -
429.mcf 10979.000 -
433.milc 99705.000 -
434.zeusmp 162829.000 -
435.gromacs 677869.000 -
436.cactusADM 551516.000 -
437.leslie3d 64776.000 -
444.namd 190766.000 -
445.gobmk 1399885.000 -
447.dealII 2118491.000 -
450.soplex 259941.000 -
453.povray 706478.000 -
454.calculix 1270135.000 -
456.hmmer 234488.000 -
458.sjeng 120025.000 -
459.GemsFDTD 254373.000 -
462.libquantum 31353.000 -
464.h264ref 417968.000 -
465.tonto 2873397.000 -
470.lbm 10916.000 -
471.omnetpp 566460.000 -
473.astar 32228.000 -
481.wrf 2623276.000 -
482.sphinx3 152612.000 -
Geometric Mean 273250.959 -
sample variability
Name Current %
400.perlbench 33.000 -2.94%
400.perlbench (avg) 33.000 -2.94%
400.perlbench (avg) (percentage) 2.090 -
400.perlbench (max) 51.000 -17.74%
400.perlbench (max) (percentage) 3.210 -16.62%
400.perlbench (unexplained diff vs previous) 21.000 -65.00%
400.perlbench (unexplained diff vs previous) (percentage) 1.320 -64.42%
401.bzip2 63.000 -1.56%
401.bzip2 (avg) 63.000 -1.56%
401.bzip2 (avg) (percentage) 2.090 -1.88%
401.bzip2 (max) 36.000 -14.29%
401.bzip2 (max) (percentage) 1.220 -12.86%
401.bzip2 (unexplained diff vs previous) 11.000 -73.81%
401.bzip2 (unexplained diff vs previous) (percentage) 0.360 -74.10%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.180 -
403.gcc (max) 5.000 -16.67%
403.gcc (max) (percentage) 10.180 -2.68%
410.bwaves 70.000 -1.41%
410.bwaves (avg) 70.000 -1.41%
410.bwaves (avg) (percentage) 1.170 -
410.bwaves (max) 39.000 44.44%
410.bwaves (max) (percentage) 0.650 41.30%
410.bwaves (unexplained diff vs previous) 39.000 39.29%
410.bwaves (unexplained diff vs previous) (percentage) 0.640 39.13%
416.gamess 105.000 -1.87%
416.gamess (avg) 105.000 -1.87%
416.gamess (avg) (percentage) 0.840 -2.33%
416.gamess (max) 20.000 -9.09%
416.gamess (max) (percentage) 0.160 -11.11%
416.gamess (unexplained diff vs previous) 11.000 266.67%
416.gamess (unexplained diff vs previous) (percentage) 0.090 350.00%
429.mcf 83.000 -1.19%
429.mcf (avg) 83.000 -1.19%
429.mcf (avg) (percentage) 5.530 -1.43%
429.mcf (max) 148.000 -
429.mcf (max) (percentage) 9.880 -
429.mcf (unexplained diff vs previous) 9.000 12.50%
429.mcf (unexplained diff vs previous) (percentage) 0.600 13.21%
433.milc 18.000 -
433.milc (avg) 18.000 -
433.milc (avg) (percentage) 1.580 -
433.milc (max) 10.000 42.86%
433.milc (max) (percentage) 0.860 34.37%
433.milc (unexplained diff vs previous) 10.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.850 97.67%
434.zeusmp 38.000 -2.56%
434.zeusmp (avg) 38.000 -2.56%
434.zeusmp (avg) (percentage) 1.500 -1.96%
434.zeusmp (max) 16.000 -5.88%
434.zeusmp (max) (percentage) 0.660 -4.35%
434.zeusmp (unexplained diff vs previous) 8.000 60.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.310 63.16%
435.gromacs 138.000 -2.13%
435.gromacs (avg) 138.000 -2.13%
435.gromacs (avg) (percentage) 1.940 -
435.gromacs (max) 156.000 30.00%
435.gromacs (max) (percentage) 2.190 32.73%
435.gromacs (unexplained diff vs previous) 160.000 34.45%
435.gromacs (unexplained diff vs previous) (percentage) 2.240 37.42%
436.cactusADM 29.000 -
436.cactusADM (avg) 29.000 -
436.cactusADM (avg) (percentage) 1.390 -1.42%
436.cactusADM (max) 7.000 -53.33%
436.cactusADM (max) (percentage) 0.360 -50.00%
436.cactusADM (unexplained diff vs previous) 6.000 -40.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.280 -40.43%
437.leslie3d 471.000 4.20%
437.leslie3d (avg) 471.000 4.20%
437.leslie3d (avg) (percentage) 4.320 -
437.leslie3d (max) 475.000 -8.12%
437.leslie3d (max) (percentage) 4.350 -11.94%
437.leslie3d (unexplained diff vs previous) 455.000 -16.36%
437.leslie3d (unexplained diff vs previous) (percentage) 4.170 -19.81%
444.namd 12.000 -
444.namd (avg) 12.000 -
444.namd (avg) (percentage) 1.720 -1.15%
444.namd (max) 3.000 -25.00%
444.namd (max) (percentage) 0.510 -7.27%
444.namd (unexplained diff vs previous) 2.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.270 92.86%
445.gobmk 57.000 -1.72%
445.gobmk (avg) 57.000 -1.72%
445.gobmk (avg) (percentage) 1.110 -
445.gobmk (max) 34.000 -
445.gobmk (max) (percentage) 0.660 -
445.gobmk (unexplained diff vs previous) 25.000 56.25%
445.gobmk (unexplained diff vs previous) (percentage) 0.480 54.84%
447.dealII 28.000 -
447.dealII (avg) 28.000 -
447.dealII (avg) (percentage) 1.470 -
447.dealII (max) 35.000 -7.89%
447.dealII (max) (percentage) 1.790 -10.05%
447.dealII (unexplained diff vs previous) 24.000 71.43%
447.dealII (unexplained diff vs previous) (percentage) 1.220 69.44%
450.soplex 17.000 -
450.soplex (avg) 17.000 -
450.soplex (avg) (percentage) 2.960 -
450.soplex (max) 11.000 -50.00%
450.soplex (max) (percentage) 1.960 -48.15%
450.soplex (unexplained diff vs previous) 9.000 -40.00%
450.soplex (unexplained diff vs previous) (percentage) 1.550 -39.22%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.890 -1.56%
453.povray (max) 9.000 -18.18%
453.povray (max) (percentage) 1.980 -12.39%
453.povray (unexplained diff vs previous) 4.000 -63.64%
453.povray (unexplained diff vs previous) (percentage) 0.810 -63.35%
454.calculix 1.000 -
454.calculix (avg) 1.000 -
454.calculix (avg) (percentage) 3.060 -1.29%
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 1.640 12.33%
454.calculix (unexplained diff vs previous) 1.000 -
454.calculix (unexplained diff vs previous) (percentage) 1.610 -
456.hmmer 24.000 -4.00%
456.hmmer (avg) 24.000 -4.00%
456.hmmer (avg) (percentage) 0.850 -1.16%
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.440 -2.22%
456.hmmer (unexplained diff vs previous) 5.000 400.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.170 466.67%
458.sjeng 60.000 -1.64%
458.sjeng (avg) 60.000 -1.64%
458.sjeng (avg) (percentage) 0.790 -1.25%
458.sjeng (max) 27.000 -49.06%
458.sjeng (max) (percentage) 0.360 -48.57%
458.sjeng (unexplained diff vs previous) 28.000 -9.68%
458.sjeng (unexplained diff vs previous) (percentage) 0.360 -10.00%
459.GemsFDTD 87.000 -1.14%
459.GemsFDTD (avg) 87.000 -1.14%
459.GemsFDTD (avg) (percentage) 1.430 -1.38%
459.GemsFDTD (max) 42.000 -12.50%
459.GemsFDTD (max) (percentage) 0.700 -12.50%
459.GemsFDTD (unexplained diff vs previous) 23.000 -53.06%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.380 -52.50%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.780 -
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.440 -2.70%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.460 102.78%
464.h264ref 54.000 -
464.h264ref (avg) 54.000 -
464.h264ref (avg) (percentage) 0.920 -1.08%
464.h264ref (max) 26.000 73.33%
464.h264ref (max) (percentage) 0.440 69.23%
464.h264ref (unexplained diff vs previous) 26.000 420.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.440 450.00%
465.tonto 143.000 -
465.tonto (avg) 143.000 -
465.tonto (avg) (percentage) 1.240 -
465.tonto (max) 120.000 64.38%
465.tonto (max) (percentage) 1.040 62.50%
465.tonto (unexplained diff vs previous) 119.000 63.01%
465.tonto (unexplained diff vs previous) (percentage) 1.030 60.94%
470.lbm 44.000 -
470.lbm (avg) 44.000 -
470.lbm (avg) (percentage) 1.190 -
470.lbm (max) 10.000 -
470.lbm (max) (percentage) 0.270 -3.57%
470.lbm (unexplained diff vs previous) 10.000 150.00%
470.lbm (unexplained diff vs previous) (percentage) 0.270 145.45%
471.omnetpp 70.000 1.45%
471.omnetpp (avg) 70.000 1.45%
471.omnetpp (avg) (percentage) 2.410 -
471.omnetpp (max) 60.000 -38.14%
471.omnetpp (max) (percentage) 2.050 -38.99%
471.omnetpp (unexplained diff vs previous) 44.000 -39.73%
471.omnetpp (unexplained diff vs previous) (percentage) 1.500 -40.48%
473.astar 97.000 -1.02%
473.astar (avg) 97.000 -1.02%
473.astar (avg) (percentage) 1.650 -1.20%
473.astar (max) 18.000 -14.29%
473.astar (max) (percentage) 0.320 -11.11%
473.astar (unexplained diff vs previous) 19.000 46.15%
473.astar (unexplained diff vs previous) (percentage) 0.320 45.45%
481.wrf 91.000 -2.15%
481.wrf (avg) 91.000 -2.15%
481.wrf (avg) (percentage) 1.660 -
481.wrf (max) 108.000 -3.57%
481.wrf (max) (percentage) 1.960 -2.00%
481.wrf (unexplained diff vs previous) 76.000 181.48%
481.wrf (unexplained diff vs previous) (percentage) 1.370 185.42%
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 1.890 -
482.sphinx3 (max) 14.000 133.33%
482.sphinx3 (max) (percentage) 1.500 117.39%
482.sphinx3 (unexplained diff vs previous) 14.000 600.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.480 604.76%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.750 -
Geometric Mean 6.532 22.57%