Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7a8cc0983ae3b954cba68dc874b0b0e738347e79 (+ 24 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (56f1863ade1bf416e09da305615ecb2ae04602a8) (+ 43 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=87cd94bba4091d22e24116298ade33b712ada235 (+ 25 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/42c1a943791e2ce85a5c9a152c7d44d369a88afb (+ 469 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/337/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0337 (4-changed-components) 2024-12-12T16:28:45 0:00:00
Previous 0336 (4-changed-components) 2024-12-08T09:33:48 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 11
Performance Improvements 74 178
Added Tests 14 0
Unchanged Tests 1125 1047
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 1.67% 7186.000 7306.000 - 0.51% -
482.sphinx3 1.31% 841.000 852.000 - -9.84% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 300.00% 0.010 0.040 - -99.96% -
458.sjeng (unexplained diff vs previous) 200.00% 1.000 3.000 - -99.96% -
447.dealII (max) (percentage) 130.91% 0.550 1.270 - -98.42% -
447.dealII (max) 122.22% 9.000 20.000 - -98.55% -
437.leslie3d (unexplained diff vs previous) (percentage) 121.87% 2.560 5.680 - -71.43% -
435.gromacs (max) 114.04% 57.000 122.000 - -96.59% -
437.leslie3d (unexplained diff vs previous) 110.03% 289.000 607.000 - -73.77% -
435.gromacs (max) (percentage) 108.75% 0.800 1.670 - -96.60% -
462.libquantum (unexplained diff vs previous) (percentage) 105.56% 1.440 2.960 - -99.97% -
437.leslie3d (max) (percentage) 104.56% 2.630 5.380 - -67.55% -
462.libquantum (unexplained diff vs previous) 100.00% 2.000 4.000 - -99.97% -
437.leslie3d (max) 93.92% 296.000 574.000 - -70.24% -
453.povray (max) (percentage) 89.94% 1.690 3.210 - -96.48% -
453.povray (max) 88.89% 9.000 17.000 - -96.59% -
465.tonto (max) (percentage) 70.19% 1.040 1.770 - -90.83% -
465.tonto (max) 67.24% 116.000 194.000 - -90.81% -
462.libquantum (max) 50.00% 2.000 3.000 - -97.83% -
462.libquantum (max) (percentage) 46.94% 1.960 2.880 - -97.09% -
435.gromacs 1.60% 125.000 127.000 - -65.40% -
435.gromacs (avg) 1.60% 125.000 127.000 - -65.40% -
453.povray (avg) (percentage) 1.30% 1.540 1.560 - -80.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -5.38% 11285.000 10678.000 - -8.26% -
453.povray -3.21% 560.000 542.000 - -0.91% -
462.libquantum -2.88% 139.000 135.000 - -3.57% -
465.tonto -1.77% 11206.000 11008.000 - 0.61% -
447.dealII -1.27% 1659.000 1638.000 - -4.99% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -92.50% 0.400 0.030 - -99.99% -
410.bwaves (unexplained diff vs previous) -92.31% 13.000 1.000 - -99.99% -
401.bzip2 (unexplained diff vs previous) -91.67% 12.000 1.000 - -99.99% -
410.bwaves (unexplained diff vs previous) (percentage) -90.91% 0.220 0.020 - -99.99% -
459.GemsFDTD (max) -77.97% 118.000 26.000 - -99.41% -
459.GemsFDTD (max) (percentage) -77.38% 2.210 0.500 - -99.30% -
473.astar (unexplained diff vs previous) (percentage) -75.63% 1.190 0.290 - -99.85% -
473.astar (unexplained diff vs previous) -75.41% 61.000 15.000 - -99.85% -
434.zeusmp (max) -75.00% 16.000 4.000 - -99.81% -
434.zeusmp (max) (percentage) -72.22% 0.720 0.200 - -99.76% -
471.omnetpp (unexplained diff vs previous) (percentage) -64.12% 1.310 0.470 - -99.88% -
471.omnetpp (unexplained diff vs previous) -63.89% 36.000 13.000 - -99.88% -
459.GemsFDTD (unexplained diff vs previous) -62.07% 29.000 11.000 - -99.93% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -61.11% 0.540 0.210 - -99.92% -
470.lbm (max) -59.26% 27.000 11.000 - -99.60% -
470.lbm (max) (percentage) -56.94% 0.720 0.310 - -99.57% -
450.soplex (max) -41.18% 17.000 10.000 - -98.17% -
450.soplex (max) (percentage) -40.61% 2.930 1.740 - -98.19% -
433.milc (unexplained diff vs previous) (percentage) -36.46% 0.960 0.610 - -99.94% -
433.milc (unexplained diff vs previous) -36.36% 11.000 7.000 - -99.94% -
470.lbm (unexplained diff vs previous) (percentage) -32.35% 0.340 0.230 - -99.91% -
470.lbm (unexplained diff vs previous) -30.77% 13.000 9.000 - -99.91% -
433.milc (max) (percentage) -25.26% 0.950 0.710 - -99.22% -
434.zeusmp (unexplained diff vs previous) (percentage) -22.73% 0.220 0.170 - -99.96% -
433.milc (max) -20.00% 10.000 8.000 - -99.23% -
434.zeusmp (unexplained diff vs previous) -20.00% 5.000 4.000 - -99.96% -
429.mcf (unexplained diff vs previous) (percentage) -18.52% 0.540 0.440 - -99.97% -
429.mcf (unexplained diff vs previous) -18.18% 11.000 9.000 - -99.95% -
473.astar (max) (percentage) -16.95% 1.180 0.980 - -98.52% -
473.astar (max) -16.67% 60.000 50.000 - -98.53% -
445.gobmk (max) -15.00% 20.000 17.000 - -99.36% -
445.gobmk (max) (percentage) -12.20% 0.410 0.360 - -99.32% -
471.omnetpp (max) -11.25% 80.000 71.000 - -96.73% -
471.omnetpp (max) (percentage) -10.96% 2.920 2.600 - -96.74% -
445.gobmk (unexplained diff vs previous) (percentage) -10.00% 0.400 0.360 - -99.68% -
444.namd (max) -10.00% 10.000 9.000 - -98.69% -
445.gobmk (unexplained diff vs previous) -10.00% 20.000 18.000 - -99.68% -
482.sphinx3 (max) -8.33% 12.000 11.000 - -98.79% -
433.milc -7.14% 14.000 13.000 - -81.16% -
433.milc (avg) -7.14% 14.000 13.000 - -81.16% -
447.dealII -5.26% 19.000 18.000 - -81.82% -
447.dealII (avg) -5.26% 19.000 18.000 - -81.82% -
437.leslie3d -5.23% 497.000 471.000 - 32.68% -
437.leslie3d (avg) -5.23% 497.000 471.000 - 32.68% -
482.sphinx3 (max) (percentage) -4.83% 1.450 1.380 - -98.57% -
444.namd (max) (percentage) -4.38% 1.370 1.310 - -98.57% -
429.mcf (max) (percentage) -3.88% 1.290 1.240 - -98.67% -
429.mcf (max) -3.85% 26.000 25.000 - -98.11% -
410.bwaves (max) (percentage) -3.33% 0.300 0.290 - -99.50% -
470.lbm -3.23% 31.000 30.000 - -87.45% -
470.lbm (avg) -3.23% 31.000 30.000 - -87.45% -
401.bzip2 (max) (percentage) -3.03% 0.660 0.640 - -99.19% -
464.h264ref (max) (percentage) -2.50% 0.400 0.390 - -99.28% -
401.bzip2 -2.44% 41.000 40.000 - -75.16% -
401.bzip2 (avg) -2.44% 41.000 40.000 - -75.16% -
445.gobmk -2.38% 42.000 41.000 - -79.08% -
445.gobmk (avg) -2.38% 42.000 41.000 - -79.08% -
458.sjeng (max) (percentage) -2.30% 0.870 0.850 - -98.21% -
429.mcf -2.11% 95.000 93.000 - -14.68% -
429.mcf (avg) -2.11% 95.000 93.000 - -14.68% -
400.perlbench (max) (percentage) -2.02% 2.480 2.430 - -97.11% -
471.omnetpp -1.79% 56.000 55.000 - -75.34% -
471.omnetpp (avg) -1.79% 56.000 55.000 - -75.34% -
458.sjeng (max) -1.59% 63.000 62.000 - -98.28% -
459.GemsFDTD -1.49% 67.000 66.000 - -81.67% -
459.GemsFDTD (avg) -1.49% 67.000 66.000 - -81.67% -
470.lbm (avg) (percentage) -1.23% 0.810 0.800 - -87.36% -
410.bwaves (avg) (percentage) -1.19% 0.840 0.830 - -81.18% -
434.zeusmp (avg) (percentage) -1.10% 0.910 0.900 - -84.62% -

Added Tests - sample variability
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.32% 1946163.000 1971787.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 42.35% 1424.000 2027.000 - -0.44% -
410.bwaves 4.99% 5652.000 5934.000 - 0.02% -
450.soplex 3.35% 567.000 586.000 - 0.86% -
401.bzip2 2.96% 2941.000 3028.000 - 0.03% -
470.lbm 1.50% 3788.000 3845.000 - 0.23% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 44.92% 3.050 4.420 - 0.23% -
437.leslie3d 32.68% 355.000 471.000 - -5.23% -
437.leslie3d (avg) 32.68% 355.000 471.000 - -5.23% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.59% 59479.000 54370.000 - 0.00% -
459.GemsFDTD -4.94% 244728.000 232644.000 - 0.00% -
434.zeusmp -3.39% 152037.000 146883.000 - 0.00% -
444.namd -3.27% 188385.000 182224.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
447.dealII -1.73% 311591.000 306198.000 - 0.00% -
410.bwaves -1.69% 16760.000 16476.000 - 0.00% -
458.sjeng -1.67% 104048.000 102311.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60484.000 - 0.00% -
450.soplex -1.30% 205081.000 202418.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
435.gromacs -1.09% 499261.000 493840.000 - 0.00% -
482.sphinx3 -1.01% 112859.000 111718.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.28% 6173.000 5353.000 - 0.21% -
482.sphinx3 -9.84% 945.000 852.000 - 1.31% -
434.zeusmp -8.47% 2514.000 2301.000 - 0.17% -
437.leslie3d -8.26% 11640.000 10678.000 - -5.38% -
447.dealII -4.99% 1724.000 1638.000 - -1.27% -
462.libquantum -3.57% 140.000 135.000 - -2.88% -
458.sjeng -3.18% 7567.000 7326.000 - 0.04% -
445.gobmk -1.69% 5023.000 4938.000 - -0.36% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (unexplained diff vs previous) (percentage) -99.99% 368.340 0.030 - -92.50% -
401.bzip2 (unexplained diff vs previous) -99.99% 10833.000 1.000 - -91.67% -
410.bwaves (unexplained diff vs previous) -99.99% 7794.000 1.000 - -92.31% -
410.bwaves (unexplained diff vs previous) (percentage) -99.99% 137.900 0.020 - -90.91% -
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.270 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.97% 13518.000 4.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.97% 9655.710 2.960 - 105.56% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.850 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.97% 1305.690 0.440 - -18.52% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 5.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 - -20.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.170 - -22.73% -
482.sphinx3 (unexplained diff vs previous) -99.96% 26073.000 11.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.96% 6876.000 3.000 - 200.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.96% 90.870 0.040 - 300.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.290 - 0.00% -
429.mcf (unexplained diff vs previous) -99.95% 18593.000 9.000 - -18.18% -
433.milc (unexplained diff vs previous) -99.94% 11289.000 7.000 - -36.36% -
433.milc (unexplained diff vs previous) (percentage) -99.94% 980.800 0.610 - -36.46% -
459.GemsFDTD (unexplained diff vs previous) -99.93% 15458.000 11.000 - -62.07% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.92% 250.410 0.210 - -61.11% -
470.lbm (unexplained diff vs previous) (percentage) -99.91% 263.730 0.230 - -32.35% -
470.lbm (unexplained diff vs previous) -99.91% 9990.000 9.000 - -30.77% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.88% 391.300 0.470 - -64.12% -
471.omnetpp (unexplained diff vs previous) -99.88% 10659.000 13.000 - -63.89% -
473.astar (unexplained diff vs previous) (percentage) -99.85% 197.850 0.290 - -75.63% -
473.astar (unexplained diff vs previous) -99.85% 10146.000 15.000 - -75.41% -
434.zeusmp (max) -99.81% 2055.000 4.000 - -75.00% -
434.zeusmp (max) (percentage) -99.76% 81.770 0.200 - -72.22% -
447.dealII (unexplained diff vs previous) -99.70% 7017.000 21.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.69% 407.020 1.280 - 0.00% -
453.povray (unexplained diff vs previous) -99.68% 5707.000 18.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.68% 1043.330 3.320 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.68% 5581.000 18.000 - -10.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.68% 111.110 0.360 - -10.00% -
470.lbm (max) -99.60% 2746.000 11.000 - -59.26% -
470.lbm (max) (percentage) -99.57% 72.510 0.310 - -56.94% -
410.bwaves (max) (percentage) -99.50% 57.970 0.290 - -3.33% -
410.bwaves (max) -99.48% 3276.000 17.000 - 0.00% -
456.hmmer (max) (percentage) -99.46% 73.590 0.400 - -2.44% -
459.GemsFDTD (max) -99.41% 4411.000 26.000 - -77.97% -
445.gobmk (max) -99.36% 2643.000 17.000 - -15.00% -
445.gobmk (max) (percentage) -99.32% 52.630 0.360 - -12.20% -
459.GemsFDTD (max) (percentage) -99.30% 71.460 0.500 - -77.38% -
464.h264ref (max) (percentage) -99.28% 54.290 0.390 - -2.50% -
433.milc (max) -99.23% 1044.000 8.000 - -20.00% -
433.milc (max) (percentage) -99.22% 90.750 0.710 - -25.26% -
401.bzip2 (max) (percentage) -99.19% 78.650 0.640 - -3.03% -
401.bzip2 (max) -99.18% 2313.000 19.000 - 0.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - 0.00% -
436.cactusADM (max) (percentage) -98.97% 88.730 0.910 - 0.00% -
481.wrf (max) (percentage) -98.84% 68.700 0.800 - 0.00% -
482.sphinx3 (max) -98.79% 911.000 11.000 - -8.33% -
444.namd (max) -98.69% 685.000 9.000 - -10.00% -
429.mcf (max) (percentage) -98.67% 92.890 1.240 - -3.88% -
444.namd (max) (percentage) -98.57% 91.790 1.310 - -4.38% -
482.sphinx3 (max) (percentage) -98.57% 96.500 1.380 - -4.83% -
447.dealII (max) -98.55% 1384.000 20.000 - 122.22% -
473.astar (max) -98.53% 3406.000 50.000 - -16.67% -
473.astar (max) (percentage) -98.52% 66.430 0.980 - -16.95% -
447.dealII (max) (percentage) -98.42% 80.280 1.270 - 130.91% -
435.gromacs (unexplained diff vs previous) (percentage) -98.30% 96.680 1.640 - 0.00% -
435.gromacs (unexplained diff vs previous) -98.29% 7028.000 120.000 - 0.00% -
458.sjeng (max) -98.28% 3602.000 62.000 - -1.59% -
458.sjeng (max) (percentage) -98.21% 47.610 0.850 - -2.30% -
450.soplex (max) (percentage) -98.19% 96.240 1.740 - -40.61% -
450.soplex (max) -98.17% 545.000 10.000 - -41.18% -
429.mcf (max) -98.11% 1322.000 25.000 - -3.85% -
462.libquantum (max) -97.83% 138.000 3.000 - 50.00% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.11% 84.060 2.430 - -2.02% -
462.libquantum (max) (percentage) -97.09% 98.970 2.880 - 46.94% -
471.omnetpp (max) (percentage) -96.74% 79.650 2.600 - -10.96% -
471.omnetpp (max) -96.73% 2169.000 71.000 - -11.25% -
435.gromacs (max) (percentage) -96.60% 49.160 1.670 - 108.75% -
453.povray (max) -96.59% 499.000 17.000 - 88.89% -
435.gromacs (max) -96.59% 3573.000 122.000 - 114.04% -
453.povray (max) (percentage) -96.48% 91.250 3.210 - 89.94% -
403.gcc (max) (percentage) -96.24% 99.360 3.740 - 0.00% -
465.tonto (max) (percentage) -90.83% 19.310 1.770 - 70.19% -
465.tonto (max) -90.81% 2112.000 194.000 - 67.24% -
465.tonto (unexplained diff vs previous) (percentage) -88.88% 16.190 1.800 - 0.00% -
465.tonto (unexplained diff vs previous) -88.82% 1771.000 198.000 - 0.00% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
470.lbm -87.45% 239.000 30.000 - -3.23% -
470.lbm (avg) -87.45% 239.000 30.000 - -3.23% -
444.namd (avg) (percentage) -87.42% 9.220 1.160 - -0.85% -
470.lbm (avg) (percentage) -87.36% 6.330 0.800 - -1.23% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -84.62% 5.850 0.900 - -1.10% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng -82.57% 241.000 42.000 - 0.00% -
458.sjeng (avg) -82.57% 241.000 42.000 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - -5.26% -
447.dealII (avg) -81.82% 99.000 18.000 - -5.26% -
458.sjeng (avg) (percentage) -81.82% 3.190 0.580 - 0.00% -
459.GemsFDTD -81.67% 360.000 66.000 - -1.49% -
459.GemsFDTD (avg) -81.67% 360.000 66.000 - -1.49% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - -1.19% -
433.milc -81.16% 69.000 13.000 - -7.14% -
433.milc (avg) -81.16% 69.000 13.000 - -7.14% -
482.sphinx3 -81.08% 74.000 14.000 - 0.00% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
410.bwaves -80.32% 249.000 49.000 - 0.00% -
410.bwaves (avg) -80.32% 249.000 49.000 - 0.00% -
447.dealII (avg) (percentage) -80.07% 5.770 1.150 - 0.00% -
453.povray (avg) (percentage) -80.03% 7.810 1.560 - 1.30% -
433.milc (avg) (percentage) -80.00% 6.050 1.210 - -0.82% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
445.gobmk -79.08% 196.000 41.000 - -2.38% -
445.gobmk (avg) -79.08% 196.000 41.000 - -2.38% -
482.sphinx3 (avg) (percentage) -78.69% 7.930 1.690 - 0.00% -
459.GemsFDTD (avg) (percentage) -78.60% 5.840 1.250 - -0.79% -
445.gobmk (avg) (percentage) -78.26% 3.910 0.850 - 0.00% -
462.libquantum (avg) (percentage) -75.85% 7.660 1.850 - 0.54% -
401.bzip2 (avg) (percentage) -75.36% 5.480 1.350 - -0.74% -
471.omnetpp -75.34% 223.000 55.000 - -1.79% -
471.omnetpp (avg) -75.34% 223.000 55.000 - -1.79% -
401.bzip2 -75.16% 161.000 40.000 - -2.44% -
401.bzip2 (avg) -75.16% 161.000 40.000 - -2.44% -
471.omnetpp (avg) (percentage) -75.12% 8.200 2.040 - -0.97% -
437.leslie3d (unexplained diff vs previous) -73.77% 2314.000 607.000 - 110.03% -
437.leslie3d (unexplained diff vs previous) (percentage) -71.43% 19.880 5.680 - 121.87% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (max) -70.24% 1929.000 574.000 - 93.92% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
437.leslie3d (max) (percentage) -67.55% 16.580 5.380 - 104.56% -
435.gromacs (avg) (percentage) -65.61% 5.060 1.740 - 0.00% -
435.gromacs -65.40% 367.000 127.000 - 1.60% -
435.gromacs (avg) -65.40% 367.000 127.000 - 1.60% -
473.astar -62.91% 213.000 79.000 - 0.00% -
473.astar (avg) -62.91% 213.000 79.000 - 0.00% -
465.tonto (avg) (percentage) -62.87% 3.340 1.240 - 0.81% -
473.astar (avg) (percentage) -62.74% 4.160 1.550 - -0.64% -
465.tonto -62.74% 365.000 136.000 - -0.73% -
465.tonto (avg) -62.74% 365.000 136.000 - -0.73% -
450.soplex (avg) (percentage) -62.52% 6.430 2.410 - -0.82% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -39.63% 7.670 4.630 - -0.86% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -14.68% 109.000 93.000 - -2.11% -
429.mcf (avg) -14.68% 109.000 93.000 - -2.11% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3028.000 -
410.bwaves 5934.000 -
429.mcf 2027.000 -
433.milc 1156.000 -
434.zeusmp 2301.000 -
435.gromacs 7306.000 1.67%
437.leslie3d 10678.000 -5.38%
444.namd 750.000 -
445.gobmk 4938.000 -
447.dealII 1638.000 -1.27%
450.soplex 586.000 -
453.povray 542.000 -3.21%
458.sjeng 7326.000 -
459.GemsFDTD 5353.000 -
462.libquantum 135.000 -2.88%
465.tonto 11008.000 -1.77%
470.lbm 3845.000 -
471.omnetpp 2745.000 -
473.astar 5120.000 -
482.sphinx3 852.000 1.31%
Geometric Mean 2396.591 -
Code Size (bytes)
Name Current %
401.bzip2 43711.000 -
410.bwaves 16476.000 -
429.mcf 9146.000 -
433.milc 60484.000 -
434.zeusmp 146883.000 -
435.gromacs 493840.000 -
437.leslie3d 54370.000 -
444.namd 182224.000 -
445.gobmk 1375090.000 -
447.dealII 306198.000 -
450.soplex 202418.000 -
453.povray 658001.000 -
458.sjeng 102311.000 -
459.GemsFDTD 232644.000 -
462.libquantum 15797.000 -
465.tonto 1971787.000 -
470.lbm 9547.000 -
471.omnetpp 475220.000 -
473.astar 22752.000 -
482.sphinx3 111718.000 -
Geometric Mean 113993.467 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.430 -2.02%
401.bzip2 40.000 -2.44%
401.bzip2 (avg) 40.000 -2.44%
401.bzip2 (avg) (percentage) 1.350 -
401.bzip2 (max) 19.000 -
401.bzip2 (max) (percentage) 0.640 -3.03%
401.bzip2 (unexplained diff vs previous) 1.000 -91.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.030 -92.50%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.740 -
410.bwaves 49.000 -
410.bwaves (avg) 49.000 -
410.bwaves (avg) (percentage) 0.830 -1.19%
410.bwaves (max) 17.000 -
410.bwaves (max) (percentage) 0.290 -3.33%
410.bwaves (unexplained diff vs previous) 1.000 -92.31%
410.bwaves (unexplained diff vs previous) (percentage) 0.020 -90.91%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.370 -
429.mcf 93.000 -2.11%
429.mcf (avg) 93.000 -2.11%
429.mcf (avg) (percentage) 4.630 -
429.mcf (max) 25.000 -3.85%
429.mcf (max) (percentage) 1.240 -3.88%
429.mcf (unexplained diff vs previous) 9.000 -18.18%
429.mcf (unexplained diff vs previous) (percentage) 0.440 -18.52%
433.milc 13.000 -7.14%
433.milc (avg) 13.000 -7.14%
433.milc (avg) (percentage) 1.210 -
433.milc (max) 8.000 -20.00%
433.milc (max) (percentage) 0.710 -25.26%
433.milc (unexplained diff vs previous) 7.000 -36.36%
433.milc (unexplained diff vs previous) (percentage) 0.610 -36.46%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.900 -1.10%
434.zeusmp (max) 4.000 -75.00%
434.zeusmp (max) (percentage) 0.200 -72.22%
434.zeusmp (unexplained diff vs previous) 4.000 -20.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.170 -22.73%
435.gromacs 127.000 1.60%
435.gromacs (avg) 127.000 1.60%
435.gromacs (avg) (percentage) 1.740 -
435.gromacs (max) 122.000 114.04%
435.gromacs (max) (percentage) 1.670 108.75%
435.gromacs (unexplained diff vs previous) 120.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.640 -
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.910 -
437.leslie3d 471.000 -5.23%
437.leslie3d (avg) 471.000 -5.23%
437.leslie3d (avg) (percentage) 4.420 -
437.leslie3d (max) 574.000 93.92%
437.leslie3d (max) (percentage) 5.380 104.56%
437.leslie3d (unexplained diff vs previous) 607.000 110.03%
437.leslie3d (unexplained diff vs previous) (percentage) 5.680 121.87%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.160 -
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.310 -4.38%
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.270 -
445.gobmk 41.000 -2.38%
445.gobmk (avg) 41.000 -2.38%
445.gobmk (avg) (percentage) 0.850 -
445.gobmk (max) 17.000 -15.00%
445.gobmk (max) (percentage) 0.360 -12.20%
445.gobmk (unexplained diff vs previous) 18.000 -10.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.360 -10.00%
447.dealII 18.000 -5.26%
447.dealII (avg) 18.000 -5.26%
447.dealII (avg) (percentage) 1.150 -
447.dealII (max) 20.000 122.22%
447.dealII (max) (percentage) 1.270 130.91%
447.dealII (unexplained diff vs previous) 21.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.280 -
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.410 -
450.soplex (max) 10.000 -41.18%
450.soplex (max) (percentage) 1.740 -40.61%
450.soplex (unexplained diff vs previous) 5.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.850 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.560 1.30%
453.povray (max) 17.000 88.89%
453.povray (max) (percentage) 3.210 89.94%
453.povray (unexplained diff vs previous) 18.000 -
453.povray (unexplained diff vs previous) (percentage) 3.320 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.400 -
458.sjeng 42.000 -
458.sjeng (avg) 42.000 -
458.sjeng (avg) (percentage) 0.580 -
458.sjeng (max) 62.000 -1.59%
458.sjeng (max) (percentage) 0.850 -2.30%
458.sjeng (unexplained diff vs previous) 3.000 200.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.040 300.00%
459.GemsFDTD 66.000 -1.49%
459.GemsFDTD (avg) 66.000 -1.49%
459.GemsFDTD (avg) (percentage) 1.250 -
459.GemsFDTD (max) 26.000 -77.97%
459.GemsFDTD (max) (percentage) 0.500 -77.38%
459.GemsFDTD (unexplained diff vs previous) 11.000 -62.07%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.210 -61.11%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.850 -
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 2.880 46.94%
462.libquantum (unexplained diff vs previous) 4.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.960 105.56%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.390 -2.50%
465.tonto 136.000 -
465.tonto (avg) 136.000 -
465.tonto (avg) (percentage) 1.240 -
465.tonto (max) 194.000 67.24%
465.tonto (max) (percentage) 1.770 70.19%
465.tonto (unexplained diff vs previous) 198.000 -
465.tonto (unexplained diff vs previous) (percentage) 1.800 -
470.lbm 30.000 -3.23%
470.lbm (avg) 30.000 -3.23%
470.lbm (avg) (percentage) 0.800 -1.23%
470.lbm (max) 11.000 -59.26%
470.lbm (max) (percentage) 0.310 -56.94%
470.lbm (unexplained diff vs previous) 9.000 -30.77%
470.lbm (unexplained diff vs previous) (percentage) 0.230 -32.35%
471.omnetpp 55.000 -1.79%
471.omnetpp (avg) 55.000 -1.79%
471.omnetpp (avg) (percentage) 2.040 -
471.omnetpp (max) 71.000 -11.25%
471.omnetpp (max) (percentage) 2.600 -10.96%
471.omnetpp (unexplained diff vs previous) 13.000 -63.89%
471.omnetpp (unexplained diff vs previous) (percentage) 0.470 -64.12%
473.astar 79.000 -
473.astar (avg) 79.000 -
473.astar (avg) (percentage) 1.550 -
473.astar (max) 50.000 -16.67%
473.astar (max) (percentage) 0.980 -16.95%
473.astar (unexplained diff vs previous) 15.000 -75.41%
473.astar (unexplained diff vs previous) (percentage) 0.290 -75.63%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.800 -
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.690 -
482.sphinx3 (max) 11.000 -8.33%
482.sphinx3 (max) (percentage) 1.380 -4.83%
482.sphinx3 (unexplained diff vs previous) 11.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.290 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 4.783 -11.44%