Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4fa9476ad23d5868c2bc4c02dc1a73acaefbcbc2 (+ 449 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (ccf9db9a6fa4b5bc7aad5e9603e2ac71984142a0) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=aaf94ec804830e0e273cfb45d54f4a04ab778fe5 (+ 105 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/dfc5f6de47b62aa45150d0b9ef1ffda99bb5112a (+ 719 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/388/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0388 (3-changed-components) 2025-03-18T07:42:11 0:00:00
Previous 0375 (3-changed-components) 2025-03-01T06:58:51 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 17 9
Performance Improvements 71 180
Unchanged Tests 1148 1047
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.14% 2017.000 2040.000 - 43.26% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) 975.00% 0.040 0.430 - -99.90% -
434.zeusmp (unexplained diff vs previous) 900.00% 1.000 10.000 - -99.91% -
450.soplex (unexplained diff vs previous) (percentage) 164.71% 1.190 3.150 - -99.88% -
450.soplex (unexplained diff vs previous) 157.14% 7.000 18.000 - -99.88% -
437.leslie3d (unexplained diff vs previous) (percentage) 43.68% 2.770 3.980 - -79.98% -
437.leslie3d (unexplained diff vs previous) 38.10% 315.000 435.000 - -81.20% -
471.omnetpp (unexplained diff vs previous) 25.00% 8.000 10.000 - -99.91% -
471.omnetpp (unexplained diff vs previous) (percentage) 23.33% 0.300 0.370 - -99.91% -
433.milc (unexplained diff vs previous) (percentage) 20.93% 0.430 0.520 - -99.95% -
433.milc (unexplained diff vs previous) 20.00% 5.000 6.000 - -99.95% -
410.bwaves (max) 15.91% 44.000 51.000 - -98.44% -
410.bwaves (max) (percentage) 14.10% 0.780 0.890 - -98.46% -
410.bwaves (unexplained diff vs previous) 13.33% 45.000 51.000 - -99.35% -
410.bwaves (unexplained diff vs previous) (percentage) 11.39% 0.790 0.880 - -99.36% -
462.libquantum (unexplained diff vs previous) (percentage) 2.26% 2.210 2.260 - -99.98% -
447.dealII (unexplained diff vs previous) (percentage) 1.64% 0.610 0.620 - -99.85% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -3.83% 11353.000 10918.000 - -6.20% -
450.soplex -3.06% 589.000 571.000 - 0.71% -
462.libquantum -2.21% 136.000 133.000 - -5.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -89.77% 0.880 0.090 - -99.90% -
465.tonto (max) -89.62% 260.000 27.000 - -98.72% -
465.tonto (max) (percentage) -89.54% 2.390 0.250 - -98.71% -
458.sjeng (unexplained diff vs previous) -89.39% 66.000 7.000 - -99.90% -
429.mcf (max) (percentage) -86.48% 8.730 1.180 - -98.73% -
429.mcf (max) -86.36% 176.000 24.000 - -98.18% -
459.GemsFDTD (max) -83.61% 122.000 20.000 - -99.55% -
459.GemsFDTD (max) (percentage) -83.07% 2.540 0.430 - -99.40% -
465.tonto (unexplained diff vs previous) (percentage) -80.00% 0.300 0.060 - -99.63% -
465.tonto (unexplained diff vs previous) -78.79% 33.000 7.000 - -99.60% -
453.povray (unexplained diff vs previous) (percentage) -66.67% 1.110 0.370 - -99.96% -
453.povray (unexplained diff vs previous) -66.67% 6.000 2.000 - -99.96% -
401.bzip2 (unexplained diff vs previous) -60.00% 15.000 6.000 - -99.94% -
462.libquantum (max) -60.00% 5.000 2.000 - -98.55% -
401.bzip2 (unexplained diff vs previous) (percentage) -59.18% 0.490 0.200 - -99.95% -
462.libquantum (max) (percentage) -49.20% 4.350 2.210 - -97.77% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -48.08% 0.520 0.270 - -99.89% -
459.GemsFDTD (unexplained diff vs previous) -48.00% 25.000 13.000 - -99.92% -
435.gromacs (unexplained diff vs previous) (percentage) -47.83% 1.610 0.840 - -99.13% -
445.gobmk (max) (percentage) -47.69% 1.300 0.680 - -98.71% -
445.gobmk (max) -47.62% 63.000 33.000 - -98.75% -
435.gromacs (unexplained diff vs previous) -47.37% 114.000 60.000 - -99.15% -
445.gobmk (unexplained diff vs previous) -33.33% 3.000 2.000 - -99.96% -
445.gobmk (unexplained diff vs previous) (percentage) -33.33% 0.060 0.040 - -99.96% -
444.namd (unexplained diff vs previous) (percentage) -25.45% 0.550 0.410 - -99.96% -
473.astar (unexplained diff vs previous) (percentage) -25.00% 0.160 0.120 - -99.94% -
444.namd (unexplained diff vs previous) -25.00% 4.000 3.000 - -99.96% -
473.astar (unexplained diff vs previous) -25.00% 8.000 6.000 - -99.94% -
482.sphinx3 (unexplained diff vs previous) -25.00% 8.000 6.000 - -99.98% -
482.sphinx3 (unexplained diff vs previous) (percentage) -24.47% 0.940 0.710 - -99.97% -
482.sphinx3 (max) -24.00% 25.000 19.000 - -97.91% -
429.mcf (unexplained diff vs previous) (percentage) -21.53% 1.440 1.130 - -99.91% -
429.mcf (unexplained diff vs previous) -20.69% 29.000 23.000 - -99.88% -
482.sphinx3 (max) (percentage) -20.00% 2.950 2.360 - -97.55% -
435.gromacs (max) (percentage) -18.08% 1.770 1.450 - -97.05% -
435.gromacs (max) -17.60% 125.000 103.000 - -97.12% -
437.leslie3d (max) -14.34% 488.000 418.000 - -78.33% -
470.lbm (unexplained diff vs previous) (percentage) -13.33% 0.450 0.390 - -99.85% -
470.lbm (unexplained diff vs previous) -11.76% 17.000 15.000 - -99.85% -
437.leslie3d (max) (percentage) -10.93% 4.300 3.830 - -76.90% -
458.sjeng (max) (percentage) -10.53% 0.950 0.850 - -98.21% -
458.sjeng (max) -10.00% 70.000 63.000 - -98.25% -
444.namd (max) (percentage) -8.49% 1.060 0.970 - -98.94% -
450.soplex (max) -7.69% 26.000 24.000 - -95.60% -
453.povray (max) -7.69% 13.000 12.000 - -97.60% -
447.dealII (max) -7.14% 14.000 13.000 - -99.06% -
453.povray (max) (percentage) -6.25% 2.400 2.250 - -97.53% -
471.omnetpp (max) (percentage) -5.88% 2.210 2.080 - -97.39% -
471.omnetpp (max) -5.08% 59.000 56.000 - -97.42% -
401.bzip2 (max) -5.00% 140.000 133.000 - -94.25% -
473.astar (max) -4.88% 205.000 195.000 - -94.27% -
401.bzip2 (max) (percentage) -4.78% 4.600 4.380 - -94.43% -
473.astar (max) (percentage) -4.77% 3.980 3.790 - -94.29% -
450.soplex (max) (percentage) -4.75% 4.420 4.210 - -95.63% -
447.dealII (max) (percentage) -4.60% 0.870 0.830 - -98.97% -
433.milc (max) -4.08% 49.000 47.000 - -95.50% -
437.leslie3d -4.01% 474.000 455.000 - 28.17% -
437.leslie3d (avg) -4.01% 474.000 455.000 - 28.17% -
433.milc (max) (percentage) -3.73% 4.290 4.130 - -95.45% -
445.gobmk -2.38% 42.000 41.000 - -79.08% -
445.gobmk (avg) -2.38% 42.000 41.000 - -79.08% -
465.tonto (avg) (percentage) -1.63% 1.230 1.210 - -63.77% -
465.tonto -1.50% 133.000 131.000 - -64.11% -
465.tonto (avg) -1.50% 133.000 131.000 - -64.11% -
445.gobmk (avg) (percentage) -1.16% 0.860 0.850 - -78.26% -
473.astar -1.16% 86.000 85.000 - -60.09% -
473.astar (avg) -1.16% 86.000 85.000 - -60.09% -
434.zeusmp (avg) (percentage) -1.15% 0.870 0.860 - -85.30% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.40% 16760.000 17832.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 43.26% 1424.000 2040.000 - 1.14% -
401.bzip2 3.47% 2941.000 3043.000 - -0.20% -
410.bwaves 2.11% 5652.000 5771.000 - 0.89% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 36.72% 3.050 4.170 - -0.24% -
437.leslie3d 28.17% 355.000 455.000 - -4.01% -
437.leslie3d (avg) 28.17% 355.000 455.000 - -4.01% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.69% 59479.000 54310.000 - 0.00% -
459.GemsFDTD -4.85% 244728.000 232852.000 - 0.00% -
447.dealII -2.16% 311591.000 304874.000 - 0.00% -
462.libquantum -1.89% 16085.000 15781.000 - 0.00% -
434.zeusmp -1.82% 152037.000 149263.000 - 0.00% -
435.gromacs -1.76% 499261.000 490450.000 - 0.00% -
433.milc -1.53% 61382.000 60440.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
453.povray -1.26% 661389.000 653088.000 - 0.00% -
444.namd -1.24% 188385.000 186052.000 - 0.00% -
401.bzip2 -1.13% 44233.000 43735.000 - 0.00% -
473.astar -1.04% 22968.000 22728.000 - 0.00% -
482.sphinx3 -1.03% 112859.000 111702.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.82% 6173.000 4826.000 - -0.27% -
482.sphinx3 -10.79% 945.000 843.000 - -0.71% -
434.zeusmp -6.96% 2514.000 2339.000 - -0.43% -
437.leslie3d -6.20% 11640.000 10918.000 - -3.83% -
447.dealII -5.97% 1724.000 1621.000 - -0.61% -
462.libquantum -5.00% 140.000 133.000 - -2.21% -
445.gobmk -2.59% 5023.000 4893.000 - -0.04% -
444.namd -1.74% 747.000 734.000 - 0.41% -
435.gromacs -1.51% 7269.000 7159.000 - 0.85% -
453.povray -1.28% 547.000 540.000 - -0.37% -
458.sjeng -1.18% 7567.000 7478.000 - 0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 6.000 - -25.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.260 - 2.26% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.710 - -24.47% -
453.povray (unexplained diff vs previous) -99.96% 5707.000 2.000 - -66.67% -
453.povray (unexplained diff vs previous) (percentage) -99.96% 1043.330 0.370 - -66.67% -
445.gobmk (unexplained diff vs previous) -99.96% 5581.000 2.000 - -33.33% -
444.namd (unexplained diff vs previous) -99.96% 8356.000 3.000 - -25.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.96% 111.110 0.040 - -33.33% -
444.namd (unexplained diff vs previous) (percentage) -99.96% 1118.610 0.410 - -25.45% -
433.milc (unexplained diff vs previous) (percentage) -99.95% 980.800 0.520 - 20.93% -
433.milc (unexplained diff vs previous) -99.95% 11289.000 6.000 - 20.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.95% 368.340 0.200 - -59.18% -
401.bzip2 (unexplained diff vs previous) -99.94% 10833.000 6.000 - -60.00% -
473.astar (unexplained diff vs previous) -99.94% 10146.000 6.000 - -25.00% -
473.astar (unexplained diff vs previous) (percentage) -99.94% 197.850 0.120 - -25.00% -
459.GemsFDTD (unexplained diff vs previous) -99.92% 15458.000 13.000 - -48.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.91% 1305.690 1.130 - -21.53% -
434.zeusmp (unexplained diff vs previous) -99.91% 11280.000 10.000 - 900.00% -
471.omnetpp (unexplained diff vs previous) -99.91% 10659.000 10.000 - 25.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.91% 391.300 0.370 - 23.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.90% 448.690 0.430 - 975.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.90% 90.870 0.090 - -89.77% -
458.sjeng (unexplained diff vs previous) -99.90% 6876.000 7.000 - -89.39% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.89% 250.410 0.270 - -48.08% -
450.soplex (unexplained diff vs previous) (percentage) -99.88% 2557.320 3.150 - 164.71% -
429.mcf (unexplained diff vs previous) -99.88% 18593.000 23.000 - -20.69% -
450.soplex (unexplained diff vs previous) -99.88% 14500.000 18.000 - 157.14% -
447.dealII (unexplained diff vs previous) -99.86% 7017.000 10.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.85% 263.730 0.390 - -13.33% -
470.lbm (unexplained diff vs previous) -99.85% 9990.000 15.000 - -11.76% -
447.dealII (unexplained diff vs previous) (percentage) -99.85% 407.020 0.620 - 1.64% -
465.tonto (unexplained diff vs previous) (percentage) -99.63% 16.190 0.060 - -80.00% -
465.tonto (unexplained diff vs previous) -99.60% 1771.000 7.000 - -78.79% -
459.GemsFDTD (max) -99.55% 4411.000 20.000 - -83.61% -
456.hmmer (max) (percentage) -99.54% 73.590 0.340 - 0.00% -
459.GemsFDTD (max) (percentage) -99.40% 71.460 0.430 - -83.07% -
410.bwaves (unexplained diff vs previous) (percentage) -99.36% 137.900 0.880 - 11.39% -
410.bwaves (unexplained diff vs previous) -99.35% 7794.000 51.000 - 13.33% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
435.gromacs (unexplained diff vs previous) -99.15% 7028.000 60.000 - -47.37% -
435.gromacs (unexplained diff vs previous) (percentage) -99.13% 96.680 0.840 - -47.83% -
434.zeusmp (max) -99.08% 2055.000 19.000 - 0.00% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
447.dealII (max) -99.06% 1384.000 13.000 - -7.14% -
436.cactusADM (max) (percentage) -99.03% 88.730 0.860 - 0.00% -
444.namd (max) -98.98% 685.000 7.000 - 0.00% -
434.zeusmp (max) (percentage) -98.97% 81.770 0.840 - 0.00% -
447.dealII (max) (percentage) -98.97% 80.280 0.830 - -4.60% -
444.namd (max) (percentage) -98.94% 91.790 0.970 - -8.49% -
481.wrf (max) (percentage) -98.86% 68.700 0.780 - 0.00% -
445.gobmk (max) -98.75% 2643.000 33.000 - -47.62% -
429.mcf (max) (percentage) -98.73% 92.890 1.180 - -86.48% -
465.tonto (max) -98.72% 2112.000 27.000 - -89.62% -
445.gobmk (max) (percentage) -98.71% 52.630 0.680 - -47.69% -
465.tonto (max) (percentage) -98.71% 19.310 0.250 - -89.54% -
462.libquantum (max) -98.55% 138.000 2.000 - -60.00% -
470.lbm (max) (percentage) -98.51% 72.510 1.080 - 0.00% -
470.lbm (max) -98.51% 2746.000 41.000 - 0.00% -
410.bwaves (max) (percentage) -98.46% 57.970 0.890 - 14.10% -
410.bwaves (max) -98.44% 3276.000 51.000 - 15.91% -
458.sjeng (max) -98.25% 3602.000 63.000 - -10.00% -
458.sjeng (max) (percentage) -98.21% 47.610 0.850 - -10.53% -
429.mcf (max) -98.18% 1322.000 24.000 - -86.36% -
482.sphinx3 (max) -97.91% 911.000 19.000 - -24.00% -
462.libquantum (max) (percentage) -97.77% 98.970 2.210 - -49.20% -
453.povray (max) -97.60% 499.000 12.000 - -7.69% -
482.sphinx3 (max) (percentage) -97.55% 96.500 2.360 - -20.00% -
400.perlbench (max) (percentage) -97.54% 84.060 2.070 - -0.48% -
453.povray (max) (percentage) -97.53% 91.250 2.250 - -6.25% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
471.omnetpp (max) -97.42% 2169.000 56.000 - -5.08% -
471.omnetpp (max) (percentage) -97.39% 79.650 2.080 - -5.88% -
435.gromacs (max) -97.12% 3573.000 103.000 - -17.60% -
435.gromacs (max) (percentage) -97.05% 49.160 1.450 - -18.08% -
403.gcc (max) (percentage) -96.29% 99.360 3.690 - 0.00% -
450.soplex (max) (percentage) -95.63% 96.240 4.210 - -4.75% -
450.soplex (max) -95.60% 545.000 24.000 - -7.69% -
433.milc (max) -95.50% 1044.000 47.000 - -4.08% -
433.milc (max) (percentage) -95.45% 90.750 4.130 - -3.73% -
401.bzip2 (max) (percentage) -94.43% 78.650 4.380 - -4.78% -
473.astar (max) (percentage) -94.29% 66.430 3.790 - -4.77% -
473.astar (max) -94.27% 3406.000 195.000 - -4.88% -
401.bzip2 (max) -94.25% 2313.000 133.000 - -5.00% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.53% 9.220 1.150 - 0.00% -
470.lbm (avg) (percentage) -87.05% 6.330 0.820 - 0.00% -
470.lbm -87.03% 239.000 31.000 - 0.00% -
470.lbm (avg) -87.03% 239.000 31.000 - 0.00% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.30% 5.850 0.860 - -1.15% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
459.GemsFDTD -82.78% 360.000 62.000 - 0.00% -
459.GemsFDTD (avg) -82.78% 360.000 62.000 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
458.sjeng -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 0.00% -
437.leslie3d (unexplained diff vs previous) -81.20% 2314.000 435.000 - 38.10% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 0.00% -
410.bwaves -81.12% 249.000 47.000 - 0.00% -
410.bwaves (avg) -81.12% 249.000 47.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.59% 5.770 1.120 - -0.88% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -79.98% 19.880 3.980 - 43.68% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - -0.61% -
445.gobmk -79.08% 196.000 41.000 - -2.38% -
445.gobmk (avg) -79.08% 196.000 41.000 - -2.38% -
437.leslie3d (max) -78.33% 1929.000 418.000 - -14.34% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
445.gobmk (avg) (percentage) -78.26% 3.910 0.850 - -1.16% -
433.milc (avg) (percentage) -78.18% 6.050 1.320 - -0.75% -
459.GemsFDTD (avg) (percentage) -77.91% 5.840 1.290 - -0.77% -
482.sphinx3 (avg) (percentage) -77.30% 7.930 1.800 - -0.55% -
437.leslie3d (max) (percentage) -76.90% 16.580 3.830 - -10.93% -
471.omnetpp -74.89% 223.000 56.000 - 0.00% -
471.omnetpp (avg) -74.89% 223.000 56.000 - 0.00% -
471.omnetpp (avg) (percentage) -74.76% 8.200 2.070 - -0.48% -
462.libquantum (avg) (percentage) -74.54% 7.660 1.950 - 0.52% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.89% 5.480 1.650 - -0.60% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
435.gromacs -68.66% 367.000 115.000 - 0.00% -
435.gromacs (avg) -68.66% 367.000 115.000 - 0.00% -
435.gromacs (avg) (percentage) -68.18% 5.060 1.610 - -0.62% -
465.tonto -64.11% 365.000 131.000 - -1.50% -
465.tonto (avg) -64.11% 365.000 131.000 - -1.50% -
465.tonto (avg) (percentage) -63.77% 3.340 1.210 - -1.63% -
450.soplex -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) -61.11% 36.000 14.000 - 0.00% -
450.soplex (avg) (percentage) -60.81% 6.430 2.520 - 0.40% -
473.astar (avg) (percentage) -60.10% 4.160 1.660 - -0.60% -
473.astar -60.09% 213.000 85.000 - -1.16% -
473.astar (avg) -60.09% 213.000 85.000 - -1.16% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -41.46% 7.670 4.490 - -0.66% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -16.51% 109.000 91.000 - 0.00% -
429.mcf (avg) -16.51% 109.000 91.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 3043.000 -
410.bwaves 5771.000 -
429.mcf 2040.000 1.14%
433.milc 1161.000 -
434.zeusmp 2339.000 -
435.gromacs 7159.000 -
437.leslie3d 10918.000 -3.83%
444.namd 734.000 -
445.gobmk 4893.000 -
447.dealII 1621.000 -
450.soplex 571.000 -3.06%
453.povray 540.000 -
458.sjeng 7478.000 -
459.GemsFDTD 4826.000 -
462.libquantum 133.000 -2.21%
465.tonto 10892.000 -
470.lbm 3800.000 -
471.omnetpp 2721.000 -
473.astar 5163.000 -
482.sphinx3 843.000 -
Geometric Mean 2373.203 -
Code Size (bytes)
Name Current %
401.bzip2 43735.000 -
410.bwaves 17832.000 -
429.mcf 9086.000 -
433.milc 60440.000 -
434.zeusmp 149263.000 -
435.gromacs 490450.000 -
437.leslie3d 54310.000 -
444.namd 186052.000 -
445.gobmk 1374806.000 -
447.dealII 304874.000 -
450.soplex 203251.000 -
453.povray 653088.000 -
458.sjeng 103327.000 -
459.GemsFDTD 232852.000 -
462.libquantum 15781.000 -
465.tonto 1964847.000 -
470.lbm 9547.000 -
471.omnetpp 475129.000 -
473.astar 22728.000 -
482.sphinx3 111702.000 -
Geometric Mean 114554.081 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.070 -
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.650 -
401.bzip2 (max) 133.000 -5.00%
401.bzip2 (max) (percentage) 4.380 -4.78%
401.bzip2 (unexplained diff vs previous) 6.000 -60.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.200 -59.18%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.690 -
410.bwaves 47.000 -
410.bwaves (avg) 47.000 -
410.bwaves (avg) (percentage) 0.830 -
410.bwaves (max) 51.000 15.91%
410.bwaves (max) (percentage) 0.890 14.10%
410.bwaves (unexplained diff vs previous) 51.000 13.33%
410.bwaves (unexplained diff vs previous) (percentage) 0.880 11.39%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 91.000 -
429.mcf (avg) 91.000 -
429.mcf (avg) (percentage) 4.490 -
429.mcf (max) 24.000 -86.36%
429.mcf (max) (percentage) 1.180 -86.48%
429.mcf (unexplained diff vs previous) 23.000 -20.69%
429.mcf (unexplained diff vs previous) (percentage) 1.130 -21.53%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.320 -
433.milc (max) 47.000 -4.08%
433.milc (max) (percentage) 4.130 -3.73%
433.milc (unexplained diff vs previous) 6.000 20.00%
433.milc (unexplained diff vs previous) (percentage) 0.520 20.93%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.860 -1.15%
434.zeusmp (max) 19.000 -
434.zeusmp (max) (percentage) 0.840 -
434.zeusmp (unexplained diff vs previous) 10.000 900.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.430 975.00%
435.gromacs 115.000 -
435.gromacs (avg) 115.000 -
435.gromacs (avg) (percentage) 1.610 -
435.gromacs (max) 103.000 -17.60%
435.gromacs (max) (percentage) 1.450 -18.08%
435.gromacs (unexplained diff vs previous) 60.000 -47.37%
435.gromacs (unexplained diff vs previous) (percentage) 0.840 -47.83%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.860 -
437.leslie3d 455.000 -4.01%
437.leslie3d (avg) 455.000 -4.01%
437.leslie3d (avg) (percentage) 4.170 -
437.leslie3d (max) 418.000 -14.34%
437.leslie3d (max) (percentage) 3.830 -10.93%
437.leslie3d (unexplained diff vs previous) 435.000 38.10%
437.leslie3d (unexplained diff vs previous) (percentage) 3.980 43.68%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.150 -
444.namd (max) 7.000 -
444.namd (max) (percentage) 0.970 -8.49%
444.namd (unexplained diff vs previous) 3.000 -25.00%
444.namd (unexplained diff vs previous) (percentage) 0.410 -25.45%
445.gobmk 41.000 -2.38%
445.gobmk (avg) 41.000 -2.38%
445.gobmk (avg) (percentage) 0.850 -1.16%
445.gobmk (max) 33.000 -47.62%
445.gobmk (max) (percentage) 0.680 -47.69%
445.gobmk (unexplained diff vs previous) 2.000 -33.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.040 -33.33%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.120 -
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 0.830 -4.60%
447.dealII (unexplained diff vs previous) 10.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.620 1.64%
450.soplex 14.000 -
450.soplex (avg) 14.000 -
450.soplex (avg) (percentage) 2.520 -
450.soplex (max) 24.000 -7.69%
450.soplex (max) (percentage) 4.210 -4.75%
450.soplex (unexplained diff vs previous) 18.000 157.14%
450.soplex (unexplained diff vs previous) (percentage) 3.150 164.71%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 -
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 2.250 -6.25%
453.povray (unexplained diff vs previous) 2.000 -66.67%
453.povray (unexplained diff vs previous) (percentage) 0.370 -66.67%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.340 -
458.sjeng 44.000 -
458.sjeng (avg) 44.000 -
458.sjeng (avg) (percentage) 0.590 -
458.sjeng (max) 63.000 -10.00%
458.sjeng (max) (percentage) 0.850 -10.53%
458.sjeng (unexplained diff vs previous) 7.000 -89.39%
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -89.77%
459.GemsFDTD 62.000 -
459.GemsFDTD (avg) 62.000 -
459.GemsFDTD (avg) (percentage) 1.290 -
459.GemsFDTD (max) 20.000 -83.61%
459.GemsFDTD (max) (percentage) 0.430 -83.07%
459.GemsFDTD (unexplained diff vs previous) 13.000 -48.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.270 -48.08%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.950 -
462.libquantum (max) 2.000 -60.00%
462.libquantum (max) (percentage) 2.210 -49.20%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.260 2.26%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 131.000 -1.50%
465.tonto (avg) 131.000 -1.50%
465.tonto (avg) (percentage) 1.210 -1.63%
465.tonto (max) 27.000 -89.62%
465.tonto (max) (percentage) 0.250 -89.54%
465.tonto (unexplained diff vs previous) 7.000 -78.79%
465.tonto (unexplained diff vs previous) (percentage) 0.060 -80.00%
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 0.820 -
470.lbm (max) 41.000 -
470.lbm (max) (percentage) 1.080 -
470.lbm (unexplained diff vs previous) 15.000 -11.76%
470.lbm (unexplained diff vs previous) (percentage) 0.390 -13.33%
471.omnetpp 56.000 -
471.omnetpp (avg) 56.000 -
471.omnetpp (avg) (percentage) 2.070 -
471.omnetpp (max) 56.000 -5.08%
471.omnetpp (max) (percentage) 2.080 -5.88%
471.omnetpp (unexplained diff vs previous) 10.000 25.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.370 23.33%
473.astar 85.000 -1.16%
473.astar (avg) 85.000 -1.16%
473.astar (avg) (percentage) 1.660 -
473.astar (max) 195.000 -4.88%
473.astar (max) (percentage) 3.790 -4.77%
473.astar (unexplained diff vs previous) 6.000 -25.00%
473.astar (unexplained diff vs previous) (percentage) 0.120 -25.00%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.800 -
482.sphinx3 (max) 19.000 -24.00%
482.sphinx3 (max) (percentage) 2.360 -20.00%
482.sphinx3 (unexplained diff vs previous) 6.000 -25.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.710 -24.47%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.165 -15.42%