Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=829b08e405a4da9f28e2ce9c386a607b6960037b (+ 36 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (b2c8d3064764f1f4bfd41d8791d06f2206b42780) (+ 111 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=af90dc572ad232d05b667c4ce218d499f066b7bc (+ 16 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (+ 781 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/419/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0419 (4-changed-components) 2025-05-27T16:21:19 0:00:00
Previous 0418 (3-changed-components) 2025-05-23T00:53:24 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 115 11
Performance Improvements 9 179
Added Tests 2 0
Unchanged Tests 1110 1046
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 11.95% 1824.000 2042.000 - 43.40% -
401.bzip2 6.01% 2911.000 3086.000 - 4.93% -
450.soplex 5.67% 547.000 578.000 - 1.94% -
437.leslie3d 5.42% 10811.000 11397.000 - -2.09% -
471.omnetpp 5.27% 2621.000 2759.000 - 1.28% -
482.sphinx3 4.75% 800.000 838.000 - -11.32% -
473.astar 4.28% 4952.000 5164.000 - 0.70% -
462.libquantum 3.88% 129.000 134.000 - -4.29% -
465.tonto 3.02% 10552.000 10871.000 - -0.64% -
459.GemsFDTD 2.68% 4703.000 4829.000 - -21.77% -
435.gromacs 2.67% 7039.000 7227.000 - -0.58% -
433.milc 2.32% 1123.000 1149.000 - -0.17% -
410.bwaves 1.77% 5655.000 5755.000 - 1.82% -
444.namd 1.67% 719.000 731.000 - -2.14% -
453.povray 1.50% 533.000 541.000 - -1.10% -
434.zeusmp 1.34% 2309.000 2340.000 - -6.92% -
445.gobmk 1.28% 4758.000 4819.000 - -4.06% -
458.sjeng 1.22% 7359.000 7449.000 - -1.56% -
470.lbm 1.01% 3762.000 3800.000 - 0.32% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) 10500.00% 2.000 212.000 - -97.91% -
473.astar (unexplained diff vs previous) (percentage) 10175.00% 0.040 4.110 - -97.92% -
401.bzip2 (unexplained diff vs previous) 5733.33% 3.000 175.000 - -98.38% -
401.bzip2 (unexplained diff vs previous) (percentage) 5570.00% 0.100 5.670 - -98.46% -
410.bwaves (unexplained diff vs previous) 4900.00% 2.000 100.000 - -98.72% -
410.bwaves (unexplained diff vs previous) (percentage) 4250.00% 0.040 1.740 - -98.74% -
450.soplex (unexplained diff vs previous) 3000.00% 1.000 31.000 - -99.79% -
450.soplex (unexplained diff vs previous) (percentage) 2877.78% 0.180 5.360 - -99.79% -
470.lbm (unexplained diff vs previous) (percentage) 1900.00% 0.050 1.000 - -99.62% -
470.lbm (unexplained diff vs previous) 1800.00% 2.000 38.000 - -99.62% -
429.mcf (unexplained diff vs previous) 1576.92% 13.000 218.000 - -98.83% -
429.mcf (unexplained diff vs previous) (percentage) 1404.23% 0.710 10.680 - -99.18% -
434.zeusmp (unexplained diff vs previous) 933.33% 3.000 31.000 - -99.73% -
434.zeusmp (unexplained diff vs previous) (percentage) 915.38% 0.130 1.320 - -99.71% -
471.omnetpp (unexplained diff vs previous) 820.00% 15.000 138.000 - -98.71% -
471.omnetpp (unexplained diff vs previous) (percentage) 777.19% 0.570 5.000 - -98.72% -
465.tonto (unexplained diff vs previous) 641.86% 43.000 319.000 - -81.99% -
465.tonto (unexplained diff vs previous) (percentage) 614.63% 0.410 2.930 - -81.90% -
459.GemsFDTD (unexplained diff vs previous) 600.00% 18.000 126.000 - -99.18% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 586.84% 0.380 2.610 - -98.96% -
445.gobmk (unexplained diff vs previous) 577.78% 9.000 61.000 - -98.91% -
445.gobmk (unexplained diff vs previous) (percentage) 568.42% 0.190 1.270 - -98.86% -
433.milc (max) 550.00% 4.000 26.000 - -97.51% -
433.milc (max) (percentage) 510.53% 0.380 2.320 - -97.44% -
435.gromacs (unexplained diff vs previous) 422.22% 36.000 188.000 - -97.32% -
435.gromacs (unexplained diff vs previous) (percentage) 409.80% 0.510 2.600 - -97.31% -
482.sphinx3 (unexplained diff vs previous) 280.00% 10.000 38.000 - -99.85% -
482.sphinx3 (unexplained diff vs previous) (percentage) 262.40% 1.250 4.530 - -99.84% -
471.omnetpp (max) 222.22% 45.000 145.000 - -93.31% -
471.omnetpp (max) (percentage) 206.40% 1.720 5.270 - -93.38% -
444.namd (unexplained diff vs previous) 200.00% 4.000 12.000 - -99.86% -
444.namd (unexplained diff vs previous) (percentage) 192.86% 0.560 1.640 - -99.85% -
458.sjeng (unexplained diff vs previous) 150.00% 36.000 90.000 - -98.69% -
458.sjeng (unexplained diff vs previous) (percentage) 146.94% 0.490 1.210 - -98.67% -
482.sphinx3 (max) 129.41% 17.000 39.000 - -95.72% -
482.sphinx3 (max) (percentage) 121.96% 2.140 4.750 - -95.08% -
437.leslie3d (unexplained diff vs previous) 114.65% 273.000 586.000 - -74.68% -
437.leslie3d (unexplained diff vs previous) (percentage) 103.16% 2.530 5.140 - -74.14% -
429.mcf (max) 59.48% 153.000 244.000 - -81.54% -
410.bwaves (max) 48.53% 68.000 101.000 - -96.92% -
410.bwaves (max) (percentage) 46.28% 1.210 1.770 - -96.95% -
429.mcf (max) (percentage) 42.09% 8.410 11.950 - -87.14% -
473.astar (max) 37.27% 161.000 221.000 - -93.51% -
458.sjeng (max) 36.36% 66.000 90.000 - -97.50% -
458.sjeng (max) (percentage) 35.56% 0.900 1.220 - -97.44% -
444.namd (max) 33.33% 9.000 12.000 - -98.25% -
473.astar (max) (percentage) 30.89% 3.270 4.280 - -93.56% -
465.tonto (max) 30.68% 251.000 328.000 - -84.47% -
401.bzip2 (max) 27.59% 145.000 185.000 - -92.00% -
465.tonto (max) (percentage) 26.89% 2.380 3.020 - -84.36% -
462.libquantum (max) 25.00% 4.000 5.000 - -96.38% -
445.gobmk (max) 24.49% 49.000 61.000 - -97.69% -
445.gobmk (max) (percentage) 24.27% 1.030 1.280 - -97.57% -
444.namd (max) (percentage) 22.79% 1.360 1.670 - -98.18% -
401.bzip2 (max) (percentage) 20.20% 5.000 6.010 - -92.36% -
434.zeusmp (max) 14.81% 27.000 31.000 - -98.49% -
429.mcf 14.10% 78.000 89.000 - -18.35% -
429.mcf (avg) 14.10% 78.000 89.000 - -18.35% -
434.zeusmp (max) (percentage) 11.67% 1.200 1.340 - -98.36% -
450.soplex (max) 10.34% 29.000 32.000 - -94.13% -
401.bzip2 8.51% 47.000 51.000 - -68.32% -
401.bzip2 (avg) 8.51% 47.000 51.000 - -68.32% -
450.soplex 7.69% 13.000 14.000 - -61.11% -
450.soplex (avg) 7.69% 13.000 14.000 - -61.11% -
482.sphinx3 7.14% 14.000 15.000 - -79.73% -
482.sphinx3 (avg) 7.14% 14.000 15.000 - -79.73% -
437.leslie3d 5.76% 451.000 477.000 - 34.37% -
437.leslie3d (avg) 5.76% 451.000 477.000 - 34.37% -
465.tonto 5.74% 122.000 129.000 - -64.66% -
465.tonto (avg) 5.74% 122.000 129.000 - -64.66% -
434.zeusmp 5.56% 18.000 19.000 - -87.07% -
434.zeusmp (avg) 5.56% 18.000 19.000 - -87.07% -
471.omnetpp 5.56% 54.000 57.000 - -74.44% -
471.omnetpp (avg) 5.56% 54.000 57.000 - -74.44% -
473.astar 5.00% 80.000 84.000 - -60.56% -
473.astar (avg) 5.00% 80.000 84.000 - -60.56% -
450.soplex (max) (percentage) 4.61% 5.420 5.670 - -94.11% -
410.bwaves 4.35% 46.000 48.000 - -80.72% -
410.bwaves (avg) 4.35% 46.000 48.000 - -80.72% -
462.libquantum (max) (percentage) 4.02% 3.730 3.880 - -96.08% -
435.gromacs 3.64% 110.000 114.000 - -68.94% -
435.gromacs (avg) 3.64% 110.000 114.000 - -68.94% -
459.GemsFDTD 3.39% 59.000 61.000 - -83.06% -
459.GemsFDTD (avg) 3.39% 59.000 61.000 - -83.06% -
437.leslie3d (max) 2.65% 756.000 776.000 - -59.77% -
465.tonto (avg) (percentage) 2.59% 1.160 1.190 - -64.37% -
401.bzip2 (avg) (percentage) 2.45% 1.630 1.670 - -69.53% -
458.sjeng 2.38% 42.000 43.000 - -82.16% -
458.sjeng (avg) 2.38% 42.000 43.000 - -82.16% -
458.sjeng (avg) (percentage) 1.72% 0.580 0.590 - -81.50% -
482.sphinx3 (avg) (percentage) 1.69% 1.770 1.800 - -77.30% -
429.mcf (avg) (percentage) 1.39% 4.310 4.370 - -43.02% -
473.astar (avg) (percentage) 1.23% 1.620 1.640 - -60.58% -
445.gobmk (avg) (percentage) 1.22% 0.820 0.830 - -78.77% -
450.soplex (avg) (percentage) 1.21% 2.480 2.510 - -60.96% -
410.bwaves (avg) (percentage) 1.20% 0.830 0.840 - -80.95% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (max) -6.67% 15.000 14.000 - -97.19% -
453.povray (max) (percentage) -6.14% 2.930 2.750 - -96.99% -
462.libquantum (unexplained diff vs previous) (percentage) -3.87% 3.880 3.730 - -99.96% -
470.lbm (max) (percentage) -3.79% 1.320 1.270 - -98.25% -
447.dealII (max) (percentage) -3.21% 1.560 1.510 - -98.12% -
459.GemsFDTD (max) (percentage) -3.02% 2.980 2.890 - -95.96% -
435.gromacs (max) (percentage) -2.77% 3.970 3.860 - -92.15% -
437.leslie3d (max) (percentage) -2.71% 7.000 6.810 - -58.93% -
470.lbm (max) -2.04% 49.000 48.000 - -98.25% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.47% 16760.000 17844.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 43.40% 1424.000 2042.000 - 11.95% -
401.bzip2 4.93% 2941.000 3086.000 - 6.01% -
450.soplex 1.94% 567.000 578.000 - 5.67% -
410.bwaves 1.82% 5652.000 5755.000 - 1.77% -
471.omnetpp 1.28% 2724.000 2759.000 - 5.27% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 37.38% 3.050 4.190 - 0.24% -
437.leslie3d 34.37% 355.000 477.000 - 5.76% -
437.leslie3d (avg) 34.37% 355.000 477.000 - 5.76% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.57% 59479.000 54382.000 - 0.00% -
459.GemsFDTD -5.11% 244728.000 232214.000 - 0.00% -
444.namd -3.60% 188385.000 181608.000 - 0.00% -
447.dealII -2.64% 311591.000 303380.000 - 0.00% -
453.povray -2.09% 661389.000 647580.000 - 0.00% -
462.libquantum -1.89% 16085.000 15781.000 - 0.00% -
435.gromacs -1.88% 499261.000 489850.000 - 0.00% -
434.zeusmp -1.81% 152037.000 149287.000 - 0.00% -
470.lbm -1.73% 9691.000 9523.000 - 0.00% -
433.milc -1.70% 61382.000 60340.000 - 0.00% -
473.astar -1.38% 22968.000 22652.000 - 0.00% -
482.sphinx3 -1.31% 112859.000 111386.000 - 0.00% -
471.omnetpp -1.26% 478024.000 471988.000 - 0.00% -
450.soplex -1.23% 205081.000 202556.000 - 0.00% -
401.bzip2 -1.20% 44233.000 43703.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.77% 6173.000 4829.000 - 2.68% -
482.sphinx3 -11.32% 945.000 838.000 - 4.75% -
434.zeusmp -6.92% 2514.000 2340.000 - 1.34% -
447.dealII -6.67% 1724.000 1609.000 - 0.81% -
462.libquantum -4.29% 140.000 134.000 - 3.88% -
445.gobmk -4.06% 5023.000 4819.000 - 1.28% -
444.namd -2.14% 747.000 731.000 - 1.67% -
437.leslie3d -2.09% 11640.000 11397.000 - 5.42% -
458.sjeng -1.56% 7567.000 7449.000 - 1.22% -
453.povray -1.10% 547.000 541.000 - 1.50% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.96% 9655.710 3.730 - -3.87% -
453.povray (unexplained diff vs previous) -99.86% 5707.000 8.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.86% 1043.330 1.480 - 0.00% -
444.namd (unexplained diff vs previous) -99.86% 8356.000 12.000 - 200.00% -
482.sphinx3 (unexplained diff vs previous) -99.85% 26073.000 38.000 - 280.00% -
444.namd (unexplained diff vs previous) (percentage) -99.85% 1118.610 1.640 - 192.86% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.84% 2759.050 4.530 - 262.40% -
450.soplex (unexplained diff vs previous) (percentage) -99.79% 2557.320 5.360 - 2877.78% -
450.soplex (unexplained diff vs previous) -99.79% 14500.000 31.000 - 3000.00% -
433.milc (unexplained diff vs previous) -99.77% 11289.000 26.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.77% 980.800 2.260 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.73% 11280.000 31.000 - 933.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.71% 448.690 1.320 - 915.38% -
470.lbm (unexplained diff vs previous) (percentage) -99.62% 263.730 1.000 - 1900.00% -
470.lbm (unexplained diff vs previous) -99.62% 9990.000 38.000 - 1800.00% -
456.hmmer (max) (percentage) -99.57% 73.590 0.320 - 0.00% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
454.calculix (max) (percentage) -99.19% 99.730 0.810 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.18% 15458.000 126.000 - 600.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.18% 1305.690 10.680 - 1404.23% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.96% 250.410 2.610 - 586.84% -
445.gobmk (unexplained diff vs previous) -98.91% 5581.000 61.000 - 577.78% -
481.wrf (max) (percentage) -98.88% 68.700 0.770 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.86% 111.110 1.270 - 568.42% -
429.mcf (unexplained diff vs previous) -98.83% 18593.000 218.000 - 1576.92% -
410.bwaves (unexplained diff vs previous) (percentage) -98.74% 137.900 1.740 - 4250.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -98.72% 391.300 5.000 - 777.19% -
410.bwaves (unexplained diff vs previous) -98.72% 7794.000 100.000 - 4900.00% -
471.omnetpp (unexplained diff vs previous) -98.71% 10659.000 138.000 - 820.00% -
458.sjeng (unexplained diff vs previous) -98.69% 6876.000 90.000 - 150.00% -
458.sjeng (unexplained diff vs previous) (percentage) -98.67% 90.870 1.210 - 146.94% -
434.zeusmp (max) -98.49% 2055.000 31.000 - 14.81% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.46% 368.340 5.670 - 5570.00% -
401.bzip2 (unexplained diff vs previous) -98.38% 10833.000 175.000 - 5733.33% -
434.zeusmp (max) (percentage) -98.36% 81.770 1.340 - 11.67% -
447.dealII (max) -98.27% 1384.000 24.000 - 0.00% -
470.lbm (max) -98.25% 2746.000 48.000 - -2.04% -
470.lbm (max) (percentage) -98.25% 72.510 1.270 - -3.79% -
444.namd (max) -98.25% 685.000 12.000 - 33.33% -
444.namd (max) (percentage) -98.18% 91.790 1.670 - 22.79% -
447.dealII (max) (percentage) -98.12% 80.280 1.510 - -3.21% -
473.astar (unexplained diff vs previous) (percentage) -97.92% 197.850 4.110 - 10175.00% -
473.astar (unexplained diff vs previous) -97.91% 10146.000 212.000 - 10500.00% -
445.gobmk (max) -97.69% 2643.000 61.000 - 24.49% -
400.perlbench (max) (percentage) -97.63% 84.060 1.990 - -0.50% -
445.gobmk (max) (percentage) -97.57% 52.630 1.280 - 24.27% -
433.milc (max) -97.51% 1044.000 26.000 - 550.00% -
458.sjeng (max) -97.50% 3602.000 90.000 - 36.36% -
433.milc (max) (percentage) -97.44% 90.750 2.320 - 510.53% -
458.sjeng (max) (percentage) -97.44% 47.610 1.220 - 35.56% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
435.gromacs (unexplained diff vs previous) -97.32% 7028.000 188.000 - 422.22% -
435.gromacs (unexplained diff vs previous) (percentage) -97.31% 96.680 2.600 - 409.80% -
453.povray (max) -97.19% 499.000 14.000 - -6.67% -
453.povray (max) (percentage) -96.99% 91.250 2.750 - -6.14% -
410.bwaves (max) (percentage) -96.95% 57.970 1.770 - 46.28% -
410.bwaves (max) -96.92% 3276.000 101.000 - 48.53% -
459.GemsFDTD (max) -96.85% 4411.000 139.000 - -0.71% -
462.libquantum (max) -96.38% 138.000 5.000 - 25.00% -
403.gcc (max) (percentage) -96.31% 99.360 3.670 - 0.00% -
462.libquantum (max) (percentage) -96.08% 98.970 3.880 - 4.02% -
459.GemsFDTD (max) (percentage) -95.96% 71.460 2.890 - -3.02% -
482.sphinx3 (max) -95.72% 911.000 39.000 - 129.41% -
482.sphinx3 (max) (percentage) -95.08% 96.500 4.750 - 121.96% -
450.soplex (max) -94.13% 545.000 32.000 - 10.34% -
450.soplex (max) (percentage) -94.11% 96.240 5.670 - 4.61% -
473.astar (max) (percentage) -93.56% 66.430 4.280 - 30.89% -
473.astar (max) -93.51% 3406.000 221.000 - 37.27% -
471.omnetpp (max) (percentage) -93.38% 79.650 5.270 - 206.40% -
471.omnetpp (max) -93.31% 2169.000 145.000 - 222.22% -
401.bzip2 (max) (percentage) -92.36% 78.650 6.010 - 20.20% -
435.gromacs (max) -92.22% 3573.000 278.000 - -0.36% -
435.gromacs (max) (percentage) -92.15% 49.160 3.860 - -2.77% -
401.bzip2 (max) -92.00% 2313.000 185.000 - 27.59% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.85% 9.220 1.120 - 0.00% -
470.lbm -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) -87.45% 239.000 30.000 - 0.00% -
470.lbm (avg) (percentage) -87.20% 6.330 0.810 - 0.00% -
429.mcf (max) (percentage) -87.14% 92.890 11.950 - 42.09% -
434.zeusmp -87.07% 147.000 19.000 - 5.56% -
434.zeusmp (avg) -87.07% 147.000 19.000 - 5.56% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.98% 5.850 0.820 - 1.23% -
465.tonto (max) -84.47% 2112.000 328.000 - 30.68% -
465.tonto (max) (percentage) -84.36% 19.310 3.020 - 26.89% -
459.GemsFDTD -83.06% 360.000 61.000 - 3.39% -
459.GemsFDTD (avg) -83.06% 360.000 61.000 - 3.39% -
447.dealII -82.83% 99.000 17.000 - 0.00% -
447.dealII (avg) -82.83% 99.000 17.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
458.sjeng -82.16% 241.000 43.000 - 2.38% -
458.sjeng (avg) -82.16% 241.000 43.000 - 2.38% -
465.tonto (unexplained diff vs previous) -81.99% 1771.000 319.000 - 641.86% -
465.tonto (unexplained diff vs previous) (percentage) -81.90% 16.190 2.930 - 614.63% -
429.mcf (max) -81.54% 1322.000 244.000 - 59.48% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 1.72% -
410.bwaves (avg) (percentage) -80.95% 4.410 0.840 - 1.20% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.76% 5.770 1.110 - 0.00% -
410.bwaves -80.72% 249.000 48.000 - 4.35% -
410.bwaves (avg) -80.72% 249.000 48.000 - 4.35% -
445.gobmk -80.10% 196.000 39.000 - 0.00% -
445.gobmk (avg) -80.10% 196.000 39.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 7.14% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 7.14% -
433.milc -79.71% 69.000 14.000 - 0.00% -
433.milc (avg) -79.71% 69.000 14.000 - 0.00% -
453.povray (avg) (percentage) -79.39% 7.810 1.610 - -0.62% -
445.gobmk (avg) (percentage) -78.77% 3.910 0.830 - 1.22% -
433.milc (avg) (percentage) -78.68% 6.050 1.290 - 0.78% -
459.GemsFDTD (avg) (percentage) -78.08% 5.840 1.280 - 0.79% -
482.sphinx3 (avg) (percentage) -77.30% 7.930 1.800 - 1.69% -
437.leslie3d (unexplained diff vs previous) -74.68% 2314.000 586.000 - 114.65% -
462.libquantum (avg) (percentage) -74.54% 7.660 1.950 - 0.52% -
471.omnetpp (avg) (percentage) -74.51% 8.200 2.090 - 0.97% -
471.omnetpp -74.44% 223.000 57.000 - 5.56% -
471.omnetpp (avg) -74.44% 223.000 57.000 - 5.56% -
437.leslie3d (unexplained diff vs previous) (percentage) -74.14% 19.880 5.140 - 103.16% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -69.53% 5.480 1.670 - 2.45% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -68.94% 367.000 114.000 - 3.64% -
435.gromacs (avg) -68.94% 367.000 114.000 - 3.64% -
435.gromacs (avg) (percentage) -68.77% 5.060 1.580 - 0.64% -
401.bzip2 -68.32% 161.000 51.000 - 8.51% -
401.bzip2 (avg) -68.32% 161.000 51.000 - 8.51% -
465.tonto -64.66% 365.000 129.000 - 5.74% -
465.tonto (avg) -64.66% 365.000 129.000 - 5.74% -
465.tonto (avg) (percentage) -64.37% 3.340 1.190 - 2.59% -
450.soplex -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) -61.11% 36.000 14.000 - 7.69% -
450.soplex (avg) (percentage) -60.96% 6.430 2.510 - 1.21% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - 1.23% -
473.astar -60.56% 213.000 84.000 - 5.00% -
473.astar (avg) -60.56% 213.000 84.000 - 5.00% -
437.leslie3d (max) -59.77% 1929.000 776.000 - 2.65% -
437.leslie3d (max) (percentage) -58.93% 16.580 6.810 - -2.71% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -43.02% 7.670 4.370 - 1.39% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -18.35% 109.000 89.000 - 14.10% -
429.mcf (avg) -18.35% 109.000 89.000 - 14.10% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
401.bzip2 3086.000 6.01%
410.bwaves 5755.000 1.77%
429.mcf 2042.000 11.95%
433.milc 1149.000 2.32%
434.zeusmp 2340.000 1.34%
435.gromacs 7227.000 2.67%
437.leslie3d 11397.000 5.42%
444.namd 731.000 1.67%
445.gobmk 4819.000 1.28%
447.dealII 1609.000 -
450.soplex 578.000 5.67%
453.povray 541.000 1.50%
458.sjeng 7449.000 1.22%
459.GemsFDTD 4829.000 2.68%
462.libquantum 134.000 3.88%
465.tonto 10871.000 3.02%
470.lbm 3800.000 1.01%
471.omnetpp 2759.000 5.27%
473.astar 5164.000 4.28%
482.sphinx3 838.000 4.75%
Geometric Mean 2379.423 3.39%
Code Size (bytes)
Name Current %
401.bzip2 43703.000 -
410.bwaves 17844.000 -
429.mcf 9094.000 -
433.milc 60340.000 -
434.zeusmp 149287.000 -
435.gromacs 489850.000 -
437.leslie3d 54382.000 -
444.namd 181608.000 -
445.gobmk 1373734.000 -
447.dealII 303380.000 -
450.soplex 202556.000 -
453.povray 647580.000 -
458.sjeng 103275.000 -
459.GemsFDTD 232214.000 -
462.libquantum 15781.000 -
465.tonto 1950705.000 -
470.lbm 9523.000 -
471.omnetpp 471988.000 -
473.astar 22652.000 -
482.sphinx3 111386.000 -
Geometric Mean 114164.463 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 1.990 -
401.bzip2 51.000 8.51%
401.bzip2 (avg) 51.000 8.51%
401.bzip2 (avg) (percentage) 1.670 2.45%
401.bzip2 (max) 185.000 27.59%
401.bzip2 (max) (percentage) 6.010 20.20%
401.bzip2 (unexplained diff vs previous) 175.000 5733.33%
401.bzip2 (unexplained diff vs previous) (percentage) 5.670 5570.00%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.670 -
410.bwaves 48.000 4.35%
410.bwaves (avg) 48.000 4.35%
410.bwaves (avg) (percentage) 0.840 1.20%
410.bwaves (max) 101.000 48.53%
410.bwaves (max) (percentage) 1.770 46.28%
410.bwaves (unexplained diff vs previous) 100.000 4900.00%
410.bwaves (unexplained diff vs previous) (percentage) 1.740 4250.00%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 89.000 14.10%
429.mcf (avg) 89.000 14.10%
429.mcf (avg) (percentage) 4.370 1.39%
429.mcf (max) 244.000 59.48%
429.mcf (max) (percentage) 11.950 42.09%
429.mcf (unexplained diff vs previous) 218.000 1576.92%
429.mcf (unexplained diff vs previous) (percentage) 10.680 1404.23%
433.milc 14.000 -
433.milc (avg) 14.000 -
433.milc (avg) (percentage) 1.290 -
433.milc (max) 26.000 550.00%
433.milc (max) (percentage) 2.320 510.53%
433.milc (unexplained diff vs previous) 26.000 -
433.milc (unexplained diff vs previous) (percentage) 2.260 -
434.zeusmp 19.000 5.56%
434.zeusmp (avg) 19.000 5.56%
434.zeusmp (avg) (percentage) 0.820 -
434.zeusmp (max) 31.000 14.81%
434.zeusmp (max) (percentage) 1.340 11.67%
434.zeusmp (unexplained diff vs previous) 31.000 933.33%
434.zeusmp (unexplained diff vs previous) (percentage) 1.320 915.38%
435.gromacs 114.000 3.64%
435.gromacs (avg) 114.000 3.64%
435.gromacs (avg) (percentage) 1.580 -
435.gromacs (max) 278.000 -
435.gromacs (max) (percentage) 3.860 -2.77%
435.gromacs (unexplained diff vs previous) 188.000 422.22%
435.gromacs (unexplained diff vs previous) (percentage) 2.600 409.80%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.850 -
437.leslie3d 477.000 5.76%
437.leslie3d (avg) 477.000 5.76%
437.leslie3d (avg) (percentage) 4.190 -
437.leslie3d (max) 776.000 2.65%
437.leslie3d (max) (percentage) 6.810 -2.71%
437.leslie3d (unexplained diff vs previous) 586.000 114.65%
437.leslie3d (unexplained diff vs previous) (percentage) 5.140 103.16%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.120 -
444.namd (max) 12.000 33.33%
444.namd (max) (percentage) 1.670 22.79%
444.namd (unexplained diff vs previous) 12.000 200.00%
444.namd (unexplained diff vs previous) (percentage) 1.640 192.86%
445.gobmk 39.000 -
445.gobmk (avg) 39.000 -
445.gobmk (avg) (percentage) 0.830 1.22%
445.gobmk (max) 61.000 24.49%
445.gobmk (max) (percentage) 1.280 24.27%
445.gobmk (unexplained diff vs previous) 61.000 577.78%
445.gobmk (unexplained diff vs previous) (percentage) 1.270 568.42%
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.110 -
447.dealII (max) 24.000 -
447.dealII (max) (percentage) 1.510 -3.21%
450.soplex 14.000 7.69%
450.soplex (avg) 14.000 7.69%
450.soplex (avg) (percentage) 2.510 1.21%
450.soplex (max) 32.000 10.34%
450.soplex (max) (percentage) 5.670 4.61%
450.soplex (unexplained diff vs previous) 31.000 3000.00%
450.soplex (unexplained diff vs previous) (percentage) 5.360 2877.78%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.610 -
453.povray (max) 14.000 -6.67%
453.povray (max) (percentage) 2.750 -6.14%
453.povray (unexplained diff vs previous) 8.000 -
453.povray (unexplained diff vs previous) (percentage) 1.480 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.810 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 43.000 2.38%
458.sjeng (avg) 43.000 2.38%
458.sjeng (avg) (percentage) 0.590 1.72%
458.sjeng (max) 90.000 36.36%
458.sjeng (max) (percentage) 1.220 35.56%
458.sjeng (unexplained diff vs previous) 90.000 150.00%
458.sjeng (unexplained diff vs previous) (percentage) 1.210 146.94%
459.GemsFDTD 61.000 3.39%
459.GemsFDTD (avg) 61.000 3.39%
459.GemsFDTD (avg) (percentage) 1.280 -
459.GemsFDTD (max) 139.000 -
459.GemsFDTD (max) (percentage) 2.890 -3.02%
459.GemsFDTD (unexplained diff vs previous) 126.000 600.00%
459.GemsFDTD (unexplained diff vs previous) (percentage) 2.610 586.84%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.950 -
462.libquantum (max) 5.000 25.00%
462.libquantum (max) (percentage) 3.880 4.02%
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.730 -3.87%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 129.000 5.74%
465.tonto (avg) 129.000 5.74%
465.tonto (avg) (percentage) 1.190 2.59%
465.tonto (max) 328.000 30.68%
465.tonto (max) (percentage) 3.020 26.89%
465.tonto (unexplained diff vs previous) 319.000 641.86%
465.tonto (unexplained diff vs previous) (percentage) 2.930 614.63%
470.lbm 30.000 -
470.lbm (avg) 30.000 -
470.lbm (avg) (percentage) 0.810 -
470.lbm (max) 48.000 -2.04%
470.lbm (max) (percentage) 1.270 -3.79%
470.lbm (unexplained diff vs previous) 38.000 1800.00%
470.lbm (unexplained diff vs previous) (percentage) 1.000 1900.00%
471.omnetpp 57.000 5.56%
471.omnetpp (avg) 57.000 5.56%
471.omnetpp (avg) (percentage) 2.090 -
471.omnetpp (max) 145.000 222.22%
471.omnetpp (max) (percentage) 5.270 206.40%
471.omnetpp (unexplained diff vs previous) 138.000 820.00%
471.omnetpp (unexplained diff vs previous) (percentage) 5.000 777.19%
473.astar 84.000 5.00%
473.astar (avg) 84.000 5.00%
473.astar (avg) (percentage) 1.640 1.23%
473.astar (max) 221.000 37.27%
473.astar (max) (percentage) 4.280 30.89%
473.astar (unexplained diff vs previous) 212.000 10500.00%
473.astar (unexplained diff vs previous) (percentage) 4.110 10175.00%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.770 -
482.sphinx3 15.000 7.14%
482.sphinx3 (avg) 15.000 7.14%
482.sphinx3 (avg) (percentage) 1.800 1.69%
482.sphinx3 (max) 39.000 129.41%
482.sphinx3 (max) (percentage) 4.750 121.96%
482.sphinx3 (unexplained diff vs previous) 38.000 280.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 4.530 262.40%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.803 104.44%