Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=85ef4a5ed82fb5f71c78505acfac2104767f908d (+ 38 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/a0cc6941d8c8fa88441fdae1ffb35396a412ec6b (+ 113 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e67f8e6dbd5ec98578a775b2e09b254f071e0f57 (+ 12 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/e7e98f48b9d83402a8baccb8f4cfb0ddb8a40aee (+ 61 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/301/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0301 (4-changed-components) 2024-09-28T06:29:19 0:00:00
Previous 0301 (-00000-) 2022-09-15T07:02:21 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 44 12
Performance Improvements 134 155
Unchanged Tests 1058 1069
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 2.26% 104028.000 106376.000 - 2.24% -
465.tonto 1.39% 1945443.000 1972539.000 - 1.36% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 27.45% 8718.000 11111.000 - 1.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) (percentage) 2505.88% 0.170 4.430 - -93.33% -
403.gcc (avg) (percentage) 1442.42% 0.330 5.090 - -30.46% -
483.xalancbmk (avg) (percentage) 1309.52% 0.210 2.960 - -54.46% -
403.gcc (max) (percentage) 963.89% 0.360 3.830 - -96.15% -
473.astar (max) 841.67% 24.000 226.000 - -93.36% -
454.calculix (avg) (percentage) 737.21% 0.430 3.600 - -55.11% -
429.mcf (avg) (percentage) 661.54% 0.650 4.950 - -35.46% -
429.mcf (max) (percentage) 609.09% 0.220 1.560 - -98.32% -
462.libquantum (max) (percentage) 458.62% 0.580 3.240 - -96.73% -
483.xalancbmk (max) (percentage) 405.71% 0.350 1.770 - -97.42% -
473.astar (avg) (percentage) 368.57% 0.350 1.640 - -60.58% -
401.bzip2 (max) (percentage) 241.46% 0.410 1.400 - -98.22% -
437.leslie3d (max) (percentage) 227.27% 4.180 13.680 - -17.49% -
458.sjeng (avg) (percentage) 215.00% 0.200 0.630 - -80.25% -
471.omnetpp (unexplained diff vs previous) (percentage) 193.70% 1.270 3.730 0.000 -99.05% 0.000
401.bzip2 (avg) (percentage) 192.31% 0.520 1.520 - -72.26% -
471.omnetpp (max) (percentage) 181.25% 1.280 3.600 - -95.48% -
437.leslie3d (max) 149.92% 613.000 1532.000 - -20.58% -
450.soplex (avg) (percentage) 143.27% 1.040 2.530 - -60.65% -
462.libquantum (avg) (percentage) 130.00% 0.800 1.840 - -75.98% -
465.tonto 106.06% 66.000 136.000 - -62.74% -
465.tonto (avg) 106.06% 66.000 136.000 - -62.74% -
437.leslie3d (avg) (percentage) 97.39% 2.300 4.540 - 48.85% -
473.astar 69.39% 49.000 83.000 - -61.03% -
473.astar (avg) 69.39% 49.000 83.000 - -61.03% -
400.perlbench (avg) (percentage) 65.85% 1.230 2.040 - -67.87% -
458.sjeng 64.29% 28.000 46.000 - -80.91% -
458.sjeng (avg) 64.29% 28.000 46.000 - -80.91% -
465.tonto (avg) (percentage) 61.84% 0.760 1.230 - -63.17% -
471.omnetpp (avg) (percentage) 60.29% 1.360 2.180 - -73.41% -
437.leslie3d 50.74% 337.000 508.000 - 43.10% -
437.leslie3d (avg) 50.74% 337.000 508.000 - 43.10% -
464.h264ref (avg) (percentage) 43.40% 0.530 0.760 - -85.07% -
447.dealII (avg) (percentage) 40.23% 0.870 1.220 - -78.86% -
400.perlbench (max) (percentage) 34.86% 1.750 2.360 - -97.19% -
445.gobmk (avg) (percentage) 28.99% 0.690 0.890 - -77.24% -
435.gromacs (avg) (percentage) 11.39% 1.580 1.760 - -65.22% -
410.bwaves (max) (percentage) 10.45% 0.670 0.740 - -98.72% -
459.GemsFDTD (avg) (percentage) 9.76% 1.230 1.350 - -76.88% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -7.77% 59403.000 54786.000 - -7.89% -
459.GemsFDTD -6.13% 247940.000 232732.000 - -4.90% -
434.zeusmp -4.70% 153897.000 146667.000 - -3.53% -
450.soplex -4.03% 211092.000 202582.000 - -1.22% -
435.gromacs -2.09% 500203.000 489749.000 - -1.91% -
464.h264ref -1.98% 387228.000 379544.000 - -2.12% -
453.povray -1.83% 661959.000 649829.000 - -1.75% -
410.bwaves -1.81% 16768.000 16464.000 - -1.77% -
470.lbm -1.69% 9711.000 9547.000 - -1.49% -
447.dealII -1.61% 312944.000 307892.000 - -1.19% -
471.omnetpp -1.47% 482480.000 475384.000 - -0.55% -
444.namd -1.35% 188301.000 185768.000 - -1.39% -
436.cactusADM -1.28% 352831.000 348331.000 - -1.29% -
456.hmmer -1.27% 108631.000 107255.000 - -1.32% -
433.milc -1.18% 61230.000 60509.000 - -1.42% -
401.bzip2 -1.14% 44221.000 43719.000 - -1.16% -
482.sphinx3 -1.04% 112831.000 111659.000 - -1.06% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.80% 11531.000 138.000 - -1.43% -
482.sphinx3 -97.18% 29598.000 836.000 - -11.53% -
450.soplex -96.37% 16072.000 583.000 - 2.82% -
444.namd -91.98% 9694.000 777.000 - 4.02% -
433.milc -91.48% 13376.000 1140.000 - -0.96% -
453.povray -91.38% 6406.000 552.000 - 0.91% -
436.cactusADM -88.46% 18217.000 2103.000 - 0.96% -
429.mcf -88.05% 17303.000 2068.000 - 45.22% -
400.perlbench -86.16% 11130.000 1540.000 - -7.40% -
447.dealII -81.70% 8943.000 1637.000 - -5.05% -
434.zeusmp -81.67% 13789.000 2527.000 - 0.52% -
401.bzip2 -80.15% 14909.000 2960.000 - 0.65% -
459.GemsFDTD -77.05% 23262.000 5339.000 - -13.51% -
471.omnetpp -75.20% 10811.000 2681.000 - -1.58% -
456.hmmer -74.40% 11256.000 2882.000 - 0.00% -
470.lbm -69.29% 12323.000 3785.000 - -0.08% -
473.astar -63.89% 14162.000 5114.000 - -0.27% -
410.bwaves -58.44% 14245.000 5920.000 - 4.74% -
464.h264ref -58.14% 13765.000 5762.000 - 0.02% -
445.gobmk -57.48% 11696.000 4973.000 - -1.00% -
435.gromacs -53.77% 15647.000 7234.000 - -0.48% -
458.sjeng -47.68% 14069.000 7361.000 - -2.72% -
437.leslie3d -23.67% 14676.000 11202.000 - -3.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) -99.68% 1580.000 5.000 - -99.45% -
444.namd (max) -99.60% 757.000 3.000 - -99.56% -
450.soplex (max) -99.09% 657.000 6.000 - -98.90% -
456.hmmer (max) -98.46% 130.000 2.000 - -99.91% -
482.sphinx3 -98.06% 772.000 15.000 - -79.73% -
482.sphinx3 (avg) -98.06% 772.000 15.000 - -79.73% -
444.namd -98.04% 460.000 9.000 - -86.76% -
444.namd (avg) -98.04% 460.000 9.000 - -86.76% -
462.libquantum -97.83% 92.000 2.000 - -80.00% -
462.libquantum (avg) -97.83% 92.000 2.000 - -80.00% -
434.zeusmp (max) -97.82% 275.000 6.000 - -99.71% -
433.milc (max) -97.14% 385.000 11.000 - -98.95% -
436.cactusADM (max) -96.66% 539.000 18.000 - -99.03% -
470.lbm (max) -95.21% 459.000 22.000 - -99.20% -
453.povray (max) -94.55% 165.000 9.000 - -98.20% -
433.milc -94.51% 255.000 14.000 - -79.71% -
433.milc (avg) -94.51% 255.000 14.000 - -79.71% -
462.libquantum (max) -93.94% 66.000 4.000 - -97.10% -
444.namd (max) (percentage) -93.85% 7.810 0.480 - -99.48% -
456.hmmer (max) (percentage) -93.10% 1.160 0.080 - -99.89% -
436.cactusADM -93.05% 331.000 23.000 - -81.45% -
436.cactusADM (avg) -93.05% 331.000 23.000 - -81.45% -
459.GemsFDTD (max) -92.74% 358.000 26.000 - -99.41% -
453.povray -92.73% 110.000 8.000 - -80.95% -
453.povray (avg) -92.73% 110.000 8.000 - -80.95% -
450.soplex -91.62% 167.000 14.000 - -61.11% -
450.soplex (avg) -91.62% 167.000 14.000 - -61.11% -
470.lbm -89.39% 311.000 33.000 - -86.19% -
470.lbm (avg) -89.39% 311.000 33.000 - -86.19% -
447.dealII (max) -89.29% 252.000 27.000 - -98.05% -
434.zeusmp -88.74% 222.000 25.000 - -82.99% -
434.zeusmp (avg) -88.74% 222.000 25.000 - -82.99% -
416.gamess (max) (percentage) -88.06% 3.100 0.370 - -99.04% -
434.zeusmp (max) (percentage) -87.00% 2.000 0.260 - -99.68% -
482.sphinx3 (max) (percentage) -86.89% 5.340 0.700 - -99.27% -
470.lbm (max) (percentage) -84.18% 3.730 0.590 - -99.19% -
400.perlbench (max) -81.44% 194.000 36.000 - -97.42% -
435.gromacs (max) -80.83% 433.000 83.000 - -97.68% -
445.gobmk (max) -79.45% 146.000 30.000 - -98.86% -
456.hmmer -77.94% 68.000 15.000 - -88.19% -
456.hmmer (avg) -77.94% 68.000 15.000 - -88.19% -
481.wrf (max) (percentage) -77.63% 3.710 0.830 - -98.79% -
400.perlbench -77.21% 136.000 31.000 - -70.48% -
400.perlbench (avg) -77.21% 136.000 31.000 - -70.48% -
447.dealII -75.32% 77.000 19.000 - -80.81% -
447.dealII (avg) -75.32% 77.000 19.000 - -80.81% -
459.GemsFDTD -74.83% 286.000 72.000 - -80.00% -
459.GemsFDTD (avg) -74.83% 286.000 72.000 - -80.00% -
444.namd (avg) (percentage) -73.89% 4.750 1.240 - -86.55% -
450.soplex (max) (percentage) -73.11% 4.090 1.100 - -98.86% -
458.sjeng (max) -72.22% 36.000 10.000 - -99.72% -
436.cactusADM (max) (percentage) -70.61% 2.960 0.870 - -99.02% -
459.GemsFDTD (max) (percentage) -68.18% 1.540 0.490 - -99.31% -
410.bwaves -66.25% 160.000 54.000 - -78.31% -
410.bwaves (avg) -66.25% 160.000 54.000 - -78.31% -
470.lbm (avg) (percentage) -64.82% 2.530 0.890 - -85.94% -
433.milc (max) (percentage) -64.24% 2.880 1.030 - -98.87% -
464.h264ref (max) -62.12% 132.000 50.000 - -98.40% -
465.tonto (max) (percentage) -61.36% 1.760 0.680 - -96.48% -
471.omnetpp -60.54% 147.000 58.000 - -73.99% -
471.omnetpp (avg) -60.54% 147.000 58.000 - -73.99% -
435.gromacs (max) (percentage) -58.12% 2.770 1.160 - -97.64% -
410.bwaves (max) -54.74% 95.000 43.000 - -98.69% -
445.gobmk (max) (percentage) -51.20% 1.250 0.610 - -98.84% -
465.tonto (max) -50.98% 153.000 75.000 - -96.45% -
416.gamess (avg) (percentage) -50.65% 1.540 0.760 - -82.81% -
435.gromacs -48.58% 247.000 127.000 - -65.40% -
435.gromacs (avg) -48.58% 247.000 127.000 - -65.40% -
458.sjeng (max) (percentage) -46.15% 0.260 0.140 - -99.71% -
445.gobmk -45.00% 80.000 44.000 - -77.55% -
445.gobmk (avg) -45.00% 80.000 44.000 - -77.55% -
401.bzip2 -42.86% 77.000 44.000 - -72.67% -
401.bzip2 (avg) -42.86% 77.000 44.000 - -72.67% -
447.dealII (max) (percentage) -40.78% 2.820 1.670 - -97.92% -
464.h264ref -40.28% 72.000 43.000 - -85.32% -
464.h264ref (avg) -40.28% 72.000 43.000 - -85.32% -
434.zeusmp (avg) (percentage) -38.51% 1.610 0.990 - -83.08% -
436.cactusADM (avg) (percentage) -37.36% 1.820 1.140 - -80.94% -
433.milc (avg) (percentage) -35.08% 1.910 1.240 - -79.50% -
401.bzip2 (max) -32.79% 61.000 41.000 - -98.23% -
453.povray (max) (percentage) -32.43% 2.590 1.750 - -98.08% -
482.sphinx3 (avg) (percentage) -30.65% 2.610 1.810 - -77.18% -
471.omnetpp (max) -30.43% 138.000 96.000 - -95.57% -
471.omnetpp (unexplained diff vs previous) -27.01% 137.000 100.000 0.000 -99.06% 0.000
410.bwaves (avg) (percentage) -18.58% 1.130 0.920 - -79.14% -
454.calculix (max) (percentage) -16.16% 0.990 0.830 - -99.17% -
429.mcf (max) -15.79% 38.000 32.000 - -97.58% -
456.hmmer (avg) (percentage) -11.48% 0.610 0.540 - -87.76% -
453.povray (avg) (percentage) -10.98% 1.730 1.540 - -80.28% -
481.wrf (avg) (percentage) -10.89% 2.020 1.800 - -71.15% -
429.mcf -8.93% 112.000 102.000 - -6.42% -
429.mcf (avg) -8.93% 112.000 102.000 - -6.42% -
464.h264ref (max) (percentage) -8.33% 0.960 0.880 - -98.38% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 2.24% 104048.000 106376.000 - 2.26% -
465.tonto 1.36% 1946163.000 1972539.000 - 1.39% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 45.22% 1424.000 2068.000 - -88.05% -
410.bwaves 4.74% 5652.000 5920.000 - -58.44% -
444.namd 4.02% 747.000 777.000 - -91.98% -
450.soplex 2.82% 567.000 583.000 - -96.37% -
465.tonto 1.55% 10941.000 11111.000 - 27.45% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 48.85% 3.050 4.540 - 97.39% -
437.leslie3d 43.10% 355.000 508.000 - 50.74% -
437.leslie3d (avg) 43.10% 355.000 508.000 - 50.74% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - -17.24% -
nb_execution_successful -17.24% 29.000 24.000 - -17.24% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.89% 59479.000 54786.000 - -7.77% -
459.GemsFDTD -4.90% 244728.000 232732.000 - -6.13% -
434.zeusmp -3.53% 152037.000 146667.000 - -4.70% -
464.h264ref -2.12% 387748.000 379544.000 - -1.98% -
435.gromacs -1.91% 499261.000 489749.000 - -2.09% -
410.bwaves -1.77% 16760.000 16464.000 - -1.81% -
453.povray -1.75% 661389.000 649829.000 - -1.83% -
470.lbm -1.49% 9691.000 9547.000 - -1.69% -
433.milc -1.42% 61382.000 60509.000 - -1.18% -
444.namd -1.39% 188385.000 185768.000 - -1.35% -
456.hmmer -1.32% 108691.000 107255.000 - -1.27% -
436.cactusADM -1.29% 352891.000 348331.000 - -1.28% -
450.soplex -1.22% 205081.000 202582.000 - -4.03% -
462.libquantum -1.19% 16085.000 15893.000 - -0.95% -
447.dealII -1.19% 311591.000 307892.000 - -1.61% -
401.bzip2 -1.16% 44233.000 43719.000 - -1.14% -
482.sphinx3 -1.06% 112859.000 111659.000 - -1.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.51% 6173.000 5339.000 - -77.05% -
482.sphinx3 -11.53% 945.000 836.000 - -97.18% -
400.perlbench -7.40% 1663.000 1540.000 - -86.16% -
447.dealII -5.05% 1724.000 1637.000 - -81.70% -
437.leslie3d -3.76% 11640.000 11202.000 - -23.67% -
458.sjeng -2.72% 7567.000 7361.000 - -47.68% -
471.omnetpp -1.58% 2724.000 2681.000 - -75.20% -
462.libquantum -1.43% 140.000 138.000 - -98.80% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
456.hmmer (max) -99.91% 2120.000 2.000 - -98.46% -
456.hmmer (max) (percentage) -99.89% 73.590 0.080 - -93.10% -
458.sjeng (max) -99.72% 3602.000 10.000 - -72.22% -
434.zeusmp (max) -99.71% 2055.000 6.000 - -97.82% -
458.sjeng (max) (percentage) -99.71% 47.610 0.140 - -46.15% -
434.zeusmp (max) (percentage) -99.68% 81.770 0.260 - -87.00% -
444.namd (max) -99.56% 685.000 3.000 - -99.60% -
444.namd (max) (percentage) -99.48% 91.790 0.480 - -93.85% -
482.sphinx3 (max) -99.45% 911.000 5.000 - -99.68% -
459.GemsFDTD (max) -99.41% 4411.000 26.000 - -92.74% -
459.GemsFDTD (max) (percentage) -99.31% 71.460 0.490 - -68.18% -
482.sphinx3 (max) (percentage) -99.27% 96.500 0.700 - -86.89% -
470.lbm (max) -99.20% 2746.000 22.000 - -95.21% -
470.lbm (max) (percentage) -99.19% 72.510 0.590 - -84.18% -
454.calculix (max) (percentage) -99.17% 99.730 0.830 - -16.16% -
471.omnetpp (unexplained diff vs previous) -99.06% 10659.000 100.000 0.000 -27.01% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.05% 391.300 3.730 0.000 193.70% 0.000
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -88.06% -
436.cactusADM (max) -99.03% 1848.000 18.000 - -96.66% -
436.cactusADM (max) (percentage) -99.02% 88.730 0.870 - -70.61% -
433.milc (max) -98.95% 1044.000 11.000 - -97.14% -
450.soplex (max) -98.90% 545.000 6.000 - -99.09% -
433.milc (max) (percentage) -98.87% 90.750 1.030 - -64.24% -
445.gobmk (max) -98.86% 2643.000 30.000 - -79.45% -
450.soplex (max) (percentage) -98.86% 96.240 1.100 - -73.11% -
445.gobmk (max) (percentage) -98.84% 52.630 0.610 - -51.20% -
481.wrf (max) (percentage) -98.79% 68.700 0.830 - -77.63% -
410.bwaves (max) (percentage) -98.72% 57.970 0.740 - 10.45% -
410.bwaves (max) -98.69% 3276.000 43.000 - -54.74% -
464.h264ref (max) -98.40% 3127.000 50.000 - -62.12% -
464.h264ref (max) (percentage) -98.38% 54.290 0.880 - -8.33% -
429.mcf (max) (percentage) -98.32% 92.890 1.560 - 609.09% -
401.bzip2 (max) -98.23% 2313.000 41.000 - -32.79% -
401.bzip2 (max) (percentage) -98.22% 78.650 1.400 - 241.46% -
453.povray (max) -98.20% 499.000 9.000 - -94.55% -
453.povray (max) (percentage) -98.08% 91.250 1.750 - -32.43% -
447.dealII (max) -98.05% 1384.000 27.000 - -89.29% -
447.dealII (max) (percentage) -97.92% 80.280 1.670 - -40.78% -
435.gromacs (max) -97.68% 3573.000 83.000 - -80.83% -
435.gromacs (max) (percentage) -97.64% 49.160 1.160 - -58.12% -
429.mcf (max) -97.58% 1322.000 32.000 - -15.79% -
400.perlbench (max) -97.42% 1397.000 36.000 - -81.44% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 405.71% -
400.perlbench (max) (percentage) -97.19% 84.060 2.360 - 34.86% -
462.libquantum (max) -97.10% 138.000 4.000 - -93.94% -
462.libquantum (max) (percentage) -96.73% 98.970 3.240 - 458.62% -
465.tonto (max) (percentage) -96.48% 19.310 0.680 - -61.36% -
465.tonto (max) -96.45% 2112.000 75.000 - -50.98% -
403.gcc (max) (percentage) -96.15% 99.360 3.830 - 963.89% -
471.omnetpp (max) -95.57% 2169.000 96.000 - -30.43% -
471.omnetpp (max) (percentage) -95.48% 79.650 3.600 - 181.25% -
473.astar (max) -93.36% 3406.000 226.000 - 841.67% -
473.astar (max) (percentage) -93.33% 66.430 4.430 - 2505.88% -
456.hmmer -88.19% 127.000 15.000 - -77.94% -
456.hmmer (avg) -88.19% 127.000 15.000 - -77.94% -
456.hmmer (avg) (percentage) -87.76% 4.410 0.540 - -11.48% -
444.namd -86.76% 68.000 9.000 - -98.04% -
444.namd (avg) -86.76% 68.000 9.000 - -98.04% -
444.namd (avg) (percentage) -86.55% 9.220 1.240 - -73.89% -
470.lbm -86.19% 239.000 33.000 - -89.39% -
470.lbm (avg) -86.19% 239.000 33.000 - -89.39% -
470.lbm (avg) (percentage) -85.94% 6.330 0.890 - -64.82% -
464.h264ref -85.32% 293.000 43.000 - -40.28% -
464.h264ref (avg) -85.32% 293.000 43.000 - -40.28% -
464.h264ref (avg) (percentage) -85.07% 5.090 0.760 - 43.40% -
434.zeusmp (avg) (percentage) -83.08% 5.850 0.990 - -38.51% -
434.zeusmp -82.99% 147.000 25.000 - -88.74% -
434.zeusmp (avg) -82.99% 147.000 25.000 - -88.74% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -50.65% -
436.cactusADM -81.45% 124.000 23.000 - -93.05% -
436.cactusADM (avg) -81.45% 124.000 23.000 - -93.05% -
453.povray -80.95% 42.000 8.000 - -92.73% -
453.povray (avg) -80.95% 42.000 8.000 - -92.73% -
436.cactusADM (avg) (percentage) -80.94% 5.980 1.140 - -37.36% -
458.sjeng -80.91% 241.000 46.000 - 64.29% -
458.sjeng (avg) -80.91% 241.000 46.000 - 64.29% -
447.dealII -80.81% 99.000 19.000 - -75.32% -
447.dealII (avg) -80.81% 99.000 19.000 - -75.32% -
453.povray (avg) (percentage) -80.28% 7.810 1.540 - -10.98% -
458.sjeng (avg) (percentage) -80.25% 3.190 0.630 - 215.00% -
459.GemsFDTD -80.00% 360.000 72.000 - -74.83% -
459.GemsFDTD (avg) -80.00% 360.000 72.000 - -74.83% -
462.libquantum -80.00% 10.000 2.000 - -97.83% -
462.libquantum (avg) -80.00% 10.000 2.000 - -97.83% -
482.sphinx3 -79.73% 74.000 15.000 - -98.06% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - -98.06% -
433.milc -79.71% 69.000 14.000 - -94.51% -
433.milc (avg) -79.71% 69.000 14.000 - -94.51% -
433.milc (avg) (percentage) -79.50% 6.050 1.240 - -35.08% -
410.bwaves (avg) (percentage) -79.14% 4.410 0.920 - -18.58% -
447.dealII (avg) (percentage) -78.86% 5.770 1.220 - 40.23% -
410.bwaves -78.31% 249.000 54.000 - -66.25% -
410.bwaves (avg) -78.31% 249.000 54.000 - -66.25% -
445.gobmk -77.55% 196.000 44.000 - -45.00% -
445.gobmk (avg) -77.55% 196.000 44.000 - -45.00% -
445.gobmk (avg) (percentage) -77.24% 3.910 0.890 - 28.99% -
482.sphinx3 (avg) (percentage) -77.18% 7.930 1.810 - -30.65% -
459.GemsFDTD (avg) (percentage) -76.88% 5.840 1.350 - 9.76% -
462.libquantum (avg) (percentage) -75.98% 7.660 1.840 - 130.00% -
471.omnetpp -73.99% 223.000 58.000 - -60.54% -
471.omnetpp (avg) -73.99% 223.000 58.000 - -60.54% -
471.omnetpp (avg) (percentage) -73.41% 8.200 2.180 - 60.29% -
401.bzip2 -72.67% 161.000 44.000 - -42.86% -
401.bzip2 (avg) -72.67% 161.000 44.000 - -42.86% -
401.bzip2 (avg) (percentage) -72.26% 5.480 1.520 - 192.31% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -10.89% -
400.perlbench -70.48% 105.000 31.000 - -77.21% -
400.perlbench (avg) -70.48% 105.000 31.000 - -77.21% -
400.perlbench (avg) (percentage) -67.87% 6.350 2.040 - 65.85% -
435.gromacs -65.40% 367.000 127.000 - -48.58% -
435.gromacs (avg) -65.40% 367.000 127.000 - -48.58% -
435.gromacs (avg) (percentage) -65.22% 5.060 1.760 - 11.39% -
465.tonto (avg) (percentage) -63.17% 3.340 1.230 - 61.84% -
465.tonto -62.74% 365.000 136.000 - 106.06% -
465.tonto (avg) -62.74% 365.000 136.000 - 106.06% -
450.soplex -61.11% 36.000 14.000 - -91.62% -
450.soplex (avg) -61.11% 36.000 14.000 - -91.62% -
473.astar -61.03% 213.000 83.000 - 69.39% -
473.astar (avg) -61.03% 213.000 83.000 - 69.39% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 143.27% -
473.astar (avg) (percentage) -60.58% 4.160 1.640 - 368.57% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 737.21% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 1309.52% -
429.mcf (avg) (percentage) -35.46% 7.670 4.950 - 661.54% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1442.42% -
437.leslie3d (max) -20.58% 1929.000 1532.000 - 149.92% -
437.leslie3d (max) (percentage) -17.49% 16.580 13.680 - 227.27% -
429.mcf -6.42% 109.000 102.000 - -8.93% -
429.mcf (avg) -6.42% 109.000 102.000 - -8.93% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 17.24% -

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1540.000 -86.16%
401.bzip2 2960.000 -80.15%
410.bwaves 5920.000 -58.44%
429.mcf 2068.000 -88.05%
433.milc 1140.000 -91.48%
434.zeusmp 2527.000 -81.67%
435.gromacs 7234.000 -53.77%
436.cactusADM 2103.000 -88.46%
437.leslie3d 11202.000 -23.67%
444.namd 777.000 -91.98%
445.gobmk 4973.000 -57.48%
447.dealII 1637.000 -81.70%
450.soplex 583.000 -96.37%
453.povray 552.000 -91.38%
456.hmmer 2882.000 -74.40%
458.sjeng 7361.000 -47.68%
459.GemsFDTD 5339.000 -77.05%
462.libquantum 138.000 -98.80%
464.h264ref 5762.000 -58.14%
465.tonto 11111.000 27.45%
470.lbm 3785.000 -69.29%
471.omnetpp 2681.000 -75.20%
473.astar 5114.000 -63.89%
482.sphinx3 836.000 -97.18%
Geometric Mean 2460.375 -81.50%
Code Size (bytes)
Name Current %
400.perlbench 895883.000 -
401.bzip2 43719.000 -1.14%
410.bwaves 16464.000 -1.81%
429.mcf 9119.000 -
433.milc 60509.000 -1.18%
434.zeusmp 146667.000 -4.70%
435.gromacs 489749.000 -2.09%
436.cactusADM 348331.000 -1.28%
437.leslie3d 54786.000 -7.77%
444.namd 185768.000 -1.35%
445.gobmk 1374834.000 -
447.dealII 307892.000 -1.61%
450.soplex 202582.000 -4.03%
453.povray 649829.000 -1.83%
456.hmmer 107255.000 -1.27%
458.sjeng 106376.000 2.26%
459.GemsFDTD 232732.000 -6.13%
462.libquantum 15893.000 -
464.h264ref 379544.000 -1.98%
465.tonto 1972539.000 1.39%
470.lbm 9547.000 -1.69%
471.omnetpp 475384.000 -1.47%
473.astar 22760.000 -
482.sphinx3 111659.000 -1.04%
Geometric Mean 136783.376 -1.73%
Score
Name Current %
nb_compile_successful 24.000 -17.24%
nb_execution_successful 24.000 -17.24%
nb_total_tests 34.000 17.24%
Geometric Mean 26.955 -7.05%
sample variability
Name Current %
400.perlbench 31.000 -77.21%
400.perlbench (avg) 31.000 -77.21%
400.perlbench (avg) (percentage) 2.040 65.85%
400.perlbench (max) 36.000 -81.44%
400.perlbench (max) (percentage) 2.360 34.86%
401.bzip2 44.000 -42.86%
401.bzip2 (avg) 44.000 -42.86%
401.bzip2 (avg) (percentage) 1.520 192.31%
401.bzip2 (max) 41.000 -32.79%
401.bzip2 (max) (percentage) 1.400 241.46%
403.gcc (avg) (percentage) 5.090 1442.42%
403.gcc (max) (percentage) 3.830 963.89%
410.bwaves 54.000 -66.25%
410.bwaves (avg) 54.000 -66.25%
410.bwaves (avg) (percentage) 0.920 -18.58%
410.bwaves (max) 43.000 -54.74%
410.bwaves (max) (percentage) 0.740 10.45%
416.gamess (avg) (percentage) 0.760 -50.65%
416.gamess (max) (percentage) 0.370 -88.06%
429.mcf 102.000 -8.93%
429.mcf (avg) 102.000 -8.93%
429.mcf (avg) (percentage) 4.950 661.54%
429.mcf (max) 32.000 -15.79%
429.mcf (max) (percentage) 1.560 609.09%
433.milc 14.000 -94.51%
433.milc (avg) 14.000 -94.51%
433.milc (avg) (percentage) 1.240 -35.08%
433.milc (max) 11.000 -97.14%
433.milc (max) (percentage) 1.030 -64.24%
434.zeusmp 25.000 -88.74%
434.zeusmp (avg) 25.000 -88.74%
434.zeusmp (avg) (percentage) 0.990 -38.51%
434.zeusmp (max) 6.000 -97.82%
434.zeusmp (max) (percentage) 0.260 -87.00%
435.gromacs 127.000 -48.58%
435.gromacs (avg) 127.000 -48.58%
435.gromacs (avg) (percentage) 1.760 11.39%
435.gromacs (max) 83.000 -80.83%
435.gromacs (max) (percentage) 1.160 -58.12%
436.cactusADM 23.000 -93.05%
436.cactusADM (avg) 23.000 -93.05%
436.cactusADM (avg) (percentage) 1.140 -37.36%
436.cactusADM (max) 18.000 -96.66%
436.cactusADM (max) (percentage) 0.870 -70.61%
437.leslie3d 508.000 50.74%
437.leslie3d (avg) 508.000 50.74%
437.leslie3d (avg) (percentage) 4.540 97.39%
437.leslie3d (max) 1532.000 149.92%
437.leslie3d (max) (percentage) 13.680 227.27%
444.namd 9.000 -98.04%
444.namd (avg) 9.000 -98.04%
444.namd (avg) (percentage) 1.240 -73.89%
444.namd (max) 3.000 -99.60%
444.namd (max) (percentage) 0.480 -93.85%
445.gobmk 44.000 -45.00%
445.gobmk (avg) 44.000 -45.00%
445.gobmk (avg) (percentage) 0.890 28.99%
445.gobmk (max) 30.000 -79.45%
445.gobmk (max) (percentage) 0.610 -51.20%
447.dealII 19.000 -75.32%
447.dealII (avg) 19.000 -75.32%
447.dealII (avg) (percentage) 1.220 40.23%
447.dealII (max) 27.000 -89.29%
447.dealII (max) (percentage) 1.670 -40.78%
450.soplex 14.000 -91.62%
450.soplex (avg) 14.000 -91.62%
450.soplex (avg) (percentage) 2.530 143.27%
450.soplex (max) 6.000 -99.09%
450.soplex (max) (percentage) 1.100 -73.11%
453.povray 8.000 -92.73%
453.povray (avg) 8.000 -92.73%
453.povray (avg) (percentage) 1.540 -10.98%
453.povray (max) 9.000 -94.55%
453.povray (max) (percentage) 1.750 -32.43%
454.calculix (avg) (percentage) 3.600 737.21%
454.calculix (max) (percentage) 0.830 -16.16%
456.hmmer 15.000 -77.94%
456.hmmer (avg) 15.000 -77.94%
456.hmmer (avg) (percentage) 0.540 -11.48%
456.hmmer (max) 2.000 -98.46%
456.hmmer (max) (percentage) 0.080 -93.10%
458.sjeng 46.000 64.29%
458.sjeng (avg) 46.000 64.29%
458.sjeng (avg) (percentage) 0.630 215.00%
458.sjeng (max) 10.000 -72.22%
458.sjeng (max) (percentage) 0.140 -46.15%
459.GemsFDTD 72.000 -74.83%
459.GemsFDTD (avg) 72.000 -74.83%
459.GemsFDTD (avg) (percentage) 1.350 9.76%
459.GemsFDTD (max) 26.000 -92.74%
459.GemsFDTD (max) (percentage) 0.490 -68.18%
462.libquantum 2.000 -97.83%
462.libquantum (avg) 2.000 -97.83%
462.libquantum (avg) (percentage) 1.840 130.00%
462.libquantum (max) 4.000 -93.94%
462.libquantum (max) (percentage) 3.240 458.62%
464.h264ref 43.000 -40.28%
464.h264ref (avg) 43.000 -40.28%
464.h264ref (avg) (percentage) 0.760 43.40%
464.h264ref (max) 50.000 -62.12%
464.h264ref (max) (percentage) 0.880 -8.33%
465.tonto 136.000 106.06%
465.tonto (avg) 136.000 106.06%
465.tonto (avg) (percentage) 1.230 61.84%
465.tonto (max) 75.000 -50.98%
465.tonto (max) (percentage) 0.680 -61.36%
470.lbm 33.000 -89.39%
470.lbm (avg) 33.000 -89.39%
470.lbm (avg) (percentage) 0.890 -64.82%
470.lbm (max) 22.000 -95.21%
470.lbm (max) (percentage) 0.590 -84.18%
471.omnetpp 58.000 -60.54%
471.omnetpp (avg) 58.000 -60.54%
471.omnetpp (avg) (percentage) 2.180 60.29%
471.omnetpp (max) 96.000 -30.43%
471.omnetpp (max) (percentage) 3.600 181.25%
471.omnetpp (unexplained diff vs previous) 100.000 -27.01%
471.omnetpp (unexplained diff vs previous) (percentage) 3.730 193.70%
473.astar 83.000 69.39%
473.astar (avg) 83.000 69.39%
473.astar (avg) (percentage) 1.640 368.57%
473.astar (max) 226.000 841.67%
473.astar (max) (percentage) 4.430 2505.88%
481.wrf (avg) (percentage) 1.800 -10.89%
481.wrf (max) (percentage) 0.830 -77.63%
482.sphinx3 15.000 -98.06%
482.sphinx3 (avg) 15.000 -98.06%
482.sphinx3 (avg) (percentage) 1.810 -30.65%
482.sphinx3 (max) 5.000 -99.68%
482.sphinx3 (max) (percentage) 0.700 -86.89%
483.xalancbmk (avg) (percentage) 2.960 1309.52%
483.xalancbmk (max) (percentage) 1.770 405.71%
Geometric Mean 7.359 -58.57%