Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=00c57bf85d0b3033e24535e0fb45c22b995abc59 (+ 262 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (c978965b445079abbb88c22ba74de1e26e9f5b81) (+ 355 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=689a62a4217fae78b9ce0db781dc2a421f2b1ab4 (+ 80 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9c1d44dcc377f4dab42cd34fbbcff8be86bdaa4e (+ 16569 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/371/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0371 (4-changed-components) 2025-02-10T00:39:42 0:00:00
Previous 0369 (4-changed-components) 2022-12-29T09:19:42 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 63 7
Performance Improvements 107 163
Unchanged Tests 1066 1066
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
410.bwaves 6.45% 16752.000 17832.000 - 6.40% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 27.55% 8378.000 10686.000 - -2.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) (percentage) 11740.00% 0.050 5.920 - -97.01% -
473.astar (unexplained diff vs previous) 4085.71% 7.000 293.000 - -97.11% -
473.astar (max) (percentage) 3892.86% 0.140 5.590 - -91.59% -
462.libquantum (unexplained diff vs previous) (percentage) 3777.78% 0.180 6.980 - -99.93% -
462.libquantum (max) (percentage) 3573.68% 0.190 6.980 - -92.95% -
401.bzip2 (max) (percentage) 3010.34% 0.290 9.020 - -88.53% -
429.mcf (avg) (percentage) 1420.00% 0.300 4.560 - -40.55% -
403.gcc (avg) (percentage) 1354.29% 0.350 5.090 - -30.46% -
473.astar (max) 1352.63% 19.000 276.000 - -91.90% -
429.mcf (unexplained diff vs previous) (percentage) 1222.22% 0.810 10.710 - -99.18% -
429.mcf (max) (percentage) 1080.49% 0.820 9.680 - -89.58% -
473.astar (avg) (percentage) 876.47% 0.170 1.660 - -60.10% -
458.sjeng (unexplained diff vs previous) (percentage) 596.15% 0.260 1.810 - -98.01% -
458.sjeng (max) (percentage) 584.62% 0.260 1.780 - -96.26% -
401.bzip2 (max) 497.67% 43.000 257.000 - -88.89% -
450.soplex (max) (percentage) 471.77% 2.090 11.950 - -87.58% -
462.libquantum (avg) (percentage) 432.43% 0.370 1.970 - -74.28% -
471.omnetpp (unexplained diff vs previous) (percentage) 420.00% 1.100 5.720 - -98.54% -
403.gcc (max) (percentage) 413.89% 0.720 3.700 - -96.28% -
401.bzip2 (avg) (percentage) 382.35% 0.340 1.640 - -70.07% -
483.xalancbmk (avg) (percentage) 362.50% 0.640 2.960 - -54.46% -
459.GemsFDTD (max) (percentage) 303.51% 1.140 4.600 - -93.56% -
458.sjeng (max) 263.89% 36.000 131.000 - -96.36% -
458.sjeng (unexplained diff vs previous) 262.16% 37.000 134.000 - -98.05% -
473.astar 241.67% 24.000 82.000 - -61.50% -
473.astar (avg) 241.67% 24.000 82.000 - -61.50% -
458.sjeng (avg) (percentage) 241.18% 0.170 0.580 - -81.82% -
482.sphinx3 (max) (percentage) 239.86% 2.760 9.380 - -90.28% -
471.omnetpp (max) (percentage) 207.18% 1.950 5.990 - -92.48% -
447.dealII (max) (percentage) 146.67% 1.200 2.960 - -96.31% -
454.calculix (avg) (percentage) 146.58% 1.460 3.600 - -55.11% -
433.milc (unexplained diff vs previous) (percentage) 135.27% 2.920 6.870 - -99.30% -
464.h264ref (avg) (percentage) 129.03% 0.310 0.710 - -86.05% -
450.soplex (avg) (percentage) 127.93% 1.110 2.530 - -60.65% -
433.milc (max) (percentage) 113.62% 3.010 6.430 - -92.91% -
445.gobmk (max) (percentage) 101.46% 1.370 2.760 - -94.76% -
453.povray (max) (percentage) 99.15% 2.340 4.660 - -94.89% -
471.omnetpp (avg) (percentage) 94.44% 1.080 2.100 - -74.39% -
458.sjeng 82.61% 23.000 42.000 - -82.57% -
458.sjeng (avg) 82.61% 23.000 42.000 - -82.57% -
437.leslie3d (avg) (percentage) 70.28% 2.490 4.240 - 39.02% -
429.mcf 62.75% 51.000 83.000 - -23.85% -
429.mcf (avg) 62.75% 51.000 83.000 - -23.85% -
459.GemsFDTD (avg) (percentage) 59.04% 0.830 1.320 - -77.40% -
483.xalancbmk (max) (percentage) 58.04% 1.120 1.770 - -97.42% -
447.dealII (avg) (percentage) 49.35% 0.770 1.150 - -80.07% -
400.perlbench (avg) (percentage) 41.61% 1.370 1.940 - -69.45% -
429.mcf (unexplained diff vs previous) 40.71% 140.000 197.000 - -98.94% -
453.povray (avg) (percentage) 32.00% 1.250 1.650 - -78.87% -
445.gobmk (avg) (percentage) 30.88% 0.680 0.890 - -77.24% -
471.omnetpp (unexplained diff vs previous) 29.06% 117.000 151.000 - -98.58% -
429.mcf (max) 26.24% 141.000 178.000 - -86.54% -
437.leslie3d 19.42% 381.000 455.000 - 28.17% -
437.leslie3d (avg) 19.42% 381.000 455.000 - 28.17% -
465.tonto 17.70% 113.000 133.000 - -63.56% -
465.tonto (avg) 17.70% 113.000 133.000 - -63.56% -
410.bwaves (max) (percentage) 12.67% 2.210 2.490 - -95.70% -
464.h264ref (max) (percentage) 12.12% 0.330 0.370 - -99.32% -
435.gromacs (avg) (percentage) 7.19% 1.530 1.640 - -67.59% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -31.03% 29.000 20.000 - -31.03% -
nb_execution_successful -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -8.71% 59491.000 54310.000 - -8.69% -
459.GemsFDTD -4.85% 244732.000 232852.000 - -4.85% -
458.sjeng -4.47% 108160.000 103327.000 - -0.69% -
447.dealII -2.17% 311667.000 304898.000 - -2.15% -
462.libquantum -1.89% 16085.000 15781.000 - -1.89% -
434.zeusmp -1.82% 152037.000 149263.000 - -1.82% -
435.gromacs -1.80% 499413.000 490446.000 - -1.77% -
433.milc -1.53% 61382.000 60440.000 - -1.53% -
470.lbm -1.45% 9687.000 9547.000 - -1.49% -
444.namd -1.24% 188397.000 186052.000 - -1.24% -
401.bzip2 -1.13% 44233.000 43735.000 - -1.13% -
482.sphinx3 -1.05% 112883.000 111702.000 - -1.03% -
473.astar -1.04% 22968.000 22728.000 - -1.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.88% 11517.000 129.000 - -7.86% -
482.sphinx3 -97.24% 29441.000 814.000 - -13.86% -
450.soplex -96.63% 16093.000 543.000 - -4.23% -
444.namd -92.52% 9728.000 728.000 - -2.54% -
433.milc -91.51% 13210.000 1121.000 - -2.61% -
453.povray -91.49% 6334.000 539.000 - -1.46% -
429.mcf -89.32% 17224.000 1839.000 - 29.14% -
434.zeusmp -83.27% 13756.000 2302.000 - -8.43% -
447.dealII -82.12% 9031.000 1615.000 - -6.32% -
401.bzip2 -81.06% 15062.000 2853.000 - -2.99% -
459.GemsFDTD -79.88% 23209.000 4669.000 - -24.36% -
471.omnetpp -75.11% 10597.000 2638.000 - -3.16% -
470.lbm -69.60% 12291.000 3737.000 - -1.35% -
473.astar -65.10% 14179.000 4948.000 - -3.51% -
410.bwaves -58.82% 13798.000 5682.000 - 0.53% -
445.gobmk -58.71% 11723.000 4840.000 - -3.64% -
435.gromacs -54.93% 15687.000 7070.000 - -2.74% -
458.sjeng -47.20% 14010.000 7397.000 - -2.25% -
437.leslie3d -29.94% 15319.000 10733.000 - -7.79% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd -98.06% 413.000 8.000 - -88.24% -
444.namd (avg) -98.06% 413.000 8.000 - -88.24% -
482.sphinx3 -97.38% 535.000 14.000 - -81.08% -
482.sphinx3 (avg) -97.38% 535.000 14.000 - -81.08% -
444.namd (max) -95.63% 732.000 32.000 - -95.33% -
462.libquantum -95.24% 42.000 2.000 - -80.00% -
462.libquantum (avg) -95.24% 42.000 2.000 - -80.00% -
433.milc -93.72% 239.000 15.000 - -78.26% -
433.milc (avg) -93.72% 239.000 15.000 - -78.26% -
450.soplex -92.70% 178.000 13.000 - -63.89% -
450.soplex (avg) -92.70% 178.000 13.000 - -63.89% -
482.sphinx3 (max) -90.64% 812.000 76.000 - -91.66% -
434.zeusmp -90.52% 211.000 20.000 - -86.39% -
434.zeusmp (avg) -90.52% 211.000 20.000 - -86.39% -
453.povray -89.87% 79.000 8.000 - -80.95% -
453.povray (avg) -89.87% 79.000 8.000 - -80.95% -
470.lbm -89.36% 282.000 30.000 - -87.45% -
470.lbm (avg) -89.36% 282.000 30.000 - -87.45% -
434.zeusmp (max) -89.33% 403.000 43.000 - -97.91% -
434.zeusmp (unexplained diff vs previous) -88.75% 391.000 44.000 - -99.61% -
416.gamess (max) (percentage) -87.67% 2.920 0.360 - -99.07% -
453.povray (max) -83.11% 148.000 25.000 - -94.99% -
470.lbm (max) -83.02% 577.000 98.000 - -96.43% -
433.milc (max) -81.86% 397.000 72.000 - -93.10% -
454.calculix (max) (percentage) -81.74% 4.490 0.820 - -99.18% -
470.lbm (unexplained diff vs previous) -81.16% 536.000 101.000 - -98.99% -
450.soplex (max) -80.95% 336.000 64.000 - -88.26% -
410.bwaves -80.58% 242.000 47.000 - -81.12% -
410.bwaves (avg) -80.58% 242.000 47.000 - -81.12% -
433.milc (unexplained diff vs previous) -80.05% 386.000 77.000 - -99.32% -
481.wrf (max) (percentage) -80.00% 3.950 0.790 - -98.85% -
456.hmmer (max) (percentage) -79.76% 1.680 0.340 - -99.54% -
447.dealII -73.91% 69.000 18.000 - -81.82% -
447.dealII (avg) -73.91% 69.000 18.000 - -81.82% -
436.cactusADM (max) (percentage) -72.87% 3.170 0.860 - -99.03% -
444.namd (avg) (percentage) -72.71% 4.250 1.160 - -87.42% -
465.tonto (max) (percentage) -69.92% 2.660 0.800 - -95.86% -
459.GemsFDTD -68.23% 192.000 61.000 - -83.06% -
459.GemsFDTD (avg) -68.23% 192.000 61.000 - -83.06% -
470.lbm (avg) (percentage) -64.35% 2.300 0.820 - -87.05% -
435.gromacs (max) -63.34% 401.000 147.000 - -95.89% -
465.tonto (max) -61.71% 222.000 85.000 - -95.98% -
416.gamess (avg) (percentage) -58.92% 1.850 0.760 - -82.81% -
462.libquantum (max) -57.14% 21.000 9.000 - -93.48% -
462.libquantum (unexplained diff vs previous) -57.14% 21.000 9.000 - -99.93% -
447.dealII (max) -56.48% 108.000 47.000 - -96.60% -
410.bwaves (max) -53.62% 304.000 141.000 - -95.70% -
410.bwaves (avg) (percentage) -52.27% 1.760 0.840 - -80.95% -
435.gromacs -52.08% 240.000 115.000 - -68.66% -
435.gromacs (avg) -52.08% 240.000 115.000 - -68.66% -
471.omnetpp -51.75% 114.000 55.000 - -75.34% -
471.omnetpp (avg) -51.75% 114.000 55.000 - -75.34% -
445.gobmk -45.57% 79.000 43.000 - -78.06% -
445.gobmk (avg) -45.57% 79.000 43.000 - -78.06% -
470.lbm (max) (percentage) -44.04% 4.700 2.630 - -96.37% -
434.zeusmp (avg) (percentage) -42.86% 1.540 0.880 - -84.96% -
444.namd (max) (percentage) -41.57% 7.530 4.400 - -95.21% -
436.cactusADM (avg) (percentage) -40.68% 1.770 1.050 - -82.44% -
470.lbm (unexplained diff vs previous) (percentage) -38.07% 4.360 2.700 - -98.98% -
437.leslie3d (max) -37.93% 638.000 396.000 - -79.47% -
434.zeusmp (max) (percentage) -35.84% 2.930 1.880 - -97.70% -
456.hmmer (avg) (percentage) -35.80% 0.810 0.520 - -88.21% -
434.zeusmp (unexplained diff vs previous) (percentage) -32.75% 2.840 1.910 - -99.57% -
433.milc (avg) (percentage) -25.97% 1.810 1.340 - -77.85% -
471.omnetpp (max) -23.30% 206.000 158.000 - -92.72% -
459.GemsFDTD (max) -18.94% 264.000 214.000 - -95.15% -
435.gromacs (max) (percentage) -18.75% 2.560 2.080 - -95.77% -
445.gobmk (max) -16.88% 160.000 133.000 - -94.97% -
400.perlbench (max) (percentage) -11.72% 2.390 2.110 - -97.49% -
437.leslie3d (max) (percentage) -11.51% 4.170 3.690 - -77.74% -
401.bzip2 -9.80% 51.000 46.000 - -71.43% -
401.bzip2 (avg) -9.80% 51.000 46.000 - -71.43% -
465.tonto (avg) (percentage) -8.09% 1.360 1.250 - -62.57% -
481.wrf (avg) (percentage) -4.26% 1.880 1.800 - -71.15% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 31.03% 29.000 38.000 - 31.03% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.40% 16760.000 17832.000 - 6.45% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 29.14% 1424.000 1839.000 - -89.32% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 39.02% 3.050 4.240 - 70.28% -
437.leslie3d 28.17% 355.000 455.000 - 19.42% -
437.leslie3d (avg) 28.17% 355.000 455.000 - 19.42% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - -31.03% -
nb_execution_successful -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.69% 59479.000 54310.000 - -8.71% -
459.GemsFDTD -4.85% 244728.000 232852.000 - -4.85% -
447.dealII -2.15% 311591.000 304898.000 - -2.17% -
462.libquantum -1.89% 16085.000 15781.000 - -1.89% -
434.zeusmp -1.82% 152037.000 149263.000 - -1.82% -
435.gromacs -1.77% 499261.000 490446.000 - -1.80% -
433.milc -1.53% 61382.000 60440.000 - -1.53% -
470.lbm -1.49% 9691.000 9547.000 - -1.45% -
453.povray -1.26% 661389.000 653088.000 - -0.66% -
444.namd -1.24% 188385.000 186052.000 - -1.24% -
401.bzip2 -1.13% 44233.000 43735.000 - -1.13% -
473.astar -1.04% 22968.000 22728.000 - -1.04% -
482.sphinx3 -1.03% 112859.000 111702.000 - -1.05% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -24.36% 6173.000 4669.000 - -79.88% -
482.sphinx3 -13.86% 945.000 814.000 - -97.24% -
434.zeusmp -8.43% 2514.000 2302.000 - -83.27% -
462.libquantum -7.86% 140.000 129.000 - -98.88% -
437.leslie3d -7.79% 11640.000 10733.000 - -29.94% -
447.dealII -6.32% 1724.000 1615.000 - -82.12% -
450.soplex -4.23% 567.000 543.000 - -96.63% -
445.gobmk -3.64% 5023.000 4840.000 - -58.71% -
473.astar -3.51% 5128.000 4948.000 - -65.10% -
471.omnetpp -3.16% 2724.000 2638.000 - -75.11% -
401.bzip2 -2.99% 2941.000 2853.000 - -81.06% -
435.gromacs -2.74% 7269.000 7070.000 - -54.93% -
433.milc -2.61% 1151.000 1121.000 - -91.51% -
444.namd -2.54% 747.000 728.000 - -92.52% -
465.tonto -2.33% 10941.000 10686.000 - 27.55% -
458.sjeng -2.25% 7567.000 7397.000 - -47.20% -
453.povray -1.46% 547.000 539.000 - -91.49% -
470.lbm -1.35% 3788.000 3737.000 - -69.60% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.93% 13518.000 9.000 - -57.14% -
462.libquantum (unexplained diff vs previous) (percentage) -99.93% 9655.710 6.980 - 3777.78% -
434.zeusmp (unexplained diff vs previous) -99.61% 11280.000 44.000 - -88.75% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.57% 448.690 1.910 - -32.75% -
456.hmmer (max) (percentage) -99.54% 73.590 0.340 - -79.76% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 12.12% -
433.milc (unexplained diff vs previous) -99.32% 11289.000 77.000 - -80.05% -
433.milc (unexplained diff vs previous) (percentage) -99.30% 980.800 6.870 - 135.27% -
429.mcf (unexplained diff vs previous) (percentage) -99.18% 1305.690 10.710 - 1222.22% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - -81.74% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - -87.67% -
436.cactusADM (max) (percentage) -99.03% 88.730 0.860 - -72.87% -
470.lbm (unexplained diff vs previous) -98.99% 9990.000 101.000 - -81.16% -
470.lbm (unexplained diff vs previous) (percentage) -98.98% 263.730 2.700 - -38.07% -
429.mcf (unexplained diff vs previous) -98.94% 18593.000 197.000 - 40.71% -
481.wrf (max) (percentage) -98.85% 68.700 0.790 - -80.00% -
471.omnetpp (unexplained diff vs previous) -98.58% 10659.000 151.000 - 29.06% -
471.omnetpp (unexplained diff vs previous) (percentage) -98.54% 391.300 5.720 - 420.00% -
458.sjeng (unexplained diff vs previous) -98.05% 6876.000 134.000 - 262.16% -
458.sjeng (unexplained diff vs previous) (percentage) -98.01% 90.870 1.810 - 596.15% -
434.zeusmp (max) -97.91% 2055.000 43.000 - -89.33% -
434.zeusmp (max) (percentage) -97.70% 81.770 1.880 - -35.84% -
400.perlbench (max) (percentage) -97.49% 84.060 2.110 - -11.72% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 58.04% -
473.astar (unexplained diff vs previous) -97.11% 10146.000 293.000 - 4085.71% -
473.astar (unexplained diff vs previous) (percentage) -97.01% 197.850 5.920 - 11740.00% -
447.dealII (max) -96.60% 1384.000 47.000 - -56.48% -
470.lbm (max) -96.43% 2746.000 98.000 - -83.02% -
470.lbm (max) (percentage) -96.37% 72.510 2.630 - -44.04% -
458.sjeng (max) -96.36% 3602.000 131.000 - 263.89% -
447.dealII (max) (percentage) -96.31% 80.280 2.960 - 146.67% -
403.gcc (max) (percentage) -96.28% 99.360 3.700 - 413.89% -
458.sjeng (max) (percentage) -96.26% 47.610 1.780 - 584.62% -
465.tonto (max) -95.98% 2112.000 85.000 - -61.71% -
435.gromacs (max) -95.89% 3573.000 147.000 - -63.34% -
465.tonto (max) (percentage) -95.86% 19.310 0.800 - -69.92% -
435.gromacs (max) (percentage) -95.77% 49.160 2.080 - -18.75% -
410.bwaves (max) (percentage) -95.70% 57.970 2.490 - 12.67% -
410.bwaves (max) -95.70% 3276.000 141.000 - -53.62% -
444.namd (max) -95.33% 685.000 32.000 - -95.63% -
444.namd (max) (percentage) -95.21% 91.790 4.400 - -41.57% -
459.GemsFDTD (max) -95.15% 4411.000 214.000 - -18.94% -
453.povray (max) -94.99% 499.000 25.000 - -83.11% -
445.gobmk (max) -94.97% 2643.000 133.000 - -16.88% -
453.povray (max) (percentage) -94.89% 91.250 4.660 - 99.15% -
445.gobmk (max) (percentage) -94.76% 52.630 2.760 - 101.46% -
459.GemsFDTD (max) (percentage) -93.56% 71.460 4.600 - 303.51% -
462.libquantum (max) -93.48% 138.000 9.000 - -57.14% -
433.milc (max) -93.10% 1044.000 72.000 - -81.86% -
462.libquantum (max) (percentage) -92.95% 98.970 6.980 - 3573.68% -
433.milc (max) (percentage) -92.91% 90.750 6.430 - 113.62% -
471.omnetpp (max) -92.72% 2169.000 158.000 - -23.30% -
471.omnetpp (max) (percentage) -92.48% 79.650 5.990 - 207.18% -
473.astar (max) -91.90% 3406.000 276.000 - 1352.63% -
482.sphinx3 (max) -91.66% 911.000 76.000 - -90.64% -
473.astar (max) (percentage) -91.59% 66.430 5.590 - 3892.86% -
482.sphinx3 (max) (percentage) -90.28% 96.500 9.380 - 239.86% -
429.mcf (max) (percentage) -89.58% 92.890 9.680 - 1080.49% -
401.bzip2 (max) -88.89% 2313.000 257.000 - 497.67% -
401.bzip2 (max) (percentage) -88.53% 78.650 9.020 - 3010.34% -
450.soplex (max) -88.26% 545.000 64.000 - -80.95% -
444.namd -88.24% 68.000 8.000 - -98.06% -
444.namd (avg) -88.24% 68.000 8.000 - -98.06% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - -35.80% -
450.soplex (max) (percentage) -87.58% 96.240 11.950 - 471.77% -
470.lbm -87.45% 239.000 30.000 - -89.36% -
470.lbm (avg) -87.45% 239.000 30.000 - -89.36% -
444.namd (avg) (percentage) -87.42% 9.220 1.160 - -72.71% -
470.lbm (avg) (percentage) -87.05% 6.330 0.820 - -64.35% -
429.mcf (max) -86.54% 1322.000 178.000 - 26.24% -
434.zeusmp -86.39% 147.000 20.000 - -90.52% -
434.zeusmp (avg) -86.39% 147.000 20.000 - -90.52% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 129.03% -
434.zeusmp (avg) (percentage) -84.96% 5.850 0.880 - -42.86% -
459.GemsFDTD -83.06% 360.000 61.000 - -68.23% -
459.GemsFDTD (avg) -83.06% 360.000 61.000 - -68.23% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -58.92% -
458.sjeng -82.57% 241.000 42.000 - 82.61% -
458.sjeng (avg) -82.57% 241.000 42.000 - 82.61% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - -40.68% -
447.dealII -81.82% 99.000 18.000 - -73.91% -
447.dealII (avg) -81.82% 99.000 18.000 - -73.91% -
458.sjeng (avg) (percentage) -81.82% 3.190 0.580 - 241.18% -
410.bwaves -81.12% 249.000 47.000 - -80.58% -
410.bwaves (avg) -81.12% 249.000 47.000 - -80.58% -
482.sphinx3 -81.08% 74.000 14.000 - -97.38% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -97.38% -
410.bwaves (avg) (percentage) -80.95% 4.410 0.840 - -52.27% -
453.povray -80.95% 42.000 8.000 - -89.87% -
453.povray (avg) -80.95% 42.000 8.000 - -89.87% -
447.dealII (avg) (percentage) -80.07% 5.770 1.150 - 49.35% -
462.libquantum -80.00% 10.000 2.000 - -95.24% -
462.libquantum (avg) -80.00% 10.000 2.000 - -95.24% -
437.leslie3d (max) -79.47% 1929.000 396.000 - -37.93% -
453.povray (avg) (percentage) -78.87% 7.810 1.650 - 32.00% -
433.milc -78.26% 69.000 15.000 - -93.72% -
433.milc (avg) -78.26% 69.000 15.000 - -93.72% -
445.gobmk -78.06% 196.000 43.000 - -45.57% -
445.gobmk (avg) -78.06% 196.000 43.000 - -45.57% -
433.milc (avg) (percentage) -77.85% 6.050 1.340 - -25.97% -
437.leslie3d (max) (percentage) -77.74% 16.580 3.690 - -11.51% -
459.GemsFDTD (avg) (percentage) -77.40% 5.840 1.320 - 59.04% -
445.gobmk (avg) (percentage) -77.24% 3.910 0.890 - 30.88% -
482.sphinx3 (avg) (percentage) -76.92% 7.930 1.830 - 0.55% -
471.omnetpp -75.34% 223.000 55.000 - -51.75% -
471.omnetpp (avg) -75.34% 223.000 55.000 - -51.75% -
471.omnetpp (avg) (percentage) -74.39% 8.200 2.100 - 94.44% -
462.libquantum (avg) (percentage) -74.28% 7.660 1.970 - 432.43% -
401.bzip2 -71.43% 161.000 46.000 - -9.80% -
401.bzip2 (avg) -71.43% 161.000 46.000 - -9.80% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -4.26% -
401.bzip2 (avg) (percentage) -70.07% 5.480 1.640 - 382.35% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 41.61% -
435.gromacs -68.66% 367.000 115.000 - -52.08% -
435.gromacs (avg) -68.66% 367.000 115.000 - -52.08% -
435.gromacs (avg) (percentage) -67.59% 5.060 1.640 - 7.19% -
450.soplex -63.89% 36.000 13.000 - -92.70% -
450.soplex (avg) -63.89% 36.000 13.000 - -92.70% -
465.tonto -63.56% 365.000 133.000 - 17.70% -
465.tonto (avg) -63.56% 365.000 133.000 - 17.70% -
465.tonto (avg) (percentage) -62.57% 3.340 1.250 - -8.09% -
473.astar -61.50% 213.000 82.000 - 241.67% -
473.astar (avg) -61.50% 213.000 82.000 - 241.67% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 127.93% -
473.astar (avg) (percentage) -60.10% 4.160 1.660 - 876.47% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 146.58% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 362.50% -
429.mcf (avg) (percentage) -40.55% 7.670 4.560 - 1420.00% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1354.29% -
429.mcf -23.85% 109.000 83.000 - 62.75% -
429.mcf (avg) -23.85% 109.000 83.000 - 62.75% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 31.03% -

Report Time: 0.37s
Execution (seconds)
Name Current %
401.bzip2 2853.000 -81.06%
410.bwaves 5682.000 -58.82%
429.mcf 1839.000 -89.32%
433.milc 1121.000 -91.51%
434.zeusmp 2302.000 -83.27%
435.gromacs 7070.000 -54.93%
437.leslie3d 10733.000 -29.94%
444.namd 728.000 -92.52%
445.gobmk 4840.000 -58.71%
447.dealII 1615.000 -82.12%
450.soplex 543.000 -96.63%
453.povray 539.000 -91.49%
458.sjeng 7397.000 -47.20%
459.GemsFDTD 4669.000 -79.88%
462.libquantum 129.000 -98.88%
465.tonto 10686.000 27.55%
470.lbm 3737.000 -69.60%
471.omnetpp 2638.000 -75.11%
473.astar 4948.000 -65.10%
482.sphinx3 814.000 -97.24%
Geometric Mean 2307.892 -82.59%
Code Size (bytes)
Name Current %
401.bzip2 43735.000 -1.13%
410.bwaves 17832.000 6.45%
429.mcf 9086.000 -
433.milc 60440.000 -1.53%
434.zeusmp 149263.000 -1.82%
435.gromacs 490446.000 -1.80%
437.leslie3d 54310.000 -8.71%
444.namd 186052.000 -1.24%
445.gobmk 1374806.000 -
447.dealII 304898.000 -2.17%
450.soplex 203251.000 -
453.povray 653088.000 -
458.sjeng 103327.000 -4.47%
459.GemsFDTD 232852.000 -4.85%
462.libquantum 15781.000 -1.89%
465.tonto 1964847.000 -
470.lbm 9547.000 -1.45%
471.omnetpp 475129.000 -
473.astar 22728.000 -1.04%
482.sphinx3 111702.000 -1.05%
Geometric Mean 114554.485 -1.47%
Score
Name Current %
nb_compile_successful 20.000 -31.03%
nb_execution_successful 20.000 -31.03%
nb_total_tests 38.000 31.03%
Geometric Mean 24.771 -14.58%
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 41.61%
400.perlbench (max) (percentage) 2.110 -11.72%
401.bzip2 46.000 -9.80%
401.bzip2 (avg) 46.000 -9.80%
401.bzip2 (avg) (percentage) 1.640 382.35%
401.bzip2 (max) 257.000 497.67%
401.bzip2 (max) (percentage) 9.020 3010.34%
403.gcc (avg) (percentage) 5.090 1354.29%
403.gcc (max) (percentage) 3.700 413.89%
410.bwaves 47.000 -80.58%
410.bwaves (avg) 47.000 -80.58%
410.bwaves (avg) (percentage) 0.840 -52.27%
410.bwaves (max) 141.000 -53.62%
410.bwaves (max) (percentage) 2.490 12.67%
416.gamess (avg) (percentage) 0.760 -58.92%
416.gamess (max) (percentage) 0.360 -87.67%
429.mcf 83.000 62.75%
429.mcf (avg) 83.000 62.75%
429.mcf (avg) (percentage) 4.560 1420.00%
429.mcf (max) 178.000 26.24%
429.mcf (max) (percentage) 9.680 1080.49%
429.mcf (unexplained diff vs previous) 197.000 40.71%
429.mcf (unexplained diff vs previous) (percentage) 10.710 1222.22%
433.milc 15.000 -93.72%
433.milc (avg) 15.000 -93.72%
433.milc (avg) (percentage) 1.340 -25.97%
433.milc (max) 72.000 -81.86%
433.milc (max) (percentage) 6.430 113.62%
433.milc (unexplained diff vs previous) 77.000 -80.05%
433.milc (unexplained diff vs previous) (percentage) 6.870 135.27%
434.zeusmp 20.000 -90.52%
434.zeusmp (avg) 20.000 -90.52%
434.zeusmp (avg) (percentage) 0.880 -42.86%
434.zeusmp (max) 43.000 -89.33%
434.zeusmp (max) (percentage) 1.880 -35.84%
434.zeusmp (unexplained diff vs previous) 44.000 -88.75%
434.zeusmp (unexplained diff vs previous) (percentage) 1.910 -32.75%
435.gromacs 115.000 -52.08%
435.gromacs (avg) 115.000 -52.08%
435.gromacs (avg) (percentage) 1.640 7.19%
435.gromacs (max) 147.000 -63.34%
435.gromacs (max) (percentage) 2.080 -18.75%
436.cactusADM (avg) (percentage) 1.050 -40.68%
436.cactusADM (max) (percentage) 0.860 -72.87%
437.leslie3d 455.000 19.42%
437.leslie3d (avg) 455.000 19.42%
437.leslie3d (avg) (percentage) 4.240 70.28%
437.leslie3d (max) 396.000 -37.93%
437.leslie3d (max) (percentage) 3.690 -11.51%
444.namd 8.000 -98.06%
444.namd (avg) 8.000 -98.06%
444.namd (avg) (percentage) 1.160 -72.71%
444.namd (max) 32.000 -95.63%
444.namd (max) (percentage) 4.400 -41.57%
445.gobmk 43.000 -45.57%
445.gobmk (avg) 43.000 -45.57%
445.gobmk (avg) (percentage) 0.890 30.88%
445.gobmk (max) 133.000 -16.88%
445.gobmk (max) (percentage) 2.760 101.46%
447.dealII 18.000 -73.91%
447.dealII (avg) 18.000 -73.91%
447.dealII (avg) (percentage) 1.150 49.35%
447.dealII (max) 47.000 -56.48%
447.dealII (max) (percentage) 2.960 146.67%
450.soplex 13.000 -92.70%
450.soplex (avg) 13.000 -92.70%
450.soplex (avg) (percentage) 2.530 127.93%
450.soplex (max) 64.000 -80.95%
450.soplex (max) (percentage) 11.950 471.77%
453.povray 8.000 -89.87%
453.povray (avg) 8.000 -89.87%
453.povray (avg) (percentage) 1.650 32.00%
453.povray (max) 25.000 -83.11%
453.povray (max) (percentage) 4.660 99.15%
454.calculix (avg) (percentage) 3.600 146.58%
454.calculix (max) (percentage) 0.820 -81.74%
456.hmmer (avg) (percentage) 0.520 -35.80%
456.hmmer (max) (percentage) 0.340 -79.76%
458.sjeng 42.000 82.61%
458.sjeng (avg) 42.000 82.61%
458.sjeng (avg) (percentage) 0.580 241.18%
458.sjeng (max) 131.000 263.89%
458.sjeng (max) (percentage) 1.780 584.62%
458.sjeng (unexplained diff vs previous) 134.000 262.16%
458.sjeng (unexplained diff vs previous) (percentage) 1.810 596.15%
459.GemsFDTD 61.000 -68.23%
459.GemsFDTD (avg) 61.000 -68.23%
459.GemsFDTD (avg) (percentage) 1.320 59.04%
459.GemsFDTD (max) 214.000 -18.94%
459.GemsFDTD (max) (percentage) 4.600 303.51%
462.libquantum 2.000 -95.24%
462.libquantum (avg) 2.000 -95.24%
462.libquantum (avg) (percentage) 1.970 432.43%
462.libquantum (max) 9.000 -57.14%
462.libquantum (max) (percentage) 6.980 3573.68%
462.libquantum (unexplained diff vs previous) 9.000 -57.14%
462.libquantum (unexplained diff vs previous) (percentage) 6.980 3777.78%
464.h264ref (avg) (percentage) 0.710 129.03%
464.h264ref (max) (percentage) 0.370 12.12%
465.tonto 133.000 17.70%
465.tonto (avg) 133.000 17.70%
465.tonto (avg) (percentage) 1.250 -8.09%
465.tonto (max) 85.000 -61.71%
465.tonto (max) (percentage) 0.800 -69.92%
470.lbm 30.000 -89.36%
470.lbm (avg) 30.000 -89.36%
470.lbm (avg) (percentage) 0.820 -64.35%
470.lbm (max) 98.000 -83.02%
470.lbm (max) (percentage) 2.630 -44.04%
470.lbm (unexplained diff vs previous) 101.000 -81.16%
470.lbm (unexplained diff vs previous) (percentage) 2.700 -38.07%
471.omnetpp 55.000 -51.75%
471.omnetpp (avg) 55.000 -51.75%
471.omnetpp (avg) (percentage) 2.100 94.44%
471.omnetpp (max) 158.000 -23.30%
471.omnetpp (max) (percentage) 5.990 207.18%
471.omnetpp (unexplained diff vs previous) 151.000 29.06%
471.omnetpp (unexplained diff vs previous) (percentage) 5.720 420.00%
473.astar 82.000 241.67%
473.astar (avg) 82.000 241.67%
473.astar (avg) (percentage) 1.660 876.47%
473.astar (max) 276.000 1352.63%
473.astar (max) (percentage) 5.590 3892.86%
473.astar (unexplained diff vs previous) 293.000 4085.71%
473.astar (unexplained diff vs previous) (percentage) 5.920 11740.00%
481.wrf (avg) (percentage) 1.800 -4.26%
481.wrf (max) (percentage) 0.790 -80.00%
482.sphinx3 14.000 -97.38%
482.sphinx3 (avg) 14.000 -97.38%
482.sphinx3 (avg) (percentage) 1.830 -
482.sphinx3 (max) 76.000 -90.64%
482.sphinx3 (max) (percentage) 9.380 239.86%
483.xalancbmk (avg) (percentage) 2.960 362.50%
483.xalancbmk (max) (percentage) 1.770 58.04%
Geometric Mean 10.674 -17.40%