Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=db00f6c3aceabbf03acdb69e74b59b2d2b043cd7 (+ 101 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (4a8685911697c237ff8c0589827eb8649f8440f1) (+ 265 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c69e8cccaff8f2d89cee43202623b33e6ef5d24a (+ 42 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/11747c52c04a32dd5e83ebffaf8030e0155c6ee7 (+ 109 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/330/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0330 (4-changed-components) 2024-11-23T07:32:21 0:00:00
Previous 0330 (-00000-) 2022-11-11T16:01:26 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 51 11
Performance Improvements 130 167
Unchanged Tests 1055 1058
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
465.tonto 1.18% 1948611.000 1971631.000 - 1.31% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 29.83% 8430.000 10945.000 - 0.04% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) (percentage) 5410.00% 0.200 11.020 - -88.14% -
429.mcf (avg) (percentage) 1904.17% 0.240 4.810 - -37.29% -
403.gcc (avg) (percentage) 1239.47% 0.380 5.090 - -30.46% -
473.astar (avg) (percentage) 1042.86% 0.140 1.600 - -61.54% -
473.astar (max) (percentage) 912.50% 0.080 0.810 - -98.78% -
462.libquantum (max) (percentage) 692.86% 0.280 2.220 - -97.76% -
462.libquantum (unexplained diff vs previous) (percentage) 675.00% 0.280 2.170 - -99.98% -
429.mcf (max) 573.53% 34.000 229.000 - -82.68% -
403.gcc (max) (percentage) 408.11% 0.740 3.760 - -96.22% -
462.libquantum (avg) (percentage) 338.10% 0.420 1.840 - -75.98% -
473.astar 326.32% 19.000 81.000 - -61.97% -
473.astar (avg) 326.32% 19.000 81.000 - -61.97% -
473.astar (max) 272.73% 11.000 41.000 - -98.80% -
401.bzip2 (unexplained diff vs previous) (percentage) 244.83% 0.290 1.000 - -99.73% -
483.xalancbmk (avg) (percentage) 211.58% 0.950 2.960 - -54.46% -
458.sjeng (avg) (percentage) 205.00% 0.200 0.610 - -80.88% -
401.bzip2 (avg) (percentage) 162.26% 0.530 1.390 - -74.64% -
454.calculix (avg) (percentage) 158.99% 1.390 3.600 - -55.11% -
429.mcf (unexplained diff vs previous) (percentage) 152.63% 0.190 0.480 - -99.96% -
429.mcf 143.90% 41.000 100.000 - -8.26% -
429.mcf (avg) 143.90% 41.000 100.000 - -8.26% -
464.h264ref (avg) (percentage) 121.87% 0.320 0.710 - -86.05% -
450.soplex (avg) (percentage) 114.04% 1.140 2.440 - -62.05% -
465.tonto (max) 109.38% 128.000 268.000 - -87.31% -
458.sjeng (unexplained diff vs previous) (percentage) 107.69% 0.130 0.270 - -99.70% -
458.sjeng (max) (percentage) 98.21% 0.560 1.110 - -97.67% -
437.leslie3d (avg) (percentage) 93.91% 2.300 4.460 - 46.23% -
471.omnetpp (unexplained diff vs previous) (percentage) 93.33% 0.150 0.290 - -99.93% -
459.GemsFDTD (max) (percentage) 70.91% 1.650 2.820 - -96.05% -
471.omnetpp (avg) (percentage) 68.29% 1.230 2.070 - -74.76% -
465.tonto (max) (percentage) 60.13% 1.530 2.450 - -87.31% -
458.sjeng 57.14% 28.000 44.000 - -81.74% -
458.sjeng (avg) 57.14% 28.000 44.000 - -81.74% -
465.tonto 48.35% 91.000 135.000 - -63.01% -
465.tonto (avg) 48.35% 91.000 135.000 - -63.01% -
437.leslie3d 44.67% 338.000 489.000 - 37.75% -
437.leslie3d (avg) 44.67% 338.000 489.000 - 37.75% -
450.soplex (max) (percentage) 41.36% 2.200 3.110 - -96.77% -
401.bzip2 (max) (percentage) 35.62% 0.730 0.990 - -98.74% -
445.gobmk (avg) (percentage) 33.85% 0.650 0.870 - -77.75% -
447.dealII (avg) (percentage) 33.72% 0.860 1.150 - -80.07% -
459.GemsFDTD (avg) (percentage) 22.64% 1.060 1.300 - -77.74% -
465.tonto (avg) (percentage) 14.81% 1.080 1.240 - -62.87% -
471.omnetpp (max) (percentage) 12.18% 1.970 2.210 - -97.23% -
458.sjeng (unexplained diff vs previous) 11.11% 18.000 20.000 - -99.71% -
435.gromacs (avg) (percentage) 9.94% 1.610 1.770 - -65.02% -
458.sjeng (max) 2.53% 79.000 81.000 - -97.75% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -31.03% 29.000 20.000 - -31.03% -
nb_execution_successful -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -8.61% 59491.000 54370.000 - -8.59% -
434.zeusmp -4.44% 153713.000 146883.000 - -3.39% -
459.GemsFDTD -3.42% 245040.000 236656.000 - -3.30% -
447.dealII -2.00% 312518.000 306267.000 - -1.71% -
462.libquantum -1.99% 16117.000 15797.000 - -1.79% -
410.bwaves -1.70% 16748.000 16464.000 - -1.77% -
458.sjeng -1.63% 104004.000 102311.000 - -1.67% -
470.lbm -1.45% 9687.000 9547.000 - -1.49% -
435.gromacs -1.31% 500327.000 493760.000 - -1.10% -
450.soplex -1.30% 205068.000 202406.000 - -1.30% -
433.milc -1.21% 61222.000 60484.000 - -1.46% -
401.bzip2 -1.19% 44241.000 43715.000 - -1.17% -
444.namd -1.08% 188365.000 186336.000 - -1.09% -
471.omnetpp -1.07% 480176.000 475044.000 - -0.62% -
482.sphinx3 -1.02% 112839.000 111686.000 - -1.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.80% 11522.000 138.000 - -1.43% -
482.sphinx3 -97.18% 29918.000 844.000 - -10.69% -
450.soplex -96.29% 15730.000 583.000 - 2.82% -
453.povray -91.80% 6536.000 536.000 - -2.01% -
444.namd -91.47% 9029.000 770.000 - 3.08% -
433.milc -90.99% 12824.000 1156.000 - 0.43% -
429.mcf -87.87% 17187.000 2084.000 - 46.35% -
434.zeusmp -82.67% 13379.000 2319.000 - -7.76% -
447.dealII -81.64% 8977.000 1648.000 - -4.41% -
401.bzip2 -79.16% 14901.000 3105.000 - 5.58% -
459.GemsFDTD -77.49% 23602.000 5313.000 - -13.93% -
471.omnetpp -74.49% 10684.000 2725.000 - 0.04% -
470.lbm -70.52% 12804.000 3774.000 - -0.37% -
473.astar -63.92% 14189.000 5119.000 - -0.18% -
445.gobmk -57.31% 11523.000 4919.000 - -2.07% -
410.bwaves -56.84% 13630.000 5883.000 - 4.09% -
435.gromacs -53.93% 15314.000 7055.000 - -2.94% -
458.sjeng -48.49% 14241.000 7336.000 - -3.05% -
437.leslie3d -25.43% 14704.000 10965.000 - -5.80% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -99.75% 397.000 1.000 - -99.99% -
482.sphinx3 (unexplained diff vs previous) -99.31% 1015.000 7.000 - -99.97% -
459.GemsFDTD (unexplained diff vs previous) -99.18% 367.000 3.000 - -99.98% -
482.sphinx3 (max) -98.38% 1050.000 17.000 - -98.13% -
470.lbm (unexplained diff vs previous) -98.35% 666.000 11.000 - -99.89% -
444.namd -97.70% 392.000 9.000 - -86.76% -
444.namd (avg) -97.70% 392.000 9.000 - -86.76% -
434.zeusmp (unexplained diff vs previous) -97.68% 345.000 8.000 - -99.93% -
482.sphinx3 -97.57% 577.000 14.000 - -81.08% -
482.sphinx3 (avg) -97.57% 577.000 14.000 - -81.08% -
444.namd (max) -97.29% 665.000 18.000 - -97.37% -
453.povray (max) -97.21% 215.000 6.000 - -98.80% -
433.milc (unexplained diff vs previous) (percentage) -97.10% 3.100 0.090 - -99.99% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -96.13% 1.550 0.060 - -99.98% -
462.libquantum -95.83% 48.000 2.000 - -80.00% -
462.libquantum (avg) -95.83% 48.000 2.000 - -80.00% -
470.lbm (max) -95.16% 702.000 34.000 - -98.76% -
450.soplex (max) -94.80% 346.000 18.000 - -96.70% -
470.lbm (unexplained diff vs previous) (percentage) -94.42% 5.200 0.290 - -99.89% -
433.milc -94.31% 246.000 14.000 - -79.71% -
433.milc (avg) -94.31% 246.000 14.000 - -79.71% -
434.zeusmp (max) -93.73% 335.000 21.000 - -98.98% -
447.dealII (max) -93.38% 136.000 9.000 - -99.35% -
453.povray -92.52% 107.000 8.000 - -80.95% -
453.povray (avg) -92.52% 107.000 8.000 - -80.95% -
410.bwaves (unexplained diff vs previous) -92.38% 105.000 8.000 - -99.90% -
450.soplex -92.18% 179.000 14.000 - -61.11% -
450.soplex (avg) -92.18% 179.000 14.000 - -61.11% -
433.milc (max) -91.67% 384.000 32.000 - -96.93% -
462.libquantum (max) -90.62% 32.000 3.000 - -97.83% -
462.libquantum (unexplained diff vs previous) -90.62% 32.000 3.000 - -99.98% -
434.zeusmp -90.09% 212.000 21.000 - -85.71% -
434.zeusmp (avg) -90.09% 212.000 21.000 - -85.71% -
470.lbm -89.08% 284.000 31.000 - -87.03% -
470.lbm (avg) -89.08% 284.000 31.000 - -87.03% -
410.bwaves (max) -88.46% 624.000 72.000 - -97.80% -
416.gamess (max) (percentage) -88.33% 3.170 0.370 - -99.04% -
434.zeusmp (unexplained diff vs previous) (percentage) -86.82% 2.580 0.340 - -99.92% -
470.lbm (max) (percentage) -83.24% 5.490 0.920 - -98.73% -
410.bwaves -82.76% 290.000 50.000 - -79.92% -
410.bwaves (avg) -82.76% 290.000 50.000 - -79.92% -
481.wrf (max) (percentage) -82.39% 4.600 0.810 - -98.82% -
410.bwaves (unexplained diff vs previous) (percentage) -81.82% 0.770 0.140 - -99.90% -
454.calculix (max) (percentage) -77.16% 3.590 0.820 - -99.18% -
447.dealII -76.62% 77.000 18.000 - -81.82% -
447.dealII (avg) -76.62% 77.000 18.000 - -81.82% -
482.sphinx3 (unexplained diff vs previous) (percentage) -75.52% 3.390 0.830 - -99.97% -
473.astar (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.99% -
437.leslie3d (unexplained diff vs previous) -73.60% 663.000 175.000 - -92.44% -
410.bwaves (max) (percentage) -73.14% 4.580 1.230 - -97.88% -
444.namd (avg) (percentage) -73.10% 4.350 1.170 - -87.31% -
459.GemsFDTD -72.40% 250.000 69.000 - -80.83% -
459.GemsFDTD (avg) -72.40% 250.000 69.000 - -80.83% -
401.bzip2 (max) -72.22% 108.000 30.000 - -98.70% -
471.omnetpp (max) -71.43% 210.000 60.000 - -97.23% -
429.mcf (unexplained diff vs previous) -68.75% 32.000 10.000 - -99.95% -
444.namd (max) (percentage) -67.84% 7.370 2.370 - -97.42% -
436.cactusADM (max) (percentage) -67.77% 3.010 0.970 - -98.91% -
416.gamess (avg) (percentage) -66.07% 2.240 0.760 - -82.81% -
437.leslie3d (unexplained diff vs previous) (percentage) -64.52% 4.510 1.600 - -91.95% -
483.xalancbmk (max) (percentage) -64.39% 4.970 1.770 - -97.42% -
453.povray (max) (percentage) -64.13% 3.290 1.180 - -98.71% -
435.gromacs (max) -64.06% 384.000 138.000 - -96.14% -
434.zeusmp (max) (percentage) -63.35% 2.510 0.920 - -98.87% -
470.lbm (avg) (percentage) -62.61% 2.220 0.830 - -86.89% -
447.dealII (max) (percentage) -62.50% 1.520 0.570 - -99.29% -
445.gobmk (max) -62.12% 132.000 50.000 - -98.11% -
459.GemsFDTD (max) -61.70% 389.000 149.000 - -96.62% -
410.bwaves (avg) (percentage) -59.62% 2.130 0.860 - -80.50% -
471.omnetpp -57.25% 131.000 56.000 - -74.89% -
471.omnetpp (avg) -57.25% 131.000 56.000 - -74.89% -
471.omnetpp (unexplained diff vs previous) -50.00% 16.000 8.000 - -99.92% -
435.gromacs -49.59% 246.000 124.000 - -66.21% -
435.gromacs (avg) -49.59% 246.000 124.000 - -66.21% -
401.bzip2 -44.87% 78.000 43.000 - -73.29% -
401.bzip2 (avg) -44.87% 78.000 43.000 - -73.29% -
445.gobmk -43.24% 74.000 42.000 - -78.57% -
445.gobmk (avg) -43.24% 74.000 42.000 - -78.57% -
482.sphinx3 (max) (percentage) -42.45% 3.510 2.020 - -97.91% -
434.zeusmp (avg) (percentage) -41.51% 1.590 0.930 - -84.10% -
436.cactusADM (avg) (percentage) -40.00% 1.750 1.050 - -82.44% -
437.leslie3d (max) -38.39% 633.000 390.000 - -79.78% -
433.milc (avg) (percentage) -35.42% 1.920 1.240 - -79.50% -
401.bzip2 (unexplained diff vs previous) -27.91% 43.000 31.000 - -99.71% -
456.hmmer (max) (percentage) -27.69% 0.650 0.470 - -99.36% -
481.wrf (avg) (percentage) -26.83% 2.460 1.800 - -71.15% -
435.gromacs (max) (percentage) -21.91% 2.510 1.960 - -96.01% -
437.leslie3d (max) (percentage) -17.40% 4.310 3.560 - -78.53% -
400.perlbench (max) (percentage) -13.84% 3.180 2.740 - -96.74% -
482.sphinx3 (avg) (percentage) -11.92% 1.930 1.700 - -78.56% -
445.gobmk (max) (percentage) -10.43% 1.150 1.030 - -98.04% -
464.h264ref (max) (percentage) -8.70% 0.460 0.420 - -99.23% -
400.perlbench (avg) (percentage) -7.62% 2.100 1.940 - -69.45% -
453.povray (avg) (percentage) -6.71% 1.640 1.530 - -80.41% -
433.milc (max) (percentage) -6.33% 3.000 2.810 - -96.90% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 31.03% 29.000 38.000 - 31.03% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.31% 1946163.000 1971631.000 - 1.18% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 46.35% 1424.000 2084.000 - -87.87% -
401.bzip2 5.58% 2941.000 3105.000 - -79.16% -
410.bwaves 4.09% 5652.000 5883.000 - -56.84% -
444.namd 3.08% 747.000 770.000 - -91.47% -
450.soplex 2.82% 567.000 583.000 - -96.29% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 46.23% 3.050 4.460 - 93.91% -
437.leslie3d 37.75% 355.000 489.000 - 44.67% -
437.leslie3d (avg) 37.75% 355.000 489.000 - 44.67% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - -31.03% -
nb_execution_successful -31.03% 29.000 20.000 - -31.03% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.59% 59479.000 54370.000 - -8.61% -
434.zeusmp -3.39% 152037.000 146883.000 - -4.44% -
459.GemsFDTD -3.30% 244728.000 236656.000 - -3.42% -
462.libquantum -1.79% 16085.000 15797.000 - -1.99% -
410.bwaves -1.77% 16760.000 16464.000 - -1.70% -
447.dealII -1.71% 311591.000 306267.000 - -2.00% -
458.sjeng -1.67% 104048.000 102311.000 - -1.63% -
470.lbm -1.49% 9691.000 9547.000 - -1.45% -
433.milc -1.46% 61382.000 60484.000 - -1.21% -
450.soplex -1.30% 205081.000 202406.000 - -1.30% -
401.bzip2 -1.17% 44233.000 43715.000 - -1.19% -
453.povray -1.13% 661389.000 653921.000 - -0.58% -
435.gromacs -1.10% 499261.000 493760.000 - -1.31% -
444.namd -1.09% 188385.000 186336.000 - -1.08% -
482.sphinx3 -1.04% 112859.000 111686.000 - -1.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -13.93% 6173.000 5313.000 - -77.49% -
482.sphinx3 -10.69% 945.000 844.000 - -97.18% -
434.zeusmp -7.76% 2514.000 2319.000 - -82.67% -
437.leslie3d -5.80% 11640.000 10965.000 - -25.43% -
447.dealII -4.41% 1724.000 1648.000 - -81.64% -
458.sjeng -3.05% 7567.000 7336.000 - -48.49% -
435.gromacs -2.94% 7269.000 7055.000 - -53.93% -
445.gobmk -2.07% 5023.000 4919.000 - -57.31% -
453.povray -2.01% 547.000 536.000 - -91.80% -
462.libquantum -1.43% 140.000 138.000 - -98.80% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - -99.75% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - -97.10% -
473.astar (unexplained diff vs previous) -99.99% 10146.000 1.000 - -75.00% -
473.astar (unexplained diff vs previous) (percentage) -99.99% 197.850 0.020 - -33.33% -
459.GemsFDTD (unexplained diff vs previous) -99.98% 15458.000 3.000 - -99.18% -
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - -90.62% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.170 - 675.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.98% 250.410 0.060 - -96.13% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 7.000 - -99.31% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.830 - -75.52% -
429.mcf (unexplained diff vs previous) (percentage) -99.96% 1305.690 0.480 - 152.63% -
429.mcf (unexplained diff vs previous) -99.95% 18593.000 10.000 - -68.75% -
434.zeusmp (unexplained diff vs previous) -99.93% 11280.000 8.000 - -97.68% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.93% 391.300 0.290 - 93.33% -
471.omnetpp (unexplained diff vs previous) -99.92% 10659.000 8.000 - -50.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.92% 448.690 0.340 - -86.82% -
410.bwaves (unexplained diff vs previous) (percentage) -99.90% 137.900 0.140 - -81.82% -
410.bwaves (unexplained diff vs previous) -99.90% 7794.000 8.000 - -92.38% -
470.lbm (unexplained diff vs previous) (percentage) -99.89% 263.730 0.290 - -94.42% -
470.lbm (unexplained diff vs previous) -99.89% 9990.000 11.000 - -98.35% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.73% 368.340 1.000 - 244.83% -
401.bzip2 (unexplained diff vs previous) -99.71% 10833.000 31.000 - -27.91% -
458.sjeng (unexplained diff vs previous) -99.71% 6876.000 20.000 - 11.11% -
458.sjeng (unexplained diff vs previous) (percentage) -99.70% 90.870 0.270 - 107.69% -
456.hmmer (max) (percentage) -99.36% 73.590 0.470 - -27.69% -
447.dealII (max) -99.35% 1384.000 9.000 - -93.38% -
447.dealII (max) (percentage) -99.29% 80.280 0.570 - -62.50% -
464.h264ref (max) (percentage) -99.23% 54.290 0.420 - -8.70% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - -77.16% -
416.gamess (max) (percentage) -99.04% 38.550 0.370 - -88.33% -
434.zeusmp (max) -98.98% 2055.000 21.000 - -93.73% -
436.cactusADM (max) (percentage) -98.91% 88.730 0.970 - -67.77% -
434.zeusmp (max) (percentage) -98.87% 81.770 0.920 - -63.35% -
481.wrf (max) (percentage) -98.82% 68.700 0.810 - -82.39% -
453.povray (max) -98.80% 499.000 6.000 - -97.21% -
473.astar (max) -98.80% 3406.000 41.000 - 272.73% -
473.astar (max) (percentage) -98.78% 66.430 0.810 - 912.50% -
470.lbm (max) -98.76% 2746.000 34.000 - -95.16% -
401.bzip2 (max) (percentage) -98.74% 78.650 0.990 - 35.62% -
470.lbm (max) (percentage) -98.73% 72.510 0.920 - -83.24% -
453.povray (max) (percentage) -98.71% 91.250 1.180 - -64.13% -
401.bzip2 (max) -98.70% 2313.000 30.000 - -72.22% -
482.sphinx3 (max) -98.13% 911.000 17.000 - -98.38% -
445.gobmk (max) -98.11% 2643.000 50.000 - -62.12% -
445.gobmk (max) (percentage) -98.04% 52.630 1.030 - -10.43% -
482.sphinx3 (max) (percentage) -97.91% 96.500 2.020 - -42.45% -
410.bwaves (max) (percentage) -97.88% 57.970 1.230 - -73.14% -
462.libquantum (max) -97.83% 138.000 3.000 - -90.62% -
410.bwaves (max) -97.80% 3276.000 72.000 - -88.46% -
462.libquantum (max) (percentage) -97.76% 98.970 2.220 - 692.86% -
458.sjeng (max) -97.75% 3602.000 81.000 - 2.53% -
458.sjeng (max) (percentage) -97.67% 47.610 1.110 - 98.21% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - -64.39% -
444.namd (max) (percentage) -97.42% 91.790 2.370 - -67.84% -
444.namd (max) -97.37% 685.000 18.000 - -97.29% -
471.omnetpp (max) -97.23% 2169.000 60.000 - -71.43% -
471.omnetpp (max) (percentage) -97.23% 79.650 2.210 - 12.18% -
433.milc (max) -96.93% 1044.000 32.000 - -91.67% -
433.milc (max) (percentage) -96.90% 90.750 2.810 - -6.33% -
450.soplex (max) (percentage) -96.77% 96.240 3.110 - 41.36% -
400.perlbench (max) (percentage) -96.74% 84.060 2.740 - -13.84% -
450.soplex (max) -96.70% 545.000 18.000 - -94.80% -
459.GemsFDTD (max) -96.62% 4411.000 149.000 - -61.70% -
403.gcc (max) (percentage) -96.22% 99.360 3.760 - 408.11% -
435.gromacs (max) -96.14% 3573.000 138.000 - -64.06% -
459.GemsFDTD (max) (percentage) -96.05% 71.460 2.820 - 70.91% -
435.gromacs (max) (percentage) -96.01% 49.160 1.960 - -21.91% -
437.leslie3d (unexplained diff vs previous) -92.44% 2314.000 175.000 - -73.60% -
437.leslie3d (unexplained diff vs previous) (percentage) -91.95% 19.880 1.600 - -64.52% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
429.mcf (max) (percentage) -88.14% 92.890 11.020 - 5410.00% -
465.tonto (max) (percentage) -87.31% 19.310 2.450 - 60.13% -
465.tonto (max) -87.31% 2112.000 268.000 - 109.38% -
444.namd (avg) (percentage) -87.31% 9.220 1.170 - -73.10% -
470.lbm -87.03% 239.000 31.000 - -89.08% -
470.lbm (avg) -87.03% 239.000 31.000 - -89.08% -
470.lbm (avg) (percentage) -86.89% 6.330 0.830 - -62.61% -
444.namd -86.76% 68.000 9.000 - -97.70% -
444.namd (avg) -86.76% 68.000 9.000 - -97.70% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 121.87% -
434.zeusmp -85.71% 147.000 21.000 - -90.09% -
434.zeusmp (avg) -85.71% 147.000 21.000 - -90.09% -
434.zeusmp (avg) (percentage) -84.10% 5.850 0.930 - -41.51% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - -66.07% -
429.mcf (max) -82.68% 1322.000 229.000 - 573.53% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - -40.00% -
447.dealII -81.82% 99.000 18.000 - -76.62% -
447.dealII (avg) -81.82% 99.000 18.000 - -76.62% -
458.sjeng -81.74% 241.000 44.000 - 57.14% -
458.sjeng (avg) -81.74% 241.000 44.000 - 57.14% -
482.sphinx3 -81.08% 74.000 14.000 - -97.57% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -97.57% -
453.povray -80.95% 42.000 8.000 - -92.52% -
453.povray (avg) -80.95% 42.000 8.000 - -92.52% -
458.sjeng (avg) (percentage) -80.88% 3.190 0.610 - 205.00% -
459.GemsFDTD -80.83% 360.000 69.000 - -72.40% -
459.GemsFDTD (avg) -80.83% 360.000 69.000 - -72.40% -
410.bwaves (avg) (percentage) -80.50% 4.410 0.860 - -59.62% -
453.povray (avg) (percentage) -80.41% 7.810 1.530 - -6.71% -
447.dealII (avg) (percentage) -80.07% 5.770 1.150 - 33.72% -
462.libquantum -80.00% 10.000 2.000 - -95.83% -
462.libquantum (avg) -80.00% 10.000 2.000 - -95.83% -
410.bwaves -79.92% 249.000 50.000 - -82.76% -
410.bwaves (avg) -79.92% 249.000 50.000 - -82.76% -
437.leslie3d (max) -79.78% 1929.000 390.000 - -38.39% -
433.milc -79.71% 69.000 14.000 - -94.31% -
433.milc (avg) -79.71% 69.000 14.000 - -94.31% -
433.milc (avg) (percentage) -79.50% 6.050 1.240 - -35.42% -
445.gobmk -78.57% 196.000 42.000 - -43.24% -
445.gobmk (avg) -78.57% 196.000 42.000 - -43.24% -
482.sphinx3 (avg) (percentage) -78.56% 7.930 1.700 - -11.92% -
437.leslie3d (max) (percentage) -78.53% 16.580 3.560 - -17.40% -
445.gobmk (avg) (percentage) -77.75% 3.910 0.870 - 33.85% -
459.GemsFDTD (avg) (percentage) -77.74% 5.840 1.300 - 22.64% -
462.libquantum (avg) (percentage) -75.98% 7.660 1.840 - 338.10% -
471.omnetpp -74.89% 223.000 56.000 - -57.25% -
471.omnetpp (avg) -74.89% 223.000 56.000 - -57.25% -
471.omnetpp (avg) (percentage) -74.76% 8.200 2.070 - 68.29% -
401.bzip2 (avg) (percentage) -74.64% 5.480 1.390 - 162.26% -
401.bzip2 -73.29% 161.000 43.000 - -44.87% -
401.bzip2 (avg) -73.29% 161.000 43.000 - -44.87% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - -26.83% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - -7.62% -
435.gromacs -66.21% 367.000 124.000 - -49.59% -
435.gromacs (avg) -66.21% 367.000 124.000 - -49.59% -
435.gromacs (avg) (percentage) -65.02% 5.060 1.770 - 9.94% -
465.tonto -63.01% 365.000 135.000 - 48.35% -
465.tonto (avg) -63.01% 365.000 135.000 - 48.35% -
465.tonto (avg) (percentage) -62.87% 3.340 1.240 - 14.81% -
450.soplex (avg) (percentage) -62.05% 6.430 2.440 - 114.04% -
473.astar -61.97% 213.000 81.000 - 326.32% -
473.astar (avg) -61.97% 213.000 81.000 - 326.32% -
473.astar (avg) (percentage) -61.54% 4.160 1.600 - 1042.86% -
450.soplex -61.11% 36.000 14.000 - -92.18% -
450.soplex (avg) -61.11% 36.000 14.000 - -92.18% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 158.99% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 211.58% -
429.mcf (avg) (percentage) -37.29% 7.670 4.810 - 1904.17% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 1239.47% -
429.mcf -8.26% 109.000 100.000 - 143.90% -
429.mcf (avg) -8.26% 109.000 100.000 - 143.90% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 31.03% -

Report Time: 0.41s
Execution (seconds)
Name Current %
401.bzip2 3105.000 -79.16%
410.bwaves 5883.000 -56.84%
429.mcf 2084.000 -87.87%
433.milc 1156.000 -90.99%
434.zeusmp 2319.000 -82.67%
435.gromacs 7055.000 -53.93%
437.leslie3d 10965.000 -25.43%
444.namd 770.000 -91.47%
445.gobmk 4919.000 -57.31%
447.dealII 1648.000 -81.64%
450.soplex 583.000 -96.29%
453.povray 536.000 -91.80%
458.sjeng 7336.000 -48.49%
459.GemsFDTD 5313.000 -77.49%
462.libquantum 138.000 -98.80%
465.tonto 10945.000 29.83%
470.lbm 3774.000 -70.52%
471.omnetpp 2725.000 -74.49%
473.astar 5119.000 -63.92%
482.sphinx3 844.000 -97.18%
Geometric Mean 2400.234 -81.77%
Code Size (bytes)
Name Current %
401.bzip2 43715.000 -1.19%
410.bwaves 16464.000 -1.70%
429.mcf 9146.000 -
433.milc 60484.000 -1.21%
434.zeusmp 146883.000 -4.44%
435.gromacs 493760.000 -1.31%
437.leslie3d 54370.000 -8.61%
444.namd 186336.000 -1.08%
445.gobmk 1375086.000 -
447.dealII 306267.000 -2.00%
450.soplex 202406.000 -1.30%
453.povray 653921.000 -
458.sjeng 102311.000 -1.63%
459.GemsFDTD 236656.000 -3.42%
462.libquantum 15797.000 -1.99%
465.tonto 1971631.000 1.18%
470.lbm 9547.000 -1.45%
471.omnetpp 475044.000 -1.07%
473.astar 22752.000 -
482.sphinx3 111686.000 -1.02%
Geometric Mean 114174.982 -1.70%
Score
Name Current %
nb_compile_successful 20.000 -31.03%
nb_execution_successful 20.000 -31.03%
nb_total_tests 38.000 31.03%
Geometric Mean 24.771 -14.58%
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -7.62%
400.perlbench (max) (percentage) 2.740 -13.84%
401.bzip2 43.000 -44.87%
401.bzip2 (avg) 43.000 -44.87%
401.bzip2 (avg) (percentage) 1.390 162.26%
401.bzip2 (max) 30.000 -72.22%
401.bzip2 (max) (percentage) 0.990 35.62%
401.bzip2 (unexplained diff vs previous) 31.000 -27.91%
401.bzip2 (unexplained diff vs previous) (percentage) 1.000 244.83%
403.gcc (avg) (percentage) 5.090 1239.47%
403.gcc (max) (percentage) 3.760 408.11%
410.bwaves 50.000 -82.76%
410.bwaves (avg) 50.000 -82.76%
410.bwaves (avg) (percentage) 0.860 -59.62%
410.bwaves (max) 72.000 -88.46%
410.bwaves (max) (percentage) 1.230 -73.14%
410.bwaves (unexplained diff vs previous) 8.000 -92.38%
410.bwaves (unexplained diff vs previous) (percentage) 0.140 -81.82%
416.gamess (avg) (percentage) 0.760 -66.07%
416.gamess (max) (percentage) 0.370 -88.33%
429.mcf 100.000 143.90%
429.mcf (avg) 100.000 143.90%
429.mcf (avg) (percentage) 4.810 1904.17%
429.mcf (max) 229.000 573.53%
429.mcf (max) (percentage) 11.020 5410.00%
429.mcf (unexplained diff vs previous) 10.000 -68.75%
429.mcf (unexplained diff vs previous) (percentage) 0.480 152.63%
433.milc 14.000 -94.31%
433.milc (avg) 14.000 -94.31%
433.milc (avg) (percentage) 1.240 -35.42%
433.milc (max) 32.000 -91.67%
433.milc (max) (percentage) 2.810 -6.33%
433.milc (unexplained diff vs previous) 1.000 -99.75%
433.milc (unexplained diff vs previous) (percentage) 0.090 -97.10%
434.zeusmp 21.000 -90.09%
434.zeusmp (avg) 21.000 -90.09%
434.zeusmp (avg) (percentage) 0.930 -41.51%
434.zeusmp (max) 21.000 -93.73%
434.zeusmp (max) (percentage) 0.920 -63.35%
434.zeusmp (unexplained diff vs previous) 8.000 -97.68%
434.zeusmp (unexplained diff vs previous) (percentage) 0.340 -86.82%
435.gromacs 124.000 -49.59%
435.gromacs (avg) 124.000 -49.59%
435.gromacs (avg) (percentage) 1.770 9.94%
435.gromacs (max) 138.000 -64.06%
435.gromacs (max) (percentage) 1.960 -21.91%
436.cactusADM (avg) (percentage) 1.050 -40.00%
436.cactusADM (max) (percentage) 0.970 -67.77%
437.leslie3d 489.000 44.67%
437.leslie3d (avg) 489.000 44.67%
437.leslie3d (avg) (percentage) 4.460 93.91%
437.leslie3d (max) 390.000 -38.39%
437.leslie3d (max) (percentage) 3.560 -17.40%
437.leslie3d (unexplained diff vs previous) 175.000 -73.60%
437.leslie3d (unexplained diff vs previous) (percentage) 1.600 -64.52%
444.namd 9.000 -97.70%
444.namd (avg) 9.000 -97.70%
444.namd (avg) (percentage) 1.170 -73.10%
444.namd (max) 18.000 -97.29%
444.namd (max) (percentage) 2.370 -67.84%
445.gobmk 42.000 -43.24%
445.gobmk (avg) 42.000 -43.24%
445.gobmk (avg) (percentage) 0.870 33.85%
445.gobmk (max) 50.000 -62.12%
445.gobmk (max) (percentage) 1.030 -10.43%
447.dealII 18.000 -76.62%
447.dealII (avg) 18.000 -76.62%
447.dealII (avg) (percentage) 1.150 33.72%
447.dealII (max) 9.000 -93.38%
447.dealII (max) (percentage) 0.570 -62.50%
450.soplex 14.000 -92.18%
450.soplex (avg) 14.000 -92.18%
450.soplex (avg) (percentage) 2.440 114.04%
450.soplex (max) 18.000 -94.80%
450.soplex (max) (percentage) 3.110 41.36%
453.povray 8.000 -92.52%
453.povray (avg) 8.000 -92.52%
453.povray (avg) (percentage) 1.530 -6.71%
453.povray (max) 6.000 -97.21%
453.povray (max) (percentage) 1.180 -64.13%
454.calculix (avg) (percentage) 3.600 158.99%
454.calculix (max) (percentage) 0.820 -77.16%
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.470 -27.69%
458.sjeng 44.000 57.14%
458.sjeng (avg) 44.000 57.14%
458.sjeng (avg) (percentage) 0.610 205.00%
458.sjeng (max) 81.000 2.53%
458.sjeng (max) (percentage) 1.110 98.21%
458.sjeng (unexplained diff vs previous) 20.000 11.11%
458.sjeng (unexplained diff vs previous) (percentage) 0.270 107.69%
459.GemsFDTD 69.000 -72.40%
459.GemsFDTD (avg) 69.000 -72.40%
459.GemsFDTD (avg) (percentage) 1.300 22.64%
459.GemsFDTD (max) 149.000 -61.70%
459.GemsFDTD (max) (percentage) 2.820 70.91%
459.GemsFDTD (unexplained diff vs previous) 3.000 -99.18%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.060 -96.13%
462.libquantum 2.000 -95.83%
462.libquantum (avg) 2.000 -95.83%
462.libquantum (avg) (percentage) 1.840 338.10%
462.libquantum (max) 3.000 -90.62%
462.libquantum (max) (percentage) 2.220 692.86%
462.libquantum (unexplained diff vs previous) 3.000 -90.62%
462.libquantum (unexplained diff vs previous) (percentage) 2.170 675.00%
464.h264ref (avg) (percentage) 0.710 121.87%
464.h264ref (max) (percentage) 0.420 -8.70%
465.tonto 135.000 48.35%
465.tonto (avg) 135.000 48.35%
465.tonto (avg) (percentage) 1.240 14.81%
465.tonto (max) 268.000 109.38%
465.tonto (max) (percentage) 2.450 60.13%
470.lbm 31.000 -89.08%
470.lbm (avg) 31.000 -89.08%
470.lbm (avg) (percentage) 0.830 -62.61%
470.lbm (max) 34.000 -95.16%
470.lbm (max) (percentage) 0.920 -83.24%
470.lbm (unexplained diff vs previous) 11.000 -98.35%
470.lbm (unexplained diff vs previous) (percentage) 0.290 -94.42%
471.omnetpp 56.000 -57.25%
471.omnetpp (avg) 56.000 -57.25%
471.omnetpp (avg) (percentage) 2.070 68.29%
471.omnetpp (max) 60.000 -71.43%
471.omnetpp (max) (percentage) 2.210 12.18%
471.omnetpp (unexplained diff vs previous) 8.000 -50.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.290 93.33%
473.astar 81.000 326.32%
473.astar (avg) 81.000 326.32%
473.astar (avg) (percentage) 1.600 1042.86%
473.astar (max) 41.000 272.73%
473.astar (max) (percentage) 0.810 912.50%
473.astar (unexplained diff vs previous) 1.000 -75.00%
473.astar (unexplained diff vs previous) (percentage) 0.020 -
481.wrf (avg) (percentage) 1.800 -26.83%
481.wrf (max) (percentage) 0.810 -82.39%
482.sphinx3 14.000 -97.57%
482.sphinx3 (avg) 14.000 -97.57%
482.sphinx3 (avg) (percentage) 1.700 -11.92%
482.sphinx3 (max) 17.000 -98.38%
482.sphinx3 (max) (percentage) 2.020 -42.45%
482.sphinx3 (unexplained diff vs previous) 7.000 -99.31%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.830 -75.52%
483.xalancbmk (avg) (percentage) 2.960 211.58%
483.xalancbmk (max) (percentage) 1.770 -64.39%
Geometric Mean 5.650 -57.27%