Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4a50820ee8f153265ec8ffd068618607d4be3a26 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/8f8db5553935edcb4731db32279418ca37e1f094 (+ 61 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=06bbe63e367abd5f7b225cbae30d1e487f237c85 (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/160/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0160 (3-changed-components) 2023-11-27T04:49:46 0:00:00
Previous 0159 (basepoints/gcc-14-05868-g221166ad15e) 2023-11-25T19:39:02 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 26 11
Performance Improvements 56 177
Added Tests 50 0
Unchanged Tests 1104 1048
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
464.h264ref 1.05% 382352.000 386364.000 - -0.36% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 4.92% 2787.000 2924.000 - -0.58% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 1857.14% 7.000 137.000 - -98.74% -
401.bzip2 (unexplained diff vs previous) (percentage) 1776.00% 0.250 4.690 - -98.73% -
401.bzip2 (max) 1687.50% 8.000 143.000 - -93.82% -
401.bzip2 (max) (percentage) 1596.55% 0.290 4.920 - -93.74% -
473.astar (unexplained diff vs previous) 1025.00% 4.000 45.000 - -99.56% -
473.astar (unexplained diff vs previous) (percentage) 1025.00% 0.080 0.900 - -99.55% -
429.mcf (unexplained diff vs previous) (percentage) 240.30% 0.670 2.280 - -99.83% -
429.mcf (unexplained diff vs previous) 233.33% 12.000 40.000 - -99.78% -
462.libquantum (unexplained diff vs previous) (percentage) 105.56% 1.440 2.960 - -99.97% -
462.libquantum (unexplained diff vs previous) 100.00% 2.000 4.000 - -99.97% -
462.libquantum (max) (percentage) 97.26% 1.460 2.880 - -97.09% -
429.mcf (max) (percentage) 65.19% 1.350 2.230 - -97.60% -
429.mcf (max) 62.50% 24.000 39.000 - -97.05% -
462.libquantum (max) 50.00% 2.000 3.000 - -97.83% -
433.milc (unexplained diff vs previous) (percentage) 33.96% 0.530 0.710 - -99.93% -
433.milc (unexplained diff vs previous) 33.33% 6.000 8.000 - -99.93% -
444.namd (unexplained diff vs previous) (percentage) 25.93% 0.540 0.680 - -99.94% -
444.namd (unexplained diff vs previous) 25.00% 4.000 5.000 - -99.94% -
471.omnetpp (unexplained diff vs previous) 10.00% 10.000 11.000 - -99.90% -
401.bzip2 9.26% 54.000 59.000 - -63.35% -
401.bzip2 (avg) 9.26% 54.000 59.000 - -63.35% -
471.omnetpp (unexplained diff vs previous) (percentage) 7.89% 0.380 0.410 - -99.90% -
401.bzip2 (avg) (percentage) 3.06% 1.960 2.020 - -63.14% -
462.libquantum (avg) (percentage) 1.02% 1.960 1.980 - -74.15% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -15.62% 64.000 54.000 - -3.57% -
450.soplex -3.68% 570.000 549.000 - -3.17% -
462.libquantum -2.88% 139.000 135.000 - -3.57% -
429.mcf -2.23% 1791.000 1751.000 - 22.96% -
482.sphinx3 -1.29% 930.000 918.000 - -2.86% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -66.67% 0.030 0.010 - -99.99% -
458.sjeng (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.99% -
470.lbm (unexplained diff vs previous) (percentage) -35.56% 0.450 0.290 - -99.89% -
470.lbm (unexplained diff vs previous) -35.29% 17.000 11.000 - -99.89% -
403.gcc -33.33% 3.000 2.000 - -50.00% -
403.gcc (avg) -33.33% 3.000 2.000 - -50.00% -
403.gcc (max) -20.00% 5.000 4.000 - -92.73% -
470.lbm (max) (percentage) -13.33% 0.450 0.390 - -99.46% -
450.soplex (max) -12.50% 8.000 7.000 - -98.72% -
470.lbm (max) -12.50% 16.000 14.000 - -99.49% -
433.milc (max) -11.11% 9.000 8.000 - -99.23% -
458.sjeng (max) -9.52% 21.000 19.000 - -99.47% -
464.h264ref (max) (percentage) -9.52% 0.210 0.190 - -99.65% -
482.sphinx3 (max) (percentage) -9.30% 0.430 0.390 - -99.60% -
464.h264ref (max) -9.09% 11.000 10.000 - -99.68% -
456.hmmer (max) (percentage) -8.47% 0.590 0.540 - -99.27% -
433.milc (max) (percentage) -7.50% 0.800 0.740 - -99.18% -
458.sjeng (max) (percentage) -6.90% 0.290 0.270 - -99.43% -
456.hmmer (max) -6.25% 16.000 15.000 - -99.29% -
471.omnetpp (max) -5.41% 37.000 35.000 - -98.39% -
471.omnetpp (max) (percentage) -4.93% 1.420 1.350 - -98.31% -
453.povray (max) (percentage) -4.88% 1.230 1.170 - -98.72% -
447.dealII (max) (percentage) -4.84% 0.620 0.590 - -99.27% -
450.soplex (max) (percentage) -4.64% 1.510 1.440 - -98.50% -
444.namd (max) (percentage) -4.44% 0.900 0.860 - -99.06% -
429.mcf -3.36% 119.000 115.000 - 5.50% -
429.mcf (avg) -3.36% 119.000 115.000 - 5.50% -
400.perlbench (max) -2.94% 34.000 33.000 - -97.64% -
473.astar (max) (percentage) -2.71% 3.320 3.230 - -95.14% -
400.perlbench (max) (percentage) -2.63% 2.280 2.220 - -97.36% -
445.gobmk (max) -2.33% 43.000 42.000 - -98.41% -
445.gobmk (max) (percentage) -2.25% 0.890 0.870 - -98.35% -
454.calculix (max) (percentage) -1.95% 5.130 5.030 - -94.96% -
435.gromacs (max) (percentage) -1.94% 1.030 1.010 - -97.95% -
473.astar (max) -1.83% 164.000 161.000 - -95.27% -
436.cactusADM (max) (percentage) -1.72% 0.580 0.570 - -99.36% -
403.gcc (max) (percentage) -1.61% 9.290 9.140 - -90.80% -
437.leslie3d (max) (percentage) -1.55% 8.400 8.270 - -50.12% -
471.omnetpp (avg) (percentage) -1.54% 2.590 2.550 - -68.90% -
458.sjeng -1.47% 68.000 67.000 - -72.20% -
458.sjeng (avg) -1.47% 68.000 67.000 - -72.20% -
471.omnetpp -1.47% 68.000 67.000 - -69.96% -
471.omnetpp (avg) -1.47% 68.000 67.000 - -69.96% -
470.lbm (avg) (percentage) -1.34% 1.490 1.470 - -76.78% -
429.mcf (avg) (percentage) -1.20% 6.660 6.580 - -14.21% -
410.bwaves (max) (percentage) -1.15% 0.870 0.860 - -98.52% -
433.milc (avg) (percentage) -1.08% 1.850 1.830 - -69.75% -
458.sjeng (avg) (percentage) -1.08% 0.930 0.920 - -71.16% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 55.56% 18.000 28.000 - -3.45% -
nb_execution_successful 55.56% 18.000 28.000 - -3.45% -
nb_total_tests 50.00% 20.000 30.000 - 3.45% -

Added Tests - Code Size
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - Execution
410.bwaves
416.gamess
434.zeusmp
435.gromacs
436.cactusADM
437.leslie3d
454.calculix
459.GemsFDTD
465.tonto
481.wrf

Added Tests - sample variability
410.bwaves
410.bwaves (avg)
410.bwaves (max)
416.gamess
416.gamess (avg)
416.gamess (max)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (max)
435.gromacs
435.gromacs (avg)
435.gromacs (max)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (max)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (max)
454.calculix
454.calculix (avg)
454.calculix (max)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (max)
465.tonto
465.tonto (avg)
465.tonto (max)
481.wrf
481.wrf (avg)
481.wrf (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.72% 205081.000 208601.000 - -0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 22.96% 1424.000 1751.000 - -2.23% -
436.cactusADM 2.30% 2083.000 2131.000 - 0.00% -
465.tonto 2.09% 10941.000 11170.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 72.46% 3.050 5.260 - 0.00% -
437.leslie3d 55.77% 355.000 553.000 - 0.00% -
437.leslie3d (avg) 55.77% 355.000 553.000 - 0.00% -
429.mcf 5.50% 109.000 115.000 - -3.36% -
429.mcf (avg) 5.50% 109.000 115.000 - -3.36% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 55.56% -
nb_execution_successful -3.45% 29.000 28.000 - 55.56% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.45% 244728.000 241184.000 - 0.00% -
410.bwaves -1.22% 16760.000 16556.000 - 0.00% -
481.wrf -1.07% 1956607.000 1935742.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.67% 11640.000 10514.000 - 0.00% -
400.perlbench -9.50% 1663.000 1505.000 - -0.86% -
403.gcc -3.57% 56.000 54.000 - -15.62% -
462.libquantum -3.57% 140.000 135.000 - -2.88% -
458.sjeng -3.26% 7567.000 7320.000 - 0.01% -
450.soplex -3.17% 567.000 549.000 - -3.68% -
435.gromacs -3.11% 7269.000 7043.000 - 0.00% -
482.sphinx3 -2.86% 945.000 918.000 - -1.29% -
445.gobmk -2.61% 5023.000 4892.000 - -0.14% -
473.astar -2.52% 5128.000 4999.000 - 0.91% -
433.milc -2.26% 1151.000 1125.000 - -0.71% -
471.omnetpp -2.20% 2724.000 2664.000 - 0.41% -
481.wrf -1.90% 5534.000 5429.000 - 0.00% -
454.calculix -1.61% 62.000 61.000 - 0.00% -
459.GemsFDTD -1.56% 6173.000 6077.000 - 0.00% -
410.bwaves -1.47% 5652.000 5569.000 - 0.00% -
447.dealII -1.45% 1724.000 1699.000 - -0.29% -
444.namd -1.34% 747.000 737.000 - -0.67% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (unexplained diff vs previous) (percentage) -99.99% 90.870 0.010 - -66.67% -
458.sjeng (unexplained diff vs previous) -99.99% 6876.000 1.000 - -50.00% -
462.libquantum (unexplained diff vs previous) -99.97% 13518.000 4.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.97% 9655.710 2.960 - 105.56% -
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 - 25.00% -
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.680 - 25.93% -
433.milc (unexplained diff vs previous) -99.93% 11289.000 8.000 - 33.33% -
433.milc (unexplained diff vs previous) (percentage) -99.93% 980.800 0.710 - 33.96% -
471.omnetpp (unexplained diff vs previous) -99.90% 10659.000 11.000 - 10.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.90% 391.300 0.410 - 7.89% -
470.lbm (unexplained diff vs previous) (percentage) -99.89% 263.730 0.290 - -35.56% -
470.lbm (unexplained diff vs previous) -99.89% 9990.000 11.000 - -35.29% -
429.mcf (unexplained diff vs previous) (percentage) -99.83% 1305.690 2.280 - 240.30% -
429.mcf (unexplained diff vs previous) -99.78% 18593.000 40.000 - 233.33% -
416.gamess (max) -99.71% 4805.000 14.000 - 0.00% -
416.gamess (max) (percentage) -99.69% 38.550 0.120 - 0.00% -
464.h264ref (max) -99.68% 3127.000 10.000 - -9.09% -
482.sphinx3 (max) -99.67% 911.000 3.000 - 0.00% -
464.h264ref (max) (percentage) -99.65% 54.290 0.190 - -9.52% -
482.sphinx3 (max) (percentage) -99.60% 96.500 0.390 - -9.30% -
473.astar (unexplained diff vs previous) -99.56% 10146.000 45.000 - 1025.00% -
473.astar (unexplained diff vs previous) (percentage) -99.55% 197.850 0.900 - 1025.00% -
470.lbm (max) -99.49% 2746.000 14.000 - -12.50% -
458.sjeng (max) -99.47% 3602.000 19.000 - -9.52% -
470.lbm (max) (percentage) -99.46% 72.510 0.390 - -13.33% -
458.sjeng (max) (percentage) -99.43% 47.610 0.270 - -6.90% -
436.cactusADM (max) (percentage) -99.36% 88.730 0.570 - -1.72% -
436.cactusADM (max) -99.35% 1848.000 12.000 - 0.00% -
456.hmmer (max) -99.29% 2120.000 15.000 - -6.25% -
447.dealII (max) -99.28% 1384.000 10.000 - 0.00% -
456.hmmer (max) (percentage) -99.27% 73.590 0.540 - -8.47% -
447.dealII (max) (percentage) -99.27% 80.280 0.590 - -4.84% -
459.GemsFDTD (max) -99.25% 4411.000 33.000 - 0.00% -
433.milc (max) -99.23% 1044.000 8.000 - -11.11% -
459.GemsFDTD (max) (percentage) -99.23% 71.460 0.550 - 0.00% -
434.zeusmp (max) -99.22% 2055.000 16.000 - 0.00% -
434.zeusmp (max) (percentage) -99.19% 81.770 0.660 - 0.00% -
433.milc (max) (percentage) -99.18% 90.750 0.740 - -7.50% -
444.namd (max) -99.12% 685.000 6.000 - 0.00% -
444.namd (max) (percentage) -99.06% 91.790 0.860 - -4.44% -
453.povray (max) -98.80% 499.000 6.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -98.74% 10833.000 137.000 - 1857.14% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.73% 368.340 4.690 - 1776.00% -
453.povray (max) (percentage) -98.72% 91.250 1.170 - -4.88% -
450.soplex (max) -98.72% 545.000 7.000 - -12.50% -
410.bwaves (max) -98.57% 3276.000 47.000 - 0.00% -
410.bwaves (max) (percentage) -98.52% 57.970 0.860 - -1.15% -
450.soplex (max) (percentage) -98.50% 96.240 1.440 - -4.64% -
445.gobmk (max) -98.41% 2643.000 42.000 - -2.33% -
471.omnetpp (max) -98.39% 2169.000 35.000 - -5.41% -
445.gobmk (max) (percentage) -98.35% 52.630 0.870 - -2.25% -
471.omnetpp (max) (percentage) -98.31% 79.650 1.350 - -4.93% -
481.wrf (max) -98.05% 3801.000 74.000 - 0.00% -
435.gromacs (max) -98.01% 3573.000 71.000 - 0.00% -
481.wrf (max) (percentage) -97.99% 68.700 1.380 - 0.00% -
435.gromacs (max) (percentage) -97.95% 49.160 1.010 - -1.94% -
462.libquantum (max) -97.83% 138.000 3.000 - 50.00% -
400.perlbench (max) -97.64% 1397.000 33.000 - -2.94% -
429.mcf (max) (percentage) -97.60% 92.890 2.230 - 65.19% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) (percentage) -97.36% 84.060 2.220 - -2.63% -
462.libquantum (max) (percentage) -97.09% 98.970 2.880 - 97.26% -
429.mcf (max) -97.05% 1322.000 39.000 - 62.50% -
473.astar (max) -95.27% 3406.000 161.000 - -1.83% -
473.astar (max) (percentage) -95.14% 66.430 3.230 - -2.71% -
454.calculix (max) -95.08% 61.000 3.000 - 0.00% -
454.calculix (max) (percentage) -94.96% 99.730 5.030 - -1.95% -
401.bzip2 (max) -93.82% 2313.000 143.000 - 1687.50% -
401.bzip2 (max) (percentage) -93.74% 78.650 4.920 - 1596.55% -
403.gcc (max) -92.73% 55.000 4.000 - -20.00% -
403.gcc (max) (percentage) -90.80% 99.360 9.140 - -1.61% -
465.tonto (max) (percentage) -87.16% 19.310 2.480 - -0.80% -
465.tonto (max) -86.88% 2112.000 277.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
456.hmmer -78.74% 127.000 27.000 - 0.00% -
456.hmmer (avg) -78.74% 127.000 27.000 - 0.00% -
456.hmmer (avg) (percentage) -78.46% 4.410 0.950 - 0.00% -
444.namd -77.94% 68.000 15.000 - 0.00% -
444.namd (avg) -77.94% 68.000 15.000 - 0.00% -
444.namd (avg) (percentage) -77.66% 9.220 2.060 - -0.96% -
470.lbm -76.99% 239.000 55.000 - 0.00% -
470.lbm (avg) -76.99% 239.000 55.000 - 0.00% -
470.lbm (avg) (percentage) -76.78% 6.330 1.470 - -1.34% -
416.gamess -76.18% 550.000 131.000 - 0.00% -
416.gamess (avg) -76.18% 550.000 131.000 - 0.00% -
416.gamess (avg) (percentage) -76.02% 4.420 1.060 - 0.00% -
464.h264ref -74.40% 293.000 75.000 - 0.00% -
464.h264ref (avg) -74.40% 293.000 75.000 - 0.00% -
462.libquantum (avg) (percentage) -74.15% 7.660 1.980 - 1.02% -
464.h264ref (avg) (percentage) -74.07% 5.090 1.320 - 0.00% -
453.povray (avg) (percentage) -73.88% 7.810 2.040 - 0.00% -
453.povray -73.81% 42.000 11.000 - 0.00% -
453.povray (avg) -73.81% 42.000 11.000 - 0.00% -
434.zeusmp -72.79% 147.000 40.000 - 0.00% -
434.zeusmp (avg) -72.79% 147.000 40.000 - 0.00% -
434.zeusmp (avg) (percentage) -72.48% 5.850 1.610 - 0.00% -
458.sjeng -72.20% 241.000 67.000 - -1.47% -
458.sjeng (avg) -72.20% 241.000 67.000 - -1.47% -
482.sphinx3 -71.62% 74.000 21.000 - 0.00% -
482.sphinx3 (avg) -71.62% 74.000 21.000 - 0.00% -
458.sjeng (avg) (percentage) -71.16% 3.190 0.920 - -1.08% -
433.milc -71.01% 69.000 20.000 - 0.00% -
433.milc (avg) -71.01% 69.000 20.000 - 0.00% -
447.dealII -70.71% 99.000 29.000 - 0.00% -
447.dealII (avg) -70.71% 99.000 29.000 - 0.00% -
445.gobmk -70.41% 196.000 58.000 - 0.00% -
445.gobmk (avg) -70.41% 196.000 58.000 - 0.00% -
482.sphinx3 (avg) (percentage) -70.37% 7.930 2.350 - 0.00% -
447.dealII (avg) (percentage) -70.19% 5.770 1.720 - 0.00% -
471.omnetpp -69.96% 223.000 67.000 - -1.47% -
471.omnetpp (avg) -69.96% 223.000 67.000 - -1.47% -
433.milc (avg) (percentage) -69.75% 6.050 1.830 - -1.08% -
459.GemsFDTD -69.72% 360.000 109.000 - 0.00% -
459.GemsFDTD (avg) -69.72% 360.000 109.000 - 0.00% -
445.gobmk (avg) (percentage) -69.31% 3.910 1.200 - 0.00% -
459.GemsFDTD (avg) (percentage) -69.18% 5.840 1.800 - 0.00% -
410.bwaves -69.08% 249.000 77.000 - 0.00% -
410.bwaves (avg) -69.08% 249.000 77.000 - 0.00% -
471.omnetpp (avg) (percentage) -68.90% 8.200 2.550 - -1.54% -
436.cactusADM (avg) (percentage) -68.73% 5.980 1.870 - 0.00% -
436.cactusADM -68.55% 124.000 39.000 - 0.00% -
436.cactusADM (avg) -68.55% 124.000 39.000 - 0.00% -
410.bwaves (avg) (percentage) -68.48% 4.410 1.390 - 0.00% -
481.wrf -68.41% 345.000 109.000 - 0.00% -
481.wrf (avg) -68.41% 345.000 109.000 - 0.00% -
481.wrf (avg) (percentage) -67.79% 6.240 2.010 - 0.00% -
400.perlbench -63.81% 105.000 38.000 - 0.00% -
400.perlbench (avg) -63.81% 105.000 38.000 - 0.00% -
401.bzip2 -63.35% 161.000 59.000 - 9.26% -
401.bzip2 (avg) -63.35% 161.000 59.000 - 9.26% -
401.bzip2 (avg) (percentage) -63.14% 5.480 2.020 - 3.06% -
400.perlbench (avg) (percentage) -60.00% 6.350 2.540 - 0.00% -
435.gromacs -57.22% 367.000 157.000 - 0.00% -
435.gromacs (avg) -57.22% 367.000 157.000 - 0.00% -
435.gromacs (avg) (percentage) -55.93% 5.060 2.230 - 0.00% -
450.soplex -55.56% 36.000 16.000 - 0.00% -
450.soplex (avg) -55.56% 36.000 16.000 - 0.00% -
437.leslie3d (max) -54.95% 1929.000 869.000 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
450.soplex (avg) (percentage) -53.97% 6.430 2.960 - 0.00% -
465.tonto (avg) (percentage) -53.29% 3.340 1.560 - 0.00% -
473.astar -53.05% 213.000 100.000 - -0.99% -
473.astar (avg) -53.05% 213.000 100.000 - -0.99% -
465.tonto -52.33% 365.000 174.000 - 0.00% -
465.tonto (avg) -52.33% 365.000 174.000 - 0.00% -
473.astar (avg) (percentage) -51.44% 4.160 2.020 - -0.98% -
437.leslie3d (max) (percentage) -50.12% 16.580 8.270 - -1.55% -
403.gcc -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) -50.00% 4.000 2.000 - -33.33% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) (percentage) -50.00% 8.020 4.010 - 0.00% -
403.gcc (avg) (percentage) -29.10% 7.320 5.190 - 0.00% -
429.mcf (avg) (percentage) -14.21% 7.670 6.580 - -1.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.45% 29.000 30.000 - 50.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1505.000 -
401.bzip2 2924.000 4.92%
403.gcc 54.000 -15.62%
410.bwaves 5569.000 -
416.gamess 12392.000 -
429.mcf 1751.000 -2.23%
433.milc 1125.000 -
434.zeusmp 2507.000 -
435.gromacs 7043.000 -
436.cactusADM 2131.000 -
437.leslie3d 10514.000 -
444.namd 737.000 -
445.gobmk 4892.000 -
447.dealII 1699.000 -
450.soplex 549.000 -3.68%
453.povray 544.000 -
454.calculix 61.000 -
456.hmmer 2888.000 -
458.sjeng 7320.000 -
459.GemsFDTD 6077.000 -
462.libquantum 135.000 -2.88%
464.h264ref 5739.000 -
465.tonto 11170.000 -
470.lbm 3764.000 -
471.omnetpp 2664.000 -
473.astar 4999.000 -
481.wrf 5429.000 -
482.sphinx3 918.000 -1.29%
Geometric Mean 2027.988 39.85%
Code Size (bytes)
Name Current %
400.perlbench 887707.000 -
401.bzip2 44007.000 -
403.gcc 2442051.000 -
410.bwaves 16556.000 -
416.gamess 5731777.000 -
429.mcf 9119.000 -
433.milc 61117.000 -
434.zeusmp 153211.000 -
435.gromacs 498121.000 -
436.cactusADM 351617.000 -
437.leslie3d 58926.000 -
444.namd 187924.000 -
445.gobmk 1379062.000 -
447.dealII 310927.000 -
450.soplex 208601.000 -
453.povray 658313.000 -
454.calculix 841006.000 -
456.hmmer 108399.000 -
458.sjeng 103492.000 -
459.GemsFDTD 241184.000 -
462.libquantum 16117.000 -
464.h264ref 386364.000 1.05%
465.tonto 1953874.000 -
470.lbm 9707.000 -
471.omnetpp 480478.000 -
473.astar 22996.000 -
481.wrf 1935742.000 -
482.sphinx3 112287.000 -
Geometric Mean 205449.118 45.59%
Score
Name Current %
nb_compile_successful 28.000 55.56%
nb_execution_successful 28.000 55.56%
nb_total_tests 30.000 50.00%
Geometric Mean 28.651 53.68%
sample variability
Name Current %
400.perlbench 38.000 -
400.perlbench (avg) 38.000 -
400.perlbench (avg) (percentage) 2.540 -
400.perlbench (max) 33.000 -2.94%
400.perlbench (max) (percentage) 2.220 -2.63%
401.bzip2 59.000 9.26%
401.bzip2 (avg) 59.000 9.26%
401.bzip2 (avg) (percentage) 2.020 3.06%
401.bzip2 (max) 143.000 1687.50%
401.bzip2 (max) (percentage) 4.920 1596.55%
401.bzip2 (unexplained diff vs previous) 137.000 1857.14%
401.bzip2 (unexplained diff vs previous) (percentage) 4.690 1776.00%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 5.190 -
403.gcc (max) 4.000 -20.00%
403.gcc (max) (percentage) 9.140 -1.61%
410.bwaves 77.000 -
410.bwaves (avg) 77.000 -
410.bwaves (avg) (percentage) 1.390 -
410.bwaves (max) 47.000 -
410.bwaves (max) (percentage) 0.860 -1.15%
416.gamess 131.000 -
416.gamess (avg) 131.000 -
416.gamess (avg) (percentage) 1.060 -
416.gamess (max) 14.000 -
416.gamess (max) (percentage) 0.120 -
429.mcf 115.000 -3.36%
429.mcf (avg) 115.000 -3.36%
429.mcf (avg) (percentage) 6.580 -1.20%
429.mcf (max) 39.000 62.50%
429.mcf (max) (percentage) 2.230 65.19%
429.mcf (unexplained diff vs previous) 40.000 233.33%
429.mcf (unexplained diff vs previous) (percentage) 2.280 240.30%
433.milc 20.000 -
433.milc (avg) 20.000 -
433.milc (avg) (percentage) 1.830 -1.08%
433.milc (max) 8.000 -11.11%
433.milc (max) (percentage) 0.740 -7.50%
433.milc (unexplained diff vs previous) 8.000 33.33%
433.milc (unexplained diff vs previous) (percentage) 0.710 33.96%
434.zeusmp 40.000 -
434.zeusmp (avg) 40.000 -
434.zeusmp (avg) (percentage) 1.610 -
434.zeusmp (max) 16.000 -
434.zeusmp (max) (percentage) 0.660 -
435.gromacs 157.000 -
435.gromacs (avg) 157.000 -
435.gromacs (avg) (percentage) 2.230 -
435.gromacs (max) 71.000 -
435.gromacs (max) (percentage) 1.010 -1.94%
436.cactusADM 39.000 -
436.cactusADM (avg) 39.000 -
436.cactusADM (avg) (percentage) 1.870 -
436.cactusADM (max) 12.000 -
436.cactusADM (max) (percentage) 0.570 -1.72%
437.leslie3d 553.000 -
437.leslie3d (avg) 553.000 -
437.leslie3d (avg) (percentage) 5.260 -
437.leslie3d (max) 869.000 -
437.leslie3d (max) (percentage) 8.270 -1.55%
444.namd 15.000 -
444.namd (avg) 15.000 -
444.namd (avg) (percentage) 2.060 -
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.860 -4.44%
444.namd (unexplained diff vs previous) 5.000 25.00%
444.namd (unexplained diff vs previous) (percentage) 0.680 25.93%
445.gobmk 58.000 -
445.gobmk (avg) 58.000 -
445.gobmk (avg) (percentage) 1.200 -
445.gobmk (max) 42.000 -2.33%
445.gobmk (max) (percentage) 0.870 -2.25%
447.dealII 29.000 -
447.dealII (avg) 29.000 -
447.dealII (avg) (percentage) 1.720 -
447.dealII (max) 10.000 -
447.dealII (max) (percentage) 0.590 -4.84%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 2.960 -
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.440 -4.64%
453.povray 11.000 -
453.povray (avg) 11.000 -
453.povray (avg) (percentage) 2.040 -
453.povray (max) 6.000 -
453.povray (max) (percentage) 1.170 -4.88%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.010 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.030 -1.95%
456.hmmer 27.000 -
456.hmmer (avg) 27.000 -
456.hmmer (avg) (percentage) 0.950 -
456.hmmer (max) 15.000 -6.25%
456.hmmer (max) (percentage) 0.540 -8.47%
458.sjeng 67.000 -1.47%
458.sjeng (avg) 67.000 -1.47%
458.sjeng (avg) (percentage) 0.920 -1.08%
458.sjeng (max) 19.000 -9.52%
458.sjeng (max) (percentage) 0.270 -6.90%
458.sjeng (unexplained diff vs previous) 1.000 -50.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.010 -66.67%
459.GemsFDTD 109.000 -
459.GemsFDTD (avg) 109.000 -
459.GemsFDTD (avg) (percentage) 1.800 -
459.GemsFDTD (max) 33.000 -
459.GemsFDTD (max) (percentage) 0.550 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.980 1.02%
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 2.880 97.26%
462.libquantum (unexplained diff vs previous) 4.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.960 105.56%
464.h264ref 75.000 -
464.h264ref (avg) 75.000 -
464.h264ref (avg) (percentage) 1.320 -
464.h264ref (max) 10.000 -9.09%
464.h264ref (max) (percentage) 0.190 -9.52%
465.tonto 174.000 -
465.tonto (avg) 174.000 -
465.tonto (avg) (percentage) 1.560 -
465.tonto (max) 277.000 -
465.tonto (max) (percentage) 2.480 -
470.lbm 55.000 -
470.lbm (avg) 55.000 -
470.lbm (avg) (percentage) 1.470 -1.34%
470.lbm (max) 14.000 -12.50%
470.lbm (max) (percentage) 0.390 -13.33%
470.lbm (unexplained diff vs previous) 11.000 -35.29%
470.lbm (unexplained diff vs previous) (percentage) 0.290 -35.56%
471.omnetpp 67.000 -1.47%
471.omnetpp (avg) 67.000 -1.47%
471.omnetpp (avg) (percentage) 2.550 -1.54%
471.omnetpp (max) 35.000 -5.41%
471.omnetpp (max) (percentage) 1.350 -4.93%
471.omnetpp (unexplained diff vs previous) 11.000 10.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.410 7.89%
473.astar 100.000 -
473.astar (avg) 100.000 -
473.astar (avg) (percentage) 2.020 -
473.astar (max) 161.000 -1.83%
473.astar (max) (percentage) 3.230 -2.71%
473.astar (unexplained diff vs previous) 45.000 1025.00%
473.astar (unexplained diff vs previous) (percentage) 0.900 1025.00%
481.wrf 109.000 -
481.wrf (avg) 109.000 -
481.wrf (avg) (percentage) 2.010 -
481.wrf (max) 74.000 -
481.wrf (max) (percentage) 1.380 -
482.sphinx3 21.000 -
482.sphinx3 (avg) 21.000 -
482.sphinx3 (avg) (percentage) 2.350 -
482.sphinx3 (max) 3.000 -
482.sphinx3 (max) (percentage) 0.390 -9.30%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 8.091 83.66%