Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=83b972fc272db31ab48aa5cde84f47c98868d7c8 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/cb478e0a6f3a296e1c234a85fc0d45d633a0ff93 (+ 453 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d49cd6a1913da9744b9a0ffbefb3f7958322382e (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=0a1118f6bab292f82acec13c0b89b99d7501298b (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/237/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0237 (basepoints/gcc-15-00267-gcb478e0a6f3) 2024-05-03T21:55:26 0:00:00
Previous 0235 (3-changed-components) 2024-04-24T10:54:43 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 29 15
Performance Improvements 86 176
Unchanged Tests 1121 1045
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 1.38% 2749.000 2787.000 - 2.31% -
436.cactusADM 1.05% 2104.000 2126.000 - 2.06% -
401.bzip2 1.04% 2993.000 3024.000 - 2.82% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 366.67% 0.030 0.140 0.000 -99.95% 0.000
470.lbm (unexplained diff vs previous) 366.67% 6.000 28.000 0.000 -99.72% 0.000
470.lbm (unexplained diff vs previous) (percentage) 362.50% 0.160 0.740 0.000 -99.72% 0.000
456.hmmer (unexplained diff vs previous) 300.00% 1.000 4.000 0.000 -99.95% 0.000
470.lbm (max) 125.00% 12.000 27.000 - -99.02% -
470.lbm (max) (percentage) 114.71% 0.340 0.730 - -98.99% -
433.milc (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 -99.98% 0.000
433.milc (unexplained diff vs previous) (percentage) 88.89% 0.090 0.170 0.000 -99.98% 0.000
471.omnetpp (unexplained diff vs previous) 72.73% 22.000 38.000 0.000 -99.64% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 70.00% 0.800 1.360 0.000 -99.65% 0.000
436.cactusADM (max) 69.23% 13.000 22.000 - -98.81% -
462.libquantum (max) (percentage) 63.64% 2.200 3.600 - -96.36% -
436.cactusADM (max) (percentage) 59.09% 0.660 1.050 - -98.82% -
436.cactusADM (unexplained diff vs previous) 57.14% 14.000 22.000 0.000 -99.87% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) 53.73% 0.670 1.030 0.000 -99.87% 0.000
450.soplex (max) (percentage) 47.45% 1.370 2.020 - -97.90% -
450.soplex (max) 37.50% 8.000 11.000 - -97.98% -
462.libquantum (max) 33.33% 3.000 4.000 - -97.10% -
401.bzip2 (max) 4.35% 23.000 24.000 - -98.96% -
445.gobmk 2.04% 49.000 50.000 - -74.49% -
445.gobmk (avg) 2.04% 49.000 50.000 - -74.49% -
458.sjeng 1.85% 54.000 55.000 - -77.18% -
458.sjeng (avg) 1.85% 54.000 55.000 - -77.18% -
462.libquantum (avg) (percentage) 1.69% 1.780 1.810 - -76.37% -
471.omnetpp 1.59% 63.000 64.000 - -71.30% -
471.omnetpp (avg) 1.59% 63.000 64.000 - -71.30% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -3.60% 139.000 134.000 - -4.29% -
450.soplex -2.02% 595.000 583.000 - 2.82% -
453.povray -1.99% 554.000 543.000 - -0.73% -
400.perlbench -1.96% 1579.000 1548.000 - -6.92% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -83.33% 6.000 1.000 0.000 -99.99% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -80.00% 0.100 0.020 0.000 -99.98% 0.000
473.astar (unexplained diff vs previous) -73.68% 19.000 5.000 0.000 -99.95% 0.000
473.astar (unexplained diff vs previous) (percentage) -72.97% 0.370 0.100 0.000 -99.95% 0.000
459.GemsFDTD (unexplained diff vs previous) -63.33% 60.000 22.000 0.000 -99.86% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -62.83% 1.130 0.420 0.000 -99.83% 0.000
410.bwaves (unexplained diff vs previous) -61.54% 26.000 10.000 0.000 -99.87% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -61.36% 0.440 0.170 0.000 -99.88% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -60.98% 0.410 0.160 0.000 -99.20% 0.000
437.leslie3d (unexplained diff vs previous) -60.87% 46.000 18.000 0.000 -99.22% 0.000
429.mcf (unexplained diff vs previous) -60.00% 10.000 4.000 0.000 -99.98% 0.000
429.mcf (unexplained diff vs previous) (percentage) -59.62% 0.520 0.210 0.000 -99.98% 0.000
482.sphinx3 (unexplained diff vs previous) -50.00% 6.000 3.000 0.000 -99.99% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -50.00% 0.720 0.360 0.000 -99.99% 0.000
453.povray (unexplained diff vs previous) -21.43% 14.000 11.000 0.000 -99.81% 0.000
453.povray (unexplained diff vs previous) (percentage) -19.76% 2.530 2.030 0.000 -99.81% 0.000
464.h264ref (max) -16.67% 6.000 5.000 - -99.84% -
453.povray (max) -14.29% 14.000 12.000 - -97.60% -
453.povray (max) (percentage) -12.36% 2.590 2.270 - -97.51% -
433.milc (max) (percentage) -10.26% 0.390 0.350 - -99.61% -
458.sjeng (max) (percentage) -9.38% 0.320 0.290 - -99.39% -
458.sjeng (max) -8.70% 23.000 21.000 - -99.42% -
456.hmmer (max) -8.33% 12.000 11.000 - -99.48% -
459.GemsFDTD (max) -8.33% 60.000 55.000 - -98.75% -
447.dealII (max) (percentage) -8.23% 1.580 1.450 - -98.19% -
465.tonto (max) (percentage) -8.11% 0.740 0.680 - -96.48% -
459.GemsFDTD (max) (percentage) -7.89% 1.140 1.050 - -98.53% -
447.dealII (max) -7.69% 26.000 24.000 - -98.27% -
445.gobmk (max) (percentage) -7.61% 0.920 0.850 - -98.38% -
410.bwaves (max) (percentage) -7.45% 0.940 0.870 - -98.50% -
410.bwaves (max) -7.27% 55.000 51.000 - -98.44% -
473.astar (max) (percentage) -7.25% 0.690 0.640 - -99.04% -
465.tonto (max) -7.06% 85.000 79.000 - -96.26% -
456.hmmer (max) (percentage) -6.98% 0.430 0.400 - -99.46% -
482.sphinx3 (max) (percentage) -6.92% 1.300 1.210 - -98.75% -
445.gobmk (max) -6.67% 45.000 42.000 - -98.41% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
400.perlbench (max) -6.52% 46.000 43.000 - -96.92% -
429.mcf (max) (percentage) -6.50% 35.870 33.540 - -63.89% -
471.omnetpp (max) (percentage) -6.41% 1.560 1.460 - -98.17% -
437.leslie3d (max) (percentage) -6.31% 5.550 5.200 - -68.64% -
429.mcf (max) -6.24% 689.000 646.000 - -51.13% -
437.leslie3d (max) -6.15% 618.000 580.000 - -69.93% -
444.namd (max) (percentage) -6.12% 0.490 0.460 - -99.50% -
473.astar (max) -5.71% 35.000 33.000 - -99.03% -
435.gromacs (max) -5.56% 72.000 68.000 - -98.10% -
400.perlbench (max) (percentage) -5.12% 2.930 2.780 - -96.69% -
435.gromacs (max) (percentage) -4.95% 1.010 0.960 - -98.05% -
471.omnetpp (max) -4.76% 42.000 40.000 - -98.16% -
456.hmmer -4.55% 22.000 21.000 - -83.46% -
456.hmmer (avg) -4.55% 22.000 21.000 - -83.46% -
434.zeusmp -3.12% 32.000 31.000 - -78.91% -
434.zeusmp (avg) -3.12% 32.000 31.000 - -78.91% -
400.perlbench -2.78% 36.000 35.000 - -66.67% -
400.perlbench (avg) -2.78% 36.000 35.000 - -66.67% -
459.GemsFDTD -2.47% 81.000 79.000 - -78.06% -
459.GemsFDTD (avg) -2.47% 81.000 79.000 - -78.06% -
470.lbm -2.22% 45.000 44.000 - -81.59% -
470.lbm (avg) -2.22% 45.000 44.000 - -81.59% -
464.h264ref (avg) (percentage) -2.04% 0.980 0.960 - -81.14% -
459.GemsFDTD (avg) (percentage) -1.95% 1.540 1.510 - -74.14% -
416.gamess (max) (percentage) -1.85% 0.540 0.530 - -98.63% -
464.h264ref -1.79% 56.000 55.000 - -81.23% -
464.h264ref (avg) -1.79% 56.000 55.000 - -81.23% -
437.leslie3d (avg) (percentage) -1.72% 4.660 4.580 - 50.16% -
434.zeusmp (max) (percentage) -1.61% 0.620 0.610 - -99.25% -
429.mcf -1.61% 124.000 122.000 - 11.93% -
429.mcf (avg) -1.61% 124.000 122.000 - 11.93% -
482.sphinx3 (avg) (percentage) -1.57% 1.910 1.880 - -76.29% -
434.zeusmp (avg) (percentage) -1.56% 1.280 1.260 - -78.46% -
437.leslie3d -1.54% 519.000 511.000 - 43.94% -
437.leslie3d (avg) -1.54% 519.000 511.000 - 43.94% -
410.bwaves -1.49% 67.000 66.000 - -73.49% -
410.bwaves (avg) -1.49% 67.000 66.000 - -73.49% -
429.mcf (avg) (percentage) -1.39% 6.470 6.380 - -16.82% -
456.hmmer (avg) (percentage) -1.33% 0.750 0.740 - -83.22% -
433.milc (avg) (percentage) -1.29% 1.550 1.530 - -74.71% -
473.astar (avg) (percentage) -1.14% 1.750 1.730 - -58.41% -
473.astar -1.11% 90.000 89.000 - -58.22% -
473.astar (avg) -1.11% 90.000 89.000 - -58.22% -
403.gcc (max) (percentage) -1.09% 4.600 4.550 - -95.42% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 35.32% 1424.000 1927.000 - 0.21% -
465.tonto 6.33% 10941.000 11634.000 - 0.37% -
410.bwaves 4.85% 5652.000 5926.000 - 0.17% -
444.namd 3.21% 747.000 771.000 - -0.90% -
401.bzip2 2.82% 2941.000 3024.000 - 1.04% -
450.soplex 2.82% 567.000 583.000 - -2.02% -
456.hmmer 2.46% 2882.000 2953.000 - -0.14% -
471.omnetpp 2.31% 2724.000 2787.000 - 1.38% -
436.cactusADM 2.06% 2083.000 2126.000 - 1.05% -
473.astar 1.05% 5128.000 5182.000 - 0.10% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 50.16% 3.050 4.580 - -1.72% -
437.leslie3d 43.94% 355.000 511.000 - -1.54% -
437.leslie3d (avg) 43.94% 355.000 511.000 - -1.54% -
429.mcf 11.93% 109.000 122.000 - -1.61% -
429.mcf (avg) 11.93% 109.000 122.000 - -1.61% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -2.66% 244728.000 238224.000 - 0.00% -
434.zeusmp -2.56% 152037.000 148143.000 - 0.00% -
410.bwaves -1.67% 16760.000 16480.000 - 0.00% -
444.namd -1.61% 188385.000 185356.000 - 0.00% -
464.h264ref -1.46% 387748.000 382096.000 - 0.00% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
435.gromacs -1.40% 499261.000 492289.000 - -0.00% -
437.leslie3d -1.33% 59479.000 58690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -14.32% 6173.000 5289.000 - -0.41% -
482.sphinx3 -12.17% 945.000 830.000 - -0.36% -
400.perlbench -6.92% 1663.000 1548.000 - -1.96% -
462.libquantum -4.29% 140.000 134.000 - -3.60% -
437.leslie3d -4.04% 11640.000 11170.000 - 0.16% -
447.dealII -3.54% 1724.000 1663.000 - -0.78% -
435.gromacs -1.76% 7269.000 7141.000 - 0.08% -
458.sjeng -1.49% 7567.000 7454.000 - 0.31% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 3.000 0.000 -50.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.360 0.000 -50.00% 0.000
464.h264ref (unexplained diff vs previous) -99.99% 6843.000 1.000 0.000 -83.33% 0.000
429.mcf (unexplained diff vs previous) (percentage) -99.98% 1305.690 0.210 0.000 -59.62% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -99.98% 118.780 0.020 0.000 -80.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 0.000 88.89% 0.000
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 0.000 100.00% 0.000
429.mcf (unexplained diff vs previous) -99.98% 18593.000 4.000 0.000 -60.00% 0.000
434.zeusmp (unexplained diff vs previous) -99.97% 11280.000 3.000 0.000 0.00% 0.000
434.zeusmp (unexplained diff vs previous) (percentage) -99.97% 448.690 0.120 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) (percentage) -99.96% 9655.710 3.730 0.000 0.00% 0.000
473.astar (unexplained diff vs previous) -99.95% 10146.000 5.000 0.000 -73.68% 0.000
456.hmmer (unexplained diff vs previous) -99.95% 8030.000 4.000 0.000 300.00% 0.000
456.hmmer (unexplained diff vs previous) (percentage) -99.95% 278.630 0.140 0.000 366.67% 0.000
473.astar (unexplained diff vs previous) (percentage) -99.95% 197.850 0.100 0.000 -72.97% 0.000
450.soplex (unexplained diff vs previous) (percentage) -99.92% 2557.320 2.060 0.000 0.00% 0.000
450.soplex (unexplained diff vs previous) -99.92% 14500.000 12.000 0.000 0.00% 0.000
410.bwaves (unexplained diff vs previous) (percentage) -99.88% 137.900 0.170 0.000 -61.36% 0.000
410.bwaves (unexplained diff vs previous) -99.87% 7794.000 10.000 0.000 -61.54% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -99.87% 787.130 1.030 0.000 53.73% 0.000
436.cactusADM (unexplained diff vs previous) -99.87% 16396.000 22.000 0.000 57.14% 0.000
459.GemsFDTD (unexplained diff vs previous) -99.86% 15458.000 22.000 0.000 -63.33% 0.000
464.h264ref (max) -99.84% 3127.000 5.000 - -16.67% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.83% 250.410 0.420 0.000 -62.83% 0.000
464.h264ref (max) (percentage) -99.82% 54.290 0.100 - -9.09% -
453.povray (unexplained diff vs previous) -99.81% 5707.000 11.000 0.000 -21.43% 0.000
453.povray (unexplained diff vs previous) (percentage) -99.81% 1043.330 2.030 0.000 -19.76% 0.000
470.lbm (unexplained diff vs previous) -99.72% 9990.000 28.000 0.000 366.67% 0.000
470.lbm (unexplained diff vs previous) (percentage) -99.72% 263.730 0.740 0.000 362.50% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.65% 391.300 1.360 0.000 70.00% 0.000
471.omnetpp (unexplained diff vs previous) -99.64% 10659.000 38.000 0.000 72.73% 0.000
433.milc (max) -99.62% 1044.000 4.000 - 0.00% -
433.milc (max) (percentage) -99.61% 90.750 0.350 - -10.26% -
444.namd (max) -99.56% 685.000 3.000 - 0.00% -
444.namd (max) (percentage) -99.50% 91.790 0.460 - -6.12% -
456.hmmer (max) -99.48% 2120.000 11.000 - -8.33% -
456.hmmer (max) (percentage) -99.46% 73.590 0.400 - -6.98% -
458.sjeng (max) -99.42% 3602.000 21.000 - -8.70% -
458.sjeng (max) (percentage) -99.39% 47.610 0.290 - -9.38% -
434.zeusmp (max) -99.27% 2055.000 15.000 - 0.00% -
434.zeusmp (max) (percentage) -99.25% 81.770 0.610 - -1.61% -
437.leslie3d (unexplained diff vs previous) -99.22% 2314.000 18.000 0.000 -60.87% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -99.20% 19.880 0.160 0.000 -60.98% 0.000
454.calculix (max) (percentage) -99.07% 99.730 0.930 - -1.06% -
473.astar (max) (percentage) -99.04% 66.430 0.640 - -7.25% -
473.astar (max) -99.03% 3406.000 33.000 - -5.71% -
470.lbm (max) -99.02% 2746.000 27.000 - 125.00% -
470.lbm (max) (percentage) -98.99% 72.510 0.730 - 114.71% -
401.bzip2 (max) (percentage) -98.98% 78.650 0.800 - 0.00% -
401.bzip2 (max) -98.96% 2313.000 24.000 - 4.35% -
482.sphinx3 (max) -98.90% 911.000 10.000 - 0.00% -
436.cactusADM (max) (percentage) -98.82% 88.730 1.050 - 59.09% -
436.cactusADM (max) -98.81% 1848.000 22.000 - 69.23% -
459.GemsFDTD (max) -98.75% 4411.000 55.000 - -8.33% -
482.sphinx3 (max) (percentage) -98.75% 96.500 1.210 - -6.92% -
416.gamess (max) (percentage) -98.63% 38.550 0.530 - -1.85% -
459.GemsFDTD (max) (percentage) -98.53% 71.460 1.050 - -7.89% -
481.wrf (max) (percentage) -98.52% 68.700 1.020 - -0.97% -
410.bwaves (max) (percentage) -98.50% 57.970 0.870 - -7.45% -
410.bwaves (max) -98.44% 3276.000 51.000 - -7.27% -
445.gobmk (max) -98.41% 2643.000 42.000 - -6.67% -
445.gobmk (max) (percentage) -98.38% 52.630 0.850 - -7.61% -
447.dealII (max) -98.27% 1384.000 24.000 - -7.69% -
447.dealII (max) (percentage) -98.19% 80.280 1.450 - -8.23% -
471.omnetpp (max) (percentage) -98.17% 79.650 1.460 - -6.41% -
471.omnetpp (max) -98.16% 2169.000 40.000 - -4.76% -
435.gromacs (max) -98.10% 3573.000 68.000 - -5.56% -
435.gromacs (max) (percentage) -98.05% 49.160 0.960 - -4.95% -
450.soplex (max) -97.98% 545.000 11.000 - 37.50% -
450.soplex (max) (percentage) -97.90% 96.240 2.020 - 47.45% -
453.povray (max) -97.60% 499.000 12.000 - -14.29% -
453.povray (max) (percentage) -97.51% 91.250 2.270 - -12.36% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
462.libquantum (max) -97.10% 138.000 4.000 - 33.33% -
400.perlbench (max) -96.92% 1397.000 43.000 - -6.52% -
400.perlbench (max) (percentage) -96.69% 84.060 2.780 - -5.12% -
465.tonto (max) (percentage) -96.48% 19.310 0.680 - -8.11% -
462.libquantum (max) (percentage) -96.36% 98.970 3.600 - 63.64% -
465.tonto (max) -96.26% 2112.000 79.000 - -7.06% -
403.gcc (max) (percentage) -95.42% 99.360 4.550 - -1.09% -
456.hmmer -83.46% 127.000 21.000 - -4.55% -
456.hmmer (avg) -83.46% 127.000 21.000 - -4.55% -
456.hmmer (avg) (percentage) -83.22% 4.410 0.740 - -1.33% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
444.namd (avg) (percentage) -82.65% 9.220 1.600 - 0.00% -
444.namd -82.35% 68.000 12.000 - 0.00% -
444.namd (avg) -82.35% 68.000 12.000 - 0.00% -
470.lbm -81.59% 239.000 44.000 - -2.22% -
470.lbm (avg) -81.59% 239.000 44.000 - -2.22% -
470.lbm (avg) (percentage) -81.52% 6.330 1.170 - -0.85% -
464.h264ref -81.23% 293.000 55.000 - -1.79% -
464.h264ref (avg) -81.23% 293.000 55.000 - -1.79% -
464.h264ref (avg) (percentage) -81.14% 5.090 0.960 - -2.04% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 0.00% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 0.00% -
434.zeusmp -78.91% 147.000 31.000 - -3.12% -
434.zeusmp (avg) -78.91% 147.000 31.000 - -3.12% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
434.zeusmp (avg) (percentage) -78.46% 5.850 1.260 - -1.56% -
459.GemsFDTD -78.06% 360.000 79.000 - -2.47% -
459.GemsFDTD (avg) -78.06% 360.000 79.000 - -2.47% -
453.povray (avg) (percentage) -77.98% 7.810 1.720 - 0.00% -
458.sjeng -77.18% 241.000 55.000 - 1.85% -
458.sjeng (avg) -77.18% 241.000 55.000 - 1.85% -
458.sjeng (avg) (percentage) -76.80% 3.190 0.740 - 0.00% -
447.dealII -76.77% 99.000 23.000 - 0.00% -
447.dealII (avg) -76.77% 99.000 23.000 - 0.00% -
462.libquantum (avg) (percentage) -76.37% 7.660 1.810 - 1.69% -
482.sphinx3 (avg) (percentage) -76.29% 7.930 1.880 - -1.57% -
433.milc -75.36% 69.000 17.000 - 0.00% -
433.milc (avg) -75.36% 69.000 17.000 - 0.00% -
447.dealII (avg) (percentage) -75.22% 5.770 1.430 - 0.00% -
436.cactusADM -75.00% 124.000 31.000 - 0.00% -
436.cactusADM (avg) -75.00% 124.000 31.000 - 0.00% -
436.cactusADM (avg) (percentage) -74.92% 5.980 1.500 - -0.66% -
433.milc (avg) (percentage) -74.71% 6.050 1.530 - -1.29% -
445.gobmk -74.49% 196.000 50.000 - 2.04% -
445.gobmk (avg) -74.49% 196.000 50.000 - 2.04% -
410.bwaves (avg) (percentage) -74.38% 4.410 1.130 - -0.88% -
445.gobmk (avg) (percentage) -74.17% 3.910 1.010 - 0.00% -
459.GemsFDTD (avg) (percentage) -74.14% 5.840 1.510 - -1.95% -
410.bwaves -73.49% 249.000 66.000 - -1.49% -
410.bwaves (avg) -73.49% 249.000 66.000 - -1.49% -
471.omnetpp (avg) (percentage) -71.83% 8.200 2.310 - -0.43% -
471.omnetpp -71.30% 223.000 64.000 - 1.59% -
471.omnetpp (avg) -71.30% 223.000 64.000 - 1.59% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
437.leslie3d (max) -69.93% 1929.000 580.000 - -6.15% -
437.leslie3d (max) (percentage) -68.64% 16.580 5.200 - -6.31% -
400.perlbench -66.67% 105.000 35.000 - -2.78% -
400.perlbench (avg) -66.67% 105.000 35.000 - -2.78% -
401.bzip2 (avg) (percentage) -66.42% 5.480 1.840 - 0.00% -
401.bzip2 -65.84% 161.000 55.000 - 0.00% -
401.bzip2 (avg) -65.84% 161.000 55.000 - 0.00% -
400.perlbench (avg) (percentage) -63.94% 6.350 2.290 - 0.00% -
429.mcf (max) (percentage) -63.89% 92.890 33.540 - -6.50% -
435.gromacs -63.49% 367.000 134.000 - 0.00% -
435.gromacs (avg) -63.49% 367.000 134.000 - 0.00% -
435.gromacs (avg) (percentage) -62.65% 5.060 1.890 - 0.00% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) (percentage) -60.03% 6.430 2.570 - -0.39% -
473.astar (avg) (percentage) -58.41% 4.160 1.730 - -1.14% -
473.astar -58.22% 213.000 89.000 - -1.11% -
473.astar (avg) -58.22% 213.000 89.000 - -1.11% -
465.tonto (avg) (percentage) -57.78% 3.340 1.410 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
465.tonto -55.07% 365.000 164.000 - 0.61% -
465.tonto (avg) -55.07% 365.000 164.000 - 0.61% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (max) -51.13% 1322.000 646.000 - -6.24% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf (avg) (percentage) -16.82% 7.670 6.380 - -1.39% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 0.00% -
nb_compile_successful 65.52% 29.000 48.000 - 0.00% -
nb_execution_successful 65.52% 29.000 48.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1548.000 -1.96%
401.bzip2 3024.000 1.04%
410.bwaves 5926.000 -
429.mcf 1927.000 -
433.milc 1158.000 -
434.zeusmp 2532.000 -
435.gromacs 7141.000 -
436.cactusADM 2126.000 1.05%
437.leslie3d 11170.000 -
444.namd 771.000 -
445.gobmk 4980.000 -
447.dealII 1663.000 -
450.soplex 583.000 -2.02%
453.povray 543.000 -1.99%
456.hmmer 2953.000 -
458.sjeng 7454.000 -
459.GemsFDTD 5289.000 -
462.libquantum 134.000 -3.60%
464.h264ref 5771.000 -
465.tonto 11634.000 -
470.lbm 3787.000 -
471.omnetpp 2787.000 1.38%
473.astar 5182.000 -
482.sphinx3 830.000 -
Geometric Mean 2465.876 -
Code Size (bytes)
Name Current %
400.perlbench 894675.000 -
401.bzip2 43847.000 -
410.bwaves 16480.000 -
429.mcf 9055.000 -
433.milc 60805.000 -
434.zeusmp 148143.000 -
435.gromacs 492289.000 -
436.cactusADM 350545.000 -
437.leslie3d 58690.000 -
444.namd 185356.000 -
445.gobmk 1379006.000 -
447.dealII 310424.000 -
450.soplex 205303.000 -
453.povray 656269.000 -
456.hmmer 108215.000 -
458.sjeng 103300.000 -
459.GemsFDTD 238224.000 -
462.libquantum 16085.000 -
464.h264ref 382096.000 -
465.tonto 1935882.000 -
470.lbm 9551.000 -
471.omnetpp 479794.000 -
473.astar 22880.000 -
482.sphinx3 112243.000 -
Geometric Mean 137617.518 -
sample variability
Name Current %
400.perlbench 35.000 -2.78%
400.perlbench (avg) 35.000 -2.78%
400.perlbench (avg) (percentage) 2.290 -
400.perlbench (max) 43.000 -6.52%
400.perlbench (max) (percentage) 2.780 -5.12%
401.bzip2 55.000 -
401.bzip2 (avg) 55.000 -
401.bzip2 (avg) (percentage) 1.840 -
401.bzip2 (max) 24.000 4.35%
401.bzip2 (max) (percentage) 0.800 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.550 -1.09%
410.bwaves 66.000 -1.49%
410.bwaves (avg) 66.000 -1.49%
410.bwaves (avg) (percentage) 1.130 -
410.bwaves (max) 51.000 -7.27%
410.bwaves (max) (percentage) 0.870 -7.45%
410.bwaves (unexplained diff vs previous) 10.000 -61.54%
410.bwaves (unexplained diff vs previous) (percentage) 0.170 -61.36%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.530 -1.85%
429.mcf 122.000 -1.61%
429.mcf (avg) 122.000 -1.61%
429.mcf (avg) (percentage) 6.380 -1.39%
429.mcf (max) 646.000 -6.24%
429.mcf (max) (percentage) 33.540 -6.50%
429.mcf (unexplained diff vs previous) 4.000 -60.00%
429.mcf (unexplained diff vs previous) (percentage) 0.210 -59.62%
433.milc 17.000 -
433.milc (avg) 17.000 -
433.milc (avg) (percentage) 1.530 -1.29%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.350 -10.26%
433.milc (unexplained diff vs previous) 2.000 100.00%
433.milc (unexplained diff vs previous) (percentage) 0.170 88.89%
434.zeusmp 31.000 -3.12%
434.zeusmp (avg) 31.000 -3.12%
434.zeusmp (avg) (percentage) 1.260 -1.56%
434.zeusmp (max) 15.000 -
434.zeusmp (max) (percentage) 0.610 -1.61%
434.zeusmp (unexplained diff vs previous) 3.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.120 -
435.gromacs 134.000 -
435.gromacs (avg) 134.000 -
435.gromacs (avg) (percentage) 1.890 -
435.gromacs (max) 68.000 -5.56%
435.gromacs (max) (percentage) 0.960 -4.95%
436.cactusADM 31.000 -
436.cactusADM (avg) 31.000 -
436.cactusADM (avg) (percentage) 1.500 -
436.cactusADM (max) 22.000 69.23%
436.cactusADM (max) (percentage) 1.050 59.09%
436.cactusADM (unexplained diff vs previous) 22.000 57.14%
436.cactusADM (unexplained diff vs previous) (percentage) 1.030 53.73%
437.leslie3d 511.000 -1.54%
437.leslie3d (avg) 511.000 -1.54%
437.leslie3d (avg) (percentage) 4.580 -1.72%
437.leslie3d (max) 580.000 -6.15%
437.leslie3d (max) (percentage) 5.200 -6.31%
437.leslie3d (unexplained diff vs previous) 18.000 -60.87%
437.leslie3d (unexplained diff vs previous) (percentage) 0.160 -60.98%
444.namd 12.000 -
444.namd (avg) 12.000 -
444.namd (avg) (percentage) 1.600 -
444.namd (max) 3.000 -
444.namd (max) (percentage) 0.460 -6.12%
445.gobmk 50.000 2.04%
445.gobmk (avg) 50.000 2.04%
445.gobmk (avg) (percentage) 1.010 -
445.gobmk (max) 42.000 -6.67%
445.gobmk (max) (percentage) 0.850 -7.61%
447.dealII 23.000 -
447.dealII (avg) 23.000 -
447.dealII (avg) (percentage) 1.430 -
447.dealII (max) 24.000 -7.69%
447.dealII (max) (percentage) 1.450 -8.23%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.570 -
450.soplex (max) 11.000 37.50%
450.soplex (max) (percentage) 2.020 47.45%
450.soplex (unexplained diff vs previous) 12.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.060 -
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.720 -
453.povray (max) 12.000 -14.29%
453.povray (max) (percentage) 2.270 -12.36%
453.povray (unexplained diff vs previous) 11.000 -21.43%
453.povray (unexplained diff vs previous) (percentage) 2.030 -19.76%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.930 -
456.hmmer 21.000 -4.55%
456.hmmer (avg) 21.000 -4.55%
456.hmmer (avg) (percentage) 0.740 -1.33%
456.hmmer (max) 11.000 -8.33%
456.hmmer (max) (percentage) 0.400 -6.98%
456.hmmer (unexplained diff vs previous) 4.000 300.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 366.67%
458.sjeng 55.000 1.85%
458.sjeng (avg) 55.000 1.85%
458.sjeng (avg) (percentage) 0.740 -
458.sjeng (max) 21.000 -8.70%
458.sjeng (max) (percentage) 0.290 -9.38%
459.GemsFDTD 79.000 -2.47%
459.GemsFDTD (avg) 79.000 -2.47%
459.GemsFDTD (avg) (percentage) 1.510 -1.95%
459.GemsFDTD (max) 55.000 -8.33%
459.GemsFDTD (max) (percentage) 1.050 -7.89%
459.GemsFDTD (unexplained diff vs previous) 22.000 -63.33%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.420 -62.83%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.810 1.69%
462.libquantum (max) 4.000 33.33%
462.libquantum (max) (percentage) 3.600 63.64%
462.libquantum (unexplained diff vs previous) 5.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.730 -
464.h264ref 55.000 -1.79%
464.h264ref (avg) 55.000 -1.79%
464.h264ref (avg) (percentage) 0.960 -2.04%
464.h264ref (max) 5.000 -16.67%
464.h264ref (max) (percentage) 0.100 -
464.h264ref (unexplained diff vs previous) 1.000 -83.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -80.00%
465.tonto 164.000 -
465.tonto (avg) 164.000 -
465.tonto (avg) (percentage) 1.410 -
465.tonto (max) 79.000 -7.06%
465.tonto (max) (percentage) 0.680 -8.11%
470.lbm 44.000 -2.22%
470.lbm (avg) 44.000 -2.22%
470.lbm (avg) (percentage) 1.170 -
470.lbm (max) 27.000 125.00%
470.lbm (max) (percentage) 0.730 114.71%
470.lbm (unexplained diff vs previous) 28.000 366.67%
470.lbm (unexplained diff vs previous) (percentage) 0.740 362.50%
471.omnetpp 64.000 1.59%
471.omnetpp (avg) 64.000 1.59%
471.omnetpp (avg) (percentage) 2.310 -
471.omnetpp (max) 40.000 -4.76%
471.omnetpp (max) (percentage) 1.460 -6.41%
471.omnetpp (unexplained diff vs previous) 38.000 72.73%
471.omnetpp (unexplained diff vs previous) (percentage) 1.360 70.00%
473.astar 89.000 -1.11%
473.astar (avg) 89.000 -1.11%
473.astar (avg) (percentage) 1.730 -1.14%
473.astar (max) 33.000 -5.71%
473.astar (max) (percentage) 0.640 -7.25%
473.astar (unexplained diff vs previous) 5.000 -73.68%
473.astar (unexplained diff vs previous) (percentage) 0.100 -72.97%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.020 -
482.sphinx3 15.000 -
482.sphinx3 (avg) 15.000 -
482.sphinx3 (avg) (percentage) 1.880 -1.57%
482.sphinx3 (max) 10.000 -
482.sphinx3 (max) (percentage) 1.210 -6.92%
482.sphinx3 (unexplained diff vs previous) 3.000 -50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.360 -50.00%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.943 26.03%