Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=44e3c1c499331332412c1a04a348da2ddf9cf822 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (2d4312bca252738f81528623d36b45a1eae4321c) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=62fba6d9807fc12334d7c5513407715d59539611 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (unchanged)
regression GNU-1600
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/425/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0425 (basepoints/gcc-16-01128-g2d4312bca25) 2025-06-06T04:32:12 0:00:00
Previous 0424 (basepoints/gcc-16-01127-g2a8af97e352) 2025-06-05T09:03:16 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 11
Performance Improvements 95 175
Added Tests 8 0
Unchanged Tests 1115 1050
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng 4.13% 103275.000 107543.000 - 3.36% -
453.povray 1.26% 647580.000 655752.000 - -0.85% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs 1.03% 7182.000 7256.000 - -0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) 600.00% 1.000 7.000 - -99.93% -
470.lbm (unexplained diff vs previous) (percentage) 500.00% 0.030 0.180 - -99.93% -
434.zeusmp (unexplained diff vs previous) 400.00% 2.000 10.000 - -99.91% -
434.zeusmp (unexplained diff vs previous) (percentage) 366.67% 0.090 0.420 - -99.91% -
445.gobmk (unexplained diff vs previous) (percentage) 50.00% 0.100 0.150 - -99.86% -
445.gobmk (unexplained diff vs previous) 40.00% 5.000 7.000 - -99.87% -
450.soplex (unexplained diff vs previous) (percentage) 36.00% 4.750 6.460 - -99.75% -
450.soplex (unexplained diff vs previous) 27.59% 29.000 37.000 - -99.74% -
450.soplex (max) (percentage) 21.64% 4.990 6.070 - -93.69% -
450.soplex (max) 13.33% 30.000 34.000 - -93.76% -
450.soplex (avg) (percentage) 2.77% 2.530 2.600 - -59.56% -
429.mcf (unexplained diff vs previous) (percentage) 2.59% 2.320 2.380 - -99.82% -
482.sphinx3 (avg) (percentage) 2.30% 1.740 1.780 - -77.55% -
444.namd (avg) (percentage) 1.09% 0.920 0.930 - -89.91% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.03% 3.890 3.930 - -99.86% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -6.07% 610.000 573.000 - 1.06% -
453.povray -4.14% 556.000 533.000 - -2.56% -
482.sphinx3 -3.78% 873.000 840.000 - -11.11% -
462.libquantum -3.62% 138.000 133.000 - -5.00% -
429.mcf -2.32% 2068.000 2020.000 - 41.85% -
471.omnetpp -2.30% 2742.000 2679.000 - -1.65% -
447.dealII -1.17% 1627.000 1608.000 - -6.73% -
444.namd -1.08% 740.000 732.000 - -2.01% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (max) -94.05% 185.000 11.000 - -99.68% -
473.astar (max) (percentage) -93.84% 3.570 0.220 - -99.67% -
437.leslie3d (unexplained diff vs previous) -85.09% 114.000 17.000 - -99.27% -
437.leslie3d (unexplained diff vs previous) (percentage) -84.62% 1.040 0.160 - -99.20% -
401.bzip2 (max) -80.26% 152.000 30.000 - -98.70% -
401.bzip2 (max) (percentage) -79.51% 4.880 1.000 - -98.73% -
429.mcf (max) -77.56% 205.000 46.000 - -96.52% -
429.mcf (max) (percentage) -76.71% 9.960 2.320 - -97.50% -
459.GemsFDTD (max) -66.04% 106.000 36.000 - -99.18% -
459.GemsFDTD (max) (percentage) -65.14% 2.180 0.760 - -98.94% -
473.astar (unexplained diff vs previous) -64.29% 14.000 5.000 - -99.95% -
473.astar (unexplained diff vs previous) (percentage) -62.96% 0.270 0.100 - -99.95% -
410.bwaves (unexplained diff vs previous) -58.97% 39.000 16.000 - -99.79% -
410.bwaves (unexplained diff vs previous) (percentage) -58.82% 0.680 0.280 - -99.80% -
410.bwaves (max) -57.89% 76.000 32.000 - -99.02% -
410.bwaves (max) (percentage) -57.14% 1.330 0.570 - -99.02% -
471.omnetpp (max) -43.52% 108.000 61.000 - -97.19% -
444.namd (unexplained diff vs previous) -42.86% 14.000 8.000 - -99.90% -
444.namd (unexplained diff vs previous) (percentage) -42.33% 1.890 1.090 - -99.90% -
471.omnetpp (max) (percentage) -41.77% 3.950 2.300 - -97.11% -
462.libquantum (unexplained diff vs previous) -37.50% 8.000 5.000 - -99.96% -
462.libquantum (unexplained diff vs previous) (percentage) -35.17% 5.800 3.760 - -99.96% -
462.libquantum (max) -25.00% 8.000 6.000 - -95.65% -
444.namd (max) -21.43% 14.000 11.000 - -98.39% -
401.bzip2 (unexplained diff vs previous) -18.92% 37.000 30.000 - -99.72% -
401.bzip2 (unexplained diff vs previous) (percentage) -18.49% 1.190 0.970 - -99.74% -
462.libquantum (max) (percentage) -16.75% 6.150 5.120 - -94.83% -
444.namd (max) (percentage) -16.58% 1.930 1.610 - -98.25% -
447.dealII (max) (percentage) -14.67% 1.840 1.570 - -98.04% -
447.dealII (max) -13.79% 29.000 25.000 - -98.19% -
482.sphinx3 (max) -11.43% 35.000 31.000 - -96.60% -
435.gromacs (max) (percentage) -11.32% 1.060 0.940 - -98.09% -
435.gromacs (max) -10.53% 76.000 68.000 - -98.10% -
433.milc -7.14% 14.000 13.000 - -81.16% -
433.milc (avg) -7.14% 14.000 13.000 - -81.16% -
434.zeusmp -7.14% 14.000 13.000 - -91.16% -
434.zeusmp (avg) -7.14% 14.000 13.000 - -91.16% -
482.sphinx3 (max) (percentage) -6.67% 4.050 3.780 - -96.08% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
482.sphinx3 -6.67% 15.000 14.000 - -81.08% -
482.sphinx3 (avg) -6.67% 15.000 14.000 - -81.08% -
471.omnetpp (unexplained diff vs previous) -5.97% 67.000 63.000 0.000 -99.41% 0.000
470.lbm (max) (percentage) -5.26% 0.760 0.720 - -99.01% -
458.sjeng (max) -5.26% 76.000 72.000 - -98.00% -
453.povray (max) -5.00% 20.000 19.000 - -96.19% -
434.zeusmp (max) (percentage) -4.59% 1.090 1.040 - -98.73% -
433.milc (max) (percentage) -4.14% 1.450 1.390 - -98.47% -
465.tonto (max) -4.12% 267.000 256.000 - -87.88% -
465.tonto (max) (percentage) -4.08% 2.450 2.350 - -87.83% -
434.zeusmp (max) -4.00% 25.000 24.000 - -98.83% -
445.gobmk (max) -4.00% 50.000 48.000 - -98.18% -
458.sjeng (max) (percentage) -3.92% 1.020 0.980 - -97.94% -
429.mcf -3.90% 77.000 74.000 - -32.11% -
429.mcf (avg) -3.90% 77.000 74.000 - -32.11% -
445.gobmk (max) (percentage) -3.85% 1.040 1.000 - -98.10% -
471.omnetpp (unexplained diff vs previous) (percentage) -3.69% 2.440 2.350 0.000 -99.40% 0.000
470.lbm (max) -3.57% 28.000 27.000 - -99.02% -
445.gobmk -3.03% 33.000 32.000 - -83.67% -
445.gobmk (avg) -3.03% 33.000 32.000 - -83.67% -
482.sphinx3 (unexplained diff vs previous) -2.94% 34.000 33.000 - -99.87% -
465.tonto (avg) (percentage) -2.78% 1.080 1.050 - -68.56% -
453.povray (max) (percentage) -2.68% 3.730 3.630 - -96.02% -
458.sjeng -2.63% 38.000 37.000 - -84.65% -
458.sjeng (avg) -2.63% 38.000 37.000 - -84.65% -
465.tonto -2.56% 117.000 114.000 - -68.77% -
465.tonto (avg) -2.56% 117.000 114.000 - -68.77% -
410.bwaves -2.44% 41.000 40.000 - -83.94% -
410.bwaves (avg) -2.44% 41.000 40.000 - -83.94% -
473.astar -2.44% 82.000 80.000 - -62.44% -
473.astar (avg) -2.44% 82.000 80.000 - -62.44% -
437.leslie3d (max) (percentage) -2.18% 5.040 4.930 - -70.27% -
437.leslie3d (max) -2.18% 551.000 539.000 - -72.06% -
401.bzip2 -2.00% 50.000 49.000 - -69.57% -
401.bzip2 (avg) -2.00% 50.000 49.000 - -69.57% -
473.astar (avg) (percentage) -1.89% 1.590 1.560 - -62.50% -
471.omnetpp -1.85% 54.000 53.000 - -76.23% -
471.omnetpp (avg) -1.85% 54.000 53.000 - -76.23% -
437.leslie3d (avg) (percentage) -1.83% 3.830 3.760 - 23.28% -
459.GemsFDTD -1.75% 57.000 56.000 - -84.44% -
459.GemsFDTD (avg) -1.75% 57.000 56.000 - -84.44% -
437.leslie3d -1.67% 418.000 411.000 - 15.77% -
437.leslie3d (avg) -1.67% 418.000 411.000 - 15.77% -
434.zeusmp (avg) (percentage) -1.67% 0.600 0.590 - -89.91% -
470.lbm (avg) (percentage) -1.54% 0.650 0.640 - -89.89% -
410.bwaves (avg) (percentage) -1.39% 0.720 0.710 - -83.90% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 7.89% 38.000 41.000 - 41.38% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.47% 16760.000 17844.000 - 0.00% -
458.sjeng 3.36% 104048.000 107543.000 - 4.13% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 41.85% 1424.000 2020.000 - -2.32% -
401.bzip2 4.96% 2941.000 3087.000 - -0.96% -
410.bwaves 1.89% 5652.000 5759.000 - -0.28% -
450.soplex 1.06% 567.000 573.000 - -6.07% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 23.28% 3.050 3.760 - -1.83% -
437.leslie3d 15.77% 355.000 411.000 - -1.67% -
437.leslie3d (avg) 15.77% 355.000 411.000 - -1.67% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.57% 59479.000 54382.000 - 0.00% -
459.GemsFDTD -5.11% 244728.000 232218.000 - 0.00% -
444.namd -3.60% 188385.000 181608.000 - 0.00% -
447.dealII -2.70% 311591.000 303184.000 - 0.00% -
434.zeusmp -1.81% 152037.000 149287.000 - 0.00% -
433.milc -1.74% 61382.000 60316.000 - 0.00% -
470.lbm -1.73% 9691.000 9523.000 - 0.00% -
462.libquantum -1.69% 16085.000 15813.000 - 0.00% -
473.astar -1.38% 22968.000 22652.000 - 0.00% -
482.sphinx3 -1.31% 112859.000 111386.000 - 0.00% -
471.omnetpp -1.26% 478024.000 471988.000 - 0.00% -
450.soplex -1.23% 205081.000 202556.000 - 0.00% -
401.bzip2 -1.20% 44233.000 43703.000 - 0.00% -
435.gromacs -1.08% 499261.000 493890.000 - 0.82% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.53% 6173.000 4844.000 - -0.76% -
482.sphinx3 -11.11% 945.000 840.000 - -3.78% -
447.dealII -6.73% 1724.000 1608.000 - -1.17% -
434.zeusmp -6.09% 2514.000 2361.000 - 0.43% -
437.leslie3d -5.92% 11640.000 10951.000 - 0.16% -
462.libquantum -5.00% 140.000 133.000 - -3.62% -
445.gobmk -3.90% 5023.000 4827.000 - -0.14% -
453.povray -2.56% 547.000 533.000 - -4.14% -
444.namd -2.01% 747.000 732.000 - -1.08% -
458.sjeng -1.88% 7567.000 7425.000 - -0.35% -
471.omnetpp -1.65% 2724.000 2679.000 - -2.30% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 - -37.50% -
462.libquantum (unexplained diff vs previous) (percentage) -99.96% 9655.710 3.760 - -35.17% -
473.astar (unexplained diff vs previous) -99.95% 10146.000 5.000 - -64.29% -
473.astar (unexplained diff vs previous) (percentage) -99.95% 197.850 0.100 - -62.96% -
470.lbm (unexplained diff vs previous) (percentage) -99.93% 263.730 0.180 - 500.00% -
470.lbm (unexplained diff vs previous) -99.93% 9990.000 7.000 - 600.00% -
434.zeusmp (unexplained diff vs previous) -99.91% 11280.000 10.000 - 400.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.91% 448.690 0.420 - 366.67% -
444.namd (unexplained diff vs previous) -99.90% 8356.000 8.000 - -42.86% -
433.milc (unexplained diff vs previous) (percentage) -99.90% 980.800 0.950 - 0.00% -
433.milc (unexplained diff vs previous) -99.90% 11289.000 11.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.90% 1118.610 1.090 - -42.33% -
445.gobmk (unexplained diff vs previous) -99.87% 5581.000 7.000 - 40.00% -
482.sphinx3 (unexplained diff vs previous) -99.87% 26073.000 33.000 - -2.94% -
445.gobmk (unexplained diff vs previous) (percentage) -99.86% 111.110 0.150 - 50.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.86% 2759.050 3.930 - 1.03% -
429.mcf (unexplained diff vs previous) (percentage) -99.82% 1305.690 2.380 - 2.59% -
410.bwaves (unexplained diff vs previous) (percentage) -99.80% 137.900 0.280 - -58.82% -
410.bwaves (unexplained diff vs previous) -99.79% 7794.000 16.000 - -58.97% -
416.gamess (max) (percentage) -99.77% 38.550 0.090 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.76% 15458.000 37.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.75% 2557.320 6.460 - 36.00% -
450.soplex (unexplained diff vs previous) -99.74% 14500.000 37.000 - 27.59% -
429.mcf (unexplained diff vs previous) -99.74% 18593.000 48.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.74% 368.340 0.970 - -18.49% -
447.dealII (unexplained diff vs previous) -99.73% 7017.000 19.000 0.000 0.00% 0.000
401.bzip2 (unexplained diff vs previous) -99.72% 10833.000 30.000 - -18.92% -
447.dealII (unexplained diff vs previous) (percentage) -99.71% 407.020 1.180 0.000 0.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.70% 250.410 0.760 - 0.00% -
473.astar (max) -99.68% 3406.000 11.000 - -94.05% -
473.astar (max) (percentage) -99.67% 66.430 0.220 - -93.84% -
465.tonto (unexplained diff vs previous) (percentage) -99.63% 16.190 0.060 - 0.00% -
465.tonto (unexplained diff vs previous) -99.60% 1771.000 7.000 - 0.00% -
456.hmmer (max) (percentage) -99.57% 73.590 0.320 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.41% 10659.000 63.000 0.000 -5.97% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) -99.40% 391.300 2.350 0.000 -3.69% 0.000
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
437.leslie3d (unexplained diff vs previous) -99.27% 2314.000 17.000 - -85.09% -
437.leslie3d (unexplained diff vs previous) (percentage) -99.20% 19.880 0.160 - -84.62% -
459.GemsFDTD (max) -99.18% 4411.000 36.000 - -66.04% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - 0.00% -
410.bwaves (max) -99.02% 3276.000 32.000 - -57.89% -
470.lbm (max) -99.02% 2746.000 27.000 - -3.57% -
410.bwaves (max) (percentage) -99.02% 57.970 0.570 - -57.14% -
470.lbm (max) (percentage) -99.01% 72.510 0.720 - -5.26% -
459.GemsFDTD (max) (percentage) -98.94% 71.460 0.760 - -65.14% -
434.zeusmp (max) -98.83% 2055.000 24.000 - -4.00% -
401.bzip2 (max) (percentage) -98.73% 78.650 1.000 - -79.51% -
434.zeusmp (max) (percentage) -98.73% 81.770 1.040 - -4.59% -
401.bzip2 (max) -98.70% 2313.000 30.000 - -80.26% -
481.wrf (max) (percentage) -98.52% 68.700 1.020 - -0.97% -
433.milc (max) (percentage) -98.47% 90.750 1.390 - -4.14% -
433.milc (max) -98.47% 1044.000 16.000 - 0.00% -
444.namd (max) -98.39% 685.000 11.000 - -21.43% -
444.namd (max) (percentage) -98.25% 91.790 1.610 - -16.58% -
447.dealII (max) -98.19% 1384.000 25.000 - -13.79% -
445.gobmk (max) -98.18% 2643.000 48.000 - -4.00% -
445.gobmk (max) (percentage) -98.10% 52.630 1.000 - -3.85% -
435.gromacs (max) -98.10% 3573.000 68.000 - -10.53% -
435.gromacs (max) (percentage) -98.09% 49.160 0.940 - -11.32% -
447.dealII (max) (percentage) -98.04% 80.280 1.570 - -14.67% -
458.sjeng (max) -98.00% 3602.000 72.000 - -5.26% -
458.sjeng (max) (percentage) -97.94% 47.610 0.980 - -3.92% -
400.perlbench (max) (percentage) -97.64% 84.060 1.980 - -0.50% -
429.mcf (max) (percentage) -97.50% 92.890 2.320 - -76.71% -
483.xalancbmk (max) (percentage) -97.29% 68.670 1.860 - 0.00% -
471.omnetpp (max) -97.19% 2169.000 61.000 - -43.52% -
471.omnetpp (max) (percentage) -97.11% 79.650 2.300 - -41.77% -
482.sphinx3 (max) -96.60% 911.000 31.000 - -11.43% -
429.mcf (max) -96.52% 1322.000 46.000 - -77.56% -
453.povray (max) -96.19% 499.000 19.000 - -5.00% -
482.sphinx3 (max) (percentage) -96.08% 96.500 3.780 - -6.67% -
453.povray (max) (percentage) -96.02% 91.250 3.630 - -2.68% -
403.gcc (max) (percentage) -95.91% 99.360 4.060 - 0.00% -
462.libquantum (max) -95.65% 138.000 6.000 - -25.00% -
416.gamess (avg) (percentage) -95.48% 4.420 0.200 - 0.00% -
462.libquantum (max) (percentage) -94.83% 98.970 5.120 - -16.75% -
450.soplex (max) -93.76% 545.000 34.000 - 13.33% -
454.calculix (max) (percentage) -93.73% 99.730 6.250 - 0.00% -
450.soplex (max) (percentage) -93.69% 96.240 6.070 - 21.64% -
456.hmmer (avg) (percentage) -93.20% 4.410 0.300 - 0.00% -
464.h264ref (avg) (percentage) -91.55% 5.090 0.430 - 0.00% -
444.namd -91.18% 68.000 6.000 - 0.00% -
444.namd (avg) -91.18% 68.000 6.000 - 0.00% -
434.zeusmp -91.16% 147.000 13.000 - -7.14% -
434.zeusmp (avg) -91.16% 147.000 13.000 - -7.14% -
470.lbm -89.96% 239.000 24.000 - 0.00% -
470.lbm (avg) -89.96% 239.000 24.000 - 0.00% -
434.zeusmp (avg) (percentage) -89.91% 5.850 0.590 - -1.67% -
444.namd (avg) (percentage) -89.91% 9.220 0.930 - 1.09% -
470.lbm (avg) (percentage) -89.89% 6.330 0.640 - -1.54% -
436.cactusADM (avg) (percentage) -89.30% 5.980 0.640 - 0.00% -
465.tonto (max) -87.88% 2112.000 256.000 - -4.12% -
465.tonto (max) (percentage) -87.83% 19.310 2.350 - -4.08% -
481.wrf (avg) (percentage) -87.18% 6.240 0.800 - 0.00% -
447.dealII -84.85% 99.000 15.000 - 0.00% -
447.dealII (avg) -84.85% 99.000 15.000 - 0.00% -
458.sjeng -84.65% 241.000 37.000 - -2.63% -
458.sjeng (avg) -84.65% 241.000 37.000 - -2.63% -
459.GemsFDTD -84.44% 360.000 56.000 - -1.75% -
459.GemsFDTD (avg) -84.44% 360.000 56.000 - -1.75% -
458.sjeng (avg) (percentage) -84.01% 3.190 0.510 - 0.00% -
410.bwaves -83.94% 249.000 40.000 - -2.44% -
410.bwaves (avg) -83.94% 249.000 40.000 - -2.44% -
410.bwaves (avg) (percentage) -83.90% 4.410 0.710 - -1.39% -
445.gobmk -83.67% 196.000 32.000 - -3.03% -
445.gobmk (avg) -83.67% 196.000 32.000 - -3.03% -
447.dealII (avg) (percentage) -83.19% 5.770 0.970 - 0.00% -
445.gobmk (avg) (percentage) -82.61% 3.910 0.680 - -1.45% -
433.milc -81.16% 69.000 13.000 - -7.14% -
433.milc (avg) -81.16% 69.000 13.000 - -7.14% -
482.sphinx3 -81.08% 74.000 14.000 - -6.67% -
482.sphinx3 (avg) -81.08% 74.000 14.000 - -6.67% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
433.milc (avg) (percentage) -80.17% 6.050 1.200 - -0.83% -
453.povray (avg) (percentage) -80.15% 7.810 1.550 - 0.00% -
459.GemsFDTD (avg) (percentage) -80.14% 5.840 1.160 - -0.85% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
482.sphinx3 (avg) (percentage) -77.55% 7.930 1.780 - 2.30% -
471.omnetpp -76.23% 223.000 53.000 - -1.85% -
471.omnetpp (avg) -76.23% 223.000 53.000 - -1.85% -
471.omnetpp (avg) (percentage) -75.73% 8.200 1.990 - 0.00% -
400.perlbench (avg) (percentage) -74.49% 6.350 1.620 - 0.00% -
462.libquantum (avg) (percentage) -72.45% 7.660 2.110 - 0.96% -
435.gromacs -72.21% 367.000 102.000 - 0.99% -
435.gromacs (avg) -72.21% 367.000 102.000 - 0.99% -
435.gromacs (avg) (percentage) -72.13% 5.060 1.410 - 0.00% -
437.leslie3d (max) -72.06% 1929.000 539.000 - -2.18% -
401.bzip2 (avg) (percentage) -70.62% 5.480 1.610 - -0.62% -
437.leslie3d (max) (percentage) -70.27% 16.580 4.930 - -2.18% -
401.bzip2 -69.57% 161.000 49.000 - -2.00% -
401.bzip2 (avg) -69.57% 161.000 49.000 - -2.00% -
465.tonto -68.77% 365.000 114.000 - -2.56% -
465.tonto (avg) -68.77% 365.000 114.000 - -2.56% -
465.tonto (avg) (percentage) -68.56% 3.340 1.050 - -2.78% -
483.xalancbmk (avg) (percentage) -63.38% 6.500 2.380 - 0.00% -
473.astar (avg) (percentage) -62.50% 4.160 1.560 - -1.89% -
473.astar -62.44% 213.000 80.000 - -2.44% -
473.astar (avg) -62.44% 213.000 80.000 - -2.44% -
454.calculix (avg) (percentage) -61.85% 8.020 3.060 - 0.00% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
403.gcc (avg) (percentage) -60.93% 7.320 2.860 - 0.00% -
450.soplex (avg) (percentage) -59.56% 6.430 2.600 - 2.77% -
429.mcf (avg) (percentage) -51.63% 7.670 3.710 - -0.54% -
429.mcf -32.11% 109.000 74.000 - -3.90% -
429.mcf (avg) -32.11% 109.000 74.000 - -3.90% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 41.38% 29.000 41.000 - 7.89% -

Report Time: 0.38s
Execution (seconds)
Name Current %
401.bzip2 3087.000 -
410.bwaves 5759.000 -
429.mcf 2020.000 -2.32%
433.milc 1158.000 -
434.zeusmp 2361.000 -
435.gromacs 7256.000 1.03%
437.leslie3d 10951.000 -
444.namd 732.000 -1.08%
445.gobmk 4827.000 -
447.dealII 1608.000 -1.17%
450.soplex 573.000 -6.07%
453.povray 533.000 -4.14%
458.sjeng 7425.000 -
459.GemsFDTD 4844.000 -
462.libquantum 133.000 -3.62%
465.tonto 10909.000 -
470.lbm 3821.000 -
471.omnetpp 2679.000 -2.30%
473.astar 5179.000 -
482.sphinx3 840.000 -3.78%
Geometric Mean 2370.762 -1.33%
Code Size (bytes)
Name Current %
401.bzip2 43703.000 -
410.bwaves 17844.000 -
429.mcf 9094.000 -
433.milc 60316.000 -
434.zeusmp 149287.000 -
435.gromacs 493890.000 -
437.leslie3d 54382.000 -
444.namd 181608.000 -
445.gobmk 1373734.000 -
447.dealII 303184.000 -
450.soplex 202556.000 -
453.povray 655752.000 1.26%
458.sjeng 107543.000 4.13%
459.GemsFDTD 232218.000 -
462.libquantum 15813.000 -
465.tonto 1950653.000 -
470.lbm 9523.000 -
471.omnetpp 471988.000 -
473.astar 22652.000 -
482.sphinx3 111386.000 -
Geometric Mean 114520.190 -
Score
Name Current %
nb_compile_successful 20.000 -
nb_execution_successful 20.000 -
nb_total_tests 41.000 7.89%
Geometric Mean 25.407 2.57%
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.620 -
400.perlbench (max) (percentage) 1.980 -
401.bzip2 49.000 -2.00%
401.bzip2 (avg) 49.000 -2.00%
401.bzip2 (avg) (percentage) 1.610 -
401.bzip2 (max) 30.000 -80.26%
401.bzip2 (max) (percentage) 1.000 -79.51%
401.bzip2 (unexplained diff vs previous) 30.000 -18.92%
401.bzip2 (unexplained diff vs previous) (percentage) 0.970 -18.49%
403.gcc (avg) (percentage) 2.860 -
403.gcc (max) (percentage) 4.060 -
410.bwaves 40.000 -2.44%
410.bwaves (avg) 40.000 -2.44%
410.bwaves (avg) (percentage) 0.710 -1.39%
410.bwaves (max) 32.000 -57.89%
410.bwaves (max) (percentage) 0.570 -57.14%
410.bwaves (unexplained diff vs previous) 16.000 -58.97%
410.bwaves (unexplained diff vs previous) (percentage) 0.280 -58.82%
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.090 -
429.mcf 74.000 -3.90%
429.mcf (avg) 74.000 -3.90%
429.mcf (avg) (percentage) 3.710 -
429.mcf (max) 46.000 -77.56%
429.mcf (max) (percentage) 2.320 -76.71%
429.mcf (unexplained diff vs previous) 48.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.380 2.59%
433.milc 13.000 -7.14%
433.milc (avg) 13.000 -7.14%
433.milc (avg) (percentage) 1.200 -
433.milc (max) 16.000 -
433.milc (max) (percentage) 1.390 -4.14%
433.milc (unexplained diff vs previous) 11.000 -
433.milc (unexplained diff vs previous) (percentage) 0.950 -
434.zeusmp 13.000 -7.14%
434.zeusmp (avg) 13.000 -7.14%
434.zeusmp (avg) (percentage) 0.590 -1.67%
434.zeusmp (max) 24.000 -4.00%
434.zeusmp (max) (percentage) 1.040 -4.59%
434.zeusmp (unexplained diff vs previous) 10.000 400.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.420 366.67%
435.gromacs 102.000 -
435.gromacs (avg) 102.000 -
435.gromacs (avg) (percentage) 1.410 -
435.gromacs (max) 68.000 -10.53%
435.gromacs (max) (percentage) 0.940 -11.32%
436.cactusADM (avg) (percentage) 0.640 -
436.cactusADM (max) (percentage) 0.850 -
437.leslie3d 411.000 -1.67%
437.leslie3d (avg) 411.000 -1.67%
437.leslie3d (avg) (percentage) 3.760 -1.83%
437.leslie3d (max) 539.000 -2.18%
437.leslie3d (max) (percentage) 4.930 -2.18%
437.leslie3d (unexplained diff vs previous) 17.000 -85.09%
437.leslie3d (unexplained diff vs previous) (percentage) 0.160 -84.62%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.930 1.09%
444.namd (max) 11.000 -21.43%
444.namd (max) (percentage) 1.610 -16.58%
444.namd (unexplained diff vs previous) 8.000 -42.86%
444.namd (unexplained diff vs previous) (percentage) 1.090 -42.33%
445.gobmk 32.000 -3.03%
445.gobmk (avg) 32.000 -3.03%
445.gobmk (avg) (percentage) 0.680 -
445.gobmk (max) 48.000 -4.00%
445.gobmk (max) (percentage) 1.000 -3.85%
445.gobmk (unexplained diff vs previous) 7.000 40.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.150 50.00%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 0.970 -
447.dealII (max) 25.000 -13.79%
447.dealII (max) (percentage) 1.570 -14.67%
447.dealII (unexplained diff vs previous) 19.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.180 -
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.600 2.77%
450.soplex (max) 34.000 13.33%
450.soplex (max) (percentage) 6.070 21.64%
450.soplex (unexplained diff vs previous) 37.000 27.59%
450.soplex (unexplained diff vs previous) (percentage) 6.460 36.00%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.550 -
453.povray (max) 19.000 -5.00%
453.povray (max) (percentage) 3.630 -2.68%
454.calculix (avg) (percentage) 3.060 -
454.calculix (max) (percentage) 6.250 -
456.hmmer (avg) (percentage) 0.300 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 37.000 -2.63%
458.sjeng (avg) 37.000 -2.63%
458.sjeng (avg) (percentage) 0.510 -
458.sjeng (max) 72.000 -5.26%
458.sjeng (max) (percentage) 0.980 -3.92%
459.GemsFDTD 56.000 -1.75%
459.GemsFDTD (avg) 56.000 -1.75%
459.GemsFDTD (avg) (percentage) 1.160 -
459.GemsFDTD (max) 36.000 -66.04%
459.GemsFDTD (max) (percentage) 0.760 -65.14%
459.GemsFDTD (unexplained diff vs previous) 37.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.760 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.110 -
462.libquantum (max) 6.000 -25.00%
462.libquantum (max) (percentage) 5.120 -16.75%
462.libquantum (unexplained diff vs previous) 5.000 -37.50%
462.libquantum (unexplained diff vs previous) (percentage) 3.760 -35.17%
464.h264ref (avg) (percentage) 0.430 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 114.000 -2.56%
465.tonto (avg) 114.000 -2.56%
465.tonto (avg) (percentage) 1.050 -2.78%
465.tonto (max) 256.000 -4.12%
465.tonto (max) (percentage) 2.350 -4.08%
465.tonto (unexplained diff vs previous) 7.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.060 -
470.lbm 24.000 -
470.lbm (avg) 24.000 -
470.lbm (avg) (percentage) 0.640 -1.54%
470.lbm (max) 27.000 -3.57%
470.lbm (max) (percentage) 0.720 -5.26%
470.lbm (unexplained diff vs previous) 7.000 600.00%
470.lbm (unexplained diff vs previous) (percentage) 0.180 500.00%
471.omnetpp 53.000 -1.85%
471.omnetpp (avg) 53.000 -1.85%
471.omnetpp (avg) (percentage) 1.990 -
471.omnetpp (max) 61.000 -43.52%
471.omnetpp (max) (percentage) 2.300 -41.77%
471.omnetpp (unexplained diff vs previous) 63.000 -5.97%
471.omnetpp (unexplained diff vs previous) (percentage) 2.350 -3.69%
473.astar 80.000 -2.44%
473.astar (avg) 80.000 -2.44%
473.astar (avg) (percentage) 1.560 -1.89%
473.astar (max) 11.000 -94.05%
473.astar (max) (percentage) 0.220 -93.84%
473.astar (unexplained diff vs previous) 5.000 -64.29%
473.astar (unexplained diff vs previous) (percentage) 0.100 -62.96%
481.wrf (avg) (percentage) 0.800 -
481.wrf (max) (percentage) 1.020 -
482.sphinx3 14.000 -6.67%
482.sphinx3 (avg) 14.000 -6.67%
482.sphinx3 (avg) (percentage) 1.780 2.30%
482.sphinx3 (max) 31.000 -11.43%
482.sphinx3 (max) (percentage) 3.780 -6.67%
482.sphinx3 (unexplained diff vs previous) 33.000 -2.94%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.930 1.03%
483.xalancbmk (avg) (percentage) 2.380 -
483.xalancbmk (max) (percentage) 1.860 -
Geometric Mean 5.520 -17.34%