Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=44e3c1c499331332412c1a04a348da2ddf9cf822 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (2a8af97e3528f812201687334f64b27b94d01271) (+ 30 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=62fba6d9807fc12334d7c5513407715d59539611 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/424/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0424 (basepoints/gcc-16-01127-g2a8af97e352) 2025-06-05T09:03:16 0:00:00
Previous 0422 (3-changed-components) 2025-06-03T18:05:25 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 61 13
Performance Improvements 47 172
Unchanged Tests 1128 1051
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 6.15% 130.000 138.000 - -1.43% -
450.soplex 4.99% 581.000 610.000 - 7.58% -
482.sphinx3 4.05% 839.000 873.000 - -7.62% -
453.povray 3.73% 536.000 556.000 - 1.65% -
471.omnetpp 2.50% 2675.000 2742.000 - 0.66% -
429.mcf 2.38% 2020.000 2068.000 - 45.22% -
444.namd 1.93% 726.000 740.000 - -0.94% -
433.milc 1.39% 1153.000 1169.000 - 1.56% -
401.bzip2 1.20% 3080.000 3117.000 - 5.98% -
459.GemsFDTD 1.14% 4826.000 4881.000 - -20.93% -
437.leslie3d 1.05% 10820.000 10934.000 - -6.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 1133.33% 3.000 37.000 - -99.66% -
401.bzip2 (unexplained diff vs previous) (percentage) 1090.00% 0.100 1.190 - -99.68% -
482.sphinx3 (unexplained diff vs previous) 1033.33% 3.000 34.000 - -99.87% -
482.sphinx3 (unexplained diff vs previous) (percentage) 980.56% 0.360 3.890 - -99.86% -
462.libquantum (unexplained diff vs previous) 700.00% 1.000 8.000 - -99.94% -
462.libquantum (unexplained diff vs previous) (percentage) 653.25% 0.770 5.800 - -99.94% -
473.astar (unexplained diff vs previous) 250.00% 4.000 14.000 - -99.86% -
473.astar (unexplained diff vs previous) (percentage) 237.50% 0.080 0.270 - -99.86% -
453.povray (unexplained diff vs previous) 233.33% 6.000 20.000 - -99.65% -
450.soplex (unexplained diff vs previous) 222.22% 9.000 29.000 - -99.80% -
453.povray (unexplained diff vs previous) (percentage) 221.43% 1.120 3.600 - -99.65% -
450.soplex (unexplained diff vs previous) (percentage) 206.45% 1.550 4.750 - -99.81% -
471.omnetpp (unexplained diff vs previous) 139.29% 28.000 67.000 - -99.37% -
471.omnetpp (unexplained diff vs previous) (percentage) 132.38% 1.050 2.440 - -99.38% -
410.bwaves (unexplained diff vs previous) 129.41% 17.000 39.000 - -99.50% -
410.bwaves (unexplained diff vs previous) (percentage) 126.67% 0.300 0.680 - -99.51% -
434.zeusmp (unexplained diff vs previous) (percentage) 125.00% 0.040 0.090 - -99.98% -
429.mcf (unexplained diff vs previous) 118.18% 22.000 48.000 - -99.74% -
429.mcf (unexplained diff vs previous) (percentage) 112.84% 1.090 2.320 - -99.82% -
434.zeusmp (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.98% -
462.libquantum (max) 100.00% 4.000 8.000 - -94.20% -
462.libquantum (max) (percentage) 78.26% 3.450 6.150 - -93.79% -
445.gobmk (unexplained diff vs previous) (percentage) 66.67% 0.060 0.100 - -99.91% -
445.gobmk (unexplained diff vs previous) 66.67% 3.000 5.000 - -99.91% -
444.namd (max) 55.56% 9.000 14.000 - -97.96% -
453.povray (max) 42.86% 14.000 20.000 - -95.99% -
444.namd (max) (percentage) 41.91% 1.360 1.930 - -97.90% -
453.povray (max) (percentage) 41.83% 2.630 3.730 - -95.91% -
444.namd (unexplained diff vs previous) 40.00% 10.000 14.000 - -99.83% -
444.namd (unexplained diff vs previous) (percentage) 36.96% 1.380 1.890 - -99.83% -
433.milc 7.69% 13.000 14.000 - -79.71% -
433.milc (avg) 7.69% 13.000 14.000 - -79.71% -
450.soplex 7.14% 14.000 15.000 - -58.33% -
450.soplex (avg) 7.14% 14.000 15.000 - -58.33% -
450.soplex (max) 7.14% 28.000 30.000 - -94.50% -
482.sphinx3 7.14% 14.000 15.000 - -79.73% -
482.sphinx3 (avg) 7.14% 14.000 15.000 - -79.73% -
471.omnetpp 3.85% 52.000 54.000 - -75.78% -
471.omnetpp (avg) 3.85% 52.000 54.000 - -75.78% -
462.libquantum (avg) (percentage) 3.47% 2.020 2.090 - -72.72% -
453.povray (avg) (percentage) 3.33% 1.500 1.550 - -80.15% -
482.sphinx3 (max) 2.94% 34.000 35.000 - -96.16% -
450.soplex (max) (percentage) 2.67% 4.860 4.990 - -94.82% -
429.mcf 2.67% 75.000 77.000 - -29.36% -
429.mcf (avg) 2.67% 75.000 77.000 - -29.36% -
482.sphinx3 (avg) (percentage) 2.35% 1.700 1.740 - -78.06% -
444.namd (avg) (percentage) 2.22% 0.900 0.920 - -90.02% -
450.soplex (avg) (percentage) 2.02% 2.480 2.530 - -60.65% -
459.GemsFDTD 1.79% 56.000 57.000 - -84.17% -
459.GemsFDTD (avg) 1.79% 56.000 57.000 - -84.17% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) -77.78% 9.000 2.000 - -99.97% -
458.sjeng (unexplained diff vs previous) (percentage) -75.00% 0.120 0.030 - -99.97% -
470.lbm (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.99% -
470.lbm (unexplained diff vs previous) (percentage) -62.50% 0.080 0.030 - -99.99% -
435.gromacs (max) -54.22% 166.000 76.000 - -97.87% -
435.gromacs (max) (percentage) -53.71% 2.290 1.060 - -97.84% -
437.leslie3d (unexplained diff vs previous) (percentage) -37.35% 1.660 1.040 - -94.77% -
437.leslie3d (unexplained diff vs previous) -36.67% 180.000 114.000 - -95.07% -
435.gromacs (unexplained diff vs previous) -29.70% 101.000 71.000 - -98.99% -
435.gromacs (unexplained diff vs previous) (percentage) -28.78% 1.390 0.990 - -98.98% -
434.zeusmp (max) -7.41% 27.000 25.000 - -98.78% -
470.lbm (max) -6.67% 30.000 28.000 - -98.98% -
433.milc (max) (percentage) -6.45% 1.550 1.450 - -98.40% -
471.omnetpp (max) (percentage) -6.40% 4.220 3.950 - -95.04% -
410.bwaves (max) (percentage) -6.34% 1.420 1.330 - -97.71% -
470.lbm (max) (percentage) -6.17% 0.810 0.760 - -98.95% -
410.bwaves (max) -6.17% 81.000 76.000 - -97.68% -
433.milc (max) -5.88% 17.000 16.000 - -98.47% -
445.gobmk (max) -5.66% 53.000 50.000 - -98.11% -
445.gobmk (max) (percentage) -5.45% 1.100 1.040 - -98.02% -
465.tonto (max) (percentage) -5.41% 2.590 2.450 - -87.31% -
401.bzip2 (max) (percentage) -5.24% 5.150 4.880 - -93.80% -
434.zeusmp (max) (percentage) -5.22% 1.150 1.090 - -98.67% -
459.GemsFDTD (max) (percentage) -5.22% 2.300 2.180 - -96.95% -
465.tonto (max) -4.98% 281.000 267.000 - -87.36% -
429.mcf (max) (percentage) -4.78% 10.460 9.960 - -89.28% -
458.sjeng (max) (percentage) -4.67% 1.070 1.020 - -97.86% -
473.astar (max) (percentage) -4.55% 3.740 3.570 - -94.63% -
473.astar (max) -4.15% 193.000 185.000 - -94.57% -
401.bzip2 (max) -3.80% 158.000 152.000 - -93.43% -
458.sjeng (max) -3.80% 79.000 76.000 - -97.89% -
459.GemsFDTD (max) -3.64% 110.000 106.000 - -97.60% -
471.omnetpp (max) -3.57% 112.000 108.000 - -95.02% -
447.dealII (max) -3.33% 30.000 29.000 - -97.90% -
445.gobmk -2.94% 34.000 33.000 - -83.16% -
445.gobmk (avg) -2.94% 34.000 33.000 - -83.16% -
429.mcf (max) -2.84% 211.000 205.000 - -84.49% -
445.gobmk (avg) (percentage) -2.82% 0.710 0.690 - -82.35% -
437.leslie3d (max) (percentage) -2.70% 5.180 5.040 - -69.60% -
447.dealII (max) (percentage) -2.65% 1.890 1.840 - -97.71% -
458.sjeng (avg) (percentage) -1.92% 0.520 0.510 - -84.01% -
434.zeusmp (avg) (percentage) -1.64% 0.610 0.600 - -89.74% -
437.leslie3d (max) -1.61% 560.000 551.000 - -71.44% -
437.leslie3d (avg) (percentage) -1.29% 3.880 3.830 - 25.57% -
473.astar (avg) (percentage) -1.24% 1.610 1.590 - -61.78% -
473.astar -1.20% 83.000 82.000 - -61.50% -
473.astar (avg) -1.20% 83.000 82.000 - -61.50% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.47% 16760.000 17844.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 45.22% 1424.000 2068.000 - 2.38% -
450.soplex 7.58% 567.000 610.000 - 4.99% -
401.bzip2 5.98% 2941.000 3117.000 - 1.20% -
410.bwaves 2.18% 5652.000 5775.000 - 0.68% -
453.povray 1.65% 547.000 556.000 - 3.73% -
433.milc 1.56% 1151.000 1169.000 - 1.39% -
473.astar 1.09% 5128.000 5184.000 - 0.27% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 25.57% 3.050 3.830 - -1.29% -
437.leslie3d 17.75% 355.000 418.000 - -0.24% -
437.leslie3d (avg) 17.75% 355.000 418.000 - -0.24% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.57% 59479.000 54382.000 - 0.00% -
459.GemsFDTD -5.11% 244728.000 232218.000 - 0.00% -
444.namd -3.60% 188385.000 181608.000 - 0.00% -
447.dealII -2.70% 311591.000 303184.000 - -0.09% -
453.povray -2.09% 661389.000 647580.000 - 0.00% -
435.gromacs -1.88% 499261.000 489850.000 - 0.00% -
434.zeusmp -1.81% 152037.000 149287.000 - 0.00% -
433.milc -1.74% 61382.000 60316.000 - -0.04% -
470.lbm -1.73% 9691.000 9523.000 - 0.00% -
462.libquantum -1.69% 16085.000 15813.000 - 0.20% -
473.astar -1.38% 22968.000 22652.000 - 0.00% -
482.sphinx3 -1.31% 112859.000 111386.000 - 0.00% -
471.omnetpp -1.26% 478024.000 471988.000 - 0.00% -
450.soplex -1.23% 205081.000 202556.000 - 0.00% -
401.bzip2 -1.20% 44233.000 43703.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -20.93% 6173.000 4881.000 - 1.14% -
482.sphinx3 -7.62% 945.000 873.000 - 4.05% -
434.zeusmp -6.48% 2514.000 2351.000 - -0.08% -
437.leslie3d -6.07% 11640.000 10934.000 - 1.05% -
447.dealII -5.63% 1724.000 1627.000 - 0.87% -
445.gobmk -3.76% 5023.000 4834.000 - 0.10% -
458.sjeng -1.53% 7567.000 7451.000 - -0.03% -
462.libquantum -1.43% 140.000 138.000 - 6.15% -
435.gromacs -1.20% 7269.000 7182.000 - -0.98% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.99% 9990.000 1.000 - -66.67% -
470.lbm (unexplained diff vs previous) (percentage) -99.99% 263.730 0.030 - -62.50% -
434.zeusmp (unexplained diff vs previous) -99.98% 11280.000 2.000 - 100.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.98% 448.690 0.090 - 125.00% -
458.sjeng (unexplained diff vs previous) -99.97% 6876.000 2.000 - -77.78% -
458.sjeng (unexplained diff vs previous) (percentage) -99.97% 90.870 0.030 - -75.00% -
462.libquantum (unexplained diff vs previous) -99.94% 13518.000 8.000 - 700.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.94% 9655.710 5.800 - 653.25% -
445.gobmk (unexplained diff vs previous) -99.91% 5581.000 5.000 - 66.67% -
445.gobmk (unexplained diff vs previous) (percentage) -99.91% 111.110 0.100 - 66.67% -
482.sphinx3 (unexplained diff vs previous) -99.87% 26073.000 34.000 - 1033.33% -
473.astar (unexplained diff vs previous) (percentage) -99.86% 197.850 0.270 - 237.50% -
473.astar (unexplained diff vs previous) -99.86% 10146.000 14.000 - 250.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.86% 2759.050 3.890 - 980.56% -
444.namd (unexplained diff vs previous) -99.83% 8356.000 14.000 - 40.00% -
444.namd (unexplained diff vs previous) (percentage) -99.83% 1118.610 1.890 - 36.96% -
429.mcf (unexplained diff vs previous) (percentage) -99.82% 1305.690 2.320 - 112.84% -
450.soplex (unexplained diff vs previous) (percentage) -99.81% 2557.320 4.750 - 206.45% -
450.soplex (unexplained diff vs previous) -99.80% 14500.000 29.000 - 222.22% -
416.gamess (max) (percentage) -99.77% 38.550 0.090 - 0.00% -
429.mcf (unexplained diff vs previous) -99.74% 18593.000 48.000 - 118.18% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.68% 368.340 1.190 - 1090.00% -
401.bzip2 (unexplained diff vs previous) -99.66% 10833.000 37.000 - 1133.33% -
453.povray (unexplained diff vs previous) (percentage) -99.65% 1043.330 3.600 - 221.43% -
453.povray (unexplained diff vs previous) -99.65% 5707.000 20.000 - 233.33% -
456.hmmer (max) (percentage) -99.57% 73.590 0.320 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.51% 137.900 0.680 - 126.67% -
410.bwaves (unexplained diff vs previous) -99.50% 7794.000 39.000 - 129.41% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.38% 391.300 2.440 - 132.38% -
471.omnetpp (unexplained diff vs previous) -99.37% 10659.000 67.000 - 139.29% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - 0.00% -
435.gromacs (unexplained diff vs previous) -98.99% 7028.000 71.000 - -29.70% -
470.lbm (max) -98.98% 2746.000 28.000 - -6.67% -
435.gromacs (unexplained diff vs previous) (percentage) -98.98% 96.680 0.990 - -28.78% -
470.lbm (max) (percentage) -98.95% 72.510 0.760 - -6.17% -
434.zeusmp (max) -98.78% 2055.000 25.000 - -7.41% -
434.zeusmp (max) (percentage) -98.67% 81.770 1.090 - -5.22% -
481.wrf (max) (percentage) -98.50% 68.700 1.030 - 0.00% -
433.milc (max) -98.47% 1044.000 16.000 - -5.88% -
433.milc (max) (percentage) -98.40% 90.750 1.450 - -6.45% -
445.gobmk (max) -98.11% 2643.000 50.000 - -5.66% -
445.gobmk (max) (percentage) -98.02% 52.630 1.040 - -5.45% -
444.namd (max) -97.96% 685.000 14.000 - 55.56% -
447.dealII (max) -97.90% 1384.000 29.000 - -3.33% -
444.namd (max) (percentage) -97.90% 91.790 1.930 - 41.91% -
458.sjeng (max) -97.89% 3602.000 76.000 - -3.80% -
435.gromacs (max) -97.87% 3573.000 76.000 - -54.22% -
458.sjeng (max) (percentage) -97.86% 47.610 1.020 - -4.67% -
435.gromacs (max) (percentage) -97.84% 49.160 1.060 - -53.71% -
447.dealII (max) (percentage) -97.71% 80.280 1.840 - -2.65% -
410.bwaves (max) (percentage) -97.71% 57.970 1.330 - -6.34% -
410.bwaves (max) -97.68% 3276.000 76.000 - -6.17% -
400.perlbench (max) (percentage) -97.63% 84.060 1.990 - 0.00% -
459.GemsFDTD (max) -97.60% 4411.000 106.000 - -3.64% -
483.xalancbmk (max) (percentage) -97.29% 68.670 1.860 - 0.00% -
459.GemsFDTD (max) (percentage) -96.95% 71.460 2.180 - -5.22% -
482.sphinx3 (max) -96.16% 911.000 35.000 - 2.94% -
453.povray (max) -95.99% 499.000 20.000 - 42.86% -
403.gcc (max) (percentage) -95.91% 99.360 4.060 - 0.00% -
453.povray (max) (percentage) -95.91% 91.250 3.730 - 41.83% -
482.sphinx3 (max) (percentage) -95.80% 96.500 4.050 - -0.49% -
416.gamess (avg) (percentage) -95.48% 4.420 0.200 - 0.00% -
437.leslie3d (unexplained diff vs previous) -95.07% 2314.000 114.000 - -36.67% -
471.omnetpp (max) (percentage) -95.04% 79.650 3.950 - -6.40% -
471.omnetpp (max) -95.02% 2169.000 108.000 - -3.57% -
450.soplex (max) (percentage) -94.82% 96.240 4.990 - 2.67% -
437.leslie3d (unexplained diff vs previous) (percentage) -94.77% 19.880 1.040 - -37.35% -
473.astar (max) (percentage) -94.63% 66.430 3.570 - -4.55% -
473.astar (max) -94.57% 3406.000 185.000 - -4.15% -
450.soplex (max) -94.50% 545.000 30.000 - 7.14% -
462.libquantum (max) -94.20% 138.000 8.000 - 100.00% -
401.bzip2 (max) (percentage) -93.80% 78.650 4.880 - -5.24% -
462.libquantum (max) (percentage) -93.79% 98.970 6.150 - 78.26% -
454.calculix (max) (percentage) -93.73% 99.730 6.250 - 0.00% -
401.bzip2 (max) -93.43% 2313.000 152.000 - -3.80% -
456.hmmer (avg) (percentage) -93.20% 4.410 0.300 - 0.00% -
464.h264ref (avg) (percentage) -91.55% 5.090 0.430 - 0.00% -
444.namd -91.18% 68.000 6.000 - 0.00% -
444.namd (avg) -91.18% 68.000 6.000 - 0.00% -
434.zeusmp -90.48% 147.000 14.000 - 0.00% -
434.zeusmp (avg) -90.48% 147.000 14.000 - 0.00% -
444.namd (avg) (percentage) -90.02% 9.220 0.920 - 2.22% -
470.lbm -89.96% 239.000 24.000 - 0.00% -
470.lbm (avg) -89.96% 239.000 24.000 - 0.00% -
434.zeusmp (avg) (percentage) -89.74% 5.850 0.600 - -1.64% -
470.lbm (avg) (percentage) -89.73% 6.330 0.650 - 0.00% -
436.cactusADM (avg) (percentage) -89.30% 5.980 0.640 - 0.00% -
429.mcf (max) (percentage) -89.28% 92.890 9.960 - -4.78% -
465.tonto (max) -87.36% 2112.000 267.000 - -4.98% -
465.tonto (max) (percentage) -87.31% 19.310 2.450 - -5.41% -
481.wrf (avg) (percentage) -87.18% 6.240 0.800 - 0.00% -
447.dealII -84.85% 99.000 15.000 - 0.00% -
447.dealII (avg) -84.85% 99.000 15.000 - 0.00% -
429.mcf (max) -84.49% 1322.000 205.000 - -2.84% -
458.sjeng -84.23% 241.000 38.000 - 0.00% -
458.sjeng (avg) -84.23% 241.000 38.000 - 0.00% -
459.GemsFDTD -84.17% 360.000 57.000 - 1.79% -
459.GemsFDTD (avg) -84.17% 360.000 57.000 - 1.79% -
458.sjeng (avg) (percentage) -84.01% 3.190 0.510 - -1.92% -
410.bwaves (avg) (percentage) -83.67% 4.410 0.720 - 0.00% -
410.bwaves -83.53% 249.000 41.000 - 0.00% -
410.bwaves (avg) -83.53% 249.000 41.000 - 0.00% -
447.dealII (avg) (percentage) -83.19% 5.770 0.970 - 0.00% -
445.gobmk -83.16% 196.000 33.000 - -2.94% -
445.gobmk (avg) -83.16% 196.000 33.000 - -2.94% -
445.gobmk (avg) (percentage) -82.35% 3.910 0.690 - -2.82% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) (percentage) -80.15% 7.810 1.550 - 3.33% -
433.milc (avg) (percentage) -80.00% 6.050 1.210 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -79.97% 5.840 1.170 - 0.00% -
482.sphinx3 -79.73% 74.000 15.000 - 7.14% -
482.sphinx3 (avg) -79.73% 74.000 15.000 - 7.14% -
433.milc -79.71% 69.000 14.000 - 7.69% -
433.milc (avg) -79.71% 69.000 14.000 - 7.69% -
482.sphinx3 (avg) (percentage) -78.06% 7.930 1.740 - 2.35% -
471.omnetpp -75.78% 223.000 54.000 - 3.85% -
471.omnetpp (avg) -75.78% 223.000 54.000 - 3.85% -
471.omnetpp (avg) (percentage) -75.73% 8.200 1.990 - 0.51% -
400.perlbench (avg) (percentage) -74.49% 6.350 1.620 - 0.00% -
462.libquantum (avg) (percentage) -72.72% 7.660 2.090 - 3.47% -
435.gromacs -72.48% 367.000 101.000 - -0.98% -
435.gromacs (avg) -72.48% 367.000 101.000 - -0.98% -
435.gromacs (avg) (percentage) -72.13% 5.060 1.410 - 0.00% -
437.leslie3d (max) -71.44% 1929.000 551.000 - -1.61% -
401.bzip2 (avg) (percentage) -70.44% 5.480 1.620 - -0.61% -
437.leslie3d (max) (percentage) -69.60% 16.580 5.040 - -2.70% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
465.tonto -67.95% 365.000 117.000 - 0.00% -
465.tonto (avg) -67.95% 365.000 117.000 - 0.00% -
465.tonto (avg) (percentage) -67.66% 3.340 1.080 - 0.00% -
483.xalancbmk (avg) (percentage) -63.38% 6.500 2.380 - 0.00% -
454.calculix (avg) (percentage) -61.85% 8.020 3.060 - 0.00% -
473.astar (avg) (percentage) -61.78% 4.160 1.590 - -1.24% -
473.astar -61.50% 213.000 82.000 - -1.20% -
473.astar (avg) -61.50% 213.000 82.000 - -1.20% -
403.gcc (avg) (percentage) -60.93% 7.320 2.860 - 0.00% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 2.02% -
450.soplex -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) -58.33% 36.000 15.000 - 7.14% -
429.mcf (avg) (percentage) -51.37% 7.670 3.730 - -0.53% -
429.mcf -29.36% 109.000 77.000 - 2.67% -
429.mcf (avg) -29.36% 109.000 77.000 - 2.67% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.38s
Execution (seconds)
Name Current %
401.bzip2 3117.000 1.20%
410.bwaves 5775.000 -
429.mcf 2068.000 2.38%
433.milc 1169.000 1.39%
434.zeusmp 2351.000 -
435.gromacs 7182.000 -
437.leslie3d 10934.000 1.05%
444.namd 740.000 1.93%
445.gobmk 4834.000 -
447.dealII 1627.000 -
450.soplex 610.000 4.99%
453.povray 556.000 3.73%
458.sjeng 7451.000 -
459.GemsFDTD 4881.000 1.14%
462.libquantum 138.000 6.15%
465.tonto 10916.000 -
470.lbm 3814.000 -
471.omnetpp 2742.000 2.50%
473.astar 5184.000 -
482.sphinx3 873.000 4.05%
Geometric Mean 2402.718 1.58%
Code Size (bytes)
Name Current %
401.bzip2 43703.000 -
410.bwaves 17844.000 -
429.mcf 9094.000 -
433.milc 60316.000 -
434.zeusmp 149287.000 -
435.gromacs 489850.000 -
437.leslie3d 54382.000 -
444.namd 181608.000 -
445.gobmk 1373734.000 -
447.dealII 303184.000 -
450.soplex 202556.000 -
453.povray 647580.000 -
458.sjeng 103275.000 -
459.GemsFDTD 232218.000 -
462.libquantum 15813.000 -
465.tonto 1950653.000 -
470.lbm 9523.000 -
471.omnetpp 471988.000 -
473.astar 22652.000 -
482.sphinx3 111386.000 -
Geometric Mean 114170.012 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.620 -
400.perlbench (max) (percentage) 1.990 -
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.620 -
401.bzip2 (max) 152.000 -3.80%
401.bzip2 (max) (percentage) 4.880 -5.24%
401.bzip2 (unexplained diff vs previous) 37.000 1133.33%
401.bzip2 (unexplained diff vs previous) (percentage) 1.190 1090.00%
403.gcc (avg) (percentage) 2.860 -
403.gcc (max) (percentage) 4.060 -
410.bwaves 41.000 -
410.bwaves (avg) 41.000 -
410.bwaves (avg) (percentage) 0.720 -
410.bwaves (max) 76.000 -6.17%
410.bwaves (max) (percentage) 1.330 -6.34%
410.bwaves (unexplained diff vs previous) 39.000 129.41%
410.bwaves (unexplained diff vs previous) (percentage) 0.680 126.67%
416.gamess (avg) (percentage) 0.200 -
416.gamess (max) (percentage) 0.090 -
429.mcf 77.000 2.67%
429.mcf (avg) 77.000 2.67%
429.mcf (avg) (percentage) 3.730 -
429.mcf (max) 205.000 -2.84%
429.mcf (max) (percentage) 9.960 -4.78%
429.mcf (unexplained diff vs previous) 48.000 118.18%
429.mcf (unexplained diff vs previous) (percentage) 2.320 112.84%
433.milc 14.000 7.69%
433.milc (avg) 14.000 7.69%
433.milc (avg) (percentage) 1.210 -
433.milc (max) 16.000 -5.88%
433.milc (max) (percentage) 1.450 -6.45%
434.zeusmp 14.000 -
434.zeusmp (avg) 14.000 -
434.zeusmp (avg) (percentage) 0.600 -1.64%
434.zeusmp (max) 25.000 -7.41%
434.zeusmp (max) (percentage) 1.090 -5.22%
434.zeusmp (unexplained diff vs previous) 2.000 100.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.090 125.00%
435.gromacs 101.000 -
435.gromacs (avg) 101.000 -
435.gromacs (avg) (percentage) 1.410 -
435.gromacs (max) 76.000 -54.22%
435.gromacs (max) (percentage) 1.060 -53.71%
435.gromacs (unexplained diff vs previous) 71.000 -29.70%
435.gromacs (unexplained diff vs previous) (percentage) 0.990 -28.78%
436.cactusADM (avg) (percentage) 0.640 -
436.cactusADM (max) (percentage) 0.850 -
437.leslie3d 418.000 -
437.leslie3d (avg) 418.000 -
437.leslie3d (avg) (percentage) 3.830 -1.29%
437.leslie3d (max) 551.000 -1.61%
437.leslie3d (max) (percentage) 5.040 -2.70%
437.leslie3d (unexplained diff vs previous) 114.000 -36.67%
437.leslie3d (unexplained diff vs previous) (percentage) 1.040 -37.35%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.920 2.22%
444.namd (max) 14.000 55.56%
444.namd (max) (percentage) 1.930 41.91%
444.namd (unexplained diff vs previous) 14.000 40.00%
444.namd (unexplained diff vs previous) (percentage) 1.890 36.96%
445.gobmk 33.000 -2.94%
445.gobmk (avg) 33.000 -2.94%
445.gobmk (avg) (percentage) 0.690 -2.82%
445.gobmk (max) 50.000 -5.66%
445.gobmk (max) (percentage) 1.040 -5.45%
445.gobmk (unexplained diff vs previous) 5.000 66.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.100 66.67%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 0.970 -
447.dealII (max) 29.000 -3.33%
447.dealII (max) (percentage) 1.840 -2.65%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.530 2.02%
450.soplex (max) 30.000 7.14%
450.soplex (max) (percentage) 4.990 2.67%
450.soplex (unexplained diff vs previous) 29.000 222.22%
450.soplex (unexplained diff vs previous) (percentage) 4.750 206.45%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.550 3.33%
453.povray (max) 20.000 42.86%
453.povray (max) (percentage) 3.730 41.83%
453.povray (unexplained diff vs previous) 20.000 233.33%
453.povray (unexplained diff vs previous) (percentage) 3.600 221.43%
454.calculix (avg) (percentage) 3.060 -
454.calculix (max) (percentage) 6.250 -
456.hmmer (avg) (percentage) 0.300 -
456.hmmer (max) (percentage) 0.320 -
458.sjeng 38.000 -
458.sjeng (avg) 38.000 -
458.sjeng (avg) (percentage) 0.510 -1.92%
458.sjeng (max) 76.000 -3.80%
458.sjeng (max) (percentage) 1.020 -4.67%
458.sjeng (unexplained diff vs previous) 2.000 -77.78%
458.sjeng (unexplained diff vs previous) (percentage) 0.030 -75.00%
459.GemsFDTD 57.000 1.79%
459.GemsFDTD (avg) 57.000 1.79%
459.GemsFDTD (avg) (percentage) 1.170 -
459.GemsFDTD (max) 106.000 -3.64%
459.GemsFDTD (max) (percentage) 2.180 -5.22%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.090 3.47%
462.libquantum (max) 8.000 100.00%
462.libquantum (max) (percentage) 6.150 78.26%
462.libquantum (unexplained diff vs previous) 8.000 700.00%
462.libquantum (unexplained diff vs previous) (percentage) 5.800 653.25%
464.h264ref (avg) (percentage) 0.430 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 117.000 -
465.tonto (avg) 117.000 -
465.tonto (avg) (percentage) 1.080 -
465.tonto (max) 267.000 -4.98%
465.tonto (max) (percentage) 2.450 -5.41%
470.lbm 24.000 -
470.lbm (avg) 24.000 -
470.lbm (avg) (percentage) 0.650 -
470.lbm (max) 28.000 -6.67%
470.lbm (max) (percentage) 0.760 -6.17%
470.lbm (unexplained diff vs previous) 1.000 -66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.030 -62.50%
471.omnetpp 54.000 3.85%
471.omnetpp (avg) 54.000 3.85%
471.omnetpp (avg) (percentage) 1.990 -
471.omnetpp (max) 108.000 -3.57%
471.omnetpp (max) (percentage) 3.950 -6.40%
471.omnetpp (unexplained diff vs previous) 67.000 139.29%
471.omnetpp (unexplained diff vs previous) (percentage) 2.440 132.38%
473.astar 82.000 -1.20%
473.astar (avg) 82.000 -1.20%
473.astar (avg) (percentage) 1.590 -1.24%
473.astar (max) 185.000 -4.15%
473.astar (max) (percentage) 3.570 -4.55%
473.astar (unexplained diff vs previous) 14.000 250.00%
473.astar (unexplained diff vs previous) (percentage) 0.270 237.50%
481.wrf (avg) (percentage) 0.800 -
481.wrf (max) (percentage) 1.030 -
482.sphinx3 15.000 7.14%
482.sphinx3 (avg) 15.000 7.14%
482.sphinx3 (avg) (percentage) 1.740 2.35%
482.sphinx3 (max) 35.000 2.94%
482.sphinx3 (max) (percentage) 4.050 -
482.sphinx3 (unexplained diff vs previous) 34.000 1033.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.890 980.56%
483.xalancbmk (avg) (percentage) 2.380 -
483.xalancbmk (max) (percentage) 1.860 -
Geometric Mean 6.431 16.56%