Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d68afffbaa0a57c79006c7ac3a4bfb42f321e979 (+ 30 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (ea228f22be816023def6cdb48e9f10a60f370833) (+ 72 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=8e524ff79b894d6cf49d873546d8ff92b4c98622 (+ 48 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/bfa40f51f6440f26bf7686eca23a2c2e126e3084 (+ 116 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/350/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0350 (4-changed-components) 2025-01-02T01:01:49 0:00:00
Previous 0349 (3-changed-components) 2024-12-30T17:22:04 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 56 8
Performance Improvements 73 188
Unchanged Tests 1107 1040
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
447.dealII 1.54% 1624.000 1649.000 - -4.35% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 109.05% 2.210 4.620 - -99.95% -
453.povray (unexplained diff vs previous) (percentage) 107.69% 1.820 3.780 - -99.64% -
453.povray (unexplained diff vs previous) 100.00% 10.000 20.000 - -99.65% -
462.libquantum (unexplained diff vs previous) 100.00% 3.000 6.000 - -99.96% -
462.libquantum (max) (percentage) 95.13% 2.260 4.410 - -95.54% -
462.libquantum (max) 66.67% 3.000 5.000 - -96.38% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 49.51% 2.060 3.080 - -98.77% -
459.GemsFDTD (unexplained diff vs previous) 45.05% 111.000 161.000 - -98.96% -
459.GemsFDTD (max) (percentage) 42.38% 2.100 2.990 - -95.82% -
453.povray (max) (percentage) 41.63% 2.570 3.640 - -96.01% -
450.soplex (unexplained diff vs previous) (percentage) 38.70% 4.470 6.200 - -99.76% -
459.GemsFDTD (max) 38.05% 113.000 156.000 - -96.46% -
453.povray (max) 35.71% 14.000 19.000 - -96.19% -
450.soplex (unexplained diff vs previous) 30.77% 26.000 34.000 - -99.77% -
465.tonto (unexplained diff vs previous) (percentage) 26.72% 2.320 2.940 - -81.84% -
450.soplex (max) (percentage) 24.79% 4.680 5.840 - -93.93% -
465.tonto (unexplained diff vs previous) 23.35% 257.000 317.000 - -82.10% -
433.milc (unexplained diff vs previous) (percentage) 23.22% 2.670 3.290 - -99.66% -
465.tonto (max) (percentage) 20.68% 2.370 2.860 - -85.19% -
433.milc (unexplained diff vs previous) 19.35% 31.000 37.000 - -99.67% -
470.lbm (unexplained diff vs previous) (percentage) 18.70% 1.230 1.460 - -99.45% -
450.soplex (max) 18.52% 27.000 32.000 - -94.13% -
434.zeusmp (unexplained diff vs previous) (percentage) 18.46% 1.300 1.540 - -99.66% -
465.tonto (max) 17.56% 262.000 308.000 - -85.42% -
470.lbm (unexplained diff vs previous) 17.02% 47.000 55.000 - -99.45% -
434.zeusmp (unexplained diff vs previous) 16.67% 30.000 35.000 - -99.69% -
433.milc (max) (percentage) 16.42% 2.740 3.190 - -96.48% -
470.lbm (max) (percentage) 15.32% 1.240 1.430 - -98.03% -
434.zeusmp (max) (percentage) 15.15% 1.320 1.520 - -98.14% -
470.lbm (max) 14.89% 47.000 54.000 - -98.03% -
447.dealII (max) 13.64% 22.000 25.000 - -98.19% -
447.dealII (unexplained diff vs previous) 13.64% 22.000 25.000 - -99.64% -
434.zeusmp (max) 13.33% 30.000 34.000 - -98.35% -
433.milc (max) 12.90% 31.000 35.000 - -96.65% -
447.dealII (unexplained diff vs previous) (percentage) 12.59% 1.350 1.520 - -99.63% -
447.dealII (max) (percentage) 12.41% 1.370 1.540 - -98.08% -
458.sjeng (unexplained diff vs previous) 12.24% 49.000 55.000 - -99.20% -
458.sjeng (max) (percentage) 12.12% 0.660 0.740 - -98.45% -
458.sjeng (unexplained diff vs previous) (percentage) 12.12% 0.660 0.740 - -99.19% -
401.bzip2 (unexplained diff vs previous) (percentage) 10.73% 6.340 7.020 - -98.09% -
458.sjeng (max) 10.20% 49.000 54.000 - -98.50% -
429.mcf (unexplained diff vs previous) (percentage) 6.26% 9.590 10.190 - -99.22% -
401.bzip2 (avg) (percentage) 4.35% 1.380 1.440 - -73.72% -
401.bzip2 (unexplained diff vs previous) 3.55% 197.000 204.000 - -98.12% -
473.astar (avg) (percentage) 1.97% 1.520 1.550 - -62.74% -
450.soplex (avg) (percentage) 1.69% 2.360 2.400 - -62.67% -
433.milc (avg) (percentage) 1.67% 1.200 1.220 - -79.83% -
459.GemsFDTD (avg) (percentage) 1.61% 1.240 1.260 - -78.42% -
465.tonto (avg) (percentage) 1.61% 1.240 1.260 - -62.28% -
453.povray (avg) (percentage) 1.28% 1.560 1.580 - -79.77% -
410.bwaves (avg) (percentage) 1.22% 0.820 0.830 - -81.18% -
445.gobmk (avg) (percentage) 1.20% 0.830 0.840 - -78.52% -
482.sphinx3 (avg) (percentage) 1.20% 1.670 1.690 - -78.69% -
429.mcf (avg) (percentage) 1.10% 4.540 4.590 - -40.16% -
462.libquantum (avg) (percentage) 1.09% 1.840 1.860 - -75.72% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -9.25% 2033.000 1845.000 - 29.56% -
401.bzip2 -6.56% 3109.000 2905.000 - -1.22% -
450.soplex -5.84% 582.000 548.000 - -3.35% -
462.libquantum -4.41% 136.000 130.000 - -7.14% -
437.leslie3d -4.40% 11709.000 11194.000 - -3.83% -
473.astar -3.79% 5115.000 4921.000 - -4.04% -
453.povray -3.64% 549.000 529.000 - -3.29% -
482.sphinx3 -3.31% 845.000 817.000 - -13.54% -
433.milc -3.19% 1161.000 1124.000 - -2.35% -
459.GemsFDTD -2.99% 5385.000 5224.000 - -15.37% -
465.tonto -2.86% 11095.000 10778.000 - -1.49% -
471.omnetpp -2.67% 2732.000 2659.000 - -2.39% -
434.zeusmp -1.52% 2301.000 2266.000 - -9.86% -
470.lbm -1.43% 3835.000 3780.000 - -0.21% -
445.gobmk -1.31% 4894.000 4830.000 - -3.84% -
410.bwaves -1.23% 5930.000 5857.000 - 3.63% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
435.gromacs (unexplained diff vs previous) (percentage) -76.79% 1.680 0.390 - -99.60% -
435.gromacs (unexplained diff vs previous) -76.67% 120.000 28.000 - -99.60% -
482.sphinx3 (unexplained diff vs previous) -30.00% 40.000 28.000 - -99.89% -
471.omnetpp (unexplained diff vs previous) -27.72% 101.000 73.000 - -99.32% -
482.sphinx3 (unexplained diff vs previous) (percentage) -27.48% 4.730 3.430 - -99.88% -
471.omnetpp (max) -26.92% 104.000 76.000 - -96.50% -
471.omnetpp (unexplained diff vs previous) (percentage) -25.68% 3.700 2.750 - -99.30% -
471.omnetpp (max) (percentage) -25.00% 3.840 2.880 - -96.38% -
410.bwaves (unexplained diff vs previous) -23.96% 96.000 73.000 - -99.06% -
437.leslie3d (unexplained diff vs previous) -23.02% 669.000 515.000 - -77.74% -
410.bwaves (unexplained diff vs previous) (percentage) -22.84% 1.620 1.250 - -99.09% -
429.mcf (max) -20.93% 215.000 170.000 - -87.14% -
437.leslie3d (unexplained diff vs previous) (percentage) -19.44% 5.710 4.600 - -76.86% -
410.bwaves (max) -17.53% 97.000 80.000 - -97.56% -
410.bwaves (max) (percentage) -16.97% 1.650 1.370 - -97.64% -
437.leslie3d (max) -16.36% 709.000 593.000 - -69.26% -
445.gobmk (unexplained diff vs previous) -15.79% 76.000 64.000 - -98.85% -
482.sphinx3 (max) -14.63% 41.000 35.000 - -96.16% -
445.gobmk (max) -14.29% 77.000 66.000 - -97.50% -
445.gobmk (unexplained diff vs previous) (percentage) -14.19% 1.550 1.330 - -98.80% -
429.mcf (max) (percentage) -12.82% 10.610 9.250 - -90.04% -
445.gobmk (max) (percentage) -12.66% 1.580 1.380 - -97.38% -
437.leslie3d (max) (percentage) -12.54% 6.060 5.300 - -68.03% -
482.sphinx3 (max) (percentage) -12.47% 4.970 4.350 - -95.49% -
473.astar (max) -10.95% 210.000 187.000 - -94.51% -
401.bzip2 (max) -9.52% 210.000 190.000 - -91.79% -
435.gromacs (max) -9.02% 122.000 111.000 - -96.89% -
429.mcf -8.70% 92.000 84.000 - -22.94% -
429.mcf (avg) -8.70% 92.000 84.000 - -22.94% -
435.gromacs (max) (percentage) -8.19% 1.710 1.570 - -96.81% -
482.sphinx3 -7.14% 14.000 13.000 - -82.43% -
482.sphinx3 (avg) -7.14% 14.000 13.000 - -82.43% -
473.astar (max) (percentage) -7.06% 4.110 3.820 - -94.25% -
434.zeusmp -5.00% 20.000 19.000 - -87.07% -
434.zeusmp (avg) -5.00% 20.000 19.000 - -87.07% -
437.leslie3d -4.47% 514.000 491.000 - 38.31% -
437.leslie3d (avg) -4.47% 514.000 491.000 - 38.31% -
473.astar (unexplained diff vs previous) -3.96% 202.000 194.000 - -98.09% -
429.mcf (unexplained diff vs previous) -3.59% 195.000 188.000 - -98.99% -
470.lbm -3.33% 30.000 29.000 - -87.87% -
470.lbm (avg) -3.33% 30.000 29.000 - -87.87% -
401.bzip2 (max) (percentage) -3.10% 6.770 6.560 - -91.66% -
456.hmmer (max) (percentage) -2.70% 0.370 0.360 - -99.51% -
401.bzip2 -2.38% 42.000 41.000 - -74.53% -
401.bzip2 (avg) -2.38% 42.000 41.000 - -74.53% -
471.omnetpp -1.85% 54.000 53.000 - -76.23% -
471.omnetpp (avg) -1.85% 54.000 53.000 - -76.23% -
435.gromacs -1.64% 122.000 120.000 - -67.30% -
435.gromacs (avg) -1.64% 122.000 120.000 - -67.30% -
459.GemsFDTD -1.52% 66.000 65.000 - -81.94% -
459.GemsFDTD (avg) -1.52% 66.000 65.000 - -81.94% -
465.tonto -1.46% 137.000 135.000 - -63.01% -
465.tonto (avg) -1.46% 137.000 135.000 - -63.01% -
473.astar -1.30% 77.000 76.000 - -64.32% -
473.astar (avg) -1.30% 77.000 76.000 - -64.32% -
435.gromacs (avg) (percentage) -1.17% 1.710 1.690 - -66.60% -
444.namd (max) (percentage) -1.08% 0.930 0.920 - -99.00% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
465.tonto 1.35% 1946163.000 1972475.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 29.56% 1424.000 1845.000 - -9.25% -
410.bwaves 3.63% 5652.000 5857.000 - -1.23% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 43.93% 3.050 4.390 - 0.00% -
437.leslie3d 38.31% 355.000 491.000 - -4.47% -
437.leslie3d (avg) 38.31% 355.000 491.000 - -4.47% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.90% 59479.000 54186.000 - 0.00% -
459.GemsFDTD -5.47% 244728.000 231344.000 - 0.00% -
444.namd -3.27% 188385.000 182220.000 - 0.00% -
447.dealII -2.16% 311591.000 304870.000 - 0.00% -
435.gromacs -1.86% 499261.000 489954.000 - 0.00% -
410.bwaves -1.84% 16760.000 16452.000 - 0.00% -
453.povray -1.82% 661389.000 649324.000 - 0.00% -
462.libquantum -1.79% 16085.000 15797.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
433.milc -1.46% 61382.000 60488.000 - 0.00% -
458.sjeng -1.44% 104048.000 102551.000 - 0.00% -
450.soplex -1.33% 205081.000 202350.000 - 0.00% -
473.astar -1.18% 22968.000 22696.000 - 0.00% -
401.bzip2 -1.18% 44233.000 43711.000 - 0.00% -
482.sphinx3 -1.04% 112859.000 111690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -15.37% 6173.000 5224.000 - -2.99% -
482.sphinx3 -13.54% 945.000 817.000 - -3.31% -
434.zeusmp -9.86% 2514.000 2266.000 - -1.52% -
462.libquantum -7.14% 140.000 130.000 - -4.41% -
447.dealII -4.35% 1724.000 1649.000 - 1.54% -
473.astar -4.04% 5128.000 4921.000 - -3.79% -
445.gobmk -3.84% 5023.000 4830.000 - -1.31% -
437.leslie3d -3.83% 11640.000 11194.000 - -4.40% -
450.soplex -3.35% 567.000 548.000 - -5.84% -
453.povray -3.29% 547.000 529.000 - -3.64% -
471.omnetpp -2.39% 2724.000 2659.000 - -2.67% -
433.milc -2.35% 1151.000 1124.000 - -3.19% -
458.sjeng -2.18% 7567.000 7402.000 - -0.74% -
435.gromacs -1.95% 7269.000 7127.000 - -0.39% -
465.tonto -1.49% 10941.000 10778.000 - -2.86% -
401.bzip2 -1.22% 2941.000 2905.000 - -6.56% -
444.namd -1.20% 747.000 738.000 - -0.81% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 6.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.95% 9655.710 4.620 - 109.05% -
444.namd (unexplained diff vs previous) -99.93% 8356.000 6.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.93% 1118.610 0.810 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.89% 26073.000 28.000 - -30.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.88% 2759.050 3.430 - -27.48% -
450.soplex (unexplained diff vs previous) -99.77% 14500.000 34.000 - 30.77% -
450.soplex (unexplained diff vs previous) (percentage) -99.76% 2557.320 6.200 - 38.70% -
434.zeusmp (unexplained diff vs previous) -99.69% 11280.000 35.000 - 16.67% -
433.milc (unexplained diff vs previous) -99.67% 11289.000 37.000 - 19.35% -
433.milc (unexplained diff vs previous) (percentage) -99.66% 980.800 3.290 - 23.22% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.66% 448.690 1.540 - 18.46% -
453.povray (unexplained diff vs previous) -99.65% 5707.000 20.000 - 100.00% -
447.dealII (unexplained diff vs previous) -99.64% 7017.000 25.000 - 13.64% -
453.povray (unexplained diff vs previous) (percentage) -99.64% 1043.330 3.780 - 107.69% -
447.dealII (unexplained diff vs previous) (percentage) -99.63% 407.020 1.520 - 12.59% -
435.gromacs (unexplained diff vs previous) -99.60% 7028.000 28.000 - -76.67% -
435.gromacs (unexplained diff vs previous) (percentage) -99.60% 96.680 0.390 - -76.79% -
456.hmmer (max) (percentage) -99.51% 73.590 0.360 - -2.70% -
470.lbm (unexplained diff vs previous) -99.45% 9990.000 55.000 - 17.02% -
470.lbm (unexplained diff vs previous) (percentage) -99.45% 263.730 1.460 - 18.70% -
471.omnetpp (unexplained diff vs previous) -99.32% 10659.000 73.000 - -27.72% -
464.h264ref (max) (percentage) -99.30% 54.290 0.380 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.30% 391.300 2.750 - -25.68% -
429.mcf (unexplained diff vs previous) (percentage) -99.22% 1305.690 10.190 - 6.26% -
458.sjeng (unexplained diff vs previous) -99.20% 6876.000 55.000 - 12.24% -
458.sjeng (unexplained diff vs previous) (percentage) -99.19% 90.870 0.740 - 12.12% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
444.namd (max) -99.12% 685.000 6.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.09% 137.900 1.250 - -22.84% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.06% 7794.000 73.000 - -23.96% -
436.cactusADM (max) (percentage) -99.01% 88.730 0.880 - 0.00% -
444.namd (max) (percentage) -99.00% 91.790 0.920 - -1.08% -
429.mcf (unexplained diff vs previous) -98.99% 18593.000 188.000 - -3.59% -
459.GemsFDTD (unexplained diff vs previous) -98.96% 15458.000 161.000 - 45.05% -
445.gobmk (unexplained diff vs previous) -98.85% 5581.000 64.000 - -15.79% -
481.wrf (max) (percentage) -98.84% 68.700 0.800 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.80% 111.110 1.330 - -14.19% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.77% 250.410 3.080 - 49.51% -
458.sjeng (max) -98.50% 3602.000 54.000 - 10.20% -
458.sjeng (max) (percentage) -98.45% 47.610 0.740 - 12.12% -
434.zeusmp (max) -98.35% 2055.000 34.000 - 13.33% -
447.dealII (max) -98.19% 1384.000 25.000 - 13.64% -
434.zeusmp (max) (percentage) -98.14% 81.770 1.520 - 15.15% -
401.bzip2 (unexplained diff vs previous) -98.12% 10833.000 204.000 - 3.55% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.09% 368.340 7.020 - 10.73% -
473.astar (unexplained diff vs previous) -98.09% 10146.000 194.000 - -3.96% -
447.dealII (max) (percentage) -98.08% 80.280 1.540 - 12.41% -
470.lbm (max) -98.03% 2746.000 54.000 - 14.89% -
470.lbm (max) (percentage) -98.03% 72.510 1.430 - 15.32% -
473.astar (unexplained diff vs previous) (percentage) -98.01% 197.850 3.940 - -0.25% -
410.bwaves (max) (percentage) -97.64% 57.970 1.370 - -16.97% -
410.bwaves (max) -97.56% 3276.000 80.000 - -17.53% -
445.gobmk (max) -97.50% 2643.000 66.000 - -14.29% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
445.gobmk (max) (percentage) -97.38% 52.630 1.380 - -12.66% -
400.perlbench (max) (percentage) -97.34% 84.060 2.240 - -0.88% -
435.gromacs (max) -96.89% 3573.000 111.000 - -9.02% -
435.gromacs (max) (percentage) -96.81% 49.160 1.570 - -8.19% -
433.milc (max) -96.65% 1044.000 35.000 - 12.90% -
471.omnetpp (max) -96.50% 2169.000 76.000 - -26.92% -
433.milc (max) (percentage) -96.48% 90.750 3.190 - 16.42% -
459.GemsFDTD (max) -96.46% 4411.000 156.000 - 38.05% -
471.omnetpp (max) (percentage) -96.38% 79.650 2.880 - -25.00% -
462.libquantum (max) -96.38% 138.000 5.000 - 66.67% -
403.gcc (max) (percentage) -96.26% 99.360 3.720 - 0.00% -
453.povray (max) -96.19% 499.000 19.000 - 35.71% -
482.sphinx3 (max) -96.16% 911.000 35.000 - -14.63% -
453.povray (max) (percentage) -96.01% 91.250 3.640 - 41.63% -
459.GemsFDTD (max) (percentage) -95.82% 71.460 2.990 - 42.38% -
462.libquantum (max) (percentage) -95.54% 98.970 4.410 - 95.13% -
482.sphinx3 (max) (percentage) -95.49% 96.500 4.350 - -12.47% -
473.astar (max) -94.51% 3406.000 187.000 - -10.95% -
473.astar (max) (percentage) -94.25% 66.430 3.820 - -7.06% -
450.soplex (max) -94.13% 545.000 32.000 - 18.52% -
450.soplex (max) (percentage) -93.93% 96.240 5.840 - 24.79% -
401.bzip2 (max) -91.79% 2313.000 190.000 - -9.52% -
401.bzip2 (max) (percentage) -91.66% 78.650 6.560 - -3.10% -
429.mcf (max) (percentage) -90.04% 92.890 9.250 - -12.82% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
470.lbm -87.87% 239.000 29.000 - -3.33% -
470.lbm (avg) -87.87% 239.000 29.000 - -3.33% -
444.namd (avg) (percentage) -87.74% 9.220 1.130 - -0.88% -
470.lbm (avg) (percentage) -87.52% 6.330 0.790 - 0.00% -
429.mcf (max) -87.14% 1322.000 170.000 - -20.93% -
434.zeusmp -87.07% 147.000 19.000 - -5.00% -
434.zeusmp (avg) -87.07% 147.000 19.000 - -5.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
465.tonto (max) -85.42% 2112.000 308.000 - 17.56% -
465.tonto (max) (percentage) -85.19% 19.310 2.860 - 20.68% -
434.zeusmp (avg) (percentage) -84.96% 5.850 0.880 - 0.00% -
458.sjeng -82.99% 241.000 41.000 - 0.00% -
458.sjeng (avg) -82.99% 241.000 41.000 - 0.00% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
458.sjeng (avg) (percentage) -82.45% 3.190 0.560 - 0.00% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
482.sphinx3 -82.43% 74.000 13.000 - -7.14% -
482.sphinx3 (avg) -82.43% 74.000 13.000 - -7.14% -
465.tonto (unexplained diff vs previous) -82.10% 1771.000 317.000 - 23.35% -
459.GemsFDTD -81.94% 360.000 65.000 - -1.52% -
459.GemsFDTD (avg) -81.94% 360.000 65.000 - -1.52% -
465.tonto (unexplained diff vs previous) (percentage) -81.84% 16.190 2.940 - 26.72% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 1.22% -
433.milc -81.16% 69.000 13.000 - 0.00% -
433.milc (avg) -81.16% 69.000 13.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
410.bwaves -80.72% 249.000 48.000 - 0.00% -
410.bwaves (avg) -80.72% 249.000 48.000 - 0.00% -
447.dealII (avg) (percentage) -80.42% 5.770 1.130 - 0.89% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
433.milc (avg) (percentage) -79.83% 6.050 1.220 - 1.67% -
453.povray (avg) (percentage) -79.77% 7.810 1.580 - 1.28% -
445.gobmk -79.59% 196.000 40.000 - 0.00% -
445.gobmk (avg) -79.59% 196.000 40.000 - 0.00% -
482.sphinx3 (avg) (percentage) -78.69% 7.930 1.690 - 1.20% -
445.gobmk (avg) (percentage) -78.52% 3.910 0.840 - 1.20% -
459.GemsFDTD (avg) (percentage) -78.42% 5.840 1.260 - 1.61% -
437.leslie3d (unexplained diff vs previous) -77.74% 2314.000 515.000 - -23.02% -
437.leslie3d (unexplained diff vs previous) (percentage) -76.86% 19.880 4.600 - -19.44% -
471.omnetpp -76.23% 223.000 53.000 - -1.85% -
471.omnetpp (avg) -76.23% 223.000 53.000 - -1.85% -
462.libquantum (avg) (percentage) -75.72% 7.660 1.860 - 1.09% -
471.omnetpp (avg) (percentage) -75.37% 8.200 2.020 - 0.50% -
401.bzip2 -74.53% 161.000 41.000 - -2.38% -
401.bzip2 (avg) -74.53% 161.000 41.000 - -2.38% -
401.bzip2 (avg) (percentage) -73.72% 5.480 1.440 - 4.35% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
437.leslie3d (max) -69.26% 1929.000 593.000 - -16.36% -
437.leslie3d (max) (percentage) -68.03% 16.580 5.300 - -12.54% -
435.gromacs -67.30% 367.000 120.000 - -1.64% -
435.gromacs (avg) -67.30% 367.000 120.000 - -1.64% -
435.gromacs (avg) (percentage) -66.60% 5.060 1.690 - -1.17% -
473.astar -64.32% 213.000 76.000 - -1.30% -
473.astar (avg) -64.32% 213.000 76.000 - -1.30% -
450.soplex -63.89% 36.000 13.000 - 0.00% -
450.soplex (avg) -63.89% 36.000 13.000 - 0.00% -
465.tonto -63.01% 365.000 135.000 - -1.46% -
465.tonto (avg) -63.01% 365.000 135.000 - -1.46% -
473.astar (avg) (percentage) -62.74% 4.160 1.550 - 1.97% -
450.soplex (avg) (percentage) -62.67% 6.430 2.400 - 1.69% -
465.tonto (avg) (percentage) -62.28% 3.340 1.260 - 1.61% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -40.16% 7.670 4.590 - 1.10% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -22.94% 109.000 84.000 - -8.70% -
429.mcf (avg) -22.94% 109.000 84.000 - -8.70% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 31.03% 29.000 38.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2905.000 -6.56%
410.bwaves 5857.000 -1.23%
429.mcf 1845.000 -9.25%
433.milc 1124.000 -3.19%
434.zeusmp 2266.000 -1.52%
435.gromacs 7127.000 -
437.leslie3d 11194.000 -4.40%
444.namd 738.000 -
445.gobmk 4830.000 -1.31%
447.dealII 1649.000 1.54%
450.soplex 548.000 -5.84%
453.povray 529.000 -3.64%
458.sjeng 7402.000 -
459.GemsFDTD 5224.000 -2.99%
462.libquantum 130.000 -4.41%
465.tonto 10778.000 -2.86%
470.lbm 3780.000 -1.43%
471.omnetpp 2659.000 -2.67%
473.astar 4921.000 -3.79%
482.sphinx3 817.000 -3.31%
Geometric Mean 2337.899 -2.97%
Code Size (bytes)
Name Current %
401.bzip2 43711.000 -
410.bwaves 16452.000 -
429.mcf 9086.000 -
433.milc 60488.000 -
434.zeusmp 151959.000 -
435.gromacs 489954.000 -
437.leslie3d 54186.000 -
444.namd 182220.000 -
445.gobmk 1375074.000 -
447.dealII 304870.000 -
450.soplex 202350.000 -
453.povray 649324.000 -
458.sjeng 102551.000 -
459.GemsFDTD 231344.000 -
462.libquantum 15797.000 -
465.tonto 1972475.000 -
470.lbm 9547.000 -
471.omnetpp 475181.000 -
473.astar 22696.000 -
482.sphinx3 111690.000 -
Geometric Mean 113942.247 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.240 -
401.bzip2 41.000 -2.38%
401.bzip2 (avg) 41.000 -2.38%
401.bzip2 (avg) (percentage) 1.440 4.35%
401.bzip2 (max) 190.000 -9.52%
401.bzip2 (max) (percentage) 6.560 -3.10%
401.bzip2 (unexplained diff vs previous) 204.000 3.55%
401.bzip2 (unexplained diff vs previous) (percentage) 7.020 10.73%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.720 -
410.bwaves 48.000 -
410.bwaves (avg) 48.000 -
410.bwaves (avg) (percentage) 0.830 1.22%
410.bwaves (max) 80.000 -17.53%
410.bwaves (max) (percentage) 1.370 -16.97%
410.bwaves (unexplained diff vs previous) 73.000 -23.96%
410.bwaves (unexplained diff vs previous) (percentage) 1.250 -22.84%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 84.000 -8.70%
429.mcf (avg) 84.000 -8.70%
429.mcf (avg) (percentage) 4.590 1.10%
429.mcf (max) 170.000 -20.93%
429.mcf (max) (percentage) 9.250 -12.82%
429.mcf (unexplained diff vs previous) 188.000 -3.59%
429.mcf (unexplained diff vs previous) (percentage) 10.190 6.26%
433.milc 13.000 -
433.milc (avg) 13.000 -
433.milc (avg) (percentage) 1.220 1.67%
433.milc (max) 35.000 12.90%
433.milc (max) (percentage) 3.190 16.42%
433.milc (unexplained diff vs previous) 37.000 19.35%
433.milc (unexplained diff vs previous) (percentage) 3.290 23.22%
434.zeusmp 19.000 -5.00%
434.zeusmp (avg) 19.000 -5.00%
434.zeusmp (avg) (percentage) 0.880 -
434.zeusmp (max) 34.000 13.33%
434.zeusmp (max) (percentage) 1.520 15.15%
434.zeusmp (unexplained diff vs previous) 35.000 16.67%
434.zeusmp (unexplained diff vs previous) (percentage) 1.540 18.46%
435.gromacs 120.000 -1.64%
435.gromacs (avg) 120.000 -1.64%
435.gromacs (avg) (percentage) 1.690 -1.17%
435.gromacs (max) 111.000 -9.02%
435.gromacs (max) (percentage) 1.570 -8.19%
435.gromacs (unexplained diff vs previous) 28.000 -76.67%
435.gromacs (unexplained diff vs previous) (percentage) 0.390 -76.79%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.880 -
437.leslie3d 491.000 -4.47%
437.leslie3d (avg) 491.000 -4.47%
437.leslie3d (avg) (percentage) 4.390 -
437.leslie3d (max) 593.000 -16.36%
437.leslie3d (max) (percentage) 5.300 -12.54%
437.leslie3d (unexplained diff vs previous) 515.000 -23.02%
437.leslie3d (unexplained diff vs previous) (percentage) 4.600 -19.44%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.130 -
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.920 -1.08%
444.namd (unexplained diff vs previous) 6.000 -
444.namd (unexplained diff vs previous) (percentage) 0.810 -
445.gobmk 40.000 -
445.gobmk (avg) 40.000 -
445.gobmk (avg) (percentage) 0.840 1.20%
445.gobmk (max) 66.000 -14.29%
445.gobmk (max) (percentage) 1.380 -12.66%
445.gobmk (unexplained diff vs previous) 64.000 -15.79%
445.gobmk (unexplained diff vs previous) (percentage) 1.330 -14.19%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.130 -
447.dealII (max) 25.000 13.64%
447.dealII (max) (percentage) 1.540 12.41%
447.dealII (unexplained diff vs previous) 25.000 13.64%
447.dealII (unexplained diff vs previous) (percentage) 1.520 12.59%
450.soplex 13.000 -
450.soplex (avg) 13.000 -
450.soplex (avg) (percentage) 2.400 1.69%
450.soplex (max) 32.000 18.52%
450.soplex (max) (percentage) 5.840 24.79%
450.soplex (unexplained diff vs previous) 34.000 30.77%
450.soplex (unexplained diff vs previous) (percentage) 6.200 38.70%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.580 1.28%
453.povray (max) 19.000 35.71%
453.povray (max) (percentage) 3.640 41.63%
453.povray (unexplained diff vs previous) 20.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 3.780 107.69%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.360 -2.70%
458.sjeng 41.000 -
458.sjeng (avg) 41.000 -
458.sjeng (avg) (percentage) 0.560 -
458.sjeng (max) 54.000 10.20%
458.sjeng (max) (percentage) 0.740 12.12%
458.sjeng (unexplained diff vs previous) 55.000 12.24%
458.sjeng (unexplained diff vs previous) (percentage) 0.740 12.12%
459.GemsFDTD 65.000 -1.52%
459.GemsFDTD (avg) 65.000 -1.52%
459.GemsFDTD (avg) (percentage) 1.260 1.61%
459.GemsFDTD (max) 156.000 38.05%
459.GemsFDTD (max) (percentage) 2.990 42.38%
459.GemsFDTD (unexplained diff vs previous) 161.000 45.05%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.080 49.51%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.860 1.09%
462.libquantum (max) 5.000 66.67%
462.libquantum (max) (percentage) 4.410 95.13%
462.libquantum (unexplained diff vs previous) 6.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.620 109.05%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.380 -
465.tonto 135.000 -1.46%
465.tonto (avg) 135.000 -1.46%
465.tonto (avg) (percentage) 1.260 1.61%
465.tonto (max) 308.000 17.56%
465.tonto (max) (percentage) 2.860 20.68%
465.tonto (unexplained diff vs previous) 317.000 23.35%
465.tonto (unexplained diff vs previous) (percentage) 2.940 26.72%
470.lbm 29.000 -3.33%
470.lbm (avg) 29.000 -3.33%
470.lbm (avg) (percentage) 0.790 -
470.lbm (max) 54.000 14.89%
470.lbm (max) (percentage) 1.430 15.32%
470.lbm (unexplained diff vs previous) 55.000 17.02%
470.lbm (unexplained diff vs previous) (percentage) 1.460 18.70%
471.omnetpp 53.000 -1.85%
471.omnetpp (avg) 53.000 -1.85%
471.omnetpp (avg) (percentage) 2.020 -
471.omnetpp (max) 76.000 -26.92%
471.omnetpp (max) (percentage) 2.880 -25.00%
471.omnetpp (unexplained diff vs previous) 73.000 -27.72%
471.omnetpp (unexplained diff vs previous) (percentage) 2.750 -25.68%
473.astar 76.000 -1.30%
473.astar (avg) 76.000 -1.30%
473.astar (avg) (percentage) 1.550 1.97%
473.astar (max) 187.000 -10.95%
473.astar (max) (percentage) 3.820 -7.06%
473.astar (unexplained diff vs previous) 194.000 -3.96%
473.astar (unexplained diff vs previous) (percentage) 3.940 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.800 -
482.sphinx3 13.000 -7.14%
482.sphinx3 (avg) 13.000 -7.14%
482.sphinx3 (avg) (percentage) 1.690 1.20%
482.sphinx3 (max) 35.000 -14.63%
482.sphinx3 (max) (percentage) 4.350 -12.47%
482.sphinx3 (unexplained diff vs previous) 28.000 -30.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.430 -27.48%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 9.126 1.20%