Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4fa9476ad23d5868c2bc4c02dc1a73acaefbcbc2 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (50cd99795268aaaf10705fa876dd4b751453e2f6) (+ 46 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=aaf94ec804830e0e273cfb45d54f4a04ab778fe5 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/dfc5f6de47b62aa45150d0b9ef1ffda99bb5112a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/390/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0390 (basepoints/gcc-15-07851-g50cd9979526) 2025-03-26T20:03:51 0:00:00
Previous 0388 (3-changed-components) 2025-03-18T07:42:11 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 52 13
Performance Improvements 50 177
Unchanged Tests 1134 1046
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 5.34% 843.000 888.000 - -6.03% -
450.soplex 3.85% 571.000 593.000 - 4.59% -
429.mcf 2.45% 2040.000 2090.000 - 46.77% -
444.namd 2.32% 734.000 751.000 - 0.54% -
453.povray 1.67% 540.000 549.000 - 0.37% -
433.milc 1.55% 1161.000 1179.000 - 2.43% -
447.dealII 1.11% 1621.000 1639.000 - -4.93% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) (percentage) 2075.00% 0.040 0.870 - -99.22% -
445.gobmk (unexplained diff vs previous) 2050.00% 2.000 43.000 - -99.23% -
482.sphinx3 (unexplained diff vs previous) 650.00% 6.000 45.000 - -99.83% -
482.sphinx3 (unexplained diff vs previous) (percentage) 614.08% 0.710 5.070 - -99.82% -
444.namd (unexplained diff vs previous) 466.67% 3.000 17.000 - -99.80% -
444.namd (unexplained diff vs previous) (percentage) 451.22% 0.410 2.260 - -99.80% -
473.astar (unexplained diff vs previous) 416.67% 6.000 31.000 - -99.69% -
473.astar (unexplained diff vs previous) (percentage) 400.00% 0.120 0.600 - -99.70% -
453.povray (unexplained diff vs previous) 350.00% 2.000 9.000 - -99.84% -
453.povray (unexplained diff vs previous) (percentage) 343.24% 0.370 1.640 - -99.84% -
458.sjeng (unexplained diff vs previous) (percentage) 333.33% 0.090 0.390 - -99.57% -
401.bzip2 (unexplained diff vs previous) 316.67% 6.000 25.000 - -99.77% -
458.sjeng (unexplained diff vs previous) 314.29% 7.000 29.000 - -99.58% -
401.bzip2 (unexplained diff vs previous) (percentage) 305.00% 0.200 0.810 - -99.78% -
433.milc (unexplained diff vs previous) 200.00% 6.000 18.000 - -99.84% -
465.tonto (unexplained diff vs previous) (percentage) 200.00% 0.060 0.180 - -98.89% -
433.milc (unexplained diff vs previous) (percentage) 194.23% 0.520 1.530 - -99.84% -
465.tonto (unexplained diff vs previous) 185.71% 7.000 20.000 - -98.87% -
482.sphinx3 (max) 147.37% 19.000 47.000 - -94.84% -
444.namd (max) 142.86% 7.000 17.000 - -97.52% -
444.namd (max) (percentage) 139.18% 0.970 2.320 - -97.47% -
482.sphinx3 (max) (percentage) 126.27% 2.360 5.340 - -94.47% -
429.mcf (unexplained diff vs previous) 117.39% 23.000 50.000 - -99.73% -
429.mcf (max) 112.50% 24.000 51.000 - -96.14% -
429.mcf (unexplained diff vs previous) (percentage) 111.50% 1.130 2.390 - -99.82% -
429.mcf (max) (percentage) 107.63% 1.180 2.450 - -97.36% -
470.lbm (unexplained diff vs previous) 100.00% 15.000 30.000 - -99.70% -
470.lbm (unexplained diff vs previous) (percentage) 100.00% 0.390 0.780 - -99.70% -
447.dealII (unexplained diff vs previous) 80.00% 10.000 18.000 - -99.74% -
447.dealII (unexplained diff vs previous) (percentage) 77.42% 0.620 1.100 - -99.73% -
435.gromacs (unexplained diff vs previous) (percentage) 59.52% 0.840 1.340 - -98.61% -
435.gromacs (unexplained diff vs previous) 58.33% 60.000 95.000 - -98.65% -
447.dealII (max) 38.46% 13.000 18.000 - -98.70% -
447.dealII (max) (percentage) 33.73% 0.830 1.110 - -98.62% -
445.gobmk (max) 30.30% 33.000 43.000 - -98.37% -
445.gobmk (max) (percentage) 29.41% 0.680 0.880 - -98.33% -
450.soplex (unexplained diff vs previous) 22.22% 18.000 22.000 0.000 -99.85% 0.000
450.soplex (unexplained diff vs previous) (percentage) 17.78% 3.150 3.710 0.000 -99.85% 0.000
450.soplex 7.14% 14.000 15.000 - -58.33% -
450.soplex (avg) 7.14% 14.000 15.000 - -58.33% -
482.sphinx3 6.67% 15.000 16.000 - -78.38% -
482.sphinx3 (avg) 6.67% 15.000 16.000 - -78.38% -
482.sphinx3 (avg) (percentage) 2.22% 1.800 1.840 - -76.80% -
429.mcf 2.20% 91.000 93.000 - -14.68% -
429.mcf (avg) 2.20% 91.000 93.000 - -14.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
435.gromacs -1.33% 7159.000 7064.000 - -2.82% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) -99.31% 435.000 3.000 - -99.87% -
437.leslie3d (unexplained diff vs previous) (percentage) -99.25% 3.980 0.030 - -99.85% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -92.59% 0.270 0.020 - -99.99% -
459.GemsFDTD (unexplained diff vs previous) -92.31% 13.000 1.000 - -99.99% -
462.libquantum (unexplained diff vs previous) (percentage) -66.81% 2.260 0.750 - -99.99% -
462.libquantum (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.99% -
434.zeusmp (max) -63.16% 19.000 7.000 - -99.66% -
434.zeusmp (max) (percentage) -59.52% 0.840 0.340 - -99.58% -
471.omnetpp (max) -58.93% 56.000 23.000 - -98.94% -
471.omnetpp (max) (percentage) -58.65% 2.080 0.860 - -98.92% -
410.bwaves (unexplained diff vs previous) -56.86% 51.000 22.000 - -99.72% -
410.bwaves (unexplained diff vs previous) (percentage) -56.82% 0.880 0.380 - -99.72% -
471.omnetpp (unexplained diff vs previous) -30.00% 10.000 7.000 - -99.93% -
471.omnetpp (unexplained diff vs previous) (percentage) -29.73% 0.370 0.260 - -99.93% -
437.leslie3d (max) -25.12% 418.000 313.000 - -83.77% -
437.leslie3d (max) (percentage) -25.07% 3.830 2.870 - -82.69% -
434.zeusmp (unexplained diff vs previous) (percentage) -20.93% 0.430 0.340 - -99.92% -
434.zeusmp (unexplained diff vs previous) -20.00% 10.000 8.000 - -99.93% -
410.bwaves (max) -13.73% 51.000 44.000 - -98.66% -
410.bwaves (max) (percentage) -12.36% 0.890 0.780 - -98.65% -
459.GemsFDTD (max) -10.00% 20.000 18.000 - -99.59% -
462.libquantum (max) (percentage) -9.95% 2.210 1.990 - -97.99% -
459.GemsFDTD (max) (percentage) -9.30% 0.430 0.390 - -99.45% -
453.povray (max) -8.33% 12.000 11.000 - -97.80% -
435.gromacs (max) -7.77% 103.000 95.000 - -97.34% -
435.gromacs (max) (percentage) -6.90% 1.450 1.350 - -97.25% -
458.sjeng (max) (percentage) -5.88% 0.850 0.800 - -98.32% -
453.povray (max) (percentage) -5.33% 2.250 2.130 - -97.67% -
458.sjeng (max) -4.76% 63.000 60.000 - -98.33% -
465.tonto (max) (percentage) -4.00% 0.250 0.240 - -98.76% -
473.astar (max) (percentage) -3.96% 3.790 3.640 - -94.52% -
401.bzip2 (max) (percentage) -3.88% 4.380 4.210 - -94.65% -
450.soplex (max) (percentage) -3.80% 4.210 4.050 - -95.79% -
465.tonto (max) -3.70% 27.000 26.000 - -98.77% -
473.astar (max) -3.08% 195.000 189.000 - -94.45% -
401.bzip2 (max) -3.01% 133.000 129.000 - -94.42% -
456.hmmer (max) (percentage) -2.94% 0.340 0.330 - -99.55% -
433.milc (max) (percentage) -2.66% 4.130 4.020 - -95.57% -
471.omnetpp -1.79% 56.000 55.000 - -75.34% -
471.omnetpp (avg) -1.79% 56.000 55.000 - -75.34% -
435.gromacs -1.74% 115.000 113.000 - -69.21% -
435.gromacs (avg) -1.74% 115.000 113.000 - -69.21% -
465.tonto (avg) (percentage) -1.65% 1.210 1.190 - -64.37% -
459.GemsFDTD -1.61% 62.000 61.000 - -83.06% -
459.GemsFDTD (avg) -1.61% 62.000 61.000 - -83.06% -
465.tonto -1.53% 131.000 129.000 - -64.66% -
465.tonto (avg) -1.53% 131.000 129.000 - -64.66% -
436.cactusADM (max) (percentage) -1.16% 0.860 0.850 - -99.04% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 2.63% 38.000 39.000 - 34.48% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 6.40% 16760.000 17832.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 46.77% 1424.000 2090.000 - 2.45% -
450.soplex 4.59% 567.000 593.000 - 3.85% -
401.bzip2 4.32% 2941.000 3068.000 - 0.82% -
433.milc 2.43% 1151.000 1179.000 - 1.55% -
410.bwaves 1.72% 5652.000 5749.000 - -0.38% -
473.astar 1.29% 5128.000 5194.000 - 0.60% -
470.lbm 1.11% 3788.000 3830.000 - 0.79% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 35.41% 3.050 4.130 - -0.96% -
437.leslie3d 27.04% 355.000 451.000 - -0.88% -
437.leslie3d (avg) 27.04% 355.000 451.000 - -0.88% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -31.03% 29.000 20.000 - 0.00% -
nb_execution_successful -31.03% 29.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -8.69% 59479.000 54310.000 - 0.00% -
459.GemsFDTD -4.85% 244728.000 232852.000 - 0.00% -
447.dealII -2.16% 311591.000 304874.000 - 0.00% -
462.libquantum -1.89% 16085.000 15781.000 - 0.00% -
434.zeusmp -1.82% 152037.000 149263.000 - 0.00% -
435.gromacs -1.76% 499261.000 490450.000 - 0.00% -
433.milc -1.53% 61382.000 60440.000 - 0.00% -
470.lbm -1.49% 9691.000 9547.000 - 0.00% -
453.povray -1.26% 661389.000 653088.000 - 0.00% -
444.namd -1.24% 188385.000 186052.000 - 0.00% -
401.bzip2 -1.13% 44233.000 43735.000 - 0.00% -
473.astar -1.04% 22968.000 22728.000 - 0.00% -
482.sphinx3 -1.03% 112859.000 111702.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -21.84% 6173.000 4825.000 - -0.02% -
434.zeusmp -6.64% 2514.000 2347.000 - 0.34% -
437.leslie3d -6.18% 11640.000 10921.000 - 0.03% -
482.sphinx3 -6.03% 945.000 888.000 - 5.34% -
447.dealII -4.93% 1724.000 1639.000 - 1.11% -
462.libquantum -4.29% 140.000 134.000 - 0.75% -
435.gromacs -2.82% 7269.000 7064.000 - -1.33% -
445.gobmk -1.73% 5023.000 4936.000 - 0.88% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD (unexplained diff vs previous) -99.99% 15458.000 1.000 - -92.31% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -66.67% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.750 - -66.81% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.99% 250.410 0.020 - -92.59% -
471.omnetpp (unexplained diff vs previous) -99.93% 10659.000 7.000 - -30.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.93% 391.300 0.260 - -29.73% -
434.zeusmp (unexplained diff vs previous) -99.93% 11280.000 8.000 - -20.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.92% 448.690 0.340 - -20.93% -
437.leslie3d (unexplained diff vs previous) -99.87% 2314.000 3.000 - -99.31% -
450.soplex (unexplained diff vs previous) (percentage) -99.85% 2557.320 3.710 0.000 17.78% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) -99.85% 19.880 0.030 - -99.25% -
450.soplex (unexplained diff vs previous) -99.85% 14500.000 22.000 0.000 22.22% 0.000
433.milc (unexplained diff vs previous) (percentage) -99.84% 980.800 1.530 - 194.23% -
453.povray (unexplained diff vs previous) (percentage) -99.84% 1043.330 1.640 - 343.24% -
453.povray (unexplained diff vs previous) -99.84% 5707.000 9.000 - 350.00% -
433.milc (unexplained diff vs previous) -99.84% 11289.000 18.000 - 200.00% -
482.sphinx3 (unexplained diff vs previous) -99.83% 26073.000 45.000 - 650.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.82% 1305.690 2.390 - 111.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.82% 2759.050 5.070 - 614.08% -
444.namd (unexplained diff vs previous) (percentage) -99.80% 1118.610 2.260 - 451.22% -
444.namd (unexplained diff vs previous) -99.80% 8356.000 17.000 - 466.67% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.78% 368.340 0.810 - 305.00% -
401.bzip2 (unexplained diff vs previous) -99.77% 10833.000 25.000 - 316.67% -
447.dealII (unexplained diff vs previous) -99.74% 7017.000 18.000 - 80.00% -
429.mcf (unexplained diff vs previous) -99.73% 18593.000 50.000 - 117.39% -
447.dealII (unexplained diff vs previous) (percentage) -99.73% 407.020 1.100 - 77.42% -
410.bwaves (unexplained diff vs previous) (percentage) -99.72% 137.900 0.380 - -56.82% -
410.bwaves (unexplained diff vs previous) -99.72% 7794.000 22.000 - -56.86% -
470.lbm (unexplained diff vs previous) (percentage) -99.70% 263.730 0.780 - 100.00% -
470.lbm (unexplained diff vs previous) -99.70% 9990.000 30.000 - 100.00% -
473.astar (unexplained diff vs previous) (percentage) -99.70% 197.850 0.600 - 400.00% -
473.astar (unexplained diff vs previous) -99.69% 10146.000 31.000 - 416.67% -
434.zeusmp (max) -99.66% 2055.000 7.000 - -63.16% -
459.GemsFDTD (max) -99.59% 4411.000 18.000 - -10.00% -
434.zeusmp (max) (percentage) -99.58% 81.770 0.340 - -59.52% -
458.sjeng (unexplained diff vs previous) -99.58% 6876.000 29.000 - 314.29% -
458.sjeng (unexplained diff vs previous) (percentage) -99.57% 90.870 0.390 - 333.33% -
456.hmmer (max) (percentage) -99.55% 73.590 0.330 - -2.94% -
459.GemsFDTD (max) (percentage) -99.45% 71.460 0.390 - -9.30% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.23% 5581.000 43.000 - 2050.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.22% 111.110 0.870 - 2075.00% -
454.calculix (max) (percentage) -99.18% 99.730 0.820 - 0.00% -
416.gamess (max) (percentage) -99.07% 38.550 0.360 - 0.00% -
436.cactusADM (max) (percentage) -99.04% 88.730 0.850 - -1.16% -
471.omnetpp (max) -98.94% 2169.000 23.000 - -58.93% -
471.omnetpp (max) (percentage) -98.92% 79.650 0.860 - -58.65% -
465.tonto (unexplained diff vs previous) (percentage) -98.89% 16.190 0.180 - 200.00% -
465.tonto (unexplained diff vs previous) -98.87% 1771.000 20.000 - 185.71% -
481.wrf (max) (percentage) -98.86% 68.700 0.780 - 0.00% -
465.tonto (max) -98.77% 2112.000 26.000 - -3.70% -
465.tonto (max) (percentage) -98.76% 19.310 0.240 - -4.00% -
447.dealII (max) -98.70% 1384.000 18.000 - 38.46% -
410.bwaves (max) -98.66% 3276.000 44.000 - -13.73% -
410.bwaves (max) (percentage) -98.65% 57.970 0.780 - -12.36% -
435.gromacs (unexplained diff vs previous) -98.65% 7028.000 95.000 - 58.33% -
447.dealII (max) (percentage) -98.62% 80.280 1.110 - 33.73% -
435.gromacs (unexplained diff vs previous) (percentage) -98.61% 96.680 1.340 - 59.52% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
470.lbm (max) (percentage) -98.51% 72.510 1.080 - 0.00% -
470.lbm (max) -98.51% 2746.000 41.000 - 0.00% -
445.gobmk (max) -98.37% 2643.000 43.000 - 30.30% -
458.sjeng (max) -98.33% 3602.000 60.000 - -4.76% -
445.gobmk (max) (percentage) -98.33% 52.630 0.880 - 29.41% -
458.sjeng (max) (percentage) -98.32% 47.610 0.800 - -5.88% -
462.libquantum (max) (percentage) -97.99% 98.970 1.990 - -9.95% -
453.povray (max) -97.80% 499.000 11.000 - -8.33% -
453.povray (max) (percentage) -97.67% 91.250 2.130 - -5.33% -
400.perlbench (max) (percentage) -97.54% 84.060 2.070 - 0.00% -
444.namd (max) -97.52% 685.000 17.000 - 142.86% -
444.namd (max) (percentage) -97.47% 91.790 2.320 - 139.18% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
429.mcf (max) (percentage) -97.36% 92.890 2.450 - 107.63% -
435.gromacs (max) -97.34% 3573.000 95.000 - -7.77% -
435.gromacs (max) (percentage) -97.25% 49.160 1.350 - -6.90% -
403.gcc (max) (percentage) -96.29% 99.360 3.690 - 0.00% -
429.mcf (max) -96.14% 1322.000 51.000 - 112.50% -
450.soplex (max) (percentage) -95.79% 96.240 4.050 - -3.80% -
450.soplex (max) -95.60% 545.000 24.000 - 0.00% -
433.milc (max) (percentage) -95.57% 90.750 4.020 - -2.66% -
433.milc (max) -95.50% 1044.000 47.000 - 0.00% -
482.sphinx3 (max) -94.84% 911.000 47.000 - 147.37% -
401.bzip2 (max) (percentage) -94.65% 78.650 4.210 - -3.88% -
473.astar (max) (percentage) -94.52% 66.430 3.640 - -3.96% -
482.sphinx3 (max) (percentage) -94.47% 96.500 5.340 - 126.27% -
473.astar (max) -94.45% 3406.000 189.000 - -3.08% -
401.bzip2 (max) -94.42% 2313.000 129.000 - -3.01% -
444.namd -88.24% 68.000 8.000 - 0.00% -
444.namd (avg) -88.24% 68.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) -88.21% 4.410 0.520 - 0.00% -
444.namd (avg) (percentage) -87.42% 9.220 1.160 - 0.87% -
470.lbm (avg) (percentage) -87.05% 6.330 0.820 - 0.00% -
470.lbm -87.03% 239.000 31.000 - 0.00% -
470.lbm (avg) -87.03% 239.000 31.000 - 0.00% -
434.zeusmp -86.39% 147.000 20.000 - 0.00% -
434.zeusmp (avg) -86.39% 147.000 20.000 - 0.00% -
464.h264ref (avg) (percentage) -86.05% 5.090 0.710 - 0.00% -
434.zeusmp (avg) (percentage) -85.30% 5.850 0.860 - 0.00% -
437.leslie3d (max) -83.77% 1929.000 313.000 - -25.12% -
459.GemsFDTD -83.06% 360.000 61.000 - -1.61% -
459.GemsFDTD (avg) -83.06% 360.000 61.000 - -1.61% -
416.gamess (avg) (percentage) -82.81% 4.420 0.760 - 0.00% -
437.leslie3d (max) (percentage) -82.69% 16.580 2.870 - -25.07% -
436.cactusADM (avg) (percentage) -82.44% 5.980 1.050 - 0.00% -
447.dealII -81.82% 99.000 18.000 - 0.00% -
447.dealII (avg) -81.82% 99.000 18.000 - 0.00% -
458.sjeng -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) -81.74% 241.000 44.000 - 0.00% -
458.sjeng (avg) (percentage) -81.50% 3.190 0.590 - 0.00% -
410.bwaves (avg) (percentage) -81.18% 4.410 0.830 - 0.00% -
410.bwaves -81.12% 249.000 47.000 - 0.00% -
410.bwaves (avg) -81.12% 249.000 47.000 - 0.00% -
453.povray -80.95% 42.000 8.000 - 0.00% -
453.povray (avg) -80.95% 42.000 8.000 - 0.00% -
447.dealII (avg) (percentage) -80.59% 5.770 1.120 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
453.povray (avg) (percentage) -79.26% 7.810 1.620 - 0.00% -
445.gobmk -79.08% 196.000 41.000 - 0.00% -
445.gobmk (avg) -79.08% 196.000 41.000 - 0.00% -
482.sphinx3 -78.38% 74.000 16.000 - 6.67% -
482.sphinx3 (avg) -78.38% 74.000 16.000 - 6.67% -
433.milc -78.26% 69.000 15.000 - 0.00% -
433.milc (avg) -78.26% 69.000 15.000 - 0.00% -
445.gobmk (avg) (percentage) -78.26% 3.910 0.850 - 0.00% -
433.milc (avg) (percentage) -78.18% 6.050 1.320 - 0.00% -
459.GemsFDTD (avg) (percentage) -78.08% 5.840 1.280 - -0.78% -
482.sphinx3 (avg) (percentage) -76.80% 7.930 1.840 - 2.22% -
471.omnetpp -75.34% 223.000 55.000 - -1.79% -
471.omnetpp (avg) -75.34% 223.000 55.000 - -1.79% -
471.omnetpp (avg) (percentage) -75.00% 8.200 2.050 - -0.97% -
462.libquantum (avg) (percentage) -74.67% 7.660 1.940 - -0.51% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
401.bzip2 (avg) (percentage) -70.07% 5.480 1.640 - -0.61% -
400.perlbench (avg) (percentage) -69.45% 6.350 1.940 - 0.00% -
435.gromacs -69.21% 367.000 113.000 - -1.74% -
435.gromacs (avg) -69.21% 367.000 113.000 - -1.74% -
401.bzip2 -68.94% 161.000 50.000 - 0.00% -
401.bzip2 (avg) -68.94% 161.000 50.000 - 0.00% -
435.gromacs (avg) (percentage) -68.18% 5.060 1.610 - 0.00% -
465.tonto -64.66% 365.000 129.000 - -1.53% -
465.tonto (avg) -64.66% 365.000 129.000 - -1.53% -
465.tonto (avg) (percentage) -64.37% 3.340 1.190 - -1.65% -
450.soplex (avg) (percentage) -60.65% 6.430 2.530 - 0.40% -
473.astar (avg) (percentage) -60.34% 4.160 1.650 - -0.60% -
473.astar -60.09% 213.000 85.000 - 0.00% -
473.astar (avg) -60.09% 213.000 85.000 - 0.00% -
450.soplex -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) -58.33% 36.000 15.000 - 7.14% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
429.mcf (avg) (percentage) -41.72% 7.670 4.470 - -0.45% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -14.68% 109.000 93.000 - 2.20% -
429.mcf (avg) -14.68% 109.000 93.000 - 2.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 34.48% 29.000 39.000 - 2.63% -

Report Time: 0.40s
Execution (seconds)
Name Current %
401.bzip2 3068.000 -
410.bwaves 5749.000 -
429.mcf 2090.000 2.45%
433.milc 1179.000 1.55%
434.zeusmp 2347.000 -
435.gromacs 7064.000 -1.33%
437.leslie3d 10921.000 -
444.namd 751.000 2.32%
445.gobmk 4936.000 -
447.dealII 1639.000 1.11%
450.soplex 593.000 3.85%
453.povray 549.000 1.67%
458.sjeng 7507.000 -
459.GemsFDTD 4825.000 -
462.libquantum 134.000 -
465.tonto 10912.000 -
470.lbm 3830.000 -
471.omnetpp 2714.000 -
473.astar 5194.000 -
482.sphinx3 888.000 5.34%
Geometric Mean 2397.964 1.04%
Code Size (bytes)
Name Current %
401.bzip2 43735.000 -
410.bwaves 17832.000 -
429.mcf 9086.000 -
433.milc 60440.000 -
434.zeusmp 149263.000 -
435.gromacs 490450.000 -
437.leslie3d 54310.000 -
444.namd 186052.000 -
445.gobmk 1374806.000 -
447.dealII 304874.000 -
450.soplex 203251.000 -
453.povray 653088.000 -
458.sjeng 103327.000 -
459.GemsFDTD 232852.000 -
462.libquantum 15781.000 -
465.tonto 1964847.000 -
470.lbm 9547.000 -
471.omnetpp 475129.000 -
473.astar 22728.000 -
482.sphinx3 111702.000 -
Geometric Mean 114554.081 -
sample variability
Name Current %
400.perlbench (avg) (percentage) 1.940 -
400.perlbench (max) (percentage) 2.070 -
401.bzip2 50.000 -
401.bzip2 (avg) 50.000 -
401.bzip2 (avg) (percentage) 1.640 -
401.bzip2 (max) 129.000 -3.01%
401.bzip2 (max) (percentage) 4.210 -3.88%
401.bzip2 (unexplained diff vs previous) 25.000 316.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.810 305.00%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 3.690 -
410.bwaves 47.000 -
410.bwaves (avg) 47.000 -
410.bwaves (avg) (percentage) 0.830 -
410.bwaves (max) 44.000 -13.73%
410.bwaves (max) (percentage) 0.780 -12.36%
410.bwaves (unexplained diff vs previous) 22.000 -56.86%
410.bwaves (unexplained diff vs previous) (percentage) 0.380 -56.82%
416.gamess (avg) (percentage) 0.760 -
416.gamess (max) (percentage) 0.360 -
429.mcf 93.000 2.20%
429.mcf (avg) 93.000 2.20%
429.mcf (avg) (percentage) 4.470 -
429.mcf (max) 51.000 112.50%
429.mcf (max) (percentage) 2.450 107.63%
429.mcf (unexplained diff vs previous) 50.000 117.39%
429.mcf (unexplained diff vs previous) (percentage) 2.390 111.50%
433.milc 15.000 -
433.milc (avg) 15.000 -
433.milc (avg) (percentage) 1.320 -
433.milc (max) 47.000 -
433.milc (max) (percentage) 4.020 -2.66%
433.milc (unexplained diff vs previous) 18.000 200.00%
433.milc (unexplained diff vs previous) (percentage) 1.530 194.23%
434.zeusmp 20.000 -
434.zeusmp (avg) 20.000 -
434.zeusmp (avg) (percentage) 0.860 -
434.zeusmp (max) 7.000 -63.16%
434.zeusmp (max) (percentage) 0.340 -59.52%
434.zeusmp (unexplained diff vs previous) 8.000 -20.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.340 -20.93%
435.gromacs 113.000 -1.74%
435.gromacs (avg) 113.000 -1.74%
435.gromacs (avg) (percentage) 1.610 -
435.gromacs (max) 95.000 -7.77%
435.gromacs (max) (percentage) 1.350 -6.90%
435.gromacs (unexplained diff vs previous) 95.000 58.33%
435.gromacs (unexplained diff vs previous) (percentage) 1.340 59.52%
436.cactusADM (avg) (percentage) 1.050 -
436.cactusADM (max) (percentage) 0.850 -1.16%
437.leslie3d 451.000 -
437.leslie3d (avg) 451.000 -
437.leslie3d (avg) (percentage) 4.130 -
437.leslie3d (max) 313.000 -25.12%
437.leslie3d (max) (percentage) 2.870 -25.07%
437.leslie3d (unexplained diff vs previous) 3.000 -99.31%
437.leslie3d (unexplained diff vs previous) (percentage) 0.030 -99.25%
444.namd 8.000 -
444.namd (avg) 8.000 -
444.namd (avg) (percentage) 1.160 -
444.namd (max) 17.000 142.86%
444.namd (max) (percentage) 2.320 139.18%
444.namd (unexplained diff vs previous) 17.000 466.67%
444.namd (unexplained diff vs previous) (percentage) 2.260 451.22%
445.gobmk 41.000 -
445.gobmk (avg) 41.000 -
445.gobmk (avg) (percentage) 0.850 -
445.gobmk (max) 43.000 30.30%
445.gobmk (max) (percentage) 0.880 29.41%
445.gobmk (unexplained diff vs previous) 43.000 2050.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.870 2075.00%
447.dealII 18.000 -
447.dealII (avg) 18.000 -
447.dealII (avg) (percentage) 1.120 -
447.dealII (max) 18.000 38.46%
447.dealII (max) (percentage) 1.110 33.73%
447.dealII (unexplained diff vs previous) 18.000 80.00%
447.dealII (unexplained diff vs previous) (percentage) 1.100 77.42%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.530 -
450.soplex (max) 24.000 -
450.soplex (max) (percentage) 4.050 -3.80%
450.soplex (unexplained diff vs previous) 22.000 22.22%
450.soplex (unexplained diff vs previous) (percentage) 3.710 17.78%
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.620 -
453.povray (max) 11.000 -8.33%
453.povray (max) (percentage) 2.130 -5.33%
453.povray (unexplained diff vs previous) 9.000 350.00%
453.povray (unexplained diff vs previous) (percentage) 1.640 343.24%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 0.820 -
456.hmmer (avg) (percentage) 0.520 -
456.hmmer (max) (percentage) 0.330 -2.94%
458.sjeng 44.000 -
458.sjeng (avg) 44.000 -
458.sjeng (avg) (percentage) 0.590 -
458.sjeng (max) 60.000 -4.76%
458.sjeng (max) (percentage) 0.800 -5.88%
458.sjeng (unexplained diff vs previous) 29.000 314.29%
458.sjeng (unexplained diff vs previous) (percentage) 0.390 333.33%
459.GemsFDTD 61.000 -1.61%
459.GemsFDTD (avg) 61.000 -1.61%
459.GemsFDTD (avg) (percentage) 1.280 -
459.GemsFDTD (max) 18.000 -10.00%
459.GemsFDTD (max) (percentage) 0.390 -9.30%
459.GemsFDTD (unexplained diff vs previous) 1.000 -92.31%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.020 -92.59%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.940 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.990 -9.95%
462.libquantum (unexplained diff vs previous) 1.000 -66.67%
462.libquantum (unexplained diff vs previous) (percentage) 0.750 -66.81%
464.h264ref (avg) (percentage) 0.710 -
464.h264ref (max) (percentage) 0.370 -
465.tonto 129.000 -1.53%
465.tonto (avg) 129.000 -1.53%
465.tonto (avg) (percentage) 1.190 -1.65%
465.tonto (max) 26.000 -3.70%
465.tonto (max) (percentage) 0.240 -4.00%
465.tonto (unexplained diff vs previous) 20.000 185.71%
465.tonto (unexplained diff vs previous) (percentage) 0.180 200.00%
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 0.820 -
470.lbm (max) 41.000 -
470.lbm (max) (percentage) 1.080 -
470.lbm (unexplained diff vs previous) 30.000 100.00%
470.lbm (unexplained diff vs previous) (percentage) 0.780 100.00%
471.omnetpp 55.000 -1.79%
471.omnetpp (avg) 55.000 -1.79%
471.omnetpp (avg) (percentage) 2.050 -
471.omnetpp (max) 23.000 -58.93%
471.omnetpp (max) (percentage) 0.860 -58.65%
471.omnetpp (unexplained diff vs previous) 7.000 -30.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.260 -29.73%
473.astar 85.000 -
473.astar (avg) 85.000 -
473.astar (avg) (percentage) 1.650 -
473.astar (max) 189.000 -3.08%
473.astar (max) (percentage) 3.640 -3.96%
473.astar (unexplained diff vs previous) 31.000 416.67%
473.astar (unexplained diff vs previous) (percentage) 0.600 400.00%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 0.780 -
482.sphinx3 16.000 6.67%
482.sphinx3 (avg) 16.000 6.67%
482.sphinx3 (avg) (percentage) 1.840 2.22%
482.sphinx3 (max) 47.000 147.37%
482.sphinx3 (max) (percentage) 5.340 126.27%
482.sphinx3 (unexplained diff vs previous) 45.000 650.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 5.070 614.08%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.708 10.52%