Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5790996072837620a8fd3756dda5138eb2f2781b (+ 327 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/31ce2e993d09dcad1ce139a2848a28de5931056d (+ 4 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b6e3898194bbae78910bbe9cd086937014961e45 (+ 109 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (+ 1649 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/206/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0206 (4-changed-components) 2024-02-29T13:31:56 0:00:00
Previous 0205 (basepoints/gcc-14-09418-g993c6de642f) 2024-02-19T00:05:04 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 12
Performance Improvements 85 195
Added Tests 46 0
Unchanged Tests 1093 1029
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.22% 135.000 138.000 - -1.43% -
453.povray 1.30% 538.000 545.000 - -0.37% -
471.omnetpp 1.19% 2698.000 2730.000 - 0.22% -
435.gromacs 1.15% 7110.000 7192.000 - -1.06% -
444.namd 1.04% 770.000 778.000 - 4.15% -
450.soplex 1.03% 581.000 587.000 - 3.53% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 100.00% 4.000 8.000 - -98.83% -
453.povray (max) 75.00% 4.000 7.000 - -98.60% -
444.namd (max) (percentage) 73.33% 0.600 1.040 - -98.87% -
453.povray (max) (percentage) 51.16% 0.860 1.300 - -98.58% -
462.libquantum (max) 50.00% 2.000 3.000 - -97.83% -
462.libquantum (max) (percentage) 31.36% 1.690 2.220 - -97.76% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -1.08% 1573.000 1556.000 - -6.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) -80.00% 15.000 3.000 - -99.67% -
459.GemsFDTD (max) -78.41% 88.000 19.000 - -99.57% -
459.GemsFDTD (max) (percentage) -77.98% 1.680 0.370 - -99.48% -
482.sphinx3 (max) (percentage) -77.25% 1.890 0.430 - -99.55% -
400.perlbench (max) -59.26% 54.000 22.000 - -98.43% -
400.perlbench (max) (percentage) -57.27% 3.440 1.470 - -98.25% -
429.mcf (max) -50.18% 281.000 140.000 - -89.41% -
429.mcf (max) (percentage) -50.17% 20.150 10.040 - -89.19% -
410.bwaves (max) -40.82% 49.000 29.000 - -99.11% -
410.bwaves (max) (percentage) -40.48% 0.840 0.500 - -99.14% -
464.h264ref (max) -40.00% 40.000 24.000 - -99.23% -
464.h264ref (max) (percentage) -40.00% 0.700 0.420 - -99.23% -
456.hmmer (max) -30.00% 10.000 7.000 - -99.67% -
437.leslie3d (max) -24.03% 462.000 351.000 - -81.80% -
437.leslie3d (max) (percentage) -23.76% 4.250 3.240 - -80.46% -
456.hmmer (max) (percentage) -22.86% 0.350 0.270 - -99.63% -
433.milc (max) -7.69% 26.000 24.000 - -97.70% -
450.soplex -5.88% 17.000 16.000 - -55.56% -
450.soplex (avg) -5.88% 17.000 16.000 - -55.56% -
401.bzip2 (max) -5.33% 75.000 71.000 - -96.93% -
458.sjeng (max) -5.33% 75.000 71.000 - -98.03% -
447.dealII (max) (percentage) -5.19% 1.350 1.280 - -98.41% -
433.milc -5.00% 20.000 19.000 - -72.46% -
433.milc (avg) -5.00% 20.000 19.000 - -72.46% -
458.sjeng (max) (percentage) -4.95% 1.010 0.960 - -97.98% -
401.bzip2 (max) (percentage) -4.80% 2.500 2.380 - -96.97% -
473.astar (max) -4.79% 188.000 179.000 - -94.74% -
471.omnetpp (max) (percentage) -4.73% 2.750 2.620 - -96.71% -
436.cactusADM (max) (percentage) -4.71% 0.850 0.810 - -99.09% -
435.gromacs (max) (percentage) -4.62% 2.380 2.270 - -95.38% -
447.dealII (max) -4.55% 22.000 21.000 - -98.48% -
433.milc (max) (percentage) -4.44% 2.250 2.150 - -97.63% -
465.tonto (max) (percentage) -4.44% 2.480 2.370 - -87.73% -
450.soplex (max) (percentage) -4.43% 5.420 5.180 - -94.62% -
473.astar (max) (percentage) -4.37% 3.660 3.500 - -94.73% -
471.omnetpp (max) -4.05% 74.000 71.000 - -96.73% -
470.lbm (max) (percentage) -4.04% 0.990 0.950 - -98.69% -
447.dealII -4.00% 25.000 24.000 - -75.76% -
447.dealII (avg) -4.00% 25.000 24.000 - -75.76% -
445.gobmk (max) (percentage) -3.98% 1.760 1.690 - -96.79% -
435.gromacs (max) -3.55% 169.000 163.000 - -95.44% -
434.zeusmp (max) (percentage) -3.48% 1.150 1.110 - -98.64% -
434.zeusmp (max) -3.45% 29.000 28.000 - -98.64% -
445.gobmk (max) -3.45% 87.000 84.000 - -96.82% -
465.tonto (max) -3.44% 291.000 281.000 - -86.70% -
450.soplex (max) -3.23% 31.000 30.000 - -94.50% -
434.zeusmp -2.78% 36.000 35.000 - -76.19% -
434.zeusmp (avg) -2.78% 36.000 35.000 - -76.19% -
454.calculix (max) (percentage) -2.75% 1.090 1.060 - -98.94% -
400.perlbench -2.70% 37.000 36.000 - -65.71% -
400.perlbench (avg) -2.70% 37.000 36.000 - -65.71% -
470.lbm (max) -2.70% 37.000 36.000 - -98.69% -
459.GemsFDTD -2.27% 88.000 86.000 - -76.11% -
459.GemsFDTD (avg) -2.27% 88.000 86.000 - -76.11% -
437.leslie3d -2.10% 525.000 514.000 - 44.79% -
437.leslie3d (avg) -2.10% 525.000 514.000 - 44.79% -
403.gcc (max) (percentage) -2.08% 5.290 5.180 - -94.79% -
473.astar -2.00% 100.000 98.000 - -53.99% -
473.astar (avg) -2.00% 100.000 98.000 - -53.99% -
447.dealII (avg) (percentage) -1.97% 1.520 1.490 - -74.18% -
459.GemsFDTD (avg) (percentage) -1.80% 1.670 1.640 - -71.92% -
445.gobmk (avg) (percentage) -1.79% 1.120 1.100 - -71.87% -
464.h264ref (avg) (percentage) -1.79% 1.120 1.100 - -78.39% -
433.milc (avg) (percentage) -1.73% 1.730 1.700 - -71.90% -
481.wrf (max) (percentage) -1.72% 1.160 1.140 - -98.34% -
437.leslie3d (avg) (percentage) -1.66% 4.830 4.750 - 55.74% -
429.mcf (avg) (percentage) -1.64% 6.710 6.600 - -13.95% -
458.sjeng -1.64% 61.000 60.000 - -75.10% -
458.sjeng (avg) -1.64% 61.000 60.000 - -75.10% -
410.bwaves (avg) (percentage) -1.60% 1.250 1.230 - -72.11% -
464.h264ref -1.56% 64.000 63.000 - -78.50% -
464.h264ref (avg) -1.56% 64.000 63.000 - -78.50% -
473.astar (avg) (percentage) -1.54% 1.950 1.920 - -53.85% -
401.bzip2 (avg) (percentage) -1.49% 2.020 1.990 - -63.69% -
482.sphinx3 (avg) (percentage) -1.42% 2.120 2.090 - -73.64% -
434.zeusmp (avg) (percentage) -1.39% 1.440 1.420 - -75.73% -
410.bwaves -1.37% 73.000 72.000 - -71.08% -
410.bwaves (avg) -1.37% 73.000 72.000 - -71.08% -
450.soplex (avg) (percentage) -1.37% 2.930 2.890 - -55.05% -
400.perlbench (avg) (percentage) -1.26% 2.390 2.360 - -62.83% -
456.hmmer (avg) (percentage) -1.20% 0.830 0.820 - -81.41% -
436.cactusADM (avg) (percentage) -1.19% 1.680 1.660 - -72.24% -
429.mcf -1.08% 93.000 92.000 - -15.60% -
429.mcf (avg) -1.08% 93.000 92.000 - -15.60% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 8.55% 10941.000 11876.000 - 0.89% -
410.bwaves 4.72% 5652.000 5919.000 - 0.12% -
444.namd 4.15% 747.000 778.000 - 1.04% -
450.soplex 3.53% 567.000 587.000 - 1.03% -
401.bzip2 2.69% 2941.000 3020.000 - 0.30% -
456.hmmer 2.50% 2882.000 2954.000 - -0.27% -
436.cactusADM 1.87% 2083.000 2122.000 - 0.24% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 55.74% 3.050 4.750 - -1.66% -
437.leslie3d 44.79% 355.000 514.000 - -2.10% -
437.leslie3d (avg) 44.79% 355.000 514.000 - -2.10% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - 0.00% -
nb_execution_successful -13.79% 29.000 25.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -2.56% 152037.000 148143.000 - 0.00% -
459.GemsFDTD -2.38% 244728.000 238900.000 - 0.00% -
410.bwaves -1.67% 16760.000 16480.000 - 0.00% -
444.namd -1.61% 188385.000 185348.000 - 0.00% -
464.h264ref -1.46% 387748.000 382104.000 - 0.00% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
435.gromacs -1.40% 499261.000 492285.000 - 0.00% -
437.leslie3d -1.33% 59479.000 58690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -14.27% 6173.000 5292.000 - 0.27% -
482.sphinx3 -13.12% 945.000 821.000 - -0.36% -
437.leslie3d -6.91% 11640.000 10836.000 - -0.42% -
400.perlbench -6.43% 1663.000 1556.000 - -1.08% -
447.dealII -3.60% 1724.000 1662.000 - 0.30% -
416.gamess -2.17% 12465.000 12194.000 - -0.23% -
429.mcf -2.04% 1424.000 1395.000 - -0.21% -
458.sjeng -1.74% 7567.000 7435.000 - -0.40% -
462.libquantum -1.43% 140.000 138.000 - 2.22% -
435.gromacs -1.06% 7269.000 7192.000 - 1.15% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.370 - 0.00% -
429.mcf (unexplained diff vs previous) -99.98% 18593.000 3.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.98% 1305.690 0.220 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.98% 13518.000 3.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 2.170 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.97% 787.130 0.240 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.97% 16396.000 5.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.96% 2557.320 1.020 - 0.00% -
450.soplex (unexplained diff vs previous) -99.96% 14500.000 6.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.93% 11280.000 8.000 - 0.00% -
447.dealII (unexplained diff vs previous) -99.93% 7017.000 5.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.93% 448.690 0.320 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.93% 407.020 0.300 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.92% 368.340 0.300 - 0.00% -
401.bzip2 (unexplained diff vs previous) -99.92% 10833.000 9.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.91% 137.900 0.120 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.91% 7794.000 7.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.91% 15458.000 14.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.91% 1118.610 1.030 - 0.00% -
444.namd (unexplained diff vs previous) -99.90% 8356.000 8.000 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.90% 278.630 0.270 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.90% 8030.000 8.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.90% 118.780 0.120 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.90% 6843.000 7.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.90% 250.410 0.260 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.89% 197.850 0.210 - 0.00% -
473.astar (unexplained diff vs previous) -99.89% 10146.000 11.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.88% 5707.000 7.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.88% 1043.330 1.280 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.81% 263.730 0.500 - 0.00% -
470.lbm (unexplained diff vs previous) -99.81% 9990.000 19.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.81% 8772.000 17.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.79% 527.480 1.090 - 0.00% -
416.gamess (max) -99.73% 4805.000 13.000 - 0.00% -
416.gamess (max) (percentage) -99.71% 38.550 0.110 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.70% 391.300 1.170 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.70% 10659.000 32.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.70% 5581.000 17.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.69% 111.110 0.340 - 0.00% -
482.sphinx3 (max) -99.67% 911.000 3.000 - -80.00% -
456.hmmer (max) -99.67% 2120.000 7.000 - -30.00% -
456.hmmer (max) (percentage) -99.63% 73.590 0.270 - -22.86% -
459.GemsFDTD (max) -99.57% 4411.000 19.000 - -78.41% -
458.sjeng (unexplained diff vs previous) -99.56% 6876.000 30.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.56% 90.870 0.400 - 0.00% -
482.sphinx3 (max) (percentage) -99.55% 96.500 0.430 - -77.25% -
459.GemsFDTD (max) (percentage) -99.48% 71.460 0.370 - -77.98% -
464.h264ref (max) -99.23% 3127.000 24.000 - -40.00% -
464.h264ref (max) (percentage) -99.23% 54.290 0.420 - -40.00% -
410.bwaves (max) (percentage) -99.14% 57.970 0.500 - -40.48% -
410.bwaves (max) -99.11% 3276.000 29.000 - -40.82% -
436.cactusADM (max) (percentage) -99.09% 88.730 0.810 - -4.71% -
436.cactusADM (max) -99.08% 1848.000 17.000 - 0.00% -
454.calculix (max) (percentage) -98.94% 99.730 1.060 - -2.75% -
444.namd (max) (percentage) -98.87% 91.790 1.040 - 73.33% -
435.gromacs (unexplained diff vs previous) -98.83% 7028.000 82.000 - 0.00% -
444.namd (max) -98.83% 685.000 8.000 - 100.00% -
435.gromacs (unexplained diff vs previous) (percentage) -98.82% 96.680 1.140 - 0.00% -
470.lbm (max) (percentage) -98.69% 72.510 0.950 - -4.04% -
470.lbm (max) -98.69% 2746.000 36.000 - -2.70% -
434.zeusmp (max) (percentage) -98.64% 81.770 1.110 - -3.48% -
434.zeusmp (max) -98.64% 2055.000 28.000 - -3.45% -
453.povray (max) -98.60% 499.000 7.000 - 75.00% -
453.povray (max) (percentage) -98.58% 91.250 1.300 - 51.16% -
447.dealII (max) -98.48% 1384.000 21.000 - -4.55% -
400.perlbench (max) -98.43% 1397.000 22.000 - -59.26% -
447.dealII (max) (percentage) -98.41% 80.280 1.280 - -5.19% -
481.wrf (max) (percentage) -98.34% 68.700 1.140 - -1.72% -
400.perlbench (max) (percentage) -98.25% 84.060 1.470 - -57.27% -
458.sjeng (max) -98.03% 3602.000 71.000 - -5.33% -
437.leslie3d (unexplained diff vs previous) -98.01% 2314.000 46.000 - 0.00% -
458.sjeng (max) (percentage) -97.98% 47.610 0.960 - -4.95% -
437.leslie3d (unexplained diff vs previous) (percentage) -97.89% 19.880 0.420 - 0.00% -
462.libquantum (max) -97.83% 138.000 3.000 - 50.00% -
462.libquantum (max) (percentage) -97.76% 98.970 2.220 - 31.36% -
433.milc (max) -97.70% 1044.000 24.000 - -7.69% -
433.milc (max) (percentage) -97.63% 90.750 2.150 - -4.44% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
401.bzip2 (max) (percentage) -96.97% 78.650 2.380 - -4.80% -
401.bzip2 (max) -96.93% 2313.000 71.000 - -5.33% -
445.gobmk (max) -96.82% 2643.000 84.000 - -3.45% -
445.gobmk (max) (percentage) -96.79% 52.630 1.690 - -3.98% -
471.omnetpp (max) -96.73% 2169.000 71.000 - -4.05% -
471.omnetpp (max) (percentage) -96.71% 79.650 2.620 - -4.73% -
435.gromacs (max) -95.44% 3573.000 163.000 - -3.55% -
435.gromacs (max) (percentage) -95.38% 49.160 2.270 - -4.62% -
403.gcc (max) (percentage) -94.79% 99.360 5.180 - -2.08% -
473.astar (max) -94.74% 3406.000 179.000 - -4.79% -
473.astar (max) (percentage) -94.73% 66.430 3.500 - -4.37% -
450.soplex (max) (percentage) -94.62% 96.240 5.180 - -4.43% -
450.soplex (max) -94.50% 545.000 30.000 - -3.23% -
429.mcf (max) -89.41% 1322.000 140.000 - -50.18% -
429.mcf (max) (percentage) -89.19% 92.890 10.040 - -50.17% -
465.tonto (max) (percentage) -87.73% 19.310 2.370 - -4.44% -
465.tonto (max) -86.70% 2112.000 281.000 - -3.44% -
437.leslie3d (max) -81.80% 1929.000 351.000 - -24.03% -
416.gamess -81.64% 550.000 101.000 - 0.00% -
416.gamess (avg) -81.64% 550.000 101.000 - 0.00% -
456.hmmer (avg) (percentage) -81.41% 4.410 0.820 - -1.20% -
416.gamess (avg) (percentage) -81.22% 4.420 0.830 - 0.00% -
456.hmmer -81.10% 127.000 24.000 - 0.00% -
456.hmmer (avg) -81.10% 127.000 24.000 - 0.00% -
444.namd -80.88% 68.000 13.000 - 0.00% -
444.namd (avg) -80.88% 68.000 13.000 - 0.00% -
444.namd (avg) (percentage) -80.80% 9.220 1.770 - -0.56% -
437.leslie3d (max) (percentage) -80.46% 16.580 3.240 - -23.76% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
470.lbm -79.50% 239.000 49.000 - 0.00% -
470.lbm (avg) -79.50% 239.000 49.000 - 0.00% -
470.lbm (avg) (percentage) -79.46% 6.330 1.300 - -0.76% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
464.h264ref -78.50% 293.000 63.000 - -1.56% -
464.h264ref (avg) -78.50% 293.000 63.000 - -1.56% -
464.h264ref (avg) (percentage) -78.39% 5.090 1.100 - -1.79% -
453.povray (avg) (percentage) -77.08% 7.810 1.790 - -0.56% -
482.sphinx3 -77.03% 74.000 17.000 - 0.00% -
482.sphinx3 (avg) -77.03% 74.000 17.000 - 0.00% -
434.zeusmp -76.19% 147.000 35.000 - -2.78% -
434.zeusmp (avg) -76.19% 147.000 35.000 - -2.78% -
459.GemsFDTD -76.11% 360.000 86.000 - -2.27% -
459.GemsFDTD (avg) -76.11% 360.000 86.000 - -2.27% -
447.dealII -75.76% 99.000 24.000 - -4.00% -
447.dealII (avg) -75.76% 99.000 24.000 - -4.00% -
434.zeusmp (avg) (percentage) -75.73% 5.850 1.420 - -1.39% -
462.libquantum (avg) (percentage) -75.72% 7.660 1.860 - 0.54% -
458.sjeng -75.10% 241.000 60.000 - -1.64% -
458.sjeng (avg) -75.10% 241.000 60.000 - -1.64% -
458.sjeng (avg) (percentage) -74.61% 3.190 0.810 - -1.22% -
447.dealII (avg) (percentage) -74.18% 5.770 1.490 - -1.97% -
482.sphinx3 (avg) (percentage) -73.64% 7.930 2.090 - -1.42% -
433.milc -72.46% 69.000 19.000 - -5.00% -
433.milc (avg) -72.46% 69.000 19.000 - -5.00% -
436.cactusADM (avg) (percentage) -72.24% 5.980 1.660 - -1.19% -
410.bwaves (avg) (percentage) -72.11% 4.410 1.230 - -1.60% -
445.gobmk -71.94% 196.000 55.000 - 0.00% -
445.gobmk (avg) -71.94% 196.000 55.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -71.92% 5.840 1.640 - -1.80% -
433.milc (avg) (percentage) -71.90% 6.050 1.700 - -1.73% -
445.gobmk (avg) (percentage) -71.87% 3.910 1.100 - -1.79% -
436.cactusADM -71.77% 124.000 35.000 - 0.00% -
436.cactusADM (avg) -71.77% 124.000 35.000 - 0.00% -
471.omnetpp -71.30% 223.000 64.000 - 0.00% -
471.omnetpp (avg) -71.30% 223.000 64.000 - 0.00% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
410.bwaves -71.08% 249.000 72.000 - -1.37% -
410.bwaves (avg) -71.08% 249.000 72.000 - -1.37% -
471.omnetpp (avg) (percentage) -70.98% 8.200 2.380 - -0.83% -
400.perlbench -65.71% 105.000 36.000 - -2.70% -
400.perlbench (avg) -65.71% 105.000 36.000 - -2.70% -
401.bzip2 (avg) (percentage) -63.69% 5.480 1.990 - -1.49% -
400.perlbench (avg) (percentage) -62.83% 6.350 2.360 - -1.26% -
401.bzip2 -62.73% 161.000 60.000 - 0.00% -
401.bzip2 (avg) -62.73% 161.000 60.000 - 0.00% -
435.gromacs -59.95% 367.000 147.000 - 0.00% -
435.gromacs (avg) -59.95% 367.000 147.000 - 0.00% -
435.gromacs (avg) (percentage) -59.49% 5.060 2.050 - -0.97% -
450.soplex -55.56% 36.000 16.000 - -5.88% -
450.soplex (avg) -55.56% 36.000 16.000 - -5.88% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
450.soplex (avg) (percentage) -55.05% 6.430 2.890 - -1.37% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
473.astar -53.99% 213.000 98.000 - -2.00% -
473.astar (avg) -53.99% 213.000 98.000 - -2.00% -
465.tonto (avg) (percentage) -53.89% 3.340 1.540 - 0.00% -
473.astar (avg) (percentage) -53.85% 4.160 1.920 - -1.54% -
465.tonto -50.14% 365.000 182.000 - 0.55% -
465.tonto (avg) -50.14% 365.000 182.000 - 0.55% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -15.60% 109.000 92.000 - -1.08% -
429.mcf (avg) -15.60% 109.000 92.000 - -1.08% -
429.mcf (avg) (percentage) -13.95% 7.670 6.600 - -1.64% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 0.00% -


Report Time: 0.43s
Name Current %
400.perlbench 1556.000 -1.08%
401.bzip2 3020.000 -
410.bwaves 5919.000 -
416.gamess 12194.000 -
429.mcf 1395.000 -
433.milc 1159.000 -
434.zeusmp 2525.000 -
435.gromacs 7192.000 1.15%
436.cactusADM 2122.000 -
437.leslie3d 10836.000 -
444.namd 778.000 1.04%
445.gobmk 5015.000 -
447.dealII 1662.000 -
450.soplex 587.000 1.03%
453.povray 545.000 1.30%
456.hmmer 2954.000 -
458.sjeng 7435.000 -
459.GemsFDTD 5292.000 -
462.libquantum 138.000 2.22%
464.h264ref 5780.000 -
465.tonto 11876.000 -
470.lbm 3810.000 -
471.omnetpp 2730.000 1.19%
473.astar 5141.000 -
482.sphinx3 821.000 -
Geometric Mean 2596.804 -
Name Current %
400.perlbench 890587.000 -
401.bzip2 43919.000 -
410.bwaves 16480.000 -
416.gamess 5696365.000 -
429.mcf 9055.000 -
433.milc 60853.000 -
434.zeusmp 148143.000 -
435.gromacs 492285.000 -
436.cactusADM 350629.000 -
437.leslie3d 58690.000 -
444.namd 185348.000 -
445.gobmk 1378998.000 -
447.dealII 310436.000 -
450.soplex 205303.000 -
453.povray 656269.000 -
456.hmmer 108215.000 -
458.sjeng 103292.000 -
459.GemsFDTD 238900.000 -
462.libquantum 16085.000 -
464.h264ref 382104.000 -
465.tonto 1936890.000 -
470.lbm 9551.000 -
471.omnetpp 479794.000 -
473.astar 22880.000 -
482.sphinx3 112243.000 -
Geometric Mean 159725.577 -
Name Current %
400.perlbench 36.000 -2.70%
400.perlbench (avg) 36.000 -2.70%
400.perlbench (avg) (percentage) 2.360 -1.26%
400.perlbench (max) 22.000 -59.26%
400.perlbench (max) (percentage) 1.470 -57.27%
400.perlbench (unexplained diff vs previous) 17.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.090 -
401.bzip2 60.000 -
401.bzip2 (avg) 60.000 -
401.bzip2 (avg) (percentage) 1.990 -1.49%
401.bzip2 (max) 71.000 -5.33%
401.bzip2 (max) (percentage) 2.380 -4.80%
401.bzip2 (unexplained diff vs previous) 9.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.300 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 5.180 -2.08%
410.bwaves 72.000 -1.37%
410.bwaves (avg) 72.000 -1.37%
410.bwaves (avg) (percentage) 1.230 -1.60%
410.bwaves (max) 29.000 -40.82%
410.bwaves (max) (percentage) 0.500 -40.48%
410.bwaves (unexplained diff vs previous) 7.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.120 -
416.gamess 101.000 -
416.gamess (avg) 101.000 -
416.gamess (avg) (percentage) 0.830 -
416.gamess (max) 13.000 -
416.gamess (max) (percentage) 0.110 -
429.mcf 92.000 -1.08%
429.mcf (avg) 92.000 -1.08%
429.mcf (avg) (percentage) 6.600 -1.64%
429.mcf (max) 140.000 -50.18%
429.mcf (max) (percentage) 10.040 -50.17%
429.mcf (unexplained diff vs previous) 3.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.220 -
433.milc 19.000 -5.00%
433.milc (avg) 19.000 -5.00%
433.milc (avg) (percentage) 1.700 -1.73%
433.milc (max) 24.000 -7.69%
433.milc (max) (percentage) 2.150 -4.44%
433.milc (unexplained diff vs previous) 1.000 -
433.milc (unexplained diff vs previous) (percentage) 0.090 -
434.zeusmp 35.000 -2.78%
434.zeusmp (avg) 35.000 -2.78%
434.zeusmp (avg) (percentage) 1.420 -1.39%
434.zeusmp (max) 28.000 -3.45%
434.zeusmp (max) (percentage) 1.110 -3.48%
434.zeusmp (unexplained diff vs previous) 8.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.320 -
435.gromacs 147.000 -
435.gromacs (avg) 147.000 -
435.gromacs (avg) (percentage) 2.050 -
435.gromacs (max) 163.000 -3.55%
435.gromacs (max) (percentage) 2.270 -4.62%
435.gromacs (unexplained diff vs previous) 82.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.140 -
436.cactusADM 35.000 -
436.cactusADM (avg) 35.000 -
436.cactusADM (avg) (percentage) 1.660 -1.19%
436.cactusADM (max) 17.000 -
436.cactusADM (max) (percentage) 0.810 -4.71%
436.cactusADM (unexplained diff vs previous) 5.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.240 -
437.leslie3d 514.000 -2.10%
437.leslie3d (avg) 514.000 -2.10%
437.leslie3d (avg) (percentage) 4.750 -1.66%
437.leslie3d (max) 351.000 -24.03%
437.leslie3d (max) (percentage) 3.240 -23.76%
437.leslie3d (unexplained diff vs previous) 46.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.420 -
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.770 -
444.namd (max) 8.000 100.00%
444.namd (max) (percentage) 1.040 73.33%
444.namd (unexplained diff vs previous) 8.000 -
444.namd (unexplained diff vs previous) (percentage) 1.030 -
445.gobmk 55.000 -
445.gobmk (avg) 55.000 -
445.gobmk (avg) (percentage) 1.100 -1.79%
445.gobmk (max) 84.000 -3.45%
445.gobmk (max) (percentage) 1.690 -3.98%
445.gobmk (unexplained diff vs previous) 17.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.340 -
447.dealII 24.000 -4.00%
447.dealII (avg) 24.000 -4.00%
447.dealII (avg) (percentage) 1.490 -1.97%
447.dealII (max) 21.000 -4.55%
447.dealII (max) (percentage) 1.280 -5.19%
447.dealII (unexplained diff vs previous) 5.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.300 -
450.soplex 16.000 -5.88%
450.soplex (avg) 16.000 -5.88%
450.soplex (avg) (percentage) 2.890 -1.37%
450.soplex (max) 30.000 -3.23%
450.soplex (max) (percentage) 5.180 -4.43%
450.soplex (unexplained diff vs previous) 6.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.020 -
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.790 -
453.povray (max) 7.000 75.00%
453.povray (max) (percentage) 1.300 51.16%
453.povray (unexplained diff vs previous) 7.000 -
453.povray (unexplained diff vs previous) (percentage) 1.280 -
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 1.060 -2.75%
456.hmmer 24.000 -
456.hmmer (avg) 24.000 -
456.hmmer (avg) (percentage) 0.820 -1.20%
456.hmmer (max) 7.000 -30.00%
456.hmmer (max) (percentage) 0.270 -22.86%
456.hmmer (unexplained diff vs previous) 8.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.270 -
458.sjeng 60.000 -1.64%
458.sjeng (avg) 60.000 -1.64%
458.sjeng (avg) (percentage) 0.810 -
458.sjeng (max) 71.000 -5.33%
458.sjeng (max) (percentage) 0.960 -4.95%
458.sjeng (unexplained diff vs previous) 30.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.400 -
459.GemsFDTD 86.000 -2.27%
459.GemsFDTD (avg) 86.000 -2.27%
459.GemsFDTD (avg) (percentage) 1.640 -1.80%
459.GemsFDTD (max) 19.000 -78.41%
459.GemsFDTD (max) (percentage) 0.370 -77.98%
459.GemsFDTD (unexplained diff vs previous) 14.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.860 -
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 2.220 31.36%
462.libquantum (unexplained diff vs previous) 3.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.170 -
464.h264ref 63.000 -1.56%
464.h264ref (avg) 63.000 -1.56%
464.h264ref (avg) (percentage) 1.100 -1.79%
464.h264ref (max) 24.000 -40.00%
464.h264ref (max) (percentage) 0.420 -40.00%
464.h264ref (unexplained diff vs previous) 7.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.120 -
465.tonto 182.000 -
465.tonto (avg) 182.000 -
465.tonto (avg) (percentage) 1.540 -
465.tonto (max) 281.000 -3.44%
465.tonto (max) (percentage) 2.370 -4.44%
470.lbm 49.000 -
470.lbm (avg) 49.000 -
470.lbm (avg) (percentage) 1.300 -
470.lbm (max) 36.000 -2.70%
470.lbm (max) (percentage) 0.950 -4.04%
470.lbm (unexplained diff vs previous) 19.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.500 -
471.omnetpp 64.000 -
471.omnetpp (avg) 64.000 -
471.omnetpp (avg) (percentage) 2.380 -
471.omnetpp (max) 71.000 -4.05%
471.omnetpp (max) (percentage) 2.620 -4.73%
471.omnetpp (unexplained diff vs previous) 32.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 1.170 -
473.astar 98.000 -2.00%
473.astar (avg) 98.000 -2.00%
473.astar (avg) (percentage) 1.920 -1.54%
473.astar (max) 179.000 -4.79%
473.astar (max) (percentage) 3.500 -4.37%
473.astar (unexplained diff vs previous) 11.000 -
473.astar (unexplained diff vs previous) (percentage) 0.210 -
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.140 -1.72%
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.090 -1.42%
482.sphinx3 (max) 3.000 -80.00%
482.sphinx3 (max) (percentage) 0.430 -77.25%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.370 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 6.410 -39.27%