Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2b53203690f3c6baa92b4c6007bc587c3c39844f (+ 13 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/218d17496122abe1fd831bd003f129310b32ca83 (+ 50 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4b0860d029f3cd61485d97c3620a5935b398b178 (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/208/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0208 (3-changed-components) 2024-03-11T20:10:10 0:00:00
Previous 0207 (3-changed-components) 2024-03-07T02:03:48 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 45 13
Performance Improvements 94 197
Added Tests 8 0
Unchanged Tests 1089 1026
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 6.26% 11460.000 12177.000 - 4.61% -
400.perlbench 1.94% 1543.000 1573.000 - -5.41% -
482.sphinx3 1.45% 828.000 840.000 - -11.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) (percentage) 1766.67% 0.030 0.560 - -99.53% -
464.h264ref (unexplained diff vs previous) 1500.00% 2.000 32.000 - -99.53% -
434.zeusmp (unexplained diff vs previous) (percentage) 366.67% 0.120 0.560 - -99.88% -
434.zeusmp (unexplained diff vs previous) 366.67% 3.000 14.000 - -99.88% -
436.cactusADM (unexplained diff vs previous) (percentage) 322.22% 0.090 0.380 - -99.95% -
436.cactusADM (unexplained diff vs previous) 300.00% 2.000 8.000 - -99.95% -
400.perlbench (unexplained diff vs previous) 130.77% 13.000 30.000 - -99.66% -
400.perlbench (unexplained diff vs previous) (percentage) 127.38% 0.840 1.910 - -99.64% -
436.cactusADM (max) 100.00% 4.000 8.000 - -99.57% -
436.cactusADM (max) (percentage) 80.95% 0.210 0.380 - -99.57% -
433.milc (unexplained diff vs previous) 75.00% 4.000 7.000 - -99.94% -
433.milc (unexplained diff vs previous) (percentage) 74.29% 0.350 0.610 - -99.94% -
482.sphinx3 (max) 71.43% 7.000 12.000 - -98.68% -
482.sphinx3 (unexplained diff vs previous) 71.43% 7.000 12.000 - -99.95% -
482.sphinx3 (max) (percentage) 70.59% 0.850 1.450 - -98.50% -
459.GemsFDTD (max) (percentage) 70.59% 0.340 0.580 - -99.19% -
482.sphinx3 (unexplained diff vs previous) (percentage) 68.24% 0.850 1.430 - -99.95% -
459.GemsFDTD (max) 66.67% 18.000 30.000 - -99.32% -
400.perlbench (max) 42.86% 21.000 30.000 - -97.85% -
471.omnetpp (unexplained diff vs previous) (percentage) 41.36% 1.620 2.290 - -99.41% -
400.perlbench (max) (percentage) 40.58% 1.380 1.940 - -97.69% -
401.bzip2 (unexplained diff vs previous) 40.00% 15.000 21.000 - -99.81% -
401.bzip2 (unexplained diff vs previous) (percentage) 40.00% 0.500 0.700 - -99.81% -
471.omnetpp (unexplained diff vs previous) 37.78% 45.000 62.000 - -99.42% -
453.povray (unexplained diff vs previous) (percentage) 36.42% 1.620 2.210 - -99.79% -
453.povray (unexplained diff vs previous) 33.33% 9.000 12.000 - -99.79% -
453.povray (max) (percentage) 31.52% 1.650 2.170 - -97.62% -
464.h264ref (max) (percentage) 30.95% 0.420 0.550 - -98.99% -
464.h264ref (max) 29.17% 24.000 31.000 - -99.01% -
450.soplex (unexplained diff vs previous) 25.00% 4.000 5.000 - -99.97% -
450.soplex (unexplained diff vs previous) (percentage) 23.19% 0.690 0.850 - -99.97% -
453.povray (max) 22.22% 9.000 11.000 - -97.80% -
435.gromacs (unexplained diff vs previous) (percentage) 18.39% 0.870 1.030 - -98.93% -
435.gromacs (unexplained diff vs previous) 17.46% 63.000 74.000 - -98.95% -
437.leslie3d (max) 15.45% 660.000 762.000 - -60.50% -
437.leslie3d (unexplained diff vs previous) 14.90% 624.000 717.000 - -69.01% -
437.leslie3d (max) (percentage) 8.68% 5.760 6.260 - -62.24% -
437.leslie3d (unexplained diff vs previous) (percentage) 8.07% 5.450 5.890 - -70.37% -
437.leslie3d 6.78% 546.000 583.000 - 64.23% -
437.leslie3d (avg) 6.78% 546.000 583.000 - 64.23% -
400.perlbench 2.86% 35.000 36.000 - -65.71% -
400.perlbench (avg) 2.86% 35.000 36.000 - -65.71% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -2.23% 2775.000 2713.000 - -0.40% -
453.povray -2.17% 554.000 542.000 - -0.91% -
435.gromacs -1.02% 7255.000 7181.000 - -1.21% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -92.91% 141.000 10.000 - -99.24% -
429.mcf (max) (percentage) -92.33% 10.040 0.770 - -99.17% -
445.gobmk (unexplained diff vs previous) -91.89% 37.000 3.000 - -99.95% -
445.gobmk (unexplained diff vs previous) (percentage) -91.89% 0.740 0.060 - -99.95% -
456.hmmer (unexplained diff vs previous) (percentage) -90.00% 0.300 0.030 - -99.99% -
473.astar (max) -89.60% 173.000 18.000 - -99.47% -
473.astar (max) (percentage) -89.32% 3.370 0.360 - -99.46% -
456.hmmer (unexplained diff vs previous) -88.89% 9.000 1.000 - -99.99% -
458.sjeng (unexplained diff vs previous) (percentage) -82.35% 0.510 0.090 - -99.90% -
458.sjeng (unexplained diff vs previous) -81.58% 38.000 7.000 - -99.90% -
410.bwaves (unexplained diff vs previous) -77.78% 18.000 4.000 - -99.95% -
444.namd (unexplained diff vs previous) -77.78% 9.000 2.000 - -99.98% -
444.namd (unexplained diff vs previous) (percentage) -77.78% 1.170 0.260 - -99.98% -
410.bwaves (unexplained diff vs previous) (percentage) -76.67% 0.300 0.070 - -99.95% -
470.lbm (unexplained diff vs previous) (percentage) -74.00% 0.500 0.130 - -99.95% -
470.lbm (unexplained diff vs previous) -73.68% 19.000 5.000 - -99.95% -
470.lbm (max) (percentage) -51.09% 0.920 0.450 - -99.38% -
445.gobmk (max) -50.62% 81.000 40.000 - -98.49% -
445.gobmk (max) (percentage) -50.00% 1.640 0.820 - -98.44% -
458.sjeng (max) -50.00% 68.000 34.000 - -99.06% -
458.sjeng (max) (percentage) -50.00% 0.920 0.460 - -99.03% -
470.lbm (max) -50.00% 34.000 17.000 - -99.38% -
410.bwaves (max) -48.15% 27.000 14.000 - -99.57% -
410.bwaves (max) (percentage) -45.65% 0.460 0.250 - -99.57% -
429.mcf (unexplained diff vs previous) -38.46% 13.000 8.000 - -99.96% -
429.mcf (unexplained diff vs previous) (percentage) -38.04% 0.920 0.570 - -99.96% -
473.astar (unexplained diff vs previous) (percentage) -37.84% 0.370 0.230 - -99.88% -
473.astar (unexplained diff vs previous) -36.84% 19.000 12.000 - -99.88% -
456.hmmer (max) (percentage) -16.67% 0.300 0.250 - -99.66% -
444.namd (max) -12.50% 8.000 7.000 - -98.98% -
456.hmmer (max) -12.50% 8.000 7.000 - -99.67% -
444.namd (max) (percentage) -10.34% 1.160 1.040 - -98.87% -
462.libquantum (max) (percentage) -7.50% 2.000 1.850 - -98.13% -
471.omnetpp (max) -5.71% 70.000 66.000 - -96.96% -
447.dealII (max) -5.00% 20.000 19.000 - -98.63% -
450.soplex (max) (percentage) -4.44% 0.900 0.860 - -99.11% -
401.bzip2 (max) -4.35% 69.000 66.000 - -97.15% -
456.hmmer -4.17% 24.000 23.000 - -81.89% -
456.hmmer (avg) -4.17% 24.000 23.000 - -81.89% -
465.tonto (max) -4.09% 269.000 258.000 - -87.78% -
416.gamess -3.96% 101.000 97.000 - -82.36% -
416.gamess (avg) -3.96% 101.000 97.000 - -82.36% -
416.gamess (avg) (percentage) -3.61% 0.830 0.800 - -81.90% -
458.sjeng -3.33% 60.000 58.000 - -75.93% -
458.sjeng (avg) -3.33% 60.000 58.000 - -75.93% -
447.dealII (max) (percentage) -3.28% 1.220 1.180 - -98.53% -
471.omnetpp (max) (percentage) -3.16% 2.530 2.450 - -96.92% -
465.tonto (max) (percentage) -3.07% 2.280 2.210 - -88.56% -
401.bzip2 (max) (percentage) -3.04% 2.300 2.230 - -97.16% -
433.milc (max) (percentage) -2.90% 2.070 2.010 - -97.79% -
434.zeusmp -2.86% 35.000 34.000 - -76.87% -
434.zeusmp (avg) -2.86% 35.000 34.000 - -76.87% -
465.tonto -2.75% 182.000 177.000 - -51.51% -
465.tonto (avg) -2.75% 182.000 177.000 - -51.51% -
458.sjeng (avg) (percentage) -2.47% 0.810 0.790 - -75.24% -
429.mcf -2.20% 91.000 89.000 - -18.35% -
429.mcf (avg) -2.20% 91.000 89.000 - -18.35% -
435.gromacs -2.05% 146.000 143.000 - -61.04% -
435.gromacs (avg) -2.05% 146.000 143.000 - -61.04% -
473.astar -2.04% 98.000 96.000 - -54.93% -
473.astar (avg) -2.04% 98.000 96.000 - -54.93% -
454.calculix (max) (percentage) -1.94% 1.030 1.010 - -98.99% -
445.gobmk -1.85% 54.000 53.000 - -72.96% -
445.gobmk (avg) -1.85% 54.000 53.000 - -72.96% -
445.gobmk (avg) (percentage) -1.82% 1.100 1.080 - -72.38% -
481.wrf (max) (percentage) -1.79% 1.120 1.100 - -98.40% -
403.gcc (max) (percentage) -1.78% 5.070 4.980 - -94.99% -
401.bzip2 -1.72% 58.000 57.000 - -64.60% -
401.bzip2 (avg) -1.72% 58.000 57.000 - -64.60% -
410.bwaves (avg) (percentage) -1.65% 1.210 1.190 - -73.02% -
464.h264ref -1.61% 62.000 61.000 - -79.18% -
464.h264ref (avg) -1.61% 62.000 61.000 - -79.18% -
473.astar (avg) (percentage) -1.58% 1.900 1.870 - -55.05% -
470.lbm (avg) (percentage) -1.55% 1.290 1.270 - -79.94% -
471.omnetpp -1.54% 65.000 64.000 - -71.30% -
471.omnetpp (avg) -1.54% 65.000 64.000 - -71.30% -
434.zeusmp (avg) (percentage) -1.44% 1.390 1.370 - -76.58% -
410.bwaves -1.41% 71.000 70.000 - -71.89% -
410.bwaves (avg) -1.41% 71.000 70.000 - -71.89% -
429.mcf (avg) (percentage) -1.38% 6.510 6.420 - -16.30% -
465.tonto (avg) (percentage) -1.30% 1.540 1.520 - -54.49% -
456.hmmer (avg) (percentage) -1.23% 0.810 0.800 - -81.86% -
436.cactusADM (avg) (percentage) -1.23% 1.630 1.610 - -73.08% -
459.GemsFDTD (avg) (percentage) -1.22% 1.640 1.620 - -72.26% -
433.milc (avg) (percentage) -1.19% 1.680 1.660 - -72.56% -
459.GemsFDTD -1.16% 86.000 85.000 - -76.39% -
459.GemsFDTD (avg) -1.16% 86.000 85.000 - -76.39% -
444.namd (avg) (percentage) -1.14% 1.760 1.740 - -81.13% -
462.libquantum (avg) (percentage) -1.09% 1.830 1.810 - -76.37% -
450.soplex (avg) (percentage) -1.05% 2.850 2.820 - -56.14% -
401.bzip2 (avg) (percentage) -1.02% 1.960 1.940 - -64.60% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 7.03% 10941.000 11710.000 - -0.95% -
410.bwaves 5.11% 5652.000 5941.000 - 0.07% -
437.leslie3d 4.61% 11640.000 12177.000 - 6.26% -
450.soplex 3.70% 567.000 588.000 - 0.86% -
456.hmmer 2.78% 2882.000 2962.000 - -0.03% -
444.namd 2.68% 747.000 767.000 - -0.26% -
436.cactusADM 1.58% 2083.000 2116.000 - -0.38% -
401.bzip2 1.46% 2941.000 2984.000 - -0.70% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 64.23% 355.000 583.000 - 6.78% -
437.leslie3d (avg) 64.23% 355.000 583.000 - 6.78% -
437.leslie3d (avg) (percentage) 57.05% 3.050 4.790 - 0.42% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -13.79% 29.000 25.000 - 0.00% -
nb_execution_successful -13.79% 29.000 25.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -2.56% 152037.000 148143.000 - 0.00% -
459.GemsFDTD -2.38% 244728.000 238904.000 - 0.00% -
410.bwaves -1.67% 16760.000 16480.000 - 0.00% -
444.namd -1.61% 188385.000 185348.000 - 0.00% -
464.h264ref -1.46% 387748.000 382104.000 - 0.00% -
470.lbm -1.44% 9691.000 9551.000 - 0.00% -
435.gromacs -1.40% 499261.000 492285.000 - 0.00% -
437.leslie3d -1.33% 59479.000 58690.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -14.60% 6173.000 5272.000 - -0.58% -
482.sphinx3 -11.11% 945.000 840.000 - 1.45% -
400.perlbench -5.41% 1663.000 1573.000 - 1.94% -
447.dealII -3.71% 1724.000 1660.000 - 0.91% -
416.gamess -2.13% 12465.000 12199.000 - 0.02% -
429.mcf -1.69% 1424.000 1400.000 - -0.57% -
458.sjeng -1.33% 7567.000 7466.000 - -0.09% -
435.gromacs -1.21% 7269.000 7181.000 - -1.02% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.99% 278.630 0.030 - -90.00% -
456.hmmer (unexplained diff vs previous) -99.99% 8030.000 1.000 - -88.89% -
444.namd (unexplained diff vs previous) (percentage) -99.98% 1118.610 0.260 - -77.78% -
444.namd (unexplained diff vs previous) -99.98% 8356.000 2.000 - -77.78% -
416.gamess (unexplained diff vs previous) (percentage) -99.97% 62.730 0.020 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.850 - 23.19% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 5.000 - 25.00% -
416.gamess (unexplained diff vs previous) -99.96% 7819.000 3.000 - 0.00% -
429.mcf (unexplained diff vs previous) -99.96% 18593.000 8.000 - -38.46% -
429.mcf (unexplained diff vs previous) (percentage) -99.96% 1305.690 0.570 - -38.04% -
482.sphinx3 (unexplained diff vs previous) -99.95% 26073.000 12.000 - 71.43% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.95% 787.130 0.380 - 322.22% -
436.cactusADM (unexplained diff vs previous) -99.95% 16396.000 8.000 - 300.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.95% 263.730 0.130 - -74.00% -
470.lbm (unexplained diff vs previous) -99.95% 9990.000 5.000 - -73.68% -
410.bwaves (unexplained diff vs previous) (percentage) -99.95% 137.900 0.070 - -76.67% -
410.bwaves (unexplained diff vs previous) -99.95% 7794.000 4.000 - -77.78% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.430 - 68.24% -
445.gobmk (unexplained diff vs previous) -99.95% 5581.000 3.000 - -91.89% -
445.gobmk (unexplained diff vs previous) (percentage) -99.95% 111.110 0.060 - -91.89% -
433.milc (unexplained diff vs previous) -99.94% 11289.000 7.000 - 75.00% -
433.milc (unexplained diff vs previous) (percentage) -99.94% 980.800 0.610 - 74.29% -
458.sjeng (unexplained diff vs previous) (percentage) -99.90% 90.870 0.090 - -82.35% -
458.sjeng (unexplained diff vs previous) -99.90% 6876.000 7.000 - -81.58% -
473.astar (unexplained diff vs previous) (percentage) -99.88% 197.850 0.230 - -37.84% -
473.astar (unexplained diff vs previous) -99.88% 10146.000 12.000 - -36.84% -
434.zeusmp (unexplained diff vs previous) -99.88% 11280.000 14.000 - 366.67% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.88% 448.690 0.560 - 366.67% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.81% 368.340 0.700 - 40.00% -
401.bzip2 (unexplained diff vs previous) -99.81% 10833.000 21.000 - 40.00% -
459.GemsFDTD (unexplained diff vs previous) -99.80% 15458.000 31.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.79% 5707.000 12.000 - 33.33% -
453.povray (unexplained diff vs previous) (percentage) -99.79% 1043.330 2.210 - 36.42% -
447.dealII (unexplained diff vs previous) -99.79% 7017.000 15.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.78% 407.020 0.900 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.76% 250.410 0.590 - 0.00% -
416.gamess (max) -99.75% 4805.000 12.000 - 0.00% -
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
456.hmmer (max) -99.67% 2120.000 7.000 - -12.50% -
456.hmmer (max) (percentage) -99.66% 73.590 0.250 - -16.67% -
400.perlbench (unexplained diff vs previous) -99.66% 8772.000 30.000 - 130.77% -
400.perlbench (unexplained diff vs previous) (percentage) -99.64% 527.480 1.910 - 127.38% -
410.bwaves (max) -99.57% 3276.000 14.000 - -48.15% -
436.cactusADM (max) (percentage) -99.57% 88.730 0.380 - 80.95% -
410.bwaves (max) (percentage) -99.57% 57.970 0.250 - -45.65% -
436.cactusADM (max) -99.57% 1848.000 8.000 - 100.00% -
464.h264ref (unexplained diff vs previous) -99.53% 6843.000 32.000 - 1500.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.53% 118.780 0.560 - 1766.67% -
473.astar (max) -99.47% 3406.000 18.000 - -89.60% -
473.astar (max) (percentage) -99.46% 66.430 0.360 - -89.32% -
471.omnetpp (unexplained diff vs previous) -99.42% 10659.000 62.000 - 37.78% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.41% 391.300 2.290 - 41.36% -
470.lbm (max) -99.38% 2746.000 17.000 - -50.00% -
470.lbm (max) (percentage) -99.38% 72.510 0.450 - -51.09% -
459.GemsFDTD (max) -99.32% 4411.000 30.000 - 66.67% -
429.mcf (max) -99.24% 1322.000 10.000 - -92.91% -
459.GemsFDTD (max) (percentage) -99.19% 71.460 0.580 - 70.59% -
429.mcf (max) (percentage) -99.17% 92.890 0.770 - -92.33% -
434.zeusmp (max) -99.12% 2055.000 18.000 - 0.00% -
434.zeusmp (max) (percentage) -99.12% 81.770 0.720 - 0.00% -
450.soplex (max) (percentage) -99.11% 96.240 0.860 - -4.44% -
450.soplex (max) -99.08% 545.000 5.000 - 0.00% -
458.sjeng (max) -99.06% 3602.000 34.000 - -50.00% -
458.sjeng (max) (percentage) -99.03% 47.610 0.460 - -50.00% -
464.h264ref (max) -99.01% 3127.000 31.000 - 29.17% -
454.calculix (max) (percentage) -98.99% 99.730 1.010 - -1.94% -
464.h264ref (max) (percentage) -98.99% 54.290 0.550 - 30.95% -
444.namd (max) -98.98% 685.000 7.000 - -12.50% -
435.gromacs (unexplained diff vs previous) -98.95% 7028.000 74.000 - 17.46% -
435.gromacs (unexplained diff vs previous) (percentage) -98.93% 96.680 1.030 - 18.39% -
444.namd (max) (percentage) -98.87% 91.790 1.040 - -10.34% -
482.sphinx3 (max) -98.68% 911.000 12.000 - 71.43% -
447.dealII (max) -98.63% 1384.000 19.000 - -5.00% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
447.dealII (max) (percentage) -98.53% 80.280 1.180 - -3.28% -
482.sphinx3 (max) (percentage) -98.50% 96.500 1.450 - 70.59% -
445.gobmk (max) -98.49% 2643.000 40.000 - -50.62% -
445.gobmk (max) (percentage) -98.44% 52.630 0.820 - -50.00% -
481.wrf (max) (percentage) -98.40% 68.700 1.100 - -1.79% -
462.libquantum (max) (percentage) -98.13% 98.970 1.850 - -7.50% -
435.gromacs (max) -97.96% 3573.000 73.000 - 0.00% -
435.gromacs (max) (percentage) -97.93% 49.160 1.020 - 0.99% -
400.perlbench (max) -97.85% 1397.000 30.000 - 42.86% -
433.milc (max) -97.80% 1044.000 23.000 - 0.00% -
453.povray (max) -97.80% 499.000 11.000 - 22.22% -
433.milc (max) (percentage) -97.79% 90.750 2.010 - -2.90% -
400.perlbench (max) (percentage) -97.69% 84.060 1.940 - 40.58% -
453.povray (max) (percentage) -97.62% 91.250 2.170 - 31.52% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
401.bzip2 (max) (percentage) -97.16% 78.650 2.230 - -3.04% -
401.bzip2 (max) -97.15% 2313.000 66.000 - -4.35% -
471.omnetpp (max) -96.96% 2169.000 66.000 - -5.71% -
471.omnetpp (max) (percentage) -96.92% 79.650 2.450 - -3.16% -
403.gcc (max) (percentage) -94.99% 99.360 4.980 - -1.78% -
465.tonto (unexplained diff vs previous) (percentage) -94.07% 16.190 0.960 - 0.00% -
465.tonto (unexplained diff vs previous) -93.68% 1771.000 112.000 - 0.00% -
465.tonto (max) (percentage) -88.56% 19.310 2.210 - -3.07% -
465.tonto (max) -87.78% 2112.000 258.000 - -4.09% -
416.gamess -82.36% 550.000 97.000 - -3.96% -
416.gamess (avg) -82.36% 550.000 97.000 - -3.96% -
416.gamess (avg) (percentage) -81.90% 4.420 0.800 - -3.61% -
456.hmmer -81.89% 127.000 23.000 - -4.17% -
456.hmmer (avg) -81.89% 127.000 23.000 - -4.17% -
456.hmmer (avg) (percentage) -81.86% 4.410 0.800 - -1.23% -
444.namd (avg) (percentage) -81.13% 9.220 1.740 - -1.14% -
444.namd -80.88% 68.000 13.000 - 0.00% -
444.namd (avg) -80.88% 68.000 13.000 - 0.00% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
470.lbm (avg) (percentage) -79.94% 6.330 1.270 - -1.55% -
470.lbm -79.92% 239.000 48.000 - 0.00% -
470.lbm (avg) -79.92% 239.000 48.000 - 0.00% -
464.h264ref -79.18% 293.000 61.000 - -1.61% -
464.h264ref (avg) -79.18% 293.000 61.000 - -1.61% -
464.h264ref (avg) (percentage) -78.98% 5.090 1.070 - -0.93% -
453.povray -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) -78.57% 42.000 9.000 - 0.00% -
453.povray (avg) (percentage) -77.08% 7.810 1.790 - 0.56% -
482.sphinx3 -77.03% 74.000 17.000 - 0.00% -
482.sphinx3 (avg) -77.03% 74.000 17.000 - 0.00% -
434.zeusmp -76.87% 147.000 34.000 - -2.86% -
434.zeusmp (avg) -76.87% 147.000 34.000 - -2.86% -
434.zeusmp (avg) (percentage) -76.58% 5.850 1.370 - -1.44% -
459.GemsFDTD -76.39% 360.000 85.000 - -1.16% -
459.GemsFDTD (avg) -76.39% 360.000 85.000 - -1.16% -
462.libquantum (avg) (percentage) -76.37% 7.660 1.810 - -1.09% -
458.sjeng -75.93% 241.000 58.000 - -3.33% -
458.sjeng (avg) -75.93% 241.000 58.000 - -3.33% -
447.dealII -75.76% 99.000 24.000 - 0.00% -
447.dealII (avg) -75.76% 99.000 24.000 - 0.00% -
458.sjeng (avg) (percentage) -75.24% 3.190 0.790 - -2.47% -
447.dealII (avg) (percentage) -74.35% 5.770 1.480 - -0.67% -
482.sphinx3 (avg) (percentage) -74.15% 7.930 2.050 - -0.49% -
436.cactusADM (avg) (percentage) -73.08% 5.980 1.610 - -1.23% -
410.bwaves (avg) (percentage) -73.02% 4.410 1.190 - -1.65% -
445.gobmk -72.96% 196.000 53.000 - -1.85% -
445.gobmk (avg) -72.96% 196.000 53.000 - -1.85% -
436.cactusADM -72.58% 124.000 34.000 - 0.00% -
436.cactusADM (avg) -72.58% 124.000 34.000 - 0.00% -
433.milc (avg) (percentage) -72.56% 6.050 1.660 - -1.19% -
433.milc -72.46% 69.000 19.000 - 0.00% -
433.milc (avg) -72.46% 69.000 19.000 - 0.00% -
445.gobmk (avg) (percentage) -72.38% 3.910 1.080 - -1.82% -
459.GemsFDTD (avg) (percentage) -72.26% 5.840 1.620 - -1.22% -
410.bwaves -71.89% 249.000 70.000 - -1.41% -
410.bwaves (avg) -71.89% 249.000 70.000 - -1.41% -
471.omnetpp -71.30% 223.000 64.000 - -1.54% -
471.omnetpp (avg) -71.30% 223.000 64.000 - -1.54% -
481.wrf (avg) (percentage) -71.15% 6.240 1.800 - 0.00% -
471.omnetpp (avg) (percentage) -71.10% 8.200 2.370 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -70.37% 19.880 5.890 - 8.07% -
437.leslie3d (unexplained diff vs previous) -69.01% 2314.000 717.000 - 14.90% -
400.perlbench -65.71% 105.000 36.000 - 2.86% -
400.perlbench (avg) -65.71% 105.000 36.000 - 2.86% -
401.bzip2 (avg) (percentage) -64.60% 5.480 1.940 - -1.02% -
401.bzip2 -64.60% 161.000 57.000 - -1.72% -
401.bzip2 (avg) -64.60% 161.000 57.000 - -1.72% -
400.perlbench (avg) (percentage) -63.46% 6.350 2.320 - -0.43% -
437.leslie3d (max) (percentage) -62.24% 16.580 6.260 - 8.68% -
435.gromacs -61.04% 367.000 143.000 - -2.05% -
435.gromacs (avg) -61.04% 367.000 143.000 - -2.05% -
437.leslie3d (max) -60.50% 1929.000 762.000 - 15.45% -
435.gromacs (avg) (percentage) -60.47% 5.060 2.000 - -0.99% -
450.soplex (avg) (percentage) -56.14% 6.430 2.820 - -1.05% -
450.soplex -55.56% 36.000 16.000 - 0.00% -
450.soplex (avg) -55.56% 36.000 16.000 - 0.00% -
454.calculix (avg) (percentage) -55.11% 8.020 3.600 - 0.00% -
473.astar (avg) (percentage) -55.05% 4.160 1.870 - -1.58% -
473.astar -54.93% 213.000 96.000 - -2.04% -
473.astar (avg) -54.93% 213.000 96.000 - -2.04% -
465.tonto (avg) (percentage) -54.49% 3.340 1.520 - -1.30% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto -51.51% 365.000 177.000 - -2.75% -
465.tonto (avg) -51.51% 365.000 177.000 - -2.75% -
403.gcc (avg) (percentage) -30.46% 7.320 5.090 - 0.00% -
429.mcf -18.35% 109.000 89.000 - -2.20% -
429.mcf (avg) -18.35% 109.000 89.000 - -2.20% -
429.mcf (avg) (percentage) -16.30% 7.670 6.420 - -1.38% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 13.79% 29.000 33.000 - 0.00% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1573.000 1.94%
401.bzip2 2984.000 -
410.bwaves 5941.000 -
416.gamess 12199.000 -
429.mcf 1400.000 -
433.milc 1148.000 -
434.zeusmp 2514.000 -
435.gromacs 7181.000 -1.02%
436.cactusADM 2116.000 -
437.leslie3d 12177.000 6.26%
444.namd 767.000 -
445.gobmk 4975.000 -
447.dealII 1660.000 -
450.soplex 588.000 -
453.povray 542.000 -2.17%
456.hmmer 2962.000 -
458.sjeng 7466.000 -
459.GemsFDTD 5272.000 -
462.libquantum 139.000 -
464.h264ref 5750.000 -
465.tonto 11710.000 -
470.lbm 3786.000 -
471.omnetpp 2713.000 -2.23%
473.astar 5172.000 -
482.sphinx3 840.000 1.45%
Geometric Mean 2605.654 -
Code Size (bytes)
Name Current %
400.perlbench 890587.000 -
401.bzip2 43919.000 -
410.bwaves 16480.000 -
416.gamess 5680013.000 -
429.mcf 9055.000 -
433.milc 60853.000 -
434.zeusmp 148143.000 -
435.gromacs 492285.000 -
436.cactusADM 350629.000 -
437.leslie3d 58690.000 -
444.namd 185348.000 -
445.gobmk 1378998.000 -
447.dealII 310444.000 -
450.soplex 205303.000 -
453.povray 656269.000 -
456.hmmer 108215.000 -
458.sjeng 103292.000 -
459.GemsFDTD 238904.000 -
462.libquantum 16085.000 -
464.h264ref 382104.000 -
465.tonto 1942866.000 -
470.lbm 9551.000 -
471.omnetpp 479794.000 -
473.astar 22880.000 -
482.sphinx3 112243.000 -
Geometric Mean 159727.164 -
sample variability
Name Current %
400.perlbench 36.000 2.86%
400.perlbench (avg) 36.000 2.86%
400.perlbench (avg) (percentage) 2.320 -
400.perlbench (max) 30.000 42.86%
400.perlbench (max) (percentage) 1.940 40.58%
400.perlbench (unexplained diff vs previous) 30.000 130.77%
400.perlbench (unexplained diff vs previous) (percentage) 1.910 127.38%
401.bzip2 57.000 -1.72%
401.bzip2 (avg) 57.000 -1.72%
401.bzip2 (avg) (percentage) 1.940 -1.02%
401.bzip2 (max) 66.000 -4.35%
401.bzip2 (max) (percentage) 2.230 -3.04%
401.bzip2 (unexplained diff vs previous) 21.000 40.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.700 40.00%
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) (percentage) 4.980 -1.78%
410.bwaves 70.000 -1.41%
410.bwaves (avg) 70.000 -1.41%
410.bwaves (avg) (percentage) 1.190 -1.65%
410.bwaves (max) 14.000 -48.15%
410.bwaves (max) (percentage) 0.250 -45.65%
410.bwaves (unexplained diff vs previous) 4.000 -77.78%
410.bwaves (unexplained diff vs previous) (percentage) 0.070 -76.67%
416.gamess 97.000 -3.96%
416.gamess (avg) 97.000 -3.96%
416.gamess (avg) (percentage) 0.800 -3.61%
416.gamess (max) 12.000 -
416.gamess (max) (percentage) 0.100 -
416.gamess (unexplained diff vs previous) 3.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.020 -
429.mcf 89.000 -2.20%
429.mcf (avg) 89.000 -2.20%
429.mcf (avg) (percentage) 6.420 -1.38%
429.mcf (max) 10.000 -92.91%
429.mcf (max) (percentage) 0.770 -92.33%
429.mcf (unexplained diff vs previous) 8.000 -38.46%
429.mcf (unexplained diff vs previous) (percentage) 0.570 -38.04%
433.milc 19.000 -
433.milc (avg) 19.000 -
433.milc (avg) (percentage) 1.660 -1.19%
433.milc (max) 23.000 -
433.milc (max) (percentage) 2.010 -2.90%
433.milc (unexplained diff vs previous) 7.000 75.00%
433.milc (unexplained diff vs previous) (percentage) 0.610 74.29%
434.zeusmp 34.000 -2.86%
434.zeusmp (avg) 34.000 -2.86%
434.zeusmp (avg) (percentage) 1.370 -1.44%
434.zeusmp (max) 18.000 -
434.zeusmp (max) (percentage) 0.720 -
434.zeusmp (unexplained diff vs previous) 14.000 366.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.560 366.67%
435.gromacs 143.000 -2.05%
435.gromacs (avg) 143.000 -2.05%
435.gromacs (avg) (percentage) 2.000 -
435.gromacs (max) 73.000 -
435.gromacs (max) (percentage) 1.020 -
435.gromacs (unexplained diff vs previous) 74.000 17.46%
435.gromacs (unexplained diff vs previous) (percentage) 1.030 18.39%
436.cactusADM 34.000 -
436.cactusADM (avg) 34.000 -
436.cactusADM (avg) (percentage) 1.610 -1.23%
436.cactusADM (max) 8.000 100.00%
436.cactusADM (max) (percentage) 0.380 80.95%
436.cactusADM (unexplained diff vs previous) 8.000 300.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.380 322.22%
437.leslie3d 583.000 6.78%
437.leslie3d (avg) 583.000 6.78%
437.leslie3d (avg) (percentage) 4.790 -
437.leslie3d (max) 762.000 15.45%
437.leslie3d (max) (percentage) 6.260 8.68%
437.leslie3d (unexplained diff vs previous) 717.000 14.90%
437.leslie3d (unexplained diff vs previous) (percentage) 5.890 8.07%
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.740 -1.14%
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 1.040 -10.34%
444.namd (unexplained diff vs previous) 2.000 -77.78%
444.namd (unexplained diff vs previous) (percentage) 0.260 -77.78%
445.gobmk 53.000 -1.85%
445.gobmk (avg) 53.000 -1.85%
445.gobmk (avg) (percentage) 1.080 -1.82%
445.gobmk (max) 40.000 -50.62%
445.gobmk (max) (percentage) 0.820 -50.00%
445.gobmk (unexplained diff vs previous) 3.000 -91.89%
445.gobmk (unexplained diff vs previous) (percentage) 0.060 -91.89%
447.dealII 24.000 -
447.dealII (avg) 24.000 -
447.dealII (avg) (percentage) 1.480 -
447.dealII (max) 19.000 -5.00%
447.dealII (max) (percentage) 1.180 -3.28%
447.dealII (unexplained diff vs previous) 15.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.900 -
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 2.820 -1.05%
450.soplex (max) 5.000 -
450.soplex (max) (percentage) 0.860 -4.44%
450.soplex (unexplained diff vs previous) 5.000 25.00%
450.soplex (unexplained diff vs previous) (percentage) 0.850 23.19%
453.povray 9.000 -
453.povray (avg) 9.000 -
453.povray (avg) (percentage) 1.790 -
453.povray (max) 11.000 22.22%
453.povray (max) (percentage) 2.170 31.52%
453.povray (unexplained diff vs previous) 12.000 33.33%
453.povray (unexplained diff vs previous) (percentage) 2.210 36.42%
454.calculix (avg) (percentage) 3.600 -
454.calculix (max) (percentage) 1.010 -1.94%
456.hmmer 23.000 -4.17%
456.hmmer (avg) 23.000 -4.17%
456.hmmer (avg) (percentage) 0.800 -1.23%
456.hmmer (max) 7.000 -12.50%
456.hmmer (max) (percentage) 0.250 -16.67%
456.hmmer (unexplained diff vs previous) 1.000 -88.89%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -90.00%
458.sjeng 58.000 -3.33%
458.sjeng (avg) 58.000 -3.33%
458.sjeng (avg) (percentage) 0.790 -2.47%
458.sjeng (max) 34.000 -50.00%
458.sjeng (max) (percentage) 0.460 -50.00%
458.sjeng (unexplained diff vs previous) 7.000 -81.58%
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -82.35%
459.GemsFDTD 85.000 -1.16%
459.GemsFDTD (avg) 85.000 -1.16%
459.GemsFDTD (avg) (percentage) 1.620 -1.22%
459.GemsFDTD (max) 30.000 66.67%
459.GemsFDTD (max) (percentage) 0.580 70.59%
459.GemsFDTD (unexplained diff vs previous) 31.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.590 -
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.810 -1.09%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.850 -7.50%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -
464.h264ref 61.000 -1.61%
464.h264ref (avg) 61.000 -1.61%
464.h264ref (avg) (percentage) 1.070 -
464.h264ref (max) 31.000 29.17%
464.h264ref (max) (percentage) 0.550 30.95%
464.h264ref (unexplained diff vs previous) 32.000 1500.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.560 1766.67%
465.tonto 177.000 -2.75%
465.tonto (avg) 177.000 -2.75%
465.tonto (avg) (percentage) 1.520 -1.30%
465.tonto (max) 258.000 -4.09%
465.tonto (max) (percentage) 2.210 -3.07%
465.tonto (unexplained diff vs previous) 112.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.960 -
470.lbm 48.000 -
470.lbm (avg) 48.000 -
470.lbm (avg) (percentage) 1.270 -1.55%
470.lbm (max) 17.000 -50.00%
470.lbm (max) (percentage) 0.450 -51.09%
470.lbm (unexplained diff vs previous) 5.000 -73.68%
470.lbm (unexplained diff vs previous) (percentage) 0.130 -74.00%
471.omnetpp 64.000 -1.54%
471.omnetpp (avg) 64.000 -1.54%
471.omnetpp (avg) (percentage) 2.370 -
471.omnetpp (max) 66.000 -5.71%
471.omnetpp (max) (percentage) 2.450 -3.16%
471.omnetpp (unexplained diff vs previous) 62.000 37.78%
471.omnetpp (unexplained diff vs previous) (percentage) 2.290 41.36%
473.astar 96.000 -2.04%
473.astar (avg) 96.000 -2.04%
473.astar (avg) (percentage) 1.870 -1.58%
473.astar (max) 18.000 -89.60%
473.astar (max) (percentage) 0.360 -89.32%
473.astar (unexplained diff vs previous) 12.000 -36.84%
473.astar (unexplained diff vs previous) (percentage) 0.230 -37.84%
481.wrf (avg) (percentage) 1.800 -
481.wrf (max) (percentage) 1.100 -1.79%
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.050 -
482.sphinx3 (max) 12.000 71.43%
482.sphinx3 (max) (percentage) 1.450 70.59%
482.sphinx3 (unexplained diff vs previous) 12.000 71.43%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.430 68.24%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.857 -3.09%