Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e5da53e26f4e3b14c542a0cb65828a3a9e574ca3 (+ 13 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fc649fe832dac20cc51816bf8b4234eb2d4f24e7 (+ 71 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d1dcb565a1fb5829f9476a1438c30eccc4027d04 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/150/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0150 (2-changed-components) 2023-11-10T15:42:23 0:00:00
Previous 0149 (3-changed-components) 2023-11-07T23:30:36 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 44 12
Performance Improvements 90 193
Added Tests 18 6
Unchanged Tests 1084 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench 2.20% 1546.000 1580.000 - -4.99% -
437.leslie3d 2.14% 10747.000 10977.000 - -5.70% -
429.mcf 2.00% 1398.000 1426.000 - 0.14% -
482.sphinx3 1.81% 938.000 955.000 - 1.06% -
453.povray 1.29% 544.000 551.000 - 0.73% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 833.33% 0.030 0.280 - -99.90% -
456.hmmer (unexplained diff vs previous) 700.00% 1.000 8.000 - -99.90% -
445.gobmk (unexplained diff vs previous) 385.71% 7.000 34.000 - -99.39% -
445.gobmk (unexplained diff vs previous) (percentage) 385.71% 0.140 0.680 - -99.39% -
400.perlbench (unexplained diff vs previous) 325.00% 8.000 34.000 - -99.61% -
400.perlbench (unexplained diff vs previous) (percentage) 313.46% 0.520 2.150 - -99.59% -
470.lbm (unexplained diff vs previous) 200.00% 1.000 3.000 - -99.97% -
470.lbm (unexplained diff vs previous) (percentage) 166.67% 0.030 0.080 - -99.97% -
473.astar (unexplained diff vs previous) (percentage) 113.89% 0.360 0.770 - -99.61% -
473.astar (unexplained diff vs previous) 110.53% 19.000 40.000 - -99.61% -
458.sjeng (unexplained diff vs previous) 83.33% 12.000 22.000 - -99.68% -
458.sjeng (unexplained diff vs previous) (percentage) 81.25% 0.160 0.290 - -99.68% -
436.cactusADM (unexplained diff vs previous) (percentage) 72.34% 0.470 0.810 - -99.90% -
436.cactusADM (unexplained diff vs previous) 70.00% 10.000 17.000 - -99.90% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 68.97% 0.290 0.490 - -99.80% -
459.GemsFDTD (unexplained diff vs previous) 66.67% 18.000 30.000 - -99.81% -
464.h264ref (unexplained diff vs previous) (percentage) 62.16% 0.370 0.600 - -99.49% -
464.h264ref (unexplained diff vs previous) 61.90% 21.000 34.000 - -99.50% -
429.mcf (max) 55.56% 18.000 28.000 - -97.88% -
429.mcf (max) (percentage) 49.25% 1.340 2.000 - -97.85% -
453.povray (unexplained diff vs previous) 40.00% 5.000 7.000 - -99.88% -
437.leslie3d (unexplained diff vs previous) 39.39% 165.000 230.000 - -90.06% -
453.povray (unexplained diff vs previous) (percentage) 38.04% 0.920 1.270 - -99.88% -
437.leslie3d (unexplained diff vs previous) (percentage) 36.36% 1.540 2.100 - -89.44% -
445.gobmk (max) (percentage) 34.00% 0.500 0.670 - -98.73% -
445.gobmk (max) 32.00% 25.000 33.000 - -98.75% -
464.h264ref (max) (percentage) 22.92% 0.480 0.590 - -98.91% -
464.h264ref (max) 22.22% 27.000 33.000 - -98.94% -
436.cactusADM (max) (percentage) 11.11% 0.720 0.800 - -99.10% -
436.cactusADM (max) 6.67% 15.000 16.000 - -99.13% -
435.gromacs (unexplained diff vs previous) (percentage) 6.40% 1.250 1.330 - -98.62% -
435.gromacs (unexplained diff vs previous) 5.49% 91.000 96.000 - -98.63% -
444.namd (max) (percentage) 5.49% 1.640 1.730 - -98.12% -
435.gromacs (max) (percentage) 4.76% 1.260 1.320 - -97.31% -
435.gromacs (max) 4.40% 91.000 95.000 - -97.34% -
482.sphinx3 4.35% 23.000 24.000 - -67.57% -
482.sphinx3 (avg) 4.35% 23.000 24.000 - -67.57% -
400.perlbench 2.44% 41.000 42.000 - -60.00% -
400.perlbench (avg) 2.44% 41.000 42.000 - -60.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -1.73% 752.000 739.000 - -1.07% -
403.gcc -1.56% 64.000 63.000 - 12.50% -
435.gromacs -1.32% 7297.000 7201.000 - -0.94% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -95.58% 2.260 0.100 - -99.97% -
401.bzip2 (unexplained diff vs previous) -95.52% 67.000 3.000 - -99.97% -
471.omnetpp (unexplained diff vs previous) (percentage) -95.11% 2.250 0.110 - -99.97% -
471.omnetpp (unexplained diff vs previous) -95.08% 61.000 3.000 - -99.97% -
410.bwaves (unexplained diff vs previous) (percentage) -89.13% 0.460 0.050 - -99.96% -
410.bwaves (unexplained diff vs previous) -88.46% 26.000 3.000 - -99.96% -
433.milc (max) -85.37% 41.000 6.000 - -99.43% -
433.milc (max) (percentage) -84.72% 3.600 0.550 - -99.39% -
433.milc (unexplained diff vs previous) (percentage) -72.13% 0.610 0.170 - -99.98% -
433.milc (unexplained diff vs previous) -71.43% 7.000 2.000 - -99.98% -
447.dealII (max) -28.12% 32.000 23.000 - -98.34% -
447.dealII (max) (percentage) -27.42% 1.860 1.350 - -98.32% -
401.bzip2 (max) -16.92% 65.000 54.000 - -97.67% -
401.bzip2 (max) (percentage) -16.74% 2.210 1.840 - -97.66% -
458.sjeng (max) -11.54% 26.000 23.000 - -99.36% -
459.GemsFDTD (max) -10.87% 46.000 41.000 - -99.07% -
459.GemsFDTD (max) (percentage) -10.67% 0.750 0.670 - -99.06% -
471.omnetpp (max) -10.17% 59.000 53.000 - -97.56% -
410.bwaves (max) -10.14% 69.000 62.000 - -98.11% -
454.calculix (max) (percentage) -10.01% 7.690 6.920 - -93.06% -
471.omnetpp (max) (percentage) -10.00% 2.200 1.980 - -97.51% -
453.povray (max) -10.00% 10.000 9.000 - -98.20% -
410.bwaves (max) (percentage) -9.84% 1.220 1.100 - -98.10% -
453.povray (max) (percentage) -8.72% 1.950 1.780 - -98.05% -
450.soplex (max) (percentage) -8.59% 4.190 3.830 - -96.02% -
458.sjeng (max) (percentage) -8.57% 0.350 0.320 - -99.33% -
450.soplex (max) -8.33% 24.000 22.000 - -95.96% -
456.hmmer (max) (percentage) -7.41% 0.540 0.500 - -99.32% -
456.hmmer (max) -6.67% 15.000 14.000 - -99.34% -
444.namd -5.88% 17.000 16.000 - -76.47% -
444.namd (avg) -5.88% 17.000 16.000 - -76.47% -
437.leslie3d (max) (percentage) -5.70% 10.880 10.260 - -38.12% -
473.astar (max) -5.43% 92.000 87.000 - -97.45% -
400.perlbench (max) (percentage) -4.75% 3.370 3.210 - -96.18% -
462.libquantum (max) (percentage) -4.59% 1.090 1.040 - -98.95% -
473.astar (max) (percentage) -4.52% 1.770 1.690 - -97.46% -
433.milc -4.35% 23.000 22.000 - -68.12% -
433.milc (avg) -4.35% 23.000 22.000 - -68.12% -
400.perlbench (max) -3.85% 52.000 50.000 - -96.42% -
437.leslie3d (max) -3.68% 1169.000 1126.000 - -41.63% -
416.gamess -3.65% 137.000 132.000 - -76.00% -
416.gamess (avg) -3.65% 137.000 132.000 - -76.00% -
416.gamess (avg) (percentage) -3.64% 1.100 1.060 - -76.02% -
456.hmmer -3.33% 30.000 29.000 - -77.17% -
456.hmmer (avg) -3.33% 30.000 29.000 - -77.17% -
454.calculix (avg) (percentage) -2.67% 4.120 4.010 - -50.00% -
458.sjeng -2.63% 76.000 74.000 - -69.29% -
458.sjeng (avg) -2.63% 76.000 74.000 - -69.29% -
410.bwaves -2.50% 80.000 78.000 - -68.67% -
410.bwaves (avg) -2.50% 80.000 78.000 - -68.67% -
436.cactusADM -2.50% 40.000 39.000 - -68.55% -
436.cactusADM (avg) -2.50% 40.000 39.000 - -68.55% -
403.gcc (max) (percentage) -2.48% 8.470 8.260 - -91.69% -
435.gromacs -2.44% 164.000 160.000 - -56.40% -
435.gromacs (avg) -2.44% 164.000 160.000 - -56.40% -
401.bzip2 (avg) (percentage) -2.44% 2.050 2.000 - -63.50% -
464.h264ref -2.38% 84.000 82.000 - -72.01% -
464.h264ref (avg) -2.38% 84.000 82.000 - -72.01% -
450.soplex (avg) (percentage) -2.21% 3.170 3.100 - -51.79% -
447.dealII (avg) (percentage) -2.13% 1.880 1.840 - -68.11% -
410.bwaves (avg) (percentage) -2.11% 1.420 1.390 - -68.48% -
458.sjeng (avg) (percentage) -1.96% 1.020 1.000 - -68.65% -
456.hmmer (avg) (percentage) -1.90% 1.050 1.030 - -76.64% -
462.libquantum (avg) (percentage) -1.89% 2.120 2.080 - -72.85% -
473.astar -1.82% 110.000 108.000 - -49.30% -
473.astar (avg) -1.82% 110.000 108.000 - -49.30% -
471.omnetpp (avg) (percentage) -1.81% 2.760 2.710 - -66.95% -
470.lbm (avg) (percentage) -1.80% 1.670 1.640 - -74.09% -
482.sphinx3 (max) (percentage) -1.68% 6.550 6.440 - -93.33% -
401.bzip2 -1.67% 60.000 59.000 - -63.35% -
401.bzip2 (avg) -1.67% 60.000 59.000 - -63.35% -
459.GemsFDTD (avg) (percentage) -1.64% 1.830 1.800 - -69.18% -
470.lbm -1.59% 63.000 62.000 - -74.06% -
470.lbm (avg) -1.59% 63.000 62.000 - -74.06% -
445.gobmk -1.52% 66.000 65.000 - -66.84% -
445.gobmk (avg) -1.52% 66.000 65.000 - -66.84% -
465.tonto (max) (percentage) -1.49% 2.690 2.650 - -86.28% -
433.milc (avg) (percentage) -1.47% 2.040 2.010 - -66.78% -
429.mcf (avg) (percentage) -1.44% 6.940 6.840 - -10.82% -
434.zeusmp (max) (percentage) -1.43% 0.700 0.690 - -99.16% -
473.astar (avg) (percentage) -1.41% 2.130 2.100 - -49.52% -
464.h264ref (avg) (percentage) -1.36% 1.470 1.450 - -71.51% -
471.omnetpp -1.35% 74.000 73.000 - -67.26% -
471.omnetpp (avg) -1.35% 74.000 73.000 - -67.26% -
437.leslie3d (avg) (percentage) -1.31% 5.330 5.260 - 72.46% -
465.tonto (avg) (percentage) -1.27% 1.580 1.560 - -53.29% -
436.cactusADM (avg) (percentage) -1.06% 1.890 1.870 - -68.73% -

Added Tests - sample variability
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.62% 893848.000 908307.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 12.50% 56.000 63.000 - -1.56% -
450.soplex 3.17% 567.000 585.000 - 0.00% -
465.tonto 2.30% 10941.000 11193.000 - 0.86% -
434.zeusmp 1.95% 2514.000 2563.000 - 0.63% -
447.dealII 1.10% 1724.000 1743.000 - 0.58% -
482.sphinx3 1.06% 945.000 955.000 - 1.81% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 72.46% 3.050 5.260 - -1.31% -
437.leslie3d 62.54% 355.000 577.000 - 0.87% -
437.leslie3d (avg) 62.54% 355.000 577.000 - 0.87% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.79% 152037.000 149315.000 - -0.01% -
464.h264ref -1.52% 387748.000 381840.000 - 0.00% -
459.GemsFDTD -1.27% 244728.000 241628.000 - 0.00% -
437.leslie3d -1.04% 59479.000 58862.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -5.70% 11640.000 10977.000 - 2.14% -
400.perlbench -4.99% 1663.000 1580.000 - 2.20% -
454.calculix -3.23% 62.000 60.000 - 0.00% -
458.sjeng -1.23% 7567.000 7474.000 - -0.29% -
444.namd -1.07% 747.000 739.000 - -1.73% -
464.h264ref -1.06% 5761.000 5700.000 - -0.59% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) (percentage) -99.98% 980.800 0.170 - -72.13% -
433.milc (unexplained diff vs previous) -99.98% 11289.000 2.000 - -71.43% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.97% 368.340 0.100 - -95.58% -
401.bzip2 (unexplained diff vs previous) -99.97% 10833.000 3.000 - -95.52% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.97% 391.300 0.110 - -95.11% -
471.omnetpp (unexplained diff vs previous) -99.97% 10659.000 3.000 - -95.08% -
470.lbm (unexplained diff vs previous) -99.97% 9990.000 3.000 - 200.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.97% 263.730 0.080 - 166.67% -
410.bwaves (unexplained diff vs previous) (percentage) -99.96% 137.900 0.050 - -89.13% -
410.bwaves (unexplained diff vs previous) -99.96% 7794.000 3.000 - -88.46% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.94% 2759.050 1.780 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.93% 26073.000 17.000 - 0.00% -
416.gamess (unexplained diff vs previous) -99.92% 7819.000 6.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.92% 62.730 0.050 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.90% 8030.000 8.000 - 700.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.90% 278.630 0.280 - 833.33% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.90% 787.130 0.810 - 72.34% -
436.cactusADM (unexplained diff vs previous) -99.90% 16396.000 17.000 - 70.00% -
453.povray (unexplained diff vs previous) (percentage) -99.88% 1043.330 1.270 - 38.04% -
453.povray (unexplained diff vs previous) -99.88% 5707.000 7.000 - 40.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.86% 407.020 0.570 - 0.00% -
447.dealII (unexplained diff vs previous) -99.86% 7017.000 10.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.85% 1305.690 1.960 - 0.00% -
429.mcf (unexplained diff vs previous) -99.85% 18593.000 28.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.84% 8356.000 13.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.84% 1118.610 1.760 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.81% 15458.000 30.000 - 66.67% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.80% 250.410 0.490 - 68.97% -
458.sjeng (unexplained diff vs previous) (percentage) -99.68% 90.870 0.290 - 81.25% -
458.sjeng (unexplained diff vs previous) -99.68% 6876.000 22.000 - 83.33% -
416.gamess (max) -99.67% 4805.000 16.000 - 0.00% -
416.gamess (max) (percentage) -99.66% 38.550 0.130 - 0.00% -
400.perlbench (unexplained diff vs previous) -99.61% 8772.000 34.000 - 325.00% -
473.astar (unexplained diff vs previous) (percentage) -99.61% 197.850 0.770 - 113.89% -
473.astar (unexplained diff vs previous) -99.61% 10146.000 40.000 - 110.53% -
400.perlbench (unexplained diff vs previous) (percentage) -99.59% 527.480 2.150 - 313.46% -
464.h264ref (unexplained diff vs previous) -99.50% 6843.000 34.000 - 61.90% -
464.h264ref (unexplained diff vs previous) (percentage) -99.49% 118.780 0.600 - 62.16% -
433.milc (max) -99.43% 1044.000 6.000 - -85.37% -
433.milc (max) (percentage) -99.39% 90.750 0.550 - -84.72% -
445.gobmk (unexplained diff vs previous) -99.39% 5581.000 34.000 - 385.71% -
445.gobmk (unexplained diff vs previous) (percentage) -99.39% 111.110 0.680 - 385.71% -
458.sjeng (max) -99.36% 3602.000 23.000 - -11.54% -
456.hmmer (max) -99.34% 2120.000 14.000 - -6.67% -
458.sjeng (max) (percentage) -99.33% 47.610 0.320 - -8.57% -
456.hmmer (max) (percentage) -99.32% 73.590 0.500 - -7.41% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
434.zeusmp (max) -99.17% 2055.000 17.000 - 0.00% -
434.zeusmp (max) (percentage) -99.16% 81.770 0.690 - -1.43% -
436.cactusADM (max) -99.13% 1848.000 16.000 - 6.67% -
436.cactusADM (max) (percentage) -99.10% 88.730 0.800 - 11.11% -
459.GemsFDTD (max) -99.07% 4411.000 41.000 - -10.87% -
459.GemsFDTD (max) (percentage) -99.06% 71.460 0.670 - -10.67% -
462.libquantum (max) (percentage) -98.95% 98.970 1.040 - -4.59% -
464.h264ref (max) -98.94% 3127.000 33.000 - 22.22% -
464.h264ref (max) (percentage) -98.91% 54.290 0.590 - 22.92% -
445.gobmk (max) -98.75% 2643.000 33.000 - 32.00% -
445.gobmk (max) (percentage) -98.73% 52.630 0.670 - 34.00% -
435.gromacs (unexplained diff vs previous) -98.63% 7028.000 96.000 - 5.49% -
435.gromacs (unexplained diff vs previous) (percentage) -98.62% 96.680 1.330 - 6.40% -
447.dealII (max) -98.34% 1384.000 23.000 - -28.12% -
447.dealII (max) (percentage) -98.32% 80.280 1.350 - -27.42% -
444.namd (max) -98.25% 685.000 12.000 - 0.00% -
453.povray (max) -98.20% 499.000 9.000 - -10.00% -
444.namd (max) (percentage) -98.12% 91.790 1.730 - 5.49% -
410.bwaves (max) -98.11% 3276.000 62.000 - -10.14% -
410.bwaves (max) (percentage) -98.10% 57.970 1.100 - -9.84% -
453.povray (max) (percentage) -98.05% 91.250 1.780 - -8.72% -
481.wrf (max) -98.00% 3801.000 76.000 - 0.00% -
481.wrf (max) (percentage) -97.99% 68.700 1.380 - 0.00% -
429.mcf (max) -97.88% 1322.000 28.000 - 55.56% -
429.mcf (max) (percentage) -97.85% 92.890 2.000 - 49.25% -
401.bzip2 (max) -97.67% 2313.000 54.000 - -16.92% -
401.bzip2 (max) (percentage) -97.66% 78.650 1.840 - -16.74% -
471.omnetpp (max) -97.56% 2169.000 53.000 - -10.17% -
471.omnetpp (max) (percentage) -97.51% 79.650 1.980 - -10.00% -
473.astar (max) (percentage) -97.46% 66.430 1.690 - -4.52% -
473.astar (max) -97.45% 3406.000 87.000 - -5.43% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
435.gromacs (max) -97.34% 3573.000 95.000 - 4.40% -
435.gromacs (max) (percentage) -97.31% 49.160 1.320 - 4.76% -
470.lbm (max) (percentage) -97.27% 72.510 1.980 - 0.00% -
470.lbm (max) -97.27% 2746.000 75.000 - 0.00% -
400.perlbench (max) -96.42% 1397.000 50.000 - -3.85% -
400.perlbench (max) (percentage) -96.18% 84.060 3.210 - -4.75% -
450.soplex (max) (percentage) -96.02% 96.240 3.830 - -8.59% -
450.soplex (max) -95.96% 545.000 22.000 - -8.33% -
465.tonto (unexplained diff vs previous) (percentage) -94.75% 16.190 0.850 - 0.00% -
465.tonto (unexplained diff vs previous) -94.64% 1771.000 95.000 - 0.00% -
454.calculix (max) -93.44% 61.000 4.000 - 0.00% -
482.sphinx3 (max) (percentage) -93.33% 96.500 6.440 - -1.68% -
482.sphinx3 (max) -93.30% 911.000 61.000 - 0.00% -
454.calculix (max) (percentage) -93.06% 99.730 6.920 - -10.01% -
403.gcc (max) (percentage) -91.69% 99.360 8.260 - -2.48% -
403.gcc (max) -90.91% 55.000 5.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -90.06% 2314.000 230.000 - 39.39% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.44% 19.880 2.100 - 36.36% -
465.tonto (max) (percentage) -86.28% 19.310 2.650 - -1.49% -
465.tonto (max) -85.98% 2112.000 296.000 - -0.67% -
462.libquantum -80.00% 10.000 2.000 - 0.00% -
462.libquantum (avg) -80.00% 10.000 2.000 - 0.00% -
456.hmmer -77.17% 127.000 29.000 - -3.33% -
456.hmmer (avg) -77.17% 127.000 29.000 - -3.33% -
456.hmmer (avg) (percentage) -76.64% 4.410 1.030 - -1.90% -
444.namd -76.47% 68.000 16.000 - -5.88% -
444.namd (avg) -76.47% 68.000 16.000 - -5.88% -
416.gamess (avg) (percentage) -76.02% 4.420 1.060 - -3.64% -
416.gamess -76.00% 550.000 132.000 - -3.65% -
416.gamess (avg) -76.00% 550.000 132.000 - -3.65% -
444.namd (avg) (percentage) -75.49% 9.220 2.260 - -0.44% -
470.lbm (avg) (percentage) -74.09% 6.330 1.640 - -1.80% -
470.lbm -74.06% 239.000 62.000 - -1.59% -
470.lbm (avg) -74.06% 239.000 62.000 - -1.59% -
453.povray -73.81% 42.000 11.000 - 0.00% -
453.povray (avg) -73.81% 42.000 11.000 - 0.00% -
462.libquantum (avg) (percentage) -72.85% 7.660 2.080 - -1.89% -
434.zeusmp (avg) (percentage) -72.48% 5.850 1.610 - 0.00% -
453.povray (avg) (percentage) -72.34% 7.810 2.160 - -0.92% -
434.zeusmp -72.11% 147.000 41.000 - 0.00% -
434.zeusmp (avg) -72.11% 147.000 41.000 - 0.00% -
464.h264ref -72.01% 293.000 82.000 - -2.38% -
464.h264ref (avg) -72.01% 293.000 82.000 - -2.38% -
464.h264ref (avg) (percentage) -71.51% 5.090 1.450 - -1.36% -
458.sjeng -69.29% 241.000 74.000 - -2.63% -
458.sjeng (avg) -69.29% 241.000 74.000 - -2.63% -
459.GemsFDTD (avg) (percentage) -69.18% 5.840 1.800 - -1.64% -
459.GemsFDTD -69.17% 360.000 111.000 - -0.89% -
459.GemsFDTD (avg) -69.17% 360.000 111.000 - -0.89% -
436.cactusADM (avg) (percentage) -68.73% 5.980 1.870 - -1.06% -
410.bwaves -68.67% 249.000 78.000 - -2.50% -
410.bwaves (avg) -68.67% 249.000 78.000 - -2.50% -
458.sjeng (avg) (percentage) -68.65% 3.190 1.000 - -1.96% -
436.cactusADM -68.55% 124.000 39.000 - -2.50% -
436.cactusADM (avg) -68.55% 124.000 39.000 - -2.50% -
410.bwaves (avg) (percentage) -68.48% 4.410 1.390 - -2.11% -
482.sphinx3 (avg) (percentage) -68.22% 7.930 2.520 - -0.79% -
433.milc -68.12% 69.000 22.000 - -4.35% -
433.milc (avg) -68.12% 69.000 22.000 - -4.35% -
447.dealII (avg) (percentage) -68.11% 5.770 1.840 - -2.13% -
481.wrf -67.83% 345.000 111.000 - 0.00% -
481.wrf (avg) -67.83% 345.000 111.000 - 0.00% -
481.wrf (avg) (percentage) -67.79% 6.240 2.010 - 0.00% -
447.dealII -67.68% 99.000 32.000 - 0.00% -
447.dealII (avg) -67.68% 99.000 32.000 - 0.00% -
482.sphinx3 -67.57% 74.000 24.000 - 4.35% -
482.sphinx3 (avg) -67.57% 74.000 24.000 - 4.35% -
471.omnetpp -67.26% 223.000 73.000 - -1.35% -
471.omnetpp (avg) -67.26% 223.000 73.000 - -1.35% -
471.omnetpp (avg) (percentage) -66.95% 8.200 2.710 - -1.81% -
445.gobmk -66.84% 196.000 65.000 - -1.52% -
445.gobmk (avg) -66.84% 196.000 65.000 - -1.52% -
433.milc (avg) (percentage) -66.78% 6.050 2.010 - -1.47% -
445.gobmk (avg) (percentage) -66.50% 3.910 1.310 - -0.76% -
401.bzip2 (avg) (percentage) -63.50% 5.480 2.000 - -2.44% -
401.bzip2 -63.35% 161.000 59.000 - -1.67% -
401.bzip2 (avg) -63.35% 161.000 59.000 - -1.67% -
400.perlbench -60.00% 105.000 42.000 - 2.44% -
400.perlbench (avg) -60.00% 105.000 42.000 - 2.44% -
400.perlbench (avg) (percentage) -57.80% 6.350 2.680 - -0.37% -
435.gromacs -56.40% 367.000 160.000 - -2.44% -
435.gromacs (avg) -56.40% 367.000 160.000 - -2.44% -
435.gromacs (avg) (percentage) -55.93% 5.060 2.230 - -0.89% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
465.tonto (avg) (percentage) -53.29% 3.340 1.560 - -1.27% -
465.tonto -52.33% 365.000 174.000 - -0.57% -
465.tonto (avg) -52.33% 365.000 174.000 - -0.57% -
450.soplex (avg) (percentage) -51.79% 6.430 3.100 - -2.21% -
450.soplex -50.00% 36.000 18.000 - 0.00% -
450.soplex (avg) -50.00% 36.000 18.000 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) (percentage) -50.00% 8.020 4.010 - -2.67% -
473.astar (avg) (percentage) -49.52% 4.160 2.100 - -1.41% -
473.astar -49.30% 213.000 108.000 - -1.82% -
473.astar (avg) -49.30% 213.000 108.000 - -1.82% -
437.leslie3d (max) -41.63% 1929.000 1126.000 - -3.68% -
437.leslie3d (max) (percentage) -38.12% 16.580 10.260 - -5.70% -
403.gcc (avg) (percentage) -32.38% 7.320 4.950 - 0.00% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
429.mcf -11.01% 109.000 97.000 - 0.00% -
429.mcf (avg) -11.01% 109.000 97.000 - 0.00% -
429.mcf (avg) (percentage) -10.82% 7.670 6.840 - -1.44% -

Added Tests - sample variability
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1580.000 2.20%
401.bzip2 2963.000 -
403.gcc 63.000 -1.56%
410.bwaves 5668.000 -
416.gamess 12479.000 -
429.mcf 1426.000 2.00%
433.milc 1143.000 -
434.zeusmp 2563.000 -
435.gromacs 7201.000 -1.32%
436.cactusADM 2100.000 -
437.leslie3d 10977.000 2.14%
444.namd 739.000 -1.73%
445.gobmk 5022.000 -
447.dealII 1743.000 -
450.soplex 585.000 -
453.povray 551.000 1.29%
454.calculix 60.000 -
456.hmmer 2903.000 -
458.sjeng 7474.000 -
459.GemsFDTD 6172.000 -
462.libquantum 139.000 -
464.h264ref 5700.000 -
465.tonto 11193.000 -
470.lbm 3823.000 -
471.omnetpp 2711.000 -
473.astar 5171.000 -
481.wrf 5533.000 -
482.sphinx3 955.000 1.81%
Geometric Mean 2059.336 -
Code Size (bytes)
Name Current %
400.perlbench 908307.000 -
401.bzip2 44031.000 -
403.gcc 2452575.000 -
410.bwaves 16604.000 -
416.gamess 5722065.000 -
429.mcf 9119.000 -
433.milc 61125.000 -
434.zeusmp 149315.000 -
435.gromacs 498325.000 -
436.cactusADM 350969.000 -
437.leslie3d 58862.000 -
444.namd 188096.000 -
445.gobmk 1378310.000 -
447.dealII 311358.000 -
450.soplex 204302.000 -
453.povray 657825.000 -
454.calculix 840362.000 -
456.hmmer 108287.000 -
458.sjeng 103652.000 -
459.GemsFDTD 241628.000 -
462.libquantum 16053.000 -
464.h264ref 381840.000 -
465.tonto 1948050.000 -
470.lbm 9707.000 -
471.omnetpp 480704.000 -
473.astar 22920.000 -
481.wrf 1953830.000 -
482.sphinx3 112775.000 -
Geometric Mean 205263.305 -
sample variability
Name Current %
400.perlbench 42.000 2.44%
400.perlbench (avg) 42.000 2.44%
400.perlbench (avg) (percentage) 2.680 -
400.perlbench (max) 50.000 -3.85%
400.perlbench (max) (percentage) 3.210 -4.75%
400.perlbench (unexplained diff vs previous) 34.000 325.00%
400.perlbench (unexplained diff vs previous) (percentage) 2.150 313.46%
401.bzip2 59.000 -1.67%
401.bzip2 (avg) 59.000 -1.67%
401.bzip2 (avg) (percentage) 2.000 -2.44%
401.bzip2 (max) 54.000 -16.92%
401.bzip2 (max) (percentage) 1.840 -16.74%
401.bzip2 (unexplained diff vs previous) 3.000 -95.52%
401.bzip2 (unexplained diff vs previous) (percentage) 0.100 -95.58%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 4.950 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 8.260 -2.48%
410.bwaves 78.000 -2.50%
410.bwaves (avg) 78.000 -2.50%
410.bwaves (avg) (percentage) 1.390 -2.11%
410.bwaves (max) 62.000 -10.14%
410.bwaves (max) (percentage) 1.100 -9.84%
410.bwaves (unexplained diff vs previous) 3.000 -88.46%
410.bwaves (unexplained diff vs previous) (percentage) 0.050 -89.13%
416.gamess 132.000 -3.65%
416.gamess (avg) 132.000 -3.65%
416.gamess (avg) (percentage) 1.060 -3.64%
416.gamess (max) 16.000 -
416.gamess (max) (percentage) 0.130 -
416.gamess (unexplained diff vs previous) 6.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.050 -
429.mcf 97.000 -
429.mcf (avg) 97.000 -
429.mcf (avg) (percentage) 6.840 -1.44%
429.mcf (max) 28.000 55.56%
429.mcf (max) (percentage) 2.000 49.25%
429.mcf (unexplained diff vs previous) 28.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.960 -
433.milc 22.000 -4.35%
433.milc (avg) 22.000 -4.35%
433.milc (avg) (percentage) 2.010 -1.47%
433.milc (max) 6.000 -85.37%
433.milc (max) (percentage) 0.550 -84.72%
433.milc (unexplained diff vs previous) 2.000 -71.43%
433.milc (unexplained diff vs previous) (percentage) 0.170 -72.13%
434.zeusmp 41.000 -
434.zeusmp (avg) 41.000 -
434.zeusmp (avg) (percentage) 1.610 -
434.zeusmp (max) 17.000 -
434.zeusmp (max) (percentage) 0.690 -1.43%
435.gromacs 160.000 -2.44%
435.gromacs (avg) 160.000 -2.44%
435.gromacs (avg) (percentage) 2.230 -
435.gromacs (max) 95.000 4.40%
435.gromacs (max) (percentage) 1.320 4.76%
435.gromacs (unexplained diff vs previous) 96.000 5.49%
435.gromacs (unexplained diff vs previous) (percentage) 1.330 6.40%
436.cactusADM 39.000 -2.50%
436.cactusADM (avg) 39.000 -2.50%
436.cactusADM (avg) (percentage) 1.870 -1.06%
436.cactusADM (max) 16.000 6.67%
436.cactusADM (max) (percentage) 0.800 11.11%
436.cactusADM (unexplained diff vs previous) 17.000 70.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.810 72.34%
437.leslie3d 577.000 -
437.leslie3d (avg) 577.000 -
437.leslie3d (avg) (percentage) 5.260 -1.31%
437.leslie3d (max) 1126.000 -3.68%
437.leslie3d (max) (percentage) 10.260 -5.70%
437.leslie3d (unexplained diff vs previous) 230.000 39.39%
437.leslie3d (unexplained diff vs previous) (percentage) 2.100 36.36%
444.namd 16.000 -5.88%
444.namd (avg) 16.000 -5.88%
444.namd (avg) (percentage) 2.260 -
444.namd (max) 12.000 -
444.namd (max) (percentage) 1.730 5.49%
444.namd (unexplained diff vs previous) 13.000 -
444.namd (unexplained diff vs previous) (percentage) 1.760 -
445.gobmk 65.000 -1.52%
445.gobmk (avg) 65.000 -1.52%
445.gobmk (avg) (percentage) 1.310 -
445.gobmk (max) 33.000 32.00%
445.gobmk (max) (percentage) 0.670 34.00%
445.gobmk (unexplained diff vs previous) 34.000 385.71%
445.gobmk (unexplained diff vs previous) (percentage) 0.680 385.71%
447.dealII 32.000 -
447.dealII (avg) 32.000 -
447.dealII (avg) (percentage) 1.840 -2.13%
447.dealII (max) 23.000 -28.12%
447.dealII (max) (percentage) 1.350 -27.42%
447.dealII (unexplained diff vs previous) 10.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.570 -
450.soplex 18.000 -
450.soplex (avg) 18.000 -
450.soplex (avg) (percentage) 3.100 -2.21%
450.soplex (max) 22.000 -8.33%
450.soplex (max) (percentage) 3.830 -8.59%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 11.000 -
453.povray (avg) 11.000 -
453.povray (avg) (percentage) 2.160 -
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 1.780 -8.72%
453.povray (unexplained diff vs previous) 7.000 40.00%
453.povray (unexplained diff vs previous) (percentage) 1.270 38.04%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.010 -2.67%
454.calculix (max) 4.000 -
454.calculix (max) (percentage) 6.920 -10.01%
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 29.000 -3.33%
456.hmmer (avg) 29.000 -3.33%
456.hmmer (avg) (percentage) 1.030 -1.90%
456.hmmer (max) 14.000 -6.67%
456.hmmer (max) (percentage) 0.500 -7.41%
456.hmmer (unexplained diff vs previous) 8.000 700.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.280 833.33%
458.sjeng 74.000 -2.63%
458.sjeng (avg) 74.000 -2.63%
458.sjeng (avg) (percentage) 1.000 -1.96%
458.sjeng (max) 23.000 -11.54%
458.sjeng (max) (percentage) 0.320 -8.57%
458.sjeng (unexplained diff vs previous) 22.000 83.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.290 81.25%
459.GemsFDTD 111.000 -
459.GemsFDTD (avg) 111.000 -
459.GemsFDTD (avg) (percentage) 1.800 -1.64%
459.GemsFDTD (max) 41.000 -10.87%
459.GemsFDTD (max) (percentage) 0.670 -10.67%
459.GemsFDTD (unexplained diff vs previous) 30.000 66.67%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.490 68.97%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 2.080 -1.89%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.040 -4.59%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 82.000 -2.38%
464.h264ref (avg) 82.000 -2.38%
464.h264ref (avg) (percentage) 1.450 -1.36%
464.h264ref (max) 33.000 22.22%
464.h264ref (max) (percentage) 0.590 22.92%
464.h264ref (unexplained diff vs previous) 34.000 61.90%
464.h264ref (unexplained diff vs previous) (percentage) 0.600 62.16%
465.tonto 174.000 -
465.tonto (avg) 174.000 -
465.tonto (avg) (percentage) 1.560 -1.27%
465.tonto (max) 296.000 -
465.tonto (max) (percentage) 2.650 -1.49%
465.tonto (unexplained diff vs previous) 95.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.850 -
470.lbm 62.000 -1.59%
470.lbm (avg) 62.000 -1.59%
470.lbm (avg) (percentage) 1.640 -1.80%
470.lbm (max) 75.000 -
470.lbm (max) (percentage) 1.980 -
470.lbm (unexplained diff vs previous) 3.000 200.00%
470.lbm (unexplained diff vs previous) (percentage) 0.080 166.67%
471.omnetpp 73.000 -1.35%
471.omnetpp (avg) 73.000 -1.35%
471.omnetpp (avg) (percentage) 2.710 -1.81%
471.omnetpp (max) 53.000 -10.17%
471.omnetpp (max) (percentage) 1.980 -10.00%
471.omnetpp (unexplained diff vs previous) 3.000 -95.08%
471.omnetpp (unexplained diff vs previous) (percentage) 0.110 -95.11%
473.astar 108.000 -1.82%
473.astar (avg) 108.000 -1.82%
473.astar (avg) (percentage) 2.100 -1.41%
473.astar (max) 87.000 -5.43%
473.astar (max) (percentage) 1.690 -4.52%
473.astar (unexplained diff vs previous) 40.000 110.53%
473.astar (unexplained diff vs previous) (percentage) 0.770 113.89%
481.wrf 111.000 -
481.wrf (avg) 111.000 -
481.wrf (avg) (percentage) 2.010 -
481.wrf (max) 76.000 -
481.wrf (max) (percentage) 1.380 -
482.sphinx3 24.000 4.35%
482.sphinx3 (avg) 24.000 4.35%
482.sphinx3 (avg) (percentage) 2.520 -
482.sphinx3 (max) 61.000 -
482.sphinx3 (max) (percentage) 6.440 -1.68%
482.sphinx3 (unexplained diff vs previous) 17.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.780 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 5.447 -35.19%