Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9326300e4d3dbe943380b30766ed474d98df07ba (+ 43 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/ad0bac803ce316bfa5330156a683cced5898cfce (+ 176 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=69239bd7a216007692470aa9d5f3658024638742 (+ 2 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=c476bbdaa3d7d176526c35c3353242443b07a27e (+ 158 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/135/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0135 (4-changed-components) 2023-10-09T01:04:54 0:00:00
Previous 0133 (4-changed-components) 2023-10-04T18:30:04 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 133 22
Performance Improvements 32 196
Added Tests 18 0
Unchanged Tests 1053 1018
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 8.73% 916.000 996.000 - 5.40% -
403.gcc 8.47% 59.000 64.000 - 14.29% -
433.milc 8.04% 1119.000 1209.000 - 5.04% -
450.soplex 8.01% 562.000 607.000 - 7.05% -
401.bzip2 4.56% 2874.000 3005.000 - 2.18% -
459.GemsFDTD 4.43% 5943.000 6206.000 - 0.53% -
473.astar 4.38% 4997.000 5216.000 - 1.72% -
465.tonto 4.37% 10668.000 11134.000 - 1.76% -
470.lbm 4.04% 3763.000 3915.000 - 3.35% -
471.omnetpp 3.57% 2687.000 2783.000 - 2.17% -
453.povray 3.33% 540.000 558.000 - 2.01% -
400.perlbench 3.32% 1535.000 1586.000 - -4.63% -
437.leslie3d 3.31% 10554.000 10903.000 - -6.33% -
454.calculix 3.17% 63.000 65.000 - 4.84% -
435.gromacs 3.16% 7065.000 7288.000 - 0.26% -
481.wrf 3.08% 5454.000 5622.000 - 1.59% -
447.dealII 2.38% 1682.000 1722.000 - -0.12% -
410.bwaves 2.31% 5532.000 5660.000 - 0.14% -
434.zeusmp 1.83% 2518.000 2564.000 - 1.99% -
445.gobmk 1.75% 4921.000 5007.000 - -0.32% -
444.namd 1.63% 735.000 747.000 - 0.00% -
462.libquantum 1.46% 137.000 139.000 - -0.71% -
458.sjeng 1.23% 7404.000 7495.000 - -0.95% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) 310.81% 37.000 152.000 - -98.48% -
470.lbm (unexplained diff vs previous) (percentage) 295.92% 0.980 3.880 - -98.53% -
453.povray (max) 260.00% 5.000 18.000 - -96.39% -
482.sphinx3 (max) 258.33% 24.000 86.000 - -90.56% -
482.sphinx3 (max) (percentage) 231.94% 2.630 8.730 - -90.95% -
453.povray (max) (percentage) 211.21% 1.070 3.330 - -96.35% -
433.milc (max) 193.94% 33.000 97.000 - -90.71% -
470.lbm (max) 182.14% 56.000 158.000 - -94.25% -
433.milc (max) (percentage) 172.54% 2.950 8.040 - -91.14% -
470.lbm (max) (percentage) 167.55% 1.510 4.040 - -94.43% -
433.milc (unexplained diff vs previous) 164.71% 34.000 90.000 - -99.20% -
433.milc (unexplained diff vs previous) (percentage) 144.74% 3.040 7.440 - -99.24% -
400.perlbench (max) 108.00% 25.000 52.000 - -96.28% -
436.cactusADM (unexplained diff vs previous) (percentage) 104.08% 0.980 2.000 - -99.75% -
436.cactusADM (unexplained diff vs previous) 100.00% 21.000 42.000 - -99.74% -
462.libquantum (max) 100.00% 1.000 2.000 - -98.55% -
400.perlbench (max) (percentage) 97.62% 1.680 3.320 - -96.05% -
459.GemsFDTD (max) 97.12% 139.000 274.000 - -93.79% -
459.GemsFDTD (max) (percentage) 88.51% 2.350 4.430 - -93.80% -
459.GemsFDTD (unexplained diff vs previous) 83.92% 143.000 263.000 - -98.30% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 75.93% 2.410 4.240 - -98.31% -
436.cactusADM (max) (percentage) 40.00% 1.400 1.960 - -97.79% -
436.cactusADM (max) 36.67% 30.000 41.000 - -97.78% -
444.namd (unexplained diff vs previous) 33.33% 9.000 12.000 - -99.86% -
444.namd (unexplained diff vs previous) (percentage) 31.97% 1.220 1.610 - -99.86% -
429.mcf (unexplained diff vs previous) (percentage) 28.01% 19.350 24.770 - -98.10% -
481.wrf (max) 26.28% 137.000 173.000 - -95.45% -
456.hmmer (unexplained diff vs previous) 25.00% 12.000 15.000 - -99.81% -
456.hmmer (max) (percentage) 24.39% 0.410 0.510 - -99.31% -
456.hmmer (unexplained diff vs previous) (percentage) 24.39% 0.410 0.510 - -99.82% -
434.zeusmp (max) 24.32% 37.000 46.000 - -97.76% -
450.soplex (max) 23.08% 39.000 48.000 - -91.19% -
434.zeusmp (max) (percentage) 22.82% 1.490 1.830 - -97.76% -
481.wrf (max) (percentage) 22.22% 2.520 3.080 - -95.52% -
434.zeusmp (unexplained diff vs previous) 21.05% 38.000 46.000 - -99.59% -
434.zeusmp (unexplained diff vs previous) (percentage) 18.54% 1.510 1.790 - -99.60% -
450.soplex (unexplained diff vs previous) 18.42% 38.000 45.000 - -99.69% -
401.bzip2 (max) 18.10% 116.000 137.000 - -94.08% -
456.hmmer (max) 16.67% 12.000 14.000 - -99.34% -
473.astar (max) 15.15% 198.000 228.000 - -93.31% -
447.dealII (max) 14.29% 35.000 40.000 - -97.11% -
410.bwaves (max) 14.04% 114.000 130.000 - -96.03% -
447.dealII (max) (percentage) 13.33% 2.100 2.380 - -97.04% -
433.milc 13.04% 23.000 26.000 - -62.32% -
433.milc (avg) 13.04% 23.000 26.000 - -62.32% -
482.sphinx3 13.04% 23.000 26.000 - -64.86% -
482.sphinx3 (avg) 13.04% 23.000 26.000 - -64.86% -
450.soplex (max) (percentage) 12.66% 7.110 8.010 - -91.68% -
401.bzip2 (max) (percentage) 12.59% 4.050 4.560 - -94.20% -
450.soplex 12.50% 16.000 18.000 - -50.00% -
450.soplex (avg) 12.50% 16.000 18.000 - -50.00% -
401.bzip2 (unexplained diff vs previous) 11.97% 117.000 131.000 - -98.79% -
410.bwaves (max) (percentage) 11.59% 2.070 2.310 - -96.02% -
447.dealII (unexplained diff vs previous) 11.11% 36.000 40.000 - -99.43% -
465.tonto 10.47% 172.000 190.000 - -47.95% -
465.tonto (avg) 10.47% 172.000 190.000 - -47.95% -
473.astar (max) (percentage) 10.33% 3.970 4.380 - -93.41% -
473.astar (unexplained diff vs previous) 10.05% 199.000 219.000 - -97.84% -
458.sjeng (unexplained diff vs previous) 9.64% 83.000 91.000 - -98.68% -
450.soplex (unexplained diff vs previous) (percentage) 9.62% 6.760 7.410 - -99.71% -
447.dealII (unexplained diff vs previous) (percentage) 8.41% 2.140 2.320 - -99.43% -
401.bzip2 8.33% 60.000 65.000 - -59.63% -
401.bzip2 (avg) 8.33% 60.000 65.000 - -59.63% -
453.povray 8.33% 12.000 13.000 - -69.05% -
453.povray (avg) 8.33% 12.000 13.000 - -69.05% -
465.tonto (max) 8.24% 449.000 486.000 - -76.99% -
458.sjeng (unexplained diff vs previous) (percentage) 8.04% 1.120 1.210 - -98.67% -
459.GemsFDTD 7.83% 115.000 124.000 - -65.56% -
459.GemsFDTD (avg) 7.83% 115.000 124.000 - -65.56% -
470.lbm 7.46% 67.000 72.000 - -69.87% -
470.lbm (avg) 7.46% 67.000 72.000 - -69.87% -
401.bzip2 (unexplained diff vs previous) (percentage) 7.13% 4.070 4.360 - -98.82% -
473.astar 6.31% 111.000 118.000 - -44.60% -
473.astar (avg) 6.31% 111.000 118.000 - -44.60% -
482.sphinx3 (avg) (percentage) 5.88% 2.550 2.700 - -65.95% -
433.milc (avg) (percentage) 5.80% 2.070 2.190 - -63.80% -
465.tonto (avg) (percentage) 5.56% 1.620 1.710 - -48.80% -
473.astar (unexplained diff vs previous) (percentage) 5.53% 3.980 4.200 - -97.88% -
471.omnetpp 5.00% 80.000 84.000 - -62.33% -
471.omnetpp (avg) 5.00% 80.000 84.000 - -62.33% -
481.wrf 4.96% 121.000 127.000 - -63.19% -
481.wrf (avg) 4.96% 121.000 127.000 - -63.19% -
435.gromacs 4.76% 168.000 176.000 - -52.04% -
435.gromacs (avg) 4.76% 168.000 176.000 - -52.04% -
450.soplex (avg) (percentage) 4.44% 2.930 3.060 - -52.41% -
429.mcf (avg) (percentage) 3.98% 6.780 7.050 - -8.08% -
465.tonto (max) (percentage) 3.80% 4.210 4.370 - -77.37% -
459.GemsFDTD (avg) (percentage) 3.08% 1.950 2.010 - -65.58% -
447.dealII 2.94% 34.000 35.000 - -64.65% -
447.dealII (avg) 2.94% 34.000 35.000 - -64.65% -
401.bzip2 (avg) (percentage) 2.84% 2.110 2.170 - -60.40% -
470.lbm (avg) (percentage) 2.79% 1.790 1.840 - -70.93% -
429.mcf (unexplained diff vs previous) 2.62% 343.000 352.000 - -98.11% -
400.perlbench 2.44% 41.000 42.000 - -60.00% -
400.perlbench (avg) 2.44% 41.000 42.000 - -60.00% -
437.leslie3d 2.43% 535.000 548.000 - 54.37% -
437.leslie3d (avg) 2.43% 535.000 548.000 - 54.37% -
410.bwaves 2.35% 85.000 87.000 - -65.06% -
410.bwaves (avg) 2.35% 85.000 87.000 - -65.06% -
434.zeusmp 2.27% 44.000 45.000 - -69.39% -
434.zeusmp (avg) 2.27% 44.000 45.000 - -69.39% -
473.astar (avg) (percentage) 1.79% 2.230 2.270 - -45.43% -
462.libquantum (max) (percentage) 1.39% 1.440 1.460 - -98.52% -
445.gobmk 1.37% 73.000 74.000 - -62.24% -
445.gobmk (avg) 1.37% 73.000 74.000 - -62.24% -
481.wrf (avg) (percentage) 1.35% 2.230 2.260 - -63.78% -
453.povray (avg) (percentage) 1.28% 2.350 2.380 - -69.53% -
435.gromacs (avg) (percentage) 1.26% 2.390 2.420 - -52.17% -
458.sjeng 1.18% 85.000 86.000 - -64.32% -
458.sjeng (avg) 1.18% 85.000 86.000 - -64.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -19.85% 1773.000 1421.000 - -0.21% -
436.cactusADM -1.96% 2143.000 2101.000 - 0.86% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) -66.17% 9.460 3.200 - -83.90% -
437.leslie3d (unexplained diff vs previous) -65.03% 998.000 349.000 - -84.92% -
464.h264ref (unexplained diff vs previous) (percentage) -51.87% 1.870 0.900 - -99.24% -
464.h264ref (unexplained diff vs previous) -51.43% 105.000 51.000 - -99.25% -
429.mcf (max) -33.65% 425.000 282.000 - -78.67% -
471.omnetpp (unexplained diff vs previous) (percentage) -18.63% 4.240 3.450 - -99.12% -
429.mcf (max) (percentage) -17.26% 23.990 19.850 - -78.63% -
429.mcf -16.67% 120.000 100.000 - -8.26% -
429.mcf (avg) -16.67% 120.000 100.000 - -8.26% -
471.omnetpp (unexplained diff vs previous) -15.79% 114.000 96.000 - -99.10% -
471.omnetpp (max) (percentage) -10.12% 4.250 3.820 - -95.20% -
445.gobmk (max) (percentage) -7.88% 2.410 2.220 - -95.78% -
471.omnetpp (max) -7.02% 114.000 106.000 - -95.11% -
445.gobmk (max) -5.93% 118.000 111.000 - -95.80% -
437.leslie3d (max) (percentage) -4.98% 8.640 8.210 - -50.48% -
464.h264ref (max) (percentage) -4.35% 1.840 1.760 - -96.76% -
435.gromacs (max) (percentage) -4.22% 3.320 3.180 - -93.53% -
458.sjeng (max) (percentage) -4.17% 1.440 1.380 - -97.10% -
444.namd (max) (percentage) -4.09% 1.710 1.640 - -98.21% -
454.calculix (max) (percentage) -3.89% 9.760 9.380 - -90.59% -
464.h264ref (max) -3.88% 103.000 99.000 - -96.83% -
458.sjeng (max) -2.83% 106.000 103.000 - -97.14% -
436.cactusADM -2.22% 45.000 44.000 - -64.52% -
436.cactusADM (avg) -2.22% 45.000 44.000 - -64.52% -
437.leslie3d (max) -1.76% 911.000 895.000 - -53.60% -
403.gcc (max) (percentage) -1.67% 3.590 3.530 - -96.45% -
456.hmmer (avg) (percentage) -1.64% 1.220 1.200 - -72.79% -
462.libquantum (unexplained diff vs previous) (percentage) -1.37% 1.460 1.440 - -99.99% -
435.gromacs (max) -1.28% 234.000 231.000 - -93.53% -
464.h264ref (avg) (percentage) -1.19% 1.680 1.660 - -67.39% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 7.51% 104048.000 111860.000 - 0.00% -
450.soplex 1.58% 205081.000 208330.000 - 0.00% -
400.perlbench 1.17% 893848.000 904307.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 14.29% 56.000 64.000 - 8.47% -
450.soplex 7.05% 567.000 607.000 - 8.01% -
482.sphinx3 5.40% 945.000 996.000 - 8.73% -
433.milc 5.04% 1151.000 1209.000 - 8.04% -
454.calculix 4.84% 62.000 65.000 - 3.17% -
470.lbm 3.35% 3788.000 3915.000 - 4.04% -
401.bzip2 2.18% 2941.000 3005.000 - 4.56% -
471.omnetpp 2.17% 2724.000 2783.000 - 3.57% -
453.povray 2.01% 547.000 558.000 - 3.33% -
434.zeusmp 1.99% 2514.000 2564.000 - 1.83% -
465.tonto 1.76% 10941.000 11134.000 - 4.37% -
473.astar 1.72% 5128.000 5216.000 - 4.38% -
456.hmmer 1.63% 2882.000 2929.000 - -0.51% -
481.wrf 1.59% 5534.000 5622.000 - 3.08% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 64.92% 3.050 5.030 - -0.79% -
437.leslie3d 54.37% 355.000 548.000 - 2.43% -
437.leslie3d (avg) 54.37% 355.000 548.000 - 2.43% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp -1.71% 152037.000 149435.000 - 0.00% -
464.h264ref -1.52% 387748.000 381848.000 - 0.00% -
459.GemsFDTD -1.46% 244728.000 241156.000 - 0.00% -
453.povray -1.15% 661389.000 653785.000 - 0.00% -
437.leslie3d -1.04% 59479.000 58862.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.33% 11640.000 10903.000 - 3.31% -
400.perlbench -4.63% 1663.000 1586.000 - 3.32% -
464.h264ref -1.70% 5761.000 5663.000 - 0.91% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -99.99% 37020.970 3.080 - 0.00% -
454.calculix (unexplained diff vs previous) -99.99% 22953.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.440 - -1.37% -
444.namd (unexplained diff vs previous) -99.86% 8356.000 12.000 - 33.33% -
444.namd (unexplained diff vs previous) (percentage) -99.86% 1118.610 1.610 - 31.97% -
456.hmmer (unexplained diff vs previous) (percentage) -99.82% 278.630 0.510 - 24.39% -
456.hmmer (unexplained diff vs previous) -99.81% 8030.000 15.000 - 25.00% -
416.gamess (max) (percentage) -99.77% 38.550 0.090 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.75% 787.130 2.000 - 104.08% -
436.cactusADM (unexplained diff vs previous) -99.74% 16396.000 42.000 - 100.00% -
450.soplex (unexplained diff vs previous) (percentage) -99.71% 2557.320 7.410 - 9.62% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.71% 2759.050 8.030 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.69% 26073.000 80.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.69% 1043.330 3.230 - 0.00% -
450.soplex (unexplained diff vs previous) -99.69% 14500.000 45.000 - 18.42% -
453.povray (unexplained diff vs previous) -99.68% 5707.000 18.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.60% 448.690 1.790 - 18.54% -
434.zeusmp (unexplained diff vs previous) -99.59% 11280.000 46.000 - 21.05% -
447.dealII (unexplained diff vs previous) (percentage) -99.43% 407.020 2.320 - 8.41% -
447.dealII (unexplained diff vs previous) -99.43% 7017.000 40.000 - 11.11% -
400.perlbench (unexplained diff vs previous) -99.42% 8772.000 51.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.39% 527.480 3.220 - 0.00% -
456.hmmer (max) -99.34% 2120.000 14.000 - 16.67% -
456.hmmer (max) (percentage) -99.31% 73.590 0.510 - 24.39% -
464.h264ref (unexplained diff vs previous) -99.25% 6843.000 51.000 - -51.43% -
464.h264ref (unexplained diff vs previous) (percentage) -99.24% 118.780 0.900 - -51.87% -
433.milc (unexplained diff vs previous) (percentage) -99.24% 980.800 7.440 - 144.74% -
433.milc (unexplained diff vs previous) -99.20% 11289.000 90.000 - 164.71% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.12% 391.300 3.450 - -18.63% -
471.omnetpp (unexplained diff vs previous) -99.10% 10659.000 96.000 - -15.79% -
401.bzip2 (unexplained diff vs previous) (percentage) -98.82% 368.340 4.360 - 7.13% -
401.bzip2 (unexplained diff vs previous) -98.79% 10833.000 131.000 - 11.97% -
458.sjeng (unexplained diff vs previous) -98.68% 6876.000 91.000 - 9.64% -
458.sjeng (unexplained diff vs previous) (percentage) -98.67% 90.870 1.210 - 8.04% -
481.wrf (unexplained diff vs previous) (percentage) -98.64% 219.530 2.990 - 0.00% -
481.wrf (unexplained diff vs previous) -98.62% 12149.000 168.000 - 0.00% -
462.libquantum (max) -98.55% 138.000 2.000 - 100.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.53% 263.730 3.880 - 295.92% -
462.libquantum (max) (percentage) -98.52% 98.970 1.460 - 1.39% -
470.lbm (unexplained diff vs previous) -98.48% 9990.000 152.000 - 310.81% -
445.gobmk (unexplained diff vs previous) -98.46% 5581.000 86.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -98.45% 111.110 1.720 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -98.36% 137.900 2.260 - 0.00% -
410.bwaves (unexplained diff vs previous) -98.36% 7794.000 128.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -98.31% 250.410 4.240 - 75.93% -
459.GemsFDTD (unexplained diff vs previous) -98.30% 15458.000 263.000 - 83.92% -
444.namd (max) -98.25% 685.000 12.000 - 0.00% -
444.namd (max) (percentage) -98.21% 91.790 1.640 - -4.09% -
429.mcf (unexplained diff vs previous) -98.11% 18593.000 352.000 - 2.62% -
429.mcf (unexplained diff vs previous) (percentage) -98.10% 1305.690 24.770 - 28.01% -
473.astar (unexplained diff vs previous) (percentage) -97.88% 197.850 4.200 - 5.53% -
473.astar (unexplained diff vs previous) -97.84% 10146.000 219.000 - 10.05% -
436.cactusADM (max) (percentage) -97.79% 88.730 1.960 - 40.00% -
436.cactusADM (max) -97.78% 1848.000 41.000 - 36.67% -
434.zeusmp (max) (percentage) -97.76% 81.770 1.830 - 22.82% -
434.zeusmp (max) -97.76% 2055.000 46.000 - 24.32% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
458.sjeng (max) -97.14% 3602.000 103.000 - -2.83% -
447.dealII (max) -97.11% 1384.000 40.000 - 14.29% -
458.sjeng (max) (percentage) -97.10% 47.610 1.380 - -4.17% -
447.dealII (max) (percentage) -97.04% 80.280 2.380 - 13.33% -
435.gromacs (unexplained diff vs previous) (percentage) -96.83% 96.680 3.060 - 0.00% -
464.h264ref (max) -96.83% 3127.000 99.000 - -3.88% -
435.gromacs (unexplained diff vs previous) -96.83% 7028.000 223.000 - 0.00% -
464.h264ref (max) (percentage) -96.76% 54.290 1.760 - -4.35% -
403.gcc (max) (percentage) -96.45% 99.360 3.530 - -1.67% -
453.povray (max) -96.39% 499.000 18.000 - 260.00% -
403.gcc (max) -96.36% 55.000 2.000 - 0.00% -
453.povray (max) (percentage) -96.35% 91.250 3.330 - 211.21% -
400.perlbench (max) -96.28% 1397.000 52.000 - 108.00% -
400.perlbench (max) (percentage) -96.05% 84.060 3.320 - 97.62% -
410.bwaves (max) -96.03% 3276.000 130.000 - 14.04% -
410.bwaves (max) (percentage) -96.02% 57.970 2.310 - 11.59% -
445.gobmk (max) -95.80% 2643.000 111.000 - -5.93% -
445.gobmk (max) (percentage) -95.78% 52.630 2.220 - -7.88% -
481.wrf (max) (percentage) -95.52% 68.700 3.080 - 22.22% -
481.wrf (max) -95.45% 3801.000 173.000 - 26.28% -
471.omnetpp (max) (percentage) -95.20% 79.650 3.820 - -10.12% -
471.omnetpp (max) -95.11% 2169.000 106.000 - -7.02% -
470.lbm (max) (percentage) -94.43% 72.510 4.040 - 167.55% -
470.lbm (max) -94.25% 2746.000 158.000 - 182.14% -
401.bzip2 (max) (percentage) -94.20% 78.650 4.560 - 12.59% -
401.bzip2 (max) -94.08% 2313.000 137.000 - 18.10% -
459.GemsFDTD (max) (percentage) -93.80% 71.460 4.430 - 88.51% -
459.GemsFDTD (max) -93.79% 4411.000 274.000 - 97.12% -
435.gromacs (max) -93.53% 3573.000 231.000 - -1.28% -
435.gromacs (max) (percentage) -93.53% 49.160 3.180 - -4.22% -
473.astar (max) (percentage) -93.41% 66.430 4.380 - 10.33% -
473.astar (max) -93.31% 3406.000 228.000 - 15.15% -
450.soplex (max) (percentage) -91.68% 96.240 8.010 - 12.66% -
450.soplex (max) -91.19% 545.000 48.000 - 23.08% -
433.milc (max) (percentage) -91.14% 90.750 8.040 - 172.54% -
482.sphinx3 (max) (percentage) -90.95% 96.500 8.730 - 231.94% -
433.milc (max) -90.71% 1044.000 97.000 - 193.94% -
454.calculix (max) (percentage) -90.59% 99.730 9.380 - -3.89% -
482.sphinx3 (max) -90.56% 911.000 86.000 - 258.33% -
454.calculix (max) -90.16% 61.000 6.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) -84.92% 2314.000 349.000 - -65.03% -
437.leslie3d (unexplained diff vs previous) (percentage) -83.90% 19.880 3.200 - -66.17% -
429.mcf (max) -78.67% 1322.000 282.000 - -33.65% -
429.mcf (max) (percentage) -78.63% 92.890 19.850 - -17.26% -
465.tonto (max) (percentage) -77.37% 19.310 4.370 - 3.80% -
465.tonto (max) -76.99% 2112.000 486.000 - 8.24% -
444.namd -75.00% 68.000 17.000 - 0.00% -
444.namd (avg) -75.00% 68.000 17.000 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -74.12% 16.190 4.190 - 0.00% -
444.namd (avg) (percentage) -73.97% 9.220 2.400 - -0.83% -
465.tonto (unexplained diff vs previous) -73.69% 1771.000 466.000 - 0.00% -
456.hmmer (avg) (percentage) -72.79% 4.410 1.200 - -1.64% -
456.hmmer -72.44% 127.000 35.000 - 0.00% -
456.hmmer (avg) -72.44% 127.000 35.000 - 0.00% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
470.lbm (avg) (percentage) -70.93% 6.330 1.840 - 2.79% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
470.lbm -69.87% 239.000 72.000 - 7.46% -
470.lbm (avg) -69.87% 239.000 72.000 - 7.46% -
434.zeusmp (avg) (percentage) -69.74% 5.850 1.770 - 0.00% -
453.povray (avg) (percentage) -69.53% 7.810 2.380 - 1.28% -
434.zeusmp -69.39% 147.000 45.000 - 2.27% -
434.zeusmp (avg) -69.39% 147.000 45.000 - 2.27% -
462.libquantum (avg) (percentage) -69.06% 7.660 2.370 - -0.84% -
453.povray -69.05% 42.000 13.000 - 8.33% -
453.povray (avg) -69.05% 42.000 13.000 - 8.33% -
464.h264ref -67.92% 293.000 94.000 - 0.00% -
464.h264ref (avg) -67.92% 293.000 94.000 - 0.00% -
464.h264ref (avg) (percentage) -67.39% 5.090 1.660 - -1.19% -
482.sphinx3 (avg) (percentage) -65.95% 7.930 2.700 - 5.88% -
459.GemsFDTD (avg) (percentage) -65.58% 5.840 2.010 - 3.08% -
459.GemsFDTD -65.56% 360.000 124.000 - 7.83% -
459.GemsFDTD (avg) -65.56% 360.000 124.000 - 7.83% -
410.bwaves -65.06% 249.000 87.000 - 2.35% -
410.bwaves (avg) -65.06% 249.000 87.000 - 2.35% -
482.sphinx3 -64.86% 74.000 26.000 - 13.04% -
482.sphinx3 (avg) -64.86% 74.000 26.000 - 13.04% -
410.bwaves (avg) (percentage) -64.85% 4.410 1.550 - 0.65% -
447.dealII -64.65% 99.000 35.000 - 2.94% -
447.dealII (avg) -64.65% 99.000 35.000 - 2.94% -
447.dealII (avg) (percentage) -64.64% 5.770 2.040 - 0.49% -
436.cactusADM (avg) (percentage) -64.55% 5.980 2.120 - 0.00% -
436.cactusADM -64.52% 124.000 44.000 - -2.22% -
436.cactusADM (avg) -64.52% 124.000 44.000 - -2.22% -
458.sjeng -64.32% 241.000 86.000 - 1.18% -
458.sjeng (avg) -64.32% 241.000 86.000 - 1.18% -
458.sjeng (avg) (percentage) -63.95% 3.190 1.150 - 0.00% -
433.milc (avg) (percentage) -63.80% 6.050 2.190 - 5.80% -
481.wrf (avg) (percentage) -63.78% 6.240 2.260 - 1.35% -
481.wrf -63.19% 345.000 127.000 - 4.96% -
481.wrf (avg) -63.19% 345.000 127.000 - 4.96% -
471.omnetpp (avg) (percentage) -63.17% 8.200 3.020 - 0.33% -
471.omnetpp -62.33% 223.000 84.000 - 5.00% -
471.omnetpp (avg) -62.33% 223.000 84.000 - 5.00% -
433.milc -62.32% 69.000 26.000 - 13.04% -
433.milc (avg) -62.32% 69.000 26.000 - 13.04% -
445.gobmk -62.24% 196.000 74.000 - 1.37% -
445.gobmk (avg) -62.24% 196.000 74.000 - 1.37% -
445.gobmk (avg) (percentage) -61.89% 3.910 1.490 - 0.00% -
401.bzip2 (avg) (percentage) -60.40% 5.480 2.170 - 2.84% -
400.perlbench -60.00% 105.000 42.000 - 2.44% -
400.perlbench (avg) -60.00% 105.000 42.000 - 2.44% -
401.bzip2 -59.63% 161.000 65.000 - 8.33% -
401.bzip2 (avg) -59.63% 161.000 65.000 - 8.33% -
400.perlbench (avg) (percentage) -57.48% 6.350 2.700 - 0.75% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
437.leslie3d (max) -53.60% 1929.000 895.000 - -1.76% -
450.soplex (avg) (percentage) -52.41% 6.430 3.060 - 4.44% -
435.gromacs (avg) (percentage) -52.17% 5.060 2.420 - 1.26% -
435.gromacs -52.04% 367.000 176.000 - 4.76% -
435.gromacs (avg) -52.04% 367.000 176.000 - 4.76% -
437.leslie3d (max) (percentage) -50.48% 16.580 8.210 - -4.98% -
450.soplex -50.00% 36.000 18.000 - 12.50% -
450.soplex (avg) -50.00% 36.000 18.000 - 12.50% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
465.tonto (avg) (percentage) -48.80% 3.340 1.710 - 5.56% -
465.tonto -47.95% 365.000 190.000 - 10.47% -
465.tonto (avg) -47.95% 365.000 190.000 - 10.47% -
454.calculix (avg) (percentage) -47.13% 8.020 4.240 - -0.93% -
473.astar (avg) (percentage) -45.43% 4.160 2.270 - 1.79% -
473.astar -44.60% 213.000 118.000 - 6.31% -
473.astar (avg) -44.60% 213.000 118.000 - 6.31% -
403.gcc (avg) (percentage) -30.19% 7.320 5.110 - 0.00% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
429.mcf -8.26% 109.000 100.000 - -16.67% -
429.mcf (avg) -8.26% 109.000 100.000 - -16.67% -
429.mcf (avg) (percentage) -8.08% 7.670 7.050 - 3.98% -

Report Time: 0.50s
Execution (seconds)
Name Current %
400.perlbench 1586.000 3.32%
401.bzip2 3005.000 4.56%
403.gcc 64.000 8.47%
410.bwaves 5660.000 2.31%
429.mcf 1421.000 -19.85%
433.milc 1209.000 8.04%
434.zeusmp 2564.000 1.83%
435.gromacs 7288.000 3.16%
436.cactusADM 2101.000 -1.96%
437.leslie3d 10903.000 3.31%
444.namd 747.000 1.63%
445.gobmk 5007.000 1.75%
447.dealII 1722.000 2.38%
450.soplex 607.000 8.01%
453.povray 558.000 3.33%
454.calculix 65.000 3.17%
456.hmmer 2929.000 -
458.sjeng 7495.000 1.23%
459.GemsFDTD 6206.000 4.43%
462.libquantum 139.000 1.46%
464.h264ref 5663.000 -
465.tonto 11134.000 4.37%
470.lbm 3915.000 4.04%
471.omnetpp 2783.000 3.57%
473.astar 5216.000 4.38%
481.wrf 5622.000 3.08%
482.sphinx3 996.000 8.73%
Geometric Mean 1950.690 2.42%
Code Size (bytes)
Name Current %
400.perlbench 904307.000 -
401.bzip2 44043.000 -
403.gcc 2444263.000 -
410.bwaves 16604.000 -
429.mcf 9119.000 -
433.milc 61117.000 -
434.zeusmp 149435.000 -
435.gromacs 498229.000 -
436.cactusADM 351077.000 -
437.leslie3d 58862.000 -
444.namd 188128.000 -
445.gobmk 1378278.000 -
447.dealII 311030.000 -
450.soplex 208330.000 -
453.povray 653785.000 -
454.calculix 840090.000 -
456.hmmer 108307.000 -
458.sjeng 111860.000 -
459.GemsFDTD 241156.000 -
462.libquantum 16125.000 -
464.h264ref 381848.000 -
465.tonto 1936314.000 -
470.lbm 9707.000 -
471.omnetpp 480712.000 -
473.astar 22920.000 -
481.wrf 1944946.000 -
482.sphinx3 112755.000 -
Geometric Mean 181956.274 -
sample variability
Name Current %
400.perlbench 42.000 2.44%
400.perlbench (avg) 42.000 2.44%
400.perlbench (avg) (percentage) 2.700 -
400.perlbench (max) 52.000 108.00%
400.perlbench (max) (percentage) 3.320 97.62%
400.perlbench (unexplained diff vs previous) 51.000 -
400.perlbench (unexplained diff vs previous) (percentage) 3.220 -
401.bzip2 65.000 8.33%
401.bzip2 (avg) 65.000 8.33%
401.bzip2 (avg) (percentage) 2.170 2.84%
401.bzip2 (max) 137.000 18.10%
401.bzip2 (max) (percentage) 4.560 12.59%
401.bzip2 (unexplained diff vs previous) 131.000 11.97%
401.bzip2 (unexplained diff vs previous) (percentage) 4.360 7.13%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.110 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.530 -1.67%
410.bwaves 87.000 2.35%
410.bwaves (avg) 87.000 2.35%
410.bwaves (avg) (percentage) 1.550 -
410.bwaves (max) 130.000 14.04%
410.bwaves (max) (percentage) 2.310 11.59%
410.bwaves (unexplained diff vs previous) 128.000 -
410.bwaves (unexplained diff vs previous) (percentage) 2.260 -
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.090 -
429.mcf 100.000 -16.67%
429.mcf (avg) 100.000 -16.67%
429.mcf (avg) (percentage) 7.050 3.98%
429.mcf (max) 282.000 -33.65%
429.mcf (max) (percentage) 19.850 -17.26%
429.mcf (unexplained diff vs previous) 352.000 2.62%
429.mcf (unexplained diff vs previous) (percentage) 24.770 28.01%
433.milc 26.000 13.04%
433.milc (avg) 26.000 13.04%
433.milc (avg) (percentage) 2.190 5.80%
433.milc (max) 97.000 193.94%
433.milc (max) (percentage) 8.040 172.54%
433.milc (unexplained diff vs previous) 90.000 164.71%
433.milc (unexplained diff vs previous) (percentage) 7.440 144.74%
434.zeusmp 45.000 2.27%
434.zeusmp (avg) 45.000 2.27%
434.zeusmp (avg) (percentage) 1.770 -
434.zeusmp (max) 46.000 24.32%
434.zeusmp (max) (percentage) 1.830 22.82%
434.zeusmp (unexplained diff vs previous) 46.000 21.05%
434.zeusmp (unexplained diff vs previous) (percentage) 1.790 18.54%
435.gromacs 176.000 4.76%
435.gromacs (avg) 176.000 4.76%
435.gromacs (avg) (percentage) 2.420 1.26%
435.gromacs (max) 231.000 -1.28%
435.gromacs (max) (percentage) 3.180 -4.22%
435.gromacs (unexplained diff vs previous) 223.000 -
435.gromacs (unexplained diff vs previous) (percentage) 3.060 -
436.cactusADM 44.000 -2.22%
436.cactusADM (avg) 44.000 -2.22%
436.cactusADM (avg) (percentage) 2.120 -
436.cactusADM (max) 41.000 36.67%
436.cactusADM (max) (percentage) 1.960 40.00%
436.cactusADM (unexplained diff vs previous) 42.000 100.00%
436.cactusADM (unexplained diff vs previous) (percentage) 2.000 104.08%
437.leslie3d 548.000 2.43%
437.leslie3d (avg) 548.000 2.43%
437.leslie3d (avg) (percentage) 5.030 -
437.leslie3d (max) 895.000 -1.76%
437.leslie3d (max) (percentage) 8.210 -4.98%
437.leslie3d (unexplained diff vs previous) 349.000 -65.03%
437.leslie3d (unexplained diff vs previous) (percentage) 3.200 -66.17%
444.namd 17.000 -
444.namd (avg) 17.000 -
444.namd (avg) (percentage) 2.400 -
444.namd (max) 12.000 -
444.namd (max) (percentage) 1.640 -4.09%
444.namd (unexplained diff vs previous) 12.000 33.33%
444.namd (unexplained diff vs previous) (percentage) 1.610 31.97%
445.gobmk 74.000 1.37%
445.gobmk (avg) 74.000 1.37%
445.gobmk (avg) (percentage) 1.490 -
445.gobmk (max) 111.000 -5.93%
445.gobmk (max) (percentage) 2.220 -7.88%
445.gobmk (unexplained diff vs previous) 86.000 -
445.gobmk (unexplained diff vs previous) (percentage) 1.720 -
447.dealII 35.000 2.94%
447.dealII (avg) 35.000 2.94%
447.dealII (avg) (percentage) 2.040 -
447.dealII (max) 40.000 14.29%
447.dealII (max) (percentage) 2.380 13.33%
447.dealII (unexplained diff vs previous) 40.000 11.11%
447.dealII (unexplained diff vs previous) (percentage) 2.320 8.41%
450.soplex 18.000 12.50%
450.soplex (avg) 18.000 12.50%
450.soplex (avg) (percentage) 3.060 4.44%
450.soplex (max) 48.000 23.08%
450.soplex (max) (percentage) 8.010 12.66%
450.soplex (unexplained diff vs previous) 45.000 18.42%
450.soplex (unexplained diff vs previous) (percentage) 7.410 9.62%
453.povray 13.000 8.33%
453.povray (avg) 13.000 8.33%
453.povray (avg) (percentage) 2.380 1.28%
453.povray (max) 18.000 260.00%
453.povray (max) (percentage) 3.330 211.21%
453.povray (unexplained diff vs previous) 18.000 -
453.povray (unexplained diff vs previous) (percentage) 3.230 -
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.240 -
454.calculix (max) 6.000 -
454.calculix (max) (percentage) 9.380 -3.89%
454.calculix (unexplained diff vs previous) 2.000 -
454.calculix (unexplained diff vs previous) (percentage) 3.080 -
456.hmmer 35.000 -
456.hmmer (avg) 35.000 -
456.hmmer (avg) (percentage) 1.200 -1.64%
456.hmmer (max) 14.000 16.67%
456.hmmer (max) (percentage) 0.510 24.39%
456.hmmer (unexplained diff vs previous) 15.000 25.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.510 24.39%
458.sjeng 86.000 1.18%
458.sjeng (avg) 86.000 1.18%
458.sjeng (avg) (percentage) 1.150 -
458.sjeng (max) 103.000 -2.83%
458.sjeng (max) (percentage) 1.380 -4.17%
458.sjeng (unexplained diff vs previous) 91.000 9.64%
458.sjeng (unexplained diff vs previous) (percentage) 1.210 8.04%
459.GemsFDTD 124.000 7.83%
459.GemsFDTD (avg) 124.000 7.83%
459.GemsFDTD (avg) (percentage) 2.010 3.08%
459.GemsFDTD (max) 274.000 97.12%
459.GemsFDTD (max) (percentage) 4.430 88.51%
459.GemsFDTD (unexplained diff vs previous) 263.000 83.92%
459.GemsFDTD (unexplained diff vs previous) (percentage) 4.240 75.93%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.370 -
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 1.460 1.39%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.440 -1.37%
464.h264ref 94.000 -
464.h264ref (avg) 94.000 -
464.h264ref (avg) (percentage) 1.660 -1.19%
464.h264ref (max) 99.000 -3.88%
464.h264ref (max) (percentage) 1.760 -4.35%
464.h264ref (unexplained diff vs previous) 51.000 -51.43%
464.h264ref (unexplained diff vs previous) (percentage) 0.900 -51.87%
465.tonto 190.000 10.47%
465.tonto (avg) 190.000 10.47%
465.tonto (avg) (percentage) 1.710 5.56%
465.tonto (max) 486.000 8.24%
465.tonto (max) (percentage) 4.370 3.80%
465.tonto (unexplained diff vs previous) 466.000 -
465.tonto (unexplained diff vs previous) (percentage) 4.190 -
470.lbm 72.000 7.46%
470.lbm (avg) 72.000 7.46%
470.lbm (avg) (percentage) 1.840 2.79%
470.lbm (max) 158.000 182.14%
470.lbm (max) (percentage) 4.040 167.55%
470.lbm (unexplained diff vs previous) 152.000 310.81%
470.lbm (unexplained diff vs previous) (percentage) 3.880 295.92%
471.omnetpp 84.000 5.00%
471.omnetpp (avg) 84.000 5.00%
471.omnetpp (avg) (percentage) 3.020 -
471.omnetpp (max) 106.000 -7.02%
471.omnetpp (max) (percentage) 3.820 -10.12%
471.omnetpp (unexplained diff vs previous) 96.000 -15.79%
471.omnetpp (unexplained diff vs previous) (percentage) 3.450 -18.63%
473.astar 118.000 6.31%
473.astar (avg) 118.000 6.31%
473.astar (avg) (percentage) 2.270 1.79%
473.astar (max) 228.000 15.15%
473.astar (max) (percentage) 4.380 10.33%
473.astar (unexplained diff vs previous) 219.000 10.05%
473.astar (unexplained diff vs previous) (percentage) 4.200 5.53%
481.wrf 127.000 4.96%
481.wrf (avg) 127.000 4.96%
481.wrf (avg) (percentage) 2.260 1.35%
481.wrf (max) 173.000 26.28%
481.wrf (max) (percentage) 3.080 22.22%
481.wrf (unexplained diff vs previous) 168.000 -
481.wrf (unexplained diff vs previous) (percentage) 2.990 -
482.sphinx3 26.000 13.04%
482.sphinx3 (avg) 26.000 13.04%
482.sphinx3 (avg) (percentage) 2.700 5.88%
482.sphinx3 (max) 86.000 258.33%
482.sphinx3 (max) (percentage) 8.730 231.94%
482.sphinx3 (unexplained diff vs previous) 80.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 8.030 -
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 14.516 14.08%