Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a88ee931eee4ba7339c481735b9405f66161e2f6 (+ 45 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/cbddd574a78529b9176eb28253c20a335daefbb4 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0aa5b28a504c6f1f17b387d8147715d1496fff62 (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4b69fbd471e9b8cad99b37c284710edefbf25ee9 (+ 137 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/36/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0036 (3-changed-components) 2023-04-19T01:54:51 0:00:00
Previous 0034 (3-changed-components) 2023-04-15T21:59:35 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 32 12
Performance Improvements 124 201
Added Tests 34 0
Unchanged Tests 1046 1023
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix 8.20% 61.000 66.000 - 6.45% -
450.soplex 3.12% 576.000 594.000 - 4.76% -
437.leslie3d 1.55% 10590.000 10754.000 - -7.61% -
482.sphinx3 1.48% 944.000 958.000 - 1.38% -
447.dealII 1.28% 1714.000 1736.000 - 0.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) 1300.00% 1.000 14.000 - -99.95% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1227.27% 0.110 1.460 - -99.95% -
429.mcf (max) 800.00% 5.000 45.000 - -96.60% -
429.mcf (max) (percentage) 723.08% 0.390 3.210 - -96.54% -
454.calculix (max) (percentage) 525.95% 1.310 8.200 - -91.78% -
456.hmmer (max) 228.57% 7.000 23.000 - -98.92% -
456.hmmer (max) (percentage) 215.38% 0.260 0.820 - -98.89% -
410.bwaves (unexplained diff vs previous) 180.00% 10.000 28.000 - -99.64% -
410.bwaves (unexplained diff vs previous) (percentage) 177.78% 0.180 0.500 - -99.64% -
401.bzip2 (unexplained diff vs previous) 133.33% 9.000 21.000 - -99.81% -
401.bzip2 (unexplained diff vs previous) (percentage) 133.33% 0.300 0.700 - -99.81% -
401.bzip2 (max) 110.00% 10.000 21.000 - -99.09% -
401.bzip2 (max) (percentage) 91.89% 0.370 0.710 - -99.10% -
447.dealII (max) 69.23% 13.000 22.000 - -98.41% -
450.soplex (max) 63.64% 11.000 18.000 - -96.70% -
447.dealII (max) (percentage) 62.03% 0.790 1.280 - -98.41% -
450.soplex (max) (percentage) 60.82% 1.940 3.120 - -96.76% -
470.lbm (unexplained diff vs previous) 55.56% 9.000 14.000 - -99.86% -
482.sphinx3 (max) 55.56% 9.000 14.000 - -98.46% -
470.lbm (unexplained diff vs previous) (percentage) 54.17% 0.240 0.370 - -99.86% -
454.calculix 50.00% 2.000 3.000 - -25.00% -
454.calculix (avg) 50.00% 2.000 3.000 - -25.00% -
482.sphinx3 (max) (percentage) 49.49% 0.990 1.480 - -98.47% -
470.lbm (max) 40.00% 10.000 14.000 - -99.49% -
470.lbm (max) (percentage) 32.14% 0.280 0.370 - -99.49% -
454.calculix (avg) (percentage) 3.13% 4.470 4.610 - -42.52% -
436.cactusADM (unexplained diff vs previous) (percentage) 1.92% 0.520 0.530 - -99.93% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -3.21% 1462.000 1415.000 - -0.63% -
403.gcc -1.64% 61.000 60.000 - 7.14% -
435.gromacs -1.44% 7434.000 7327.000 - 0.80% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (max) -75.00% 12.000 3.000 - -99.94% -
416.gamess (max) (percentage) -70.00% 0.100 0.030 - -99.92% -
437.leslie3d (unexplained diff vs previous) (percentage) -68.32% 4.830 1.530 - -92.30% -
437.leslie3d (unexplained diff vs previous) -67.97% 512.000 164.000 - -92.91% -
459.GemsFDTD (unexplained diff vs previous) -65.96% 47.000 16.000 - -99.90% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -65.79% 0.760 0.260 - -99.90% -
434.zeusmp (unexplained diff vs previous) (percentage) -63.64% 0.440 0.160 - -99.96% -
434.zeusmp (unexplained diff vs previous) -63.64% 11.000 4.000 - -99.96% -
458.sjeng (max) -59.09% 44.000 18.000 - -99.50% -
458.sjeng (max) (percentage) -57.63% 0.590 0.250 - -99.47% -
445.gobmk (max) -54.55% 55.000 25.000 - -99.05% -
445.gobmk (max) (percentage) -54.13% 1.090 0.500 - -99.05% -
444.namd (unexplained diff vs previous) -50.00% 8.000 4.000 - -99.95% -
444.namd (unexplained diff vs previous) (percentage) -49.53% 1.070 0.540 - -99.95% -
471.omnetpp (unexplained diff vs previous) -47.92% 48.000 25.000 - -99.77% -
471.omnetpp (unexplained diff vs previous) (percentage) -47.13% 1.740 0.920 - -99.76% -
462.libquantum (max) (percentage) -36.04% 1.110 0.710 - -99.28% -
400.perlbench (max) (percentage) -29.30% 2.560 1.810 - -97.85% -
400.perlbench (max) -29.27% 41.000 29.000 - -97.92% -
403.gcc (max) -25.00% 4.000 3.000 - -94.55% -
481.wrf (max) (percentage) -22.02% 2.180 1.700 - -97.53% -
481.wrf (max) -21.85% 119.000 93.000 - -97.55% -
433.milc (max) (percentage) -20.45% 0.440 0.350 - -99.61% -
433.milc (unexplained diff vs previous) (percentage) -20.45% 0.440 0.350 - -99.96% -
433.milc (max) -20.00% 5.000 4.000 - -99.62% -
433.milc (unexplained diff vs previous) -20.00% 5.000 4.000 - -99.96% -
403.gcc (max) (percentage) -18.08% 6.860 5.620 - -94.34% -
437.leslie3d (max) (percentage) -16.61% 11.800 9.840 - -40.65% -
437.leslie3d (max) -15.29% 1249.000 1058.000 - -45.15% -
444.namd (max) -12.50% 8.000 7.000 - -98.98% -
434.zeusmp (max) -12.00% 25.000 22.000 - -98.93% -
471.omnetpp (max) -10.84% 83.000 74.000 - -96.59% -
434.zeusmp (max) (percentage) -10.68% 1.030 0.920 - -98.87% -
453.povray (max) -10.00% 10.000 9.000 - -98.20% -
471.omnetpp (max) (percentage) -9.93% 3.020 2.720 - -96.59% -
444.namd (max) (percentage) -8.33% 1.080 0.990 - -98.92% -
459.GemsFDTD (max) (percentage) -7.79% 0.770 0.710 - -99.01% -
483.xalancbmk (max) (percentage) -7.49% 3.070 2.840 - -95.86% -
483.xalancbmk (max) -7.02% 114.000 106.000 - -95.96% -
473.astar (max) (percentage) -6.40% 1.250 1.170 - -98.24% -
459.GemsFDTD (max) -6.38% 47.000 44.000 - -99.00% -
473.astar (max) -6.25% 64.000 60.000 - -98.24% -
410.bwaves (max) (percentage) -6.15% 0.650 0.610 - -98.95% -
410.bwaves (max) -5.56% 36.000 34.000 - -98.96% -
429.mcf -5.26% 133.000 126.000 - 15.60% -
429.mcf (avg) -5.26% 133.000 126.000 - 15.60% -
416.gamess -4.78% 251.000 239.000 - -56.55% -
416.gamess (avg) -4.78% 251.000 239.000 - -56.55% -
403.gcc (avg) (percentage) -4.66% 6.440 6.140 - -16.12% -
416.gamess (avg) (percentage) -4.46% 2.020 1.930 - -56.33% -
453.povray (max) (percentage) -4.30% 1.860 1.780 - -98.05% -
465.tonto (avg) (percentage) -4.30% 2.560 2.450 - -26.65% -
465.tonto -3.94% 279.000 268.000 - -26.58% -
465.tonto (avg) -3.94% 279.000 268.000 - -26.58% -
435.gromacs -3.81% 236.000 227.000 - -38.15% -
435.gromacs (avg) -3.81% 236.000 227.000 - -38.15% -
445.gobmk -3.70% 108.000 104.000 - -46.94% -
445.gobmk (avg) -3.70% 108.000 104.000 - -46.94% -
483.xalancbmk (avg) (percentage) -3.52% 3.980 3.840 - -40.92% -
400.perlbench -3.45% 58.000 56.000 - -46.67% -
400.perlbench (avg) -3.45% 58.000 56.000 - -46.67% -
481.wrf (avg) (percentage) -3.41% 3.520 3.400 - -45.51% -
464.h264ref (max) (percentage) -3.39% 0.590 0.570 - -98.95% -
483.xalancbmk -3.38% 148.000 143.000 - -42.34% -
483.xalancbmk (avg) -3.38% 148.000 143.000 - -42.34% -
400.perlbench (avg) (percentage) -3.31% 3.620 3.500 - -44.88% -
445.gobmk (avg) (percentage) -3.27% 2.140 2.070 - -47.06% -
464.h264ref -3.25% 154.000 149.000 - -49.15% -
464.h264ref (avg) -3.25% 154.000 149.000 - -49.15% -
458.sjeng (avg) (percentage) -3.24% 1.850 1.790 - -43.89% -
453.povray (avg) (percentage) -3.13% 3.830 3.710 - -52.50% -
481.wrf -3.11% 193.000 187.000 - -45.80% -
481.wrf (avg) -3.11% 193.000 187.000 - -45.80% -
459.GemsFDTD (avg) (percentage) -3.10% 3.230 3.130 - -46.40% -
471.omnetpp -3.08% 130.000 126.000 - -43.50% -
471.omnetpp (avg) -3.08% 130.000 126.000 - -43.50% -
444.namd -3.03% 33.000 32.000 - -52.94% -
444.namd (avg) -3.03% 33.000 32.000 - -52.94% -
464.h264ref (max) -3.03% 33.000 32.000 - -98.98% -
464.h264ref (avg) (percentage) -2.99% 2.680 2.600 - -48.92% -
444.namd (avg) (percentage) -2.90% 4.480 4.350 - -52.82% -
458.sjeng -2.88% 139.000 135.000 - -43.98% -
458.sjeng (avg) -2.88% 139.000 135.000 - -43.98% -
410.bwaves -2.82% 142.000 138.000 - -44.58% -
410.bwaves (avg) -2.82% 142.000 138.000 - -44.58% -
434.zeusmp (avg) (percentage) -2.79% 3.230 3.140 - -46.32% -
473.astar (avg) (percentage) -2.68% 2.990 2.910 - -30.05% -
436.cactusADM -2.60% 77.000 75.000 - -39.52% -
436.cactusADM (avg) -2.60% 77.000 75.000 - -39.52% -
473.astar -2.60% 154.000 150.000 - -29.58% -
473.astar (avg) -2.60% 154.000 150.000 - -29.58% -
433.milc (avg) (percentage) -2.54% 3.540 3.450 - -42.98% -
459.GemsFDTD -2.51% 199.000 194.000 - -46.11% -
459.GemsFDTD (avg) -2.51% 199.000 194.000 - -46.11% -
433.milc -2.50% 40.000 39.000 - -43.48% -
433.milc (avg) -2.50% 40.000 39.000 - -43.48% -
434.zeusmp -2.50% 80.000 78.000 - -46.94% -
434.zeusmp (avg) -2.50% 80.000 78.000 - -46.94% -
470.lbm (avg) (percentage) -2.45% 3.270 3.190 - -49.61% -
436.cactusADM (avg) (percentage) -2.44% 3.690 3.600 - -39.80% -
401.bzip2 (avg) (percentage) -2.43% 2.880 2.810 - -48.72% -
470.lbm -2.42% 124.000 121.000 - -49.37% -
470.lbm (avg) -2.42% 124.000 121.000 - -49.37% -
401.bzip2 -2.35% 85.000 83.000 - -48.45% -
401.bzip2 (avg) -2.35% 85.000 83.000 - -48.45% -
471.omnetpp (avg) (percentage) -2.33% 4.730 4.620 - -43.66% -
437.leslie3d (avg) (percentage) -2.31% 4.320 4.220 - 38.36% -
462.libquantum (avg) (percentage) -2.25% 4.000 3.910 - -48.96% -
435.gromacs (avg) (percentage) -2.20% 3.180 3.110 - -38.54% -
482.sphinx3 (avg) (percentage) -2.10% 4.280 4.190 - -47.16% -
429.mcf (avg) (percentage) -2.07% 9.160 8.970 - 16.95% -
447.dealII (avg) (percentage) -2.04% 2.940 2.880 - -50.09% -
447.dealII -2.00% 50.000 49.000 - -50.51% -
447.dealII (avg) -2.00% 50.000 49.000 - -50.51% -
410.bwaves (avg) (percentage) -1.99% 2.510 2.460 - -44.22% -
435.gromacs (max) -1.87% 107.000 105.000 - -97.06% -
456.hmmer (avg) (percentage) -1.86% 2.150 2.110 - -52.15% -
456.hmmer -1.61% 62.000 61.000 - -51.97% -
456.hmmer (avg) -1.61% 62.000 61.000 - -51.97% -
465.tonto (max) (percentage) -1.20% 0.830 0.820 - -95.75% -
465.tonto (max) -1.11% 90.000 89.000 - -95.79% -

Added Tests - sample variability
400.perlbench (unexplained diff vs previous)
400.perlbench (unexplained diff vs previous) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
416.gamess (unexplained diff vs previous)
416.gamess (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 3.91% 104048.000 108116.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 7.14% 56.000 60.000 - -1.64% -
454.calculix 6.45% 62.000 66.000 - 8.20% -
450.soplex 4.76% 567.000 594.000 - 3.12% -
401.bzip2 1.53% 2941.000 2986.000 - 0.71% -
482.sphinx3 1.38% 945.000 958.000 - 1.48% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 38.36% 3.050 4.220 - -2.31% -
437.leslie3d 27.61% 355.000 453.000 - -0.88% -
437.leslie3d (avg) 27.61% 355.000 453.000 - -0.88% -
429.mcf (avg) (percentage) 16.95% 7.670 8.970 - -2.07% -
429.mcf 15.60% 109.000 126.000 - -5.26% -
429.mcf (avg) 15.60% 109.000 126.000 - -5.26% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.13% 387748.000 383364.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.61% 11640.000 10754.000 - 1.55% -
400.perlbench -2.59% 1663.000 1620.000 - -0.43% -
483.xalancbmk -2.15% 3818.000 3736.000 - 0.11% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.710 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
403.gcc (unexplained diff vs previous) (percentage) -99.99% 15435.710 1.670 - 0.00% -
403.gcc (unexplained diff vs previous) -99.99% 8644.000 1.000 - 0.00% -
454.calculix (unexplained diff vs previous) (percentage) -99.98% 37020.970 7.580 - 0.00% -
454.calculix (unexplained diff vs previous) -99.98% 22953.000 5.000 - 0.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.97% 62.730 0.020 - 0.00% -
433.milc (unexplained diff vs previous) -99.96% 11289.000 4.000 - -20.00% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 - -63.64% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.160 - -63.64% -
433.milc (unexplained diff vs previous) (percentage) -99.96% 980.800 0.350 - -20.45% -
416.gamess (unexplained diff vs previous) -99.96% 7819.000 3.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) -99.95% 8368.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.95% 8356.000 4.000 - -50.00% -
444.namd (unexplained diff vs previous) (percentage) -99.95% 1118.610 0.540 - -49.53% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.95% 219.170 0.110 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.95% 2759.050 1.460 - 1227.27% -
482.sphinx3 (unexplained diff vs previous) -99.95% 26073.000 14.000 - 1300.00% -
416.gamess (max) -99.94% 4805.000 3.000 - -75.00% -
436.cactusADM (unexplained diff vs previous) -99.93% 16396.000 11.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.93% 787.130 0.530 - 1.92% -
453.povray (unexplained diff vs previous) -99.93% 5707.000 4.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -99.93% 1043.330 0.740 - 0.00% -
458.sjeng (unexplained diff vs previous) -99.93% 6876.000 5.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.92% 90.870 0.070 - 0.00% -
416.gamess (max) (percentage) -99.92% 38.550 0.030 - -70.00% -
400.perlbench (unexplained diff vs previous) -99.92% 8772.000 7.000 - 0.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.92% 527.480 0.430 - 0.00% -
445.gobmk (unexplained diff vs previous) -99.91% 5581.000 5.000 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.91% 111.110 0.100 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.90% 15458.000 16.000 - -65.96% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.90% 250.410 0.260 - -65.79% -
450.soplex (unexplained diff vs previous) (percentage) -99.88% 2557.320 3.030 - 0.00% -
450.soplex (unexplained diff vs previous) -99.88% 14500.000 18.000 - 0.00% -
470.lbm (unexplained diff vs previous) -99.86% 9990.000 14.000 - 55.56% -
470.lbm (unexplained diff vs previous) (percentage) -99.86% 263.730 0.370 - 54.17% -
464.h264ref (unexplained diff vs previous) (percentage) -99.84% 118.780 0.190 - 0.00% -
464.h264ref (unexplained diff vs previous) -99.84% 6843.000 11.000 - 0.00% -
481.wrf (unexplained diff vs previous) -99.82% 12149.000 22.000 - 0.00% -
481.wrf (unexplained diff vs previous) (percentage) -99.82% 219.530 0.400 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.81% 368.340 0.700 - 133.33% -
401.bzip2 (unexplained diff vs previous) -99.81% 10833.000 21.000 - 133.33% -
471.omnetpp (unexplained diff vs previous) -99.77% 10659.000 25.000 - -47.92% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.76% 391.300 0.920 - -47.13% -
473.astar (unexplained diff vs previous) (percentage) -99.76% 197.850 0.480 - 0.00% -
473.astar (unexplained diff vs previous) -99.75% 10146.000 25.000 - 0.00% -
429.mcf (unexplained diff vs previous) -99.75% 18593.000 47.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.75% 1305.690 3.320 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.70% 278.630 0.830 - 0.00% -
456.hmmer (unexplained diff vs previous) -99.70% 8030.000 24.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.69% 407.020 1.270 - 0.00% -
447.dealII (unexplained diff vs previous) -99.69% 7017.000 22.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.64% 7794.000 28.000 - 180.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.64% 137.900 0.500 - 177.78% -
433.milc (max) -99.62% 1044.000 4.000 - -20.00% -
433.milc (max) (percentage) -99.61% 90.750 0.350 - -20.45% -
458.sjeng (max) -99.50% 3602.000 18.000 - -59.09% -
470.lbm (max) -99.49% 2746.000 14.000 - 40.00% -
470.lbm (max) (percentage) -99.49% 72.510 0.370 - 32.14% -
458.sjeng (max) (percentage) -99.47% 47.610 0.250 - -57.63% -
436.cactusADM (max) -99.46% 1848.000 10.000 - 0.00% -
436.cactusADM (max) (percentage) -99.41% 88.730 0.520 - 0.00% -
462.libquantum (max) (percentage) -99.28% 98.970 0.710 - -36.04% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
401.bzip2 (max) (percentage) -99.10% 78.650 0.710 - 91.89% -
401.bzip2 (max) -99.09% 2313.000 21.000 - 110.00% -
445.gobmk (max) -99.05% 2643.000 25.000 - -54.55% -
445.gobmk (max) (percentage) -99.05% 52.630 0.500 - -54.13% -
459.GemsFDTD (max) (percentage) -99.01% 71.460 0.710 - -7.79% -
459.GemsFDTD (max) -99.00% 4411.000 44.000 - -6.38% -
444.namd (max) -98.98% 685.000 7.000 - -12.50% -
464.h264ref (max) -98.98% 3127.000 32.000 - -3.03% -
410.bwaves (max) -98.96% 3276.000 34.000 - -5.56% -
464.h264ref (max) (percentage) -98.95% 54.290 0.570 - -3.39% -
410.bwaves (max) (percentage) -98.95% 57.970 0.610 - -6.15% -
434.zeusmp (max) -98.93% 2055.000 22.000 - -12.00% -
444.namd (max) (percentage) -98.92% 91.790 0.990 - -8.33% -
456.hmmer (max) -98.92% 2120.000 23.000 - 228.57% -
456.hmmer (max) (percentage) -98.89% 73.590 0.820 - 215.38% -
434.zeusmp (max) (percentage) -98.87% 81.770 0.920 - -10.68% -
435.gromacs (unexplained diff vs previous) (percentage) -98.49% 96.680 1.460 - 0.00% -
435.gromacs (unexplained diff vs previous) -98.48% 7028.000 107.000 - 0.00% -
482.sphinx3 (max) (percentage) -98.47% 96.500 1.480 - 49.49% -
482.sphinx3 (max) -98.46% 911.000 14.000 - 55.56% -
447.dealII (max) -98.41% 1384.000 22.000 - 69.23% -
447.dealII (max) (percentage) -98.41% 80.280 1.280 - 62.03% -
473.astar (max) (percentage) -98.24% 66.430 1.170 - -6.40% -
473.astar (max) -98.24% 3406.000 60.000 - -6.25% -
453.povray (max) -98.20% 499.000 9.000 - -10.00% -
465.tonto (unexplained diff vs previous) (percentage) -98.09% 16.190 0.310 - 0.00% -
465.tonto (unexplained diff vs previous) -98.08% 1771.000 34.000 - 0.00% -
453.povray (max) (percentage) -98.05% 91.250 1.780 - -4.30% -
400.perlbench (max) -97.92% 1397.000 29.000 - -29.27% -
400.perlbench (max) (percentage) -97.85% 84.060 1.810 - -29.30% -
481.wrf (max) -97.55% 3801.000 93.000 - -21.85% -
481.wrf (max) (percentage) -97.53% 68.700 1.700 - -22.02% -
435.gromacs (max) (percentage) -97.07% 49.160 1.440 - -0.69% -
435.gromacs (max) -97.06% 3573.000 105.000 - -1.87% -
450.soplex (max) (percentage) -96.76% 96.240 3.120 - 60.82% -
450.soplex (max) -96.70% 545.000 18.000 - 63.64% -
429.mcf (max) -96.60% 1322.000 45.000 - 800.00% -
471.omnetpp (max) -96.59% 2169.000 74.000 - -10.84% -
471.omnetpp (max) (percentage) -96.59% 79.650 2.720 - -9.93% -
429.mcf (max) (percentage) -96.54% 92.890 3.210 - 723.08% -
483.xalancbmk (max) -95.96% 2621.000 106.000 - -7.02% -
483.xalancbmk (max) (percentage) -95.86% 68.670 2.840 - -7.49% -
465.tonto (max) -95.79% 2112.000 89.000 - -1.11% -
465.tonto (max) (percentage) -95.75% 19.310 0.820 - -1.20% -
403.gcc (max) -94.55% 55.000 3.000 - -25.00% -
403.gcc (max) (percentage) -94.34% 99.360 5.620 - -18.08% -
437.leslie3d (unexplained diff vs previous) -92.91% 2314.000 164.000 - -67.97% -
437.leslie3d (unexplained diff vs previous) (percentage) -92.30% 19.880 1.530 - -68.32% -
454.calculix (max) -91.80% 61.000 5.000 - 0.00% -
454.calculix (max) (percentage) -91.78% 99.730 8.200 - 525.95% -
416.gamess -56.55% 550.000 239.000 - -4.78% -
416.gamess (avg) -56.55% 550.000 239.000 - -4.78% -
416.gamess (avg) (percentage) -56.33% 4.420 1.930 - -4.46% -
444.namd -52.94% 68.000 32.000 - -3.03% -
444.namd (avg) -52.94% 68.000 32.000 - -3.03% -
444.namd (avg) (percentage) -52.82% 9.220 4.350 - -2.90% -
453.povray (avg) (percentage) -52.50% 7.810 3.710 - -3.13% -
453.povray -52.38% 42.000 20.000 - 0.00% -
453.povray (avg) -52.38% 42.000 20.000 - 0.00% -
456.hmmer (avg) (percentage) -52.15% 4.410 2.110 - -1.86% -
456.hmmer -51.97% 127.000 61.000 - -1.61% -
456.hmmer (avg) -51.97% 127.000 61.000 - -1.61% -
447.dealII -50.51% 99.000 49.000 - -2.00% -
447.dealII (avg) -50.51% 99.000 49.000 - -2.00% -
447.dealII (avg) (percentage) -50.09% 5.770 2.880 - -2.04% -
462.libquantum -50.00% 10.000 5.000 - 0.00% -
462.libquantum (avg) -50.00% 10.000 5.000 - 0.00% -
470.lbm (avg) (percentage) -49.61% 6.330 3.190 - -2.45% -
470.lbm -49.37% 239.000 121.000 - -2.42% -
470.lbm (avg) -49.37% 239.000 121.000 - -2.42% -
464.h264ref -49.15% 293.000 149.000 - -3.25% -
464.h264ref (avg) -49.15% 293.000 149.000 - -3.25% -
462.libquantum (avg) (percentage) -48.96% 7.660 3.910 - -2.25% -
464.h264ref (avg) (percentage) -48.92% 5.090 2.600 - -2.99% -
401.bzip2 (avg) (percentage) -48.72% 5.480 2.810 - -2.43% -
401.bzip2 -48.45% 161.000 83.000 - -2.35% -
401.bzip2 (avg) -48.45% 161.000 83.000 - -2.35% -
482.sphinx3 (avg) (percentage) -47.16% 7.930 4.190 - -2.10% -
445.gobmk (avg) (percentage) -47.06% 3.910 2.070 - -3.27% -
434.zeusmp -46.94% 147.000 78.000 - -2.50% -
434.zeusmp (avg) -46.94% 147.000 78.000 - -2.50% -
445.gobmk -46.94% 196.000 104.000 - -3.70% -
445.gobmk (avg) -46.94% 196.000 104.000 - -3.70% -
400.perlbench -46.67% 105.000 56.000 - -3.45% -
400.perlbench (avg) -46.67% 105.000 56.000 - -3.45% -
459.GemsFDTD (avg) (percentage) -46.40% 5.840 3.130 - -3.10% -
434.zeusmp (avg) (percentage) -46.32% 5.850 3.140 - -2.79% -
459.GemsFDTD -46.11% 360.000 194.000 - -2.51% -
459.GemsFDTD (avg) -46.11% 360.000 194.000 - -2.51% -
482.sphinx3 -45.95% 74.000 40.000 - 0.00% -
482.sphinx3 (avg) -45.95% 74.000 40.000 - 0.00% -
481.wrf -45.80% 345.000 187.000 - -3.11% -
481.wrf (avg) -45.80% 345.000 187.000 - -3.11% -
481.wrf (avg) (percentage) -45.51% 6.240 3.400 - -3.41% -
437.leslie3d (max) -45.15% 1929.000 1058.000 - -15.29% -
400.perlbench (avg) (percentage) -44.88% 6.350 3.500 - -3.31% -
410.bwaves -44.58% 249.000 138.000 - -2.82% -
410.bwaves (avg) -44.58% 249.000 138.000 - -2.82% -
410.bwaves (avg) (percentage) -44.22% 4.410 2.460 - -1.99% -
458.sjeng -43.98% 241.000 135.000 - -2.88% -
458.sjeng (avg) -43.98% 241.000 135.000 - -2.88% -
458.sjeng (avg) (percentage) -43.89% 3.190 1.790 - -3.24% -
471.omnetpp (avg) (percentage) -43.66% 8.200 4.620 - -2.33% -
471.omnetpp -43.50% 223.000 126.000 - -3.08% -
471.omnetpp (avg) -43.50% 223.000 126.000 - -3.08% -
433.milc -43.48% 69.000 39.000 - -2.50% -
433.milc (avg) -43.48% 69.000 39.000 - -2.50% -
433.milc (avg) (percentage) -42.98% 6.050 3.450 - -2.54% -
454.calculix (avg) (percentage) -42.52% 8.020 4.610 - 3.13% -
483.xalancbmk -42.34% 248.000 143.000 - -3.38% -
483.xalancbmk (avg) -42.34% 248.000 143.000 - -3.38% -
483.xalancbmk (avg) (percentage) -40.92% 6.500 3.840 - -3.52% -
450.soplex (avg) (percentage) -40.90% 6.430 3.800 - -0.52% -
437.leslie3d (max) (percentage) -40.65% 16.580 9.840 - -16.61% -
436.cactusADM (avg) (percentage) -39.80% 5.980 3.600 - -2.44% -
436.cactusADM -39.52% 124.000 75.000 - -2.60% -
436.cactusADM (avg) -39.52% 124.000 75.000 - -2.60% -
450.soplex -38.89% 36.000 22.000 - 0.00% -
450.soplex (avg) -38.89% 36.000 22.000 - 0.00% -
435.gromacs (avg) (percentage) -38.54% 5.060 3.110 - -2.20% -
435.gromacs -38.15% 367.000 227.000 - -3.81% -
435.gromacs (avg) -38.15% 367.000 227.000 - -3.81% -
473.astar (avg) (percentage) -30.05% 4.160 2.910 - -2.68% -
473.astar -29.58% 213.000 150.000 - -2.60% -
473.astar (avg) -29.58% 213.000 150.000 - -2.60% -
465.tonto (avg) (percentage) -26.65% 3.340 2.450 - -4.30% -
465.tonto -26.58% 365.000 268.000 - -3.94% -
465.tonto (avg) -26.58% 365.000 268.000 - -3.94% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
454.calculix -25.00% 4.000 3.000 - 50.00% -
454.calculix (avg) -25.00% 4.000 3.000 - 50.00% -
403.gcc (avg) (percentage) -16.12% 7.320 6.140 - -4.66% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1620.000 -
401.bzip2 2986.000 -
403.gcc 60.000 -1.64%
410.bwaves 5650.000 -
416.gamess 12426.000 -
429.mcf 1415.000 -3.21%
433.milc 1147.000 -
434.zeusmp 2492.000 -
435.gromacs 7327.000 -1.44%
436.cactusADM 2091.000 -
437.leslie3d 10754.000 1.55%
444.namd 745.000 -
445.gobmk 5067.000 -
447.dealII 1736.000 1.28%
450.soplex 594.000 3.12%
453.povray 543.000 -
454.calculix 66.000 8.20%
456.hmmer 2896.000 -
458.sjeng 7551.000 -
459.GemsFDTD 6200.000 -
462.libquantum 141.000 -
464.h264ref 5739.000 -
465.tonto 10953.000 -
470.lbm 3808.000 -
471.omnetpp 2728.000 -
473.astar 5157.000 -
481.wrf 5523.000 -
482.sphinx3 958.000 1.48%
483.xalancbmk 3736.000 -
Geometric Mean 2106.304 -
Code Size (bytes)
Name Current %
400.perlbench 893259.000 -
401.bzip2 44233.000 -
403.gcc 2443939.000 -
410.bwaves 16760.000 -
416.gamess 5747461.000 -
429.mcf 9119.000 -
433.milc 61378.000 -
434.zeusmp 152125.000 -
435.gromacs 498921.000 -
436.cactusADM 352895.000 -
437.leslie3d 59467.000 -
444.namd 188340.000 -
445.gobmk 1377694.000 -
447.dealII 313190.000 -
450.soplex 205148.000 -
453.povray 661273.000 -
454.calculix 845118.000 -
456.hmmer 108675.000 -
458.sjeng 108116.000 -
459.GemsFDTD 245032.000 -
462.libquantum 16085.000 -
464.h264ref 383364.000 -
465.tonto 1946166.000 -
470.lbm 9691.000 -
471.omnetpp 478111.000 -
473.astar 22952.000 -
481.wrf 1964130.000 -
482.sphinx3 112787.000 -
483.xalancbmk 2344125.000 -
Geometric Mean 224201.721 -
sample variability
Name Current %
400.perlbench 56.000 -3.45%
400.perlbench (avg) 56.000 -3.45%
400.perlbench (avg) (percentage) 3.500 -3.31%
400.perlbench (max) 29.000 -29.27%
400.perlbench (max) (percentage) 1.810 -29.30%
400.perlbench (unexplained diff vs previous) 7.000 -
400.perlbench (unexplained diff vs previous) (percentage) 0.430 -
401.bzip2 83.000 -2.35%
401.bzip2 (avg) 83.000 -2.35%
401.bzip2 (avg) (percentage) 2.810 -2.43%
401.bzip2 (max) 21.000 110.00%
401.bzip2 (max) (percentage) 0.710 91.89%
401.bzip2 (unexplained diff vs previous) 21.000 133.33%
401.bzip2 (unexplained diff vs previous) (percentage) 0.700 133.33%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.140 -4.66%
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 5.620 -18.08%
403.gcc (unexplained diff vs previous) 1.000 -
403.gcc (unexplained diff vs previous) (percentage) 1.670 -
410.bwaves 138.000 -2.82%
410.bwaves (avg) 138.000 -2.82%
410.bwaves (avg) (percentage) 2.460 -1.99%
410.bwaves (max) 34.000 -5.56%
410.bwaves (max) (percentage) 0.610 -6.15%
410.bwaves (unexplained diff vs previous) 28.000 180.00%
410.bwaves (unexplained diff vs previous) (percentage) 0.500 177.78%
416.gamess 239.000 -4.78%
416.gamess (avg) 239.000 -4.78%
416.gamess (avg) (percentage) 1.930 -4.46%
416.gamess (max) 3.000 -75.00%
416.gamess (max) (percentage) 0.030 -70.00%
416.gamess (unexplained diff vs previous) 3.000 -
416.gamess (unexplained diff vs previous) (percentage) 0.020 -
429.mcf 126.000 -5.26%
429.mcf (avg) 126.000 -5.26%
429.mcf (avg) (percentage) 8.970 -2.07%
429.mcf (max) 45.000 800.00%
429.mcf (max) (percentage) 3.210 723.08%
429.mcf (unexplained diff vs previous) 47.000 -
429.mcf (unexplained diff vs previous) (percentage) 3.320 -
433.milc 39.000 -2.50%
433.milc (avg) 39.000 -2.50%
433.milc (avg) (percentage) 3.450 -2.54%
433.milc (max) 4.000 -20.00%
433.milc (max) (percentage) 0.350 -20.45%
433.milc (unexplained diff vs previous) 4.000 -20.00%
433.milc (unexplained diff vs previous) (percentage) 0.350 -20.45%
434.zeusmp 78.000 -2.50%
434.zeusmp (avg) 78.000 -2.50%
434.zeusmp (avg) (percentage) 3.140 -2.79%
434.zeusmp (max) 22.000 -12.00%
434.zeusmp (max) (percentage) 0.920 -10.68%
434.zeusmp (unexplained diff vs previous) 4.000 -63.64%
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -63.64%
435.gromacs 227.000 -3.81%
435.gromacs (avg) 227.000 -3.81%
435.gromacs (avg) (percentage) 3.110 -2.20%
435.gromacs (max) 105.000 -1.87%
435.gromacs (max) (percentage) 1.440 -
435.gromacs (unexplained diff vs previous) 107.000 -
435.gromacs (unexplained diff vs previous) (percentage) 1.460 -
436.cactusADM 75.000 -2.60%
436.cactusADM (avg) 75.000 -2.60%
436.cactusADM (avg) (percentage) 3.600 -2.44%
436.cactusADM (max) 10.000 -
436.cactusADM (max) (percentage) 0.520 -
436.cactusADM (unexplained diff vs previous) 11.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.530 1.92%
437.leslie3d 453.000 -
437.leslie3d (avg) 453.000 -
437.leslie3d (avg) (percentage) 4.220 -2.31%
437.leslie3d (max) 1058.000 -15.29%
437.leslie3d (max) (percentage) 9.840 -16.61%
437.leslie3d (unexplained diff vs previous) 164.000 -67.97%
437.leslie3d (unexplained diff vs previous) (percentage) 1.530 -68.32%
444.namd 32.000 -3.03%
444.namd (avg) 32.000 -3.03%
444.namd (avg) (percentage) 4.350 -2.90%
444.namd (max) 7.000 -12.50%
444.namd (max) (percentage) 0.990 -8.33%
444.namd (unexplained diff vs previous) 4.000 -50.00%
444.namd (unexplained diff vs previous) (percentage) 0.540 -49.53%
445.gobmk 104.000 -3.70%
445.gobmk (avg) 104.000 -3.70%
445.gobmk (avg) (percentage) 2.070 -3.27%
445.gobmk (max) 25.000 -54.55%
445.gobmk (max) (percentage) 0.500 -54.13%
445.gobmk (unexplained diff vs previous) 5.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.100 -
447.dealII 49.000 -2.00%
447.dealII (avg) 49.000 -2.00%
447.dealII (avg) (percentage) 2.880 -2.04%
447.dealII (max) 22.000 69.23%
447.dealII (max) (percentage) 1.280 62.03%
447.dealII (unexplained diff vs previous) 22.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.270 -
450.soplex 22.000 -
450.soplex (avg) 22.000 -
450.soplex (avg) (percentage) 3.800 -
450.soplex (max) 18.000 63.64%
450.soplex (max) (percentage) 3.120 60.82%
450.soplex (unexplained diff vs previous) 18.000 -
450.soplex (unexplained diff vs previous) (percentage) 3.030 -
453.povray 20.000 -
453.povray (avg) 20.000 -
453.povray (avg) (percentage) 3.710 -3.13%
453.povray (max) 9.000 -10.00%
453.povray (max) (percentage) 1.780 -4.30%
453.povray (unexplained diff vs previous) 4.000 -
453.povray (unexplained diff vs previous) (percentage) 0.740 -
454.calculix 3.000 50.00%
454.calculix (avg) 3.000 50.00%
454.calculix (avg) (percentage) 4.610 3.13%
454.calculix (max) 5.000 -
454.calculix (max) (percentage) 8.200 525.95%
454.calculix (unexplained diff vs previous) 5.000 -
454.calculix (unexplained diff vs previous) (percentage) 7.580 -
456.hmmer 61.000 -1.61%
456.hmmer (avg) 61.000 -1.61%
456.hmmer (avg) (percentage) 2.110 -1.86%
456.hmmer (max) 23.000 228.57%
456.hmmer (max) (percentage) 0.820 215.38%
456.hmmer (unexplained diff vs previous) 24.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.830 -
458.sjeng 135.000 -2.88%
458.sjeng (avg) 135.000 -2.88%
458.sjeng (avg) (percentage) 1.790 -3.24%
458.sjeng (max) 18.000 -59.09%
458.sjeng (max) (percentage) 0.250 -57.63%
458.sjeng (unexplained diff vs previous) 5.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.070 -
459.GemsFDTD 194.000 -2.51%
459.GemsFDTD (avg) 194.000 -2.51%
459.GemsFDTD (avg) (percentage) 3.130 -3.10%
459.GemsFDTD (max) 44.000 -6.38%
459.GemsFDTD (max) (percentage) 0.710 -7.79%
459.GemsFDTD (unexplained diff vs previous) 16.000 -65.96%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 -65.79%
462.libquantum 5.000 -
462.libquantum (avg) 5.000 -
462.libquantum (avg) (percentage) 3.910 -2.25%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 0.710 -36.04%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.710 -
464.h264ref 149.000 -3.25%
464.h264ref (avg) 149.000 -3.25%
464.h264ref (avg) (percentage) 2.600 -2.99%
464.h264ref (max) 32.000 -3.03%
464.h264ref (max) (percentage) 0.570 -3.39%
464.h264ref (unexplained diff vs previous) 11.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.190 -
465.tonto 268.000 -3.94%
465.tonto (avg) 268.000 -3.94%
465.tonto (avg) (percentage) 2.450 -4.30%
465.tonto (max) 89.000 -1.11%
465.tonto (max) (percentage) 0.820 -1.20%
465.tonto (unexplained diff vs previous) 34.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.310 -
470.lbm 121.000 -2.42%
470.lbm (avg) 121.000 -2.42%
470.lbm (avg) (percentage) 3.190 -2.45%
470.lbm (max) 14.000 40.00%
470.lbm (max) (percentage) 0.370 32.14%
470.lbm (unexplained diff vs previous) 14.000 55.56%
470.lbm (unexplained diff vs previous) (percentage) 0.370 54.17%
471.omnetpp 126.000 -3.08%
471.omnetpp (avg) 126.000 -3.08%
471.omnetpp (avg) (percentage) 4.620 -2.33%
471.omnetpp (max) 74.000 -10.84%
471.omnetpp (max) (percentage) 2.720 -9.93%
471.omnetpp (unexplained diff vs previous) 25.000 -47.92%
471.omnetpp (unexplained diff vs previous) (percentage) 0.920 -47.13%
473.astar 150.000 -2.60%
473.astar (avg) 150.000 -2.60%
473.astar (avg) (percentage) 2.910 -2.68%
473.astar (max) 60.000 -6.25%
473.astar (max) (percentage) 1.170 -6.40%
473.astar (unexplained diff vs previous) 25.000 -
473.astar (unexplained diff vs previous) (percentage) 0.480 -
481.wrf 187.000 -3.11%
481.wrf (avg) 187.000 -3.11%
481.wrf (avg) (percentage) 3.400 -3.41%
481.wrf (max) 93.000 -21.85%
481.wrf (max) (percentage) 1.700 -22.02%
481.wrf (unexplained diff vs previous) 22.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.400 -
482.sphinx3 40.000 -
482.sphinx3 (avg) 40.000 -
482.sphinx3 (avg) (percentage) 4.190 -2.10%
482.sphinx3 (max) 14.000 55.56%
482.sphinx3 (max) (percentage) 1.480 49.49%
482.sphinx3 (unexplained diff vs previous) 14.000 1300.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.460 1227.27%
483.xalancbmk 143.000 -3.38%
483.xalancbmk (avg) 143.000 -3.38%
483.xalancbmk (avg) (percentage) 3.840 -3.52%
483.xalancbmk (max) 106.000 -7.02%
483.xalancbmk (max) (percentage) 2.840 -7.49%
483.xalancbmk (unexplained diff vs previous) 4.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.110 -
Geometric Mean 8.090 -15.86%