Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=be3bed0696aa3beea2c9d539e08743f14bbe1db1 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/0cfc9c953d0221ec3971a25e6509ebe1041f142e (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d2123d68275acc0f061e73d5f86ca504e0d5a344 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=569306fa74e3adbe699e8548698815473469e440 (unchanged)
regression GNU-892
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/103/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0103 (basepoints/gcc-14-03414-g0cfc9c953d0) 2023-08-24T21:29:58 0:00:00
Previous 0102 (4-changed-components) 2023-08-17T10:30:07 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 12 14
Performance Improvements 80 171
Added Tests 28 0
Unchanged Tests 1116 1051
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench 1.86% 883803.000 900219.000 - 0.71% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.27% 55.000 59.000 - 5.36% -
434.zeusmp 1.12% 2502.000 2530.000 - 0.64% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (max) (percentage) 116.01% 6.120 13.220 - -20.27% -
436.cactusADM (max) (percentage) 110.53% 0.380 0.800 - -99.10% -
436.cactusADM (max) 100.00% 8.000 16.000 - -99.13% -
437.leslie3d (max) 87.60% 742.000 1392.000 - -27.84% -
462.libquantum (max) (percentage) 33.96% 1.060 1.420 - -98.57% -
403.gcc (max) 33.33% 3.000 4.000 - -92.73% -
458.sjeng (max) (percentage) 27.45% 0.510 0.650 - -98.63% -
458.sjeng (max) 26.32% 38.000 48.000 - -98.67% -
437.leslie3d (avg) (percentage) 5.41% 4.250 4.480 - 46.89% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
464.h264ref -1.04% 390572.000 386508.000 - -0.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -13.22% 12137.000 10532.000 - -9.52% -
462.libquantum -1.42% 141.000 139.000 - -0.71% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (max) (percentage) -25.79% 1.900 1.410 - -98.23% -
465.tonto (max) (percentage) -25.58% 0.860 0.640 - -96.69% -
465.tonto (max) -25.53% 94.000 70.000 - -96.69% -
471.omnetpp (max) -25.00% 52.000 39.000 - -98.20% -
444.namd (max) -14.29% 7.000 6.000 - -99.12% -
453.povray (max) -12.50% 8.000 7.000 - -98.60% -
433.milc (max) -10.00% 10.000 9.000 - -99.14% -
437.leslie3d -8.54% 515.000 471.000 - 32.68% -
437.leslie3d (avg) -8.54% 515.000 471.000 - 32.68% -
470.lbm (max) -8.33% 12.000 11.000 - -99.60% -
459.GemsFDTD (max) (percentage) -8.14% 0.860 0.790 - -98.89% -
416.gamess (max) (percentage) -7.69% 0.130 0.120 - -99.69% -
429.mcf (max) -7.69% 13.000 12.000 - -99.09% -
434.zeusmp (max) -7.69% 13.000 12.000 - -99.42% -
459.GemsFDTD (max) -7.69% 52.000 48.000 - -98.91% -
434.zeusmp (max) (percentage) -7.55% 0.530 0.490 - -99.40% -
444.namd (max) (percentage) -6.93% 1.010 0.940 - -98.98% -
435.gromacs (max) (percentage) -6.73% 1.040 0.970 - -98.03% -
435.gromacs (max) -6.58% 76.000 71.000 - -98.01% -
429.mcf (max) (percentage) -6.32% 0.950 0.890 - -99.04% -
450.soplex (max) (percentage) -6.19% 1.130 1.060 - -98.90% -
470.lbm (max) (percentage) -6.06% 0.330 0.310 - -99.57% -
454.calculix (max) (percentage) -5.78% 2.940 2.770 - -97.22% -
433.milc (max) (percentage) -5.56% 0.900 0.850 - -99.06% -
401.bzip2 (max) (percentage) -5.56% 0.720 0.680 - -99.14% -
401.bzip2 (max) -4.76% 21.000 20.000 - -99.14% -
444.namd -4.76% 21.000 20.000 - -70.59% -
444.namd (avg) -4.76% 21.000 20.000 - -70.59% -
473.astar (max) -4.65% 43.000 41.000 - -98.80% -
464.h264ref (max) (percentage) -4.17% 0.480 0.460 - -99.15% -
445.gobmk (max) (percentage) -3.95% 0.760 0.730 - -98.61% -
433.milc -3.85% 26.000 25.000 - -63.77% -
433.milc (avg) -3.85% 26.000 25.000 - -63.77% -
465.tonto -3.78% 185.000 178.000 - -51.23% -
465.tonto (avg) -3.78% 185.000 178.000 - -51.23% -
482.sphinx3 (max) (percentage) -3.77% 1.590 1.530 - -98.41% -
464.h264ref (max) -3.70% 27.000 26.000 - -99.17% -
481.wrf (max) -3.70% 54.000 52.000 - -98.63% -
473.astar (max) (percentage) -3.61% 0.830 0.800 - -98.80% -
410.bwaves (max) -3.57% 28.000 27.000 - -99.18% -
465.tonto (avg) (percentage) -3.57% 1.680 1.620 - -51.50% -
481.wrf (max) (percentage) -3.06% 0.980 0.950 - -98.62% -
483.xalancbmk (max) (percentage) -2.78% 4.670 4.540 - -93.39% -
403.gcc (max) (percentage) -2.76% 7.250 7.050 - -92.90% -
473.astar -2.73% 110.000 107.000 - -49.77% -
473.astar (avg) -2.73% 110.000 107.000 - -49.77% -
483.xalancbmk (max) -2.70% 185.000 180.000 - -93.13% -
453.povray (max) (percentage) -2.68% 1.490 1.450 - -98.41% -
447.dealII (max) (percentage) -2.67% 1.500 1.460 - -98.18% -
445.gobmk (max) -2.63% 38.000 37.000 - -98.60% -
400.perlbench (max) (percentage) -2.53% 2.770 2.700 - -96.79% -
456.hmmer (max) (percentage) -2.50% 0.400 0.390 - -99.47% -
470.lbm -2.50% 80.000 78.000 - -67.36% -
470.lbm (avg) -2.50% 80.000 78.000 - -67.36% -
473.astar (avg) (percentage) -2.37% 2.110 2.060 - -50.48% -
429.mcf (avg) (percentage) -2.32% 6.470 6.320 - -17.60% -
400.perlbench (max) -2.22% 45.000 44.000 - -96.85% -
429.mcf -2.20% 91.000 89.000 - -18.35% -
429.mcf (avg) -2.20% 91.000 89.000 - -18.35% -
447.dealII (avg) (percentage) -2.19% 2.280 2.230 - -61.35% -
471.omnetpp -2.17% 92.000 90.000 - -59.64% -
471.omnetpp (avg) -2.17% 92.000 90.000 - -59.64% -
410.bwaves -2.11% 95.000 93.000 - -62.65% -
410.bwaves (avg) -2.11% 95.000 93.000 - -62.65% -
471.omnetpp (avg) (percentage) -2.10% 3.340 3.270 - -60.12% -
482.sphinx3 (avg) (percentage) -2.03% 2.950 2.890 - -63.56% -
410.bwaves (max) (percentage) -2.00% 0.500 0.490 - -99.15% -
436.cactusADM -1.92% 52.000 51.000 - -58.87% -
436.cactusADM (avg) -1.92% 52.000 51.000 - -58.87% -
470.lbm (avg) (percentage) -1.90% 2.110 2.070 - -67.30% -
410.bwaves (avg) (percentage) -1.78% 1.690 1.660 - -62.36% -
444.namd (avg) (percentage) -1.75% 2.850 2.800 - -69.63% -
459.GemsFDTD (avg) (percentage) -1.40% 2.140 2.110 - -63.87% -
436.cactusADM (avg) (percentage) -1.21% 2.480 2.450 - -59.03% -
462.libquantum (avg) (percentage) -1.07% 2.800 2.770 - -63.84% -
458.sjeng -1.05% 95.000 94.000 - -61.00% -
458.sjeng (avg) -1.05% 95.000 94.000 - -61.00% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
465.tonto (unexplained diff vs previous)
465.tonto (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
471.omnetpp (unexplained diff vs previous)
471.omnetpp (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - 7.27% -
483.xalancbmk 3.85% 3818.000 3965.000 - 0.00% -
450.soplex 3.17% 567.000 585.000 - 0.69% -
401.bzip2 2.11% 2941.000 3003.000 - -0.03% -
471.omnetpp 2.09% 2724.000 2781.000 - 0.36% -
435.gromacs 2.02% 7269.000 7416.000 - 0.56% -
473.astar 1.68% 5128.000 5214.000 - -0.27% -
454.calculix 1.61% 62.000 63.000 - 0.00% -
456.hmmer 1.25% 2882.000 2918.000 - -0.58% -
445.gobmk 1.09% 5023.000 5078.000 - 0.61% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 46.89% 3.050 4.480 - 5.41% -
437.leslie3d 32.68% 355.000 471.000 - -8.54% -
437.leslie3d (avg) 32.68% 355.000 471.000 - -8.54% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD -1.42% 244728.000 241260.000 - 0.00% -
453.povray -1.18% 661389.000 653573.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.52% 11640.000 10532.000 - -13.22% -
400.perlbench -1.92% 1663.000 1631.000 - 0.06% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.99% 26073.000 3.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.99% 2759.050 0.320 - 0.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.440 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.98% 1305.690 0.210 - 0.00% -
429.mcf (unexplained diff vs previous) -99.98% 18593.000 3.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.95% 263.730 0.130 - 0.00% -
470.lbm (unexplained diff vs previous) -99.95% 9990.000 5.000 - 0.00% -
465.tonto (unexplained diff vs previous) -99.94% 1771.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.670 - 0.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.94% 16.190 0.010 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.91% 391.300 0.360 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.91% 10659.000 10.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.90% 787.130 0.810 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.90% 16396.000 17.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -99.86% 197.850 0.270 - 0.00% -
473.astar (unexplained diff vs previous) -99.86% 10146.000 14.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -99.79% 407.020 0.870 - 0.00% -
447.dealII (unexplained diff vs previous) -99.79% 7017.000 15.000 - 0.00% -
410.bwaves (unexplained diff vs previous) -99.74% 7794.000 20.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.74% 137.900 0.360 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -99.69% 15458.000 48.000 - 0.00% -
416.gamess (max) (percentage) -99.69% 38.550 0.120 - -7.69% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.69% 250.410 0.780 - 0.00% -
470.lbm (max) -99.60% 2746.000 11.000 - -8.33% -
470.lbm (max) (percentage) -99.57% 72.510 0.310 - -6.06% -
456.hmmer (max) -99.48% 2120.000 11.000 - 0.00% -
456.hmmer (max) (percentage) -99.47% 73.590 0.390 - -2.50% -
434.zeusmp (max) -99.42% 2055.000 12.000 - -7.69% -
434.zeusmp (max) (percentage) -99.40% 81.770 0.490 - -7.55% -
458.sjeng (unexplained diff vs previous) -99.29% 6876.000 49.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.28% 90.870 0.650 - 0.00% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
410.bwaves (max) -99.18% 3276.000 27.000 - -3.57% -
464.h264ref (max) -99.17% 3127.000 26.000 - -3.70% -
410.bwaves (max) (percentage) -99.15% 57.970 0.490 - -2.00% -
464.h264ref (max) (percentage) -99.15% 54.290 0.460 - -4.17% -
433.milc (max) -99.14% 1044.000 9.000 - -10.00% -
401.bzip2 (max) (percentage) -99.14% 78.650 0.680 - -5.56% -
401.bzip2 (max) -99.14% 2313.000 20.000 - -4.76% -
436.cactusADM (max) -99.13% 1848.000 16.000 - 100.00% -
444.namd (max) -99.12% 685.000 6.000 - -14.29% -
436.cactusADM (max) (percentage) -99.10% 88.730 0.800 - 110.53% -
429.mcf (max) -99.09% 1322.000 12.000 - -7.69% -
433.milc (max) (percentage) -99.06% 90.750 0.850 - -5.56% -
429.mcf (max) (percentage) -99.04% 92.890 0.890 - -6.32% -
444.namd (max) (percentage) -98.98% 91.790 0.940 - -6.93% -
459.GemsFDTD (max) -98.91% 4411.000 48.000 - -7.69% -
450.soplex (max) -98.90% 545.000 6.000 - 0.00% -
450.soplex (max) (percentage) -98.90% 96.240 1.060 - -6.19% -
459.GemsFDTD (max) (percentage) -98.89% 71.460 0.790 - -8.14% -
473.astar (max) -98.80% 3406.000 41.000 - -4.65% -
473.astar (max) (percentage) -98.80% 66.430 0.800 - -3.61% -
458.sjeng (max) -98.67% 3602.000 48.000 - 26.32% -
458.sjeng (max) (percentage) -98.63% 47.610 0.650 - 27.45% -
481.wrf (max) -98.63% 3801.000 52.000 - -3.70% -
481.wrf (max) (percentage) -98.62% 68.700 0.950 - -3.06% -
445.gobmk (max) (percentage) -98.61% 52.630 0.730 - -3.95% -
445.gobmk (max) -98.60% 2643.000 37.000 - -2.63% -
453.povray (max) -98.60% 499.000 7.000 - -12.50% -
462.libquantum (max) (percentage) -98.57% 98.970 1.420 - 33.96% -
482.sphinx3 (max) -98.46% 911.000 14.000 - 0.00% -
482.sphinx3 (max) (percentage) -98.41% 96.500 1.530 - -3.77% -
453.povray (max) (percentage) -98.41% 91.250 1.450 - -2.68% -
454.calculix (max) -98.36% 61.000 1.000 - 0.00% -
471.omnetpp (max) (percentage) -98.23% 79.650 1.410 - -25.79% -
471.omnetpp (max) -98.20% 2169.000 39.000 - -25.00% -
447.dealII (max) -98.19% 1384.000 25.000 - 0.00% -
447.dealII (max) (percentage) -98.18% 80.280 1.460 - -2.67% -
435.gromacs (max) (percentage) -98.03% 49.160 0.970 - -6.73% -
435.gromacs (max) -98.01% 3573.000 71.000 - -6.58% -
454.calculix (max) (percentage) -97.22% 99.730 2.770 - -5.78% -
400.perlbench (max) -96.85% 1397.000 44.000 - -2.22% -
400.perlbench (max) (percentage) -96.79% 84.060 2.700 - -2.53% -
465.tonto (max) (percentage) -96.69% 19.310 0.640 - -25.58% -
465.tonto (max) -96.69% 2112.000 70.000 - -25.53% -
483.xalancbmk (max) (percentage) -93.39% 68.670 4.540 - -2.78% -
483.xalancbmk (max) -93.13% 2621.000 180.000 - -2.70% -
403.gcc (max) (percentage) -92.90% 99.360 7.050 - -2.76% -
403.gcc (max) -92.73% 55.000 4.000 - 33.33% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
444.namd -70.59% 68.000 20.000 - -4.76% -
444.namd (avg) -70.59% 68.000 20.000 - -4.76% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
444.namd (avg) (percentage) -69.63% 9.220 2.800 - -1.75% -
470.lbm -67.36% 239.000 78.000 - -2.50% -
470.lbm (avg) -67.36% 239.000 78.000 - -2.50% -
470.lbm (avg) (percentage) -67.30% 6.330 2.070 - -1.90% -
456.hmmer -66.93% 127.000 42.000 - 0.00% -
456.hmmer (avg) -66.93% 127.000 42.000 - 0.00% -
456.hmmer (avg) (percentage) -66.89% 4.410 1.460 - 0.00% -
453.povray -66.67% 42.000 14.000 - 0.00% -
453.povray (avg) -66.67% 42.000 14.000 - 0.00% -
453.povray (avg) (percentage) -65.69% 7.810 2.680 - 0.00% -
434.zeusmp -65.31% 147.000 51.000 - 0.00% -
434.zeusmp (avg) -65.31% 147.000 51.000 - 0.00% -
434.zeusmp (avg) (percentage) -65.13% 5.850 2.040 - 0.00% -
464.h264ref -64.51% 293.000 104.000 - -0.95% -
464.h264ref (avg) -64.51% 293.000 104.000 - -0.95% -
459.GemsFDTD -64.17% 360.000 129.000 - -0.77% -
459.GemsFDTD (avg) -64.17% 360.000 129.000 - -0.77% -
464.h264ref (avg) (percentage) -64.05% 5.090 1.830 - 0.00% -
459.GemsFDTD (avg) (percentage) -63.87% 5.840 2.110 - -1.40% -
462.libquantum (avg) (percentage) -63.84% 7.660 2.770 - -1.07% -
433.milc -63.77% 69.000 25.000 - -3.85% -
433.milc (avg) -63.77% 69.000 25.000 - -3.85% -
482.sphinx3 (avg) (percentage) -63.56% 7.930 2.890 - -2.03% -
482.sphinx3 -63.51% 74.000 27.000 - 0.00% -
482.sphinx3 (avg) -63.51% 74.000 27.000 - 0.00% -
410.bwaves -62.65% 249.000 93.000 - -2.11% -
410.bwaves (avg) -62.65% 249.000 93.000 - -2.11% -
410.bwaves (avg) (percentage) -62.36% 4.410 1.660 - -1.78% -
481.wrf -62.32% 345.000 130.000 - 0.00% -
481.wrf (avg) -62.32% 345.000 130.000 - 0.00% -
433.milc (avg) (percentage) -62.31% 6.050 2.280 - 0.00% -
481.wrf (avg) (percentage) -62.02% 6.240 2.370 - 0.00% -
447.dealII -61.62% 99.000 38.000 - 0.00% -
447.dealII (avg) -61.62% 99.000 38.000 - 0.00% -
445.gobmk (avg) (percentage) -61.38% 3.910 1.510 - 0.00% -
447.dealII (avg) (percentage) -61.35% 5.770 2.230 - -2.19% -
445.gobmk -61.22% 196.000 76.000 - 0.00% -
445.gobmk (avg) -61.22% 196.000 76.000 - 0.00% -
458.sjeng -61.00% 241.000 94.000 - -1.05% -
458.sjeng (avg) -61.00% 241.000 94.000 - -1.05% -
458.sjeng (avg) (percentage) -60.50% 3.190 1.260 - -0.79% -
471.omnetpp (avg) (percentage) -60.12% 8.200 3.270 - -2.10% -
401.bzip2 (avg) (percentage) -59.85% 5.480 2.200 - 0.00% -
471.omnetpp -59.64% 223.000 90.000 - -2.17% -
471.omnetpp (avg) -59.64% 223.000 90.000 - -2.17% -
436.cactusADM (avg) (percentage) -59.03% 5.980 2.450 - -1.21% -
401.bzip2 -59.01% 161.000 66.000 - 0.00% -
401.bzip2 (avg) -59.01% 161.000 66.000 - 0.00% -
436.cactusADM -58.87% 124.000 51.000 - -1.92% -
436.cactusADM (avg) -58.87% 124.000 51.000 - -1.92% -
450.soplex (avg) (percentage) -55.68% 6.430 2.850 - 0.35% -
450.soplex -55.56% 36.000 16.000 - 0.00% -
450.soplex (avg) -55.56% 36.000 16.000 - 0.00% -
400.perlbench -54.29% 105.000 48.000 - 0.00% -
400.perlbench (avg) -54.29% 105.000 48.000 - 0.00% -
400.perlbench (avg) (percentage) -53.23% 6.350 2.970 - 0.00% -
435.gromacs (avg) (percentage) -51.58% 5.060 2.450 - 0.00% -
465.tonto (avg) (percentage) -51.50% 3.340 1.620 - -3.57% -
465.tonto -51.23% 365.000 178.000 - -3.78% -
465.tonto (avg) -51.23% 365.000 178.000 - -3.78% -
435.gromacs -50.68% 367.000 181.000 - 0.56% -
435.gromacs (avg) -50.68% 367.000 181.000 - 0.56% -
473.astar (avg) (percentage) -50.48% 4.160 2.060 - -2.37% -
483.xalancbmk (avg) (percentage) -50.15% 6.500 3.240 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
473.astar -49.77% 213.000 107.000 - -2.73% -
473.astar (avg) -49.77% 213.000 107.000 - -2.73% -
483.xalancbmk -48.39% 248.000 128.000 - 0.00% -
483.xalancbmk (avg) -48.39% 248.000 128.000 - 0.00% -
454.calculix (avg) (percentage) -45.51% 8.020 4.370 - 0.00% -
437.leslie3d (unexplained diff vs previous) -30.64% 2314.000 1605.000 - 0.00% -
437.leslie3d (max) -27.84% 1929.000 1392.000 - 87.60% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) -23.34% 19.880 15.240 - 0.00% -
403.gcc (avg) (percentage) -20.90% 7.320 5.790 - 0.00% -
437.leslie3d (max) (percentage) -20.27% 16.580 13.220 - 116.01% -
429.mcf -18.35% 109.000 89.000 - -2.20% -
429.mcf (avg) -18.35% 109.000 89.000 - -2.20% -
429.mcf (avg) (percentage) -17.60% 7.670 6.320 - -2.32% -

Report Time: 0.37s
Execution (seconds)
Name Current %
400.perlbench 1631.000 -
401.bzip2 3003.000 -
403.gcc 59.000 7.27%
410.bwaves 5632.000 -
429.mcf 1418.000 -
433.milc 1140.000 -
434.zeusmp 2530.000 1.12%
435.gromacs 7416.000 -
436.cactusADM 2102.000 -
437.leslie3d 10532.000 -13.22%
444.namd 742.000 -
445.gobmk 5078.000 -
447.dealII 1723.000 -
450.soplex 585.000 -
453.povray 548.000 -
454.calculix 63.000 -
456.hmmer 2918.000 -
458.sjeng 7510.000 -
459.GemsFDTD 6130.000 -
462.libquantum 139.000 -1.42%
464.h264ref 5721.000 -
465.tonto 11017.000 -
470.lbm 3816.000 -
471.omnetpp 2781.000 -
473.astar 5214.000 -
481.wrf 5496.000 -
482.sphinx3 939.000 -
483.xalancbmk 3965.000 -
Geometric Mean 1975.811 -
Code Size (bytes)
Name Current %
400.perlbench 900219.000 1.86%
401.bzip2 44201.000 -
403.gcc 2445023.000 -
410.bwaves 16720.000 -
429.mcf 9119.000 -
433.milc 61354.000 -
434.zeusmp 152069.000 -
435.gromacs 498313.000 -
436.cactusADM 352955.000 -
437.leslie3d 59347.000 -
444.namd 188116.000 -
445.gobmk 1378206.000 -
447.dealII 311258.000 -
450.soplex 204341.000 -
453.povray 653573.000 -
454.calculix 838482.000 -
456.hmmer 108331.000 -
458.sjeng 103580.000 -
459.GemsFDTD 241260.000 -
462.libquantum 16077.000 -
464.h264ref 386508.000 -1.04%
465.tonto 1939526.000 -
470.lbm 9707.000 -
471.omnetpp 480768.000 -
473.astar 22916.000 -
481.wrf 1962642.000 -
482.sphinx3 112735.000 -
483.xalancbmk 2331940.000 -
Geometric Mean 199052.668 -
sample variability
Name Current %
400.perlbench 48.000 -
400.perlbench (avg) 48.000 -
400.perlbench (avg) (percentage) 2.970 -
400.perlbench (max) 44.000 -2.22%
400.perlbench (max) (percentage) 2.700 -2.53%
401.bzip2 66.000 -
401.bzip2 (avg) 66.000 -
401.bzip2 (avg) (percentage) 2.200 -
401.bzip2 (max) 20.000 -4.76%
401.bzip2 (max) (percentage) 0.680 -5.56%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.790 -
403.gcc (max) 4.000 33.33%
403.gcc (max) (percentage) 7.050 -2.76%
410.bwaves 93.000 -2.11%
410.bwaves (avg) 93.000 -2.11%
410.bwaves (avg) (percentage) 1.660 -1.78%
410.bwaves (max) 27.000 -3.57%
410.bwaves (max) (percentage) 0.490 -2.00%
410.bwaves (unexplained diff vs previous) 20.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.360 -
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.120 -7.69%
429.mcf 89.000 -2.20%
429.mcf (avg) 89.000 -2.20%
429.mcf (avg) (percentage) 6.320 -2.32%
429.mcf (max) 12.000 -7.69%
429.mcf (max) (percentage) 0.890 -6.32%
429.mcf (unexplained diff vs previous) 3.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.210 -
433.milc 25.000 -3.85%
433.milc (avg) 25.000 -3.85%
433.milc (avg) (percentage) 2.280 -
433.milc (max) 9.000 -10.00%
433.milc (max) (percentage) 0.850 -5.56%
434.zeusmp 51.000 -
434.zeusmp (avg) 51.000 -
434.zeusmp (avg) (percentage) 2.040 -
434.zeusmp (max) 12.000 -7.69%
434.zeusmp (max) (percentage) 0.490 -7.55%
435.gromacs 181.000 -
435.gromacs (avg) 181.000 -
435.gromacs (avg) (percentage) 2.450 -
435.gromacs (max) 71.000 -6.58%
435.gromacs (max) (percentage) 0.970 -6.73%
436.cactusADM 51.000 -1.92%
436.cactusADM (avg) 51.000 -1.92%
436.cactusADM (avg) (percentage) 2.450 -1.21%
436.cactusADM (max) 16.000 100.00%
436.cactusADM (max) (percentage) 0.800 110.53%
436.cactusADM (unexplained diff vs previous) 17.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.810 -
437.leslie3d 471.000 -8.54%
437.leslie3d (avg) 471.000 -8.54%
437.leslie3d (avg) (percentage) 4.480 5.41%
437.leslie3d (max) 1392.000 87.60%
437.leslie3d (max) (percentage) 13.220 116.01%
437.leslie3d (unexplained diff vs previous) 1605.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 15.240 -
444.namd 20.000 -4.76%
444.namd (avg) 20.000 -4.76%
444.namd (avg) (percentage) 2.800 -1.75%
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.940 -6.93%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.670 -
445.gobmk 76.000 -
445.gobmk (avg) 76.000 -
445.gobmk (avg) (percentage) 1.510 -
445.gobmk (max) 37.000 -2.63%
445.gobmk (max) (percentage) 0.730 -3.95%
447.dealII 38.000 -
447.dealII (avg) 38.000 -
447.dealII (avg) (percentage) 2.230 -2.19%
447.dealII (max) 25.000 -
447.dealII (max) (percentage) 1.460 -2.67%
447.dealII (unexplained diff vs previous) 15.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.870 -
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 2.850 -
450.soplex (max) 6.000 -
450.soplex (max) (percentage) 1.060 -6.19%
453.povray 14.000 -
453.povray (avg) 14.000 -
453.povray (avg) (percentage) 2.680 -
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.450 -2.68%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.370 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 2.770 -5.78%
456.hmmer 42.000 -
456.hmmer (avg) 42.000 -
456.hmmer (avg) (percentage) 1.460 -
456.hmmer (max) 11.000 -
456.hmmer (max) (percentage) 0.390 -2.50%
458.sjeng 94.000 -1.05%
458.sjeng (avg) 94.000 -1.05%
458.sjeng (avg) (percentage) 1.260 -
458.sjeng (max) 48.000 26.32%
458.sjeng (max) (percentage) 0.650 27.45%
458.sjeng (unexplained diff vs previous) 49.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.650 -
459.GemsFDTD 129.000 -
459.GemsFDTD (avg) 129.000 -
459.GemsFDTD (avg) (percentage) 2.110 -1.40%
459.GemsFDTD (max) 48.000 -7.69%
459.GemsFDTD (max) (percentage) 0.790 -8.14%
459.GemsFDTD (unexplained diff vs previous) 48.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.780 -
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.770 -1.07%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.420 33.96%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.440 -
464.h264ref 104.000 -
464.h264ref (avg) 104.000 -
464.h264ref (avg) (percentage) 1.830 -
464.h264ref (max) 26.000 -3.70%
464.h264ref (max) (percentage) 0.460 -4.17%
465.tonto 178.000 -3.78%
465.tonto (avg) 178.000 -3.78%
465.tonto (avg) (percentage) 1.620 -3.57%
465.tonto (max) 70.000 -25.53%
465.tonto (max) (percentage) 0.640 -25.58%
465.tonto (unexplained diff vs previous) 1.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.010 -
470.lbm 78.000 -2.50%
470.lbm (avg) 78.000 -2.50%
470.lbm (avg) (percentage) 2.070 -1.90%
470.lbm (max) 11.000 -8.33%
470.lbm (max) (percentage) 0.310 -6.06%
470.lbm (unexplained diff vs previous) 5.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.130 -
471.omnetpp 90.000 -2.17%
471.omnetpp (avg) 90.000 -2.17%
471.omnetpp (avg) (percentage) 3.270 -2.10%
471.omnetpp (max) 39.000 -25.00%
471.omnetpp (max) (percentage) 1.410 -25.79%
471.omnetpp (unexplained diff vs previous) 10.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.360 -
473.astar 107.000 -2.73%
473.astar (avg) 107.000 -2.73%
473.astar (avg) (percentage) 2.060 -2.37%
473.astar (max) 41.000 -4.65%
473.astar (max) (percentage) 0.800 -3.61%
473.astar (unexplained diff vs previous) 14.000 -
473.astar (unexplained diff vs previous) (percentage) 0.270 -
481.wrf 130.000 -
481.wrf (avg) 130.000 -
481.wrf (avg) (percentage) 2.370 -
481.wrf (max) 52.000 -3.70%
481.wrf (max) (percentage) 0.950 -3.06%
482.sphinx3 27.000 -
482.sphinx3 (avg) 27.000 -
482.sphinx3 (avg) (percentage) 2.890 -2.03%
482.sphinx3 (max) 14.000 -
482.sphinx3 (max) (percentage) 1.530 -3.77%
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.320 -
483.xalancbmk 128.000 -
483.xalancbmk (avg) 128.000 -
483.xalancbmk (avg) (percentage) 3.240 -
483.xalancbmk (max) 180.000 -2.70%
483.xalancbmk (max) (percentage) 4.540 -2.78%
Geometric Mean 7.911 -21.64%