Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1d8f691da90daae3e34c69ba553817e261166f5b (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/962ca7149d652e4077a2259886e5cd2ea3cea0ab (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d90b43a4ed475dac5b0cd6e01ceb35c7b0f7f2ff (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (unchanged)
regression GNU-959
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/131/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0131 (basepoints/gcc-14-04329-g962ca7149d6) 2023-09-30T00:25:31 0:00:00
Previous 0125 (basepoints/gcc-14-04312-g8552dcd8e44) 2023-09-27T01:40:37 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 85 11
Performance Improvements 40 174
Added Tests 12 0
Unchanged Tests 1099 1051
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.95% 204340.000 208330.000 - 1.58% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 8.93% 56.000 61.000 - 8.93% -
437.leslie3d 5.19% 10240.000 10771.000 - -7.47% -
450.soplex 2.01% 547.000 558.000 - -1.59% -
481.wrf 1.99% 5333.000 5439.000 - -1.72% -
462.libquantum 1.48% 135.000 137.000 - -2.14% -
434.zeusmp 1.33% 2473.000 2506.000 - -0.32% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) 3061.54% 13.000 411.000 - -68.91% -
429.mcf (max) (percentage) 2844.30% 0.790 23.260 - -74.96% -
465.tonto (max) 663.49% 63.000 481.000 - -77.23% -
465.tonto (max) (percentage) 653.33% 0.600 4.520 - -76.59% -
470.lbm (max) 570.00% 10.000 67.000 - -97.56% -
458.sjeng (max) 561.11% 18.000 119.000 - -96.70% -
458.sjeng (max) (percentage) 548.00% 0.250 1.620 - -96.60% -
470.lbm (max) (percentage) 524.14% 0.290 1.810 - -97.50% -
444.namd (max) 366.67% 3.000 14.000 - -97.96% -
435.gromacs (max) 363.79% 58.000 269.000 - -92.47% -
435.gromacs (max) (percentage) 355.95% 0.840 3.830 - -92.21% -
433.milc (max) 350.00% 4.000 18.000 - -98.28% -
401.bzip2 (max) 338.10% 21.000 92.000 - -96.02% -
401.bzip2 (max) (percentage) 332.00% 0.750 3.240 - -95.88% -
433.milc (max) (percentage) 307.32% 0.410 1.670 - -98.16% -
444.namd (max) (percentage) 300.00% 0.490 1.960 - -97.86% -
450.soplex (max) 300.00% 9.000 36.000 - -93.39% -
459.GemsFDTD (max) 291.89% 37.000 145.000 - -96.71% -
410.bwaves (max) 291.18% 34.000 133.000 - -95.94% -
459.GemsFDTD (max) (percentage) 290.32% 0.620 2.420 - -96.61% -
436.cactusADM (max) 288.89% 9.000 35.000 - -98.11% -
410.bwaves (max) (percentage) 285.48% 0.620 2.390 - -95.88% -
436.cactusADM (max) (percentage) 283.72% 0.430 1.650 - -98.14% -
450.soplex (max) (percentage) 269.32% 1.760 6.500 - -93.25% -
473.astar (max) 219.72% 71.000 227.000 - -93.34% -
473.astar (max) (percentage) 219.72% 1.420 4.540 - -93.17% -
462.libquantum (max) 200.00% 1.000 3.000 - -97.83% -
434.zeusmp (max) 178.57% 14.000 39.000 - -98.10% -
434.zeusmp (max) (percentage) 166.10% 0.590 1.570 - -98.08% -
482.sphinx3 (max) 162.50% 8.000 21.000 - -97.69% -
464.h264ref (max) (percentage) 159.46% 0.370 0.960 - -98.23% -
482.sphinx3 (max) (percentage) 153.19% 0.940 2.380 - -97.53% -
464.h264ref (max) 152.38% 21.000 53.000 - -98.31% -
447.dealII (max) 110.00% 10.000 21.000 - -98.48% -
462.libquantum (max) (percentage) 103.76% 1.330 2.710 - -97.26% -
447.dealII (max) (percentage) 101.61% 0.620 1.250 - -98.44% -
454.calculix (max) (percentage) 51.40% 2.140 3.240 - -96.75% -
403.gcc 50.00% 2.000 3.000 - -25.00% -
403.gcc (avg) 50.00% 2.000 3.000 - -25.00% -
456.hmmer (max) 44.44% 9.000 13.000 - -99.39% -
445.gobmk (max) (percentage) 38.46% 1.170 1.620 - -96.92% -
456.hmmer (max) (percentage) 36.36% 0.330 0.450 - -99.39% -
445.gobmk (max) 32.76% 58.000 77.000 - -97.09% -
481.wrf (max) 17.86% 84.000 99.000 - -97.40% -
481.wrf (max) (percentage) 15.09% 1.590 1.830 - -97.34% -
429.mcf 12.50% 96.000 108.000 - -0.92% -
429.mcf (avg) 12.50% 96.000 108.000 - -0.92% -
429.mcf (avg) (percentage) 12.07% 5.470 6.130 - -20.08% -
465.tonto 7.50% 160.000 172.000 - -52.88% -
465.tonto (avg) 7.50% 160.000 172.000 - -52.88% -
465.tonto (avg) (percentage) 7.28% 1.510 1.620 - -51.50% -
450.soplex 7.14% 14.000 15.000 - -58.33% -
450.soplex (avg) 7.14% 14.000 15.000 - -58.33% -
473.astar 5.88% 102.000 108.000 - -49.30% -
473.astar (avg) 5.88% 102.000 108.000 - -49.30% -
473.astar (avg) (percentage) 5.37% 2.050 2.160 - -48.08% -
437.leslie3d 4.73% 507.000 531.000 - 49.58% -
437.leslie3d (avg) 4.73% 507.000 531.000 - 49.58% -
450.soplex (avg) (percentage) 4.21% 2.610 2.720 - -57.70% -
458.sjeng 3.66% 82.000 85.000 - -64.73% -
458.sjeng (avg) 3.66% 82.000 85.000 - -64.73% -
458.sjeng (avg) (percentage) 2.68% 1.120 1.150 - -63.95% -
435.gromacs 2.47% 162.000 166.000 - -54.77% -
435.gromacs (avg) 2.47% 162.000 166.000 - -54.77% -
410.bwaves 2.41% 83.000 85.000 - -65.86% -
410.bwaves (avg) 2.41% 83.000 85.000 - -65.86% -
434.zeusmp 2.33% 43.000 44.000 - -70.07% -
434.zeusmp (avg) 2.33% 43.000 44.000 - -70.07% -
435.gromacs (avg) (percentage) 2.16% 2.320 2.370 - -53.16% -
401.bzip2 (avg) (percentage) 2.03% 1.970 2.010 - -63.32% -
401.bzip2 1.79% 56.000 57.000 - -64.60% -
401.bzip2 (avg) 1.79% 56.000 57.000 - -64.60% -
459.GemsFDTD 1.74% 115.000 117.000 - -67.50% -
459.GemsFDTD (avg) 1.74% 115.000 117.000 - -67.50% -
481.wrf 1.69% 118.000 120.000 - -65.22% -
481.wrf (avg) 1.69% 118.000 120.000 - -65.22% -
410.bwaves (avg) (percentage) 1.32% 1.510 1.530 - -65.31% -
459.GemsFDTD (avg) (percentage) 1.03% 1.940 1.960 - -66.44% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
434.zeusmp -1.36% 152069.000 150007.000 - -1.34% -
481.wrf -1.09% 1962154.000 1940842.000 - -0.81% -
437.leslie3d -1.02% 59475.000 58866.000 - -1.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -4.19% 1599.000 1532.000 - -7.88% -
445.gobmk -3.26% 4970.000 4808.000 - -4.28% -
464.h264ref -1.75% 5717.000 5617.000 - -2.50% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -65.87% 4.630 1.580 - -99.60% -
471.omnetpp (unexplained diff vs previous) -65.85% 123.000 42.000 - -99.61% -
400.perlbench (max) -31.58% 38.000 26.000 - -98.14% -
400.perlbench (max) (percentage) -28.51% 2.420 1.730 - -97.94% -
471.omnetpp (max) (percentage) -20.09% 4.430 3.540 - -95.56% -
471.omnetpp (max) -19.66% 117.000 94.000 - -95.67% -
453.povray (max) -12.50% 8.000 7.000 - -98.60% -
453.povray -7.69% 13.000 12.000 - -71.43% -
453.povray (avg) -7.69% 13.000 12.000 - -71.43% -
400.perlbench -6.82% 44.000 41.000 - -60.95% -
400.perlbench (avg) -6.82% 44.000 41.000 - -60.95% -
403.gcc (max) (percentage) -5.30% 3.960 3.750 - -96.23% -
453.povray (max) (percentage) -5.23% 1.530 1.450 - -98.41% -
433.milc -4.35% 23.000 22.000 - -68.12% -
433.milc (avg) -4.35% 23.000 22.000 - -68.12% -
437.leslie3d (max) (percentage) -3.95% 8.860 8.510 - -48.67% -
464.h264ref -3.09% 97.000 94.000 - -67.92% -
464.h264ref (avg) -3.09% 97.000 94.000 - -67.92% -
447.dealII -2.86% 35.000 34.000 - -65.66% -
447.dealII (avg) -2.86% 35.000 34.000 - -65.66% -
445.gobmk -2.78% 72.000 70.000 - -64.29% -
445.gobmk (avg) -2.78% 72.000 70.000 - -64.29% -
471.omnetpp (avg) (percentage) -1.67% 3.000 2.950 - -64.02% -
456.hmmer (avg) (percentage) -1.55% 1.290 1.270 - -71.20% -
470.lbm -1.47% 68.000 67.000 - -71.97% -
470.lbm (avg) -1.47% 68.000 67.000 - -71.97% -
447.dealII (avg) (percentage) -1.46% 2.060 2.030 - -64.82% -
400.perlbench (avg) (percentage) -1.44% 2.780 2.740 - -56.85% -
471.omnetpp -1.27% 79.000 78.000 - -65.02% -
471.omnetpp (avg) -1.27% 79.000 78.000 - -65.02% -
453.povray (avg) (percentage) -1.23% 2.430 2.400 - -69.27% -
444.namd (avg) (percentage) -1.19% 2.530 2.500 - -72.89% -
464.h264ref (avg) (percentage) -1.18% 1.700 1.680 - -66.99% -
470.lbm (avg) (percentage) -1.09% 1.830 1.810 - -71.41% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
470.lbm (unexplained diff vs previous)
470.lbm (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 7.51% 104048.000 111860.000 - 0.00% -
450.soplex 1.58% 205081.000 208330.000 - 1.95% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.30% 1424.000 1770.000 - 0.23% -
403.gcc 8.93% 56.000 61.000 - 8.93% -
436.cactusADM 3.22% 2083.000 2150.000 - 0.51% -
456.hmmer 1.67% 2882.000 2930.000 - 0.24% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 61.64% 3.050 4.930 - -0.60% -
437.leslie3d 49.58% 355.000 531.000 - 4.73% -
437.leslie3d (avg) 49.58% 355.000 531.000 - 4.73% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.52% 387748.000 381848.000 - -0.05% -
459.GemsFDTD -1.46% 244728.000 241156.000 - -0.31% -
434.zeusmp -1.34% 152037.000 150007.000 - -1.36% -
453.povray -1.19% 661389.000 653525.000 - 0.01% -
437.leslie3d -1.03% 59479.000 58866.000 - -1.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench -7.88% 1663.000 1532.000 - -4.19% -
437.leslie3d -7.47% 11640.000 10771.000 - 5.19% -
445.gobmk -4.28% 5023.000 4808.000 - -3.26% -
482.sphinx3 -3.39% 945.000 913.000 - -0.65% -
454.calculix -3.23% 62.000 60.000 - 0.00% -
435.gromacs -3.14% 7269.000 7041.000 - 0.64% -
465.tonto -2.71% 10941.000 10645.000 - 0.10% -
459.GemsFDTD -2.64% 6173.000 6010.000 - 0.59% -
401.bzip2 -2.55% 2941.000 2866.000 - 0.24% -
464.h264ref -2.50% 5761.000 5617.000 - -1.75% -
473.astar -2.50% 5128.000 5000.000 - -0.12% -
458.sjeng -2.26% 7567.000 7396.000 - -0.09% -
433.milc -2.17% 1151.000 1126.000 - 0.27% -
471.omnetpp -2.17% 2724.000 2665.000 - 0.38% -
462.libquantum -2.14% 140.000 137.000 - 1.48% -
481.wrf -1.72% 5534.000 5439.000 - 1.99% -
450.soplex -1.59% 567.000 558.000 - 2.01% -
447.dealII -1.39% 1724.000 1700.000 - -0.53% -
410.bwaves -1.31% 5652.000 5578.000 - 1.00% -
453.povray -1.28% 547.000 540.000 - -0.92% -
470.lbm -1.21% 3788.000 3742.000 - -0.66% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.460 - 0.00% -
444.namd (unexplained diff vs previous) -99.88% 8356.000 10.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -99.88% 1118.610 1.350 - 0.00% -
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.61% 10659.000 42.000 - -65.85% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.60% 391.300 1.580 - -65.87% -
456.hmmer (max) (percentage) -99.39% 73.590 0.450 - 36.36% -
456.hmmer (max) -99.39% 2120.000 13.000 - 44.44% -
470.lbm (unexplained diff vs previous) -99.31% 9990.000 69.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -99.30% 263.730 1.840 - 0.00% -
453.povray (max) -98.60% 499.000 7.000 - -12.50% -
429.mcf (unexplained diff vs previous) (percentage) -98.55% 1305.690 18.870 - 0.00% -
447.dealII (max) -98.48% 1384.000 21.000 - 110.00% -
447.dealII (max) (percentage) -98.44% 80.280 1.250 - 101.61% -
453.povray (max) (percentage) -98.41% 91.250 1.450 - -5.23% -
454.calculix (max) -98.36% 61.000 1.000 - 0.00% -
464.h264ref (max) -98.31% 3127.000 53.000 - 152.38% -
433.milc (max) -98.28% 1044.000 18.000 - 350.00% -
464.h264ref (max) (percentage) -98.23% 54.290 0.960 - 159.46% -
458.sjeng (unexplained diff vs previous) -98.23% 6876.000 122.000 - 0.00% -
429.mcf (unexplained diff vs previous) -98.20% 18593.000 334.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -98.18% 90.870 1.650 - 0.00% -
433.milc (max) (percentage) -98.16% 90.750 1.670 - 307.32% -
436.cactusADM (max) (percentage) -98.14% 88.730 1.650 - 283.72% -
400.perlbench (max) -98.14% 1397.000 26.000 - -31.58% -
436.cactusADM (max) -98.11% 1848.000 35.000 - 288.89% -
434.zeusmp (max) -98.10% 2055.000 39.000 - 178.57% -
434.zeusmp (max) (percentage) -98.08% 81.770 1.570 - 166.10% -
444.namd (max) -97.96% 685.000 14.000 - 366.67% -
400.perlbench (max) (percentage) -97.94% 84.060 1.730 - -28.51% -
444.namd (max) (percentage) -97.86% 91.790 1.960 - 300.00% -
462.libquantum (max) -97.83% 138.000 3.000 - 200.00% -
482.sphinx3 (max) -97.69% 911.000 21.000 - 162.50% -
473.astar (unexplained diff vs previous) -97.65% 10146.000 238.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -97.59% 197.850 4.760 - 0.00% -
470.lbm (max) -97.56% 2746.000 67.000 - 570.00% -
482.sphinx3 (max) (percentage) -97.53% 96.500 2.380 - 153.19% -
470.lbm (max) (percentage) -97.50% 72.510 1.810 - 524.14% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
481.wrf (max) -97.40% 3801.000 99.000 - 17.86% -
481.wrf (max) (percentage) -97.34% 68.700 1.830 - 15.09% -
462.libquantum (max) (percentage) -97.26% 98.970 2.710 - 103.76% -
445.gobmk (max) -97.09% 2643.000 77.000 - 32.76% -
445.gobmk (max) (percentage) -96.92% 52.630 1.620 - 38.46% -
454.calculix (max) (percentage) -96.75% 99.730 3.240 - 51.40% -
459.GemsFDTD (max) -96.71% 4411.000 145.000 - 291.89% -
458.sjeng (max) -96.70% 3602.000 119.000 - 561.11% -
459.GemsFDTD (max) (percentage) -96.61% 71.460 2.420 - 290.32% -
458.sjeng (max) (percentage) -96.60% 47.610 1.620 - 548.00% -
403.gcc (max) -96.36% 55.000 2.000 - 0.00% -
403.gcc (max) (percentage) -96.23% 99.360 3.750 - -5.30% -
401.bzip2 (max) -96.02% 2313.000 92.000 - 338.10% -
410.bwaves (max) -95.94% 3276.000 133.000 - 291.18% -
401.bzip2 (max) (percentage) -95.88% 78.650 3.240 - 332.00% -
410.bwaves (max) (percentage) -95.88% 57.970 2.390 - 285.48% -
471.omnetpp (max) -95.67% 2169.000 94.000 - -19.66% -
471.omnetpp (max) (percentage) -95.56% 79.650 3.540 - -20.09% -
450.soplex (max) -93.39% 545.000 36.000 - 300.00% -
473.astar (max) -93.34% 3406.000 227.000 - 219.72% -
450.soplex (max) (percentage) -93.25% 96.240 6.500 - 269.32% -
473.astar (max) (percentage) -93.17% 66.430 4.540 - 219.72% -
435.gromacs (max) -92.47% 3573.000 269.000 - 363.79% -
435.gromacs (max) (percentage) -92.21% 49.160 3.830 - 355.95% -
465.tonto (max) -77.23% 2112.000 481.000 - 663.49% -
465.tonto (max) (percentage) -76.59% 19.310 4.520 - 653.33% -
429.mcf (max) (percentage) -74.96% 92.890 23.260 - 2844.30% -
444.namd -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) (percentage) -72.89% 9.220 2.500 - -1.19% -
470.lbm -71.97% 239.000 67.000 - -1.47% -
470.lbm (avg) -71.97% 239.000 67.000 - -1.47% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
453.povray -71.43% 42.000 12.000 - -7.69% -
453.povray (avg) -71.43% 42.000 12.000 - -7.69% -
470.lbm (avg) (percentage) -71.41% 6.330 1.810 - -1.09% -
456.hmmer (avg) (percentage) -71.20% 4.410 1.270 - -1.55% -
456.hmmer -70.87% 127.000 37.000 - 0.00% -
456.hmmer (avg) -70.87% 127.000 37.000 - 0.00% -
434.zeusmp -70.07% 147.000 44.000 - 2.33% -
434.zeusmp (avg) -70.07% 147.000 44.000 - 2.33% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
434.zeusmp (avg) (percentage) -69.74% 5.850 1.770 - 0.00% -
453.povray (avg) (percentage) -69.27% 7.810 2.400 - -1.23% -
482.sphinx3 -68.92% 74.000 23.000 - 0.00% -
482.sphinx3 (avg) -68.92% 74.000 23.000 - 0.00% -
429.mcf (max) -68.91% 1322.000 411.000 - 3061.54% -
462.libquantum (avg) (percentage) -68.28% 7.660 2.430 - -0.41% -
433.milc -68.12% 69.000 22.000 - -4.35% -
433.milc (avg) -68.12% 69.000 22.000 - -4.35% -
464.h264ref -67.92% 293.000 94.000 - -3.09% -
464.h264ref (avg) -67.92% 293.000 94.000 - -3.09% -
482.sphinx3 (avg) (percentage) -67.84% 7.930 2.550 - 0.00% -
459.GemsFDTD -67.50% 360.000 117.000 - 1.74% -
459.GemsFDTD (avg) -67.50% 360.000 117.000 - 1.74% -
464.h264ref (avg) (percentage) -66.99% 5.090 1.680 - -1.18% -
459.GemsFDTD (avg) (percentage) -66.44% 5.840 1.960 - 1.03% -
433.milc (avg) (percentage) -66.28% 6.050 2.040 - -0.49% -
410.bwaves -65.86% 249.000 85.000 - 2.41% -
410.bwaves (avg) -65.86% 249.000 85.000 - 2.41% -
447.dealII -65.66% 99.000 34.000 - -2.86% -
447.dealII (avg) -65.66% 99.000 34.000 - -2.86% -
410.bwaves (avg) (percentage) -65.31% 4.410 1.530 - 1.32% -
481.wrf -65.22% 345.000 120.000 - 1.69% -
481.wrf (avg) -65.22% 345.000 120.000 - 1.69% -
471.omnetpp -65.02% 223.000 78.000 - -1.27% -
471.omnetpp (avg) -65.02% 223.000 78.000 - -1.27% -
447.dealII (avg) (percentage) -64.82% 5.770 2.030 - -1.46% -
458.sjeng -64.73% 241.000 85.000 - 3.66% -
458.sjeng (avg) -64.73% 241.000 85.000 - 3.66% -
401.bzip2 -64.60% 161.000 57.000 - 1.79% -
401.bzip2 (avg) -64.60% 161.000 57.000 - 1.79% -
481.wrf (avg) (percentage) -64.42% 6.240 2.220 - -0.45% -
445.gobmk -64.29% 196.000 70.000 - -2.78% -
445.gobmk (avg) -64.29% 196.000 70.000 - -2.78% -
471.omnetpp (avg) (percentage) -64.02% 8.200 2.950 - -1.67% -
458.sjeng (avg) (percentage) -63.95% 3.190 1.150 - 2.68% -
436.cactusADM (avg) (percentage) -63.88% 5.980 2.160 - -0.46% -
401.bzip2 (avg) (percentage) -63.32% 5.480 2.010 - 2.03% -
436.cactusADM -62.90% 124.000 46.000 - 0.00% -
436.cactusADM (avg) -62.90% 124.000 46.000 - 0.00% -
445.gobmk (avg) (percentage) -62.66% 3.910 1.460 - 0.69% -
400.perlbench -60.95% 105.000 41.000 - -6.82% -
400.perlbench (avg) -60.95% 105.000 41.000 - -6.82% -
450.soplex -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) -58.33% 36.000 15.000 - 7.14% -
450.soplex (avg) (percentage) -57.70% 6.430 2.720 - 4.21% -
400.perlbench (avg) (percentage) -56.85% 6.350 2.740 - -1.44% -
435.gromacs -54.77% 367.000 166.000 - 2.47% -
435.gromacs (avg) -54.77% 367.000 166.000 - 2.47% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
435.gromacs (avg) (percentage) -53.16% 5.060 2.370 - 2.16% -
465.tonto -52.88% 365.000 172.000 - 7.50% -
465.tonto (avg) -52.88% 365.000 172.000 - 7.50% -
437.leslie3d (max) -52.51% 1929.000 916.000 - 0.99% -
465.tonto (avg) (percentage) -51.50% 3.340 1.620 - 7.28% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
473.astar -49.30% 213.000 108.000 - 5.88% -
473.astar (avg) -49.30% 213.000 108.000 - 5.88% -
454.calculix (avg) (percentage) -48.88% 8.020 4.100 - -0.49% -
437.leslie3d (max) (percentage) -48.67% 16.580 8.510 - -3.95% -
473.astar (avg) (percentage) -48.08% 4.160 2.160 - 5.37% -
403.gcc (avg) (percentage) -28.83% 7.320 5.210 - 0.00% -
403.gcc -25.00% 4.000 3.000 - 50.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 50.00% -
429.mcf (avg) (percentage) -20.08% 7.670 6.130 - 12.07% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1532.000 -4.19%
401.bzip2 2866.000 -
403.gcc 61.000 8.93%
410.bwaves 5578.000 -
429.mcf 1770.000 -
433.milc 1126.000 -
434.zeusmp 2506.000 1.33%
435.gromacs 7041.000 -
436.cactusADM 2150.000 -
437.leslie3d 10771.000 5.19%
444.namd 741.000 -
445.gobmk 4808.000 -3.26%
447.dealII 1700.000 -
450.soplex 558.000 2.01%
453.povray 540.000 -
454.calculix 60.000 -
456.hmmer 2930.000 -
458.sjeng 7396.000 -
459.GemsFDTD 6010.000 -
462.libquantum 137.000 1.48%
464.h264ref 5617.000 -1.75%
465.tonto 10645.000 -
470.lbm 3742.000 -
471.omnetpp 2665.000 -
473.astar 5000.000 -
481.wrf 5439.000 1.99%
482.sphinx3 913.000 -
Geometric Mean 1903.260 -
Code Size (bytes)
Name Current %
400.perlbench 900195.000 -
401.bzip2 44043.000 -
403.gcc 2444251.000 -
410.bwaves 16596.000 -
429.mcf 9119.000 -
433.milc 61121.000 -
434.zeusmp 150007.000 -1.36%
435.gromacs 498213.000 -
436.cactusADM 350929.000 -
437.leslie3d 58866.000 -1.02%
444.namd 188128.000 -
445.gobmk 1381766.000 -
447.dealII 311058.000 -
450.soplex 208330.000 1.95%
453.povray 653525.000 -
454.calculix 837902.000 -
456.hmmer 108307.000 -
458.sjeng 111860.000 -
459.GemsFDTD 241156.000 -
462.libquantum 16125.000 -
464.h264ref 381848.000 -
465.tonto 1934842.000 -
470.lbm 9707.000 -
471.omnetpp 480712.000 -
473.astar 22920.000 -
481.wrf 1940842.000 -1.09%
482.sphinx3 112747.000 -
Geometric Mean 181923.416 -
sample variability
Name Current %
400.perlbench 41.000 -6.82%
400.perlbench (avg) 41.000 -6.82%
400.perlbench (avg) (percentage) 2.740 -1.44%
400.perlbench (max) 26.000 -31.58%
400.perlbench (max) (percentage) 1.730 -28.51%
401.bzip2 57.000 1.79%
401.bzip2 (avg) 57.000 1.79%
401.bzip2 (avg) (percentage) 2.010 2.03%
401.bzip2 (max) 92.000 338.10%
401.bzip2 (max) (percentage) 3.240 332.00%
403.gcc 3.000 50.00%
403.gcc (avg) 3.000 50.00%
403.gcc (avg) (percentage) 5.210 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.750 -5.30%
410.bwaves 85.000 2.41%
410.bwaves (avg) 85.000 2.41%
410.bwaves (avg) (percentage) 1.530 1.32%
410.bwaves (max) 133.000 291.18%
410.bwaves (max) (percentage) 2.390 285.48%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.100 -
429.mcf 108.000 12.50%
429.mcf (avg) 108.000 12.50%
429.mcf (avg) (percentage) 6.130 12.07%
429.mcf (max) 411.000 3061.54%
429.mcf (max) (percentage) 23.260 2844.30%
429.mcf (unexplained diff vs previous) 334.000 -
429.mcf (unexplained diff vs previous) (percentage) 18.870 -
433.milc 22.000 -4.35%
433.milc (avg) 22.000 -4.35%
433.milc (avg) (percentage) 2.040 -
433.milc (max) 18.000 350.00%
433.milc (max) (percentage) 1.670 307.32%
434.zeusmp 44.000 2.33%
434.zeusmp (avg) 44.000 2.33%
434.zeusmp (avg) (percentage) 1.770 -
434.zeusmp (max) 39.000 178.57%
434.zeusmp (max) (percentage) 1.570 166.10%
435.gromacs 166.000 2.47%
435.gromacs (avg) 166.000 2.47%
435.gromacs (avg) (percentage) 2.370 2.16%
435.gromacs (max) 269.000 363.79%
435.gromacs (max) (percentage) 3.830 355.95%
436.cactusADM 46.000 -
436.cactusADM (avg) 46.000 -
436.cactusADM (avg) (percentage) 2.160 -
436.cactusADM (max) 35.000 288.89%
436.cactusADM (max) (percentage) 1.650 283.72%
437.leslie3d 531.000 4.73%
437.leslie3d (avg) 531.000 4.73%
437.leslie3d (avg) (percentage) 4.930 -
437.leslie3d (max) 916.000 -
437.leslie3d (max) (percentage) 8.510 -3.95%
444.namd 18.000 -
444.namd (avg) 18.000 -
444.namd (avg) (percentage) 2.500 -1.19%
444.namd (max) 14.000 366.67%
444.namd (max) (percentage) 1.960 300.00%
444.namd (unexplained diff vs previous) 10.000 -
444.namd (unexplained diff vs previous) (percentage) 1.350 -
445.gobmk 70.000 -2.78%
445.gobmk (avg) 70.000 -2.78%
445.gobmk (avg) (percentage) 1.460 -
445.gobmk (max) 77.000 32.76%
445.gobmk (max) (percentage) 1.620 38.46%
447.dealII 34.000 -2.86%
447.dealII (avg) 34.000 -2.86%
447.dealII (avg) (percentage) 2.030 -1.46%
447.dealII (max) 21.000 110.00%
447.dealII (max) (percentage) 1.250 101.61%
450.soplex 15.000 7.14%
450.soplex (avg) 15.000 7.14%
450.soplex (avg) (percentage) 2.720 4.21%
450.soplex (max) 36.000 300.00%
450.soplex (max) (percentage) 6.500 269.32%
453.povray 12.000 -7.69%
453.povray (avg) 12.000 -7.69%
453.povray (avg) (percentage) 2.400 -1.23%
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.450 -5.23%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.100 -
454.calculix (max) 1.000 -
454.calculix (max) (percentage) 3.240 51.40%
456.hmmer 37.000 -
456.hmmer (avg) 37.000 -
456.hmmer (avg) (percentage) 1.270 -1.55%
456.hmmer (max) 13.000 44.44%
456.hmmer (max) (percentage) 0.450 36.36%
458.sjeng 85.000 3.66%
458.sjeng (avg) 85.000 3.66%
458.sjeng (avg) (percentage) 1.150 2.68%
458.sjeng (max) 119.000 561.11%
458.sjeng (max) (percentage) 1.620 548.00%
458.sjeng (unexplained diff vs previous) 122.000 -
458.sjeng (unexplained diff vs previous) (percentage) 1.650 -
459.GemsFDTD 117.000 1.74%
459.GemsFDTD (avg) 117.000 1.74%
459.GemsFDTD (avg) (percentage) 1.960 1.03%
459.GemsFDTD (max) 145.000 291.89%
459.GemsFDTD (max) (percentage) 2.420 290.32%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.430 -
462.libquantum (max) 3.000 200.00%
462.libquantum (max) (percentage) 2.710 103.76%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.460 -
464.h264ref 94.000 -3.09%
464.h264ref (avg) 94.000 -3.09%
464.h264ref (avg) (percentage) 1.680 -1.18%
464.h264ref (max) 53.000 152.38%
464.h264ref (max) (percentage) 0.960 159.46%
465.tonto 172.000 7.50%
465.tonto (avg) 172.000 7.50%
465.tonto (avg) (percentage) 1.620 7.28%
465.tonto (max) 481.000 663.49%
465.tonto (max) (percentage) 4.520 653.33%
470.lbm 67.000 -1.47%
470.lbm (avg) 67.000 -1.47%
470.lbm (avg) (percentage) 1.810 -1.09%
470.lbm (max) 67.000 570.00%
470.lbm (max) (percentage) 1.810 524.14%
470.lbm (unexplained diff vs previous) 69.000 -
470.lbm (unexplained diff vs previous) (percentage) 1.840 -
471.omnetpp 78.000 -1.27%
471.omnetpp (avg) 78.000 -1.27%
471.omnetpp (avg) (percentage) 2.950 -1.67%
471.omnetpp (max) 94.000 -19.66%
471.omnetpp (max) (percentage) 3.540 -20.09%
471.omnetpp (unexplained diff vs previous) 42.000 -65.85%
471.omnetpp (unexplained diff vs previous) (percentage) 1.580 -65.87%
473.astar 108.000 5.88%
473.astar (avg) 108.000 5.88%
473.astar (avg) (percentage) 2.160 5.37%
473.astar (max) 227.000 219.72%
473.astar (max) (percentage) 4.540 219.72%
473.astar (unexplained diff vs previous) 238.000 -
473.astar (unexplained diff vs previous) (percentage) 4.760 -
481.wrf 120.000 1.69%
481.wrf (avg) 120.000 1.69%
481.wrf (avg) (percentage) 2.220 -
481.wrf (max) 99.000 17.86%
481.wrf (max) (percentage) 1.830 15.09%
482.sphinx3 23.000 -
482.sphinx3 (avg) 23.000 -
482.sphinx3 (avg) (percentage) 2.550 -
482.sphinx3 (max) 21.000 162.50%
482.sphinx3 (max) (percentage) 2.380 153.19%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 12.481 44.19%