Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1d8f691da90daae3e34c69ba553817e261166f5b (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/962ca7149d652e4077a2259886e5cd2ea3cea0ab (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d90b43a4ed475dac5b0cd6e01ceb35c7b0f7f2ff (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (unchanged)
regression GNU-959
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/131/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0131 (basepoints/gcc-14-04329-g962ca7149d6) 2023-09-30T00:25:31 0:00:00
Previous 0127 (basepoints/gcc-14-04328-g59cda1f9525) 2023-09-29T00:50:33 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 28 11
Performance Improvements 107 174
Unchanged Tests 1101 1051
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.95% 204340.000 208330.000 - 1.58% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 23.26% 1436.000 1770.000 - 24.30% -
436.cactusADM 2.33% 2101.000 2150.000 - 3.22% -
437.leslie3d 1.15% 10649.000 10771.000 - -7.47% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) (percentage) 60.00% 1.150 1.840 - -99.30% -
470.lbm (unexplained diff vs previous) 56.82% 44.000 69.000 - -99.31% -
470.lbm (max) (percentage) 54.70% 1.170 1.810 - -97.50% -
429.mcf (max) 53.36% 268.000 411.000 - -68.91% -
470.lbm (max) 52.27% 44.000 67.000 - -97.56% -
429.mcf 31.71% 82.000 108.000 - -0.92% -
429.mcf (avg) 31.71% 82.000 108.000 - -0.92% -
429.mcf (max) (percentage) 24.45% 18.690 23.260 - -74.96% -
458.sjeng (unexplained diff vs previous) (percentage) 7.84% 1.530 1.650 - -98.18% -
473.astar (unexplained diff vs previous) (percentage) 7.45% 4.430 4.760 - -97.59% -
429.mcf (avg) (percentage) 6.42% 5.760 6.130 - -20.08% -
458.sjeng (unexplained diff vs previous) 6.09% 115.000 122.000 - -98.23% -
458.sjeng (max) (percentage) 4.52% 1.550 1.620 - -96.60% -
458.sjeng (max) 2.59% 116.000 119.000 - -96.70% -
473.astar (unexplained diff vs previous) 2.59% 232.000 238.000 - -97.65% -
473.astar (avg) (percentage) 2.37% 2.110 2.160 - -48.08% -
436.cactusADM 2.22% 45.000 46.000 - -62.90% -
436.cactusADM (avg) 2.22% 45.000 46.000 - -62.90% -
458.sjeng (avg) (percentage) 1.77% 1.130 1.150 - -63.95% -
437.leslie3d 1.34% 524.000 531.000 - 49.58% -
437.leslie3d (avg) 1.34% 524.000 531.000 - 49.58% -
429.mcf (unexplained diff vs previous) 1.21% 330.000 334.000 - -98.20% -
458.sjeng 1.19% 84.000 85.000 - -64.73% -
458.sjeng (avg) 1.19% 84.000 85.000 - -64.73% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
434.zeusmp -1.36% 152069.000 150007.000 - -1.34% -
481.wrf -1.09% 1962154.000 1940842.000 - -0.81% -
437.leslie3d -1.02% 59475.000 58866.000 - -1.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -5.55% 1622.000 1532.000 - -7.88% -
445.gobmk -4.87% 5054.000 4808.000 - -4.28% -
473.astar -4.54% 5238.000 5000.000 - -2.50% -
450.soplex -4.45% 584.000 558.000 - -1.59% -
465.tonto -4.41% 11136.000 10645.000 - -2.71% -
435.gromacs -3.31% 7282.000 7041.000 - -3.14% -
454.calculix -3.23% 62.000 60.000 - -3.23% -
482.sphinx3 -3.08% 942.000 913.000 - -3.39% -
401.bzip2 -3.08% 2957.000 2866.000 - -2.55% -
464.h264ref -2.72% 5774.000 5617.000 - -2.50% -
453.povray -2.17% 552.000 540.000 - -1.28% -
459.GemsFDTD -1.88% 6125.000 6010.000 - -2.64% -
470.lbm -1.81% 3811.000 3742.000 - -1.21% -
447.dealII -1.79% 1731.000 1700.000 - -1.39% -
458.sjeng -1.62% 7518.000 7396.000 - -2.26% -
471.omnetpp -1.55% 2707.000 2665.000 - -2.17% -
410.bwaves -1.52% 5664.000 5578.000 - -1.31% -
433.milc -1.49% 1143.000 1126.000 - -2.17% -
462.libquantum -1.44% 139.000 137.000 - -2.14% -
444.namd -1.33% 751.000 741.000 - -0.80% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (max) -50.00% 2.000 1.000 - -98.36% -
462.libquantum (unexplained diff vs previous) -50.00% 4.000 2.000 - -99.99% -
462.libquantum (unexplained diff vs previous) (percentage) -49.31% 2.880 1.460 - -99.98% -
444.namd (unexplained diff vs previous) -37.50% 16.000 10.000 - -99.88% -
444.namd (unexplained diff vs previous) (percentage) -36.62% 2.130 1.350 - -99.88% -
462.libquantum (max) -25.00% 4.000 3.000 - -97.83% -
471.omnetpp (unexplained diff vs previous) -19.23% 52.000 42.000 - -99.61% -
429.mcf (unexplained diff vs previous) (percentage) -17.89% 22.980 18.870 - -98.55% -
471.omnetpp (unexplained diff vs previous) (percentage) -17.71% 1.920 1.580 - -99.60% -
444.namd (max) -12.50% 16.000 14.000 - -97.96% -
453.povray (max) -12.50% 8.000 7.000 - -98.60% -
471.omnetpp (max) -10.48% 105.000 94.000 - -95.67% -
444.namd (max) (percentage) -10.09% 2.180 1.960 - -97.86% -
433.milc (max) -10.00% 20.000 18.000 - -98.28% -
435.gromacs (max) -9.43% 297.000 269.000 - -92.47% -
445.gobmk (max) -9.41% 85.000 77.000 - -97.09% -
401.bzip2 (max) -8.91% 101.000 92.000 - -96.02% -
471.omnetpp (max) (percentage) -8.76% 3.880 3.540 - -95.56% -
482.sphinx3 (max) -8.70% 23.000 21.000 - -97.69% -
462.libquantum (max) (percentage) -8.45% 2.960 2.710 - -97.26% -
465.tonto (max) -8.38% 525.000 481.000 - -77.23% -
450.soplex (max) -7.69% 39.000 36.000 - -93.39% -
453.povray -7.69% 13.000 12.000 - -71.43% -
453.povray (avg) -7.69% 13.000 12.000 - -71.43% -
410.bwaves (max) -7.64% 144.000 133.000 - -95.94% -
436.cactusADM (max) (percentage) -7.30% 1.780 1.650 - -98.14% -
400.perlbench (max) -7.14% 28.000 26.000 - -98.14% -
456.hmmer (max) -7.14% 14.000 13.000 - -99.39% -
464.h264ref (max) -7.02% 57.000 53.000 - -98.31% -
400.perlbench -6.82% 44.000 41.000 - -60.95% -
400.perlbench (avg) -6.82% 44.000 41.000 - -60.95% -
435.gromacs (max) (percentage) -6.36% 4.090 3.830 - -92.21% -
410.bwaves (max) (percentage) -6.27% 2.550 2.390 - -95.88% -
456.hmmer (max) (percentage) -6.25% 0.480 0.450 - -99.39% -
473.astar (max) -6.20% 242.000 227.000 - -93.34% -
433.milc (max) (percentage) -6.18% 1.780 1.670 - -98.16% -
401.bzip2 (max) (percentage) -5.54% 3.430 3.240 - -95.88% -
434.zeusmp (max) (percentage) -5.42% 1.660 1.570 - -98.08% -
436.cactusADM (max) -5.41% 37.000 35.000 - -98.11% -
459.GemsFDTD (max) -5.23% 153.000 145.000 - -96.71% -
434.zeusmp (max) -4.88% 41.000 39.000 - -98.10% -
482.sphinx3 (max) (percentage) -4.80% 2.500 2.380 - -97.53% -
447.dealII (max) -4.55% 22.000 21.000 - -98.48% -
465.tonto -4.44% 180.000 172.000 - -52.88% -
465.tonto (avg) -4.44% 180.000 172.000 - -52.88% -
433.milc -4.35% 23.000 22.000 - -68.12% -
433.milc (avg) -4.35% 23.000 22.000 - -68.12% -
465.tonto (max) (percentage) -4.24% 4.720 4.520 - -76.59% -
482.sphinx3 -4.17% 24.000 23.000 - -68.92% -
482.sphinx3 (avg) -4.17% 24.000 23.000 - -68.92% -
445.gobmk (max) (percentage) -4.14% 1.690 1.620 - -96.92% -
445.gobmk -4.11% 73.000 70.000 - -64.29% -
445.gobmk (avg) -4.11% 73.000 70.000 - -64.29% -
464.h264ref (max) (percentage) -4.00% 1.000 0.960 - -98.23% -
450.soplex (max) (percentage) -3.85% 6.760 6.500 - -93.25% -
459.GemsFDTD (max) (percentage) -3.59% 2.510 2.420 - -96.61% -
435.gromacs -3.49% 172.000 166.000 - -54.77% -
435.gromacs (avg) -3.49% 172.000 166.000 - -54.77% -
401.bzip2 -3.39% 59.000 57.000 - -64.60% -
401.bzip2 (avg) -3.39% 59.000 57.000 - -64.60% -
481.wrf (max) (percentage) -3.17% 1.890 1.830 - -97.34% -
447.dealII (max) (percentage) -3.10% 1.290 1.250 - -98.44% -
464.h264ref -3.09% 97.000 94.000 - -67.92% -
464.h264ref (avg) -3.09% 97.000 94.000 - -67.92% -
481.wrf (max) -2.94% 102.000 99.000 - -97.40% -
447.dealII -2.86% 35.000 34.000 - -65.66% -
447.dealII (avg) -2.86% 35.000 34.000 - -65.66% -
454.calculix (max) (percentage) -2.70% 3.330 3.240 - -96.75% -
453.povray (max) (percentage) -2.68% 1.490 1.450 - -98.41% -
403.gcc (max) (percentage) -2.60% 3.850 3.750 - -96.23% -
459.GemsFDTD -2.50% 120.000 117.000 - -67.50% -
459.GemsFDTD (avg) -2.50% 120.000 117.000 - -67.50% -
471.omnetpp -2.50% 80.000 78.000 - -65.02% -
471.omnetpp (avg) -2.50% 80.000 78.000 - -65.02% -
473.astar (max) (percentage) -1.94% 4.630 4.540 - -93.17% -
437.leslie3d (max) (percentage) -1.85% 8.670 8.510 - -48.67% -
473.astar -1.82% 110.000 108.000 - -49.30% -
473.astar (avg) -1.82% 110.000 108.000 - -49.30% -
400.perlbench (max) (percentage) -1.70% 1.760 1.730 - -97.94% -
470.lbm -1.47% 68.000 67.000 - -71.97% -
470.lbm (avg) -1.47% 68.000 67.000 - -71.97% -
410.bwaves -1.16% 86.000 85.000 - -65.86% -
410.bwaves (avg) -1.16% 86.000 85.000 - -65.86% -
471.omnetpp (avg) (percentage) -1.01% 2.980 2.950 - -64.02% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 7.51% 104048.000 111860.000 - 0.00% -
450.soplex 1.58% 205081.000 208330.000 - 1.95% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.30% 1424.000 1770.000 - 23.26% -
403.gcc 8.93% 56.000 61.000 - 0.00% -
436.cactusADM 3.22% 2083.000 2150.000 - 2.33% -
456.hmmer 1.67% 2882.000 2930.000 - -0.24% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 61.64% 3.050 4.930 - 0.00% -
437.leslie3d 49.58% 355.000 531.000 - 1.34% -
437.leslie3d (avg) 49.58% 355.000 531.000 - 1.34% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.52% 387748.000 381848.000 - -0.05% -
459.GemsFDTD -1.46% 244728.000 241156.000 - -0.31% -
434.zeusmp -1.34% 152037.000 150007.000 - -1.36% -
453.povray -1.19% 661389.000 653525.000 - 0.01% -
437.leslie3d -1.03% 59479.000 58866.000 - -1.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
400.perlbench -7.88% 1663.000 1532.000 - -5.55% -
437.leslie3d -7.47% 11640.000 10771.000 - 1.15% -
445.gobmk -4.28% 5023.000 4808.000 - -4.87% -
482.sphinx3 -3.39% 945.000 913.000 - -3.08% -
454.calculix -3.23% 62.000 60.000 - -3.23% -
435.gromacs -3.14% 7269.000 7041.000 - -3.31% -
465.tonto -2.71% 10941.000 10645.000 - -4.41% -
459.GemsFDTD -2.64% 6173.000 6010.000 - -1.88% -
401.bzip2 -2.55% 2941.000 2866.000 - -3.08% -
464.h264ref -2.50% 5761.000 5617.000 - -2.72% -
473.astar -2.50% 5128.000 5000.000 - -4.54% -
458.sjeng -2.26% 7567.000 7396.000 - -1.62% -
433.milc -2.17% 1151.000 1126.000 - -1.49% -
471.omnetpp -2.17% 2724.000 2665.000 - -1.55% -
462.libquantum -2.14% 140.000 137.000 - -1.44% -
481.wrf -1.72% 5534.000 5439.000 - 0.09% -
450.soplex -1.59% 567.000 558.000 - -4.45% -
447.dealII -1.39% 1724.000 1700.000 - -1.79% -
410.bwaves -1.31% 5652.000 5578.000 - -1.52% -
453.povray -1.28% 547.000 540.000 - -2.17% -
470.lbm -1.21% 3788.000 3742.000 - -1.81% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - -50.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.98% 9655.710 1.460 - -49.31% -
444.namd (unexplained diff vs previous) -99.88% 8356.000 10.000 - -37.50% -
444.namd (unexplained diff vs previous) (percentage) -99.88% 1118.610 1.350 - -36.62% -
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.61% 10659.000 42.000 - -19.23% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.60% 391.300 1.580 - -17.71% -
456.hmmer (max) (percentage) -99.39% 73.590 0.450 - -6.25% -
456.hmmer (max) -99.39% 2120.000 13.000 - -7.14% -
470.lbm (unexplained diff vs previous) -99.31% 9990.000 69.000 - 56.82% -
470.lbm (unexplained diff vs previous) (percentage) -99.30% 263.730 1.840 - 60.00% -
453.povray (max) -98.60% 499.000 7.000 - -12.50% -
429.mcf (unexplained diff vs previous) (percentage) -98.55% 1305.690 18.870 - -17.89% -
447.dealII (max) -98.48% 1384.000 21.000 - -4.55% -
447.dealII (max) (percentage) -98.44% 80.280 1.250 - -3.10% -
453.povray (max) (percentage) -98.41% 91.250 1.450 - -2.68% -
454.calculix (max) -98.36% 61.000 1.000 - -50.00% -
464.h264ref (max) -98.31% 3127.000 53.000 - -7.02% -
433.milc (max) -98.28% 1044.000 18.000 - -10.00% -
464.h264ref (max) (percentage) -98.23% 54.290 0.960 - -4.00% -
458.sjeng (unexplained diff vs previous) -98.23% 6876.000 122.000 - 6.09% -
429.mcf (unexplained diff vs previous) -98.20% 18593.000 334.000 - 1.21% -
458.sjeng (unexplained diff vs previous) (percentage) -98.18% 90.870 1.650 - 7.84% -
433.milc (max) (percentage) -98.16% 90.750 1.670 - -6.18% -
436.cactusADM (max) (percentage) -98.14% 88.730 1.650 - -7.30% -
400.perlbench (max) -98.14% 1397.000 26.000 - -7.14% -
436.cactusADM (max) -98.11% 1848.000 35.000 - -5.41% -
434.zeusmp (max) -98.10% 2055.000 39.000 - -4.88% -
434.zeusmp (max) (percentage) -98.08% 81.770 1.570 - -5.42% -
444.namd (max) -97.96% 685.000 14.000 - -12.50% -
400.perlbench (max) (percentage) -97.94% 84.060 1.730 - -1.70% -
444.namd (max) (percentage) -97.86% 91.790 1.960 - -10.09% -
462.libquantum (max) -97.83% 138.000 3.000 - -25.00% -
482.sphinx3 (max) -97.69% 911.000 21.000 - -8.70% -
473.astar (unexplained diff vs previous) -97.65% 10146.000 238.000 - 2.59% -
473.astar (unexplained diff vs previous) (percentage) -97.59% 197.850 4.760 - 7.45% -
470.lbm (max) -97.56% 2746.000 67.000 - 52.27% -
482.sphinx3 (max) (percentage) -97.53% 96.500 2.380 - -4.80% -
470.lbm (max) (percentage) -97.50% 72.510 1.810 - 54.70% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
481.wrf (max) -97.40% 3801.000 99.000 - -2.94% -
481.wrf (max) (percentage) -97.34% 68.700 1.830 - -3.17% -
462.libquantum (max) (percentage) -97.26% 98.970 2.710 - -8.45% -
445.gobmk (max) -97.09% 2643.000 77.000 - -9.41% -
445.gobmk (max) (percentage) -96.92% 52.630 1.620 - -4.14% -
454.calculix (max) (percentage) -96.75% 99.730 3.240 - -2.70% -
459.GemsFDTD (max) -96.71% 4411.000 145.000 - -5.23% -
458.sjeng (max) -96.70% 3602.000 119.000 - 2.59% -
459.GemsFDTD (max) (percentage) -96.61% 71.460 2.420 - -3.59% -
458.sjeng (max) (percentage) -96.60% 47.610 1.620 - 4.52% -
403.gcc (max) -96.36% 55.000 2.000 - 0.00% -
403.gcc (max) (percentage) -96.23% 99.360 3.750 - -2.60% -
401.bzip2 (max) -96.02% 2313.000 92.000 - -8.91% -
410.bwaves (max) -95.94% 3276.000 133.000 - -7.64% -
401.bzip2 (max) (percentage) -95.88% 78.650 3.240 - -5.54% -
410.bwaves (max) (percentage) -95.88% 57.970 2.390 - -6.27% -
471.omnetpp (max) -95.67% 2169.000 94.000 - -10.48% -
471.omnetpp (max) (percentage) -95.56% 79.650 3.540 - -8.76% -
450.soplex (max) -93.39% 545.000 36.000 - -7.69% -
473.astar (max) -93.34% 3406.000 227.000 - -6.20% -
450.soplex (max) (percentage) -93.25% 96.240 6.500 - -3.85% -
473.astar (max) (percentage) -93.17% 66.430 4.540 - -1.94% -
435.gromacs (max) -92.47% 3573.000 269.000 - -9.43% -
435.gromacs (max) (percentage) -92.21% 49.160 3.830 - -6.36% -
465.tonto (max) -77.23% 2112.000 481.000 - -8.38% -
465.tonto (max) (percentage) -76.59% 19.310 4.520 - -4.24% -
429.mcf (max) (percentage) -74.96% 92.890 23.260 - 24.45% -
444.namd -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) (percentage) -72.89% 9.220 2.500 - -0.79% -
470.lbm -71.97% 239.000 67.000 - -1.47% -
470.lbm (avg) -71.97% 239.000 67.000 - -1.47% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
453.povray -71.43% 42.000 12.000 - -7.69% -
453.povray (avg) -71.43% 42.000 12.000 - -7.69% -
470.lbm (avg) (percentage) -71.41% 6.330 1.810 - 0.00% -
456.hmmer (avg) (percentage) -71.20% 4.410 1.270 - 0.00% -
456.hmmer -70.87% 127.000 37.000 - 0.00% -
456.hmmer (avg) -70.87% 127.000 37.000 - 0.00% -
434.zeusmp -70.07% 147.000 44.000 - 0.00% -
434.zeusmp (avg) -70.07% 147.000 44.000 - 0.00% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
434.zeusmp (avg) (percentage) -69.74% 5.850 1.770 - 0.00% -
453.povray (avg) (percentage) -69.27% 7.810 2.400 - 0.00% -
482.sphinx3 -68.92% 74.000 23.000 - -4.17% -
482.sphinx3 (avg) -68.92% 74.000 23.000 - -4.17% -
429.mcf (max) -68.91% 1322.000 411.000 - 53.36% -
462.libquantum (avg) (percentage) -68.28% 7.660 2.430 - -0.82% -
433.milc -68.12% 69.000 22.000 - -4.35% -
433.milc (avg) -68.12% 69.000 22.000 - -4.35% -
464.h264ref -67.92% 293.000 94.000 - -3.09% -
464.h264ref (avg) -67.92% 293.000 94.000 - -3.09% -
482.sphinx3 (avg) (percentage) -67.84% 7.930 2.550 - 0.00% -
459.GemsFDTD -67.50% 360.000 117.000 - -2.50% -
459.GemsFDTD (avg) -67.50% 360.000 117.000 - -2.50% -
464.h264ref (avg) (percentage) -66.99% 5.090 1.680 - 0.00% -
459.GemsFDTD (avg) (percentage) -66.44% 5.840 1.960 - 0.00% -
433.milc (avg) (percentage) -66.28% 6.050 2.040 - 0.00% -
410.bwaves -65.86% 249.000 85.000 - -1.16% -
410.bwaves (avg) -65.86% 249.000 85.000 - -1.16% -
447.dealII -65.66% 99.000 34.000 - -2.86% -
447.dealII (avg) -65.66% 99.000 34.000 - -2.86% -
410.bwaves (avg) (percentage) -65.31% 4.410 1.530 - 0.00% -
481.wrf -65.22% 345.000 120.000 - 0.00% -
481.wrf (avg) -65.22% 345.000 120.000 - 0.00% -
471.omnetpp -65.02% 223.000 78.000 - -2.50% -
471.omnetpp (avg) -65.02% 223.000 78.000 - -2.50% -
447.dealII (avg) (percentage) -64.82% 5.770 2.030 - 0.00% -
458.sjeng -64.73% 241.000 85.000 - 1.19% -
458.sjeng (avg) -64.73% 241.000 85.000 - 1.19% -
401.bzip2 -64.60% 161.000 57.000 - -3.39% -
401.bzip2 (avg) -64.60% 161.000 57.000 - -3.39% -
481.wrf (avg) (percentage) -64.42% 6.240 2.220 - 0.00% -
445.gobmk -64.29% 196.000 70.000 - -4.11% -
445.gobmk (avg) -64.29% 196.000 70.000 - -4.11% -
471.omnetpp (avg) (percentage) -64.02% 8.200 2.950 - -1.01% -
458.sjeng (avg) (percentage) -63.95% 3.190 1.150 - 1.77% -
436.cactusADM (avg) (percentage) -63.88% 5.980 2.160 - 0.00% -
401.bzip2 (avg) (percentage) -63.32% 5.480 2.010 - 0.00% -
436.cactusADM -62.90% 124.000 46.000 - 2.22% -
436.cactusADM (avg) -62.90% 124.000 46.000 - 2.22% -
445.gobmk (avg) (percentage) -62.66% 3.910 1.460 - 0.00% -
400.perlbench -60.95% 105.000 41.000 - -6.82% -
400.perlbench (avg) -60.95% 105.000 41.000 - -6.82% -
450.soplex -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) -58.33% 36.000 15.000 - 0.00% -
450.soplex (avg) (percentage) -57.70% 6.430 2.720 - 0.00% -
400.perlbench (avg) (percentage) -56.85% 6.350 2.740 - 0.00% -
435.gromacs -54.77% 367.000 166.000 - -3.49% -
435.gromacs (avg) -54.77% 367.000 166.000 - -3.49% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
435.gromacs (avg) (percentage) -53.16% 5.060 2.370 - 0.00% -
465.tonto -52.88% 365.000 172.000 - -4.44% -
465.tonto (avg) -52.88% 365.000 172.000 - -4.44% -
437.leslie3d (max) -52.51% 1929.000 916.000 - -0.76% -
465.tonto (avg) (percentage) -51.50% 3.340 1.620 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
473.astar -49.30% 213.000 108.000 - -1.82% -
473.astar (avg) -49.30% 213.000 108.000 - -1.82% -
454.calculix (avg) (percentage) -48.88% 8.020 4.100 - 0.00% -
437.leslie3d (max) (percentage) -48.67% 16.580 8.510 - -1.85% -
473.astar (avg) (percentage) -48.08% 4.160 2.160 - 2.37% -
403.gcc (avg) (percentage) -28.83% 7.320 5.210 - 0.00% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
429.mcf (avg) (percentage) -20.08% 7.670 6.130 - 6.42% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1532.000 -5.55%
401.bzip2 2866.000 -3.08%
403.gcc 61.000 -
410.bwaves 5578.000 -1.52%
429.mcf 1770.000 23.26%
433.milc 1126.000 -1.49%
434.zeusmp 2506.000 -
435.gromacs 7041.000 -3.31%
436.cactusADM 2150.000 2.33%
437.leslie3d 10771.000 1.15%
444.namd 741.000 -1.33%
445.gobmk 4808.000 -4.87%
447.dealII 1700.000 -1.79%
450.soplex 558.000 -4.45%
453.povray 540.000 -2.17%
454.calculix 60.000 -3.23%
456.hmmer 2930.000 -
458.sjeng 7396.000 -1.62%
459.GemsFDTD 6010.000 -1.88%
462.libquantum 137.000 -1.44%
464.h264ref 5617.000 -2.72%
465.tonto 10645.000 -4.41%
470.lbm 3742.000 -1.81%
471.omnetpp 2665.000 -1.55%
473.astar 5000.000 -4.54%
481.wrf 5439.000 -
482.sphinx3 913.000 -3.08%
Geometric Mean 1903.260 -1.21%
Code Size (bytes)
Name Current %
400.perlbench 900195.000 -
401.bzip2 44043.000 -
403.gcc 2444251.000 -
410.bwaves 16596.000 -
429.mcf 9119.000 -
433.milc 61121.000 -
434.zeusmp 150007.000 -1.36%
435.gromacs 498213.000 -
436.cactusADM 350929.000 -
437.leslie3d 58866.000 -1.02%
444.namd 188128.000 -
445.gobmk 1381766.000 -
447.dealII 311058.000 -
450.soplex 208330.000 1.95%
453.povray 653525.000 -
454.calculix 837902.000 -
456.hmmer 108307.000 -
458.sjeng 111860.000 -
459.GemsFDTD 241156.000 -
462.libquantum 16125.000 -
464.h264ref 381848.000 -
465.tonto 1934842.000 -
470.lbm 9707.000 -
471.omnetpp 480712.000 -
473.astar 22920.000 -
481.wrf 1940842.000 -1.09%
482.sphinx3 112747.000 -
Geometric Mean 181923.416 -
sample variability
Name Current %
400.perlbench 41.000 -6.82%
400.perlbench (avg) 41.000 -6.82%
400.perlbench (avg) (percentage) 2.740 -
400.perlbench (max) 26.000 -7.14%
400.perlbench (max) (percentage) 1.730 -1.70%
401.bzip2 57.000 -3.39%
401.bzip2 (avg) 57.000 -3.39%
401.bzip2 (avg) (percentage) 2.010 -
401.bzip2 (max) 92.000 -8.91%
401.bzip2 (max) (percentage) 3.240 -5.54%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.210 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.750 -2.60%
410.bwaves 85.000 -1.16%
410.bwaves (avg) 85.000 -1.16%
410.bwaves (avg) (percentage) 1.530 -
410.bwaves (max) 133.000 -7.64%
410.bwaves (max) (percentage) 2.390 -6.27%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.100 -
429.mcf 108.000 31.71%
429.mcf (avg) 108.000 31.71%
429.mcf (avg) (percentage) 6.130 6.42%
429.mcf (max) 411.000 53.36%
429.mcf (max) (percentage) 23.260 24.45%
429.mcf (unexplained diff vs previous) 334.000 1.21%
429.mcf (unexplained diff vs previous) (percentage) 18.870 -17.89%
433.milc 22.000 -4.35%
433.milc (avg) 22.000 -4.35%
433.milc (avg) (percentage) 2.040 -
433.milc (max) 18.000 -10.00%
433.milc (max) (percentage) 1.670 -6.18%
434.zeusmp 44.000 -
434.zeusmp (avg) 44.000 -
434.zeusmp (avg) (percentage) 1.770 -
434.zeusmp (max) 39.000 -4.88%
434.zeusmp (max) (percentage) 1.570 -5.42%
435.gromacs 166.000 -3.49%
435.gromacs (avg) 166.000 -3.49%
435.gromacs (avg) (percentage) 2.370 -
435.gromacs (max) 269.000 -9.43%
435.gromacs (max) (percentage) 3.830 -6.36%
436.cactusADM 46.000 2.22%
436.cactusADM (avg) 46.000 2.22%
436.cactusADM (avg) (percentage) 2.160 -
436.cactusADM (max) 35.000 -5.41%
436.cactusADM (max) (percentage) 1.650 -7.30%
437.leslie3d 531.000 1.34%
437.leslie3d (avg) 531.000 1.34%
437.leslie3d (avg) (percentage) 4.930 -
437.leslie3d (max) 916.000 -
437.leslie3d (max) (percentage) 8.510 -1.85%
444.namd 18.000 -
444.namd (avg) 18.000 -
444.namd (avg) (percentage) 2.500 -
444.namd (max) 14.000 -12.50%
444.namd (max) (percentage) 1.960 -10.09%
444.namd (unexplained diff vs previous) 10.000 -37.50%
444.namd (unexplained diff vs previous) (percentage) 1.350 -36.62%
445.gobmk 70.000 -4.11%
445.gobmk (avg) 70.000 -4.11%
445.gobmk (avg) (percentage) 1.460 -
445.gobmk (max) 77.000 -9.41%
445.gobmk (max) (percentage) 1.620 -4.14%
447.dealII 34.000 -2.86%
447.dealII (avg) 34.000 -2.86%
447.dealII (avg) (percentage) 2.030 -
447.dealII (max) 21.000 -4.55%
447.dealII (max) (percentage) 1.250 -3.10%
450.soplex 15.000 -
450.soplex (avg) 15.000 -
450.soplex (avg) (percentage) 2.720 -
450.soplex (max) 36.000 -7.69%
450.soplex (max) (percentage) 6.500 -3.85%
453.povray 12.000 -7.69%
453.povray (avg) 12.000 -7.69%
453.povray (avg) (percentage) 2.400 -
453.povray (max) 7.000 -12.50%
453.povray (max) (percentage) 1.450 -2.68%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.100 -
454.calculix (max) 1.000 -50.00%
454.calculix (max) (percentage) 3.240 -2.70%
456.hmmer 37.000 -
456.hmmer (avg) 37.000 -
456.hmmer (avg) (percentage) 1.270 -
456.hmmer (max) 13.000 -7.14%
456.hmmer (max) (percentage) 0.450 -6.25%
458.sjeng 85.000 1.19%
458.sjeng (avg) 85.000 1.19%
458.sjeng (avg) (percentage) 1.150 1.77%
458.sjeng (max) 119.000 2.59%
458.sjeng (max) (percentage) 1.620 4.52%
458.sjeng (unexplained diff vs previous) 122.000 6.09%
458.sjeng (unexplained diff vs previous) (percentage) 1.650 7.84%
459.GemsFDTD 117.000 -2.50%
459.GemsFDTD (avg) 117.000 -2.50%
459.GemsFDTD (avg) (percentage) 1.960 -
459.GemsFDTD (max) 145.000 -5.23%
459.GemsFDTD (max) (percentage) 2.420 -3.59%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.430 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 2.710 -8.45%
462.libquantum (unexplained diff vs previous) 2.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.460 -49.31%
464.h264ref 94.000 -3.09%
464.h264ref (avg) 94.000 -3.09%
464.h264ref (avg) (percentage) 1.680 -
464.h264ref (max) 53.000 -7.02%
464.h264ref (max) (percentage) 0.960 -4.00%
465.tonto 172.000 -4.44%
465.tonto (avg) 172.000 -4.44%
465.tonto (avg) (percentage) 1.620 -
465.tonto (max) 481.000 -8.38%
465.tonto (max) (percentage) 4.520 -4.24%
470.lbm 67.000 -1.47%
470.lbm (avg) 67.000 -1.47%
470.lbm (avg) (percentage) 1.810 -
470.lbm (max) 67.000 52.27%
470.lbm (max) (percentage) 1.810 54.70%
470.lbm (unexplained diff vs previous) 69.000 56.82%
470.lbm (unexplained diff vs previous) (percentage) 1.840 60.00%
471.omnetpp 78.000 -2.50%
471.omnetpp (avg) 78.000 -2.50%
471.omnetpp (avg) (percentage) 2.950 -1.01%
471.omnetpp (max) 94.000 -10.48%
471.omnetpp (max) (percentage) 3.540 -8.76%
471.omnetpp (unexplained diff vs previous) 42.000 -19.23%
471.omnetpp (unexplained diff vs previous) (percentage) 1.580 -17.71%
473.astar 108.000 -1.82%
473.astar (avg) 108.000 -1.82%
473.astar (avg) (percentage) 2.160 2.37%
473.astar (max) 227.000 -6.20%
473.astar (max) (percentage) 4.540 -1.94%
473.astar (unexplained diff vs previous) 238.000 2.59%
473.astar (unexplained diff vs previous) (percentage) 4.760 7.45%
481.wrf 120.000 -
481.wrf (avg) 120.000 -
481.wrf (avg) (percentage) 2.220 -
481.wrf (max) 99.000 -2.94%
481.wrf (max) (percentage) 1.830 -3.17%
482.sphinx3 23.000 -4.17%
482.sphinx3 (avg) 23.000 -4.17%
482.sphinx3 (avg) (percentage) 2.550 -
482.sphinx3 (max) 21.000 -8.70%
482.sphinx3 (max) (percentage) 2.380 -4.80%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 12.481 -2.81%