Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1d8f691da90daae3e34c69ba553817e261166f5b (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/8552dcd8e4448c02fe230662093756b75dd94399 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d90b43a4ed475dac5b0cd6e01ceb35c7b0f7f2ff (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (unchanged)
regression GNU-952
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/125/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0125 (basepoints/gcc-14-04312-g8552dcd8e44) 2023-09-27T01:40:37 0:00:00
Previous 0127 (basepoints/gcc-14-04328-g59cda1f9525) 2023-09-29T00:50:33 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 21 10
Performance Improvements 106 160
Added Tests 2 2
Unchanged Tests 1107 1064
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 22.98% 1436.000 1766.000 - 24.02% -
436.cactusADM 1.81% 2101.000 2139.000 - 2.69% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 141.15% 1.920 4.630 - -98.82% -
471.omnetpp (unexplained diff vs previous) 136.54% 52.000 123.000 - -98.85% -
400.perlbench (max) (percentage) 37.50% 1.760 2.420 - -97.12% -
400.perlbench (max) 35.71% 28.000 38.000 - -97.28% -
429.mcf 17.07% 82.000 96.000 - -11.93% -
429.mcf (avg) 17.07% 82.000 96.000 - -11.93% -
471.omnetpp (max) (percentage) 14.18% 3.880 4.430 - -94.44% -
471.omnetpp (max) 11.43% 105.000 117.000 - -94.61% -
403.gcc (max) (percentage) 2.86% 3.850 3.960 - -96.01% -
453.povray (max) (percentage) 2.68% 1.490 1.530 - -98.32% -
436.cactusADM 2.22% 45.000 46.000 - -62.90% -
436.cactusADM (avg) 2.22% 45.000 46.000 - -62.90% -
437.leslie3d (max) (percentage) 2.19% 8.670 8.860 - -46.56% -
456.hmmer (avg) (percentage) 1.57% 1.270 1.290 - -70.75% -
447.dealII (avg) (percentage) 1.48% 2.030 2.060 - -64.30% -
400.perlbench (avg) (percentage) 1.46% 2.740 2.780 - -56.22% -
453.povray (avg) (percentage) 1.25% 2.400 2.430 - -68.89% -
464.h264ref (avg) (percentage) 1.19% 1.680 1.700 - -66.60% -
470.lbm (avg) (percentage) 1.10% 1.810 1.830 - -71.09% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -8.20% 61.000 56.000 - 0.00% -
450.soplex -6.34% 584.000 547.000 - -3.53% -
465.tonto -4.51% 11136.000 10634.000 - -2.81% -
473.astar -4.43% 5238.000 5006.000 - -2.38% -
435.gromacs -3.93% 7282.000 6996.000 - -3.76% -
437.leslie3d -3.84% 10649.000 10240.000 - -12.03% -
401.bzip2 -3.31% 2957.000 2859.000 - -2.79% -
454.calculix -3.23% 62.000 60.000 - -3.23% -
462.libquantum -2.88% 139.000 135.000 - -3.57% -
410.bwaves -2.49% 5664.000 5523.000 - -2.28% -
459.GemsFDTD -2.45% 6125.000 5975.000 - -3.21% -
482.sphinx3 -2.44% 942.000 919.000 - -2.75% -
444.namd -2.13% 751.000 735.000 - -1.61% -
471.omnetpp -1.92% 2707.000 2655.000 - -2.53% -
481.wrf -1.86% 5434.000 5333.000 - -3.63% -
433.milc -1.75% 1143.000 1123.000 - -2.43% -
445.gobmk -1.66% 5054.000 4970.000 - -1.06% -
434.zeusmp -1.63% 2514.000 2473.000 - -1.63% -
458.sjeng -1.53% 7518.000 7403.000 - -2.17% -
400.perlbench -1.42% 1622.000 1599.000 - -3.85% -
447.dealII -1.27% 1731.000 1709.000 - -0.87% -
453.povray -1.27% 552.000 545.000 - -0.37% -
470.lbm -1.15% 3811.000 3767.000 - -0.55% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) (percentage) -95.77% 18.690 0.790 - -99.15% -
429.mcf (max) -95.15% 268.000 13.000 - -99.02% -
465.tonto (max) -88.00% 525.000 63.000 - -97.02% -
465.tonto (max) (percentage) -87.29% 4.720 0.600 - -96.89% -
458.sjeng (max) -84.48% 116.000 18.000 - -99.50% -
458.sjeng (max) (percentage) -83.87% 1.550 0.250 - -99.47% -
444.namd (max) -81.25% 16.000 3.000 - -99.56% -
435.gromacs (max) -80.47% 297.000 58.000 - -98.38% -
433.milc (max) -80.00% 20.000 4.000 - -99.62% -
435.gromacs (max) (percentage) -79.46% 4.090 0.840 - -98.29% -
401.bzip2 (max) -79.21% 101.000 21.000 - -99.09% -
401.bzip2 (max) (percentage) -78.13% 3.430 0.750 - -99.05% -
444.namd (max) (percentage) -77.52% 2.180 0.490 - -99.47% -
470.lbm (max) -77.27% 44.000 10.000 - -99.64% -
433.milc (max) (percentage) -76.97% 1.780 0.410 - -99.55% -
450.soplex (max) -76.92% 39.000 9.000 - -98.35% -
410.bwaves (max) -76.39% 144.000 34.000 - -98.96% -
436.cactusADM (max) (percentage) -75.84% 1.780 0.430 - -99.52% -
459.GemsFDTD (max) -75.82% 153.000 37.000 - -99.16% -
410.bwaves (max) (percentage) -75.69% 2.550 0.620 - -98.93% -
436.cactusADM (max) -75.68% 37.000 9.000 - -99.51% -
459.GemsFDTD (max) (percentage) -75.30% 2.510 0.620 - -99.13% -
470.lbm (max) (percentage) -75.21% 1.170 0.290 - -99.60% -
462.libquantum (max) -75.00% 4.000 1.000 - -99.28% -
450.soplex (max) (percentage) -73.96% 6.760 1.760 - -98.17% -
473.astar (max) -70.66% 242.000 71.000 - -97.92% -
473.astar (max) (percentage) -69.33% 4.630 1.420 - -97.86% -
434.zeusmp (max) -65.85% 41.000 14.000 - -99.32% -
482.sphinx3 (max) -65.22% 23.000 8.000 - -99.12% -
434.zeusmp (max) (percentage) -64.46% 1.660 0.590 - -99.28% -
464.h264ref (max) -63.16% 57.000 21.000 - -99.33% -
464.h264ref (max) (percentage) -63.00% 1.000 0.370 - -99.32% -
482.sphinx3 (max) (percentage) -62.40% 2.500 0.940 - -99.03% -
462.libquantum (max) (percentage) -55.07% 2.960 1.330 - -98.66% -
447.dealII (max) -54.55% 22.000 10.000 - -99.28% -
447.dealII (max) (percentage) -51.94% 1.290 0.620 - -99.23% -
454.calculix (max) -50.00% 2.000 1.000 - -98.36% -
454.calculix (max) (percentage) -35.74% 3.330 2.140 - -97.85% -
456.hmmer (max) -35.71% 14.000 9.000 - -99.58% -
403.gcc -33.33% 3.000 2.000 - -50.00% -
403.gcc (avg) -33.33% 3.000 2.000 - -50.00% -
445.gobmk (max) -31.76% 85.000 58.000 - -97.81% -
456.hmmer (max) (percentage) -31.25% 0.480 0.330 - -99.55% -
445.gobmk (max) (percentage) -30.77% 1.690 1.170 - -97.78% -
481.wrf (max) -17.65% 102.000 84.000 - -97.79% -
481.wrf (max) (percentage) -15.87% 1.890 1.590 - -97.69% -
465.tonto -11.11% 180.000 160.000 - -56.16% -
465.tonto (avg) -11.11% 180.000 160.000 - -56.16% -
473.astar -7.27% 110.000 102.000 - -52.11% -
473.astar (avg) -7.27% 110.000 102.000 - -52.11% -
465.tonto (avg) (percentage) -6.79% 1.620 1.510 - -54.79% -
450.soplex -6.67% 15.000 14.000 - -61.11% -
450.soplex (avg) -6.67% 15.000 14.000 - -61.11% -
435.gromacs -5.81% 172.000 162.000 - -55.86% -
435.gromacs (avg) -5.81% 172.000 162.000 - -55.86% -
401.bzip2 -5.08% 59.000 56.000 - -65.22% -
401.bzip2 (avg) -5.08% 59.000 56.000 - -65.22% -
429.mcf (avg) (percentage) -5.03% 5.760 5.470 - -28.68% -
459.GemsFDTD -4.17% 120.000 115.000 - -68.06% -
459.GemsFDTD (avg) -4.17% 120.000 115.000 - -68.06% -
482.sphinx3 -4.17% 24.000 23.000 - -68.92% -
482.sphinx3 (avg) -4.17% 24.000 23.000 - -68.92% -
450.soplex (avg) (percentage) -4.04% 2.720 2.610 - -59.41% -
410.bwaves -3.49% 86.000 83.000 - -66.67% -
410.bwaves (avg) -3.49% 86.000 83.000 - -66.67% -
437.leslie3d -3.24% 524.000 507.000 - 42.82% -
437.leslie3d (avg) -3.24% 524.000 507.000 - 42.82% -
473.astar (avg) (percentage) -2.84% 2.110 2.050 - -50.72% -
458.sjeng -2.38% 84.000 82.000 - -65.98% -
458.sjeng (avg) -2.38% 84.000 82.000 - -65.98% -
434.zeusmp -2.27% 44.000 43.000 - -70.75% -
434.zeusmp (avg) -2.27% 44.000 43.000 - -70.75% -
435.gromacs (avg) (percentage) -2.11% 2.370 2.320 - -54.15% -
401.bzip2 (avg) (percentage) -1.99% 2.010 1.970 - -64.05% -
437.leslie3d (max) -1.73% 923.000 907.000 - -52.98% -
481.wrf -1.67% 120.000 118.000 - -65.80% -
481.wrf (avg) -1.67% 120.000 118.000 - -65.80% -
445.gobmk -1.37% 73.000 72.000 - -63.27% -
445.gobmk (avg) -1.37% 73.000 72.000 - -63.27% -
410.bwaves (avg) (percentage) -1.31% 1.530 1.510 - -65.76% -
471.omnetpp -1.25% 80.000 79.000 - -64.57% -
471.omnetpp (avg) -1.25% 80.000 79.000 - -64.57% -
459.GemsFDTD (avg) (percentage) -1.02% 1.960 1.940 - -66.78% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 7.51% 104048.000 111860.000 - 0.00% -
471.omnetpp 1.42% 478024.000 484792.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 24.02% 1424.000 1766.000 - 22.98% -
436.cactusADM 2.69% 2083.000 2139.000 - 1.81% -
456.hmmer 1.42% 2882.000 2923.000 - -0.48% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 62.62% 3.050 4.960 - 0.61% -
437.leslie3d 42.82% 355.000 507.000 - -3.24% -
437.leslie3d (avg) 42.82% 355.000 507.000 - -3.24% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -6.90% 29.000 27.000 - 0.00% -
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.48% 387748.000 382028.000 - 0.00% -
453.povray -1.20% 661389.000 653481.000 - 0.00% -
459.GemsFDTD -1.16% 244728.000 241896.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -12.03% 11640.000 10240.000 - -3.84% -
400.perlbench -3.85% 1663.000 1599.000 - -1.42% -
435.gromacs -3.76% 7269.000 6996.000 - -3.93% -
481.wrf -3.63% 5534.000 5333.000 - -1.86% -
462.libquantum -3.57% 140.000 135.000 - -2.88% -
450.soplex -3.53% 567.000 547.000 - -6.34% -
454.calculix -3.23% 62.000 60.000 - -3.23% -
459.GemsFDTD -3.21% 6173.000 5975.000 - -2.45% -
465.tonto -2.81% 10941.000 10634.000 - -4.51% -
401.bzip2 -2.79% 2941.000 2859.000 - -3.31% -
482.sphinx3 -2.75% 945.000 919.000 - -2.44% -
471.omnetpp -2.53% 2724.000 2655.000 - -1.92% -
433.milc -2.43% 1151.000 1123.000 - -1.75% -
473.astar -2.38% 5128.000 5006.000 - -4.43% -
410.bwaves -2.28% 5652.000 5523.000 - -2.49% -
458.sjeng -2.17% 7567.000 7403.000 - -1.53% -
434.zeusmp -1.63% 2514.000 2473.000 - -1.63% -
444.namd -1.61% 747.000 735.000 - -2.13% -
445.gobmk -1.06% 5023.000 4970.000 - -1.66% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
416.gamess (max) (percentage) -99.74% 38.550 0.100 - 0.00% -
470.lbm (max) -99.64% 2746.000 10.000 - -77.27% -
433.milc (max) -99.62% 1044.000 4.000 - -80.00% -
470.lbm (max) (percentage) -99.60% 72.510 0.290 - -75.21% -
456.hmmer (max) -99.58% 2120.000 9.000 - -35.71% -
444.namd (max) -99.56% 685.000 3.000 - -81.25% -
456.hmmer (max) (percentage) -99.55% 73.590 0.330 - -31.25% -
433.milc (max) (percentage) -99.55% 90.750 0.410 - -76.97% -
436.cactusADM (max) (percentage) -99.52% 88.730 0.430 - -75.84% -
436.cactusADM (max) -99.51% 1848.000 9.000 - -75.68% -
458.sjeng (max) -99.50% 3602.000 18.000 - -84.48% -
458.sjeng (max) (percentage) -99.47% 47.610 0.250 - -83.87% -
444.namd (max) (percentage) -99.47% 91.790 0.490 - -77.52% -
464.h264ref (max) -99.33% 3127.000 21.000 - -63.16% -
434.zeusmp (max) -99.32% 2055.000 14.000 - -65.85% -
464.h264ref (max) (percentage) -99.32% 54.290 0.370 - -63.00% -
434.zeusmp (max) (percentage) -99.28% 81.770 0.590 - -64.46% -
447.dealII (max) -99.28% 1384.000 10.000 - -54.55% -
462.libquantum (max) -99.28% 138.000 1.000 - -75.00% -
447.dealII (max) (percentage) -99.23% 80.280 0.620 - -51.94% -
459.GemsFDTD (max) -99.16% 4411.000 37.000 - -75.82% -
429.mcf (max) (percentage) -99.15% 92.890 0.790 - -95.77% -
459.GemsFDTD (max) (percentage) -99.13% 71.460 0.620 - -75.30% -
482.sphinx3 (max) -99.12% 911.000 8.000 - -65.22% -
401.bzip2 (max) -99.09% 2313.000 21.000 - -79.21% -
401.bzip2 (max) (percentage) -99.05% 78.650 0.750 - -78.13% -
482.sphinx3 (max) (percentage) -99.03% 96.500 0.940 - -62.40% -
429.mcf (max) -99.02% 1322.000 13.000 - -95.15% -
410.bwaves (max) -98.96% 3276.000 34.000 - -76.39% -
410.bwaves (max) (percentage) -98.93% 57.970 0.620 - -75.69% -
471.omnetpp (unexplained diff vs previous) -98.85% 10659.000 123.000 - 136.54% -
471.omnetpp (unexplained diff vs previous) (percentage) -98.82% 391.300 4.630 - 141.15% -
462.libquantum (max) (percentage) -98.66% 98.970 1.330 - -55.07% -
453.povray (max) -98.40% 499.000 8.000 - 0.00% -
435.gromacs (max) -98.38% 3573.000 58.000 - -80.47% -
454.calculix (max) -98.36% 61.000 1.000 - -50.00% -
450.soplex (max) -98.35% 545.000 9.000 - -76.92% -
453.povray (max) (percentage) -98.32% 91.250 1.530 - 2.68% -
435.gromacs (max) (percentage) -98.29% 49.160 0.840 - -79.46% -
450.soplex (max) (percentage) -98.17% 96.240 1.760 - -73.96% -
473.astar (max) -97.92% 3406.000 71.000 - -70.66% -
473.astar (max) (percentage) -97.86% 66.430 1.420 - -69.33% -
454.calculix (max) (percentage) -97.85% 99.730 2.140 - -35.74% -
445.gobmk (max) -97.81% 2643.000 58.000 - -31.76% -
481.wrf (max) -97.79% 3801.000 84.000 - -17.65% -
445.gobmk (max) (percentage) -97.78% 52.630 1.170 - -30.77% -
481.wrf (max) (percentage) -97.69% 68.700 1.590 - -15.87% -
483.xalancbmk (max) (percentage) -97.42% 68.670 1.770 - 0.00% -
400.perlbench (max) -97.28% 1397.000 38.000 - 35.71% -
400.perlbench (max) (percentage) -97.12% 84.060 2.420 - 37.50% -
465.tonto (max) -97.02% 2112.000 63.000 - -88.00% -
465.tonto (max) (percentage) -96.89% 19.310 0.600 - -87.29% -
403.gcc (max) -96.36% 55.000 2.000 - 0.00% -
403.gcc (max) (percentage) -96.01% 99.360 3.960 - 2.86% -
471.omnetpp (max) -94.61% 2169.000 117.000 - 11.43% -
471.omnetpp (max) (percentage) -94.44% 79.650 4.430 - 14.18% -
444.namd -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) -73.53% 68.000 18.000 - 0.00% -
444.namd (avg) (percentage) -72.56% 9.220 2.530 - 0.40% -
416.gamess (avg) (percentage) -71.95% 4.420 1.240 - 0.00% -
470.lbm -71.55% 239.000 68.000 - 0.00% -
470.lbm (avg) -71.55% 239.000 68.000 - 0.00% -
470.lbm (avg) (percentage) -71.09% 6.330 1.830 - 1.10% -
456.hmmer -70.87% 127.000 37.000 - 0.00% -
456.hmmer (avg) -70.87% 127.000 37.000 - 0.00% -
434.zeusmp -70.75% 147.000 43.000 - -2.27% -
434.zeusmp (avg) -70.75% 147.000 43.000 - -2.27% -
456.hmmer (avg) (percentage) -70.75% 4.410 1.290 - 1.57% -
462.libquantum -70.00% 10.000 3.000 - 0.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - 0.00% -
434.zeusmp (avg) (percentage) -69.74% 5.850 1.770 - 0.00% -
453.povray -69.05% 42.000 13.000 - 0.00% -
453.povray (avg) -69.05% 42.000 13.000 - 0.00% -
482.sphinx3 -68.92% 74.000 23.000 - -4.17% -
482.sphinx3 (avg) -68.92% 74.000 23.000 - -4.17% -
453.povray (avg) (percentage) -68.89% 7.810 2.430 - 1.25% -
462.libquantum (avg) (percentage) -68.15% 7.660 2.440 - -0.41% -
459.GemsFDTD -68.06% 360.000 115.000 - -4.17% -
459.GemsFDTD (avg) -68.06% 360.000 115.000 - -4.17% -
482.sphinx3 (avg) (percentage) -67.84% 7.930 2.550 - 0.00% -
464.h264ref -66.89% 293.000 97.000 - 0.00% -
464.h264ref (avg) -66.89% 293.000 97.000 - 0.00% -
459.GemsFDTD (avg) (percentage) -66.78% 5.840 1.940 - -1.02% -
410.bwaves -66.67% 249.000 83.000 - -3.49% -
410.bwaves (avg) -66.67% 249.000 83.000 - -3.49% -
433.milc -66.67% 69.000 23.000 - 0.00% -
433.milc (avg) -66.67% 69.000 23.000 - 0.00% -
464.h264ref (avg) (percentage) -66.60% 5.090 1.700 - 1.19% -
433.milc (avg) (percentage) -66.12% 6.050 2.050 - 0.49% -
458.sjeng -65.98% 241.000 82.000 - -2.38% -
458.sjeng (avg) -65.98% 241.000 82.000 - -2.38% -
481.wrf -65.80% 345.000 118.000 - -1.67% -
481.wrf (avg) -65.80% 345.000 118.000 - -1.67% -
410.bwaves (avg) (percentage) -65.76% 4.410 1.510 - -1.31% -
401.bzip2 -65.22% 161.000 56.000 - -5.08% -
401.bzip2 (avg) -65.22% 161.000 56.000 - -5.08% -
458.sjeng (avg) (percentage) -64.89% 3.190 1.120 - -0.88% -
447.dealII -64.65% 99.000 35.000 - 0.00% -
447.dealII (avg) -64.65% 99.000 35.000 - 0.00% -
471.omnetpp -64.57% 223.000 79.000 - -1.25% -
471.omnetpp (avg) -64.57% 223.000 79.000 - -1.25% -
447.dealII (avg) (percentage) -64.30% 5.770 2.060 - 1.48% -
481.wrf (avg) (percentage) -64.26% 6.240 2.230 - 0.45% -
401.bzip2 (avg) (percentage) -64.05% 5.480 1.970 - -1.99% -
436.cactusADM (avg) (percentage) -63.71% 5.980 2.170 - 0.46% -
471.omnetpp (avg) (percentage) -63.41% 8.200 3.000 - 0.67% -
445.gobmk -63.27% 196.000 72.000 - -1.37% -
445.gobmk (avg) -63.27% 196.000 72.000 - -1.37% -
445.gobmk (avg) (percentage) -62.92% 3.910 1.450 - -0.68% -
436.cactusADM -62.90% 124.000 46.000 - 2.22% -
436.cactusADM (avg) -62.90% 124.000 46.000 - 2.22% -
450.soplex -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) -61.11% 36.000 14.000 - -6.67% -
450.soplex (avg) (percentage) -59.41% 6.430 2.610 - -4.04% -
400.perlbench -58.10% 105.000 44.000 - 0.00% -
400.perlbench (avg) -58.10% 105.000 44.000 - 0.00% -
400.perlbench (avg) (percentage) -56.22% 6.350 2.780 - 1.46% -
465.tonto -56.16% 365.000 160.000 - -11.11% -
465.tonto (avg) -56.16% 365.000 160.000 - -11.11% -
435.gromacs -55.86% 367.000 162.000 - -5.81% -
435.gromacs (avg) -55.86% 367.000 162.000 - -5.81% -
465.tonto (avg) (percentage) -54.79% 3.340 1.510 - -6.79% -
483.xalancbmk (avg) (percentage) -54.46% 6.500 2.960 - 0.00% -
435.gromacs (avg) (percentage) -54.15% 5.060 2.320 - -2.11% -
437.leslie3d (max) -52.98% 1929.000 907.000 - -1.73% -
473.astar -52.11% 213.000 102.000 - -7.27% -
473.astar (avg) -52.11% 213.000 102.000 - -7.27% -
473.astar (avg) (percentage) -50.72% 4.160 2.050 - -2.84% -
403.gcc -50.00% 4.000 2.000 - -33.33% -
403.gcc (avg) -50.00% 4.000 2.000 - -33.33% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) (percentage) -48.63% 8.020 4.120 - 0.49% -
437.leslie3d (max) (percentage) -46.56% 16.580 8.860 - 2.19% -
403.gcc (avg) (percentage) -28.83% 7.320 5.210 - 0.00% -
429.mcf (avg) (percentage) -28.68% 7.670 5.470 - -5.03% -
429.mcf -11.93% 109.000 96.000 - 17.07% -
429.mcf (avg) -11.93% 109.000 96.000 - 17.07% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1599.000 -1.42%
401.bzip2 2859.000 -3.31%
403.gcc 56.000 -8.20%
410.bwaves 5523.000 -2.49%
429.mcf 1766.000 22.98%
433.milc 1123.000 -1.75%
434.zeusmp 2473.000 -1.63%
435.gromacs 6996.000 -3.93%
436.cactusADM 2139.000 1.81%
437.leslie3d 10240.000 -3.84%
444.namd 735.000 -2.13%
445.gobmk 4970.000 -1.66%
447.dealII 1709.000 -1.27%
450.soplex 547.000 -6.34%
453.povray 545.000 -1.27%
454.calculix 60.000 -3.23%
456.hmmer 2923.000 -
458.sjeng 7403.000 -1.53%
459.GemsFDTD 5975.000 -2.45%
462.libquantum 135.000 -2.88%
464.h264ref 5717.000 -
465.tonto 10634.000 -4.51%
470.lbm 3767.000 -1.15%
471.omnetpp 2655.000 -1.92%
473.astar 5006.000 -4.43%
481.wrf 5333.000 -1.86%
482.sphinx3 919.000 -2.44%
Geometric Mean 1894.106 -1.69%
Code Size (bytes)
Name Current %
400.perlbench 900195.000 -
401.bzip2 44169.000 -
403.gcc 2440431.000 -
410.bwaves 16708.000 -
429.mcf 9119.000 -
433.milc 61338.000 -
434.zeusmp 152069.000 -
435.gromacs 498297.000 -
436.cactusADM 352967.000 -
437.leslie3d 59475.000 -
444.namd 188128.000 -
445.gobmk 1382054.000 -
447.dealII 311198.000 -
450.soplex 204340.000 -
453.povray 653481.000 -
454.calculix 838318.000 -
456.hmmer 108315.000 -
458.sjeng 111860.000 -
459.GemsFDTD 241896.000 -
462.libquantum 16125.000 -
464.h264ref 382028.000 -
465.tonto 1943254.000 -
470.lbm 9707.000 -
471.omnetpp 484792.000 -
473.astar 22916.000 -
481.wrf 1962154.000 -
482.sphinx3 112739.000 -
Geometric Mean 182262.583 -
sample variability
Name Current %
400.perlbench 44.000 -
400.perlbench (avg) 44.000 -
400.perlbench (avg) (percentage) 2.780 1.46%
400.perlbench (max) 38.000 35.71%
400.perlbench (max) (percentage) 2.420 37.50%
401.bzip2 56.000 -5.08%
401.bzip2 (avg) 56.000 -5.08%
401.bzip2 (avg) (percentage) 1.970 -1.99%
401.bzip2 (max) 21.000 -79.21%
401.bzip2 (max) (percentage) 0.750 -78.13%
403.gcc 2.000 -33.33%
403.gcc (avg) 2.000 -33.33%
403.gcc (avg) (percentage) 5.210 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.960 2.86%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
410.bwaves 83.000 -3.49%
410.bwaves (avg) 83.000 -3.49%
410.bwaves (avg) (percentage) 1.510 -1.31%
410.bwaves (max) 34.000 -76.39%
410.bwaves (max) (percentage) 0.620 -75.69%
416.gamess (avg) (percentage) 1.240 -
416.gamess (max) (percentage) 0.100 -
429.mcf 96.000 17.07%
429.mcf (avg) 96.000 17.07%
429.mcf (avg) (percentage) 5.470 -5.03%
429.mcf (max) 13.000 -95.15%
429.mcf (max) (percentage) 0.790 -95.77%
433.milc 23.000 -
433.milc (avg) 23.000 -
433.milc (avg) (percentage) 2.050 -
433.milc (max) 4.000 -80.00%
433.milc (max) (percentage) 0.410 -76.97%
434.zeusmp 43.000 -2.27%
434.zeusmp (avg) 43.000 -2.27%
434.zeusmp (avg) (percentage) 1.770 -
434.zeusmp (max) 14.000 -65.85%
434.zeusmp (max) (percentage) 0.590 -64.46%
435.gromacs 162.000 -5.81%
435.gromacs (avg) 162.000 -5.81%
435.gromacs (avg) (percentage) 2.320 -2.11%
435.gromacs (max) 58.000 -80.47%
435.gromacs (max) (percentage) 0.840 -79.46%
436.cactusADM 46.000 2.22%
436.cactusADM (avg) 46.000 2.22%
436.cactusADM (avg) (percentage) 2.170 -
436.cactusADM (max) 9.000 -75.68%
436.cactusADM (max) (percentage) 0.430 -75.84%
437.leslie3d 507.000 -3.24%
437.leslie3d (avg) 507.000 -3.24%
437.leslie3d (avg) (percentage) 4.960 -
437.leslie3d (max) 907.000 -1.73%
437.leslie3d (max) (percentage) 8.860 2.19%
444.namd 18.000 -
444.namd (avg) 18.000 -
444.namd (avg) (percentage) 2.530 -
444.namd (max) 3.000 -81.25%
444.namd (max) (percentage) 0.490 -77.52%
445.gobmk 72.000 -1.37%
445.gobmk (avg) 72.000 -1.37%
445.gobmk (avg) (percentage) 1.450 -
445.gobmk (max) 58.000 -31.76%
445.gobmk (max) (percentage) 1.170 -30.77%
447.dealII 35.000 -
447.dealII (avg) 35.000 -
447.dealII (avg) (percentage) 2.060 1.48%
447.dealII (max) 10.000 -54.55%
447.dealII (max) (percentage) 0.620 -51.94%
450.soplex 14.000 -6.67%
450.soplex (avg) 14.000 -6.67%
450.soplex (avg) (percentage) 2.610 -4.04%
450.soplex (max) 9.000 -76.92%
450.soplex (max) (percentage) 1.760 -73.96%
453.povray 13.000 -
453.povray (avg) 13.000 -
453.povray (avg) (percentage) 2.430 1.25%
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.530 2.68%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.120 -
454.calculix (max) 1.000 -50.00%
454.calculix (max) (percentage) 2.140 -35.74%
456.hmmer 37.000 -
456.hmmer (avg) 37.000 -
456.hmmer (avg) (percentage) 1.290 1.57%
456.hmmer (max) 9.000 -35.71%
456.hmmer (max) (percentage) 0.330 -31.25%
458.sjeng 82.000 -2.38%
458.sjeng (avg) 82.000 -2.38%
458.sjeng (avg) (percentage) 1.120 -
458.sjeng (max) 18.000 -84.48%
458.sjeng (max) (percentage) 0.250 -83.87%
459.GemsFDTD 115.000 -4.17%
459.GemsFDTD (avg) 115.000 -4.17%
459.GemsFDTD (avg) (percentage) 1.940 -1.02%
459.GemsFDTD (max) 37.000 -75.82%
459.GemsFDTD (max) (percentage) 0.620 -75.30%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.440 -
462.libquantum (max) 1.000 -75.00%
462.libquantum (max) (percentage) 1.330 -55.07%
464.h264ref 97.000 -
464.h264ref (avg) 97.000 -
464.h264ref (avg) (percentage) 1.700 1.19%
464.h264ref (max) 21.000 -63.16%
464.h264ref (max) (percentage) 0.370 -63.00%
465.tonto 160.000 -11.11%
465.tonto (avg) 160.000 -11.11%
465.tonto (avg) (percentage) 1.510 -6.79%
465.tonto (max) 63.000 -88.00%
465.tonto (max) (percentage) 0.600 -87.29%
470.lbm 68.000 -
470.lbm (avg) 68.000 -
470.lbm (avg) (percentage) 1.830 1.10%
470.lbm (max) 10.000 -77.27%
470.lbm (max) (percentage) 0.290 -75.21%
471.omnetpp 79.000 -1.25%
471.omnetpp (avg) 79.000 -1.25%
471.omnetpp (avg) (percentage) 3.000 -
471.omnetpp (max) 117.000 11.43%
471.omnetpp (max) (percentage) 4.430 14.18%
471.omnetpp (unexplained diff vs previous) 123.000 136.54%
471.omnetpp (unexplained diff vs previous) (percentage) 4.630 141.15%
473.astar 102.000 -7.27%
473.astar (avg) 102.000 -7.27%
473.astar (avg) (percentage) 2.050 -2.84%
473.astar (max) 71.000 -70.66%
473.astar (max) (percentage) 1.420 -69.33%
481.wrf 118.000 -1.67%
481.wrf (avg) 118.000 -1.67%
481.wrf (avg) (percentage) 2.230 -
481.wrf (max) 84.000 -17.65%
481.wrf (max) (percentage) 1.590 -15.87%
482.sphinx3 23.000 -4.17%
482.sphinx3 (avg) 23.000 -4.17%
482.sphinx3 (avg) (percentage) 2.550 -
482.sphinx3 (max) 8.000 -65.22%
482.sphinx3 (max) (percentage) 0.940 -62.40%
483.xalancbmk (avg) (percentage) 2.960 -
483.xalancbmk (max) (percentage) 1.770 -
Geometric Mean 7.383 -42.38%