Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=6a4058a60683ea096683d441cb78e3ad686f134f (+ 30 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f10a4ce044a62c92ff3787895f5bae11f5375a59 (+ 106 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=1d44530a5be2442e064baa48139adc9fdfb1fc6b (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=428d764c681607c504c3274cdf38b863f34e9793 (+ 161 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/60/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0060 (4-changed-components) 2023-06-13T21:18:24 0:00:00
Previous 0059 (3-changed-components) 2023-06-10T18:19:31 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 26 10
Performance Improvements 143 191
Added Tests 1 1
Unchanged Tests 1066 1034
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 2.00% 10638.000 10851.000 - -6.78% -
454.calculix 1.64% 61.000 62.000 - 0.00% -
401.bzip2 1.34% 2986.000 3026.000 - 2.89% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) 1000.00% 1.000 11.000 - -99.86% -
416.gamess (unexplained diff vs previous) (percentage) 800.00% 0.010 0.090 - -99.86% -
458.sjeng (unexplained diff vs previous) 112.50% 8.000 17.000 - -99.75% -
458.sjeng (unexplained diff vs previous) (percentage) 100.00% 0.110 0.220 - -99.76% -
445.gobmk (unexplained diff vs previous) 91.67% 12.000 23.000 - -99.59% -
445.gobmk (unexplained diff vs previous) (percentage) 87.50% 0.240 0.450 - -99.59% -
435.gromacs (unexplained diff vs previous) (percentage) 70.37% 0.810 1.380 - -98.57% -
435.gromacs (unexplained diff vs previous) 66.67% 60.000 100.000 - -98.58% -
482.sphinx3 (unexplained diff vs previous) (percentage) 50.79% 0.630 0.950 - -99.97% -
482.sphinx3 (unexplained diff vs previous) 50.00% 6.000 9.000 - -99.97% -
471.omnetpp (unexplained diff vs previous) (percentage) 39.36% 0.940 1.310 - -99.67% -
471.omnetpp (unexplained diff vs previous) 38.46% 26.000 36.000 - -99.66% -
471.omnetpp (max) (percentage) 36.84% 0.950 1.300 - -98.37% -
471.omnetpp (max) 34.62% 26.000 35.000 - -98.39% -
482.sphinx3 (max) 33.33% 6.000 8.000 - -99.12% -
482.sphinx3 (max) (percentage) 32.39% 0.710 0.940 - -99.03% -
444.namd (max) 16.67% 6.000 7.000 - -98.98% -
444.namd (unexplained diff vs previous) 16.67% 6.000 7.000 - -99.92% -
444.namd (unexplained diff vs previous) (percentage) 16.25% 0.800 0.930 - -99.92% -
444.namd (max) (percentage) 4.44% 0.900 0.940 - -98.98% -
401.bzip2 1.43% 70.000 71.000 - -55.90% -
401.bzip2 (avg) 1.43% 70.000 71.000 - -55.90% -
462.libquantum (unexplained diff vs previous) (percentage) 1.41% 0.710 0.720 - -99.99% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.08% 59.000 56.000 - 0.00% -
400.perlbench -3.96% 1667.000 1601.000 - -3.73% -
450.soplex -2.18% 597.000 584.000 - 3.00% -
483.xalancbmk -2.14% 3834.000 3752.000 - -1.73% -
447.dealII -1.67% 1738.000 1709.000 - -0.87% -
435.gromacs -1.36% 7370.000 7270.000 - 0.01% -
471.omnetpp -1.30% 2777.000 2741.000 - 0.62% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
465.tonto (max) -83.93% 56.000 9.000 - -99.57% -
465.tonto (max) (percentage) -82.69% 0.520 0.090 - -99.53% -
433.milc (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.99% -
434.zeusmp (unexplained diff vs previous) -80.00% 10.000 2.000 - -99.98% -
434.zeusmp (unexplained diff vs previous) (percentage) -80.00% 0.400 0.080 - -99.98% -
433.milc (unexplained diff vs previous) (percentage) -79.07% 0.430 0.090 - -99.99% -
436.cactusADM (unexplained diff vs previous) -68.75% 16.000 5.000 - -99.97% -
436.cactusADM (unexplained diff vs previous) (percentage) -68.42% 0.760 0.240 - -99.97% -
437.leslie3d (unexplained diff vs previous) (percentage) -67.39% 6.010 1.960 - -90.14% -
429.mcf (unexplained diff vs previous) (percentage) -66.67% 0.630 0.210 - -99.98% -
429.mcf (unexplained diff vs previous) -66.67% 9.000 3.000 - -99.98% -
437.leslie3d (unexplained diff vs previous) -66.67% 639.000 213.000 - -90.80% -
465.tonto (unexplained diff vs previous) -63.64% 11.000 4.000 - -99.77% -
465.tonto (unexplained diff vs previous) (percentage) -60.00% 0.100 0.040 - -99.75% -
453.povray (unexplained diff vs previous) (percentage) -58.90% 2.190 0.900 - -99.91% -
453.povray (unexplained diff vs previous) -58.33% 12.000 5.000 - -99.91% -
410.bwaves (unexplained diff vs previous) -54.05% 37.000 17.000 - -99.78% -
410.bwaves (unexplained diff vs previous) (percentage) -53.85% 0.650 0.300 - -99.78% -
462.libquantum (max) (percentage) -51.70% 1.470 0.710 - -99.28% -
454.calculix (unexplained diff vs previous) (percentage) -50.91% 3.280 1.610 - -100.00% -
454.calculix (unexplained diff vs previous) -50.00% 2.000 1.000 - -100.00% -
481.wrf (unexplained diff vs previous) (percentage) -45.04% 1.310 0.720 - -99.67% -
481.wrf (unexplained diff vs previous) -44.44% 72.000 40.000 - -99.67% -
459.GemsFDTD (unexplained diff vs previous) -35.29% 34.000 22.000 - -99.86% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -34.55% 0.550 0.360 - -99.86% -
403.gcc (max) -33.33% 3.000 2.000 - -96.36% -
410.bwaves (max) -32.50% 40.000 27.000 - -99.18% -
410.bwaves (max) (percentage) -31.94% 0.720 0.490 - -99.15% -
436.cactusADM (max) -26.67% 15.000 11.000 - -99.40% -
436.cactusADM (max) (percentage) -25.00% 0.760 0.570 - -99.36% -
433.milc (max) -20.00% 5.000 4.000 - -99.62% -
456.hmmer (unexplained diff vs previous) -20.00% 5.000 4.000 - -99.95% -
470.lbm (max) -18.18% 11.000 9.000 - -99.67% -
456.hmmer (unexplained diff vs previous) (percentage) -17.65% 0.170 0.140 - -99.95% -
437.leslie3d (max) (percentage) -16.75% 5.670 4.720 - -71.53% -
453.povray (max) -16.67% 12.000 10.000 - -98.00% -
433.milc (max) (percentage) -15.91% 0.440 0.370 - -99.59% -
437.leslie3d (max) -15.09% 603.000 512.000 - -73.46% -
459.GemsFDTD (max) (percentage) -12.73% 0.550 0.480 - -99.33% -
453.povray (max) (percentage) -12.56% 2.230 1.950 - -97.86% -
459.GemsFDTD (max) -12.12% 33.000 29.000 - -99.34% -
429.mcf (max) (percentage) -10.67% 0.750 0.670 - -99.28% -
470.lbm (max) (percentage) -10.34% 0.290 0.260 - -99.64% -
470.lbm (unexplained diff vs previous) (percentage) -10.34% 0.290 0.260 - -99.90% -
429.mcf (max) -10.00% 10.000 9.000 - -99.32% -
450.soplex (max) -10.00% 10.000 9.000 - -98.35% -
473.astar (unexplained diff vs previous) (percentage) -9.90% 1.010 0.910 - -99.54% -
473.astar (unexplained diff vs previous) -9.62% 52.000 47.000 - -99.54% -
458.sjeng (max) -9.52% 21.000 19.000 - -99.47% -
434.zeusmp (max) (percentage) -9.43% 0.530 0.480 - -99.41% -
470.lbm (unexplained diff vs previous) -9.09% 11.000 10.000 - -99.90% -
473.astar (max) (percentage) -8.65% 1.040 0.950 - -98.57% -
400.perlbench (max) -8.33% 60.000 55.000 - -96.06% -
434.zeusmp (max) -7.69% 13.000 12.000 - -99.42% -
456.hmmer (max) -7.69% 13.000 12.000 - -99.43% -
473.astar (max) -7.55% 53.000 49.000 - -98.56% -
458.sjeng (max) (percentage) -7.14% 0.280 0.260 - -99.45% -
450.soplex (max) (percentage) -7.06% 1.700 1.580 - -98.36% -
481.wrf (max) -7.04% 71.000 66.000 - -98.26% -
481.wrf (max) (percentage) -6.92% 1.300 1.210 - -98.24% -
464.h264ref (max) -6.67% 15.000 14.000 - -99.55% -
447.dealII (max) -5.88% 34.000 32.000 - -97.69% -
450.soplex -5.56% 18.000 17.000 - -52.78% -
450.soplex (avg) -5.56% 18.000 17.000 - -52.78% -
447.dealII (max) (percentage) -5.50% 2.000 1.890 - -97.65% -
401.bzip2 (max) -5.00% 20.000 19.000 - -99.18% -
454.calculix (max) (percentage) -4.35% 4.370 4.180 - -95.81% -
445.gobmk (max) -4.17% 24.000 23.000 - -99.13% -
445.gobmk (max) (percentage) -4.17% 0.480 0.460 - -99.13% -
483.xalancbmk (max) -4.00% 100.000 96.000 - -96.34% -
416.gamess -3.95% 177.000 170.000 - -69.09% -
416.gamess (avg) -3.95% 177.000 170.000 - -69.09% -
465.tonto -3.94% 203.000 195.000 - -46.58% -
465.tonto (avg) -3.94% 203.000 195.000 - -46.58% -
400.perlbench (max) (percentage) -3.89% 3.600 3.460 - -95.88% -
464.h264ref (max) (percentage) -3.85% 0.260 0.250 - -99.54% -
400.perlbench -3.77% 53.000 51.000 - -51.43% -
400.perlbench (avg) -3.77% 53.000 51.000 - -51.43% -
465.tonto (avg) (percentage) -3.76% 1.860 1.790 - -46.41% -
416.gamess (avg) (percentage) -3.52% 1.420 1.370 - -69.00% -
482.sphinx3 -3.33% 30.000 29.000 - -60.81% -
482.sphinx3 (avg) -3.33% 30.000 29.000 - -60.81% -
435.gromacs -3.08% 195.000 189.000 - -48.50% -
435.gromacs (avg) -3.08% 195.000 189.000 - -48.50% -
471.omnetpp -3.03% 99.000 96.000 - -56.95% -
471.omnetpp (avg) -3.03% 99.000 96.000 - -56.95% -
456.hmmer (avg) (percentage) -3.01% 1.660 1.610 - -63.49% -
401.bzip2 (max) (percentage) -2.99% 0.670 0.650 - -99.17% -
464.h264ref (avg) (percentage) -2.96% 2.030 1.970 - -61.30% -
429.mcf -2.91% 103.000 100.000 - -8.26% -
429.mcf (avg) -2.91% 103.000 100.000 - -8.26% -
458.sjeng -2.86% 105.000 102.000 - -57.68% -
458.sjeng (avg) -2.86% 105.000 102.000 - -57.68% -
481.wrf (avg) (percentage) -2.62% 2.670 2.600 - -58.33% -
464.h264ref -2.56% 117.000 114.000 - -61.09% -
464.h264ref (avg) -2.56% 117.000 114.000 - -61.09% -
433.milc (avg) (percentage) -2.40% 2.500 2.440 - -59.67% -
429.mcf (avg) (percentage) -2.35% 7.230 7.060 - -7.95% -
483.xalancbmk -2.34% 128.000 125.000 - -49.60% -
483.xalancbmk (avg) -2.34% 128.000 125.000 - -49.60% -
453.povray (avg) (percentage) -2.32% 3.020 2.950 - -62.23% -
470.lbm -2.25% 89.000 87.000 - -63.60% -
470.lbm (avg) -2.25% 89.000 87.000 - -63.60% -
456.hmmer (max) (percentage) -2.22% 0.450 0.440 - -99.40% -
434.zeusmp (avg) (percentage) -2.22% 2.250 2.200 - -62.39% -
436.cactusADM (avg) (percentage) -2.17% 2.760 2.700 - -54.85% -
458.sjeng (avg) (percentage) -2.16% 1.390 1.360 - -57.37% -
410.bwaves (avg) (percentage) -2.15% 1.860 1.820 - -58.73% -
470.lbm (avg) (percentage) -2.14% 2.340 2.290 - -63.82% -
459.GemsFDTD (avg) (percentage) -2.12% 2.360 2.310 - -60.45% -
456.hmmer -2.08% 48.000 47.000 - -62.99% -
456.hmmer (avg) -2.08% 48.000 47.000 - -62.99% -
459.GemsFDTD -2.07% 145.000 142.000 - -60.56% -
459.GemsFDTD (avg) -2.07% 145.000 142.000 - -60.56% -
481.wrf -2.05% 146.000 143.000 - -58.55% -
481.wrf (avg) -2.05% 146.000 143.000 - -58.55% -
435.gromacs (max) -2.00% 100.000 98.000 - -97.26% -
454.calculix (avg) (percentage) -1.95% 4.620 4.530 - -43.52% -
444.namd (avg) (percentage) -1.92% 3.130 3.070 - -66.70% -
410.bwaves -1.90% 105.000 103.000 - -58.63% -
410.bwaves (avg) -1.90% 105.000 103.000 - -58.63% -
482.sphinx3 (avg) (percentage) -1.89% 3.170 3.110 - -60.78% -
445.gobmk (avg) (percentage) -1.86% 1.610 1.580 - -59.59% -
434.zeusmp -1.79% 56.000 55.000 - -62.59% -
434.zeusmp (avg) -1.79% 56.000 55.000 - -62.59% -
436.cactusADM -1.75% 57.000 56.000 - -54.84% -
436.cactusADM (avg) -1.75% 57.000 56.000 - -54.84% -
471.omnetpp (avg) (percentage) -1.68% 3.580 3.520 - -57.07% -
437.leslie3d (avg) (percentage) -1.64% 4.280 4.210 - 38.03% -
462.libquantum (avg) (percentage) -1.63% 3.060 3.010 - -60.70% -
403.gcc (max) (percentage) -1.57% 5.110 5.030 - -94.94% -
483.xalancbmk (max) (percentage) -1.53% 2.620 2.580 - -96.24% -
435.gromacs (avg) (percentage) -1.51% 2.650 2.610 - -48.42% -
473.astar (avg) (percentage) -1.31% 2.290 2.260 - -45.67% -
445.gobmk -1.23% 81.000 80.000 - -59.18% -
445.gobmk (avg) -1.23% 81.000 80.000 - -59.18% -

Added Tests - sample variability
462.libquantum (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
436.cactusADM 1.08% 352891.000 356691.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
450.soplex 3.00% 567.000 584.000 - -2.18% -
401.bzip2 2.89% 2941.000 3026.000 - 1.34% -
456.hmmer 1.56% 2882.000 2927.000 - -0.14% -
445.gobmk 1.35% 5023.000 5091.000 - 0.45% -
453.povray 1.28% 547.000 554.000 - 0.91% -
473.astar 1.19% 5128.000 5189.000 - 0.91% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 38.03% 3.050 4.210 - -1.64% -
437.leslie3d 28.45% 355.000 456.000 - 0.22% -
437.leslie3d (avg) 28.45% 355.000 456.000 - 0.22% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.03% 387748.000 383756.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.78% 11640.000 10851.000 - 2.00% -
400.perlbench -3.73% 1663.000 1601.000 - -3.96% -
483.xalancbmk -1.73% 3818.000 3752.000 - -2.14% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 1.610 - -50.91% -
454.calculix (unexplained diff vs previous) -100.00% 22953.000 1.000 - -50.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - 1.41% -
433.milc (unexplained diff vs previous) -99.99% 11289.000 1.000 - -80.00% -
433.milc (unexplained diff vs previous) (percentage) -99.99% 980.800 0.090 - -79.07% -
464.h264ref (unexplained diff vs previous) -99.99% 6843.000 1.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.98% 1305.690 0.210 - -66.67% -
429.mcf (unexplained diff vs previous) -99.98% 18593.000 3.000 - -66.67% -
464.h264ref (unexplained diff vs previous) (percentage) -99.98% 118.780 0.020 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.98% 11280.000 2.000 - -80.00% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.98% 448.690 0.080 - -80.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.97% 787.130 0.240 - -68.42% -
436.cactusADM (unexplained diff vs previous) -99.97% 16396.000 5.000 - -68.75% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.97% 2759.050 0.950 - 50.79% -
482.sphinx3 (unexplained diff vs previous) -99.97% 26073.000 9.000 - 50.00% -
456.hmmer (unexplained diff vs previous) -99.95% 8030.000 4.000 - -20.00% -
456.hmmer (unexplained diff vs previous) (percentage) -99.95% 278.630 0.140 - -17.65% -
444.namd (unexplained diff vs previous) (percentage) -99.92% 1118.610 0.930 - 16.25% -
444.namd (unexplained diff vs previous) -99.92% 8356.000 7.000 - 16.67% -
453.povray (unexplained diff vs previous) (percentage) -99.91% 1043.330 0.900 - -58.90% -
453.povray (unexplained diff vs previous) -99.91% 5707.000 5.000 - -58.33% -
470.lbm (unexplained diff vs previous) (percentage) -99.90% 263.730 0.260 - -10.34% -
470.lbm (unexplained diff vs previous) -99.90% 9990.000 10.000 - -9.09% -
416.gamess (unexplained diff vs previous) -99.86% 7819.000 11.000 - 1000.00% -
459.GemsFDTD (unexplained diff vs previous) -99.86% 15458.000 22.000 - -35.29% -
416.gamess (unexplained diff vs previous) (percentage) -99.86% 62.730 0.090 - 800.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.86% 250.410 0.360 - -34.55% -
410.bwaves (unexplained diff vs previous) (percentage) -99.78% 137.900 0.300 - -53.85% -
410.bwaves (unexplained diff vs previous) -99.78% 7794.000 17.000 - -54.05% -
465.tonto (unexplained diff vs previous) -99.77% 1771.000 4.000 - -63.64% -
458.sjeng (unexplained diff vs previous) (percentage) -99.76% 90.870 0.220 - 100.00% -
465.tonto (unexplained diff vs previous) (percentage) -99.75% 16.190 0.040 - -60.00% -
458.sjeng (unexplained diff vs previous) -99.75% 6876.000 17.000 - 112.50% -
416.gamess (max) -99.73% 4805.000 13.000 - 0.00% -
416.gamess (max) (percentage) -99.71% 38.550 0.110 - 0.00% -
470.lbm (max) -99.67% 2746.000 9.000 - -18.18% -
481.wrf (unexplained diff vs previous) (percentage) -99.67% 219.530 0.720 - -45.04% -
481.wrf (unexplained diff vs previous) -99.67% 12149.000 40.000 - -44.44% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.67% 391.300 1.310 - 39.36% -
471.omnetpp (unexplained diff vs previous) -99.66% 10659.000 36.000 - 38.46% -
470.lbm (max) (percentage) -99.64% 72.510 0.260 - -10.34% -
433.milc (max) -99.62% 1044.000 4.000 - -20.00% -
445.gobmk (unexplained diff vs previous) (percentage) -99.59% 111.110 0.450 - 87.50% -
433.milc (max) (percentage) -99.59% 90.750 0.370 - -15.91% -
445.gobmk (unexplained diff vs previous) -99.59% 5581.000 23.000 - 91.67% -
465.tonto (max) -99.57% 2112.000 9.000 - -83.93% -
464.h264ref (max) -99.55% 3127.000 14.000 - -6.67% -
473.astar (unexplained diff vs previous) (percentage) -99.54% 197.850 0.910 - -9.90% -
464.h264ref (max) (percentage) -99.54% 54.290 0.250 - -3.85% -
473.astar (unexplained diff vs previous) -99.54% 10146.000 47.000 - -9.62% -
465.tonto (max) (percentage) -99.53% 19.310 0.090 - -82.69% -
458.sjeng (max) -99.47% 3602.000 19.000 - -9.52% -
458.sjeng (max) (percentage) -99.45% 47.610 0.260 - -7.14% -
456.hmmer (max) -99.43% 2120.000 12.000 - -7.69% -
434.zeusmp (max) -99.42% 2055.000 12.000 - -7.69% -
434.zeusmp (max) (percentage) -99.41% 81.770 0.480 - -9.43% -
436.cactusADM (max) -99.40% 1848.000 11.000 - -26.67% -
456.hmmer (max) (percentage) -99.40% 73.590 0.440 - -2.22% -
436.cactusADM (max) (percentage) -99.36% 88.730 0.570 - -25.00% -
459.GemsFDTD (max) -99.34% 4411.000 29.000 - -12.12% -
459.GemsFDTD (max) (percentage) -99.33% 71.460 0.480 - -12.73% -
429.mcf (max) -99.32% 1322.000 9.000 - -10.00% -
462.libquantum (max) (percentage) -99.28% 98.970 0.710 - -51.70% -
429.mcf (max) (percentage) -99.28% 92.890 0.670 - -10.67% -
401.bzip2 (max) -99.18% 2313.000 19.000 - -5.00% -
410.bwaves (max) -99.18% 3276.000 27.000 - -32.50% -
401.bzip2 (max) (percentage) -99.17% 78.650 0.650 - -2.99% -
410.bwaves (max) (percentage) -99.15% 57.970 0.490 - -31.94% -
445.gobmk (max) -99.13% 2643.000 23.000 - -4.17% -
445.gobmk (max) (percentage) -99.13% 52.630 0.460 - -4.17% -
482.sphinx3 (max) -99.12% 911.000 8.000 - 33.33% -
482.sphinx3 (max) (percentage) -99.03% 96.500 0.940 - 32.39% -
444.namd (max) -98.98% 685.000 7.000 - 16.67% -
444.namd (max) (percentage) -98.98% 91.790 0.940 - 4.44% -
435.gromacs (unexplained diff vs previous) -98.58% 7028.000 100.000 - 66.67% -
435.gromacs (unexplained diff vs previous) (percentage) -98.57% 96.680 1.380 - 70.37% -
473.astar (max) (percentage) -98.57% 66.430 0.950 - -8.65% -
473.astar (max) -98.56% 3406.000 49.000 - -7.55% -
471.omnetpp (max) -98.39% 2169.000 35.000 - 34.62% -
471.omnetpp (max) (percentage) -98.37% 79.650 1.300 - 36.84% -
450.soplex (max) (percentage) -98.36% 96.240 1.580 - -7.06% -
450.soplex (max) -98.35% 545.000 9.000 - -10.00% -
481.wrf (max) -98.26% 3801.000 66.000 - -7.04% -
481.wrf (max) (percentage) -98.24% 68.700 1.210 - -6.92% -
453.povray (max) -98.00% 499.000 10.000 - -16.67% -
453.povray (max) (percentage) -97.86% 91.250 1.950 - -12.56% -
447.dealII (max) -97.69% 1384.000 32.000 - -5.88% -
447.dealII (max) (percentage) -97.65% 80.280 1.890 - -5.50% -
435.gromacs (max) -97.26% 3573.000 98.000 - -2.00% -
435.gromacs (max) (percentage) -97.23% 49.160 1.360 - -0.73% -
454.calculix (max) -96.72% 61.000 2.000 - 0.00% -
403.gcc (max) -96.36% 55.000 2.000 - -33.33% -
483.xalancbmk (max) -96.34% 2621.000 96.000 - -4.00% -
483.xalancbmk (max) (percentage) -96.24% 68.670 2.580 - -1.53% -
400.perlbench (max) -96.06% 1397.000 55.000 - -8.33% -
400.perlbench (max) (percentage) -95.88% 84.060 3.460 - -3.89% -
454.calculix (max) (percentage) -95.81% 99.730 4.180 - -4.35% -
403.gcc (max) (percentage) -94.94% 99.360 5.030 - -1.57% -
437.leslie3d (unexplained diff vs previous) -90.80% 2314.000 213.000 - -66.67% -
437.leslie3d (unexplained diff vs previous) (percentage) -90.14% 19.880 1.960 - -67.39% -
437.leslie3d (max) -73.46% 1929.000 512.000 - -15.09% -
437.leslie3d (max) (percentage) -71.53% 16.580 4.720 - -16.75% -
416.gamess -69.09% 550.000 170.000 - -3.95% -
416.gamess (avg) -69.09% 550.000 170.000 - -3.95% -
416.gamess (avg) (percentage) -69.00% 4.420 1.370 - -3.52% -
444.namd (avg) (percentage) -66.70% 9.220 3.070 - -1.92% -
444.namd -66.18% 68.000 23.000 - 0.00% -
444.namd (avg) -66.18% 68.000 23.000 - 0.00% -
470.lbm (avg) (percentage) -63.82% 6.330 2.290 - -2.14% -
470.lbm -63.60% 239.000 87.000 - -2.25% -
470.lbm (avg) -63.60% 239.000 87.000 - -2.25% -
456.hmmer (avg) (percentage) -63.49% 4.410 1.610 - -3.01% -
456.hmmer -62.99% 127.000 47.000 - -2.08% -
456.hmmer (avg) -62.99% 127.000 47.000 - -2.08% -
434.zeusmp -62.59% 147.000 55.000 - -1.79% -
434.zeusmp (avg) -62.59% 147.000 55.000 - -1.79% -
434.zeusmp (avg) (percentage) -62.39% 5.850 2.200 - -2.22% -
453.povray (avg) (percentage) -62.23% 7.810 2.950 - -2.32% -
453.povray -61.90% 42.000 16.000 - 0.00% -
453.povray (avg) -61.90% 42.000 16.000 - 0.00% -
464.h264ref (avg) (percentage) -61.30% 5.090 1.970 - -2.96% -
464.h264ref -61.09% 293.000 114.000 - -2.56% -
464.h264ref (avg) -61.09% 293.000 114.000 - -2.56% -
482.sphinx3 -60.81% 74.000 29.000 - -3.33% -
482.sphinx3 (avg) -60.81% 74.000 29.000 - -3.33% -
482.sphinx3 (avg) (percentage) -60.78% 7.930 3.110 - -1.89% -
462.libquantum (avg) (percentage) -60.70% 7.660 3.010 - -1.63% -
459.GemsFDTD -60.56% 360.000 142.000 - -2.07% -
459.GemsFDTD (avg) -60.56% 360.000 142.000 - -2.07% -
459.GemsFDTD (avg) (percentage) -60.45% 5.840 2.310 - -2.12% -
462.libquantum -60.00% 10.000 4.000 - 0.00% -
462.libquantum (avg) -60.00% 10.000 4.000 - 0.00% -
433.milc (avg) (percentage) -59.67% 6.050 2.440 - -2.40% -
445.gobmk (avg) (percentage) -59.59% 3.910 1.580 - -1.86% -
433.milc -59.42% 69.000 28.000 - 0.00% -
433.milc (avg) -59.42% 69.000 28.000 - 0.00% -
445.gobmk -59.18% 196.000 80.000 - -1.23% -
445.gobmk (avg) -59.18% 196.000 80.000 - -1.23% -
410.bwaves (avg) (percentage) -58.73% 4.410 1.820 - -2.15% -
410.bwaves -58.63% 249.000 103.000 - -1.90% -
410.bwaves (avg) -58.63% 249.000 103.000 - -1.90% -
481.wrf -58.55% 345.000 143.000 - -2.05% -
481.wrf (avg) -58.55% 345.000 143.000 - -2.05% -
481.wrf (avg) (percentage) -58.33% 6.240 2.600 - -2.62% -
458.sjeng -57.68% 241.000 102.000 - -2.86% -
458.sjeng (avg) -57.68% 241.000 102.000 - -2.86% -
447.dealII -57.58% 99.000 42.000 - 0.00% -
447.dealII (avg) -57.58% 99.000 42.000 - 0.00% -
458.sjeng (avg) (percentage) -57.37% 3.190 1.360 - -2.16% -
447.dealII (avg) (percentage) -57.19% 5.770 2.470 - 0.00% -
401.bzip2 (avg) (percentage) -57.12% 5.480 2.350 - 0.00% -
471.omnetpp (avg) (percentage) -57.07% 8.200 3.520 - -1.68% -
471.omnetpp -56.95% 223.000 96.000 - -3.03% -
471.omnetpp (avg) -56.95% 223.000 96.000 - -3.03% -
401.bzip2 -55.90% 161.000 71.000 - 1.43% -
401.bzip2 (avg) -55.90% 161.000 71.000 - 1.43% -
436.cactusADM (avg) (percentage) -54.85% 5.980 2.700 - -2.17% -
436.cactusADM -54.84% 124.000 56.000 - -1.75% -
436.cactusADM (avg) -54.84% 124.000 56.000 - -1.75% -
450.soplex -52.78% 36.000 17.000 - -5.56% -
450.soplex (avg) -52.78% 36.000 17.000 - -5.56% -
450.soplex (avg) (percentage) -52.57% 6.430 3.050 - 0.00% -
400.perlbench -51.43% 105.000 51.000 - -3.77% -
400.perlbench (avg) -51.43% 105.000 51.000 - -3.77% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
483.xalancbmk -49.60% 248.000 125.000 - -2.34% -
483.xalancbmk (avg) -49.60% 248.000 125.000 - -2.34% -
400.perlbench (avg) (percentage) -49.29% 6.350 3.220 - 0.00% -
483.xalancbmk (avg) (percentage) -48.62% 6.500 3.340 - 0.00% -
435.gromacs -48.50% 367.000 189.000 - -3.08% -
435.gromacs (avg) -48.50% 367.000 189.000 - -3.08% -
435.gromacs (avg) (percentage) -48.42% 5.060 2.610 - -1.51% -
465.tonto -46.58% 365.000 195.000 - -3.94% -
465.tonto (avg) -46.58% 365.000 195.000 - -3.94% -
465.tonto (avg) (percentage) -46.41% 3.340 1.790 - -3.76% -
473.astar (avg) (percentage) -45.67% 4.160 2.260 - -1.31% -
473.astar -45.07% 213.000 117.000 - 0.00% -
473.astar (avg) -45.07% 213.000 117.000 - 0.00% -
454.calculix (avg) (percentage) -43.52% 8.020 4.530 - -1.95% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -19.13% 7.320 5.920 - 0.00% -
429.mcf -8.26% 109.000 100.000 - -2.91% -
429.mcf (avg) -8.26% 109.000 100.000 - -2.91% -
429.mcf (avg) (percentage) -7.95% 7.670 7.060 - -2.35% -

Added Tests - sample variability
462.libquantum (max)

Report Time: 0.41s
Execution (seconds)
Name Current %
400.perlbench 1601.000 -3.96%
401.bzip2 3026.000 1.34%
403.gcc 56.000 -5.08%
410.bwaves 5703.000 -
416.gamess 12463.000 -
429.mcf 1429.000 -
433.milc 1151.000 -
434.zeusmp 2514.000 -
435.gromacs 7270.000 -1.36%
436.cactusADM 2094.000 -
437.leslie3d 10851.000 2.00%
444.namd 753.000 -
445.gobmk 5091.000 -
447.dealII 1709.000 -1.67%
450.soplex 584.000 -2.18%
453.povray 554.000 -
454.calculix 62.000 1.64%
456.hmmer 2927.000 -
458.sjeng 7562.000 -
459.GemsFDTD 6168.000 -
462.libquantum 139.000 -
464.h264ref 5804.000 -
465.tonto 10930.000 -
470.lbm 3813.000 -
471.omnetpp 2741.000 -1.30%
473.astar 5189.000 -
481.wrf 5526.000 -
482.sphinx3 945.000 -
483.xalancbmk 3752.000 -2.14%
Geometric Mean 2100.143 -
Code Size (bytes)
Name Current %
400.perlbench 888707.000 -
401.bzip2 44197.000 -
403.gcc 2443503.000 -
410.bwaves 16712.000 -
416.gamess 5717321.000 -
429.mcf 9119.000 -
433.milc 61358.000 -
434.zeusmp 152129.000 -
435.gromacs 498705.000 -
436.cactusADM 356691.000 -
437.leslie3d 59383.000 -
444.namd 188272.000 -
445.gobmk 1377662.000 -
447.dealII 313201.000 -
450.soplex 205067.000 -
453.povray 656677.000 -
454.calculix 844346.000 -
456.hmmer 108507.000 -
458.sjeng 103936.000 -
459.GemsFDTD 243996.000 -
462.libquantum 16045.000 -
464.h264ref 383756.000 -
465.tonto 1946818.000 -
470.lbm 9691.000 -
471.omnetpp 478193.000 -
473.astar 22952.000 -
481.wrf 1953374.000 -
482.sphinx3 112711.000 -
483.xalancbmk 2343995.000 -
Geometric Mean 223686.630 -
sample variability
Name Current %
400.perlbench 51.000 -3.77%
400.perlbench (avg) 51.000 -3.77%
400.perlbench (avg) (percentage) 3.220 -
400.perlbench (max) 55.000 -8.33%
400.perlbench (max) (percentage) 3.460 -3.89%
401.bzip2 71.000 1.43%
401.bzip2 (avg) 71.000 1.43%
401.bzip2 (avg) (percentage) 2.350 -
401.bzip2 (max) 19.000 -5.00%
401.bzip2 (max) (percentage) 0.650 -2.99%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.920 -
403.gcc (max) 2.000 -33.33%
403.gcc (max) (percentage) 5.030 -1.57%
410.bwaves 103.000 -1.90%
410.bwaves (avg) 103.000 -1.90%
410.bwaves (avg) (percentage) 1.820 -2.15%
410.bwaves (max) 27.000 -32.50%
410.bwaves (max) (percentage) 0.490 -31.94%
410.bwaves (unexplained diff vs previous) 17.000 -54.05%
410.bwaves (unexplained diff vs previous) (percentage) 0.300 -53.85%
416.gamess 170.000 -3.95%
416.gamess (avg) 170.000 -3.95%
416.gamess (avg) (percentage) 1.370 -3.52%
416.gamess (max) 13.000 -
416.gamess (max) (percentage) 0.110 -
416.gamess (unexplained diff vs previous) 11.000 1000.00%
416.gamess (unexplained diff vs previous) (percentage) 0.090 800.00%
429.mcf 100.000 -2.91%
429.mcf (avg) 100.000 -2.91%
429.mcf (avg) (percentage) 7.060 -2.35%
429.mcf (max) 9.000 -10.00%
429.mcf (max) (percentage) 0.670 -10.67%
429.mcf (unexplained diff vs previous) 3.000 -66.67%
429.mcf (unexplained diff vs previous) (percentage) 0.210 -66.67%
433.milc 28.000 -
433.milc (avg) 28.000 -
433.milc (avg) (percentage) 2.440 -2.40%
433.milc (max) 4.000 -20.00%
433.milc (max) (percentage) 0.370 -15.91%
433.milc (unexplained diff vs previous) 1.000 -80.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -79.07%
434.zeusmp 55.000 -1.79%
434.zeusmp (avg) 55.000 -1.79%
434.zeusmp (avg) (percentage) 2.200 -2.22%
434.zeusmp (max) 12.000 -7.69%
434.zeusmp (max) (percentage) 0.480 -9.43%
434.zeusmp (unexplained diff vs previous) 2.000 -80.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.080 -80.00%
435.gromacs 189.000 -3.08%
435.gromacs (avg) 189.000 -3.08%
435.gromacs (avg) (percentage) 2.610 -1.51%
435.gromacs (max) 98.000 -2.00%
435.gromacs (max) (percentage) 1.360 -
435.gromacs (unexplained diff vs previous) 100.000 66.67%
435.gromacs (unexplained diff vs previous) (percentage) 1.380 70.37%
436.cactusADM 56.000 -1.75%
436.cactusADM (avg) 56.000 -1.75%
436.cactusADM (avg) (percentage) 2.700 -2.17%
436.cactusADM (max) 11.000 -26.67%
436.cactusADM (max) (percentage) 0.570 -25.00%
436.cactusADM (unexplained diff vs previous) 5.000 -68.75%
436.cactusADM (unexplained diff vs previous) (percentage) 0.240 -68.42%
437.leslie3d 456.000 -
437.leslie3d (avg) 456.000 -
437.leslie3d (avg) (percentage) 4.210 -1.64%
437.leslie3d (max) 512.000 -15.09%
437.leslie3d (max) (percentage) 4.720 -16.75%
437.leslie3d (unexplained diff vs previous) 213.000 -66.67%
437.leslie3d (unexplained diff vs previous) (percentage) 1.960 -67.39%
444.namd 23.000 -
444.namd (avg) 23.000 -
444.namd (avg) (percentage) 3.070 -1.92%
444.namd (max) 7.000 16.67%
444.namd (max) (percentage) 0.940 4.44%
444.namd (unexplained diff vs previous) 7.000 16.67%
444.namd (unexplained diff vs previous) (percentage) 0.930 16.25%
445.gobmk 80.000 -1.23%
445.gobmk (avg) 80.000 -1.23%
445.gobmk (avg) (percentage) 1.580 -1.86%
445.gobmk (max) 23.000 -4.17%
445.gobmk (max) (percentage) 0.460 -4.17%
445.gobmk (unexplained diff vs previous) 23.000 91.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.450 87.50%
447.dealII 42.000 -
447.dealII (avg) 42.000 -
447.dealII (avg) (percentage) 2.470 -
447.dealII (max) 32.000 -5.88%
447.dealII (max) (percentage) 1.890 -5.50%
450.soplex 17.000 -5.56%
450.soplex (avg) 17.000 -5.56%
450.soplex (avg) (percentage) 3.050 -
450.soplex (max) 9.000 -10.00%
450.soplex (max) (percentage) 1.580 -7.06%
453.povray 16.000 -
453.povray (avg) 16.000 -
453.povray (avg) (percentage) 2.950 -2.32%
453.povray (max) 10.000 -16.67%
453.povray (max) (percentage) 1.950 -12.56%
453.povray (unexplained diff vs previous) 5.000 -58.33%
453.povray (unexplained diff vs previous) (percentage) 0.900 -58.90%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.530 -1.95%
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.180 -4.35%
454.calculix (unexplained diff vs previous) 1.000 -50.00%
454.calculix (unexplained diff vs previous) (percentage) 1.610 -50.91%
456.hmmer 47.000 -2.08%
456.hmmer (avg) 47.000 -2.08%
456.hmmer (avg) (percentage) 1.610 -3.01%
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.440 -2.22%
456.hmmer (unexplained diff vs previous) 4.000 -20.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -17.65%
458.sjeng 102.000 -2.86%
458.sjeng (avg) 102.000 -2.86%
458.sjeng (avg) (percentage) 1.360 -2.16%
458.sjeng (max) 19.000 -9.52%
458.sjeng (max) (percentage) 0.260 -7.14%
458.sjeng (unexplained diff vs previous) 17.000 112.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.220 100.00%
459.GemsFDTD 142.000 -2.07%
459.GemsFDTD (avg) 142.000 -2.07%
459.GemsFDTD (avg) (percentage) 2.310 -2.12%
459.GemsFDTD (max) 29.000 -12.12%
459.GemsFDTD (max) (percentage) 0.480 -12.73%
459.GemsFDTD (unexplained diff vs previous) 22.000 -35.29%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.360 -34.55%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.010 -1.63%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.710 -51.70%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.720 1.41%
464.h264ref 114.000 -2.56%
464.h264ref (avg) 114.000 -2.56%
464.h264ref (avg) (percentage) 1.970 -2.96%
464.h264ref (max) 14.000 -6.67%
464.h264ref (max) (percentage) 0.250 -3.85%
464.h264ref (unexplained diff vs previous) 1.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -
465.tonto 195.000 -3.94%
465.tonto (avg) 195.000 -3.94%
465.tonto (avg) (percentage) 1.790 -3.76%
465.tonto (max) 9.000 -83.93%
465.tonto (max) (percentage) 0.090 -82.69%
465.tonto (unexplained diff vs previous) 4.000 -63.64%
465.tonto (unexplained diff vs previous) (percentage) 0.040 -60.00%
470.lbm 87.000 -2.25%
470.lbm (avg) 87.000 -2.25%
470.lbm (avg) (percentage) 2.290 -2.14%
470.lbm (max) 9.000 -18.18%
470.lbm (max) (percentage) 0.260 -10.34%
470.lbm (unexplained diff vs previous) 10.000 -9.09%
470.lbm (unexplained diff vs previous) (percentage) 0.260 -10.34%
471.omnetpp 96.000 -3.03%
471.omnetpp (avg) 96.000 -3.03%
471.omnetpp (avg) (percentage) 3.520 -1.68%
471.omnetpp (max) 35.000 34.62%
471.omnetpp (max) (percentage) 1.300 36.84%
471.omnetpp (unexplained diff vs previous) 36.000 38.46%
471.omnetpp (unexplained diff vs previous) (percentage) 1.310 39.36%
473.astar 117.000 -
473.astar (avg) 117.000 -
473.astar (avg) (percentage) 2.260 -1.31%
473.astar (max) 49.000 -7.55%
473.astar (max) (percentage) 0.950 -8.65%
473.astar (unexplained diff vs previous) 47.000 -9.62%
473.astar (unexplained diff vs previous) (percentage) 0.910 -9.90%
481.wrf 143.000 -2.05%
481.wrf (avg) 143.000 -2.05%
481.wrf (avg) (percentage) 2.600 -2.62%
481.wrf (max) 66.000 -7.04%
481.wrf (max) (percentage) 1.210 -6.92%
481.wrf (unexplained diff vs previous) 40.000 -44.44%
481.wrf (unexplained diff vs previous) (percentage) 0.720 -45.04%
482.sphinx3 29.000 -3.33%
482.sphinx3 (avg) 29.000 -3.33%
482.sphinx3 (avg) (percentage) 3.110 -1.89%
482.sphinx3 (max) 8.000 33.33%
482.sphinx3 (max) (percentage) 0.940 32.39%
482.sphinx3 (unexplained diff vs previous) 9.000 50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.950 50.79%
483.xalancbmk 125.000 -2.34%
483.xalancbmk (avg) 125.000 -2.34%
483.xalancbmk (avg) (percentage) 3.340 -
483.xalancbmk (max) 96.000 -4.00%
483.xalancbmk (max) (percentage) 2.580 -1.53%
Geometric Mean 6.250 -16.06%