Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b27cafb9e09f251f595df3a9222a48f950aa00de (+ 29 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/727be65ec40e119a7c864bfaa5d6a73547863c06 (+ 68 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e5524ef335dc8e28d64cc376d57c219e566fcf53 (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=911893ac7b96a82cd5251f3bb864b892a8fe91cf (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/34/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0034 (3-changed-components) 2023-04-15T13:36:12 0:00:00
Previous 0033 (4-changed-components) 2023-04-11T21:48:56 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 79
Performance Improvements 106 118
Added Tests 4 4
Unchanged Tests 1104 1035
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 1.46% 566625.000 574889.000 - 1.47% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 6.15% 2977.000 3160.000 - -70.57% -
437.leslie3d 3.13% 10415.000 10741.000 - -28.42% -
400.perlbench 2.86% 1611.000 1657.000 - -84.44% -
401.bzip2 1.78% 2973.000 3026.000 - -80.07% -
481.wrf 1.27% 5585.000 5656.000 - -66.40% -
483.xalancbmk 1.08% 4274.000 4320.000 - -61.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (max) 32.88% 146.000 194.000 - -70.69% -
471.omnetpp (unexplained diff vs previous) 30.71% 140.000 183.000 - 603.85% -
471.omnetpp (max) (percentage) 24.75% 4.930 6.150 - -0.32% -
471.omnetpp (unexplained diff vs previous) (percentage) 23.19% 4.700 5.790 - 2312.50% -
471.omnetpp 7.89% 114.000 123.000 - -27.65% -
471.omnetpp (avg) 7.89% 114.000 123.000 - -27.65% -
437.leslie3d 3.29% 425.000 439.000 - 22.97% -
437.leslie3d (avg) 3.29% 425.000 439.000 - 22.97% -
400.perlbench 3.08% 65.000 67.000 - -57.05% -
400.perlbench (avg) 3.08% 65.000 67.000 - -57.05% -
456.hmmer 1.61% 62.000 63.000 - -16.00% -
456.hmmer (avg) 1.61% 62.000 63.000 - -16.00% -
471.omnetpp (avg) (percentage) 1.55% 3.860 3.920 - 146.54% -
481.wrf 1.04% 192.000 194.000 - -38.99% -
481.wrf (avg) 1.04% 192.000 194.000 - -38.99% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -2.70% 740.000 720.000 - -92.04% -
403.gcc -1.64% 61.000 60.000 - -99.33% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
459.GemsFDTD (unexplained diff vs previous) -97.86% 140.000 3.000 - -93.75% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -97.80% 2.270 0.050 - -76.19% -
473.astar (unexplained diff vs previous) -95.88% 243.000 10.000 - 233.33% -
473.astar (unexplained diff vs previous) (percentage) -95.85% 4.100 0.170 - 750.00% -
434.zeusmp (unexplained diff vs previous) -94.74% 38.000 2.000 - -99.35% -
434.zeusmp (unexplained diff vs previous) (percentage) -94.70% 1.510 0.080 - -96.57% -
410.bwaves (unexplained diff vs previous) -90.77% 130.000 12.000 - -20.00% -
410.bwaves (unexplained diff vs previous) (percentage) -90.61% 2.130 0.200 - 100.00% -
433.milc (unexplained diff vs previous) -85.71% 21.000 3.000 - -99.29% -
433.milc (unexplained diff vs previous) (percentage) -85.56% 1.800 0.260 - -92.07% -
470.lbm (unexplained diff vs previous) -81.48% 54.000 10.000 - -28.57% -
470.lbm (unexplained diff vs previous) (percentage) -81.25% 1.440 0.270 - 145.45% -
436.cactusADM (unexplained diff vs previous) -80.00% 40.000 8.000 - -98.60% -
436.cactusADM (unexplained diff vs previous) (percentage) -80.00% 1.900 0.380 - -88.31% -
401.bzip2 (unexplained diff vs previous) (percentage) -52.32% 3.670 1.750 - 101.15% -
401.bzip2 (unexplained diff vs previous) -51.38% 109.000 53.000 - -59.85% -
434.zeusmp (max) -47.17% 53.000 28.000 - -90.70% -
434.zeusmp (max) (percentage) -45.50% 2.110 1.150 - -49.56% -
462.libquantum (max) -40.00% 5.000 3.000 - -95.95% -
436.cactusADM (max) (percentage) -32.69% 2.080 1.400 - -55.56% -
436.cactusADM (max) -32.56% 43.000 29.000 - -94.75% -
433.milc (max) (percentage) -30.81% 1.980 1.370 - -56.78% -
433.milc (max) -30.43% 23.000 16.000 - -96.11% -
482.sphinx3 (max) -26.47% 34.000 25.000 - -94.31% -
473.astar (max) -25.30% 253.000 189.000 - 845.00% -
459.GemsFDTD (max) -25.17% 143.000 107.000 - -23.57% -
473.astar (max) (percentage) -25.00% 4.280 3.210 - 2192.86% -
403.gcc (max) -25.00% 4.000 3.000 - -95.31% -
462.libquantum (max) (percentage) -25.00% 3.760 2.820 - 340.62% -
459.GemsFDTD (max) (percentage) -25.00% 2.320 1.740 - 190.00% -
401.bzip2 (max) (percentage) -24.93% 3.810 2.860 - 225.00% -
482.sphinx3 (max) (percentage) -24.86% 3.620 2.720 - 85.03% -
410.bwaves (max) (percentage) -24.77% 2.180 1.640 - 680.95% -
470.lbm (max) (percentage) -24.66% 1.460 1.100 - -78.43% -
410.bwaves (max) -24.24% 132.000 100.000 - 233.33% -
470.lbm (max) -24.07% 54.000 41.000 - -93.72% -
401.bzip2 (max) -23.89% 113.000 86.000 - -35.34% -
444.namd (max) -13.64% 22.000 19.000 - -97.07% -
444.namd (max) (percentage) -11.76% 3.060 2.700 - -62.40% -
435.gromacs (max) -10.59% 321.000 287.000 - -7.72% -
458.sjeng (max) (percentage) -10.14% 1.380 1.240 - 463.64% -
429.mcf (max) (percentage) -9.98% 18.740 16.870 - 3024.07% -
435.gromacs (max) (percentage) -9.98% 4.410 3.970 - 96.53% -
429.mcf (max) -9.82% 285.000 257.000 - 179.35% -
458.sjeng (max) -9.43% 106.000 96.000 - 209.68% -
444.namd (unexplained diff vs previous) -9.09% 22.000 20.000 - -97.14% -
447.dealII (max) -8.89% 45.000 41.000 - -61.68% -
453.povray (max) (percentage) -8.37% 2.630 2.410 - -4.74% -
447.dealII (max) (percentage) -8.26% 2.300 2.110 - 91.82% -
456.hmmer (max) (percentage) -7.69% 0.520 0.480 - -62.20% -
450.soplex (max) -7.14% 28.000 26.000 - -91.45% -
453.povray (max) -7.14% 14.000 13.000 - -92.12% -
450.soplex (max) (percentage) -6.71% 5.070 4.730 - 140.10% -
456.hmmer (max) -6.67% 15.000 14.000 - -90.00% -
445.gobmk (max) -6.49% 154.000 144.000 - -21.31% -
444.namd (unexplained diff vs previous) (percentage) -6.40% 2.970 2.780 - -64.04% -
437.leslie3d (max) (percentage) -6.38% 6.580 6.160 - 163.25% -
445.gobmk (max) (percentage) -6.21% 2.900 2.720 - 77.78% -
465.tonto (max) -5.79% 380.000 358.000 - 22.18% -
464.h264ref (max) (percentage) -5.66% 0.530 0.500 - 16.28% -
465.tonto (max) (percentage) -4.96% 3.430 3.260 - -8.94% -
400.perlbench (max) (percentage) -4.02% 2.240 2.150 - -33.64% -
481.wrf (max) (percentage) -4.00% 1.750 1.680 - -46.67% -
437.leslie3d (max) -3.50% 685.000 661.000 - 88.32% -
464.h264ref (max) -3.33% 30.000 29.000 - -53.23% -
459.GemsFDTD (avg) (percentage) -3.22% 3.110 3.010 - 234.44% -
459.GemsFDTD -3.14% 191.000 185.000 - -11.90% -
459.GemsFDTD (avg) -3.14% 191.000 185.000 - -11.90% -
444.namd -3.12% 32.000 31.000 - -91.27% -
444.namd (avg) -3.12% 32.000 31.000 - -91.27% -
434.zeusmp (avg) (percentage) -2.99% 3.340 3.240 - 118.92% -
482.sphinx3 (avg) (percentage) -2.91% 3.780 3.670 - 151.37% -
482.sphinx3 -2.86% 35.000 34.000 - -92.20% -
482.sphinx3 (avg) -2.86% 35.000 34.000 - -92.20% -
400.perlbench (max) -2.78% 36.000 35.000 - -89.86% -
462.libquantum (avg) (percentage) -2.69% 3.340 3.250 - 400.00% -
473.astar (avg) (percentage) -2.66% 2.630 2.560 - 1247.37% -
473.astar -2.58% 155.000 151.000 - 439.29% -
473.astar (avg) -2.58% 155.000 151.000 - 439.29% -
454.calculix (max) (percentage) -2.57% 5.830 5.680 - 20.85% -
410.bwaves -2.56% 156.000 152.000 - -5.00% -
410.bwaves (avg) -2.56% 156.000 152.000 - -5.00% -
433.milc (avg) (percentage) -2.54% 3.930 3.830 - 125.29% -
470.lbm -2.50% 120.000 117.000 - -61.39% -
470.lbm (avg) -2.50% 120.000 117.000 - -61.39% -
470.lbm (avg) (percentage) -2.49% 3.210 3.130 - 32.07% -
403.gcc (max) (percentage) -2.49% 6.830 6.660 - 825.00% -
436.cactusADM (avg) (percentage) -2.45% 3.270 3.190 - 92.17% -
434.zeusmp -2.41% 83.000 81.000 - -58.46% -
434.zeusmp (avg) -2.41% 83.000 81.000 - -58.46% -
410.bwaves (avg) (percentage) -2.34% 2.560 2.500 - 129.36% -
433.milc -2.22% 45.000 44.000 - -80.00% -
433.milc (avg) -2.22% 45.000 44.000 - -80.00% -
481.wrf (max) -2.06% 97.000 95.000 - -82.08% -
416.gamess (max) -1.75% 171.000 168.000 - -74.39% -
447.dealII -1.69% 59.000 58.000 - -44.23% -
447.dealII (avg) -1.69% 59.000 58.000 - -44.23% -
436.cactusADM -1.47% 68.000 67.000 - -76.98% -
436.cactusADM (avg) -1.47% 68.000 67.000 - -76.98% -
416.gamess (max) (percentage) -1.45% 1.380 1.360 - -52.94% -
401.bzip2 (avg) (percentage) -1.29% 3.110 3.070 - 597.73% -
444.namd (avg) (percentage) -1.14% 4.400 4.350 - 10.69% -
465.tonto -1.04% 288.000 285.000 - 108.03% -
465.tonto (avg) -1.04% 288.000 285.000 - 108.03% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 1.47% 566534.000 574889.000 - 1.46% -
400.perlbench 1.26% 930652.000 942420.000 - 0.88% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 33.85% 8205.000 10982.000 - -0.92% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 3024.07% 0.540 16.870 - -9.98% -
471.omnetpp (unexplained diff vs previous) (percentage) 2312.50% 0.240 5.790 - 23.19% -
473.astar (max) (percentage) 2192.86% 0.140 3.210 - -25.00% -
483.xalancbmk (max) (percentage) 1485.37% 0.410 6.500 - -0.61% -
473.astar (avg) (percentage) 1247.37% 0.190 2.560 - -2.66% -
429.mcf (avg) (percentage) 1241.51% 0.530 7.110 - 0.00% -
403.gcc (avg) (percentage) 909.84% 0.610 6.160 - 0.00% -
473.astar (max) 845.00% 20.000 189.000 - -25.30% -
403.gcc (max) (percentage) 825.00% 0.720 6.660 - -2.49% -
473.astar (unexplained diff vs previous) (percentage) 750.00% 0.020 0.170 - -95.85% -
410.bwaves (max) (percentage) 680.95% 0.210 1.640 - -24.77% -
471.omnetpp (unexplained diff vs previous) 603.85% 26.000 183.000 - 30.71% -
401.bzip2 (avg) (percentage) 597.73% 0.440 3.070 - -1.29% -
483.xalancbmk (max) 522.22% 45.000 280.000 - 0.36% -
458.sjeng (max) (percentage) 463.64% 0.220 1.240 - -10.14% -
473.astar 439.29% 28.000 151.000 - -2.58% -
473.astar (avg) 439.29% 28.000 151.000 - -2.58% -
458.sjeng (avg) (percentage) 409.09% 0.330 1.680 - 0.00% -
462.libquantum (avg) (percentage) 400.00% 0.650 3.250 - -2.69% -
462.libquantum (max) (percentage) 340.62% 0.640 2.820 - -25.00% -
464.h264ref (avg) (percentage) 329.63% 0.540 2.320 - 0.00% -
450.soplex (avg) (percentage) 296.77% 1.240 4.920 - 0.00% -
459.GemsFDTD (avg) (percentage) 234.44% 0.900 3.010 - -3.22% -
410.bwaves (max) 233.33% 30.000 100.000 - -24.24% -
473.astar (unexplained diff vs previous) 233.33% 3.000 10.000 - -95.88% -
401.bzip2 (max) (percentage) 225.00% 0.880 2.860 - -24.93% -
456.hmmer (avg) (percentage) 219.12% 0.680 2.170 - 0.00% -
458.sjeng (max) 209.68% 31.000 96.000 - -9.43% -
445.gobmk (avg) (percentage) 200.00% 0.770 2.310 - 0.00% -
459.GemsFDTD (max) (percentage) 190.00% 0.600 1.740 - -25.00% -
453.povray (avg) (percentage) 186.40% 1.250 3.580 - 0.00% -
429.mcf (max) 179.35% 92.000 257.000 - -9.82% -
400.perlbench (avg) (percentage) 178.23% 1.470 4.090 - 0.00% -
447.dealII (avg) (percentage) 176.64% 1.070 2.960 - 0.00% -
458.sjeng 176.60% 47.000 130.000 - 0.78% -
458.sjeng (avg) 176.60% 47.000 130.000 - 0.78% -
437.leslie3d (max) (percentage) 163.25% 2.340 6.160 - -6.38% -
482.sphinx3 (avg) (percentage) 151.37% 1.460 3.670 - -2.91% -
454.calculix (avg) (percentage) 148.26% 2.010 4.990 - 0.00% -
471.omnetpp (avg) (percentage) 146.54% 1.590 3.920 - 1.55% -
470.lbm (unexplained diff vs previous) (percentage) 145.45% 0.110 0.270 - -81.25% -
450.soplex (max) (percentage) 140.10% 1.970 4.730 - -6.71% -
410.bwaves (avg) (percentage) 129.36% 1.090 2.500 - -2.34% -
433.milc (avg) (percentage) 125.29% 1.700 3.830 - -2.54% -
434.zeusmp (avg) (percentage) 118.92% 1.480 3.240 - -2.99% -
465.tonto 108.03% 137.000 285.000 - -1.04% -
465.tonto (avg) 108.03% 137.000 285.000 - -1.04% -
401.bzip2 (unexplained diff vs previous) (percentage) 101.15% 0.870 1.750 - -52.32% -
410.bwaves (unexplained diff vs previous) (percentage) 100.00% 0.100 0.200 - -90.61% -
435.gromacs (max) (percentage) 96.53% 2.020 3.970 - -9.98% -
435.gromacs (avg) (percentage) 94.22% 1.730 3.360 - 0.00% -
436.cactusADM (avg) (percentage) 92.17% 1.660 3.190 - -2.45% -
447.dealII (max) (percentage) 91.82% 1.100 2.110 - -8.26% -
437.leslie3d (max) 88.32% 351.000 661.000 - -3.50% -
482.sphinx3 (max) (percentage) 85.03% 1.470 2.720 - -24.86% -
481.wrf (avg) (percentage) 82.01% 1.890 3.440 - 0.00% -
445.gobmk (max) (percentage) 77.78% 1.530 2.720 - -6.21% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
464.h264ref 74.36% 78.000 136.000 - 0.74% -
464.h264ref (avg) 74.36% 78.000 136.000 - 0.74% -
437.leslie3d (avg) (percentage) 71.85% 2.380 4.090 - 0.00% -
465.tonto (avg) (percentage) 55.69% 1.670 2.600 - 0.00% -
401.bzip2 39.39% 66.000 92.000 - 0.00% -
401.bzip2 (avg) 39.39% 66.000 92.000 - 0.00% -
445.gobmk 32.61% 92.000 122.000 - 0.00% -
445.gobmk (avg) 32.61% 92.000 122.000 - 0.00% -
470.lbm (avg) (percentage) 32.07% 2.370 3.130 - -2.49% -
437.leslie3d 22.97% 357.000 439.000 - 3.29% -
437.leslie3d (avg) 22.97% 357.000 439.000 - 3.29% -
465.tonto (max) 22.18% 293.000 358.000 - -5.79% -
454.calculix (max) (percentage) 20.85% 4.700 5.680 - -2.57% -
429.mcf 20.00% 90.000 108.000 - 0.00% -
429.mcf (avg) 20.00% 90.000 108.000 - 0.00% -
464.h264ref (max) (percentage) 16.28% 0.430 0.500 - -5.66% -
416.gamess (avg) (percentage) 11.98% 2.170 2.430 - 0.00% -
444.namd (avg) (percentage) 10.69% 3.930 4.350 - -1.14% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.90% 120221.000 111929.000 - -0.01% -
464.h264ref -1.01% 428364.000 424052.000 - 0.99% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 63.000 - 0.00% -
403.gcc -99.33% 9010.000 60.000 - -1.64% -
462.libquantum -98.81% 11614.000 138.000 - 0.00% -
482.sphinx3 -96.85% 29928.000 944.000 - 0.00% -
450.soplex -96.36% 15466.000 563.000 - -0.71% -
444.namd -92.04% 9050.000 720.000 - -2.70% -
453.povray -91.63% 6544.000 548.000 - 0.37% -
429.mcf -91.09% 17158.000 1528.000 - 0.13% -
433.milc -90.97% 12976.000 1172.000 - 0.26% -
436.cactusADM -87.95% 17544.000 2114.000 - 0.38% -
400.perlbench -84.44% 10650.000 1657.000 - 2.86% -
434.zeusmp -80.99% 13211.000 2512.000 - -0.08% -
401.bzip2 -80.07% 15185.000 3026.000 - 1.78% -
447.dealII -79.59% 9751.000 1990.000 - -0.45% -
459.GemsFDTD -73.60% 23356.000 6167.000 - 0.05% -
456.hmmer -73.57% 11046.000 2919.000 - 0.86% -
470.lbm -70.73% 12819.000 3752.000 - 0.27% -
471.omnetpp -70.57% 10739.000 3160.000 - 6.15% -
481.wrf -66.40% 16834.000 5656.000 - 1.27% -
483.xalancbmk -61.33% 11172.000 4320.000 - 1.08% -
473.astar -60.40% 14932.000 5913.000 - -0.17% -
464.h264ref -59.69% 14556.000 5867.000 - 0.58% -
410.bwaves -58.60% 14755.000 6109.000 - 0.20% -
445.gobmk -55.86% 11995.000 5295.000 - -0.38% -
435.gromacs -52.96% 15419.000 7253.000 - -0.45% -
458.sjeng -45.70% 14275.000 7752.000 - 0.39% -
416.gamess -45.33% 22704.000 12412.000 - 0.11% -
437.leslie3d -28.42% 15005.000 10741.000 - 3.13% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.35% 308.000 2.000 - -94.74% -
454.calculix -99.35% 459.000 3.000 - 0.00% -
454.calculix (avg) -99.35% 459.000 3.000 - 0.00% -
433.milc (unexplained diff vs previous) -99.29% 425.000 3.000 - -85.71% -
436.cactusADM (unexplained diff vs previous) -98.60% 570.000 8.000 - -80.00% -
444.namd (unexplained diff vs previous) -97.14% 700.000 20.000 - -9.09% -
444.namd (max) -97.07% 649.000 19.000 - -13.64% -
434.zeusmp (unexplained diff vs previous) (percentage) -96.57% 2.330 0.080 - -94.70% -
433.milc (max) -96.11% 411.000 16.000 - -30.43% -
462.libquantum (max) -95.95% 74.000 3.000 - -40.00% -
403.gcc (max) -95.31% 64.000 3.000 - -25.00% -
436.cactusADM (max) -94.75% 552.000 29.000 - -32.56% -
462.libquantum -94.67% 75.000 4.000 - 0.00% -
462.libquantum (avg) -94.67% 75.000 4.000 - 0.00% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
482.sphinx3 (max) -94.31% 439.000 25.000 - -26.47% -
459.GemsFDTD (unexplained diff vs previous) -93.75% 48.000 3.000 - -97.86% -
470.lbm (max) -93.72% 653.000 41.000 - -24.07% -
482.sphinx3 -92.20% 436.000 34.000 - -2.86% -
482.sphinx3 (avg) -92.20% 436.000 34.000 - -2.86% -
453.povray (max) -92.12% 165.000 13.000 - -7.14% -
433.milc (unexplained diff vs previous) (percentage) -92.07% 3.280 0.260 - -85.56% -
450.soplex (max) -91.45% 304.000 26.000 - -7.14% -
444.namd -91.27% 355.000 31.000 - -3.12% -
444.namd (avg) -91.27% 355.000 31.000 - -3.12% -
434.zeusmp (max) -90.70% 301.000 28.000 - -47.17% -
456.hmmer (max) -90.00% 140.000 14.000 - -6.67% -
400.perlbench (max) -89.86% 345.000 35.000 - -2.78% -
436.cactusADM (unexplained diff vs previous) (percentage) -88.31% 3.250 0.380 - -80.00% -
450.soplex -85.86% 191.000 27.000 - 0.00% -
450.soplex (avg) -85.86% 191.000 27.000 - 0.00% -
481.wrf (max) -82.08% 530.000 95.000 - -2.06% -
433.milc -80.00% 220.000 44.000 - -2.22% -
433.milc (avg) -80.00% 220.000 44.000 - -2.22% -
470.lbm (max) (percentage) -78.43% 5.100 1.100 - -24.66% -
436.cactusADM -76.98% 291.000 67.000 - -1.47% -
436.cactusADM (avg) -76.98% 291.000 67.000 - -1.47% -
453.povray -76.54% 81.000 19.000 - 0.00% -
453.povray (avg) -76.54% 81.000 19.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -76.19% 0.210 0.050 - -97.80% -
416.gamess (max) -74.39% 656.000 168.000 - -1.75% -
471.omnetpp (max) -70.69% 662.000 194.000 - 32.88% -
444.namd (unexplained diff vs previous) (percentage) -64.04% 7.730 2.780 - -6.40% -
444.namd (max) (percentage) -62.40% 7.180 2.700 - -11.76% -
456.hmmer (max) (percentage) -62.20% 1.270 0.480 - -7.69% -
447.dealII (max) -61.68% 107.000 41.000 - -8.89% -
470.lbm -61.39% 303.000 117.000 - -2.50% -
470.lbm (avg) -61.39% 303.000 117.000 - -2.50% -
401.bzip2 (unexplained diff vs previous) -59.85% 132.000 53.000 - -51.38% -
434.zeusmp -58.46% 195.000 81.000 - -2.41% -
434.zeusmp (avg) -58.46% 195.000 81.000 - -2.41% -
400.perlbench -57.05% 156.000 67.000 - 3.08% -
400.perlbench (avg) -57.05% 156.000 67.000 - 3.08% -
433.milc (max) (percentage) -56.78% 3.170 1.370 - -30.81% -
436.cactusADM (max) (percentage) -55.56% 3.150 1.400 - -32.69% -
464.h264ref (max) -53.23% 62.000 29.000 - -3.33% -
416.gamess (max) (percentage) -52.94% 2.890 1.360 - -1.45% -
434.zeusmp (max) (percentage) -49.56% 2.280 1.150 - -45.50% -
481.wrf (max) (percentage) -46.67% 3.150 1.680 - -4.00% -
447.dealII -44.23% 104.000 58.000 - -1.69% -
447.dealII (avg) -44.23% 104.000 58.000 - -1.69% -
481.wrf -38.99% 318.000 194.000 - 1.04% -
481.wrf (avg) -38.99% 318.000 194.000 - 1.04% -
416.gamess -38.82% 492.000 301.000 - 0.00% -
416.gamess (avg) -38.82% 492.000 301.000 - 0.00% -
401.bzip2 (max) -35.34% 133.000 86.000 - -23.89% -
400.perlbench (max) (percentage) -33.64% 3.240 2.150 - -4.02% -
483.xalancbmk -32.43% 74.000 50.000 - 0.00% -
483.xalancbmk (avg) -32.43% 74.000 50.000 - 0.00% -
470.lbm (unexplained diff vs previous) -28.57% 14.000 10.000 - -81.48% -
471.omnetpp -27.65% 170.000 123.000 - 7.89% -
471.omnetpp (avg) -27.65% 170.000 123.000 - 7.89% -
459.GemsFDTD (max) -23.57% 140.000 107.000 - -25.17% -
445.gobmk (max) -21.31% 183.000 144.000 - -6.49% -
410.bwaves (unexplained diff vs previous) -20.00% 15.000 12.000 - -90.77% -
456.hmmer -16.00% 75.000 63.000 - 1.61% -
456.hmmer (avg) -16.00% 75.000 63.000 - 1.61% -
459.GemsFDTD -11.90% 210.000 185.000 - -3.14% -
459.GemsFDTD (avg) -11.90% 210.000 185.000 - -3.14% -
465.tonto (max) (percentage) -8.94% 3.580 3.260 - -4.96% -
435.gromacs -8.65% 266.000 243.000 - -0.41% -
435.gromacs (avg) -8.65% 266.000 243.000 - -0.41% -
435.gromacs (max) -7.72% 311.000 287.000 - -10.59% -
410.bwaves -5.00% 160.000 152.000 - -2.56% -
410.bwaves (avg) -5.00% 160.000 152.000 - -2.56% -
453.povray (max) (percentage) -4.74% 2.530 2.410 - -8.37% -

Added Tests - sample variability
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1657.000 2.86%
401.bzip2 3026.000 1.78%
403.gcc 60.000 -1.64%
410.bwaves 6109.000 -
416.gamess 12412.000 -
429.mcf 1528.000 -
433.milc 1172.000 -
434.zeusmp 2512.000 -
435.gromacs 7253.000 -
436.cactusADM 2114.000 -
437.leslie3d 10741.000 3.13%
444.namd 720.000 -2.70%
445.gobmk 5295.000 -
447.dealII 1990.000 -
450.soplex 563.000 -
453.povray 548.000 -
454.calculix 63.000 -
456.hmmer 2919.000 -
458.sjeng 7752.000 -
459.GemsFDTD 6167.000 -
462.libquantum 138.000 -
464.h264ref 5867.000 -
465.tonto 10982.000 -
470.lbm 3752.000 -
471.omnetpp 3160.000 6.15%
473.astar 5913.000 -
481.wrf 5656.000 1.27%
482.sphinx3 944.000 -
483.xalancbmk 4320.000 1.08%
Geometric Mean 2159.972 -
Code Size (bytes)
Name Current %
400.perlbench 942420.000 -
401.bzip2 49892.000 -
403.gcc 2682457.000 -
410.bwaves 17876.000 -
416.gamess 6255999.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165703.000 -
435.gromacs 678517.000 -
436.cactusADM 553666.000 -
437.leslie3d 65253.000 -
444.namd 190970.000 -
445.gobmk 1399587.000 -
447.dealII 2122271.000 -
450.soplex 260559.000 -
453.povray 704505.000 -
454.calculix 1272891.000 -
456.hmmer 231156.000 -
458.sjeng 111929.000 -
459.GemsFDTD 254113.000 -
462.libquantum 31313.000 -
464.h264ref 424052.000 -
465.tonto 2875105.000 -
470.lbm 10908.000 -
471.omnetpp 574889.000 1.46%
473.astar 32052.000 -
481.wrf 2647256.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3286434.000 -
Geometric Mean 297421.836 -
sample variability
Name Current %
400.perlbench 67.000 3.08%
400.perlbench (avg) 67.000 3.08%
400.perlbench (avg) (percentage) 4.090 -
400.perlbench (max) 35.000 -2.78%
400.perlbench (max) (percentage) 2.150 -4.02%
401.bzip2 92.000 -
401.bzip2 (avg) 92.000 -
401.bzip2 (avg) (percentage) 3.070 -1.29%
401.bzip2 (max) 86.000 -23.89%
401.bzip2 (max) (percentage) 2.860 -24.93%
401.bzip2 (unexplained diff vs previous) 53.000 -51.38%
401.bzip2 (unexplained diff vs previous) (percentage) 1.750 -52.32%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.160 -
403.gcc (max) 3.000 -25.00%
403.gcc (max) (percentage) 6.660 -2.49%
410.bwaves 152.000 -2.56%
410.bwaves (avg) 152.000 -2.56%
410.bwaves (avg) (percentage) 2.500 -2.34%
410.bwaves (max) 100.000 -24.24%
410.bwaves (max) (percentage) 1.640 -24.77%
410.bwaves (unexplained diff vs previous) 12.000 -90.77%
410.bwaves (unexplained diff vs previous) (percentage) 0.200 -90.61%
416.gamess 301.000 -
416.gamess (avg) 301.000 -
416.gamess (avg) (percentage) 2.430 -
416.gamess (max) 168.000 -1.75%
416.gamess (max) (percentage) 1.360 -1.45%
429.mcf 108.000 -
429.mcf (avg) 108.000 -
429.mcf (avg) (percentage) 7.110 -
429.mcf (max) 257.000 -9.82%
429.mcf (max) (percentage) 16.870 -9.98%
433.milc 44.000 -2.22%
433.milc (avg) 44.000 -2.22%
433.milc (avg) (percentage) 3.830 -2.54%
433.milc (max) 16.000 -30.43%
433.milc (max) (percentage) 1.370 -30.81%
433.milc (unexplained diff vs previous) 3.000 -85.71%
433.milc (unexplained diff vs previous) (percentage) 0.260 -85.56%
434.zeusmp 81.000 -2.41%
434.zeusmp (avg) 81.000 -2.41%
434.zeusmp (avg) (percentage) 3.240 -2.99%
434.zeusmp (max) 28.000 -47.17%
434.zeusmp (max) (percentage) 1.150 -45.50%
434.zeusmp (unexplained diff vs previous) 2.000 -94.74%
434.zeusmp (unexplained diff vs previous) (percentage) 0.080 -94.70%
435.gromacs 243.000 -
435.gromacs (avg) 243.000 -
435.gromacs (avg) (percentage) 3.360 -
435.gromacs (max) 287.000 -10.59%
435.gromacs (max) (percentage) 3.970 -9.98%
436.cactusADM 67.000 -1.47%
436.cactusADM (avg) 67.000 -1.47%
436.cactusADM (avg) (percentage) 3.190 -2.45%
436.cactusADM (max) 29.000 -32.56%
436.cactusADM (max) (percentage) 1.400 -32.69%
436.cactusADM (unexplained diff vs previous) 8.000 -80.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.380 -80.00%
437.leslie3d 439.000 3.29%
437.leslie3d (avg) 439.000 3.29%
437.leslie3d (avg) (percentage) 4.090 -
437.leslie3d (max) 661.000 -3.50%
437.leslie3d (max) (percentage) 6.160 -6.38%
444.namd 31.000 -3.12%
444.namd (avg) 31.000 -3.12%
444.namd (avg) (percentage) 4.350 -1.14%
444.namd (max) 19.000 -13.64%
444.namd (max) (percentage) 2.700 -11.76%
444.namd (unexplained diff vs previous) 20.000 -9.09%
444.namd (unexplained diff vs previous) (percentage) 2.780 -6.40%
445.gobmk 122.000 -
445.gobmk (avg) 122.000 -
445.gobmk (avg) (percentage) 2.310 -
445.gobmk (max) 144.000 -6.49%
445.gobmk (max) (percentage) 2.720 -6.21%
447.dealII 58.000 -1.69%
447.dealII (avg) 58.000 -1.69%
447.dealII (avg) (percentage) 2.960 -
447.dealII (max) 41.000 -8.89%
447.dealII (max) (percentage) 2.110 -8.26%
450.soplex 27.000 -
450.soplex (avg) 27.000 -
450.soplex (avg) (percentage) 4.920 -
450.soplex (max) 26.000 -7.14%
450.soplex (max) (percentage) 4.730 -6.71%
453.povray 19.000 -
453.povray (avg) 19.000 -
453.povray (avg) (percentage) 3.580 -
453.povray (max) 13.000 -7.14%
453.povray (max) (percentage) 2.410 -8.37%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 4.990 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.680 -2.57%
456.hmmer 63.000 1.61%
456.hmmer (avg) 63.000 1.61%
456.hmmer (avg) (percentage) 2.170 -
456.hmmer (max) 14.000 -6.67%
456.hmmer (max) (percentage) 0.480 -7.69%
458.sjeng 130.000 -
458.sjeng (avg) 130.000 -
458.sjeng (avg) (percentage) 1.680 -
458.sjeng (max) 96.000 -9.43%
458.sjeng (max) (percentage) 1.240 -10.14%
459.GemsFDTD 185.000 -3.14%
459.GemsFDTD (avg) 185.000 -3.14%
459.GemsFDTD (avg) (percentage) 3.010 -3.22%
459.GemsFDTD (max) 107.000 -25.17%
459.GemsFDTD (max) (percentage) 1.740 -25.00%
459.GemsFDTD (unexplained diff vs previous) 3.000 -97.86%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.050 -97.80%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.250 -2.69%
462.libquantum (max) 3.000 -40.00%
462.libquantum (max) (percentage) 2.820 -25.00%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 136.000 -
464.h264ref (avg) 136.000 -
464.h264ref (avg) (percentage) 2.320 -
464.h264ref (max) 29.000 -3.33%
464.h264ref (max) (percentage) 0.500 -5.66%
465.tonto 285.000 -1.04%
465.tonto (avg) 285.000 -1.04%
465.tonto (avg) (percentage) 2.600 -
465.tonto (max) 358.000 -5.79%
465.tonto (max) (percentage) 3.260 -4.96%
470.lbm 117.000 -2.50%
470.lbm (avg) 117.000 -2.50%
470.lbm (avg) (percentage) 3.130 -2.49%
470.lbm (max) 41.000 -24.07%
470.lbm (max) (percentage) 1.100 -24.66%
470.lbm (unexplained diff vs previous) 10.000 -81.48%
470.lbm (unexplained diff vs previous) (percentage) 0.270 -81.25%
471.omnetpp 123.000 7.89%
471.omnetpp (avg) 123.000 7.89%
471.omnetpp (avg) (percentage) 3.920 1.55%
471.omnetpp (max) 194.000 32.88%
471.omnetpp (max) (percentage) 6.150 24.75%
471.omnetpp (unexplained diff vs previous) 183.000 30.71%
471.omnetpp (unexplained diff vs previous) (percentage) 5.790 23.19%
473.astar 151.000 -2.58%
473.astar (avg) 151.000 -2.58%
473.astar (avg) (percentage) 2.560 -2.66%
473.astar (max) 189.000 -25.30%
473.astar (max) (percentage) 3.210 -25.00%
473.astar (unexplained diff vs previous) 10.000 -95.88%
473.astar (unexplained diff vs previous) (percentage) 0.170 -95.85%
481.wrf 194.000 1.04%
481.wrf (avg) 194.000 1.04%
481.wrf (avg) (percentage) 3.440 -
481.wrf (max) 95.000 -2.06%
481.wrf (max) (percentage) 1.680 -4.00%
482.sphinx3 34.000 -2.86%
482.sphinx3 (avg) 34.000 -2.86%
482.sphinx3 (avg) (percentage) 3.670 -2.91%
482.sphinx3 (max) 25.000 -26.47%
482.sphinx3 (max) (percentage) 2.720 -24.86%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
483.xalancbmk 50.000 -
483.xalancbmk (avg) 50.000 -
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 280.000 -
483.xalancbmk (max) (percentage) 6.500 -
Geometric Mean 10.497 -42.71%