Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d89504f0d90dedd3d5ab83d8c91707a354231d2f (+ 44 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6d7f9ebfb827d238543ce81a096ee0ad369715ef (+ 104 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0aa5b28a504c6f1f17b387d8147715d1496fff62 (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4b69fbd471e9b8cad99b37c284710edefbf25ee9 (+ 137 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/35/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0035 (4-changed-components) 2023-04-18T18:56:33 0:00:00
Previous 0034 (3-changed-components) 2023-04-15T13:36:12 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 18 75
Performance Improvements 92 113
Added Tests 2 0
Unchanged Tests 1124 1048
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.33% 60.000 62.000 - -99.31% -
437.leslie3d 3.23% 10741.000 11088.000 - -26.10% -
450.soplex 1.95% 563.000 574.000 - -96.29% -
434.zeusmp 1.51% 2512.000 2550.000 - -80.70% -
435.gromacs 1.38% 7253.000 7353.000 - -52.31% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) 133.33% 3.000 7.000 - -98.35% -
433.milc (unexplained diff vs previous) (percentage) 130.77% 0.260 0.600 - -81.71% -
470.lbm (unexplained diff vs previous) 50.00% 10.000 15.000 - 7.14% -
470.lbm (unexplained diff vs previous) (percentage) 48.15% 0.270 0.400 - 263.64% -
403.gcc (max) 33.33% 3.000 4.000 - -93.75% -
450.soplex 3.70% 27.000 28.000 - -85.34% -
450.soplex (avg) 3.70% 27.000 28.000 - -85.34% -
437.leslie3d 3.19% 439.000 453.000 - 26.89% -
437.leslie3d (avg) 3.19% 439.000 453.000 - 26.89% -
435.gromacs 1.65% 243.000 247.000 - -7.14% -
435.gromacs (avg) 1.65% 243.000 247.000 - -7.14% -
434.zeusmp 1.23% 81.000 82.000 - -57.95% -
434.zeusmp (avg) 1.23% 81.000 82.000 - -57.95% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench -2.62% 942420.000 917716.000 - -1.39% -
471.omnetpp -1.43% 574889.000 566644.000 - 0.02% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -4.75% 4320.000 4115.000 - -63.17% -
471.omnetpp -4.68% 3160.000 3012.000 - -71.95% -
401.bzip2 -2.12% 3026.000 2962.000 - -80.49% -
482.sphinx3 -1.80% 944.000 927.000 - -96.90% -
400.perlbench -1.69% 1657.000 1629.000 - -84.70% -
454.calculix -1.59% 63.000 62.000 - -99.73% -
481.wrf -1.04% 5656.000 5597.000 - -66.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) (percentage) -75.18% 2.780 0.690 - -91.07% -
444.namd (unexplained diff vs previous) -75.00% 20.000 5.000 - -99.29% -
429.mcf (max) -26.07% 257.000 190.000 - 106.52% -
429.mcf (max) (percentage) -25.96% 16.870 12.490 - 2212.96% -
471.omnetpp (max) -20.62% 194.000 154.000 - -76.74% -
471.omnetpp (unexplained diff vs previous) -19.13% 183.000 148.000 - 469.23% -
471.omnetpp (max) (percentage) -16.75% 6.150 5.120 - -17.02% -
444.namd (max) (percentage) -16.67% 2.700 2.250 - -68.66% -
444.namd (max) -15.79% 19.000 16.000 - -97.53% -
471.omnetpp (unexplained diff vs previous) (percentage) -15.20% 5.790 4.910 - 1945.83% -
401.bzip2 (max) -12.79% 86.000 75.000 - -43.61% -
433.milc (max) -12.50% 16.000 14.000 - -96.59% -
470.lbm (max) -12.20% 41.000 36.000 - -94.49% -
410.bwaves (max) -12.00% 100.000 88.000 - 193.33% -
482.sphinx3 (max) -12.00% 25.000 22.000 - -94.99% -
470.lbm (max) (percentage) -11.82% 1.100 0.970 - -80.98% -
473.astar (max) -11.64% 189.000 167.000 - 735.00% -
410.bwaves (max) (percentage) -11.59% 1.640 1.450 - 590.48% -
436.cactusADM (max) (percentage) -11.43% 1.400 1.240 - -60.63% -
482.sphinx3 (max) (percentage) -11.40% 2.720 2.410 - 63.95% -
434.zeusmp (max) (percentage) -11.30% 1.150 1.020 - -55.26% -
459.GemsFDTD (max) -11.21% 107.000 95.000 - -32.14% -
473.astar (max) (percentage) -11.21% 3.210 2.850 - 1935.71% -
401.bzip2 (max) (percentage) -11.19% 2.860 2.540 - 188.64% -
462.libquantum (max) (percentage) -10.99% 2.820 2.510 - 292.19% -
433.milc (max) (percentage) -10.95% 1.370 1.220 - -61.51% -
459.GemsFDTD (max) (percentage) -10.92% 1.740 1.550 - 158.33% -
436.cactusADM (max) -10.34% 29.000 26.000 - -95.29% -
458.sjeng (max) -8.33% 96.000 88.000 - 183.87% -
453.povray (max) -7.69% 13.000 12.000 - -92.73% -
435.gromacs (max) (percentage) -7.56% 3.970 3.670 - 81.68% -
458.sjeng (max) (percentage) -7.26% 1.240 1.150 - 422.73% -
434.zeusmp (max) -7.14% 28.000 26.000 - -91.36% -
456.hmmer (max) -7.14% 14.000 13.000 - -90.71% -
464.h264ref (max) -6.90% 29.000 27.000 - -56.45% -
453.povray (max) (percentage) -6.64% 2.410 2.250 - -11.07% -
447.dealII (max) (percentage) -6.64% 2.110 1.970 - 79.09% -
435.gromacs (max) -6.27% 287.000 269.000 - -13.50% -
464.h264ref (max) (percentage) -6.00% 0.500 0.470 - 9.30% -
400.perlbench (max) -5.71% 35.000 33.000 - -90.43% -
445.gobmk (max) -5.56% 144.000 136.000 - -25.68% -
481.wrf (max) -5.26% 95.000 90.000 - -83.02% -
445.gobmk (max) (percentage) -5.15% 2.720 2.580 - 68.63% -
483.xalancbmk (max) -5.00% 280.000 266.000 - 491.11% -
447.dealII (max) -4.88% 41.000 39.000 - -63.55% -
437.leslie3d (max) (percentage) -4.71% 6.160 5.870 - 150.85% -
450.soplex (max) (percentage) -4.65% 4.730 4.510 - 128.93% -
465.tonto (max) -4.47% 358.000 342.000 - 16.72% -
465.tonto (max) (percentage) -4.29% 3.260 3.120 - -12.85% -
400.perlbench (max) (percentage) -4.19% 2.150 2.060 - -36.42% -
456.hmmer (max) (percentage) -4.17% 0.480 0.460 - -63.78% -
471.omnetpp -4.07% 123.000 118.000 - -30.59% -
471.omnetpp (avg) -4.07% 123.000 118.000 - -30.59% -
483.xalancbmk -4.00% 50.000 48.000 - -35.14% -
483.xalancbmk (avg) -4.00% 50.000 48.000 - -35.14% -
450.soplex (max) -3.85% 26.000 25.000 - -91.78% -
481.wrf (max) (percentage) -3.57% 1.680 1.620 - -48.57% -
470.lbm -3.42% 117.000 113.000 - -62.71% -
470.lbm (avg) -3.42% 117.000 113.000 - -62.71% -
444.namd -3.23% 31.000 30.000 - -91.55% -
444.namd (avg) -3.23% 31.000 30.000 - -91.55% -
429.mcf -2.78% 108.000 105.000 - 16.67% -
429.mcf (avg) -2.78% 108.000 105.000 - 16.67% -
444.namd (avg) (percentage) -2.76% 4.350 4.230 - 7.63% -
429.mcf (avg) (percentage) -2.67% 7.110 6.920 - 1205.66% -
470.lbm (avg) (percentage) -2.56% 3.130 3.050 - 28.69% -
433.milc (avg) (percentage) -2.35% 3.830 3.740 - 120.00% -
454.calculix (max) (percentage) -2.29% 5.680 5.550 - 18.09% -
433.milc -2.27% 44.000 43.000 - -80.45% -
433.milc (avg) -2.27% 44.000 43.000 - -80.45% -
403.gcc (max) (percentage) -2.25% 6.660 6.510 - 804.17% -
401.bzip2 -2.17% 92.000 90.000 - 36.36% -
401.bzip2 (avg) -2.17% 92.000 90.000 - 36.36% -
462.libquantum (avg) (percentage) -2.15% 3.250 3.180 - 389.23% -
416.gamess (max) -1.79% 168.000 165.000 - -74.85% -
437.leslie3d (max) -1.66% 661.000 650.000 - 85.19% -
456.hmmer -1.59% 63.000 62.000 - -17.33% -
456.hmmer (avg) -1.59% 63.000 62.000 - -17.33% -
400.perlbench -1.49% 67.000 66.000 - -57.69% -
400.perlbench (avg) -1.49% 67.000 66.000 - -57.69% -
416.gamess (max) (percentage) -1.47% 1.360 1.340 - -53.63% -
481.wrf -1.03% 194.000 192.000 - -39.62% -
481.wrf (avg) -1.03% 194.000 192.000 - -39.62% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 33.83% 8205.000 10981.000 - -0.01% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 7100.00% 0.010 0.720 - 0.00% -
429.mcf (max) (percentage) 2212.96% 0.540 12.490 - -25.96% -
471.omnetpp (unexplained diff vs previous) (percentage) 1945.83% 0.240 4.910 - -15.20% -
473.astar (max) (percentage) 1935.71% 0.140 2.850 - -11.21% -
483.xalancbmk (max) (percentage) 1478.05% 0.410 6.470 - -0.46% -
473.astar (avg) (percentage) 1247.37% 0.190 2.560 - 0.00% -
429.mcf (avg) (percentage) 1205.66% 0.530 6.920 - -2.67% -
403.gcc (avg) (percentage) 909.84% 0.610 6.160 - 0.00% -
403.gcc (max) (percentage) 804.17% 0.720 6.510 - -2.25% -
473.astar (max) 735.00% 20.000 167.000 - -11.64% -
401.bzip2 (avg) (percentage) 597.73% 0.440 3.070 - 0.00% -
410.bwaves (max) (percentage) 590.48% 0.210 1.450 - -11.59% -
483.xalancbmk (max) 491.11% 45.000 266.000 - -5.00% -
471.omnetpp (unexplained diff vs previous) 469.23% 26.000 148.000 - -19.13% -
473.astar 435.71% 28.000 150.000 - -0.66% -
473.astar (avg) 435.71% 28.000 150.000 - -0.66% -
458.sjeng (max) (percentage) 422.73% 0.220 1.150 - -7.26% -
458.sjeng (avg) (percentage) 409.09% 0.330 1.680 - 0.00% -
462.libquantum (avg) (percentage) 389.23% 0.650 3.180 - -2.15% -
464.h264ref (avg) (percentage) 329.63% 0.540 2.320 - 0.00% -
450.soplex (avg) (percentage) 296.77% 1.240 4.920 - 0.00% -
462.libquantum (max) (percentage) 292.19% 0.640 2.510 - -10.99% -
470.lbm (unexplained diff vs previous) (percentage) 263.64% 0.110 0.400 - 48.15% -
459.GemsFDTD (avg) (percentage) 234.44% 0.900 3.010 - 0.00% -
456.hmmer (avg) (percentage) 219.12% 0.680 2.170 - 0.00% -
445.gobmk (avg) (percentage) 200.00% 0.770 2.310 - 0.00% -
410.bwaves (max) 193.33% 30.000 88.000 - -12.00% -
401.bzip2 (max) (percentage) 188.64% 0.880 2.540 - -11.19% -
453.povray (avg) (percentage) 186.40% 1.250 3.580 - 0.00% -
458.sjeng (max) 183.87% 31.000 88.000 - -8.33% -
400.perlbench (avg) (percentage) 178.23% 1.470 4.090 - 0.00% -
447.dealII (avg) (percentage) 176.64% 1.070 2.960 - 0.00% -
458.sjeng 174.47% 47.000 129.000 - -0.77% -
458.sjeng (avg) 174.47% 47.000 129.000 - -0.77% -
459.GemsFDTD (max) (percentage) 158.33% 0.600 1.550 - -10.92% -
482.sphinx3 (avg) (percentage) 151.37% 1.460 3.670 - 0.00% -
437.leslie3d (max) (percentage) 150.85% 2.340 5.870 - -4.71% -
454.calculix (avg) (percentage) 148.26% 2.010 4.990 - 0.00% -
471.omnetpp (avg) (percentage) 147.80% 1.590 3.940 - 0.51% -
410.bwaves (avg) (percentage) 129.36% 1.090 2.500 - 0.00% -
450.soplex (max) (percentage) 128.93% 1.970 4.510 - -4.65% -
433.milc (avg) (percentage) 120.00% 1.700 3.740 - -2.35% -
434.zeusmp (avg) (percentage) 118.92% 1.480 3.240 - 0.00% -
465.tonto 108.03% 137.000 285.000 - 0.00% -
465.tonto (avg) 108.03% 137.000 285.000 - 0.00% -
429.mcf (max) 106.52% 92.000 190.000 - -26.07% -
435.gromacs (avg) (percentage) 94.22% 1.730 3.360 - 0.00% -
436.cactusADM (avg) (percentage) 92.17% 1.660 3.190 - 0.00% -
437.leslie3d (max) 85.19% 351.000 650.000 - -1.66% -
481.wrf (avg) (percentage) 82.01% 1.890 3.440 - 0.00% -
435.gromacs (max) (percentage) 81.68% 2.020 3.670 - -7.56% -
447.dealII (max) (percentage) 79.09% 1.100 1.970 - -6.64% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
464.h264ref 74.36% 78.000 136.000 - 0.00% -
464.h264ref (avg) 74.36% 78.000 136.000 - 0.00% -
437.leslie3d (avg) (percentage) 71.85% 2.380 4.090 - 0.00% -
445.gobmk (max) (percentage) 68.63% 1.530 2.580 - -5.15% -
482.sphinx3 (max) (percentage) 63.95% 1.470 2.410 - -11.40% -
465.tonto (avg) (percentage) 55.69% 1.670 2.600 - 0.00% -
401.bzip2 36.36% 66.000 90.000 - -2.17% -
401.bzip2 (avg) 36.36% 66.000 90.000 - -2.17% -
445.gobmk 32.61% 92.000 122.000 - 0.00% -
445.gobmk (avg) 32.61% 92.000 122.000 - 0.00% -
470.lbm (avg) (percentage) 28.69% 2.370 3.050 - -2.56% -
437.leslie3d 26.89% 357.000 453.000 - 3.19% -
437.leslie3d (avg) 26.89% 357.000 453.000 - 3.19% -
454.calculix (max) (percentage) 18.09% 4.700 5.550 - -2.29% -
465.tonto (max) 16.72% 293.000 342.000 - -4.47% -
429.mcf 16.67% 90.000 105.000 - -2.78% -
429.mcf (avg) 16.67% 90.000 105.000 - -2.78% -
416.gamess (avg) (percentage) 11.98% 2.170 2.430 - 0.00% -
464.h264ref (max) (percentage) 9.30% 0.430 0.470 - -6.00% -
444.namd (avg) (percentage) 7.63% 3.930 4.230 - -2.76% -
470.lbm (unexplained diff vs previous) 7.14% 14.000 15.000 - 50.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.90% 120221.000 111921.000 - -0.01% -
400.perlbench -1.39% 930652.000 917716.000 - -2.62% -
464.h264ref -1.08% 428364.000 423736.000 - -0.07% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - -1.59% -
403.gcc -99.31% 9010.000 62.000 - 3.33% -
462.libquantum -98.80% 11614.000 139.000 - 0.72% -
482.sphinx3 -96.90% 29928.000 927.000 - -1.80% -
450.soplex -96.29% 15466.000 574.000 - 1.95% -
444.namd -91.99% 9050.000 725.000 - 0.69% -
453.povray -91.61% 6544.000 549.000 - 0.18% -
429.mcf -91.13% 17158.000 1522.000 - -0.39% -
433.milc -91.02% 12976.000 1165.000 - -0.60% -
436.cactusADM -88.01% 17544.000 2103.000 - -0.52% -
400.perlbench -84.70% 10650.000 1629.000 - -1.69% -
434.zeusmp -80.70% 13211.000 2550.000 - 1.51% -
401.bzip2 -80.49% 15185.000 2962.000 - -2.12% -
447.dealII -79.57% 9751.000 1992.000 - 0.10% -
456.hmmer -73.81% 11046.000 2893.000 - -0.89% -
459.GemsFDTD -73.65% 23356.000 6155.000 - -0.19% -
471.omnetpp -71.95% 10739.000 3012.000 - -4.68% -
470.lbm -70.85% 12819.000 3737.000 - -0.40% -
481.wrf -66.75% 16834.000 5597.000 - -1.04% -
483.xalancbmk -63.17% 11172.000 4115.000 - -4.75% -
473.astar -60.58% 14932.000 5886.000 - -0.46% -
464.h264ref -59.53% 14556.000 5891.000 - 0.41% -
410.bwaves -58.66% 14755.000 6100.000 - -0.15% -
445.gobmk -55.84% 11995.000 5297.000 - 0.04% -
435.gromacs -52.31% 15419.000 7353.000 - 1.38% -
458.sjeng -45.88% 14275.000 7725.000 - -0.35% -
416.gamess -45.48% 22704.000 12379.000 - -0.27% -
437.leslie3d -26.10% 15005.000 11088.000 - 3.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - 0.00% -
454.calculix -99.35% 459.000 3.000 - 0.00% -
454.calculix (avg) -99.35% 459.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.29% 700.000 5.000 - -75.00% -
433.milc (unexplained diff vs previous) -98.35% 425.000 7.000 - 133.33% -
444.namd (max) -97.53% 649.000 16.000 - -15.79% -
433.milc (max) -96.59% 411.000 14.000 - -12.50% -
462.libquantum (max) -95.95% 74.000 3.000 - 0.00% -
436.cactusADM (max) -95.29% 552.000 26.000 - -10.34% -
482.sphinx3 (max) -94.99% 439.000 22.000 - -12.00% -
462.libquantum -94.67% 75.000 4.000 - 0.00% -
462.libquantum (avg) -94.67% 75.000 4.000 - 0.00% -
470.lbm (max) -94.49% 653.000 36.000 - -12.20% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
403.gcc (max) -93.75% 64.000 4.000 - 33.33% -
429.mcf (unexplained diff vs previous) -93.55% 93.000 6.000 - 0.00% -
453.povray (max) -92.73% 165.000 12.000 - -7.69% -
482.sphinx3 -92.20% 436.000 34.000 - 0.00% -
482.sphinx3 (avg) -92.20% 436.000 34.000 - 0.00% -
450.soplex (max) -91.78% 304.000 25.000 - -3.85% -
444.namd -91.55% 355.000 30.000 - -3.23% -
444.namd (avg) -91.55% 355.000 30.000 - -3.23% -
434.zeusmp (max) -91.36% 301.000 26.000 - -7.14% -
444.namd (unexplained diff vs previous) (percentage) -91.07% 7.730 0.690 - -75.18% -
456.hmmer (max) -90.71% 140.000 13.000 - -7.14% -
400.perlbench (max) -90.43% 345.000 33.000 - -5.71% -
450.soplex -85.34% 191.000 28.000 - 3.70% -
450.soplex (avg) -85.34% 191.000 28.000 - 3.70% -
481.wrf (max) -83.02% 530.000 90.000 - -5.26% -
433.milc (unexplained diff vs previous) (percentage) -81.71% 3.280 0.600 - 130.77% -
470.lbm (max) (percentage) -80.98% 5.100 0.970 - -11.82% -
433.milc -80.45% 220.000 43.000 - -2.27% -
433.milc (avg) -80.45% 220.000 43.000 - -2.27% -
436.cactusADM -76.98% 291.000 67.000 - 0.00% -
436.cactusADM (avg) -76.98% 291.000 67.000 - 0.00% -
471.omnetpp (max) -76.74% 662.000 154.000 - -20.62% -
453.povray -76.54% 81.000 19.000 - 0.00% -
453.povray (avg) -76.54% 81.000 19.000 - 0.00% -
416.gamess (max) -74.85% 656.000 165.000 - -1.79% -
444.namd (max) (percentage) -68.66% 7.180 2.250 - -16.67% -
456.hmmer (max) (percentage) -63.78% 1.270 0.460 - -4.17% -
447.dealII (max) -63.55% 107.000 39.000 - -4.88% -
470.lbm -62.71% 303.000 113.000 - -3.42% -
470.lbm (avg) -62.71% 303.000 113.000 - -3.42% -
433.milc (max) (percentage) -61.51% 3.170 1.220 - -10.95% -
436.cactusADM (max) (percentage) -60.63% 3.150 1.240 - -11.43% -
434.zeusmp -57.95% 195.000 82.000 - 1.23% -
434.zeusmp (avg) -57.95% 195.000 82.000 - 1.23% -
400.perlbench -57.69% 156.000 66.000 - -1.49% -
400.perlbench (avg) -57.69% 156.000 66.000 - -1.49% -
464.h264ref (max) -56.45% 62.000 27.000 - -6.90% -
434.zeusmp (max) (percentage) -55.26% 2.280 1.020 - -11.30% -
416.gamess (max) (percentage) -53.63% 2.890 1.340 - -1.47% -
481.wrf (max) (percentage) -48.57% 3.150 1.620 - -3.57% -
447.dealII -44.23% 104.000 58.000 - 0.00% -
447.dealII (avg) -44.23% 104.000 58.000 - 0.00% -
401.bzip2 (max) -43.61% 133.000 75.000 - -12.79% -
481.wrf -39.62% 318.000 192.000 - -1.03% -
481.wrf (avg) -39.62% 318.000 192.000 - -1.03% -
416.gamess -39.02% 492.000 300.000 - -0.33% -
416.gamess (avg) -39.02% 492.000 300.000 - -0.33% -
400.perlbench (max) (percentage) -36.42% 3.240 2.060 - -4.19% -
483.xalancbmk -35.14% 74.000 48.000 - -4.00% -
483.xalancbmk (avg) -35.14% 74.000 48.000 - -4.00% -
459.GemsFDTD (max) -32.14% 140.000 95.000 - -11.21% -
471.omnetpp -30.59% 170.000 118.000 - -4.07% -
471.omnetpp (avg) -30.59% 170.000 118.000 - -4.07% -
429.mcf (unexplained diff vs previous) (percentage) -27.78% 0.540 0.390 - 0.00% -
445.gobmk (max) -25.68% 183.000 136.000 - -5.56% -
456.hmmer -17.33% 75.000 62.000 - -1.59% -
456.hmmer (avg) -17.33% 75.000 62.000 - -1.59% -
471.omnetpp (max) (percentage) -17.02% 6.170 5.120 - -16.75% -
435.gromacs (max) -13.50% 311.000 269.000 - -6.27% -
465.tonto (max) (percentage) -12.85% 3.580 3.120 - -4.29% -
459.GemsFDTD -11.90% 210.000 185.000 - 0.00% -
459.GemsFDTD (avg) -11.90% 210.000 185.000 - 0.00% -
453.povray (max) (percentage) -11.07% 2.530 2.250 - -6.64% -
435.gromacs -7.14% 266.000 247.000 - 1.65% -
435.gromacs (avg) -7.14% 266.000 247.000 - 1.65% -
410.bwaves -5.00% 160.000 152.000 - 0.00% -
410.bwaves (avg) -5.00% 160.000 152.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
400.perlbench 1629.000 -1.69%
401.bzip2 2962.000 -2.12%
403.gcc 62.000 3.33%
410.bwaves 6100.000 -
416.gamess 12379.000 -
429.mcf 1522.000 -
433.milc 1165.000 -
434.zeusmp 2550.000 1.51%
435.gromacs 7353.000 1.38%
436.cactusADM 2103.000 -
437.leslie3d 11088.000 3.23%
444.namd 725.000 -
445.gobmk 5297.000 -
447.dealII 1992.000 -
450.soplex 574.000 1.95%
453.povray 549.000 -
454.calculix 62.000 -1.59%
456.hmmer 2893.000 -
458.sjeng 7725.000 -
459.GemsFDTD 6155.000 -
462.libquantum 139.000 -
464.h264ref 5891.000 -
465.tonto 10981.000 -
470.lbm 3737.000 -
471.omnetpp 3012.000 -4.68%
473.astar 5886.000 -
481.wrf 5597.000 -1.04%
482.sphinx3 927.000 -1.80%
483.xalancbmk 4115.000 -4.75%
Geometric Mean 2153.433 -
Code Size (bytes)
Name Current %
400.perlbench 917716.000 -2.62%
401.bzip2 49856.000 -
403.gcc 2665977.000 -
410.bwaves 17740.000 -
416.gamess 6244419.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165687.000 -
435.gromacs 678385.000 -
436.cactusADM 553378.000 -
437.leslie3d 65185.000 -
444.namd 190970.000 -
445.gobmk 1403651.000 -
447.dealII 2126196.000 -
450.soplex 260404.000 -
453.povray 708537.000 -
454.calculix 1272427.000 -
456.hmmer 231092.000 -
458.sjeng 111921.000 -
459.GemsFDTD 253073.000 -
462.libquantum 31313.000 -
464.h264ref 423736.000 -
465.tonto 2870425.000 -
470.lbm 10908.000 -
471.omnetpp 566644.000 -1.43%
473.astar 32044.000 -
481.wrf 2631912.000 -
482.sphinx3 152636.000 -
483.xalancbmk 3282263.000 -
Geometric Mean 296762.117 -
sample variability
Name Current %
400.perlbench 66.000 -1.49%
400.perlbench (avg) 66.000 -1.49%
400.perlbench (avg) (percentage) 4.090 -
400.perlbench (max) 33.000 -5.71%
400.perlbench (max) (percentage) 2.060 -4.19%
401.bzip2 90.000 -2.17%
401.bzip2 (avg) 90.000 -2.17%
401.bzip2 (avg) (percentage) 3.070 -
401.bzip2 (max) 75.000 -12.79%
401.bzip2 (max) (percentage) 2.540 -11.19%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.160 -
403.gcc (max) 4.000 33.33%
403.gcc (max) (percentage) 6.510 -2.25%
410.bwaves 152.000 -
410.bwaves (avg) 152.000 -
410.bwaves (avg) (percentage) 2.500 -
410.bwaves (max) 88.000 -12.00%
410.bwaves (max) (percentage) 1.450 -11.59%
416.gamess 300.000 -
416.gamess (avg) 300.000 -
416.gamess (avg) (percentage) 2.430 -
416.gamess (max) 165.000 -1.79%
416.gamess (max) (percentage) 1.340 -1.47%
429.mcf 105.000 -2.78%
429.mcf (avg) 105.000 -2.78%
429.mcf (avg) (percentage) 6.920 -2.67%
429.mcf (max) 190.000 -26.07%
429.mcf (max) (percentage) 12.490 -25.96%
429.mcf (unexplained diff vs previous) 6.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.390 -
433.milc 43.000 -2.27%
433.milc (avg) 43.000 -2.27%
433.milc (avg) (percentage) 3.740 -2.35%
433.milc (max) 14.000 -12.50%
433.milc (max) (percentage) 1.220 -10.95%
433.milc (unexplained diff vs previous) 7.000 133.33%
433.milc (unexplained diff vs previous) (percentage) 0.600 130.77%
434.zeusmp 82.000 1.23%
434.zeusmp (avg) 82.000 1.23%
434.zeusmp (avg) (percentage) 3.240 -
434.zeusmp (max) 26.000 -7.14%
434.zeusmp (max) (percentage) 1.020 -11.30%
435.gromacs 247.000 1.65%
435.gromacs (avg) 247.000 1.65%
435.gromacs (avg) (percentage) 3.360 -
435.gromacs (max) 269.000 -6.27%
435.gromacs (max) (percentage) 3.670 -7.56%
436.cactusADM 67.000 -
436.cactusADM (avg) 67.000 -
436.cactusADM (avg) (percentage) 3.190 -
436.cactusADM (max) 26.000 -10.34%
436.cactusADM (max) (percentage) 1.240 -11.43%
437.leslie3d 453.000 3.19%
437.leslie3d (avg) 453.000 3.19%
437.leslie3d (avg) (percentage) 4.090 -
437.leslie3d (max) 650.000 -1.66%
437.leslie3d (max) (percentage) 5.870 -4.71%
444.namd 30.000 -3.23%
444.namd (avg) 30.000 -3.23%
444.namd (avg) (percentage) 4.230 -2.76%
444.namd (max) 16.000 -15.79%
444.namd (max) (percentage) 2.250 -16.67%
444.namd (unexplained diff vs previous) 5.000 -75.00%
444.namd (unexplained diff vs previous) (percentage) 0.690 -75.18%
445.gobmk 122.000 -
445.gobmk (avg) 122.000 -
445.gobmk (avg) (percentage) 2.310 -
445.gobmk (max) 136.000 -5.56%
445.gobmk (max) (percentage) 2.580 -5.15%
447.dealII 58.000 -
447.dealII (avg) 58.000 -
447.dealII (avg) (percentage) 2.960 -
447.dealII (max) 39.000 -4.88%
447.dealII (max) (percentage) 1.970 -6.64%
450.soplex 28.000 3.70%
450.soplex (avg) 28.000 3.70%
450.soplex (avg) (percentage) 4.920 -
450.soplex (max) 25.000 -3.85%
450.soplex (max) (percentage) 4.510 -4.65%
453.povray 19.000 -
453.povray (avg) 19.000 -
453.povray (avg) (percentage) 3.580 -
453.povray (max) 12.000 -7.69%
453.povray (max) (percentage) 2.250 -6.64%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 4.990 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.550 -2.29%
456.hmmer 62.000 -1.59%
456.hmmer (avg) 62.000 -1.59%
456.hmmer (avg) (percentage) 2.170 -
456.hmmer (max) 13.000 -7.14%
456.hmmer (max) (percentage) 0.460 -4.17%
458.sjeng 129.000 -
458.sjeng (avg) 129.000 -
458.sjeng (avg) (percentage) 1.680 -
458.sjeng (max) 88.000 -8.33%
458.sjeng (max) (percentage) 1.150 -7.26%
459.GemsFDTD 185.000 -
459.GemsFDTD (avg) 185.000 -
459.GemsFDTD (avg) (percentage) 3.010 -
459.GemsFDTD (max) 95.000 -11.21%
459.GemsFDTD (max) (percentage) 1.550 -10.92%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.180 -2.15%
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 2.510 -10.99%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -
464.h264ref 136.000 -
464.h264ref (avg) 136.000 -
464.h264ref (avg) (percentage) 2.320 -
464.h264ref (max) 27.000 -6.90%
464.h264ref (max) (percentage) 0.470 -6.00%
465.tonto 285.000 -
465.tonto (avg) 285.000 -
465.tonto (avg) (percentage) 2.600 -
465.tonto (max) 342.000 -4.47%
465.tonto (max) (percentage) 3.120 -4.29%
470.lbm 113.000 -3.42%
470.lbm (avg) 113.000 -3.42%
470.lbm (avg) (percentage) 3.050 -2.56%
470.lbm (max) 36.000 -12.20%
470.lbm (max) (percentage) 0.970 -11.82%
470.lbm (unexplained diff vs previous) 15.000 50.00%
470.lbm (unexplained diff vs previous) (percentage) 0.400 48.15%
471.omnetpp 118.000 -4.07%
471.omnetpp (avg) 118.000 -4.07%
471.omnetpp (avg) (percentage) 3.940 -
471.omnetpp (max) 154.000 -20.62%
471.omnetpp (max) (percentage) 5.120 -16.75%
471.omnetpp (unexplained diff vs previous) 148.000 -19.13%
471.omnetpp (unexplained diff vs previous) (percentage) 4.910 -15.20%
473.astar 150.000 -
473.astar (avg) 150.000 -
473.astar (avg) (percentage) 2.560 -
473.astar (max) 167.000 -11.64%
473.astar (max) (percentage) 2.850 -11.21%
481.wrf 192.000 -1.03%
481.wrf (avg) 192.000 -1.03%
481.wrf (avg) (percentage) 3.440 -
481.wrf (max) 90.000 -5.26%
481.wrf (max) (percentage) 1.620 -3.57%
482.sphinx3 34.000 -
482.sphinx3 (avg) 34.000 -
482.sphinx3 (avg) (percentage) 3.670 -
482.sphinx3 (max) 22.000 -12.00%
482.sphinx3 (max) (percentage) 2.410 -11.40%
483.xalancbmk 48.000 -4.00%
483.xalancbmk (avg) 48.000 -4.00%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 266.000 -5.00%
483.xalancbmk (max) (percentage) 6.470 -
Geometric Mean 15.017 4.95%