Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d89504f0d90dedd3d5ab83d8c91707a354231d2f (+ 44 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6d7f9ebfb827d238543ce81a096ee0ad369715ef (+ 104 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0aa5b28a504c6f1f17b387d8147715d1496fff62 (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4b69fbd471e9b8cad99b37c284710edefbf25ee9 (+ 137 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/35/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0035 (4-changed-components) 2023-04-18T18:56:33 0:00:00
Previous 0033 (4-changed-components) 2023-04-11T21:48:56 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 21 75
Performance Improvements 109 113
Unchanged Tests 1106 1048
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 6.46% 10415.000 11088.000 - -26.10% -
403.gcc 1.64% 61.000 62.000 - -99.31% -
434.zeusmp 1.43% 2514.000 2550.000 - -80.70% -
450.soplex 1.23% 567.000 574.000 - -96.29% -
471.omnetpp 1.18% 2977.000 3012.000 - -71.95% -
400.perlbench 1.12% 1611.000 1629.000 - -84.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 6.59% 425.000 453.000 - 26.89% -
437.leslie3d (avg) 6.59% 425.000 453.000 - 26.89% -
471.omnetpp (unexplained diff vs previous) 5.71% 140.000 148.000 - 469.23% -
471.omnetpp (max) 5.48% 146.000 154.000 - -76.74% -
471.omnetpp (unexplained diff vs previous) (percentage) 4.47% 4.700 4.910 - 1945.83% -
471.omnetpp (max) (percentage) 3.85% 4.930 5.120 - -17.02% -
450.soplex 3.70% 27.000 28.000 - -85.34% -
450.soplex (avg) 3.70% 27.000 28.000 - -85.34% -
471.omnetpp 3.51% 114.000 118.000 - -30.59% -
471.omnetpp (avg) 3.51% 114.000 118.000 - -30.59% -
471.omnetpp (avg) (percentage) 2.07% 3.860 3.940 - 147.80% -
400.perlbench 1.54% 65.000 66.000 - -57.69% -
400.perlbench (avg) 1.54% 65.000 66.000 - -57.69% -
435.gromacs 1.23% 244.000 247.000 - -7.14% -
435.gromacs (avg) 1.23% 244.000 247.000 - -7.14% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
400.perlbench -1.77% 934212.000 917716.000 - -1.39% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk -3.72% 4274.000 4115.000 - -63.17% -
444.namd -2.03% 740.000 725.000 - -91.99% -
482.sphinx3 -1.80% 944.000 927.000 - -96.90% -
454.calculix -1.59% 63.000 62.000 - -99.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -98.31% 23.070 0.390 - -27.78% -
429.mcf (unexplained diff vs previous) -98.30% 352.000 6.000 - -93.55% -
462.libquantum (unexplained diff vs previous) (percentage) -80.11% 3.620 0.720 - 7100.00% -
462.libquantum (unexplained diff vs previous) -80.00% 5.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) -77.27% 22.000 5.000 - -99.29% -
444.namd (unexplained diff vs previous) (percentage) -76.77% 2.970 0.690 - -91.07% -
470.lbm (unexplained diff vs previous) (percentage) -72.22% 1.440 0.400 - 263.64% -
470.lbm (unexplained diff vs previous) -72.22% 54.000 15.000 - 7.14% -
433.milc (unexplained diff vs previous) (percentage) -66.67% 1.800 0.600 - -81.71% -
433.milc (unexplained diff vs previous) -66.67% 21.000 7.000 - -98.35% -
434.zeusmp (max) (percentage) -51.66% 2.110 1.020 - -55.26% -
434.zeusmp (max) -50.94% 53.000 26.000 - -91.36% -
436.cactusADM (max) (percentage) -40.38% 2.080 1.240 - -60.63% -
462.libquantum (max) -40.00% 5.000 3.000 - -95.95% -
436.cactusADM (max) -39.53% 43.000 26.000 - -95.29% -
433.milc (max) -39.13% 23.000 14.000 - -96.59% -
433.milc (max) (percentage) -38.38% 1.980 1.220 - -61.51% -
482.sphinx3 (max) -35.29% 34.000 22.000 - -94.99% -
473.astar (max) -33.99% 253.000 167.000 - 735.00% -
401.bzip2 (max) -33.63% 113.000 75.000 - -43.61% -
459.GemsFDTD (max) -33.57% 143.000 95.000 - -32.14% -
470.lbm (max) (percentage) -33.56% 1.460 0.970 - -80.98% -
410.bwaves (max) (percentage) -33.49% 2.180 1.450 - 590.48% -
482.sphinx3 (max) (percentage) -33.43% 3.620 2.410 - 63.95% -
473.astar (max) (percentage) -33.41% 4.280 2.850 - 1935.71% -
429.mcf (max) (percentage) -33.35% 18.740 12.490 - 2212.96% -
401.bzip2 (max) (percentage) -33.33% 3.810 2.540 - 188.64% -
410.bwaves (max) -33.33% 132.000 88.000 - 193.33% -
429.mcf (max) -33.33% 285.000 190.000 - 106.52% -
470.lbm (max) -33.33% 54.000 36.000 - -94.49% -
462.libquantum (max) (percentage) -33.24% 3.760 2.510 - 292.19% -
459.GemsFDTD (max) (percentage) -33.19% 2.320 1.550 - 158.33% -
444.namd (max) -27.27% 22.000 16.000 - -97.53% -
444.namd (max) (percentage) -26.47% 3.060 2.250 - -68.66% -
458.sjeng (max) -16.98% 106.000 88.000 - 183.87% -
435.gromacs (max) (percentage) -16.78% 4.410 3.670 - 81.68% -
458.sjeng (max) (percentage) -16.67% 1.380 1.150 - 422.73% -
435.gromacs (max) -16.20% 321.000 269.000 - -13.50% -
453.povray (max) (percentage) -14.45% 2.630 2.250 - -11.07% -
447.dealII (max) (percentage) -14.35% 2.300 1.970 - 79.09% -
453.povray (max) -14.29% 14.000 12.000 - -92.73% -
447.dealII (max) -13.33% 45.000 39.000 - -63.55% -
456.hmmer (max) -13.33% 15.000 13.000 - -90.71% -
445.gobmk (max) -11.69% 154.000 136.000 - -25.68% -
456.hmmer (max) (percentage) -11.54% 0.520 0.460 - -63.78% -
464.h264ref (max) (percentage) -11.32% 0.530 0.470 - 9.30% -
450.soplex (max) (percentage) -11.05% 5.070 4.510 - 128.93% -
445.gobmk (max) (percentage) -11.03% 2.900 2.580 - 68.63% -
437.leslie3d (max) (percentage) -10.79% 6.580 5.870 - 150.85% -
450.soplex (max) -10.71% 28.000 25.000 - -91.78% -
464.h264ref (max) -10.00% 30.000 27.000 - -56.45% -
465.tonto (max) -10.00% 380.000 342.000 - 16.72% -
465.tonto (max) (percentage) -9.04% 3.430 3.120 - -12.85% -
400.perlbench (max) -8.33% 36.000 33.000 - -90.43% -
400.perlbench (max) (percentage) -8.04% 2.240 2.060 - -36.42% -
481.wrf (max) (percentage) -7.43% 1.750 1.620 - -48.57% -
481.wrf (max) -7.22% 97.000 90.000 - -83.02% -
444.namd -6.25% 32.000 30.000 - -91.55% -
444.namd (avg) -6.25% 32.000 30.000 - -91.55% -
470.lbm -5.83% 120.000 113.000 - -62.71% -
470.lbm (avg) -5.83% 120.000 113.000 - -62.71% -
437.leslie3d (max) -5.11% 685.000 650.000 - 85.19% -
470.lbm (avg) (percentage) -4.98% 3.210 3.050 - 28.69% -
433.milc (avg) (percentage) -4.83% 3.930 3.740 - 120.00% -
454.calculix (max) (percentage) -4.80% 5.830 5.550 - 18.09% -
462.libquantum (avg) (percentage) -4.79% 3.340 3.180 - 389.23% -
403.gcc (max) (percentage) -4.69% 6.830 6.510 - 804.17% -
483.xalancbmk (max) -4.66% 279.000 266.000 - 491.11% -
433.milc -4.44% 45.000 43.000 - -80.45% -
433.milc (avg) -4.44% 45.000 43.000 - -80.45% -
483.xalancbmk -4.00% 50.000 48.000 - -35.14% -
483.xalancbmk (avg) -4.00% 50.000 48.000 - -35.14% -
444.namd (avg) (percentage) -3.86% 4.400 4.230 - 7.63% -
416.gamess (max) -3.51% 171.000 165.000 - -74.85% -
473.astar -3.23% 155.000 150.000 - 435.71% -
473.astar (avg) -3.23% 155.000 150.000 - 435.71% -
459.GemsFDTD (avg) (percentage) -3.22% 3.110 3.010 - 234.44% -
459.GemsFDTD -3.14% 191.000 185.000 - -11.90% -
459.GemsFDTD (avg) -3.14% 191.000 185.000 - -11.90% -
434.zeusmp (avg) (percentage) -2.99% 3.340 3.240 - 118.92% -
482.sphinx3 (avg) (percentage) -2.91% 3.780 3.670 - 151.37% -
416.gamess (max) (percentage) -2.90% 1.380 1.340 - -53.63% -
482.sphinx3 -2.86% 35.000 34.000 - -92.20% -
482.sphinx3 (avg) -2.86% 35.000 34.000 - -92.20% -
429.mcf -2.78% 108.000 105.000 - 16.67% -
429.mcf (avg) -2.78% 108.000 105.000 - 16.67% -
429.mcf (avg) (percentage) -2.67% 7.110 6.920 - 1205.66% -
473.astar (avg) (percentage) -2.66% 2.630 2.560 - 1247.37% -
410.bwaves -2.56% 156.000 152.000 - -5.00% -
410.bwaves (avg) -2.56% 156.000 152.000 - -5.00% -
436.cactusADM (avg) (percentage) -2.45% 3.270 3.190 - 92.17% -
410.bwaves (avg) (percentage) -2.34% 2.560 2.500 - 129.36% -
401.bzip2 -2.17% 92.000 90.000 - 36.36% -
401.bzip2 (avg) -2.17% 92.000 90.000 - 36.36% -
447.dealII -1.69% 59.000 58.000 - -44.23% -
447.dealII (avg) -1.69% 59.000 58.000 - -44.23% -
436.cactusADM -1.47% 68.000 67.000 - -76.98% -
436.cactusADM (avg) -1.47% 68.000 67.000 - -76.98% -
401.bzip2 (avg) (percentage) -1.29% 3.110 3.070 - 597.73% -
434.zeusmp -1.20% 83.000 82.000 - -57.95% -
434.zeusmp (avg) -1.20% 83.000 82.000 - -57.95% -
483.xalancbmk (max) (percentage) -1.07% 6.540 6.470 - 1478.05% -
465.tonto -1.04% 288.000 285.000 - 108.03% -
465.tonto (avg) -1.04% 288.000 285.000 - 108.03% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 33.83% 8205.000 10981.000 - -0.93% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 7100.00% 0.010 0.720 - -80.11% -
429.mcf (max) (percentage) 2212.96% 0.540 12.490 - -33.35% -
471.omnetpp (unexplained diff vs previous) (percentage) 1945.83% 0.240 4.910 - 4.47% -
473.astar (max) (percentage) 1935.71% 0.140 2.850 - -33.41% -
483.xalancbmk (max) (percentage) 1478.05% 0.410 6.470 - -1.07% -
473.astar (avg) (percentage) 1247.37% 0.190 2.560 - -2.66% -
429.mcf (avg) (percentage) 1205.66% 0.530 6.920 - -2.67% -
403.gcc (avg) (percentage) 909.84% 0.610 6.160 - 0.00% -
403.gcc (max) (percentage) 804.17% 0.720 6.510 - -4.69% -
473.astar (max) 735.00% 20.000 167.000 - -33.99% -
401.bzip2 (avg) (percentage) 597.73% 0.440 3.070 - -1.29% -
410.bwaves (max) (percentage) 590.48% 0.210 1.450 - -33.49% -
483.xalancbmk (max) 491.11% 45.000 266.000 - -4.66% -
471.omnetpp (unexplained diff vs previous) 469.23% 26.000 148.000 - 5.71% -
473.astar 435.71% 28.000 150.000 - -3.23% -
473.astar (avg) 435.71% 28.000 150.000 - -3.23% -
458.sjeng (max) (percentage) 422.73% 0.220 1.150 - -16.67% -
458.sjeng (avg) (percentage) 409.09% 0.330 1.680 - 0.00% -
462.libquantum (avg) (percentage) 389.23% 0.650 3.180 - -4.79% -
464.h264ref (avg) (percentage) 329.63% 0.540 2.320 - 0.00% -
450.soplex (avg) (percentage) 296.77% 1.240 4.920 - 0.00% -
462.libquantum (max) (percentage) 292.19% 0.640 2.510 - -33.24% -
470.lbm (unexplained diff vs previous) (percentage) 263.64% 0.110 0.400 - -72.22% -
459.GemsFDTD (avg) (percentage) 234.44% 0.900 3.010 - -3.22% -
456.hmmer (avg) (percentage) 219.12% 0.680 2.170 - 0.00% -
445.gobmk (avg) (percentage) 200.00% 0.770 2.310 - 0.00% -
410.bwaves (max) 193.33% 30.000 88.000 - -33.33% -
401.bzip2 (max) (percentage) 188.64% 0.880 2.540 - -33.33% -
453.povray (avg) (percentage) 186.40% 1.250 3.580 - 0.00% -
458.sjeng (max) 183.87% 31.000 88.000 - -16.98% -
400.perlbench (avg) (percentage) 178.23% 1.470 4.090 - 0.00% -
447.dealII (avg) (percentage) 176.64% 1.070 2.960 - 0.00% -
458.sjeng 174.47% 47.000 129.000 - 0.00% -
458.sjeng (avg) 174.47% 47.000 129.000 - 0.00% -
459.GemsFDTD (max) (percentage) 158.33% 0.600 1.550 - -33.19% -
482.sphinx3 (avg) (percentage) 151.37% 1.460 3.670 - -2.91% -
437.leslie3d (max) (percentage) 150.85% 2.340 5.870 - -10.79% -
454.calculix (avg) (percentage) 148.26% 2.010 4.990 - 0.00% -
471.omnetpp (avg) (percentage) 147.80% 1.590 3.940 - 2.07% -
410.bwaves (avg) (percentage) 129.36% 1.090 2.500 - -2.34% -
450.soplex (max) (percentage) 128.93% 1.970 4.510 - -11.05% -
433.milc (avg) (percentage) 120.00% 1.700 3.740 - -4.83% -
434.zeusmp (avg) (percentage) 118.92% 1.480 3.240 - -2.99% -
465.tonto 108.03% 137.000 285.000 - -1.04% -
465.tonto (avg) 108.03% 137.000 285.000 - -1.04% -
429.mcf (max) 106.52% 92.000 190.000 - -33.33% -
435.gromacs (avg) (percentage) 94.22% 1.730 3.360 - 0.00% -
436.cactusADM (avg) (percentage) 92.17% 1.660 3.190 - -2.45% -
437.leslie3d (max) 85.19% 351.000 650.000 - -5.11% -
481.wrf (avg) (percentage) 82.01% 1.890 3.440 - 0.00% -
435.gromacs (max) (percentage) 81.68% 2.020 3.670 - -16.78% -
447.dealII (max) (percentage) 79.09% 1.100 1.970 - -14.35% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
464.h264ref 74.36% 78.000 136.000 - 0.74% -
464.h264ref (avg) 74.36% 78.000 136.000 - 0.74% -
437.leslie3d (avg) (percentage) 71.85% 2.380 4.090 - 0.00% -
445.gobmk (max) (percentage) 68.63% 1.530 2.580 - -11.03% -
482.sphinx3 (max) (percentage) 63.95% 1.470 2.410 - -33.43% -
465.tonto (avg) (percentage) 55.69% 1.670 2.600 - 0.00% -
401.bzip2 36.36% 66.000 90.000 - -2.17% -
401.bzip2 (avg) 36.36% 66.000 90.000 - -2.17% -
445.gobmk 32.61% 92.000 122.000 - 0.00% -
445.gobmk (avg) 32.61% 92.000 122.000 - 0.00% -
470.lbm (avg) (percentage) 28.69% 2.370 3.050 - -4.98% -
437.leslie3d 26.89% 357.000 453.000 - 6.59% -
437.leslie3d (avg) 26.89% 357.000 453.000 - 6.59% -
454.calculix (max) (percentage) 18.09% 4.700 5.550 - -4.80% -
465.tonto (max) 16.72% 293.000 342.000 - -10.00% -
429.mcf 16.67% 90.000 105.000 - -2.78% -
429.mcf (avg) 16.67% 90.000 105.000 - -2.78% -
416.gamess (avg) (percentage) 11.98% 2.170 2.430 - 0.00% -
464.h264ref (max) (percentage) 9.30% 0.430 0.470 - -11.32% -
444.namd (avg) (percentage) 7.63% 3.930 4.230 - -3.86% -
470.lbm (unexplained diff vs previous) 7.14% 14.000 15.000 - -72.22% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.90% 120221.000 111921.000 - -0.02% -
400.perlbench -1.39% 930652.000 917716.000 - -1.77% -
464.h264ref -1.08% 428364.000 423736.000 - 0.91% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - -1.59% -
403.gcc -99.31% 9010.000 62.000 - 1.64% -
462.libquantum -98.80% 11614.000 139.000 - 0.72% -
482.sphinx3 -96.90% 29928.000 927.000 - -1.80% -
450.soplex -96.29% 15466.000 574.000 - 1.23% -
444.namd -91.99% 9050.000 725.000 - -2.03% -
453.povray -91.61% 6544.000 549.000 - 0.55% -
429.mcf -91.13% 17158.000 1522.000 - -0.26% -
433.milc -91.02% 12976.000 1165.000 - -0.34% -
436.cactusADM -88.01% 17544.000 2103.000 - -0.14% -
400.perlbench -84.70% 10650.000 1629.000 - 1.12% -
434.zeusmp -80.70% 13211.000 2550.000 - 1.43% -
401.bzip2 -80.49% 15185.000 2962.000 - -0.37% -
447.dealII -79.57% 9751.000 1992.000 - -0.35% -
456.hmmer -73.81% 11046.000 2893.000 - -0.03% -
459.GemsFDTD -73.65% 23356.000 6155.000 - -0.15% -
471.omnetpp -71.95% 10739.000 3012.000 - 1.18% -
470.lbm -70.85% 12819.000 3737.000 - -0.13% -
481.wrf -66.75% 16834.000 5597.000 - 0.21% -
483.xalancbmk -63.17% 11172.000 4115.000 - -3.72% -
473.astar -60.58% 14932.000 5886.000 - -0.62% -
464.h264ref -59.53% 14556.000 5891.000 - 0.99% -
410.bwaves -58.66% 14755.000 6100.000 - 0.05% -
445.gobmk -55.84% 11995.000 5297.000 - -0.34% -
435.gromacs -52.31% 15419.000 7353.000 - 0.92% -
458.sjeng -45.88% 14275.000 7725.000 - 0.04% -
416.gamess -45.48% 22704.000 12379.000 - -0.15% -
437.leslie3d -26.10% 15005.000 11088.000 - 6.46% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - 0.00% -
454.calculix -99.35% 459.000 3.000 - 0.00% -
454.calculix (avg) -99.35% 459.000 3.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.29% 700.000 5.000 - -77.27% -
433.milc (unexplained diff vs previous) -98.35% 425.000 7.000 - -66.67% -
444.namd (max) -97.53% 649.000 16.000 - -27.27% -
433.milc (max) -96.59% 411.000 14.000 - -39.13% -
462.libquantum (max) -95.95% 74.000 3.000 - -40.00% -
436.cactusADM (max) -95.29% 552.000 26.000 - -39.53% -
482.sphinx3 (max) -94.99% 439.000 22.000 - -35.29% -
462.libquantum -94.67% 75.000 4.000 - 0.00% -
462.libquantum (avg) -94.67% 75.000 4.000 - 0.00% -
470.lbm (max) -94.49% 653.000 36.000 - -33.33% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
403.gcc (max) -93.75% 64.000 4.000 - 0.00% -
429.mcf (unexplained diff vs previous) -93.55% 93.000 6.000 - -98.30% -
453.povray (max) -92.73% 165.000 12.000 - -14.29% -
482.sphinx3 -92.20% 436.000 34.000 - -2.86% -
482.sphinx3 (avg) -92.20% 436.000 34.000 - -2.86% -
450.soplex (max) -91.78% 304.000 25.000 - -10.71% -
444.namd -91.55% 355.000 30.000 - -6.25% -
444.namd (avg) -91.55% 355.000 30.000 - -6.25% -
434.zeusmp (max) -91.36% 301.000 26.000 - -50.94% -
444.namd (unexplained diff vs previous) (percentage) -91.07% 7.730 0.690 - -76.77% -
456.hmmer (max) -90.71% 140.000 13.000 - -13.33% -
400.perlbench (max) -90.43% 345.000 33.000 - -8.33% -
450.soplex -85.34% 191.000 28.000 - 3.70% -
450.soplex (avg) -85.34% 191.000 28.000 - 3.70% -
481.wrf (max) -83.02% 530.000 90.000 - -7.22% -
433.milc (unexplained diff vs previous) (percentage) -81.71% 3.280 0.600 - -66.67% -
470.lbm (max) (percentage) -80.98% 5.100 0.970 - -33.56% -
433.milc -80.45% 220.000 43.000 - -4.44% -
433.milc (avg) -80.45% 220.000 43.000 - -4.44% -
436.cactusADM -76.98% 291.000 67.000 - -1.47% -
436.cactusADM (avg) -76.98% 291.000 67.000 - -1.47% -
471.omnetpp (max) -76.74% 662.000 154.000 - 5.48% -
453.povray -76.54% 81.000 19.000 - 0.00% -
453.povray (avg) -76.54% 81.000 19.000 - 0.00% -
416.gamess (max) -74.85% 656.000 165.000 - -3.51% -
444.namd (max) (percentage) -68.66% 7.180 2.250 - -26.47% -
456.hmmer (max) (percentage) -63.78% 1.270 0.460 - -11.54% -
447.dealII (max) -63.55% 107.000 39.000 - -13.33% -
470.lbm -62.71% 303.000 113.000 - -5.83% -
470.lbm (avg) -62.71% 303.000 113.000 - -5.83% -
433.milc (max) (percentage) -61.51% 3.170 1.220 - -38.38% -
436.cactusADM (max) (percentage) -60.63% 3.150 1.240 - -40.38% -
434.zeusmp -57.95% 195.000 82.000 - -1.20% -
434.zeusmp (avg) -57.95% 195.000 82.000 - -1.20% -
400.perlbench -57.69% 156.000 66.000 - 1.54% -
400.perlbench (avg) -57.69% 156.000 66.000 - 1.54% -
464.h264ref (max) -56.45% 62.000 27.000 - -10.00% -
434.zeusmp (max) (percentage) -55.26% 2.280 1.020 - -51.66% -
416.gamess (max) (percentage) -53.63% 2.890 1.340 - -2.90% -
481.wrf (max) (percentage) -48.57% 3.150 1.620 - -7.43% -
447.dealII -44.23% 104.000 58.000 - -1.69% -
447.dealII (avg) -44.23% 104.000 58.000 - -1.69% -
401.bzip2 (max) -43.61% 133.000 75.000 - -33.63% -
481.wrf -39.62% 318.000 192.000 - 0.00% -
481.wrf (avg) -39.62% 318.000 192.000 - 0.00% -
416.gamess -39.02% 492.000 300.000 - -0.33% -
416.gamess (avg) -39.02% 492.000 300.000 - -0.33% -
400.perlbench (max) (percentage) -36.42% 3.240 2.060 - -8.04% -
483.xalancbmk -35.14% 74.000 48.000 - -4.00% -
483.xalancbmk (avg) -35.14% 74.000 48.000 - -4.00% -
459.GemsFDTD (max) -32.14% 140.000 95.000 - -33.57% -
471.omnetpp -30.59% 170.000 118.000 - 3.51% -
471.omnetpp (avg) -30.59% 170.000 118.000 - 3.51% -
429.mcf (unexplained diff vs previous) (percentage) -27.78% 0.540 0.390 - -98.31% -
445.gobmk (max) -25.68% 183.000 136.000 - -11.69% -
456.hmmer -17.33% 75.000 62.000 - 0.00% -
456.hmmer (avg) -17.33% 75.000 62.000 - 0.00% -
471.omnetpp (max) (percentage) -17.02% 6.170 5.120 - 3.85% -
435.gromacs (max) -13.50% 311.000 269.000 - -16.20% -
465.tonto (max) (percentage) -12.85% 3.580 3.120 - -9.04% -
459.GemsFDTD -11.90% 210.000 185.000 - -3.14% -
459.GemsFDTD (avg) -11.90% 210.000 185.000 - -3.14% -
453.povray (max) (percentage) -11.07% 2.530 2.250 - -14.45% -
435.gromacs -7.14% 266.000 247.000 - 1.23% -
435.gromacs (avg) -7.14% 266.000 247.000 - 1.23% -
410.bwaves -5.00% 160.000 152.000 - -2.56% -
410.bwaves (avg) -5.00% 160.000 152.000 - -2.56% -

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1629.000 1.12%
401.bzip2 2962.000 -
403.gcc 62.000 1.64%
410.bwaves 6100.000 -
416.gamess 12379.000 -
429.mcf 1522.000 -
433.milc 1165.000 -
434.zeusmp 2550.000 1.43%
435.gromacs 7353.000 -
436.cactusADM 2103.000 -
437.leslie3d 11088.000 6.46%
444.namd 725.000 -2.03%
445.gobmk 5297.000 -
447.dealII 1992.000 -
450.soplex 574.000 1.23%
453.povray 549.000 -
454.calculix 62.000 -1.59%
456.hmmer 2893.000 -
458.sjeng 7725.000 -
459.GemsFDTD 6155.000 -
462.libquantum 139.000 -
464.h264ref 5891.000 -
465.tonto 10981.000 -
470.lbm 3737.000 -
471.omnetpp 3012.000 1.18%
473.astar 5886.000 -
481.wrf 5597.000 -
482.sphinx3 927.000 -1.80%
483.xalancbmk 4115.000 -3.72%
Geometric Mean 2153.433 -
Code Size (bytes)
Name Current %
400.perlbench 917716.000 -1.77%
401.bzip2 49856.000 -
403.gcc 2665977.000 -
410.bwaves 17740.000 -
416.gamess 6244419.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165687.000 -
435.gromacs 678385.000 -
436.cactusADM 553378.000 -
437.leslie3d 65185.000 -
444.namd 190970.000 -
445.gobmk 1403651.000 -
447.dealII 2126196.000 -
450.soplex 260404.000 -
453.povray 708537.000 -
454.calculix 1272427.000 -
456.hmmer 231092.000 -
458.sjeng 111921.000 -
459.GemsFDTD 253073.000 -
462.libquantum 31313.000 -
464.h264ref 423736.000 -
465.tonto 2870425.000 -
470.lbm 10908.000 -
471.omnetpp 566644.000 -
473.astar 32044.000 -
481.wrf 2631912.000 -
482.sphinx3 152636.000 -
483.xalancbmk 3282263.000 -
Geometric Mean 296762.117 -
sample variability
Name Current %
400.perlbench 66.000 1.54%
400.perlbench (avg) 66.000 1.54%
400.perlbench (avg) (percentage) 4.090 -
400.perlbench (max) 33.000 -8.33%
400.perlbench (max) (percentage) 2.060 -8.04%
401.bzip2 90.000 -2.17%
401.bzip2 (avg) 90.000 -2.17%
401.bzip2 (avg) (percentage) 3.070 -1.29%
401.bzip2 (max) 75.000 -33.63%
401.bzip2 (max) (percentage) 2.540 -33.33%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.160 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 6.510 -4.69%
410.bwaves 152.000 -2.56%
410.bwaves (avg) 152.000 -2.56%
410.bwaves (avg) (percentage) 2.500 -2.34%
410.bwaves (max) 88.000 -33.33%
410.bwaves (max) (percentage) 1.450 -33.49%
416.gamess 300.000 -
416.gamess (avg) 300.000 -
416.gamess (avg) (percentage) 2.430 -
416.gamess (max) 165.000 -3.51%
416.gamess (max) (percentage) 1.340 -2.90%
429.mcf 105.000 -2.78%
429.mcf (avg) 105.000 -2.78%
429.mcf (avg) (percentage) 6.920 -2.67%
429.mcf (max) 190.000 -33.33%
429.mcf (max) (percentage) 12.490 -33.35%
429.mcf (unexplained diff vs previous) 6.000 -98.30%
429.mcf (unexplained diff vs previous) (percentage) 0.390 -98.31%
433.milc 43.000 -4.44%
433.milc (avg) 43.000 -4.44%
433.milc (avg) (percentage) 3.740 -4.83%
433.milc (max) 14.000 -39.13%
433.milc (max) (percentage) 1.220 -38.38%
433.milc (unexplained diff vs previous) 7.000 -66.67%
433.milc (unexplained diff vs previous) (percentage) 0.600 -66.67%
434.zeusmp 82.000 -1.20%
434.zeusmp (avg) 82.000 -1.20%
434.zeusmp (avg) (percentage) 3.240 -2.99%
434.zeusmp (max) 26.000 -50.94%
434.zeusmp (max) (percentage) 1.020 -51.66%
435.gromacs 247.000 1.23%
435.gromacs (avg) 247.000 1.23%
435.gromacs (avg) (percentage) 3.360 -
435.gromacs (max) 269.000 -16.20%
435.gromacs (max) (percentage) 3.670 -16.78%
436.cactusADM 67.000 -1.47%
436.cactusADM (avg) 67.000 -1.47%
436.cactusADM (avg) (percentage) 3.190 -2.45%
436.cactusADM (max) 26.000 -39.53%
436.cactusADM (max) (percentage) 1.240 -40.38%
437.leslie3d 453.000 6.59%
437.leslie3d (avg) 453.000 6.59%
437.leslie3d (avg) (percentage) 4.090 -
437.leslie3d (max) 650.000 -5.11%
437.leslie3d (max) (percentage) 5.870 -10.79%
444.namd 30.000 -6.25%
444.namd (avg) 30.000 -6.25%
444.namd (avg) (percentage) 4.230 -3.86%
444.namd (max) 16.000 -27.27%
444.namd (max) (percentage) 2.250 -26.47%
444.namd (unexplained diff vs previous) 5.000 -77.27%
444.namd (unexplained diff vs previous) (percentage) 0.690 -76.77%
445.gobmk 122.000 -
445.gobmk (avg) 122.000 -
445.gobmk (avg) (percentage) 2.310 -
445.gobmk (max) 136.000 -11.69%
445.gobmk (max) (percentage) 2.580 -11.03%
447.dealII 58.000 -1.69%
447.dealII (avg) 58.000 -1.69%
447.dealII (avg) (percentage) 2.960 -
447.dealII (max) 39.000 -13.33%
447.dealII (max) (percentage) 1.970 -14.35%
450.soplex 28.000 3.70%
450.soplex (avg) 28.000 3.70%
450.soplex (avg) (percentage) 4.920 -
450.soplex (max) 25.000 -10.71%
450.soplex (max) (percentage) 4.510 -11.05%
453.povray 19.000 -
453.povray (avg) 19.000 -
453.povray (avg) (percentage) 3.580 -
453.povray (max) 12.000 -14.29%
453.povray (max) (percentage) 2.250 -14.45%
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 4.990 -
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.550 -4.80%
456.hmmer 62.000 -
456.hmmer (avg) 62.000 -
456.hmmer (avg) (percentage) 2.170 -
456.hmmer (max) 13.000 -13.33%
456.hmmer (max) (percentage) 0.460 -11.54%
458.sjeng 129.000 -
458.sjeng (avg) 129.000 -
458.sjeng (avg) (percentage) 1.680 -
458.sjeng (max) 88.000 -16.98%
458.sjeng (max) (percentage) 1.150 -16.67%
459.GemsFDTD 185.000 -3.14%
459.GemsFDTD (avg) 185.000 -3.14%
459.GemsFDTD (avg) (percentage) 3.010 -3.22%
459.GemsFDTD (max) 95.000 -33.57%
459.GemsFDTD (max) (percentage) 1.550 -33.19%
462.libquantum 4.000 -
462.libquantum (avg) 4.000 -
462.libquantum (avg) (percentage) 3.180 -4.79%
462.libquantum (max) 3.000 -40.00%
462.libquantum (max) (percentage) 2.510 -33.24%
462.libquantum (unexplained diff vs previous) 1.000 -80.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -80.11%
464.h264ref 136.000 -
464.h264ref (avg) 136.000 -
464.h264ref (avg) (percentage) 2.320 -
464.h264ref (max) 27.000 -10.00%
464.h264ref (max) (percentage) 0.470 -11.32%
465.tonto 285.000 -1.04%
465.tonto (avg) 285.000 -1.04%
465.tonto (avg) (percentage) 2.600 -
465.tonto (max) 342.000 -10.00%
465.tonto (max) (percentage) 3.120 -9.04%
470.lbm 113.000 -5.83%
470.lbm (avg) 113.000 -5.83%
470.lbm (avg) (percentage) 3.050 -4.98%
470.lbm (max) 36.000 -33.33%
470.lbm (max) (percentage) 0.970 -33.56%
470.lbm (unexplained diff vs previous) 15.000 -72.22%
470.lbm (unexplained diff vs previous) (percentage) 0.400 -72.22%
471.omnetpp 118.000 3.51%
471.omnetpp (avg) 118.000 3.51%
471.omnetpp (avg) (percentage) 3.940 2.07%
471.omnetpp (max) 154.000 5.48%
471.omnetpp (max) (percentage) 5.120 3.85%
471.omnetpp (unexplained diff vs previous) 148.000 5.71%
471.omnetpp (unexplained diff vs previous) (percentage) 4.910 4.47%
473.astar 150.000 -3.23%
473.astar (avg) 150.000 -3.23%
473.astar (avg) (percentage) 2.560 -2.66%
473.astar (max) 167.000 -33.99%
473.astar (max) (percentage) 2.850 -33.41%
481.wrf 192.000 -
481.wrf (avg) 192.000 -
481.wrf (avg) (percentage) 3.440 -
481.wrf (max) 90.000 -7.22%
481.wrf (max) (percentage) 1.620 -7.43%
482.sphinx3 34.000 -2.86%
482.sphinx3 (avg) 34.000 -2.86%
482.sphinx3 (avg) (percentage) 3.670 -2.91%
482.sphinx3 (max) 22.000 -35.29%
482.sphinx3 (max) (percentage) 2.410 -33.43%
483.xalancbmk 48.000 -4.00%
483.xalancbmk (avg) 48.000 -4.00%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 266.000 -4.66%
483.xalancbmk (max) (percentage) 6.470 -1.07%
Geometric Mean 15.017 -19.33%