Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4148b4fe9fd15607aad8b082c7b724f355f2da64 (+ 58 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/2fc55f51f9953b451d6d6ddfae23379001e6ac95 (+ 54 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=10f980d31e3d65c4c5bfafd176e7e1db92e2babe (+ 15 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=8a1c87c391aa0de11900231e2c208b6516a6921c (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/10/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0010 (3-changed-components) 2023-03-07T07:32:57 0:00:00
Previous 0009 (3-changed-components) 2023-03-04T11:15:00 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 11 88
Performance Improvements 137 111
Unchanged Tests 1088 1037
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
473.astar 1.74% 6036.000 6141.000 - -58.87% -
445.gobmk 1.73% 5261.000 5352.000 - -55.38% -
454.calculix 1.59% 63.000 64.000 - -99.72% -
453.povray 1.29% 541.000 548.000 - -91.63% -
450.soplex 1.29% 621.000 629.000 - -95.93% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 310.00% 0.100 0.410 - -45.33% -
456.hmmer (unexplained diff vs previous) 300.00% 3.000 12.000 - -85.54% -
456.hmmer (max) (percentage) 57.69% 0.260 0.410 - -67.72% -
456.hmmer (max) 57.14% 7.000 11.000 - -92.14% -
445.gobmk 1.23% 163.000 165.000 - 79.35% -
445.gobmk (avg) 1.23% 163.000 165.000 - 79.35% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
458.sjeng -6.87% 120213.000 111949.000 - -6.88% -
453.povray -1.18% 712861.000 704477.000 - -0.66% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -3.84% 1666.000 1602.000 - -84.96% -
437.leslie3d -3.76% 11056.000 10640.000 - -29.09% -
483.xalancbmk -2.80% 4322.000 4201.000 - -62.40% -
471.omnetpp -2.17% 3001.000 2936.000 - -72.66% -
462.libquantum -2.11% 142.000 139.000 - -98.80% -
435.gromacs -1.98% 7482.000 7334.000 - -52.44% -
403.gcc -1.59% 63.000 62.000 - -99.31% -
464.h264ref -1.55% 5928.000 5836.000 - -59.91% -
458.sjeng -1.41% 7881.000 7770.000 - -45.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) (percentage) -98.07% 5.180 0.100 - -83.87% -
482.sphinx3 (unexplained diff vs previous) -98.04% 51.000 1.000 - -99.46% -
459.GemsFDTD (unexplained diff vs previous) -97.29% 406.000 11.000 - -77.08% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -97.28% 6.240 0.170 - -19.05% -
410.bwaves (unexplained diff vs previous) (percentage) -96.85% 4.440 0.140 - 40.00% -
410.bwaves (unexplained diff vs previous) -96.80% 281.000 9.000 - -40.00% -
462.libquantum (max) -95.40% 87.000 4.000 - -94.59% -
462.libquantum (max) (percentage) -94.59% 61.880 3.350 - 423.44% -
433.milc (unexplained diff vs previous) -92.86% 98.000 7.000 - -98.35% -
433.milc (unexplained diff vs previous) (percentage) -92.79% 7.770 0.560 - -82.93% -
450.soplex (unexplained diff vs previous) (percentage) -87.27% 9.980 1.270 - -36.82% -
450.soplex (unexplained diff vs previous) -87.10% 62.000 8.000 - -97.43% -
434.zeusmp (unexplained diff vs previous) -86.67% 75.000 10.000 - -96.75% -
434.zeusmp (unexplained diff vs previous) (percentage) -86.60% 2.910 0.390 - -83.26% -
470.lbm (unexplained diff vs previous) (percentage) -84.55% 5.500 0.850 - 672.73% -
470.lbm (unexplained diff vs previous) -84.40% 218.000 34.000 - 142.86% -
429.mcf (unexplained diff vs previous) -73.58% 53.000 14.000 - -84.95% -
429.mcf (unexplained diff vs previous) (percentage) -73.37% 3.380 0.900 - 66.67% -
436.cactusADM (unexplained diff vs previous) (percentage) -70.21% 0.940 0.280 - -91.38% -
436.cactusADM (unexplained diff vs previous) -70.00% 20.000 6.000 - -98.95% -
471.omnetpp (unexplained diff vs previous) -48.41% 126.000 65.000 - 150.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -47.38% 4.200 2.210 - 820.83% -
473.astar (unexplained diff vs previous) (percentage) -42.62% 2.980 1.710 - 8450.00% -
473.astar (unexplained diff vs previous) -41.67% 180.000 105.000 - 3400.00% -
462.libquantum (unexplained diff vs previous) -40.00% 5.000 3.000 - 200.00% -
462.libquantum (unexplained diff vs previous) (percentage) -38.64% 3.520 2.160 - 21500.00% -
410.bwaves (max) -25.17% 294.000 220.000 - 633.33% -
450.soplex (max) (percentage) -24.98% 11.090 8.320 - 322.34% -
410.bwaves (max) (percentage) -24.95% 4.650 3.490 - 1561.90% -
450.soplex (max) -23.53% 68.000 52.000 - -82.89% -
471.omnetpp (max) -18.32% 131.000 107.000 - -83.84% -
482.sphinx3 (max) -16.98% 53.000 44.000 - -89.98% -
459.GemsFDTD (max) -16.90% 432.000 359.000 - 156.43% -
459.GemsFDTD (max) (percentage) -16.69% 6.650 5.540 - 823.33% -
470.lbm (max) (percentage) -16.67% 5.820 4.850 - -4.90% -
453.povray (max) -16.67% 6.000 5.000 - -96.97% -
471.omnetpp (max) (percentage) -16.67% 4.380 3.650 - -40.84% -
482.sphinx3 (max) (percentage) -16.64% 5.470 4.560 - 210.20% -
473.astar (max) (percentage) -16.61% 3.070 2.560 - 1728.57% -
470.lbm (max) -16.09% 230.000 193.000 - -70.44% -
473.astar (max) -15.14% 185.000 157.000 - 685.00% -
437.leslie3d (max) -14.54% 832.000 711.000 - 102.56% -
435.gromacs (max) -13.25% 234.000 203.000 - -34.73% -
458.sjeng (max) -12.09% 91.000 80.000 - 158.06% -
429.mcf (max) -11.83% 338.000 298.000 - 223.91% -
465.tonto (max) -11.79% 229.000 202.000 - -31.06% -
400.perlbench (max) -11.67% 60.000 53.000 - -84.64% -
458.sjeng (max) (percentage) -11.21% 1.160 1.030 - 368.18% -
435.gromacs (max) (percentage) -11.18% 3.130 2.780 - 37.62% -
465.tonto (max) (percentage) -11.17% 2.060 1.830 - -48.88% -
437.leslie3d (max) (percentage) -11.16% 7.530 6.690 - 185.90% -
429.mcf (max) (percentage) -11.08% 21.580 19.190 - 3453.70% -
453.povray (max) (percentage) -10.81% 1.110 0.990 - -60.87% -
416.gamess (max) (percentage) -10.71% 0.280 0.250 - -91.35% -
444.namd (max) -10.00% 10.000 9.000 - -98.61% -
464.h264ref (max) -10.00% 50.000 45.000 - -27.42% -
416.gamess (max) -8.82% 34.000 31.000 - -95.27% -
481.wrf (max) -8.64% 162.000 148.000 - -72.08% -
481.wrf (max) (percentage) -8.36% 2.870 2.630 - -16.51% -
447.dealII (max) -8.33% 24.000 22.000 - -79.44% -
400.perlbench (max) (percentage) -8.31% 3.610 3.310 - 2.16% -
464.h264ref (max) (percentage) -8.24% 0.850 0.780 - 81.40% -
445.gobmk (max) (percentage) -8.16% 1.960 1.800 - 17.65% -
436.cactusADM (max) -7.53% 93.000 86.000 - -84.42% -
447.dealII (max) (percentage) -7.50% 1.200 1.110 - 0.91% -
436.cactusADM (max) (percentage) -7.29% 4.390 4.070 - 29.21% -
401.bzip2 (max) -7.00% 100.000 93.000 - -30.08% -
433.milc (max) -6.92% 159.000 148.000 - -63.99% -
445.gobmk (max) -6.80% 103.000 96.000 - -47.54% -
433.milc (max) (percentage) -6.24% 12.660 11.870 - 274.45% -
434.zeusmp (max) (percentage) -6.22% 4.180 3.920 - 71.93% -
444.namd (max) (percentage) -6.21% 1.450 1.360 - -81.06% -
401.bzip2 (max) (percentage) -6.10% 3.280 3.080 - 250.00% -
434.zeusmp (max) -5.61% 107.000 101.000 - -66.45% -
454.calculix (max) (percentage) -4.79% 4.380 4.170 - -11.28% -
403.gcc (max) -4.65% 43.000 41.000 - -35.94% -
483.xalancbmk (max) -4.29% 326.000 312.000 - 593.33% -
433.milc -4.29% 70.000 67.000 - -69.55% -
433.milc (avg) -4.29% 70.000 67.000 - -69.55% -
471.omnetpp -4.23% 142.000 136.000 - -20.00% -
471.omnetpp (avg) -4.23% 142.000 136.000 - -20.00% -
482.sphinx3 (avg) (percentage) -4.05% 5.430 5.210 - 256.85% -
459.GemsFDTD -3.86% 259.000 249.000 - 18.57% -
459.GemsFDTD (avg) -3.86% 259.000 249.000 - 18.57% -
437.leslie3d -3.78% 370.000 356.000 - -0.28% -
437.leslie3d (avg) -3.78% 370.000 356.000 - -0.28% -
482.sphinx3 -3.77% 53.000 51.000 - -88.30% -
482.sphinx3 (avg) -3.77% 53.000 51.000 - -88.30% -
459.GemsFDTD (avg) (percentage) -3.76% 3.990 3.840 - 326.67% -
410.bwaves (avg) (percentage) -3.47% 3.460 3.340 - 206.42% -
450.soplex (avg) (percentage) -3.43% 6.130 5.920 - 377.42% -
456.hmmer (avg) (percentage) -3.38% 3.550 3.430 - 404.41% -
434.zeusmp (avg) (percentage) -3.35% 4.770 4.610 - 211.49% -
400.perlbench -3.30% 91.000 88.000 - -43.59% -
400.perlbench (avg) -3.30% 91.000 88.000 - -43.59% -
434.zeusmp -3.25% 123.000 119.000 - -38.97% -
434.zeusmp (avg) -3.25% 123.000 119.000 - -38.97% -
436.cactusADM (avg) (percentage) -3.23% 4.640 4.490 - 170.48% -
433.milc (avg) (percentage) -3.23% 5.580 5.400 - 217.65% -
410.bwaves -3.21% 218.000 211.000 - 31.87% -
410.bwaves (avg) -3.21% 218.000 211.000 - 31.87% -
429.mcf -3.09% 97.000 94.000 - 4.44% -
429.mcf (avg) -3.09% 97.000 94.000 - 4.44% -
436.cactusADM -3.06% 98.000 95.000 - -67.35% -
436.cactusADM (avg) -3.06% 98.000 95.000 - -67.35% -
456.hmmer -2.94% 102.000 99.000 - 32.00% -
456.hmmer (avg) -2.94% 102.000 99.000 - 32.00% -
429.mcf (avg) (percentage) -2.88% 6.240 6.060 - 1043.40% -
470.lbm (avg) (percentage) -2.84% 4.570 4.440 - 87.34% -
450.soplex -2.63% 38.000 37.000 - -80.63% -
450.soplex (avg) -2.63% 38.000 37.000 - -80.63% -
403.gcc (max) (percentage) -2.59% 69.520 67.720 - 9305.56% -
470.lbm -2.21% 181.000 177.000 - -41.58% -
470.lbm (avg) -2.21% 181.000 177.000 - -41.58% -
435.gromacs -2.00% 300.000 294.000 - 10.53% -
435.gromacs (avg) -2.00% 300.000 294.000 - 10.53% -
483.xalancbmk -2.00% 50.000 49.000 - -33.78% -
483.xalancbmk (avg) -2.00% 50.000 49.000 - -33.78% -
462.libquantum (avg) (percentage) -1.96% 4.590 4.500 - 592.31% -
471.omnetpp (avg) (percentage) -1.90% 4.740 4.650 - 192.45% -
464.h264ref -1.60% 188.000 185.000 - 137.18% -
464.h264ref (avg) -1.60% 188.000 185.000 - 137.18% -
483.xalancbmk (max) (percentage) -1.46% 7.560 7.450 - 1717.07% -
473.astar (avg) (percentage) -1.39% 2.870 2.830 - 1389.47% -
458.sjeng -1.12% 178.000 176.000 - 274.47% -
458.sjeng (avg) -1.12% 178.000 176.000 - 274.47% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 34.65% 8205.000 11048.000 - -0.96% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21500.00% 0.010 2.160 - -38.64% -
403.gcc (max) (percentage) 9305.56% 0.720 67.720 - -2.59% -
473.astar (unexplained diff vs previous) (percentage) 8450.00% 0.020 1.710 - -42.62% -
429.mcf (max) (percentage) 3453.70% 0.540 19.190 - -11.08% -
473.astar (unexplained diff vs previous) 3400.00% 3.000 105.000 - -41.67% -
473.astar (max) (percentage) 1728.57% 0.140 2.560 - -16.61% -
483.xalancbmk (max) (percentage) 1717.07% 0.410 7.450 - -1.46% -
410.bwaves (max) (percentage) 1561.90% 0.210 3.490 - -24.95% -
473.astar (avg) (percentage) 1389.47% 0.190 2.830 - -1.39% -
403.gcc (avg) (percentage) 1068.85% 0.610 7.130 - 0.00% -
429.mcf (avg) (percentage) 1043.40% 0.530 6.060 - -2.88% -
459.GemsFDTD (max) (percentage) 823.33% 0.600 5.540 - -16.69% -
471.omnetpp (unexplained diff vs previous) (percentage) 820.83% 0.240 2.210 - -47.38% -
401.bzip2 (avg) (percentage) 765.91% 0.440 3.810 - 0.00% -
473.astar (max) 685.00% 20.000 157.000 - -15.14% -
470.lbm (unexplained diff vs previous) (percentage) 672.73% 0.110 0.850 - -84.55% -
410.bwaves (max) 633.33% 30.000 220.000 - -25.17% -
483.xalancbmk (max) 593.33% 45.000 312.000 - -4.29% -
462.libquantum (avg) (percentage) 592.31% 0.650 4.500 - -1.96% -
458.sjeng (avg) (percentage) 587.88% 0.330 2.270 - 0.00% -
473.astar 517.86% 28.000 173.000 - 0.00% -
473.astar (avg) 517.86% 28.000 173.000 - 0.00% -
464.h264ref (avg) (percentage) 488.89% 0.540 3.180 - 0.00% -
462.libquantum (max) (percentage) 423.44% 0.640 3.350 - -94.59% -
456.hmmer (avg) (percentage) 404.41% 0.680 3.430 - -3.38% -
450.soplex (avg) (percentage) 377.42% 1.240 5.920 - -3.43% -
458.sjeng (max) (percentage) 368.18% 0.220 1.030 - -11.21% -
453.povray (avg) (percentage) 329.60% 1.250 5.370 - 0.00% -
459.GemsFDTD (avg) (percentage) 326.67% 0.900 3.840 - -3.76% -
450.soplex (max) (percentage) 322.34% 1.970 8.320 - -24.98% -
447.dealII (avg) (percentage) 319.63% 1.070 4.490 - 0.00% -
445.gobmk (avg) (percentage) 302.60% 0.770 3.100 - 0.00% -
400.perlbench (avg) (percentage) 274.83% 1.470 5.510 - 0.00% -
458.sjeng 274.47% 47.000 176.000 - -1.12% -
458.sjeng (avg) 274.47% 47.000 176.000 - -1.12% -
433.milc (max) (percentage) 274.45% 3.170 11.870 - -6.24% -
482.sphinx3 (avg) (percentage) 256.85% 1.460 5.210 - -4.05% -
401.bzip2 (max) (percentage) 250.00% 0.880 3.080 - -6.10% -
429.mcf (max) 223.91% 92.000 298.000 - -11.83% -
454.calculix (avg) (percentage) 223.38% 2.010 6.500 - 0.00% -
433.milc (avg) (percentage) 217.65% 1.700 5.400 - -3.23% -
434.zeusmp (avg) (percentage) 211.49% 1.480 4.610 - -3.35% -
482.sphinx3 (max) (percentage) 210.20% 1.470 4.560 - -16.64% -
410.bwaves (avg) (percentage) 206.42% 1.090 3.340 - -3.47% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - -40.00% -
471.omnetpp (avg) (percentage) 192.45% 1.590 4.650 - -1.90% -
437.leslie3d (max) (percentage) 185.90% 2.340 6.690 - -11.16% -
436.cactusADM (avg) (percentage) 170.48% 1.660 4.490 - -3.23% -
458.sjeng (max) 158.06% 31.000 80.000 - -12.09% -
459.GemsFDTD (max) 156.43% 140.000 359.000 - -16.90% -
471.omnetpp (unexplained diff vs previous) 150.00% 26.000 65.000 - -48.41% -
470.lbm (unexplained diff vs previous) 142.86% 14.000 34.000 - -84.40% -
481.wrf (avg) (percentage) 140.21% 1.890 4.540 - 0.00% -
465.tonto 139.42% 137.000 328.000 - -0.91% -
465.tonto (avg) 139.42% 137.000 328.000 - -0.91% -
464.h264ref 137.18% 78.000 185.000 - -1.60% -
464.h264ref (avg) 137.18% 78.000 185.000 - -1.60% -
435.gromacs (avg) (percentage) 131.79% 1.730 4.010 - 0.00% -
437.leslie3d (max) 102.56% 351.000 711.000 - -14.54% -
470.lbm (avg) (percentage) 87.34% 2.370 4.440 - -2.84% -
464.h264ref (max) (percentage) 81.40% 0.430 0.780 - -8.24% -
445.gobmk 79.35% 92.000 165.000 - 1.23% -
445.gobmk (avg) 79.35% 92.000 165.000 - 1.23% -
465.tonto (avg) (percentage) 77.84% 1.670 2.970 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
401.bzip2 75.76% 66.000 116.000 - 0.00% -
401.bzip2 (avg) 75.76% 66.000 116.000 - 0.00% -
434.zeusmp (max) (percentage) 71.93% 2.280 3.920 - -6.22% -
444.namd (avg) (percentage) 67.68% 3.930 6.590 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 66.67% 0.540 0.900 - -73.37% -
416.gamess (avg) (percentage) 54.84% 2.170 3.360 - 0.00% -
437.leslie3d (avg) (percentage) 40.76% 2.380 3.350 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 40.00% 0.100 0.140 - -96.85% -
435.gromacs (max) (percentage) 37.62% 2.020 2.780 - -11.18% -
456.hmmer 32.00% 75.000 99.000 - -2.94% -
456.hmmer (avg) 32.00% 75.000 99.000 - -2.94% -
410.bwaves 31.87% 160.000 211.000 - -3.21% -
410.bwaves (avg) 31.87% 160.000 211.000 - -3.21% -
436.cactusADM (max) (percentage) 29.21% 3.150 4.070 - -7.29% -
459.GemsFDTD 18.57% 210.000 249.000 - -3.86% -
459.GemsFDTD (avg) 18.57% 210.000 249.000 - -3.86% -
445.gobmk (max) (percentage) 17.65% 1.530 1.800 - -8.16% -
435.gromacs 10.53% 266.000 294.000 - -2.00% -
435.gromacs (avg) 10.53% 266.000 294.000 - -2.00% -
429.mcf 4.44% 90.000 94.000 - -3.09% -
429.mcf (avg) 4.44% 90.000 94.000 - -3.09% -
400.perlbench (max) (percentage) 2.16% 3.240 3.310 - -8.31% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.88% 120221.000 111949.000 - -6.87% -
464.h264ref -1.01% 428364.000 424052.000 - -0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 64.000 - 1.59% -
403.gcc -99.31% 9010.000 62.000 - -1.59% -
462.libquantum -98.80% 11614.000 139.000 - -2.11% -
482.sphinx3 -96.72% 29928.000 983.000 - -0.10% -
450.soplex -95.93% 15466.000 629.000 - 1.29% -
444.namd -92.01% 9050.000 723.000 - -0.55% -
453.povray -91.63% 6544.000 548.000 - 1.29% -
429.mcf -90.93% 17158.000 1556.000 - -0.89% -
433.milc -90.33% 12976.000 1255.000 - -0.55% -
436.cactusADM -87.84% 17544.000 2133.000 - 0.28% -
400.perlbench -84.96% 10650.000 1602.000 - -3.84% -
434.zeusmp -80.39% 13211.000 2591.000 - 0.39% -
401.bzip2 -79.91% 15185.000 3051.000 - -0.23% -
447.dealII -79.26% 9751.000 2022.000 - 0.80% -
456.hmmer -73.71% 11046.000 2904.000 - 0.41% -
471.omnetpp -72.66% 10739.000 2936.000 - -2.17% -
459.GemsFDTD -72.19% 23356.000 6496.000 - -0.17% -
470.lbm -68.80% 12819.000 3999.000 - 0.86% -
481.wrf -66.41% 16834.000 5655.000 - -0.26% -
483.xalancbmk -62.40% 11172.000 4201.000 - -2.80% -
464.h264ref -59.91% 14556.000 5836.000 - -1.55% -
473.astar -58.87% 14932.000 6141.000 - 1.74% -
410.bwaves -57.18% 14755.000 6318.000 - -0.14% -
445.gobmk -55.38% 11995.000 5352.000 - 1.73% -
435.gromacs -52.44% 15419.000 7334.000 - -1.98% -
458.sjeng -45.57% 14275.000 7770.000 - -1.41% -
416.gamess -45.31% 22704.000 12416.000 - -0.35% -
437.leslie3d -29.09% 15005.000 10640.000 - -3.76% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.81% 1074.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) -99.46% 186.000 1.000 - -98.04% -
454.calculix -99.13% 459.000 4.000 - 0.00% -
454.calculix (avg) -99.13% 459.000 4.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -98.95% 570.000 6.000 - -70.00% -
444.namd (max) -98.61% 649.000 9.000 - -10.00% -
433.milc (unexplained diff vs previous) -98.35% 425.000 7.000 - -92.86% -
450.soplex (unexplained diff vs previous) -97.43% 311.000 8.000 - -87.10% -
453.povray (max) -96.97% 165.000 5.000 - -16.67% -
434.zeusmp (unexplained diff vs previous) -96.75% 308.000 10.000 - -86.67% -
416.gamess (max) -95.27% 656.000 31.000 - -8.82% -
462.libquantum (max) -94.59% 74.000 4.000 - -95.40% -
403.gcc -92.59% 54.000 4.000 - 0.00% -
403.gcc (avg) -92.59% 54.000 4.000 - 0.00% -
456.hmmer (max) -92.14% 140.000 11.000 - 57.14% -
462.libquantum -92.00% 75.000 6.000 - 0.00% -
462.libquantum (avg) -92.00% 75.000 6.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -91.38% 3.250 0.280 - -70.21% -
416.gamess (max) (percentage) -91.35% 2.890 0.250 - -10.71% -
482.sphinx3 (max) -89.98% 439.000 44.000 - -16.98% -
482.sphinx3 -88.30% 436.000 51.000 - -3.77% -
482.sphinx3 (avg) -88.30% 436.000 51.000 - -3.77% -
444.namd -86.76% 355.000 47.000 - 0.00% -
444.namd (avg) -86.76% 355.000 47.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -85.54% 83.000 12.000 - 300.00% -
429.mcf (unexplained diff vs previous) -84.95% 93.000 14.000 - -73.58% -
400.perlbench (max) -84.64% 345.000 53.000 - -11.67% -
436.cactusADM (max) -84.42% 552.000 86.000 - -7.53% -
482.sphinx3 (unexplained diff vs previous) (percentage) -83.87% 0.620 0.100 - -98.07% -
471.omnetpp (max) -83.84% 662.000 107.000 - -18.32% -
434.zeusmp (unexplained diff vs previous) (percentage) -83.26% 2.330 0.390 - -86.60% -
433.milc (unexplained diff vs previous) (percentage) -82.93% 3.280 0.560 - -92.79% -
450.soplex (max) -82.89% 304.000 52.000 - -23.53% -
444.namd (max) (percentage) -81.06% 7.180 1.360 - -6.21% -
450.soplex -80.63% 191.000 37.000 - -2.63% -
450.soplex (avg) -80.63% 191.000 37.000 - -2.63% -
447.dealII (max) -79.44% 107.000 22.000 - -8.33% -
459.GemsFDTD (unexplained diff vs previous) -77.08% 48.000 11.000 - -97.29% -
481.wrf (max) -72.08% 530.000 148.000 - -8.64% -
470.lbm (max) -70.44% 653.000 193.000 - -16.09% -
433.milc -69.55% 220.000 67.000 - -4.29% -
433.milc (avg) -69.55% 220.000 67.000 - -4.29% -
456.hmmer (max) (percentage) -67.72% 1.270 0.410 - 57.69% -
436.cactusADM -67.35% 291.000 95.000 - -3.06% -
436.cactusADM (avg) -67.35% 291.000 95.000 - -3.06% -
434.zeusmp (max) -66.45% 301.000 101.000 - -5.61% -
453.povray -64.20% 81.000 29.000 - 0.00% -
453.povray (avg) -64.20% 81.000 29.000 - 0.00% -
433.milc (max) -63.99% 411.000 148.000 - -6.92% -
453.povray (max) (percentage) -60.87% 2.530 0.990 - -10.81% -
465.tonto (max) (percentage) -48.88% 3.580 1.830 - -11.17% -
445.gobmk (max) -47.54% 183.000 96.000 - -6.80% -
456.hmmer (unexplained diff vs previous) (percentage) -45.33% 0.750 0.410 - 310.00% -
400.perlbench -43.59% 156.000 88.000 - -3.30% -
400.perlbench (avg) -43.59% 156.000 88.000 - -3.30% -
470.lbm -41.58% 303.000 177.000 - -2.21% -
470.lbm (avg) -41.58% 303.000 177.000 - -2.21% -
471.omnetpp (max) (percentage) -40.84% 6.170 3.650 - -16.67% -
410.bwaves (unexplained diff vs previous) -40.00% 15.000 9.000 - -96.80% -
434.zeusmp -38.97% 195.000 119.000 - -3.25% -
434.zeusmp (avg) -38.97% 195.000 119.000 - -3.25% -
450.soplex (unexplained diff vs previous) (percentage) -36.82% 2.010 1.270 - -87.27% -
403.gcc (max) -35.94% 64.000 41.000 - -4.65% -
435.gromacs (max) -34.73% 311.000 203.000 - -13.25% -
483.xalancbmk -33.78% 74.000 49.000 - -2.00% -
483.xalancbmk (avg) -33.78% 74.000 49.000 - -2.00% -
465.tonto (max) -31.06% 293.000 202.000 - -11.79% -
401.bzip2 (max) -30.08% 133.000 93.000 - -7.00% -
464.h264ref (max) -27.42% 62.000 45.000 - -10.00% -
471.omnetpp -20.00% 170.000 136.000 - -4.23% -
471.omnetpp (avg) -20.00% 170.000 136.000 - -4.23% -
481.wrf -19.50% 318.000 256.000 - -0.39% -
481.wrf (avg) -19.50% 318.000 256.000 - -0.39% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -19.05% 0.210 0.170 - -97.28% -
481.wrf (max) (percentage) -16.51% 3.150 2.630 - -8.36% -
416.gamess -15.24% 492.000 417.000 - -0.24% -
416.gamess (avg) -15.24% 492.000 417.000 - -0.24% -
447.dealII -13.46% 104.000 90.000 - 0.00% -
447.dealII (avg) -13.46% 104.000 90.000 - 0.00% -
454.calculix (max) (percentage) -11.28% 4.700 4.170 - -4.79% -
470.lbm (max) (percentage) -4.90% 5.100 4.850 - -16.67% -

Report Time: 0.43s
Execution (seconds)
Name Current %
400.perlbench 1602.000 -3.84%
401.bzip2 3051.000 -
403.gcc 62.000 -1.59%
410.bwaves 6318.000 -
416.gamess 12416.000 -
429.mcf 1556.000 -
433.milc 1255.000 -
434.zeusmp 2591.000 -
435.gromacs 7334.000 -1.98%
436.cactusADM 2133.000 -
437.leslie3d 10640.000 -3.76%
444.namd 723.000 -
445.gobmk 5352.000 1.73%
447.dealII 2022.000 -
450.soplex 629.000 1.29%
453.povray 548.000 1.29%
454.calculix 64.000 1.59%
456.hmmer 2904.000 -
458.sjeng 7770.000 -1.41%
459.GemsFDTD 6496.000 -
462.libquantum 139.000 -2.11%
464.h264ref 5836.000 -1.55%
465.tonto 11048.000 -
470.lbm 3999.000 -
471.omnetpp 2936.000 -2.17%
473.astar 6141.000 1.74%
481.wrf 5655.000 -
482.sphinx3 983.000 -
483.xalancbmk 4201.000 -2.80%
Geometric Mean 2191.806 -
Code Size (bytes)
Name Current %
400.perlbench 930113.000 -
401.bzip2 49892.000 -
403.gcc 2682349.000 -
410.bwaves 17876.000 -
416.gamess 6261071.000 -
429.mcf 10951.000 -
433.milc 95862.000 -
434.zeusmp 165667.000 -
435.gromacs 678645.000 -
436.cactusADM 553770.000 -
437.leslie3d 65173.000 -
444.namd 190962.000 -
445.gobmk 1399483.000 -
447.dealII 2121732.000 -
450.soplex 260508.000 -
453.povray 704477.000 -1.18%
454.calculix 1272852.000 -
456.hmmer 231140.000 -
458.sjeng 111949.000 -6.87%
459.GemsFDTD 253797.000 -
462.libquantum 31297.000 -
464.h264ref 424052.000 -
465.tonto 2875350.000 -
470.lbm 10908.000 -
471.omnetpp 566593.000 -
473.astar 32056.000 -
481.wrf 2638533.000 -
482.sphinx3 152712.000 -
483.xalancbmk 3281683.000 -
Geometric Mean 297065.167 -
sample variability
Name Current %
400.perlbench 88.000 -3.30%
400.perlbench (avg) 88.000 -3.30%
400.perlbench (avg) (percentage) 5.510 -
400.perlbench (max) 53.000 -11.67%
400.perlbench (max) (percentage) 3.310 -8.31%
401.bzip2 116.000 -
401.bzip2 (avg) 116.000 -
401.bzip2 (avg) (percentage) 3.810 -
401.bzip2 (max) 93.000 -7.00%
401.bzip2 (max) (percentage) 3.080 -6.10%
403.gcc 4.000 -
403.gcc (avg) 4.000 -
403.gcc (avg) (percentage) 7.130 -
403.gcc (max) 41.000 -4.65%
403.gcc (max) (percentage) 67.720 -2.59%
410.bwaves 211.000 -3.21%
410.bwaves (avg) 211.000 -3.21%
410.bwaves (avg) (percentage) 3.340 -3.47%
410.bwaves (max) 220.000 -25.17%
410.bwaves (max) (percentage) 3.490 -24.95%
410.bwaves (unexplained diff vs previous) 9.000 -96.80%
410.bwaves (unexplained diff vs previous) (percentage) 0.140 -96.85%
416.gamess 417.000 -
416.gamess (avg) 417.000 -
416.gamess (avg) (percentage) 3.360 -
416.gamess (max) 31.000 -8.82%
416.gamess (max) (percentage) 0.250 -10.71%
429.mcf 94.000 -3.09%
429.mcf (avg) 94.000 -3.09%
429.mcf (avg) (percentage) 6.060 -2.88%
429.mcf (max) 298.000 -11.83%
429.mcf (max) (percentage) 19.190 -11.08%
429.mcf (unexplained diff vs previous) 14.000 -73.58%
429.mcf (unexplained diff vs previous) (percentage) 0.900 -73.37%
433.milc 67.000 -4.29%
433.milc (avg) 67.000 -4.29%
433.milc (avg) (percentage) 5.400 -3.23%
433.milc (max) 148.000 -6.92%
433.milc (max) (percentage) 11.870 -6.24%
433.milc (unexplained diff vs previous) 7.000 -92.86%
433.milc (unexplained diff vs previous) (percentage) 0.560 -92.79%
434.zeusmp 119.000 -3.25%
434.zeusmp (avg) 119.000 -3.25%
434.zeusmp (avg) (percentage) 4.610 -3.35%
434.zeusmp (max) 101.000 -5.61%
434.zeusmp (max) (percentage) 3.920 -6.22%
434.zeusmp (unexplained diff vs previous) 10.000 -86.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.390 -86.60%
435.gromacs 294.000 -2.00%
435.gromacs (avg) 294.000 -2.00%
435.gromacs (avg) (percentage) 4.010 -
435.gromacs (max) 203.000 -13.25%
435.gromacs (max) (percentage) 2.780 -11.18%
436.cactusADM 95.000 -3.06%
436.cactusADM (avg) 95.000 -3.06%
436.cactusADM (avg) (percentage) 4.490 -3.23%
436.cactusADM (max) 86.000 -7.53%
436.cactusADM (max) (percentage) 4.070 -7.29%
436.cactusADM (unexplained diff vs previous) 6.000 -70.00%
436.cactusADM (unexplained diff vs previous) (percentage) 0.280 -70.21%
437.leslie3d 356.000 -3.78%
437.leslie3d (avg) 356.000 -3.78%
437.leslie3d (avg) (percentage) 3.350 -
437.leslie3d (max) 711.000 -14.54%
437.leslie3d (max) (percentage) 6.690 -11.16%
444.namd 47.000 -
444.namd (avg) 47.000 -
444.namd (avg) (percentage) 6.590 -
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.360 -6.21%
445.gobmk 165.000 1.23%
445.gobmk (avg) 165.000 1.23%
445.gobmk (avg) (percentage) 3.100 -
445.gobmk (max) 96.000 -6.80%
445.gobmk (max) (percentage) 1.800 -8.16%
447.dealII 90.000 -
447.dealII (avg) 90.000 -
447.dealII (avg) (percentage) 4.490 -
447.dealII (max) 22.000 -8.33%
447.dealII (max) (percentage) 1.110 -7.50%
450.soplex 37.000 -2.63%
450.soplex (avg) 37.000 -2.63%
450.soplex (avg) (percentage) 5.920 -3.43%
450.soplex (max) 52.000 -23.53%
450.soplex (max) (percentage) 8.320 -24.98%
450.soplex (unexplained diff vs previous) 8.000 -87.10%
450.soplex (unexplained diff vs previous) (percentage) 1.270 -87.27%
453.povray 29.000 -
453.povray (avg) 29.000 -
453.povray (avg) (percentage) 5.370 -
453.povray (max) 5.000 -16.67%
453.povray (max) (percentage) 0.990 -10.81%
454.calculix 4.000 -
454.calculix (avg) 4.000 -
454.calculix (avg) (percentage) 6.500 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 4.170 -4.79%
456.hmmer 99.000 -2.94%
456.hmmer (avg) 99.000 -2.94%
456.hmmer (avg) (percentage) 3.430 -3.38%
456.hmmer (max) 11.000 57.14%
456.hmmer (max) (percentage) 0.410 57.69%
456.hmmer (unexplained diff vs previous) 12.000 300.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.410 310.00%
458.sjeng 176.000 -1.12%
458.sjeng (avg) 176.000 -1.12%
458.sjeng (avg) (percentage) 2.270 -
458.sjeng (max) 80.000 -12.09%
458.sjeng (max) (percentage) 1.030 -11.21%
459.GemsFDTD 249.000 -3.86%
459.GemsFDTD (avg) 249.000 -3.86%
459.GemsFDTD (avg) (percentage) 3.840 -3.76%
459.GemsFDTD (max) 359.000 -16.90%
459.GemsFDTD (max) (percentage) 5.540 -16.69%
459.GemsFDTD (unexplained diff vs previous) 11.000 -97.29%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.170 -97.28%
462.libquantum 6.000 -
462.libquantum (avg) 6.000 -
462.libquantum (avg) (percentage) 4.500 -1.96%
462.libquantum (max) 4.000 -95.40%
462.libquantum (max) (percentage) 3.350 -94.59%
462.libquantum (unexplained diff vs previous) 3.000 -40.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.160 -38.64%
464.h264ref 185.000 -1.60%
464.h264ref (avg) 185.000 -1.60%
464.h264ref (avg) (percentage) 3.180 -
464.h264ref (max) 45.000 -10.00%
464.h264ref (max) (percentage) 0.780 -8.24%
465.tonto 328.000 -
465.tonto (avg) 328.000 -
465.tonto (avg) (percentage) 2.970 -
465.tonto (max) 202.000 -11.79%
465.tonto (max) (percentage) 1.830 -11.17%
470.lbm 177.000 -2.21%
470.lbm (avg) 177.000 -2.21%
470.lbm (avg) (percentage) 4.440 -2.84%
470.lbm (max) 193.000 -16.09%
470.lbm (max) (percentage) 4.850 -16.67%
470.lbm (unexplained diff vs previous) 34.000 -84.40%
470.lbm (unexplained diff vs previous) (percentage) 0.850 -84.55%
471.omnetpp 136.000 -4.23%
471.omnetpp (avg) 136.000 -4.23%
471.omnetpp (avg) (percentage) 4.650 -1.90%
471.omnetpp (max) 107.000 -18.32%
471.omnetpp (max) (percentage) 3.650 -16.67%
471.omnetpp (unexplained diff vs previous) 65.000 -48.41%
471.omnetpp (unexplained diff vs previous) (percentage) 2.210 -47.38%
473.astar 173.000 -
473.astar (avg) 173.000 -
473.astar (avg) (percentage) 2.830 -1.39%
473.astar (max) 157.000 -15.14%
473.astar (max) (percentage) 2.560 -16.61%
473.astar (unexplained diff vs previous) 105.000 -41.67%
473.astar (unexplained diff vs previous) (percentage) 1.710 -42.62%
481.wrf 256.000 -
481.wrf (avg) 256.000 -
481.wrf (avg) (percentage) 4.540 -
481.wrf (max) 148.000 -8.64%
481.wrf (max) (percentage) 2.630 -8.36%
482.sphinx3 51.000 -3.77%
482.sphinx3 (avg) 51.000 -3.77%
482.sphinx3 (avg) (percentage) 5.210 -4.05%
482.sphinx3 (max) 44.000 -16.98%
482.sphinx3 (max) (percentage) 4.560 -16.64%
482.sphinx3 (unexplained diff vs previous) 1.000 -98.04%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.100 -98.07%
483.xalancbmk 49.000 -2.00%
483.xalancbmk (avg) 49.000 -2.00%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 312.000 -4.29%
483.xalancbmk (max) (percentage) 7.450 -1.46%
Geometric Mean 16.479 -28.69%