Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f0874f419209510d2a55e994f6ca10eb9f7905bc (+ 46 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/7f26e76c9848aeea9ec10ea701a6168464a4a9c2 (+ 89 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=abcf8db7fa46b73fd5b8193ce11f9312301b84c7 (+ 10 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=cf2e1dca2069cc2209ac8aa55b2f686c80d272fe (+ 47 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/50/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0050 (4-changed-components) 2023-06-04T11:25:54 0:00:00
Previous 0049 (3-changed-components) 2023-06-01T05:13:26 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 87 79
Performance Improvements 54 123
Added Tests 2 2
Unchanged Tests 1093 1032
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.02% 57.000 61.000 - -99.32% -
483.xalancbmk 6.11% 4028.000 4274.000 - -61.74% -
450.soplex 5.76% 538.000 569.000 - -96.32% -
481.wrf 5.56% 5409.000 5710.000 - -66.08% -
453.povray 4.88% 533.000 559.000 - -91.46% -
482.sphinx3 4.04% 916.000 953.000 - -96.82% -
465.tonto 3.63% 10671.000 11058.000 - 34.77% -
473.astar 3.34% 5690.000 5880.000 - -60.62% -
462.libquantum 2.99% 134.000 138.000 - -98.81% -
401.bzip2 2.78% 2876.000 2956.000 - -80.53% -
435.gromacs 2.35% 7049.000 7215.000 - -53.21% -
437.leslie3d 2.34% 10270.000 10510.000 - -29.96% -
445.gobmk 2.05% 5163.000 5269.000 - -56.07% -
433.milc 2.02% 1139.000 1162.000 - -91.05% -
459.GemsFDTD 1.82% 6030.000 6140.000 - -73.71% -
456.hmmer 1.77% 2876.000 2927.000 - -73.50% -
458.sjeng 1.39% 7651.000 7757.000 - -45.66% -
464.h264ref 1.37% 5782.000 5861.000 - -59.73% -
434.zeusmp 1.25% 2477.000 2508.000 - -81.02% -
410.bwaves 1.12% 5972.000 6039.000 - -59.07% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) 8933.33% 0.030 2.710 - 211.49% -
401.bzip2 (unexplained diff vs previous) 7900.00% 1.000 80.000 - -39.39% -
429.mcf (unexplained diff vs previous) (percentage) 5332.56% 0.430 23.360 - 4225.93% -
429.mcf (unexplained diff vs previous) 4337.50% 8.000 355.000 - 281.72% -
482.sphinx3 (unexplained diff vs previous) 1133.33% 3.000 37.000 - -80.11% -
482.sphinx3 (unexplained diff vs previous) (percentage) 1075.76% 0.330 3.880 - 525.81% -
473.astar (unexplained diff vs previous) 578.57% 28.000 190.000 - 6233.33% -
473.astar (unexplained diff vs previous) (percentage) 559.18% 0.490 3.230 - 16050.00% -
444.namd (unexplained diff vs previous) 500.00% 1.000 6.000 - -99.14% -
444.namd (unexplained diff vs previous) (percentage) 492.86% 0.140 0.830 - -89.26% -
436.cactusADM (unexplained diff vs previous) (percentage) 354.76% 0.420 1.910 - -41.23% -
436.cactusADM (unexplained diff vs previous) 344.44% 9.000 40.000 - -92.98% -
436.cactusADM (max) (percentage) 334.88% 0.430 1.870 - -40.63% -
436.cactusADM (max) 333.33% 9.000 39.000 - -92.93% -
410.bwaves (unexplained diff vs previous) 318.75% 16.000 67.000 - 346.67% -
410.bwaves (unexplained diff vs previous) (percentage) 311.11% 0.270 1.110 - 1010.00% -
459.GemsFDTD (unexplained diff vs previous) 307.41% 27.000 110.000 - 129.17% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 300.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 297.78% 0.450 1.790 - 752.38% -
462.libquantum (unexplained diff vs previous) (percentage) 286.67% 0.750 2.900 - 28900.00% -
434.zeusmp (unexplained diff vs previous) 210.00% 10.000 31.000 - -89.94% -
434.zeusmp (unexplained diff vs previous) (percentage) 210.00% 0.400 1.240 - -46.78% -
410.bwaves (max) 131.03% 29.000 67.000 - 123.33% -
410.bwaves (max) (percentage) 128.57% 0.490 1.120 - 433.33% -
433.milc (unexplained diff vs previous) 109.09% 11.000 23.000 - -94.59% -
433.milc (unexplained diff vs previous) (percentage) 104.12% 0.970 1.980 - -39.63% -
462.libquantum (max) 100.00% 2.000 4.000 - -94.59% -
462.libquantum (max) (percentage) 83.44% 1.630 2.990 - 367.19% -
433.milc (max) 76.92% 13.000 23.000 - -94.40% -
433.milc (max) (percentage) 74.14% 1.160 2.020 - -36.28% -
401.bzip2 (max) 67.35% 49.000 82.000 - -38.35% -
470.lbm (unexplained diff vs previous) (percentage) 66.67% 0.240 0.400 - 263.64% -
470.lbm (unexplained diff vs previous) 66.67% 9.000 15.000 - 7.14% -
401.bzip2 (max) (percentage) 61.63% 1.720 2.780 - 215.91% -
482.sphinx3 (max) 52.00% 25.000 38.000 - -91.34% -
482.sphinx3 (max) (percentage) 45.32% 2.780 4.040 - 174.83% -
473.astar (max) 14.62% 171.000 196.000 - 880.00% -
459.GemsFDTD (max) 11.00% 100.000 111.000 - -20.71% -
473.astar (max) (percentage) 10.96% 3.010 3.340 - 2285.71% -
459.GemsFDTD (max) (percentage) 8.98% 1.670 1.820 - 203.33% -
429.mcf (max) (percentage) 8.30% 17.480 18.930 - 3405.56% -
482.sphinx3 6.90% 29.000 31.000 - -92.89% -
482.sphinx3 (avg) 6.90% 29.000 31.000 - -92.89% -
483.xalancbmk 6.38% 47.000 50.000 - -32.43% -
483.xalancbmk (avg) 6.38% 47.000 50.000 - -32.43% -
453.povray 6.25% 16.000 17.000 - -79.01% -
453.povray (avg) 6.25% 16.000 17.000 - -79.01% -
483.xalancbmk (max) 5.62% 249.000 263.000 - 484.44% -
481.wrf 5.19% 154.000 162.000 - -49.06% -
481.wrf (avg) 5.19% 154.000 162.000 - -49.06% -
473.astar 4.38% 137.000 143.000 - 410.71% -
473.astar (avg) 4.38% 137.000 143.000 - 410.71% -
450.soplex 4.17% 24.000 25.000 - -86.91% -
450.soplex (avg) 4.17% 24.000 25.000 - -86.91% -
429.mcf (avg) (percentage) 3.59% 7.520 7.790 - 1369.81% -
465.tonto 3.54% 226.000 234.000 - 70.80% -
465.tonto (avg) 3.54% 226.000 234.000 - 70.80% -
401.bzip2 2.63% 76.000 78.000 - 18.18% -
401.bzip2 (avg) 2.63% 76.000 78.000 - 18.18% -
435.gromacs 2.38% 210.000 215.000 - -19.17% -
435.gromacs (avg) 2.38% 210.000 215.000 - -19.17% -
456.hmmer 2.08% 48.000 49.000 - -34.67% -
456.hmmer (avg) 2.08% 48.000 49.000 - -34.67% -
445.gobmk 2.02% 99.000 101.000 - 9.78% -
445.gobmk (avg) 2.02% 99.000 101.000 - 9.78% -
464.h264ref 1.85% 108.000 110.000 - 41.03% -
464.h264ref (avg) 1.85% 108.000 110.000 - 41.03% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -18.93% 1875.000 1520.000 - -91.14% -
436.cactusADM -1.87% 2137.000 2097.000 - -88.05% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -96.51% 0.860 0.030 - -87.50% -
471.omnetpp (unexplained diff vs previous) -96.00% 25.000 1.000 - -96.15% -
454.calculix (max) -50.00% 2.000 1.000 - -99.91% -
437.leslie3d (unexplained diff vs previous) (percentage) -29.85% 3.250 2.280 - -0.44% -
437.leslie3d (unexplained diff vs previous) -28.14% 334.000 240.000 - -30.03% -
454.calculix (max) (percentage) -23.18% 3.840 2.950 - -37.23% -
429.mcf -16.31% 141.000 118.000 - 31.11% -
429.mcf (avg) -16.31% 141.000 118.000 - 31.11% -
429.mcf (max) -12.23% 327.000 287.000 - 211.96% -
416.gamess (max) -12.12% 33.000 29.000 - -95.58% -
471.omnetpp (max) -11.49% 87.000 77.000 - -88.37% -
416.gamess (max) (percentage) -11.11% 0.270 0.240 - -91.70% -
471.omnetpp (max) (percentage) -11.07% 2.980 2.650 - -57.05% -
470.lbm (max) (percentage) -10.34% 0.580 0.520 - -89.80% -
444.namd (max) -10.00% 10.000 9.000 - -98.61% -
470.lbm (max) -9.52% 21.000 19.000 - -97.09% -
450.soplex (max) (percentage) -8.66% 3.350 3.060 - 55.33% -
435.gromacs (max) (percentage) -8.60% 3.490 3.190 - 57.92% -
445.gobmk (max) (percentage) -8.59% 1.630 1.490 - -2.61% -
444.namd (max) (percentage) -8.33% 1.440 1.320 - -81.62% -
464.h264ref (max) (percentage) -8.20% 1.220 1.120 - 160.47% -
434.zeusmp (max) (percentage) -8.09% 1.360 1.250 - -45.18% -
458.sjeng (max) -7.27% 55.000 51.000 - 64.52% -
445.gobmk (max) -7.14% 84.000 78.000 - -57.38% -
464.h264ref (max) -7.14% 70.000 65.000 - 4.84% -
458.sjeng (max) (percentage) -6.94% 0.720 0.670 - 204.55% -
481.wrf (max) (percentage) -6.82% 0.880 0.820 - -73.97% -
437.leslie3d (max) (percentage) -6.70% 8.510 7.940 - 239.32% -
435.gromacs (max) -6.50% 246.000 230.000 - -26.05% -
453.povray (max) (percentage) -6.36% 3.300 3.090 - 22.13% -
434.zeusmp (max) -6.06% 33.000 31.000 - -89.70% -
450.soplex (max) -5.56% 18.000 17.000 - -94.41% -
437.leslie3d (max) -4.47% 873.000 834.000 - 137.61% -
447.dealII (max) (percentage) -3.77% 0.530 0.510 - -53.64% -
454.calculix (avg) (percentage) -3.30% 4.240 4.100 - 103.98% -
456.hmmer (max) (percentage) -3.23% 0.620 0.600 - -52.76% -
400.perlbench (max) -2.56% 39.000 38.000 - -88.99% -
400.perlbench (max) (percentage) -2.47% 2.430 2.370 - -26.85% -
465.tonto (max) (percentage) -2.46% 1.220 1.190 - -66.76% -
471.omnetpp (avg) (percentage) -2.32% 3.450 3.370 - 111.95% -
481.wrf (max) -2.13% 47.000 46.000 - -91.32% -
444.namd (avg) (percentage) -2.10% 3.330 3.260 - -17.05% -
471.omnetpp -2.00% 100.000 98.000 - -42.35% -
471.omnetpp (avg) -2.00% 100.000 98.000 - -42.35% -
436.cactusADM -1.89% 53.000 52.000 - -82.13% -
436.cactusADM (avg) -1.89% 53.000 52.000 - -82.13% -
470.lbm (avg) (percentage) -1.66% 2.410 2.370 - 0.00% -
437.leslie3d (avg) (percentage) -1.23% 4.080 4.030 - 69.33% -
459.GemsFDTD (avg) (percentage) -1.15% 2.610 2.580 - 186.67% -
470.lbm -1.12% 89.000 88.000 - -70.96% -
470.lbm (avg) -1.12% 89.000 88.000 - -70.96% -
434.zeusmp (avg) (percentage) -1.11% 2.700 2.670 - 80.41% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 34.77% 8205.000 11058.000 - 3.63% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 28900.00% 0.010 2.900 - 286.67% -
473.astar (unexplained diff vs previous) (percentage) 16050.00% 0.020 3.230 - 559.18% -
473.astar (unexplained diff vs previous) 6233.33% 3.000 190.000 - 578.57% -
429.mcf (unexplained diff vs previous) (percentage) 4225.93% 0.540 23.360 - 5332.56% -
429.mcf (max) (percentage) 3405.56% 0.540 18.930 - 8.30% -
473.astar (max) (percentage) 2285.71% 0.140 3.340 - 10.96% -
483.xalancbmk (max) (percentage) 1404.88% 0.410 6.170 - -0.32% -
429.mcf (avg) (percentage) 1369.81% 0.530 7.790 - 3.59% -
473.astar (avg) (percentage) 1184.21% 0.190 2.440 - 0.83% -
410.bwaves (unexplained diff vs previous) (percentage) 1010.00% 0.100 1.110 - 311.11% -
473.astar (max) 880.00% 20.000 196.000 - 14.62% -
403.gcc (avg) (percentage) 827.87% 0.610 5.660 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 752.38% 0.210 1.790 - 297.78% -
403.gcc (max) (percentage) 659.72% 0.720 5.470 - -0.73% -
482.sphinx3 (unexplained diff vs previous) (percentage) 525.81% 0.620 3.880 - 1075.76% -
401.bzip2 (avg) (percentage) 506.82% 0.440 2.670 - 0.00% -
483.xalancbmk (max) 484.44% 45.000 263.000 - 5.62% -
410.bwaves (max) (percentage) 433.33% 0.210 1.120 - 128.57% -
473.astar 410.71% 28.000 143.000 - 4.38% -
473.astar (avg) 410.71% 28.000 143.000 - 4.38% -
462.libquantum (max) (percentage) 367.19% 0.640 2.990 - 83.44% -
410.bwaves (unexplained diff vs previous) 346.67% 15.000 67.000 - 318.75% -
458.sjeng (avg) (percentage) 333.33% 0.330 1.430 - 0.00% -
462.libquantum (avg) (percentage) 316.92% 0.650 2.710 - 0.00% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 300.00% -
429.mcf (unexplained diff vs previous) 281.72% 93.000 355.000 - 4337.50% -
450.soplex (avg) (percentage) 263.71% 1.240 4.510 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 263.64% 0.110 0.400 - 66.67% -
464.h264ref (avg) (percentage) 248.15% 0.540 1.880 - 0.00% -
437.leslie3d (max) (percentage) 239.32% 2.340 7.940 - -6.70% -
401.bzip2 (max) (percentage) 215.91% 0.880 2.780 - 61.63% -
429.mcf (max) 211.96% 92.000 287.000 - -12.23% -
401.bzip2 (unexplained diff vs previous) (percentage) 211.49% 0.870 2.710 - 8933.33% -
458.sjeng (max) (percentage) 204.55% 0.220 0.670 - -6.94% -
459.GemsFDTD (max) (percentage) 203.33% 0.600 1.820 - 8.98% -
459.GemsFDTD (avg) (percentage) 186.67% 0.900 2.580 - -1.15% -
482.sphinx3 (max) (percentage) 174.83% 1.470 4.040 - 45.32% -
464.h264ref (max) (percentage) 160.47% 0.430 1.120 - -8.20% -
456.hmmer (avg) (percentage) 150.00% 0.680 1.700 - 0.00% -
445.gobmk (avg) (percentage) 149.35% 0.770 1.920 - 0.00% -
400.perlbench (avg) (percentage) 145.58% 1.470 3.610 - 0.00% -
453.povray (avg) (percentage) 144.80% 1.250 3.060 - 0.00% -
437.leslie3d (max) 137.61% 351.000 834.000 - -4.47% -
458.sjeng 134.04% 47.000 110.000 - 0.92% -
458.sjeng (avg) 134.04% 47.000 110.000 - 0.92% -
459.GemsFDTD (unexplained diff vs previous) 129.17% 48.000 110.000 - 307.41% -
447.dealII (avg) (percentage) 126.17% 1.070 2.420 - 0.00% -
410.bwaves (max) 123.33% 30.000 67.000 - 131.03% -
482.sphinx3 (avg) (percentage) 123.29% 1.460 3.260 - 0.62% -
471.omnetpp (avg) (percentage) 111.95% 1.590 3.370 - -2.32% -
454.calculix (avg) (percentage) 103.98% 2.010 4.100 - -3.30% -
410.bwaves (avg) (percentage) 92.66% 1.090 2.100 - -0.94% -
433.milc (avg) (percentage) 81.76% 1.700 3.090 - -0.64% -
434.zeusmp (avg) (percentage) 80.41% 1.480 2.670 - -1.11% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
435.gromacs (avg) (percentage) 72.25% 1.730 2.980 - 0.00% -
465.tonto 70.80% 137.000 234.000 - 3.54% -
465.tonto (avg) 70.80% 137.000 234.000 - 3.54% -
437.leslie3d (avg) (percentage) 69.33% 2.380 4.030 - -1.23% -
458.sjeng (max) 64.52% 31.000 51.000 - -7.27% -
435.gromacs (max) (percentage) 57.92% 2.020 3.190 - -8.60% -
450.soplex (max) (percentage) 55.33% 1.970 3.060 - -8.66% -
481.wrf (avg) (percentage) 50.79% 1.890 2.850 - 0.00% -
436.cactusADM (avg) (percentage) 50.60% 1.660 2.500 - -0.79% -
464.h264ref 41.03% 78.000 110.000 - 1.85% -
464.h264ref (avg) 41.03% 78.000 110.000 - 1.85% -
429.mcf 31.11% 90.000 118.000 - -16.31% -
429.mcf (avg) 31.11% 90.000 118.000 - -16.31% -
465.tonto (avg) (percentage) 26.95% 1.670 2.120 - 0.00% -
453.povray (max) (percentage) 22.13% 2.530 3.090 - -6.36% -
437.leslie3d 18.49% 357.000 423.000 - 0.95% -
437.leslie3d (avg) 18.49% 357.000 423.000 - 0.95% -
401.bzip2 18.18% 66.000 78.000 - 2.63% -
401.bzip2 (avg) 18.18% 66.000 78.000 - 2.63% -
445.gobmk 9.78% 92.000 101.000 - 2.02% -
445.gobmk (avg) 9.78% 92.000 101.000 - 2.02% -
470.lbm (unexplained diff vs previous) 7.14% 14.000 15.000 - 66.67% -
464.h264ref (max) 4.84% 62.000 65.000 - -7.14% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -6.99% 120221.000 111821.000 - 0.01% -
464.h264ref -1.06% 428364.000 423816.000 - -0.97% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.72% 22860.000 63.000 - 0.00% -
403.gcc -99.32% 9010.000 61.000 - 7.02% -
462.libquantum -98.81% 11614.000 138.000 - 2.99% -
482.sphinx3 -96.82% 29928.000 953.000 - 4.04% -
450.soplex -96.32% 15466.000 569.000 - 5.76% -
444.namd -92.01% 9050.000 723.000 - 0.84% -
453.povray -91.46% 6544.000 559.000 - 4.88% -
429.mcf -91.14% 17158.000 1520.000 - -18.93% -
433.milc -91.05% 12976.000 1162.000 - 2.02% -
436.cactusADM -88.05% 17544.000 2097.000 - -1.87% -
400.perlbench -84.56% 10650.000 1644.000 - 0.49% -
434.zeusmp -81.02% 13211.000 2508.000 - 1.25% -
401.bzip2 -80.53% 15185.000 2956.000 - 2.78% -
447.dealII -79.69% 9751.000 1980.000 - 0.00% -
459.GemsFDTD -73.71% 23356.000 6140.000 - 1.82% -
456.hmmer -73.50% 11046.000 2927.000 - 1.77% -
471.omnetpp -72.78% 10739.000 2923.000 - 0.03% -
470.lbm -70.91% 12819.000 3729.000 - 0.40% -
481.wrf -66.08% 16834.000 5710.000 - 5.56% -
483.xalancbmk -61.74% 11172.000 4274.000 - 6.11% -
473.astar -60.62% 14932.000 5880.000 - 3.34% -
464.h264ref -59.73% 14556.000 5861.000 - 1.37% -
410.bwaves -59.07% 14755.000 6039.000 - 1.12% -
445.gobmk -56.07% 11995.000 5269.000 - 2.05% -
435.gromacs -53.21% 15419.000 7215.000 - 2.35% -
458.sjeng -45.66% 14275.000 7757.000 - 1.39% -
416.gamess -45.12% 22704.000 12461.000 - 0.27% -
437.leslie3d -29.96% 15005.000 10510.000 - 2.34% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.91% 1074.000 1.000 - -50.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (unexplained diff vs previous) -99.14% 700.000 6.000 - 500.00% -
444.namd (max) -98.61% 649.000 9.000 - -10.00% -
470.lbm (max) -97.09% 653.000 19.000 - -9.52% -
471.omnetpp (unexplained diff vs previous) -96.15% 26.000 1.000 - -96.00% -
462.libquantum -96.00% 75.000 3.000 - 0.00% -
462.libquantum (avg) -96.00% 75.000 3.000 - 0.00% -
416.gamess (max) -95.58% 656.000 29.000 - -12.12% -
403.gcc (max) -95.31% 64.000 3.000 - 0.00% -
462.libquantum (max) -94.59% 74.000 4.000 - 100.00% -
433.milc (unexplained diff vs previous) -94.59% 425.000 23.000 - 109.09% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
450.soplex (max) -94.41% 304.000 17.000 - -5.56% -
433.milc (max) -94.40% 411.000 23.000 - 76.92% -
444.namd -93.52% 355.000 23.000 - 0.00% -
444.namd (avg) -93.52% 355.000 23.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -92.98% 570.000 40.000 - 344.44% -
436.cactusADM (max) -92.93% 552.000 39.000 - 333.33% -
482.sphinx3 -92.89% 436.000 31.000 - 6.90% -
482.sphinx3 (avg) -92.89% 436.000 31.000 - 6.90% -
416.gamess (max) (percentage) -91.70% 2.890 0.240 - -11.11% -
482.sphinx3 (max) -91.34% 439.000 38.000 - 52.00% -
481.wrf (max) -91.32% 530.000 46.000 - -2.13% -
447.dealII (max) -90.65% 107.000 10.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -89.94% 308.000 31.000 - 210.00% -
470.lbm (max) (percentage) -89.80% 5.100 0.520 - -10.34% -
434.zeusmp (max) -89.70% 301.000 31.000 - -6.06% -
453.povray (max) -89.70% 165.000 17.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -89.26% 7.730 0.830 - 492.86% -
400.perlbench (max) -88.99% 345.000 38.000 - -2.56% -
471.omnetpp (max) -88.37% 662.000 77.000 - -11.49% -
456.hmmer (max) -87.86% 140.000 17.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -87.50% 0.240 0.030 - -96.51% -
450.soplex -86.91% 191.000 25.000 - 4.17% -
450.soplex (avg) -86.91% 191.000 25.000 - 4.17% -
433.milc -84.09% 220.000 35.000 - 0.00% -
433.milc (avg) -84.09% 220.000 35.000 - 0.00% -
436.cactusADM -82.13% 291.000 52.000 - -1.89% -
436.cactusADM (avg) -82.13% 291.000 52.000 - -1.89% -
444.namd (max) (percentage) -81.62% 7.180 1.320 - -8.33% -
482.sphinx3 (unexplained diff vs previous) -80.11% 186.000 37.000 - 1133.33% -
453.povray -79.01% 81.000 17.000 - 6.25% -
453.povray (avg) -79.01% 81.000 17.000 - 6.25% -
481.wrf (max) (percentage) -73.97% 3.150 0.820 - -6.82% -
470.lbm -70.96% 303.000 88.000 - -1.12% -
470.lbm (avg) -70.96% 303.000 88.000 - -1.12% -
465.tonto (max) (percentage) -66.76% 3.580 1.190 - -2.46% -
434.zeusmp -66.15% 195.000 66.000 - 0.00% -
434.zeusmp (avg) -66.15% 195.000 66.000 - 0.00% -
400.perlbench -62.18% 156.000 59.000 - 0.00% -
400.perlbench (avg) -62.18% 156.000 59.000 - 0.00% -
445.gobmk (max) -57.38% 183.000 78.000 - -7.14% -
471.omnetpp (max) (percentage) -57.05% 6.170 2.650 - -11.07% -
465.tonto (max) -55.29% 293.000 131.000 - 0.77% -
447.dealII -54.81% 104.000 47.000 - 0.00% -
447.dealII (avg) -54.81% 104.000 47.000 - 0.00% -
416.gamess -53.66% 492.000 228.000 - 0.44% -
416.gamess (avg) -53.66% 492.000 228.000 - 0.44% -
447.dealII (max) (percentage) -53.64% 1.100 0.510 - -3.77% -
456.hmmer (max) (percentage) -52.76% 1.270 0.600 - -3.23% -
481.wrf -49.06% 318.000 162.000 - 5.19% -
481.wrf (avg) -49.06% 318.000 162.000 - 5.19% -
434.zeusmp (unexplained diff vs previous) (percentage) -46.78% 2.330 1.240 - 210.00% -
434.zeusmp (max) (percentage) -45.18% 2.280 1.250 - -8.09% -
471.omnetpp -42.35% 170.000 98.000 - -2.00% -
471.omnetpp (avg) -42.35% 170.000 98.000 - -2.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -41.23% 3.250 1.910 - 354.76% -
436.cactusADM (max) (percentage) -40.63% 3.150 1.870 - 334.88% -
433.milc (unexplained diff vs previous) (percentage) -39.63% 3.280 1.980 - 104.12% -
401.bzip2 (unexplained diff vs previous) -39.39% 132.000 80.000 - 7900.00% -
401.bzip2 (max) -38.35% 133.000 82.000 - 67.35% -
454.calculix (max) (percentage) -37.23% 4.700 2.950 - -23.18% -
433.milc (max) (percentage) -36.28% 3.170 2.020 - 74.14% -
456.hmmer -34.67% 75.000 49.000 - 2.08% -
456.hmmer (avg) -34.67% 75.000 49.000 - 2.08% -
483.xalancbmk -32.43% 74.000 50.000 - 6.38% -
483.xalancbmk (avg) -32.43% 74.000 50.000 - 6.38% -
437.leslie3d (unexplained diff vs previous) -30.03% 343.000 240.000 - -28.14% -
400.perlbench (max) (percentage) -26.85% 3.240 2.370 - -2.47% -
435.gromacs (max) -26.05% 311.000 230.000 - -6.50% -
459.GemsFDTD -24.76% 210.000 158.000 - 0.64% -
459.GemsFDTD (avg) -24.76% 210.000 158.000 - 0.64% -
410.bwaves -21.25% 160.000 126.000 - 0.00% -
410.bwaves (avg) -21.25% 160.000 126.000 - 0.00% -
459.GemsFDTD (max) -20.71% 140.000 111.000 - 11.00% -
435.gromacs -19.17% 266.000 215.000 - 2.38% -
435.gromacs (avg) -19.17% 266.000 215.000 - 2.38% -
444.namd (avg) (percentage) -17.05% 3.930 3.260 - -2.10% -
416.gamess (avg) (percentage) -15.67% 2.170 1.830 - 0.00% -
445.gobmk (max) (percentage) -2.61% 1.530 1.490 - -8.59% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1644.000 -
401.bzip2 2956.000 2.78%
403.gcc 61.000 7.02%
410.bwaves 6039.000 1.12%
416.gamess 12461.000 -
429.mcf 1520.000 -18.93%
433.milc 1162.000 2.02%
434.zeusmp 2508.000 1.25%
435.gromacs 7215.000 2.35%
436.cactusADM 2097.000 -1.87%
437.leslie3d 10510.000 2.34%
444.namd 723.000 -
445.gobmk 5269.000 2.05%
447.dealII 1980.000 -
450.soplex 569.000 5.76%
453.povray 559.000 4.88%
454.calculix 63.000 -
456.hmmer 2927.000 1.77%
458.sjeng 7757.000 1.39%
459.GemsFDTD 6140.000 1.82%
462.libquantum 138.000 2.99%
464.h264ref 5861.000 1.37%
465.tonto 11058.000 3.63%
470.lbm 3729.000 -
471.omnetpp 2923.000 -
473.astar 5880.000 3.34%
481.wrf 5710.000 5.56%
482.sphinx3 953.000 4.04%
483.xalancbmk 4274.000 6.11%
Geometric Mean 2150.704 1.44%
Code Size (bytes)
Name Current %
400.perlbench 921772.000 -
401.bzip2 49748.000 -
403.gcc 2678257.000 -
410.bwaves 17732.000 -
416.gamess 6242351.000 -
429.mcf 10951.000 -
433.milc 95822.000 -
434.zeusmp 165643.000 -
435.gromacs 678385.000 -
436.cactusADM 553198.000 -
437.leslie3d 65185.000 -
444.namd 190898.000 -
445.gobmk 1399507.000 -
447.dealII 2122597.000 -
450.soplex 260218.000 -
453.povray 708445.000 -
454.calculix 1272083.000 -
456.hmmer 231108.000 -
458.sjeng 111821.000 -
459.GemsFDTD 253069.000 -
462.libquantum 31329.000 -
464.h264ref 423816.000 -
465.tonto 2869501.000 -
470.lbm 10908.000 -
471.omnetpp 566590.000 -
473.astar 32056.000 -
481.wrf 2639000.000 -
482.sphinx3 152636.000 -
483.xalancbmk 3283028.000 -
Geometric Mean 296778.926 -
sample variability
Name Current %
400.perlbench 59.000 -
400.perlbench (avg) 59.000 -
400.perlbench (avg) (percentage) 3.610 -
400.perlbench (max) 38.000 -2.56%
400.perlbench (max) (percentage) 2.370 -2.47%
401.bzip2 78.000 2.63%
401.bzip2 (avg) 78.000 2.63%
401.bzip2 (avg) (percentage) 2.670 -
401.bzip2 (max) 82.000 67.35%
401.bzip2 (max) (percentage) 2.780 61.63%
401.bzip2 (unexplained diff vs previous) 80.000 7900.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.710 8933.33%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.660 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.470 -
410.bwaves 126.000 -
410.bwaves (avg) 126.000 -
410.bwaves (avg) (percentage) 2.100 -
410.bwaves (max) 67.000 131.03%
410.bwaves (max) (percentage) 1.120 128.57%
410.bwaves (unexplained diff vs previous) 67.000 318.75%
410.bwaves (unexplained diff vs previous) (percentage) 1.110 311.11%
416.gamess 228.000 -
416.gamess (avg) 228.000 -
416.gamess (avg) (percentage) 1.830 -
416.gamess (max) 29.000 -12.12%
416.gamess (max) (percentage) 0.240 -11.11%
429.mcf 118.000 -16.31%
429.mcf (avg) 118.000 -16.31%
429.mcf (avg) (percentage) 7.790 3.59%
429.mcf (max) 287.000 -12.23%
429.mcf (max) (percentage) 18.930 8.30%
429.mcf (unexplained diff vs previous) 355.000 4337.50%
429.mcf (unexplained diff vs previous) (percentage) 23.360 5332.56%
433.milc 35.000 -
433.milc (avg) 35.000 -
433.milc (avg) (percentage) 3.090 -
433.milc (max) 23.000 76.92%
433.milc (max) (percentage) 2.020 74.14%
433.milc (unexplained diff vs previous) 23.000 109.09%
433.milc (unexplained diff vs previous) (percentage) 1.980 104.12%
434.zeusmp 66.000 -
434.zeusmp (avg) 66.000 -
434.zeusmp (avg) (percentage) 2.670 -1.11%
434.zeusmp (max) 31.000 -6.06%
434.zeusmp (max) (percentage) 1.250 -8.09%
434.zeusmp (unexplained diff vs previous) 31.000 210.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.240 210.00%
435.gromacs 215.000 2.38%
435.gromacs (avg) 215.000 2.38%
435.gromacs (avg) (percentage) 2.980 -
435.gromacs (max) 230.000 -6.50%
435.gromacs (max) (percentage) 3.190 -8.60%
436.cactusADM 52.000 -1.89%
436.cactusADM (avg) 52.000 -1.89%
436.cactusADM (avg) (percentage) 2.500 -
436.cactusADM (max) 39.000 333.33%
436.cactusADM (max) (percentage) 1.870 334.88%
436.cactusADM (unexplained diff vs previous) 40.000 344.44%
436.cactusADM (unexplained diff vs previous) (percentage) 1.910 354.76%
437.leslie3d 423.000 -
437.leslie3d (avg) 423.000 -
437.leslie3d (avg) (percentage) 4.030 -1.23%
437.leslie3d (max) 834.000 -4.47%
437.leslie3d (max) (percentage) 7.940 -6.70%
437.leslie3d (unexplained diff vs previous) 240.000 -28.14%
437.leslie3d (unexplained diff vs previous) (percentage) 2.280 -29.85%
444.namd 23.000 -
444.namd (avg) 23.000 -
444.namd (avg) (percentage) 3.260 -2.10%
444.namd (max) 9.000 -10.00%
444.namd (max) (percentage) 1.320 -8.33%
444.namd (unexplained diff vs previous) 6.000 500.00%
444.namd (unexplained diff vs previous) (percentage) 0.830 492.86%
445.gobmk 101.000 2.02%
445.gobmk (avg) 101.000 2.02%
445.gobmk (avg) (percentage) 1.920 -
445.gobmk (max) 78.000 -7.14%
445.gobmk (max) (percentage) 1.490 -8.59%
447.dealII 47.000 -
447.dealII (avg) 47.000 -
447.dealII (avg) (percentage) 2.420 -
447.dealII (max) 10.000 -
447.dealII (max) (percentage) 0.510 -3.77%
450.soplex 25.000 4.17%
450.soplex (avg) 25.000 4.17%
450.soplex (avg) (percentage) 4.510 -
450.soplex (max) 17.000 -5.56%
450.soplex (max) (percentage) 3.060 -8.66%
453.povray 17.000 6.25%
453.povray (avg) 17.000 6.25%
453.povray (avg) (percentage) 3.060 -
453.povray (max) 17.000 -
453.povray (max) (percentage) 3.090 -6.36%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.100 -3.30%
454.calculix (max) 1.000 -50.00%
454.calculix (max) (percentage) 2.950 -23.18%
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 49.000 2.08%
456.hmmer (avg) 49.000 2.08%
456.hmmer (avg) (percentage) 1.700 -
456.hmmer (max) 17.000 -
456.hmmer (max) (percentage) 0.600 -3.23%
458.sjeng 110.000 -
458.sjeng (avg) 110.000 -
458.sjeng (avg) (percentage) 1.430 -
458.sjeng (max) 51.000 -7.27%
458.sjeng (max) (percentage) 0.670 -6.94%
459.GemsFDTD 158.000 -
459.GemsFDTD (avg) 158.000 -
459.GemsFDTD (avg) (percentage) 2.580 -1.15%
459.GemsFDTD (max) 111.000 11.00%
459.GemsFDTD (max) (percentage) 1.820 8.98%
459.GemsFDTD (unexplained diff vs previous) 110.000 307.41%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.790 297.78%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 2.710 -
462.libquantum (max) 4.000 100.00%
462.libquantum (max) (percentage) 2.990 83.44%
462.libquantum (unexplained diff vs previous) 4.000 300.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.900 286.67%
464.h264ref 110.000 1.85%
464.h264ref (avg) 110.000 1.85%
464.h264ref (avg) (percentage) 1.880 -
464.h264ref (max) 65.000 -7.14%
464.h264ref (max) (percentage) 1.120 -8.20%
465.tonto 234.000 3.54%
465.tonto (avg) 234.000 3.54%
465.tonto (avg) (percentage) 2.120 -
465.tonto (max) 131.000 -
465.tonto (max) (percentage) 1.190 -2.46%
470.lbm 88.000 -1.12%
470.lbm (avg) 88.000 -1.12%
470.lbm (avg) (percentage) 2.370 -1.66%
470.lbm (max) 19.000 -9.52%
470.lbm (max) (percentage) 0.520 -10.34%
470.lbm (unexplained diff vs previous) 15.000 66.67%
470.lbm (unexplained diff vs previous) (percentage) 0.400 66.67%
471.omnetpp 98.000 -2.00%
471.omnetpp (avg) 98.000 -2.00%
471.omnetpp (avg) (percentage) 3.370 -2.32%
471.omnetpp (max) 77.000 -11.49%
471.omnetpp (max) (percentage) 2.650 -11.07%
471.omnetpp (unexplained diff vs previous) 1.000 -96.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.030 -96.51%
473.astar 143.000 4.38%
473.astar (avg) 143.000 4.38%
473.astar (avg) (percentage) 2.440 -
473.astar (max) 196.000 14.62%
473.astar (max) (percentage) 3.340 10.96%
473.astar (unexplained diff vs previous) 190.000 578.57%
473.astar (unexplained diff vs previous) (percentage) 3.230 559.18%
481.wrf 162.000 5.19%
481.wrf (avg) 162.000 5.19%
481.wrf (avg) (percentage) 2.850 -
481.wrf (max) 46.000 -2.13%
481.wrf (max) (percentage) 0.820 -6.82%
482.sphinx3 31.000 6.90%
482.sphinx3 (avg) 31.000 6.90%
482.sphinx3 (avg) (percentage) 3.260 -
482.sphinx3 (max) 38.000 52.00%
482.sphinx3 (max) (percentage) 4.040 45.32%
482.sphinx3 (unexplained diff vs previous) 37.000 1133.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.880 1075.76%
483.xalancbmk 50.000 6.38%
483.xalancbmk (avg) 50.000 6.38%
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) 263.000 5.62%
483.xalancbmk (max) (percentage) 6.170 -
Geometric Mean 11.487 12.94%