Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e0446214a07dd4e6709c63d1eb3d764181264246 (+ 37 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/879cf9ff45d94065d89e24b71c6b27c7076ac518 (+ 133 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d1dcb565a1fb5829f9476a1438c30eccc4027d04 (+ 10 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/140/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0140 (3-changed-components) 2023-11-07T12:26:33 0:00:00
Previous 0139 (3-changed-components) 2023-11-04T20:51:09 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 14 70
Performance Improvements 112 140
Added Tests 8 6
Unchanged Tests 1102 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 2.14% 2995.000 3059.000 - -71.52% -
450.soplex 1.70% 589.000 599.000 - -96.13% -
400.perlbench 1.42% 1551.000 1573.000 - -85.23% -
481.wrf 1.05% 5534.000 5592.000 - -66.78% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) (percentage) 620.00% 0.200 1.440 - 7100.00% -
453.povray (unexplained diff vs previous) 600.00% 1.000 7.000 - 600.00% -
453.povray (max) (percentage) 73.17% 0.820 1.420 - -43.87% -
481.wrf (max) 52.63% 38.000 58.000 - -89.06% -
481.wrf (max) (percentage) 50.00% 0.700 1.050 - -66.67% -
453.povray (max) 50.00% 4.000 6.000 - -96.36% -
400.perlbench (unexplained diff vs previous) 46.67% 15.000 22.000 - -93.84% -
400.perlbench (unexplained diff vs previous) (percentage) 44.33% 0.970 1.400 - -58.21% -
471.omnetpp 2.63% 76.000 78.000 - -54.12% -
471.omnetpp (avg) 2.63% 76.000 78.000 - -54.12% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -4.92% 61.000 58.000 - -99.36% -
437.leslie3d -4.75% 11764.000 11205.000 - -25.32% -
435.gromacs -2.40% 7295.000 7120.000 - -53.82% -
453.povray -1.42% 493.000 486.000 - -92.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) (percentage) -96.01% 22.800 0.910 - 68.52% -
429.mcf (unexplained diff vs previous) -95.98% 348.000 14.000 - -84.95% -
410.bwaves (unexplained diff vs previous) -93.68% 95.000 6.000 - -60.00% -
410.bwaves (unexplained diff vs previous) (percentage) -93.63% 1.570 0.100 - 0.00% -
470.lbm (unexplained diff vs previous) -90.70% 43.000 4.000 - -71.43% -
470.lbm (unexplained diff vs previous) (percentage) -90.43% 1.150 0.110 - 0.00% -
473.astar (unexplained diff vs previous) -88.02% 217.000 26.000 - 766.67% -
473.astar (unexplained diff vs previous) (percentage) -88.01% 3.670 0.440 - 2100.00% -
458.sjeng (unexplained diff vs previous) (percentage) -83.74% 1.230 0.200 - 233.33% -
458.sjeng (unexplained diff vs previous) -83.33% 96.000 16.000 - 77.78% -
401.bzip2 (unexplained diff vs previous) (percentage) -81.52% 2.760 0.510 - -41.38% -
401.bzip2 (unexplained diff vs previous) -81.48% 81.000 15.000 - -88.64% -
450.soplex (unexplained diff vs previous) (percentage) -76.01% 6.960 1.670 - -16.92% -
450.soplex (unexplained diff vs previous) -75.61% 41.000 10.000 - -96.78% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -74.58% 2.400 0.610 - 190.48% -
459.GemsFDTD (unexplained diff vs previous) -74.32% 148.000 38.000 - -20.83% -
436.cactusADM (unexplained diff vs previous) -72.22% 18.000 5.000 - -99.12% -
436.cactusADM (unexplained diff vs previous) (percentage) -71.76% 0.850 0.240 - -92.62% -
433.milc (unexplained diff vs previous) (percentage) -70.87% 2.060 0.600 - -81.71% -
433.milc (unexplained diff vs previous) -70.83% 24.000 7.000 - -98.35% -
456.hmmer (unexplained diff vs previous) (percentage) -52.78% 0.720 0.340 - -54.67% -
456.hmmer (unexplained diff vs previous) -52.38% 21.000 10.000 - -87.95% -
437.leslie3d (unexplained diff vs previous) -47.51% 1065.000 559.000 - 62.97% -
437.leslie3d (unexplained diff vs previous) (percentage) -44.86% 9.050 4.990 - 117.90% -
437.leslie3d (max) -39.10% 1371.000 835.000 - 137.89% -
437.leslie3d (max) (percentage) -36.02% 11.660 7.460 - 218.80% -
445.gobmk (unexplained diff vs previous) (percentage) -33.33% 1.470 0.980 - -36.77% -
445.gobmk (unexplained diff vs previous) -32.47% 77.000 52.000 - -72.04% -
458.sjeng (max) -25.77% 97.000 72.000 - 132.26% -
470.lbm (max) -25.58% 43.000 32.000 - -95.10% -
462.libquantum (max) -25.00% 4.000 3.000 - -95.95% -
458.sjeng (max) (percentage) -25.00% 1.240 0.930 - 322.73% -
470.lbm (max) (percentage) -25.00% 1.160 0.870 - -82.94% -
429.mcf (max) (percentage) -24.99% 18.570 13.930 - 2479.63% -
473.astar (max) (percentage) -24.93% 3.810 2.860 - 1942.86% -
473.astar (max) -24.89% 225.000 169.000 - 745.00% -
445.gobmk (max) (percentage) -24.83% 1.490 1.120 - -26.80% -
471.omnetpp (unexplained diff vs previous) (percentage) -24.55% 2.770 2.090 - 770.83% -
429.mcf (max) -24.38% 283.000 214.000 - 132.61% -
445.gobmk (max) -24.36% 78.000 59.000 - -67.76% -
471.omnetpp (unexplained diff vs previous) -22.89% 83.000 64.000 - 146.15% -
401.bzip2 (max) -16.87% 83.000 69.000 - -48.12% -
471.omnetpp (max) (percentage) -16.84% 2.850 2.370 - -61.59% -
482.sphinx3 (max) (percentage) -16.75% 3.880 3.230 - 119.73% -
462.libquantum (max) (percentage) -16.72% 2.990 2.490 - 289.06% -
459.GemsFDTD (max) (percentage) -16.67% 2.460 2.050 - 241.67% -
433.milc (max) (percentage) -16.67% 2.100 1.750 - -44.79% -
433.milc (max) -16.67% 24.000 20.000 - -95.13% -
482.sphinx3 (max) -16.67% 36.000 30.000 - -93.17% -
401.bzip2 (max) (percentage) -16.55% 2.840 2.370 - 169.32% -
459.GemsFDTD (max) -15.89% 151.000 127.000 - -9.29% -
471.omnetpp (max) -15.29% 85.000 72.000 - -89.12% -
450.soplex (max) (percentage) -12.57% 7.480 6.540 - 231.98% -
410.bwaves (max) (percentage) -12.50% 1.600 1.400 - 566.67% -
410.bwaves (max) -12.50% 96.000 84.000 - 180.00% -
450.soplex (max) -11.36% 44.000 39.000 - -87.17% -
456.hmmer (max) -9.52% 21.000 19.000 - -86.43% -
453.povray -9.09% 11.000 10.000 - -87.65% -
453.povray (avg) -9.09% 11.000 10.000 - -87.65% -
434.zeusmp (max) -7.69% 52.000 48.000 - -84.05% -
436.cactusADM (max) (percentage) -7.14% 0.840 0.780 - -75.24% -
435.gromacs (max) -6.67% 90.000 84.000 - -72.99% -
434.zeusmp (max) (percentage) -6.44% 2.020 1.890 - -17.11% -
465.tonto (max) -5.92% 355.000 334.000 - 13.99% -
436.cactusADM (max) -5.88% 17.000 16.000 - -97.10% -
447.dealII (max) -5.88% 34.000 32.000 - -70.09% -
465.tonto (max) (percentage) -5.63% 3.200 3.020 - -15.64% -
456.hmmer (max) (percentage) -5.56% 0.720 0.680 - -46.46% -
416.gamess (max) -5.45% 55.000 52.000 - -92.07% -
444.namd (max) (percentage) -5.33% 0.750 0.710 - -90.11% -
447.dealII (max) (percentage) -5.20% 1.730 1.640 - 49.09% -
435.gromacs (max) (percentage) -4.84% 1.240 1.180 - -41.58% -
437.leslie3d -4.65% 559.000 533.000 - 49.30% -
437.leslie3d (avg) -4.65% 559.000 533.000 - 49.30% -
416.gamess (max) (percentage) -4.55% 0.440 0.420 - -85.47% -
456.hmmer -3.12% 32.000 31.000 - -58.67% -
456.hmmer (avg) -3.12% 32.000 31.000 - -58.67% -
454.calculix (max) (percentage) -2.84% 5.640 5.480 - 16.60% -
454.calculix (avg) (percentage) -2.75% 3.640 3.540 - 76.12% -
435.gromacs -2.56% 156.000 152.000 - -42.86% -
435.gromacs (avg) -2.56% 156.000 152.000 - -42.86% -
410.bwaves -2.35% 85.000 83.000 - -48.12% -
410.bwaves (avg) -2.35% 85.000 83.000 - -48.12% -
464.h264ref (max) (percentage) -2.20% 0.910 0.890 - 106.98% -
410.bwaves (avg) (percentage) -2.13% 1.410 1.380 - 26.61% -
403.gcc (max) (percentage) -2.13% 8.930 8.740 - 1113.89% -
400.perlbench (max) (percentage) -2.08% 1.920 1.880 - -41.98% -
482.sphinx3 (avg) (percentage) -2.06% 2.430 2.380 - 63.01% -
470.lbm (avg) (percentage) -1.90% 1.580 1.550 - -34.60% -
464.h264ref (max) -1.89% 53.000 52.000 - -16.13% -
456.hmmer (avg) (percentage) -1.80% 1.110 1.090 - 60.29% -
401.bzip2 -1.79% 56.000 55.000 - -16.67% -
401.bzip2 (avg) -1.79% 56.000 55.000 - -16.67% -
470.lbm -1.69% 59.000 58.000 - -80.86% -
470.lbm (avg) -1.69% 59.000 58.000 - -80.86% -
429.mcf (avg) (percentage) -1.57% 5.720 5.630 - 962.26% -
401.bzip2 (avg) (percentage) -1.57% 1.910 1.880 - 327.27% -
481.wrf (avg) (percentage) -1.54% 1.950 1.920 - 1.59% -
462.libquantum (avg) (percentage) -1.52% 1.970 1.940 - 198.46% -
400.perlbench (avg) (percentage) -1.49% 2.690 2.650 - 80.27% -
458.sjeng -1.37% 73.000 72.000 - 53.19% -
458.sjeng (avg) -1.37% 73.000 72.000 - 53.19% -
436.cactusADM (avg) (percentage) -1.23% 1.630 1.610 - -3.01% -
459.GemsFDTD (avg) (percentage) -1.15% 1.740 1.720 - 91.11% -
429.mcf -1.15% 87.000 86.000 - -4.44% -
429.mcf (avg) -1.15% 87.000 86.000 - -4.44% -
473.astar (avg) (percentage) -1.12% 1.780 1.760 - 826.32% -
433.milc (avg) (percentage) -1.02% 1.970 1.950 - 14.71% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
400.perlbench 1.16% 930652.000 941436.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 35.08% 8205.000 11083.000 - -0.17% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
453.povray (unexplained diff vs previous) (percentage) 7100.00% 0.020 1.440 - 620.00% -
429.mcf (max) (percentage) 2479.63% 0.540 13.930 - -24.99% -
473.astar (unexplained diff vs previous) (percentage) 2100.00% 0.020 0.440 - -88.01% -
473.astar (max) (percentage) 1942.86% 0.140 2.860 - -24.93% -
483.xalancbmk (max) (percentage) 1329.27% 0.410 5.860 - -0.17% -
403.gcc (max) (percentage) 1113.89% 0.720 8.740 - -2.13% -
429.mcf (avg) (percentage) 962.26% 0.530 5.630 - -1.57% -
403.gcc (avg) (percentage) 868.85% 0.610 5.910 - 0.00% -
473.astar (avg) (percentage) 826.32% 0.190 1.760 - -1.12% -
471.omnetpp (unexplained diff vs previous) (percentage) 770.83% 0.240 2.090 - -24.55% -
473.astar (unexplained diff vs previous) 766.67% 3.000 26.000 - -88.02% -
473.astar (max) 745.00% 20.000 169.000 - -24.89% -
453.povray (unexplained diff vs previous) 600.00% 1.000 7.000 - 600.00% -
410.bwaves (max) (percentage) 566.67% 0.210 1.400 - -12.50% -
401.bzip2 (avg) (percentage) 327.27% 0.440 1.880 - -1.57% -
458.sjeng (max) (percentage) 322.73% 0.220 0.930 - -25.00% -
462.libquantum (max) (percentage) 289.06% 0.640 2.490 - -16.72% -
473.astar 271.43% 28.000 104.000 - -0.95% -
473.astar (avg) 271.43% 28.000 104.000 - -0.95% -
459.GemsFDTD (max) (percentage) 241.67% 0.600 2.050 - -16.67% -
458.sjeng (unexplained diff vs previous) (percentage) 233.33% 0.060 0.200 - -83.74% -
450.soplex (max) (percentage) 231.98% 1.970 6.540 - -12.57% -
437.leslie3d (max) (percentage) 218.80% 2.340 7.460 - -36.02% -
462.libquantum (avg) (percentage) 198.46% 0.650 1.940 - -1.52% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 190.48% 0.210 0.610 - -74.58% -
458.sjeng (avg) (percentage) 181.82% 0.330 0.930 - -1.06% -
410.bwaves (max) 180.00% 30.000 84.000 - -12.50% -
401.bzip2 (max) (percentage) 169.32% 0.880 2.370 - -16.55% -
450.soplex (avg) (percentage) 163.71% 1.240 3.270 - -0.91% -
471.omnetpp (unexplained diff vs previous) 146.15% 26.000 64.000 - -22.89% -
437.leslie3d (max) 137.89% 351.000 835.000 - -39.10% -
429.mcf (max) 132.61% 92.000 214.000 - -24.38% -
458.sjeng (max) 132.26% 31.000 72.000 - -25.77% -
464.h264ref (avg) (percentage) 122.22% 0.540 1.200 - 0.00% -
482.sphinx3 (max) (percentage) 119.73% 1.470 3.230 - -16.75% -
437.leslie3d (unexplained diff vs previous) (percentage) 117.90% 2.290 4.990 - -44.86% -
464.h264ref (max) (percentage) 106.98% 0.430 0.890 - -2.20% -
437.leslie3d (avg) (percentage) 100.00% 2.380 4.760 - 0.00% -
459.GemsFDTD (avg) (percentage) 91.11% 0.900 1.720 - -1.15% -
400.perlbench (avg) (percentage) 80.27% 1.470 2.650 - -1.49% -
458.sjeng (unexplained diff vs previous) 77.78% 9.000 16.000 - -83.33% -
453.povray (avg) (percentage) 77.60% 1.250 2.220 - -0.89% -
445.gobmk (avg) (percentage) 76.62% 0.770 1.360 - -0.73% -
454.calculix (avg) (percentage) 76.12% 2.010 3.540 - -2.75% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 68.52% 0.540 0.910 - -96.01% -
447.dealII (avg) (percentage) 66.36% 1.070 1.780 - 0.00% -
482.sphinx3 (avg) (percentage) 63.01% 1.460 2.380 - -2.06% -
437.leslie3d (unexplained diff vs previous) 62.97% 343.000 559.000 - -47.51% -
471.omnetpp (avg) (percentage) 61.01% 1.590 2.560 - 0.00% -
456.hmmer (avg) (percentage) 60.29% 0.680 1.090 - -1.80% -
481.wrf (unexplained diff vs previous) (percentage) 55.22% 0.670 1.040 - 0.00% -
458.sjeng 53.19% 47.000 72.000 - -1.37% -
458.sjeng (avg) 53.19% 47.000 72.000 - -1.37% -
437.leslie3d 49.30% 357.000 533.000 - -4.65% -
437.leslie3d (avg) 49.30% 357.000 533.000 - -4.65% -
447.dealII (max) (percentage) 49.09% 1.100 1.640 - -5.20% -
410.bwaves (avg) (percentage) 26.61% 1.090 1.380 - -2.13% -
435.gromacs (avg) (percentage) 23.70% 1.730 2.140 - 0.00% -
434.zeusmp (avg) (percentage) 22.30% 1.480 1.810 - 0.00% -
454.calculix (max) (percentage) 16.60% 4.700 5.480 - -2.84% -
465.tonto 16.06% 137.000 159.000 - 0.00% -
465.tonto (avg) 16.06% 137.000 159.000 - 0.00% -
433.milc (avg) (percentage) 14.71% 1.700 1.950 - -1.02% -
465.tonto (max) 13.99% 293.000 334.000 - -5.92% -
481.wrf (avg) (percentage) 1.59% 1.890 1.920 - -1.54% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.57% 120221.000 115929.000 - 0.00% -
464.h264ref -2.37% 428364.000 418228.000 - 0.00% -
434.zeusmp -1.61% 165699.000 163037.000 - 0.04% -
459.GemsFDTD -1.57% 253716.000 249721.000 - 0.00% -
410.bwaves -1.34% 17880.000 17640.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.73% 22860.000 62.000 - 0.00% -
403.gcc -99.36% 9010.000 58.000 - -4.92% -
462.libquantum -98.81% 11614.000 138.000 - 0.00% -
482.sphinx3 -96.87% 29928.000 938.000 - 0.00% -
450.soplex -96.13% 15466.000 599.000 - 1.70% -
453.povray -92.57% 6544.000 486.000 - -1.42% -
444.namd -92.01% 9050.000 723.000 - -0.41% -
429.mcf -91.02% 17158.000 1540.000 - 0.92% -
433.milc -90.96% 12976.000 1173.000 - 0.60% -
436.cactusADM -87.88% 17544.000 2127.000 - 0.24% -
400.perlbench -85.23% 10650.000 1573.000 - 1.42% -
401.bzip2 -80.57% 15185.000 2951.000 - 0.51% -
434.zeusmp -80.55% 13211.000 2569.000 - -0.35% -
447.dealII -79.49% 9751.000 2000.000 - 0.10% -
456.hmmer -73.59% 11046.000 2917.000 - -0.34% -
459.GemsFDTD -73.47% 23356.000 6197.000 - 0.62% -
471.omnetpp -71.52% 10739.000 3059.000 - 2.14% -
470.lbm -70.71% 12819.000 3755.000 - 0.11% -
481.wrf -66.78% 16834.000 5592.000 - 1.05% -
473.astar -60.24% 14932.000 5937.000 - 0.44% -
464.h264ref -59.64% 14556.000 5875.000 - 0.50% -
410.bwaves -59.06% 14755.000 6041.000 - 0.10% -
445.gobmk -55.88% 11995.000 5292.000 - 0.99% -
435.gromacs -53.82% 15419.000 7120.000 - -2.40% -
458.sjeng -45.26% 14275.000 7814.000 - -0.20% -
416.gamess -44.64% 22704.000 12568.000 - -0.02% -
437.leslie3d -25.32% 15005.000 11205.000 - -4.75% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (max) -99.72% 1074.000 3.000 - 0.00% -
454.calculix -99.56% 459.000 2.000 - 0.00% -
454.calculix (avg) -99.56% 459.000 2.000 - 0.00% -
444.namd (max) -99.23% 649.000 5.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.12% 570.000 5.000 - -72.22% -
433.milc (unexplained diff vs previous) -98.35% 425.000 7.000 - -70.83% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
436.cactusADM (max) -97.10% 552.000 16.000 - -5.88% -
450.soplex (unexplained diff vs previous) -96.78% 311.000 10.000 - -75.61% -
453.povray (max) -96.36% 165.000 6.000 - 50.00% -
462.libquantum (max) -95.95% 74.000 3.000 - -25.00% -
444.namd -95.49% 355.000 16.000 - 0.00% -
444.namd (avg) -95.49% 355.000 16.000 - 0.00% -
433.milc (max) -95.13% 411.000 20.000 - -16.67% -
470.lbm (max) -95.10% 653.000 32.000 - -25.58% -
482.sphinx3 -94.95% 436.000 22.000 - 0.00% -
482.sphinx3 (avg) -94.95% 436.000 22.000 - 0.00% -
403.gcc -94.44% 54.000 3.000 - 0.00% -
403.gcc (avg) -94.44% 54.000 3.000 - 0.00% -
400.perlbench (unexplained diff vs previous) -93.84% 357.000 22.000 - 46.67% -
482.sphinx3 (max) -93.17% 439.000 30.000 - -16.67% -
436.cactusADM (unexplained diff vs previous) (percentage) -92.62% 3.250 0.240 - -71.76% -
403.gcc (max) -92.19% 64.000 5.000 - 0.00% -
416.gamess (max) -92.07% 656.000 52.000 - -5.45% -
400.perlbench (max) -91.59% 345.000 29.000 - 0.00% -
444.namd (max) (percentage) -90.11% 7.180 0.710 - -5.33% -
450.soplex -90.05% 191.000 19.000 - 0.00% -
450.soplex (avg) -90.05% 191.000 19.000 - 0.00% -
433.milc -90.00% 220.000 22.000 - 0.00% -
433.milc (avg) -90.00% 220.000 22.000 - 0.00% -
471.omnetpp (max) -89.12% 662.000 72.000 - -15.29% -
481.wrf (max) -89.06% 530.000 58.000 - 52.63% -
401.bzip2 (unexplained diff vs previous) -88.64% 132.000 15.000 - -81.48% -
436.cactusADM -88.32% 291.000 34.000 - 0.00% -
436.cactusADM (avg) -88.32% 291.000 34.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -87.95% 83.000 10.000 - -52.38% -
453.povray -87.65% 81.000 10.000 - -9.09% -
453.povray (avg) -87.65% 81.000 10.000 - -9.09% -
450.soplex (max) -87.17% 304.000 39.000 - -11.36% -
456.hmmer (max) -86.43% 140.000 19.000 - -9.52% -
416.gamess (max) (percentage) -85.47% 2.890 0.420 - -4.55% -
429.mcf (unexplained diff vs previous) -84.95% 93.000 14.000 - -95.98% -
434.zeusmp (max) -84.05% 301.000 48.000 - -7.69% -
470.lbm (max) (percentage) -82.94% 5.100 0.870 - -25.00% -
433.milc (unexplained diff vs previous) (percentage) -81.71% 3.280 0.600 - -70.87% -
470.lbm -80.86% 303.000 58.000 - -1.69% -
470.lbm (avg) -80.86% 303.000 58.000 - -1.69% -
434.zeusmp -76.41% 195.000 46.000 - 0.00% -
434.zeusmp (avg) -76.41% 195.000 46.000 - 0.00% -
436.cactusADM (max) (percentage) -75.24% 3.150 0.780 - -7.14% -
400.perlbench -73.72% 156.000 41.000 - 0.00% -
400.perlbench (avg) -73.72% 156.000 41.000 - 0.00% -
435.gromacs (max) -72.99% 311.000 84.000 - -6.67% -
445.gobmk (unexplained diff vs previous) -72.04% 186.000 52.000 - -32.47% -
416.gamess -71.75% 492.000 139.000 - 0.00% -
416.gamess (avg) -71.75% 492.000 139.000 - 0.00% -
470.lbm (unexplained diff vs previous) -71.43% 14.000 4.000 - -90.70% -
447.dealII (max) -70.09% 107.000 32.000 - -5.88% -
445.gobmk (max) -67.76% 183.000 59.000 - -24.36% -
481.wrf (max) (percentage) -66.67% 3.150 1.050 - 50.00% -
481.wrf -66.35% 318.000 107.000 - 0.00% -
481.wrf (avg) -66.35% 318.000 107.000 - 0.00% -
447.dealII -66.35% 104.000 35.000 - 0.00% -
447.dealII (avg) -66.35% 104.000 35.000 - 0.00% -
471.omnetpp (max) (percentage) -61.59% 6.170 2.370 - -16.84% -
410.bwaves (unexplained diff vs previous) -60.00% 15.000 6.000 - -93.68% -
456.hmmer -58.67% 75.000 31.000 - -3.12% -
456.hmmer (avg) -58.67% 75.000 31.000 - -3.12% -
400.perlbench (unexplained diff vs previous) (percentage) -58.21% 3.350 1.400 - 44.33% -
456.hmmer (unexplained diff vs previous) (percentage) -54.67% 0.750 0.340 - -52.78% -
471.omnetpp -54.12% 170.000 78.000 - 2.63% -
471.omnetpp (avg) -54.12% 170.000 78.000 - 2.63% -
459.GemsFDTD -49.52% 210.000 106.000 - -0.93% -
459.GemsFDTD (avg) -49.52% 210.000 106.000 - -0.93% -
416.gamess (avg) (percentage) -48.85% 2.170 1.110 - 0.00% -
481.wrf (unexplained diff vs previous) -48.21% 112.000 58.000 - 0.00% -
410.bwaves -48.12% 160.000 83.000 - -2.35% -
410.bwaves (avg) -48.12% 160.000 83.000 - -2.35% -
401.bzip2 (max) -48.12% 133.000 69.000 - -16.87% -
456.hmmer (max) (percentage) -46.46% 1.270 0.680 - -5.56% -
433.milc (max) (percentage) -44.79% 3.170 1.750 - -16.67% -
453.povray (max) (percentage) -43.87% 2.530 1.420 - 73.17% -
444.namd (avg) (percentage) -43.51% 3.930 2.220 - 0.00% -
435.gromacs -42.86% 266.000 152.000 - -2.56% -
435.gromacs (avg) -42.86% 266.000 152.000 - -2.56% -
400.perlbench (max) (percentage) -41.98% 3.240 1.880 - -2.08% -
435.gromacs (max) (percentage) -41.58% 2.020 1.180 - -4.84% -
401.bzip2 (unexplained diff vs previous) (percentage) -41.38% 0.870 0.510 - -81.52% -
445.gobmk (unexplained diff vs previous) (percentage) -36.77% 1.550 0.980 - -33.33% -
470.lbm (avg) (percentage) -34.60% 2.370 1.550 - -1.90% -
445.gobmk (max) (percentage) -26.80% 1.530 1.120 - -24.83% -
445.gobmk -22.83% 92.000 71.000 - 0.00% -
445.gobmk (avg) -22.83% 92.000 71.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) -20.83% 48.000 38.000 - -74.32% -
434.zeusmp (max) (percentage) -17.11% 2.280 1.890 - -6.44% -
450.soplex (unexplained diff vs previous) (percentage) -16.92% 2.010 1.670 - -76.01% -
401.bzip2 -16.67% 66.000 55.000 - -1.79% -
401.bzip2 (avg) -16.67% 66.000 55.000 - -1.79% -
464.h264ref (max) -16.13% 62.000 52.000 - -1.89% -
465.tonto (max) (percentage) -15.64% 3.580 3.020 - -5.63% -
465.tonto (avg) (percentage) -13.77% 1.670 1.440 - 0.00% -
464.h264ref -10.26% 78.000 70.000 - 0.00% -
464.h264ref (avg) -10.26% 78.000 70.000 - 0.00% -
459.GemsFDTD (max) -9.29% 140.000 127.000 - -15.89% -
429.mcf -4.44% 90.000 86.000 - -1.15% -
429.mcf (avg) -4.44% 90.000 86.000 - -1.15% -
436.cactusADM (avg) (percentage) -3.01% 1.660 1.610 - -1.23% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1573.000 1.42%
401.bzip2 2951.000 -
403.gcc 58.000 -4.92%
410.bwaves 6041.000 -
416.gamess 12568.000 -
429.mcf 1540.000 -
433.milc 1173.000 -
434.zeusmp 2569.000 -
435.gromacs 7120.000 -2.40%
436.cactusADM 2127.000 -
437.leslie3d 11205.000 -4.75%
444.namd 723.000 -
445.gobmk 5292.000 -
447.dealII 2000.000 -
450.soplex 599.000 1.70%
453.povray 486.000 -1.42%
454.calculix 62.000 -
456.hmmer 2917.000 -
458.sjeng 7814.000 -
459.GemsFDTD 6197.000 -
462.libquantum 138.000 -
464.h264ref 5875.000 -
465.tonto 11083.000 -
470.lbm 3755.000 -
471.omnetpp 3059.000 2.14%
473.astar 5937.000 -
481.wrf 5592.000 1.05%
482.sphinx3 938.000 -
Geometric Mean 2096.878 -
Code Size (bytes)
Name Current %
400.perlbench 941436.000 -
401.bzip2 49698.000 -
403.gcc 2671145.000 -
410.bwaves 17640.000 -
416.gamess 6229331.000 -
429.mcf 10979.000 -
433.milc 95589.000 -
434.zeusmp 163037.000 -
435.gromacs 677981.000 -
436.cactusADM 551244.000 -
437.leslie3d 64764.000 -
444.namd 190746.000 -
445.gobmk 1399537.000 -
447.dealII 2123042.000 -
450.soplex 259980.000 -
453.povray 702162.000 -
454.calculix 1268827.000 -
456.hmmer 230496.000 -
458.sjeng 115929.000 -
459.GemsFDTD 249721.000 -
462.libquantum 31321.000 -
464.h264ref 418228.000 -
465.tonto 2868529.000 -
470.lbm 10916.000 -
471.omnetpp 566294.000 -
473.astar 32056.000 -
481.wrf 2617288.000 -
482.sphinx3 152548.000 -
Geometric Mean 272059.489 -
sample variability
Name Current %
400.perlbench 41.000 -
400.perlbench (avg) 41.000 -
400.perlbench (avg) (percentage) 2.650 -1.49%
400.perlbench (max) 29.000 -
400.perlbench (max) (percentage) 1.880 -2.08%
400.perlbench (unexplained diff vs previous) 22.000 46.67%
400.perlbench (unexplained diff vs previous) (percentage) 1.400 44.33%
401.bzip2 55.000 -1.79%
401.bzip2 (avg) 55.000 -1.79%
401.bzip2 (avg) (percentage) 1.880 -1.57%
401.bzip2 (max) 69.000 -16.87%
401.bzip2 (max) (percentage) 2.370 -16.55%
401.bzip2 (unexplained diff vs previous) 15.000 -81.48%
401.bzip2 (unexplained diff vs previous) (percentage) 0.510 -81.52%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 5.910 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 8.740 -2.13%
410.bwaves 83.000 -2.35%
410.bwaves (avg) 83.000 -2.35%
410.bwaves (avg) (percentage) 1.380 -2.13%
410.bwaves (max) 84.000 -12.50%
410.bwaves (max) (percentage) 1.400 -12.50%
410.bwaves (unexplained diff vs previous) 6.000 -93.68%
410.bwaves (unexplained diff vs previous) (percentage) 0.100 -93.63%
416.gamess 139.000 -
416.gamess (avg) 139.000 -
416.gamess (avg) (percentage) 1.110 -
416.gamess (max) 52.000 -5.45%
416.gamess (max) (percentage) 0.420 -4.55%
429.mcf 86.000 -1.15%
429.mcf (avg) 86.000 -1.15%
429.mcf (avg) (percentage) 5.630 -1.57%
429.mcf (max) 214.000 -24.38%
429.mcf (max) (percentage) 13.930 -24.99%
429.mcf (unexplained diff vs previous) 14.000 -95.98%
429.mcf (unexplained diff vs previous) (percentage) 0.910 -96.01%
433.milc 22.000 -
433.milc (avg) 22.000 -
433.milc (avg) (percentage) 1.950 -1.02%
433.milc (max) 20.000 -16.67%
433.milc (max) (percentage) 1.750 -16.67%
433.milc (unexplained diff vs previous) 7.000 -70.83%
433.milc (unexplained diff vs previous) (percentage) 0.600 -70.87%
434.zeusmp 46.000 -
434.zeusmp (avg) 46.000 -
434.zeusmp (avg) (percentage) 1.810 -
434.zeusmp (max) 48.000 -7.69%
434.zeusmp (max) (percentage) 1.890 -6.44%
435.gromacs 152.000 -2.56%
435.gromacs (avg) 152.000 -2.56%
435.gromacs (avg) (percentage) 2.140 -
435.gromacs (max) 84.000 -6.67%
435.gromacs (max) (percentage) 1.180 -4.84%
436.cactusADM 34.000 -
436.cactusADM (avg) 34.000 -
436.cactusADM (avg) (percentage) 1.610 -1.23%
436.cactusADM (max) 16.000 -5.88%
436.cactusADM (max) (percentage) 0.780 -7.14%
436.cactusADM (unexplained diff vs previous) 5.000 -72.22%
436.cactusADM (unexplained diff vs previous) (percentage) 0.240 -71.76%
437.leslie3d 533.000 -4.65%
437.leslie3d (avg) 533.000 -4.65%
437.leslie3d (avg) (percentage) 4.760 -
437.leslie3d (max) 835.000 -39.10%
437.leslie3d (max) (percentage) 7.460 -36.02%
437.leslie3d (unexplained diff vs previous) 559.000 -47.51%
437.leslie3d (unexplained diff vs previous) (percentage) 4.990 -44.86%
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 2.220 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.710 -5.33%
445.gobmk 71.000 -
445.gobmk (avg) 71.000 -
445.gobmk (avg) (percentage) 1.360 -
445.gobmk (max) 59.000 -24.36%
445.gobmk (max) (percentage) 1.120 -24.83%
445.gobmk (unexplained diff vs previous) 52.000 -32.47%
445.gobmk (unexplained diff vs previous) (percentage) 0.980 -33.33%
447.dealII 35.000 -
447.dealII (avg) 35.000 -
447.dealII (avg) (percentage) 1.780 -
447.dealII (max) 32.000 -5.88%
447.dealII (max) (percentage) 1.640 -5.20%
450.soplex 19.000 -
450.soplex (avg) 19.000 -
450.soplex (avg) (percentage) 3.270 -
450.soplex (max) 39.000 -11.36%
450.soplex (max) (percentage) 6.540 -12.57%
450.soplex (unexplained diff vs previous) 10.000 -75.61%
450.soplex (unexplained diff vs previous) (percentage) 1.670 -76.01%
453.povray 10.000 -9.09%
453.povray (avg) 10.000 -9.09%
453.povray (avg) (percentage) 2.220 -
453.povray (max) 6.000 50.00%
453.povray (max) (percentage) 1.420 73.17%
453.povray (unexplained diff vs previous) 7.000 600.00%
453.povray (unexplained diff vs previous) (percentage) 1.440 620.00%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.540 -2.75%
454.calculix (max) 3.000 -
454.calculix (max) (percentage) 5.480 -2.84%
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 31.000 -3.12%
456.hmmer (avg) 31.000 -3.12%
456.hmmer (avg) (percentage) 1.090 -1.80%
456.hmmer (max) 19.000 -9.52%
456.hmmer (max) (percentage) 0.680 -5.56%
456.hmmer (unexplained diff vs previous) 10.000 -52.38%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 -52.78%
458.sjeng 72.000 -1.37%
458.sjeng (avg) 72.000 -1.37%
458.sjeng (avg) (percentage) 0.930 -
458.sjeng (max) 72.000 -25.77%
458.sjeng (max) (percentage) 0.930 -25.00%
458.sjeng (unexplained diff vs previous) 16.000 -83.33%
458.sjeng (unexplained diff vs previous) (percentage) 0.200 -83.74%
459.GemsFDTD 106.000 -
459.GemsFDTD (avg) 106.000 -
459.GemsFDTD (avg) (percentage) 1.720 -1.15%
459.GemsFDTD (max) 127.000 -15.89%
459.GemsFDTD (max) (percentage) 2.050 -16.67%
459.GemsFDTD (unexplained diff vs previous) 38.000 -74.32%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.610 -74.58%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.940 -1.52%
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 2.490 -16.72%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 70.000 -
464.h264ref (avg) 70.000 -
464.h264ref (avg) (percentage) 1.200 -
464.h264ref (max) 52.000 -1.89%
464.h264ref (max) (percentage) 0.890 -2.20%
465.tonto 159.000 -
465.tonto (avg) 159.000 -
465.tonto (avg) (percentage) 1.440 -
465.tonto (max) 334.000 -5.92%
465.tonto (max) (percentage) 3.020 -5.63%
470.lbm 58.000 -1.69%
470.lbm (avg) 58.000 -1.69%
470.lbm (avg) (percentage) 1.550 -1.90%
470.lbm (max) 32.000 -25.58%
470.lbm (max) (percentage) 0.870 -25.00%
470.lbm (unexplained diff vs previous) 4.000 -90.70%
470.lbm (unexplained diff vs previous) (percentage) 0.110 -90.43%
471.omnetpp 78.000 2.63%
471.omnetpp (avg) 78.000 2.63%
471.omnetpp (avg) (percentage) 2.560 -
471.omnetpp (max) 72.000 -15.29%
471.omnetpp (max) (percentage) 2.370 -16.84%
471.omnetpp (unexplained diff vs previous) 64.000 -22.89%
471.omnetpp (unexplained diff vs previous) (percentage) 2.090 -24.55%
473.astar 104.000 -
473.astar (avg) 104.000 -
473.astar (avg) (percentage) 1.760 -1.12%
473.astar (max) 169.000 -24.89%
473.astar (max) (percentage) 2.860 -24.93%
473.astar (unexplained diff vs previous) 26.000 -88.02%
473.astar (unexplained diff vs previous) (percentage) 0.440 -88.01%
481.wrf 107.000 -
481.wrf (avg) 107.000 -
481.wrf (avg) (percentage) 1.920 -1.54%
481.wrf (max) 58.000 52.63%
481.wrf (max) (percentage) 1.050 50.00%
481.wrf (unexplained diff vs previous) 58.000 -
481.wrf (unexplained diff vs previous) (percentage) 1.040 -
482.sphinx3 22.000 -
482.sphinx3 (avg) 22.000 -
482.sphinx3 (avg) (percentage) 2.380 -2.06%
482.sphinx3 (max) 30.000 -16.67%
482.sphinx3 (max) (percentage) 3.230 -16.75%
482.sphinx3 (unexplained diff vs previous) 0.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.000 -
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.860 -
Geometric Mean 6.401 -47.04%