Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7ecf0250f7f0868f3b828ffadd47d0e5f2dbd875 (+ 1 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/bdbd0607d5933cdecbf7e009a42f1d9486dddf44 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e67f8e6dbd5ec98578a775b2e09b254f071e0f57 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/3b232d34011a152832ba40289e9d476dfcb846d2 (unchanged)
regression GNU-1359
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os-build/438/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0438 (binutils-2_41-release-04424-g7ecf0250f7f) 2024-10-03T23:09:53 0:00:00
Previous 0437 (binutils-2_41-release-04423-g4339a3ffc39) 2024-10-03T07:45:57 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 29 66
Performance Improvements 57 128
Unchanged Tests 1150 1042
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
435.gromacs 1.23% 667189.000 675385.000 - -0.56% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum 2.22% 135.000 138.000 - -98.81% -
447.dealII 1.88% 1916.000 1952.000 - -79.98% -
429.mcf 1.78% 2021.000 2057.000 - -88.01% -
473.astar 1.64% 5860.000 5956.000 - -60.11% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) 600.00% 2.000 14.000 - -83.13% -
456.hmmer (unexplained diff vs previous) (percentage) 585.71% 0.070 0.480 - -36.00% -
473.astar (unexplained diff vs previous) 255.56% 27.000 96.000 - 3100.00% -
473.astar (unexplained diff vs previous) (percentage) 250.00% 0.460 1.610 - 7950.00% -
445.gobmk (unexplained diff vs previous) 240.00% 5.000 17.000 - -90.86% -
445.gobmk (unexplained diff vs previous) (percentage) 230.00% 0.100 0.330 - -78.71% -
462.libquantum (max) 200.00% 1.000 3.000 - -95.95% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 200.00% -
462.libquantum (unexplained diff vs previous) (percentage) 193.24% 0.740 2.170 - 21600.00% -
456.hmmer (max) 160.00% 5.000 13.000 - -90.71% -
456.hmmer (max) (percentage) 140.00% 0.200 0.480 - -62.20% -
470.lbm (unexplained diff vs previous) 100.00% 4.000 8.000 - -42.86% -
470.lbm (unexplained diff vs previous) (percentage) 90.91% 0.110 0.210 - 90.91% -
462.libquantum (max) (percentage) 64.44% 1.350 2.220 - 246.88% -
464.h264ref (unexplained diff vs previous) (percentage) 54.55% 0.220 0.340 - 240.00% -
464.h264ref (unexplained diff vs previous) 53.85% 13.000 20.000 - 33.33% -
410.bwaves (unexplained diff vs previous) (percentage) 7.02% 0.570 0.610 - 510.00% -
410.bwaves (unexplained diff vs previous) 5.71% 35.000 37.000 - 146.67% -
447.dealII 4.17% 24.000 25.000 - -75.96% -
447.dealII (avg) 4.17% 24.000 25.000 - -75.96% -
473.astar 1.92% 104.000 106.000 - 278.57% -
473.astar (avg) 1.92% 104.000 106.000 - 278.57% -
401.bzip2 1.67% 60.000 61.000 - -7.58% -
401.bzip2 (avg) 1.67% 60.000 61.000 - -7.58% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -2.28% 571.000 558.000 - -96.39% -
444.namd -1.04% 769.000 761.000 - -91.59% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -68.75% 16.000 5.000 - -98.82% -
433.milc (unexplained diff vs previous) (percentage) -68.57% 1.400 0.440 - -86.59% -
433.milc (max) -65.62% 32.000 11.000 - -97.32% -
429.mcf (unexplained diff vs previous) (percentage) -64.65% 4.950 1.750 - 224.07% -
429.mcf (unexplained diff vs previous) -64.00% 100.000 36.000 - -61.29% -
433.milc (max) (percentage) -63.38% 2.840 1.040 - -67.19% -
447.dealII (max) -20.00% 5.000 4.000 - -96.26% -
450.soplex (max) -9.09% 22.000 20.000 - -93.42% -
436.cactusADM (max) -8.70% 23.000 21.000 - -96.20% -
458.sjeng (max) -8.20% 61.000 56.000 - 80.65% -
434.zeusmp (max) -7.89% 38.000 35.000 - -88.37% -
435.gromacs (max) -7.69% 156.000 144.000 - -53.70% -
410.bwaves (max) -7.61% 92.000 85.000 - 183.33% -
458.sjeng (max) (percentage) -7.50% 0.800 0.740 - 236.36% -
447.dealII (max) (percentage) -7.41% 0.270 0.250 - -77.27% -
436.cactusADM (max) (percentage) -7.14% 1.120 1.040 - -66.98% -
470.lbm (max) -6.98% 43.000 40.000 - -93.87% -
444.namd (max) (percentage) -6.92% 1.300 1.210 - -83.15% -
470.lbm (max) (percentage) -6.90% 1.160 1.080 - -78.82% -
471.omnetpp (max) (percentage) -6.88% 4.070 3.790 - -38.57% -
435.gromacs (max) (percentage) -6.85% 2.190 2.040 - 0.99% -
401.bzip2 (max) (percentage) -6.80% 2.060 1.920 - 118.18% -
429.mcf (max) (percentage) -6.73% 7.880 7.350 - 1261.11% -
437.leslie3d (max) (percentage) -6.71% 6.260 5.840 - 149.57% -
410.bwaves (max) (percentage) -6.62% 1.510 1.410 - 571.43% -
459.GemsFDTD (max) (percentage) -6.61% 2.570 2.400 - 300.00% -
471.omnetpp (max) -6.61% 121.000 113.000 - -82.93% -
450.soplex (max) (percentage) -6.58% 3.950 3.690 - 87.31% -
473.astar (max) (percentage) -6.56% 3.660 3.420 - 2342.86% -
434.zeusmp (max) (percentage) -6.49% 1.540 1.440 - -36.84% -
482.sphinx3 (max) (percentage) -6.49% 2.310 2.160 - 46.94% -
465.tonto (max) (percentage) -6.48% 1.080 1.010 - -71.79% -
464.h264ref (max) (percentage) -6.38% 0.940 0.880 - 104.65% -
459.GemsFDTD (max) -6.06% 132.000 124.000 - -11.43% -
465.tonto (max) -5.83% 120.000 113.000 - -61.43% -
437.leslie3d (max) -5.80% 655.000 617.000 - 75.78% -
464.h264ref (max) -5.45% 55.000 52.000 - -16.13% -
473.astar (max) -5.14% 214.000 203.000 - 915.00% -
429.mcf (max) -5.03% 159.000 151.000 - 64.13% -
453.povray (max) (percentage) -5.00% 2.800 2.660 - 5.14% -
401.bzip2 (max) -4.92% 61.000 58.000 - -56.39% -
482.sphinx3 (max) -4.76% 21.000 20.000 - -95.44% -
445.gobmk (max) (percentage) -3.82% 1.310 1.260 - -17.65% -
445.gobmk (max) -2.99% 67.000 65.000 - -64.48% -
400.perlbench (max) -2.27% 44.000 43.000 - -87.54% -
400.perlbench (max) (percentage) -2.11% 2.850 2.790 - -13.89% -
464.h264ref -2.00% 50.000 49.000 - -37.18% -
464.h264ref (avg) -2.00% 50.000 49.000 - -37.18% -
471.omnetpp -1.39% 72.000 71.000 - -58.24% -
471.omnetpp (avg) -1.39% 72.000 71.000 - -58.24% -
456.hmmer (avg) (percentage) -1.35% 0.740 0.730 - 7.35% -
403.gcc (max) (percentage) -1.33% 6.030 5.950 - 726.39% -
471.omnetpp (avg) (percentage) -1.24% 2.420 2.390 - 50.31% -
464.h264ref (avg) (percentage) -1.18% 0.850 0.840 - 55.56% -
482.sphinx3 (avg) (percentage) -1.06% 1.890 1.870 - 28.08% -

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto 37.06% 8205.000 11246.000 - 0.77% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 21600.00% 0.010 2.170 - 193.24% -
473.astar (unexplained diff vs previous) (percentage) 7950.00% 0.020 1.610 - 250.00% -
473.astar (unexplained diff vs previous) 3100.00% 3.000 96.000 - 255.56% -
473.astar (max) (percentage) 2342.86% 0.140 3.420 - -6.56% -
483.xalancbmk (max) (percentage) 1287.80% 0.410 5.690 - 0.00% -
429.mcf (max) (percentage) 1261.11% 0.540 7.350 - -6.73% -
429.mcf (avg) (percentage) 975.47% 0.530 5.700 - -0.87% -
403.gcc (avg) (percentage) 945.90% 0.610 6.380 - 0.00% -
473.astar (max) 915.00% 20.000 203.000 - -5.14% -
473.astar (avg) (percentage) 842.11% 0.190 1.790 - 0.00% -
403.gcc (max) (percentage) 726.39% 0.720 5.950 - -1.33% -
410.bwaves (max) (percentage) 571.43% 0.210 1.410 - -6.62% -
410.bwaves (unexplained diff vs previous) (percentage) 510.00% 0.100 0.610 - 7.02% -
458.sjeng (unexplained diff vs previous) (percentage) 400.00% 0.060 0.300 - 0.00% -
401.bzip2 (avg) (percentage) 359.09% 0.440 2.020 - 0.00% -
459.GemsFDTD (max) (percentage) 300.00% 0.600 2.400 - -6.61% -
473.astar 278.57% 28.000 106.000 - 1.92% -
473.astar (avg) 278.57% 28.000 106.000 - 1.92% -
462.libquantum (max) (percentage) 246.88% 0.640 2.220 - 64.44% -
464.h264ref (unexplained diff vs previous) (percentage) 240.00% 0.100 0.340 - 54.55% -
458.sjeng (max) (percentage) 236.36% 0.220 0.740 - -7.50% -
429.mcf (unexplained diff vs previous) (percentage) 224.07% 0.540 1.750 - -64.65% -
462.libquantum (unexplained diff vs previous) 200.00% 1.000 3.000 - 200.00% -
410.bwaves (max) 183.33% 30.000 85.000 - -7.61% -
462.libquantum (avg) (percentage) 158.46% 0.650 1.680 - 0.60% -
458.sjeng (unexplained diff vs previous) 155.56% 9.000 23.000 - 0.00% -
437.leslie3d (max) (percentage) 149.57% 2.340 5.840 - -6.71% -
410.bwaves (unexplained diff vs previous) 146.67% 15.000 37.000 - 5.71% -
450.soplex (avg) (percentage) 136.29% 1.240 2.930 - -0.68% -
458.sjeng (avg) (percentage) 127.27% 0.330 0.750 - 0.00% -
401.bzip2 (max) (percentage) 118.18% 0.880 1.920 - -6.80% -
464.h264ref (max) (percentage) 104.65% 0.430 0.880 - -6.38% -
470.lbm (unexplained diff vs previous) (percentage) 90.91% 0.110 0.210 - 90.91% -
450.soplex (max) (percentage) 87.31% 1.970 3.690 - -6.58% -
458.sjeng (max) 80.65% 31.000 56.000 - -8.20% -
437.leslie3d (avg) (percentage) 79.83% 2.380 4.280 - 0.00% -
483.xalancbmk (avg) (percentage) 76.12% 0.670 1.180 - 0.00% -
437.leslie3d (max) 75.78% 351.000 617.000 - -5.80% -
459.GemsFDTD (avg) (percentage) 66.67% 0.900 1.500 - 0.00% -
429.mcf (max) 64.13% 92.000 151.000 - -5.03% -
464.h264ref (avg) (percentage) 55.56% 0.540 0.840 - -1.18% -
454.calculix (avg) (percentage) 52.24% 2.010 3.060 - 0.00% -
471.omnetpp (avg) (percentage) 50.31% 1.590 2.390 - -1.24% -
482.sphinx3 (max) (percentage) 46.94% 1.470 2.160 - -6.49% -
453.povray (avg) (percentage) 44.00% 1.250 1.800 - 0.00% -
445.gobmk (avg) (percentage) 41.56% 0.770 1.090 - -0.91% -
400.perlbench (avg) (percentage) 36.05% 1.470 2.000 - 0.00% -
464.h264ref (unexplained diff vs previous) 33.33% 15.000 20.000 - 53.85% -
429.mcf 30.00% 90.000 117.000 - 0.86% -
429.mcf (avg) 30.00% 90.000 117.000 - 0.86% -
482.sphinx3 (avg) (percentage) 28.08% 1.460 1.870 - -1.06% -
437.leslie3d 26.61% 357.000 452.000 - 0.89% -
437.leslie3d (avg) 26.61% 357.000 452.000 - 0.89% -
458.sjeng 21.28% 47.000 57.000 - 0.00% -
458.sjeng (avg) 21.28% 47.000 57.000 - 0.00% -
447.dealII (avg) (percentage) 20.56% 1.070 1.290 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 15.92% 2.010 2.330 - 0.00% -
435.gromacs (avg) (percentage) 12.14% 1.730 1.940 - 0.00% -
456.hmmer (avg) (percentage) 7.35% 0.680 0.730 - -1.35% -
453.povray (max) (percentage) 5.14% 2.530 2.660 - -5.00% -
410.bwaves (avg) (percentage) 4.59% 1.090 1.140 - 0.00% -
465.tonto 3.65% 137.000 142.000 - 0.71% -
465.tonto (avg) 3.65% 137.000 142.000 - 0.71% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -17.24% 29.000 24.000 - 0.00% -
nb_execution_successful -17.24% 29.000 24.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -8.10% 120221.000 110489.000 - 0.00% -
437.leslie3d -7.59% 65177.000 60232.000 - 0.00% -
459.GemsFDTD -4.55% 253716.000 242173.000 - 0.00% -
434.zeusmp -3.89% 165699.000 159253.000 - 0.00% -
410.bwaves -2.91% 17880.000 17360.000 - 0.00% -
453.povray -1.84% 709140.000 696074.000 - 0.00% -
433.milc -1.66% 95873.000 94277.000 - 0.00% -
444.namd -1.46% 191059.000 188270.000 - 0.00% -
470.lbm -1.43% 10908.000 10752.000 - 0.00% -
436.cactusADM -1.36% 554386.000 546830.000 - 0.00% -
450.soplex -1.23% 260647.000 257453.000 - 0.00% -
464.h264ref -1.20% 428364.000 423224.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.81% 11614.000 138.000 - 2.22% -
482.sphinx3 -96.87% 29928.000 937.000 - -0.11% -
450.soplex -96.39% 15466.000 558.000 - -2.28% -
453.povray -92.44% 6544.000 495.000 - 0.61% -
444.namd -91.59% 9050.000 761.000 - -1.04% -
433.milc -91.18% 12976.000 1144.000 - 0.44% -
429.mcf -88.01% 17158.000 2057.000 - 1.78% -
436.cactusADM -87.94% 17544.000 2115.000 - -0.38% -
400.perlbench -85.32% 10650.000 1563.000 - -0.64% -
434.zeusmp -81.09% 13211.000 2498.000 - -0.52% -
401.bzip2 -80.05% 15185.000 3029.000 - 0.80% -
447.dealII -79.98% 9751.000 1952.000 - 1.88% -
459.GemsFDTD -77.77% 23356.000 5192.000 - 0.78% -
456.hmmer -73.61% 11046.000 2915.000 - -0.48% -
471.omnetpp -72.18% 10739.000 2988.000 - -0.07% -
470.lbm -70.92% 12819.000 3728.000 - -0.21% -
473.astar -60.11% 14932.000 5956.000 - 1.64% -
464.h264ref -59.21% 14556.000 5938.000 - 0.34% -
410.bwaves -58.76% 14755.000 6085.000 - -0.60% -
445.gobmk -56.96% 11995.000 5163.000 - -0.33% -
435.gromacs -54.00% 15419.000 7092.000 - -0.98% -
458.sjeng -46.42% 14275.000 7648.000 - -0.30% -
437.leslie3d -29.52% 15005.000 10576.000 - 0.94% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.46% 186.000 1.000 - 0.00% -
433.milc (unexplained diff vs previous) -98.82% 425.000 5.000 - -68.75% -
444.namd (max) -98.61% 649.000 9.000 - 0.00% -
462.libquantum -97.33% 75.000 2.000 - 0.00% -
462.libquantum (avg) -97.33% 75.000 2.000 - 0.00% -
433.milc (max) -97.32% 411.000 11.000 - -65.62% -
444.namd -96.90% 355.000 11.000 - 0.00% -
444.namd (avg) -96.90% 355.000 11.000 - 0.00% -
447.dealII (max) -96.26% 107.000 4.000 - -20.00% -
436.cactusADM (max) -96.20% 552.000 21.000 - -8.70% -
482.sphinx3 -96.10% 436.000 17.000 - 0.00% -
482.sphinx3 (avg) -96.10% 436.000 17.000 - 0.00% -
462.libquantum (max) -95.95% 74.000 3.000 - 200.00% -
416.gamess (max) (percentage) -95.85% 2.890 0.120 - 0.00% -
450.soplex (unexplained diff vs previous) -95.82% 311.000 13.000 - 0.00% -
482.sphinx3 (max) -95.44% 439.000 20.000 - -4.76% -
470.lbm (max) -93.87% 653.000 40.000 - -6.98% -
450.soplex (max) -93.42% 304.000 20.000 - -9.09% -
471.omnetpp (unexplained diff vs previous) -92.31% 26.000 2.000 - 0.00% -
433.milc -92.27% 220.000 17.000 - 0.00% -
433.milc (avg) -92.27% 220.000 17.000 - 0.00% -
453.povray (max) -92.12% 165.000 13.000 - 0.00% -
450.soplex -91.62% 191.000 16.000 - 0.00% -
450.soplex (avg) -91.62% 191.000 16.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -90.86% 186.000 17.000 - 240.00% -
436.cactusADM -90.72% 291.000 27.000 - 0.00% -
436.cactusADM (avg) -90.72% 291.000 27.000 - 0.00% -
456.hmmer (max) -90.71% 140.000 13.000 - 160.00% -
453.povray -90.12% 81.000 8.000 - 0.00% -
453.povray (avg) -90.12% 81.000 8.000 - 0.00% -
434.zeusmp (max) -88.37% 301.000 35.000 - -7.89% -
400.perlbench (max) -87.54% 345.000 43.000 - -2.27% -
433.milc (unexplained diff vs previous) (percentage) -86.59% 3.280 0.440 - -68.57% -
470.lbm -86.47% 303.000 41.000 - 0.00% -
470.lbm (avg) -86.47% 303.000 41.000 - 0.00% -
444.namd (max) (percentage) -83.15% 7.180 1.210 - -6.92% -
456.hmmer (unexplained diff vs previous) -83.13% 83.000 14.000 - 600.00% -
471.omnetpp (max) -82.93% 662.000 113.000 - -6.61% -
482.sphinx3 (unexplained diff vs previous) (percentage) -82.26% 0.620 0.110 - 0.00% -
434.zeusmp -82.05% 195.000 35.000 - 0.00% -
434.zeusmp (avg) -82.05% 195.000 35.000 - 0.00% -
400.perlbench -80.13% 156.000 31.000 - 0.00% -
400.perlbench (avg) -80.13% 156.000 31.000 - 0.00% -
470.lbm (max) (percentage) -78.82% 5.100 1.080 - -6.90% -
445.gobmk (unexplained diff vs previous) (percentage) -78.71% 1.550 0.330 - 230.00% -
447.dealII (max) (percentage) -77.27% 1.100 0.250 - -7.41% -
447.dealII -75.96% 104.000 25.000 - 4.17% -
447.dealII (avg) -75.96% 104.000 25.000 - 4.17% -
454.calculix (max) (percentage) -75.11% 4.700 1.170 - -0.85% -
456.hmmer -72.00% 75.000 21.000 - 0.00% -
456.hmmer (avg) -72.00% 75.000 21.000 - 0.00% -
465.tonto (max) (percentage) -71.79% 3.580 1.010 - -6.48% -
471.omnetpp (unexplained diff vs previous) (percentage) -70.83% 0.240 0.070 - 0.00% -
433.milc (max) (percentage) -67.19% 3.170 1.040 - -63.38% -
436.cactusADM (max) (percentage) -66.98% 3.150 1.040 - -7.14% -
445.gobmk (max) -64.48% 183.000 65.000 - -2.99% -
459.GemsFDTD -63.33% 210.000 77.000 - 0.00% -
459.GemsFDTD (avg) -63.33% 210.000 77.000 - 0.00% -
456.hmmer (max) (percentage) -62.20% 1.270 0.480 - 140.00% -
465.tonto (max) -61.43% 293.000 113.000 - -5.83% -
416.gamess (avg) (percentage) -61.29% 2.170 0.840 - 0.00% -
429.mcf (unexplained diff vs previous) -61.29% 93.000 36.000 - -64.00% -
444.namd (avg) (percentage) -60.31% 3.930 1.560 - 0.00% -
471.omnetpp -58.24% 170.000 71.000 - -1.39% -
471.omnetpp (avg) -58.24% 170.000 71.000 - -1.39% -
410.bwaves -56.88% 160.000 69.000 - 0.00% -
410.bwaves (avg) -56.88% 160.000 69.000 - 0.00% -
401.bzip2 (max) -56.39% 133.000 58.000 - -4.92% -
435.gromacs (max) -53.70% 311.000 144.000 - -7.69% -
470.lbm (avg) (percentage) -53.16% 2.370 1.110 - -0.89% -
481.wrf (max) (percentage) -49.52% 3.150 1.590 - -0.63% -
435.gromacs -48.50% 266.000 137.000 - -0.72% -
435.gromacs (avg) -48.50% 266.000 137.000 - -0.72% -
470.lbm (unexplained diff vs previous) -42.86% 14.000 8.000 - 100.00% -
445.gobmk -39.13% 92.000 56.000 - 0.00% -
445.gobmk (avg) -39.13% 92.000 56.000 - 0.00% -
471.omnetpp (max) (percentage) -38.57% 6.170 3.790 - -6.88% -
464.h264ref -37.18% 78.000 49.000 - -2.00% -
464.h264ref (avg) -37.18% 78.000 49.000 - -2.00% -
434.zeusmp (max) (percentage) -36.84% 2.280 1.440 - -6.49% -
456.hmmer (unexplained diff vs previous) (percentage) -36.00% 0.750 0.480 - 585.71% -
465.tonto (avg) (percentage) -23.95% 1.670 1.270 - 0.00% -
436.cactusADM (avg) (percentage) -21.69% 1.660 1.300 - 0.00% -
445.gobmk (max) (percentage) -17.65% 1.530 1.260 - -3.82% -
464.h264ref (max) -16.13% 62.000 52.000 - -5.45% -
400.perlbench (max) (percentage) -13.89% 3.240 2.790 - -2.11% -
481.wrf (avg) (percentage) -12.17% 1.890 1.660 - 0.00% -
459.GemsFDTD (max) -11.43% 140.000 124.000 - -6.06% -
433.milc (avg) (percentage) -8.82% 1.700 1.550 - -0.64% -
401.bzip2 -7.58% 66.000 61.000 - 1.67% -
401.bzip2 (avg) -7.58% 66.000 61.000 - 1.67% -
434.zeusmp (avg) (percentage) -4.05% 1.480 1.420 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 17.24% 29.000 34.000 - 0.00% -

Report Time: 0.35s
Execution (seconds)
Name Current %
400.perlbench 1563.000 -
401.bzip2 3029.000 -
410.bwaves 6085.000 -
429.mcf 2057.000 1.78%
433.milc 1144.000 -
434.zeusmp 2498.000 -
435.gromacs 7092.000 -
436.cactusADM 2115.000 -
437.leslie3d 10576.000 -
444.namd 761.000 -1.04%
445.gobmk 5163.000 -
447.dealII 1952.000 1.88%
450.soplex 558.000 -2.28%
453.povray 495.000 -
456.hmmer 2915.000 -
458.sjeng 7648.000 -
459.GemsFDTD 5192.000 -
462.libquantum 138.000 2.22%
464.h264ref 5938.000 -
465.tonto 11246.000 -
470.lbm 3728.000 -
471.omnetpp 2988.000 -
473.astar 5956.000 1.64%
482.sphinx3 937.000 -
Geometric Mean 2506.294 -
Code Size (bytes)
Name Current %
400.perlbench 921386.000 -
401.bzip2 49414.000 -
410.bwaves 17360.000 -
429.mcf 10915.000 -
433.milc 94277.000 -
434.zeusmp 159253.000 -
435.gromacs 675385.000 1.23%
436.cactusADM 546830.000 -
437.leslie3d 60232.000 -
444.namd 188270.000 -
445.gobmk 1397633.000 -
447.dealII 2099572.000 -
450.soplex 257453.000 -
453.povray 696074.000 -
456.hmmer 228924.000 -
458.sjeng 110489.000 -
459.GemsFDTD 242173.000 -
462.libquantum 31273.000 -
464.h264ref 423224.000 -
465.tonto 2870779.000 -
470.lbm 10752.000 -
471.omnetpp 565415.000 -
473.astar 31904.000 -
482.sphinx3 151928.000 -
Geometric Mean 182870.771 -
sample variability
Name Current %
400.perlbench 31.000 -
400.perlbench (avg) 31.000 -
400.perlbench (avg) (percentage) 2.000 -
400.perlbench (max) 43.000 -2.27%
400.perlbench (max) (percentage) 2.790 -2.11%
401.bzip2 61.000 1.67%
401.bzip2 (avg) 61.000 1.67%
401.bzip2 (avg) (percentage) 2.020 -
401.bzip2 (max) 58.000 -4.92%
401.bzip2 (max) (percentage) 1.920 -6.80%
403.gcc (avg) (percentage) 6.380 -
403.gcc (max) (percentage) 5.950 -1.33%
410.bwaves 69.000 -
410.bwaves (avg) 69.000 -
410.bwaves (avg) (percentage) 1.140 -
410.bwaves (max) 85.000 -7.61%
410.bwaves (max) (percentage) 1.410 -6.62%
410.bwaves (unexplained diff vs previous) 37.000 5.71%
410.bwaves (unexplained diff vs previous) (percentage) 0.610 7.02%
416.gamess (avg) (percentage) 0.840 -
416.gamess (max) (percentage) 0.120 -
429.mcf 117.000 -
429.mcf (avg) 117.000 -
429.mcf (avg) (percentage) 5.700 -
429.mcf (max) 151.000 -5.03%
429.mcf (max) (percentage) 7.350 -6.73%
429.mcf (unexplained diff vs previous) 36.000 -64.00%
429.mcf (unexplained diff vs previous) (percentage) 1.750 -64.65%
433.milc 17.000 -
433.milc (avg) 17.000 -
433.milc (avg) (percentage) 1.550 -
433.milc (max) 11.000 -65.62%
433.milc (max) (percentage) 1.040 -63.38%
433.milc (unexplained diff vs previous) 5.000 -68.75%
433.milc (unexplained diff vs previous) (percentage) 0.440 -68.57%
434.zeusmp 35.000 -
434.zeusmp (avg) 35.000 -
434.zeusmp (avg) (percentage) 1.420 -
434.zeusmp (max) 35.000 -7.89%
434.zeusmp (max) (percentage) 1.440 -6.49%
435.gromacs 137.000 -
435.gromacs (avg) 137.000 -
435.gromacs (avg) (percentage) 1.940 -
435.gromacs (max) 144.000 -7.69%
435.gromacs (max) (percentage) 2.040 -6.85%
436.cactusADM 27.000 -
436.cactusADM (avg) 27.000 -
436.cactusADM (avg) (percentage) 1.300 -
436.cactusADM (max) 21.000 -8.70%
436.cactusADM (max) (percentage) 1.040 -7.14%
437.leslie3d 452.000 -
437.leslie3d (avg) 452.000 -
437.leslie3d (avg) (percentage) 4.280 -
437.leslie3d (max) 617.000 -5.80%
437.leslie3d (max) (percentage) 5.840 -6.71%
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.560 -
444.namd (max) 9.000 -
444.namd (max) (percentage) 1.210 -6.92%
445.gobmk 56.000 -
445.gobmk (avg) 56.000 -
445.gobmk (avg) (percentage) 1.090 -
445.gobmk (max) 65.000 -2.99%
445.gobmk (max) (percentage) 1.260 -3.82%
445.gobmk (unexplained diff vs previous) 17.000 240.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.330 230.00%
447.dealII 25.000 4.17%
447.dealII (avg) 25.000 4.17%
447.dealII (avg) (percentage) 1.290 -
447.dealII (max) 4.000 -20.00%
447.dealII (max) (percentage) 0.250 -7.41%
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 2.930 -
450.soplex (max) 20.000 -9.09%
450.soplex (max) (percentage) 3.690 -6.58%
450.soplex (unexplained diff vs previous) 13.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.330 -
453.povray 8.000 -
453.povray (avg) 8.000 -
453.povray (avg) (percentage) 1.800 -
453.povray (max) 13.000 -
453.povray (max) (percentage) 2.660 -5.00%
454.calculix (avg) (percentage) 3.060 -
454.calculix (max) (percentage) 1.170 -
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.730 -1.35%
456.hmmer (max) 13.000 160.00%
456.hmmer (max) (percentage) 0.480 140.00%
456.hmmer (unexplained diff vs previous) 14.000 600.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.480 585.71%
458.sjeng 57.000 -
458.sjeng (avg) 57.000 -
458.sjeng (avg) (percentage) 0.750 -
458.sjeng (max) 56.000 -8.20%
458.sjeng (max) (percentage) 0.740 -7.50%
458.sjeng (unexplained diff vs previous) 23.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.300 -
459.GemsFDTD 77.000 -
459.GemsFDTD (avg) 77.000 -
459.GemsFDTD (avg) (percentage) 1.500 -
459.GemsFDTD (max) 124.000 -6.06%
459.GemsFDTD (max) (percentage) 2.400 -6.61%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.680 -
462.libquantum (max) 3.000 200.00%
462.libquantum (max) (percentage) 2.220 64.44%
462.libquantum (unexplained diff vs previous) 3.000 200.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.170 193.24%
464.h264ref 49.000 -2.00%
464.h264ref (avg) 49.000 -2.00%
464.h264ref (avg) (percentage) 0.840 -1.18%
464.h264ref (max) 52.000 -5.45%
464.h264ref (max) (percentage) 0.880 -6.38%
464.h264ref (unexplained diff vs previous) 20.000 53.85%
464.h264ref (unexplained diff vs previous) (percentage) 0.340 54.55%
465.tonto 142.000 -
465.tonto (avg) 142.000 -
465.tonto (avg) (percentage) 1.270 -
465.tonto (max) 113.000 -5.83%
465.tonto (max) (percentage) 1.010 -6.48%
470.lbm 41.000 -
470.lbm (avg) 41.000 -
470.lbm (avg) (percentage) 1.110 -
470.lbm (max) 40.000 -6.98%
470.lbm (max) (percentage) 1.080 -6.90%
470.lbm (unexplained diff vs previous) 8.000 100.00%
470.lbm (unexplained diff vs previous) (percentage) 0.210 90.91%
471.omnetpp 71.000 -1.39%
471.omnetpp (avg) 71.000 -1.39%
471.omnetpp (avg) (percentage) 2.390 -1.24%
471.omnetpp (max) 113.000 -6.61%
471.omnetpp (max) (percentage) 3.790 -6.88%
471.omnetpp (unexplained diff vs previous) 2.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 0.070 -
473.astar 106.000 1.92%
473.astar (avg) 106.000 1.92%
473.astar (avg) (percentage) 1.790 -
473.astar (max) 203.000 -5.14%
473.astar (max) (percentage) 3.420 -6.56%
473.astar (unexplained diff vs previous) 96.000 255.56%
473.astar (unexplained diff vs previous) (percentage) 1.610 250.00%
481.wrf (avg) (percentage) 1.660 -
481.wrf (max) (percentage) 1.590 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 1.870 -1.06%
482.sphinx3 (max) 20.000 -4.76%
482.sphinx3 (max) (percentage) 2.160 -6.49%
482.sphinx3 (unexplained diff vs previous) 1.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -
483.xalancbmk (avg) (percentage) 1.180 -
483.xalancbmk (max) (percentage) 5.690 -
Geometric Mean 7.612 37.54%