Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d56fdf1b976d32762c780a0107b20e61ce768967 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/370432688259aed1c99f9b29d8d09e534fb94037 (+ 153 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=90bcc8721ef82b7378d2b080141228660e862d56 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/121/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0121 (basepoints/gcc-14-06031-g37043268825) 2023-12-10T13:54:25 0:00:00
Previous 0118 (2-changed-components) 2023-12-05T05:06:10 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 80 85
Performance Improvements 57 131
Unchanged Tests 1099 1020
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 6.79% 560.000 598.000 - -96.19% -
435.gromacs 4.69% 7362.000 7707.000 - -54.27% -
473.astar 4.49% 4682.000 4892.000 - -62.32% -
437.leslie3d 3.42% 11247.000 11632.000 - -35.63% -
401.bzip2 3.25% 2859.000 2952.000 - -82.61% -
462.libquantum 2.97% 202.000 208.000 - -98.78% -
445.gobmk 2.34% 5032.000 5150.000 - -58.45% -
447.dealII 2.32% 1856.000 1899.000 - -79.13% -
433.milc 2.05% 1073.000 1095.000 - -91.99% -
453.povray 1.87% 536.000 546.000 - -92.62% -
400.perlbench 1.86% 1609.000 1639.000 - -85.39% -
482.sphinx3 1.68% 894.000 909.000 - -97.52% -
444.namd 1.35% 889.000 901.000 - -94.35% -
410.bwaves 1.34% 5879.000 5958.000 - -59.59% -
470.lbm 1.31% 3676.000 3724.000 - -77.17% -
481.wrf 1.30% 6323.000 6405.000 - -70.87% -
434.zeusmp 1.20% 2748.000 2781.000 - -86.71% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
453.povray (unexplained diff vs previous) 900.00% 1.000 10.000 - -94.08% -
453.povray (unexplained diff vs previous) (percentage) 863.16% 0.190 1.830 - -20.09% -
453.povray (max) 100.00% 5.000 10.000 - -94.76% -
462.libquantum (max) 100.00% 3.000 6.000 - -53.85% -
453.povray (max) (percentage) 98.94% 0.940 1.870 - -27.80% -
410.bwaves (max) 54.90% 51.000 79.000 - -69.62% -
462.libquantum (max) (percentage) 53.09% 1.940 2.970 - 3612.50% -
410.bwaves (max) (percentage) 52.27% 0.880 1.340 - -24.29% -
410.bwaves (unexplained diff vs previous) 51.92% 52.000 79.000 - -69.26% -
410.bwaves (unexplained diff vs previous) (percentage) 51.14% 0.880 1.330 - -23.56% -
462.libquantum (unexplained diff vs previous) 50.00% 4.000 6.000 - -57.14% -
462.libquantum (unexplained diff vs previous) (percentage) 45.45% 1.980 2.880 - 3500.00% -
445.gobmk (max) 44.58% 83.000 120.000 - 263.64% -
445.gobmk (max) (percentage) 40.96% 1.660 2.340 - 766.67% -
445.gobmk (unexplained diff vs previous) 38.82% 85.000 118.000 - 555.56% -
436.cactusADM (unexplained diff vs previous) (percentage) 36.92% 0.650 0.890 - -81.50% -
473.astar (max) 36.88% 160.000 219.000 - 259.02% -
445.gobmk (unexplained diff vs previous) (percentage) 35.50% 1.690 2.290 - 1426.67% -
436.cactusADM (unexplained diff vs previous) 35.29% 17.000 23.000 - -98.04% -
444.namd (max) 33.33% 9.000 12.000 - -98.63% -
436.cactusADM (max) (percentage) 33.33% 0.660 0.880 - -82.57% -
473.astar (max) (percentage) 31.29% 3.420 4.490 - 855.32% -
436.cactusADM (max) 29.41% 17.000 22.000 - -98.21% -
473.astar (unexplained diff vs previous) 26.51% 166.000 210.000 - 244.26% -
444.namd (max) (percentage) 21.62% 1.110 1.350 - -75.50% -
473.astar (unexplained diff vs previous) (percentage) 20.85% 3.550 4.290 - 812.77% -
444.namd (unexplained diff vs previous) 20.00% 10.000 12.000 - -98.56% -
444.namd (unexplained diff vs previous) (percentage) 18.75% 1.120 1.330 - -74.57% -
429.mcf (unexplained diff vs previous) (percentage) 16.96% 20.990 24.550 - 27177.78% -
473.astar 7.95% 88.000 95.000 - 86.27% -
473.astar (avg) 7.95% 88.000 95.000 - 86.27% -
450.soplex 5.56% 18.000 19.000 - -48.65% -
450.soplex (avg) 5.56% 18.000 19.000 - -48.65% -
482.sphinx3 5.56% 18.000 19.000 - -97.79% -
482.sphinx3 (avg) 5.56% 18.000 19.000 - -97.79% -
445.gobmk 4.69% 64.000 67.000 - 148.15% -
445.gobmk (avg) 4.69% 64.000 67.000 - 148.15% -
429.mcf (avg) (percentage) 4.44% 6.300 6.580 - 1270.83% -
435.gromacs 4.35% 161.000 168.000 - 5.00% -
435.gromacs (avg) 4.35% 161.000 168.000 - 5.00% -
437.leslie3d 3.46% 462.000 478.000 - 58.80% -
437.leslie3d (avg) 3.46% 462.000 478.000 - 58.80% -
400.perlbench (max) 3.45% 29.000 30.000 - -66.29% -
401.bzip2 2.86% 70.000 72.000 - 60.00% -
401.bzip2 (avg) 2.86% 70.000 72.000 - 60.00% -
450.soplex (avg) (percentage) 2.80% 3.220 3.310 - 1279.17% -
473.astar (avg) (percentage) 2.63% 1.900 1.950 - 387.50% -
447.dealII 2.56% 39.000 40.000 - -49.37% -
447.dealII (avg) 2.56% 39.000 40.000 - -49.37% -
445.gobmk (avg) (percentage) 2.33% 1.290 1.320 - 500.00% -
434.zeusmp 2.27% 44.000 45.000 - -82.35% -
434.zeusmp (avg) 2.27% 44.000 45.000 - -82.35% -
400.perlbench (max) (percentage) 1.64% 1.830 1.860 - 132.50% -
435.gromacs (max) 1.64% 122.000 124.000 - -58.11% -
462.libquantum (avg) (percentage) 1.63% 1.840 1.870 - 884.21% -
481.wrf 1.48% 135.000 137.000 - -75.75% -
481.wrf (avg) 1.48% 135.000 137.000 - -75.75% -
464.h264ref 1.33% 75.000 76.000 - 28.81% -
464.h264ref (avg) 1.33% 75.000 76.000 - 28.81% -
410.bwaves 1.18% 85.000 86.000 - -70.24% -
410.bwaves (avg) 1.18% 85.000 86.000 - -70.24% -
437.leslie3d (max) 1.09% 1193.000 1206.000 - 115.36% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -3.33% 30.000 29.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.82% 10853.000 10221.000 - -5.75% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -19.71% 1177.000 945.000 - -91.94% -
403.gcc -3.39% 59.000 57.000 - -99.36% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -93.33% 15.000 1.000 - -98.39% -
471.omnetpp (unexplained diff vs previous) (percentage) -92.59% 0.540 0.040 - -94.03% -
458.sjeng (unexplained diff vs previous) (percentage) -39.47% 1.520 0.920 - 206.67% -
458.sjeng (unexplained diff vs previous) -38.98% 118.000 72.000 - 50.00% -
470.lbm (unexplained diff vs previous) (percentage) -38.28% 2.090 1.290 - -74.40% -
470.lbm (unexplained diff vs previous) -37.66% 77.000 48.000 - -94.16% -
434.zeusmp (unexplained diff vs previous) (percentage) -34.62% 1.820 1.190 - -47.11% -
434.zeusmp (unexplained diff vs previous) -34.00% 50.000 33.000 - -92.98% -
450.soplex (unexplained diff vs previous) (percentage) -28.89% 8.930 6.350 - 1343.18% -
429.mcf (max) -27.88% 312.000 225.000 - 508.11% -
434.zeusmp (max) (percentage) -25.14% 1.790 1.340 - -41.74% -
434.zeusmp (max) -24.49% 49.000 37.000 - -92.31% -
450.soplex (unexplained diff vs previous) -24.00% 50.000 38.000 - -44.93% -
433.milc (unexplained diff vs previous) (percentage) -22.99% 2.610 2.010 - 187.14% -
433.milc (unexplained diff vs previous) -21.43% 28.000 22.000 - -77.08% -
470.lbm (max) (percentage) -16.59% 2.050 1.710 - -68.80% -
429.mcf -16.22% 74.000 62.000 - 10.71% -
429.mcf (avg) -16.22% 74.000 62.000 - 10.71% -
470.lbm (max) -16.00% 75.000 63.000 - -92.95% -
447.dealII (unexplained diff vs previous) (percentage) -14.39% 2.640 2.260 - 201.33% -
447.dealII (unexplained diff vs previous) -12.24% 49.000 43.000 - -36.76% -
416.gamess (max) -10.53% 19.000 17.000 - -98.16% -
429.mcf (max) (percentage) -10.02% 26.560 23.900 - 7368.75% -
450.soplex (max) (percentage) -10.00% 8.200 7.380 - 1577.27% -
458.sjeng (max) (percentage) -10.00% 1.500 1.350 - 350.00% -
447.dealII (max) (percentage) -9.73% 2.570 2.320 - 40.61% -
458.sjeng (max) -9.48% 116.000 105.000 - 118.75% -
401.bzip2 (unexplained diff vs previous) (percentage) -8.96% 3.460 3.150 - 668.29% -
464.h264ref (max) (percentage) -8.20% 1.220 1.120 - 187.18% -
464.h264ref (max) -8.00% 75.000 69.000 - 16.95% -
416.gamess (max) (percentage) -7.69% 0.130 0.120 - -96.18% -
433.milc (max) -7.41% 27.000 25.000 - -74.23% -
433.milc (max) (percentage) -7.09% 2.540 2.360 - 232.39% -
447.dealII (max) -6.38% 47.000 44.000 - -70.67% -
471.omnetpp (max) (percentage) -6.15% 1.300 1.220 - -34.41% -
429.mcf (unexplained diff vs previous) -6.07% 247.000 232.000 - 2220.00% -
401.bzip2 (unexplained diff vs previous) -6.06% 99.000 93.000 - 34.78% -
482.sphinx3 (max) -5.88% 17.000 16.000 - -98.61% -
471.omnetpp (max) -5.56% 36.000 34.000 - -80.23% -
481.wrf (max) (percentage) -5.41% 1.110 1.050 - -74.76% -
482.sphinx3 (max) (percentage) -5.08% 1.970 1.870 - -40.63% -
459.GemsFDTD (max) (percentage) -4.92% 1.830 1.740 - -23.68% -
481.wrf (max) -4.29% 70.000 67.000 - -92.67% -
459.GemsFDTD (max) -3.91% 128.000 123.000 - -78.72% -
401.bzip2 (max) (percentage) -2.99% 3.350 3.250 - 712.50% -
465.tonto (max) (percentage) -2.75% 1.090 1.060 - -38.01% -
435.gromacs (max) (percentage) -2.41% 1.660 1.620 - -7.95% -
437.leslie3d (max) (percentage) -2.26% 10.610 10.370 - 234.52% -
450.soplex (max) -2.22% 45.000 44.000 - -36.23% -
465.tonto (max) -2.13% 141.000 138.000 - -38.12% -
471.omnetpp (avg) (percentage) -1.91% 2.090 2.050 - 73.73% -
471.omnetpp -1.72% 58.000 57.000 - -47.71% -
471.omnetpp (avg) -1.72% 58.000 57.000 - -47.71% -
400.perlbench (unexplained diff vs previous) (percentage) -1.61% 1.860 1.830 - 490.32% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 3.26% 48001.000 49564.000 - -0.07% -
453.povray 2.06% 489013.000 499105.000 - 0.00% -
416.gamess 1.69% 4554728.000 4631717.000 - -0.00% -
473.astar 1.49% 15549.000 15781.000 - 0.00% -
459.GemsFDTD 1.44% 195766.000 198587.000 - -0.04% -
471.omnetpp 1.26% 295652.000 299385.000 - 0.00% -
462.libquantum 1.13% 13066.000 13214.000 - 0.00% -
447.dealII 1.08% 191136.000 193202.000 - 0.00% -
450.soplex 1.04% 135596.000 137008.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 27177.78% 0.090 24.550 - 16.96% -
429.mcf (max) (percentage) 7368.75% 0.320 23.900 - -10.02% -
462.libquantum (max) (percentage) 3612.50% 0.080 2.970 - 53.09% -
462.libquantum (unexplained diff vs previous) (percentage) 3500.00% 0.080 2.880 - 45.45% -
429.mcf (unexplained diff vs previous) 2220.00% 10.000 232.000 - -6.07% -
403.gcc (max) (percentage) 1598.31% 0.590 10.020 - -0.99% -
450.soplex (max) (percentage) 1577.27% 0.440 7.380 - -10.00% -
445.gobmk (unexplained diff vs previous) (percentage) 1426.67% 0.150 2.290 - 35.50% -
450.soplex (unexplained diff vs previous) (percentage) 1343.18% 0.440 6.350 - -28.89% -
450.soplex (avg) (percentage) 1279.17% 0.240 3.310 - 2.80% -
429.mcf (avg) (percentage) 1270.83% 0.480 6.580 - 4.44% -
462.libquantum (avg) (percentage) 884.21% 0.190 1.870 - 1.63% -
473.astar (max) (percentage) 855.32% 0.470 4.490 - 31.29% -
401.bzip2 (avg) (percentage) 814.81% 0.270 2.470 - 0.41% -
473.astar (unexplained diff vs previous) (percentage) 812.77% 0.470 4.290 - 20.85% -
445.gobmk (max) (percentage) 766.67% 0.270 2.340 - 40.96% -
401.bzip2 (max) (percentage) 712.50% 0.400 3.250 - -2.99% -
401.bzip2 (unexplained diff vs previous) (percentage) 668.29% 0.410 3.150 - -8.96% -
445.gobmk (unexplained diff vs previous) 555.56% 18.000 118.000 - 38.82% -
429.mcf (max) 508.11% 37.000 225.000 - -27.88% -
445.gobmk (avg) (percentage) 500.00% 0.220 1.320 - 2.33% -
400.perlbench (unexplained diff vs previous) (percentage) 490.32% 0.310 1.830 - -1.61% -
400.perlbench (avg) (percentage) 430.77% 0.390 2.070 - 0.00% -
403.gcc (avg) (percentage) 418.60% 0.430 2.230 - 0.00% -
473.astar (avg) (percentage) 387.50% 0.400 1.950 - 2.63% -
458.sjeng (max) (percentage) 350.00% 0.300 1.350 - -10.00% -
458.sjeng (avg) (percentage) 343.48% 0.230 1.020 - -0.97% -
454.calculix (max) (percentage) 278.57% 0.840 3.180 - 0.00% -
445.gobmk (max) 263.64% 33.000 120.000 - 44.58% -
473.astar (max) 259.02% 61.000 219.000 - 36.88% -
473.astar (unexplained diff vs previous) 244.26% 61.000 210.000 - 26.51% -
437.leslie3d (max) (percentage) 234.52% 3.100 10.370 - -2.26% -
433.milc (max) (percentage) 232.39% 0.710 2.360 - -7.09% -
464.h264ref (avg) (percentage) 215.38% 0.390 1.230 - 0.00% -
456.hmmer (avg) (percentage) 210.00% 0.300 0.930 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 206.67% 0.300 0.920 - -39.47% -
447.dealII (unexplained diff vs previous) (percentage) 201.33% 0.750 2.260 - -14.39% -
464.h264ref (max) (percentage) 187.18% 0.390 1.120 - -8.20% -
433.milc (unexplained diff vs previous) (percentage) 187.14% 0.700 2.010 - -22.99% -
433.milc (avg) (percentage) 175.36% 0.690 1.900 - 0.00% -
445.gobmk 148.15% 27.000 67.000 - 4.69% -
445.gobmk (avg) 148.15% 27.000 67.000 - 4.69% -
437.leslie3d (avg) (percentage) 146.11% 1.670 4.110 - 0.00% -
447.dealII (avg) (percentage) 143.68% 0.870 2.120 - 0.00% -
400.perlbench (max) (percentage) 132.50% 0.800 1.860 - 1.64% -
435.gromacs (avg) (percentage) 130.53% 0.950 2.190 - 0.00% -
458.sjeng 119.44% 36.000 79.000 - 0.00% -
458.sjeng (avg) 119.44% 36.000 79.000 - 0.00% -
458.sjeng (max) 118.75% 48.000 105.000 - -9.48% -
437.leslie3d (max) 115.36% 560.000 1206.000 - 1.09% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 0.00% -
473.astar 86.27% 51.000 95.000 - 7.95% -
473.astar (avg) 86.27% 51.000 95.000 - 7.95% -
454.calculix (avg) (percentage) 84.73% 2.030 3.750 - 0.00% -
471.omnetpp (avg) (percentage) 73.73% 1.180 2.050 - -1.91% -
483.xalancbmk (max) (percentage) 69.57% 0.920 1.560 - 0.00% -
401.bzip2 60.00% 45.000 72.000 - 2.86% -
401.bzip2 (avg) 60.00% 45.000 72.000 - 2.86% -
437.leslie3d 58.80% 301.000 478.000 - 3.46% -
437.leslie3d (avg) 58.80% 301.000 478.000 - 3.46% -
458.sjeng (unexplained diff vs previous) 50.00% 48.000 72.000 - -38.98% -
401.bzip2 (max) 41.79% 67.000 95.000 - 0.00% -
447.dealII (max) (percentage) 40.61% 1.650 2.320 - -9.73% -
401.bzip2 (unexplained diff vs previous) 34.78% 69.000 93.000 - -6.06% -
434.zeusmp (avg) (percentage) 32.79% 1.220 1.620 - -0.61% -
464.h264ref 28.81% 59.000 76.000 - 1.33% -
464.h264ref (avg) 28.81% 59.000 76.000 - 1.33% -
459.GemsFDTD (avg) (percentage) 27.34% 1.390 1.770 - 0.00% -
453.povray (avg) (percentage) 22.22% 1.530 1.870 - 0.00% -
464.h264ref (max) 16.95% 59.000 69.000 - -8.00% -
429.mcf 10.71% 56.000 62.000 - -16.22% -
429.mcf (avg) 10.71% 56.000 62.000 - -16.22% -
435.gromacs 5.00% 160.000 168.000 - 4.35% -
435.gromacs (avg) 5.00% 160.000 168.000 - 4.35% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - 0.00% -
nb_execution_successful -3.45% 29.000 28.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.75% 10845.000 10221.000 - -5.82% -
434.zeusmp -1.32% 141060.000 139198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 63.000 - 0.00% -
403.gcc -99.36% 8890.000 57.000 - -3.39% -
462.libquantum -98.78% 17005.000 208.000 - 2.97% -
482.sphinx3 -97.52% 36586.000 909.000 - 1.68% -
450.soplex -96.19% 15709.000 598.000 - 6.79% -
444.namd -94.35% 15957.000 901.000 - 1.35% -
453.povray -92.62% 7395.000 546.000 - 1.87% -
433.milc -91.99% 13668.000 1095.000 - 2.05% -
429.mcf -91.94% 11727.000 945.000 - -19.71% -
436.cactusADM -89.40% 24396.000 2585.000 - -0.88% -
434.zeusmp -86.71% 20932.000 2781.000 - 1.20% -
400.perlbench -85.39% 11215.000 1639.000 - 1.86% -
401.bzip2 -82.61% 16971.000 2952.000 - 3.25% -
447.dealII -79.13% 9101.000 1899.000 - 2.32% -
470.lbm -77.17% 16312.000 3724.000 - 1.31% -
456.hmmer -76.06% 18995.000 4547.000 - 0.11% -
459.GemsFDTD -71.98% 25364.000 7108.000 - 0.97% -
481.wrf -70.87% 21991.000 6405.000 - 1.30% -
471.omnetpp -69.92% 9265.000 2787.000 - 0.04% -
473.astar -62.32% 12983.000 4892.000 - 4.49% -
410.bwaves -59.59% 14745.000 5958.000 - 1.34% -
464.h264ref -59.11% 15208.000 6219.000 - 0.84% -
445.gobmk -58.45% 12396.000 5150.000 - 2.34% -
435.gromacs -54.27% 16853.000 7707.000 - 4.69% -
458.sjeng -51.12% 16018.000 7830.000 - 0.93% -
416.gamess -49.75% 29409.000 14778.000 - 0.17% -
437.leslie3d -35.63% 18070.000 11632.000 - 3.42% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.70% 659.000 2.000 - 0.00% -
454.calculix (avg) -99.70% 659.000 2.000 - 0.00% -
454.calculix (max) -99.26% 272.000 2.000 - 0.00% -
444.namd (max) -98.63% 879.000 12.000 - 33.33% -
482.sphinx3 (max) -98.61% 1152.000 16.000 - -5.88% -
444.namd (unexplained diff vs previous) -98.56% 834.000 12.000 - 20.00% -
471.omnetpp (unexplained diff vs previous) -98.39% 62.000 1.000 - -93.33% -
436.cactusADM (max) -98.21% 1231.000 22.000 - 29.41% -
416.gamess (max) -98.16% 923.000 17.000 - -10.53% -
436.cactusADM (unexplained diff vs previous) -98.04% 1173.000 23.000 - 35.29% -
482.sphinx3 -97.79% 859.000 19.000 - 5.56% -
482.sphinx3 (avg) -97.79% 859.000 19.000 - 5.56% -
403.gcc -97.37% 38.000 1.000 - 0.00% -
403.gcc (avg) -97.37% 38.000 1.000 - 0.00% -
444.namd -96.38% 414.000 15.000 - 0.00% -
444.namd (avg) -96.38% 414.000 15.000 - 0.00% -
416.gamess (max) (percentage) -96.18% 3.140 0.120 - -7.69% -
456.hmmer (max) -95.92% 98.000 4.000 - 0.00% -
453.povray (max) -94.76% 191.000 10.000 - 100.00% -
470.lbm (unexplained diff vs previous) -94.16% 822.000 48.000 - -37.66% -
453.povray (unexplained diff vs previous) -94.08% 169.000 10.000 - 900.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -94.03% 0.670 0.040 - -92.59% -
436.cactusADM -93.33% 585.000 39.000 - 0.00% -
436.cactusADM (avg) -93.33% 585.000 39.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -92.98% 470.000 33.000 - -34.00% -
470.lbm (max) -92.95% 893.000 63.000 - -16.00% -
481.wrf (max) -92.67% 914.000 67.000 - -4.29% -
434.zeusmp (max) -92.31% 481.000 37.000 - -24.49% -
453.povray -91.15% 113.000 10.000 - 0.00% -
453.povray (avg) -91.15% 113.000 10.000 - 0.00% -
462.libquantum -90.62% 32.000 3.000 - 0.00% -
462.libquantum (avg) -90.62% 32.000 3.000 - 0.00% -
403.gcc (max) -90.38% 52.000 5.000 - 0.00% -
470.lbm -88.82% 608.000 68.000 - 0.00% -
470.lbm (avg) -88.82% 608.000 68.000 - 0.00% -
436.cactusADM (max) (percentage) -82.57% 5.050 0.880 - 33.33% -
434.zeusmp -82.35% 255.000 45.000 - 2.27% -
434.zeusmp (avg) -82.35% 255.000 45.000 - 2.27% -
436.cactusADM (unexplained diff vs previous) (percentage) -81.50% 4.810 0.890 - 36.92% -
456.hmmer (max) (percentage) -80.77% 0.520 0.100 - -9.09% -
471.omnetpp (max) -80.23% 172.000 34.000 - -5.56% -
433.milc -78.72% 94.000 20.000 - 0.00% -
433.milc (avg) -78.72% 94.000 20.000 - 0.00% -
459.GemsFDTD (max) -78.72% 578.000 123.000 - -3.91% -
433.milc (unexplained diff vs previous) -77.08% 96.000 22.000 - -21.43% -
481.wrf -75.75% 565.000 137.000 - 1.48% -
481.wrf (avg) -75.75% 565.000 137.000 - 1.48% -
444.namd (max) (percentage) -75.50% 5.510 1.350 - 21.62% -
481.wrf (max) (percentage) -74.76% 4.160 1.050 - -5.41% -
444.namd (unexplained diff vs previous) (percentage) -74.57% 5.230 1.330 - 18.75% -
470.lbm (unexplained diff vs previous) (percentage) -74.40% 5.040 1.290 - -38.28% -
433.milc (max) -74.23% 97.000 25.000 - -7.41% -
447.dealII (max) -70.67% 150.000 44.000 - -6.38% -
410.bwaves -70.24% 289.000 86.000 - 1.18% -
410.bwaves (avg) -70.24% 289.000 86.000 - 1.18% -
416.gamess -69.90% 485.000 146.000 - 0.00% -
416.gamess (avg) -69.90% 485.000 146.000 - 0.00% -
410.bwaves (max) -69.62% 260.000 79.000 - 54.90% -
410.bwaves (unexplained diff vs previous) -69.26% 257.000 79.000 - 51.92% -
470.lbm (max) (percentage) -68.80% 5.480 1.710 - -16.59% -
400.perlbench (max) -66.29% 89.000 30.000 - 3.45% -
459.GemsFDTD -64.49% 352.000 125.000 - 0.81% -
459.GemsFDTD (avg) -64.49% 352.000 125.000 - 0.81% -
435.gromacs (max) -58.11% 296.000 124.000 - 1.64% -
462.libquantum (unexplained diff vs previous) -57.14% 14.000 6.000 - 50.00% -
462.libquantum (max) -53.85% 13.000 6.000 - 100.00% -
470.lbm (avg) (percentage) -50.67% 3.730 1.840 - -0.54% -
447.dealII -49.37% 79.000 40.000 - 2.56% -
447.dealII (avg) -49.37% 79.000 40.000 - 2.56% -
450.soplex -48.65% 37.000 19.000 - 5.56% -
450.soplex (avg) -48.65% 37.000 19.000 - 5.56% -
471.omnetpp -47.71% 109.000 57.000 - -1.72% -
471.omnetpp (avg) -47.71% 109.000 57.000 - -1.72% -
434.zeusmp (unexplained diff vs previous) (percentage) -47.11% 2.250 1.190 - -34.62% -
450.soplex (unexplained diff vs previous) -44.93% 69.000 38.000 - -24.00% -
434.zeusmp (max) (percentage) -41.74% 2.300 1.340 - -25.14% -
482.sphinx3 (max) (percentage) -40.63% 3.150 1.870 - -5.08% -
416.gamess (avg) (percentage) -40.00% 1.650 0.990 - 0.00% -
465.tonto (max) -38.12% 223.000 138.000 - -2.13% -
465.tonto (max) (percentage) -38.01% 1.710 1.060 - -2.75% -
447.dealII (unexplained diff vs previous) -36.76% 68.000 43.000 - -12.24% -
436.cactusADM (avg) (percentage) -36.67% 2.400 1.520 - -0.65% -
450.soplex (max) -36.23% 69.000 44.000 - -2.22% -
471.omnetpp (max) (percentage) -34.41% 1.860 1.220 - -6.15% -
444.namd (avg) (percentage) -34.23% 2.600 1.710 - 0.00% -
453.povray (max) (percentage) -27.80% 2.590 1.870 - 98.94% -
410.bwaves (avg) (percentage) -26.02% 1.960 1.450 - 0.00% -
456.hmmer -25.00% 56.000 42.000 - 0.00% -
456.hmmer (avg) -25.00% 56.000 42.000 - 0.00% -
410.bwaves (max) (percentage) -24.29% 1.770 1.340 - 52.27% -
459.GemsFDTD (max) (percentage) -23.68% 2.280 1.740 - -4.92% -
410.bwaves (unexplained diff vs previous) (percentage) -23.56% 1.740 1.330 - 51.14% -
400.perlbench -23.26% 43.000 33.000 - 0.00% -
400.perlbench (avg) -23.26% 43.000 33.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -20.09% 2.290 1.830 - 863.16% -
465.tonto -17.57% 148.000 122.000 - 0.00% -
465.tonto (avg) -17.57% 148.000 122.000 - 0.00% -
465.tonto (avg) (percentage) -17.54% 1.140 0.940 - 0.00% -
481.wrf (avg) (percentage) -16.34% 2.570 2.150 - 0.00% -
400.perlbench (unexplained diff vs previous) -14.29% 35.000 30.000 - 0.00% -
482.sphinx3 (avg) (percentage) -10.21% 2.350 2.110 - 0.00% -
435.gromacs (max) (percentage) -7.95% 1.760 1.620 - -2.41% -

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1639.000 1.86%
401.bzip2 2952.000 3.25%
403.gcc 57.000 -3.39%
410.bwaves 5958.000 1.34%
416.gamess 14778.000 -
429.mcf 945.000 -19.71%
433.milc 1095.000 2.05%
434.zeusmp 2781.000 1.20%
435.gromacs 7707.000 4.69%
436.cactusADM 2585.000 -
437.leslie3d 11632.000 3.42%
444.namd 901.000 1.35%
445.gobmk 5150.000 2.34%
447.dealII 1899.000 2.32%
450.soplex 598.000 6.79%
453.povray 546.000 1.87%
454.calculix 63.000 -
456.hmmer 4547.000 -
458.sjeng 7830.000 -
459.GemsFDTD 7108.000 -
462.libquantum 208.000 2.97%
464.h264ref 6219.000 -
465.tonto 13025.000 -
470.lbm 3724.000 1.31%
471.omnetpp 2787.000 -
473.astar 4892.000 4.49%
481.wrf 6405.000 1.30%
482.sphinx3 909.000 1.68%
Geometric Mean 2196.439 -
Code Size (bytes)
Name Current %
400.perlbench 567102.000 -
401.bzip2 33542.000 -
403.gcc 1603710.000 -
410.bwaves 14723.000 -
416.gamess 4631717.000 -
429.mcf 7701.000 -
433.milc 47965.000 -
434.zeusmp 139198.000 -
435.gromacs 394950.000 -
436.cactusADM 258206.000 -
437.leslie3d 49564.000 -
444.namd 162891.000 -
445.gobmk 1089944.000 -
447.dealII 193202.000 -
450.soplex 137008.000 -
453.povray 499105.000 -
454.calculix 687701.000 -
456.hmmer 74805.000 -
458.sjeng 81765.000 -
459.GemsFDTD 198587.000 -
462.libquantum 13214.000 -
464.h264ref 302154.000 -
465.tonto 1450245.000 -
470.lbm 10221.000 -5.82%
471.omnetpp 299385.000 -
473.astar 15781.000 -
481.wrf 1537684.000 -
482.sphinx3 79862.000 -
Geometric Mean 157978.742 -
Score
Name Current %
nb_compile_successful 28.000 -
nb_execution_successful 28.000 -
nb_total_tests 29.000 -3.33%
Geometric Mean 28.329 -1.12%
sample variability
Name Current %
400.perlbench 33.000 -
400.perlbench (avg) 33.000 -
400.perlbench (avg) (percentage) 2.070 -
400.perlbench (max) 30.000 3.45%
400.perlbench (max) (percentage) 1.860 1.64%
400.perlbench (unexplained diff vs previous) 30.000 -
400.perlbench (unexplained diff vs previous) (percentage) 1.830 -1.61%
401.bzip2 72.000 2.86%
401.bzip2 (avg) 72.000 2.86%
401.bzip2 (avg) (percentage) 2.470 -
401.bzip2 (max) 95.000 -
401.bzip2 (max) (percentage) 3.250 -2.99%
401.bzip2 (unexplained diff vs previous) 93.000 -6.06%
401.bzip2 (unexplained diff vs previous) (percentage) 3.150 -8.96%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.230 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 10.020 -
410.bwaves 86.000 1.18%
410.bwaves (avg) 86.000 1.18%
410.bwaves (avg) (percentage) 1.450 -
410.bwaves (max) 79.000 54.90%
410.bwaves (max) (percentage) 1.340 52.27%
410.bwaves (unexplained diff vs previous) 79.000 51.92%
410.bwaves (unexplained diff vs previous) (percentage) 1.330 51.14%
416.gamess 146.000 -
416.gamess (avg) 146.000 -
416.gamess (avg) (percentage) 0.990 -
416.gamess (max) 17.000 -10.53%
416.gamess (max) (percentage) 0.120 -7.69%
429.mcf 62.000 -16.22%
429.mcf (avg) 62.000 -16.22%
429.mcf (avg) (percentage) 6.580 4.44%
429.mcf (max) 225.000 -27.88%
429.mcf (max) (percentage) 23.900 -10.02%
429.mcf (unexplained diff vs previous) 232.000 -6.07%
429.mcf (unexplained diff vs previous) (percentage) 24.550 16.96%
433.milc 20.000 -
433.milc (avg) 20.000 -
433.milc (avg) (percentage) 1.900 -
433.milc (max) 25.000 -7.41%
433.milc (max) (percentage) 2.360 -7.09%
433.milc (unexplained diff vs previous) 22.000 -21.43%
433.milc (unexplained diff vs previous) (percentage) 2.010 -22.99%
434.zeusmp 45.000 2.27%
434.zeusmp (avg) 45.000 2.27%
434.zeusmp (avg) (percentage) 1.620 -
434.zeusmp (max) 37.000 -24.49%
434.zeusmp (max) (percentage) 1.340 -25.14%
434.zeusmp (unexplained diff vs previous) 33.000 -34.00%
434.zeusmp (unexplained diff vs previous) (percentage) 1.190 -34.62%
435.gromacs 168.000 4.35%
435.gromacs (avg) 168.000 4.35%
435.gromacs (avg) (percentage) 2.190 -
435.gromacs (max) 124.000 1.64%
435.gromacs (max) (percentage) 1.620 -2.41%
436.cactusADM 39.000 -
436.cactusADM (avg) 39.000 -
436.cactusADM (avg) (percentage) 1.520 -
436.cactusADM (max) 22.000 29.41%
436.cactusADM (max) (percentage) 0.880 33.33%
436.cactusADM (unexplained diff vs previous) 23.000 35.29%
436.cactusADM (unexplained diff vs previous) (percentage) 0.890 36.92%
437.leslie3d 478.000 3.46%
437.leslie3d (avg) 478.000 3.46%
437.leslie3d (avg) (percentage) 4.110 -
437.leslie3d (max) 1206.000 1.09%
437.leslie3d (max) (percentage) 10.370 -2.26%
444.namd 15.000 -
444.namd (avg) 15.000 -
444.namd (avg) (percentage) 1.710 -
444.namd (max) 12.000 33.33%
444.namd (max) (percentage) 1.350 21.62%
444.namd (unexplained diff vs previous) 12.000 20.00%
444.namd (unexplained diff vs previous) (percentage) 1.330 18.75%
445.gobmk 67.000 4.69%
445.gobmk (avg) 67.000 4.69%
445.gobmk (avg) (percentage) 1.320 2.33%
445.gobmk (max) 120.000 44.58%
445.gobmk (max) (percentage) 2.340 40.96%
445.gobmk (unexplained diff vs previous) 118.000 38.82%
445.gobmk (unexplained diff vs previous) (percentage) 2.290 35.50%
447.dealII 40.000 2.56%
447.dealII (avg) 40.000 2.56%
447.dealII (avg) (percentage) 2.120 -
447.dealII (max) 44.000 -6.38%
447.dealII (max) (percentage) 2.320 -9.73%
447.dealII (unexplained diff vs previous) 43.000 -12.24%
447.dealII (unexplained diff vs previous) (percentage) 2.260 -14.39%
450.soplex 19.000 5.56%
450.soplex (avg) 19.000 5.56%
450.soplex (avg) (percentage) 3.310 2.80%
450.soplex (max) 44.000 -2.22%
450.soplex (max) (percentage) 7.380 -10.00%
450.soplex (unexplained diff vs previous) 38.000 -24.00%
450.soplex (unexplained diff vs previous) (percentage) 6.350 -28.89%
453.povray 10.000 -
453.povray (avg) 10.000 -
453.povray (avg) (percentage) 1.870 -
453.povray (max) 10.000 100.00%
453.povray (max) (percentage) 1.870 98.94%
453.povray (unexplained diff vs previous) 10.000 900.00%
453.povray (unexplained diff vs previous) (percentage) 1.830 863.16%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 3.750 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.180 -
456.hmmer 42.000 -
456.hmmer (avg) 42.000 -
456.hmmer (avg) (percentage) 0.930 -
456.hmmer (max) 4.000 -
456.hmmer (max) (percentage) 0.100 -
458.sjeng 79.000 -
458.sjeng (avg) 79.000 -
458.sjeng (avg) (percentage) 1.020 -
458.sjeng (max) 105.000 -9.48%
458.sjeng (max) (percentage) 1.350 -10.00%
458.sjeng (unexplained diff vs previous) 72.000 -38.98%
458.sjeng (unexplained diff vs previous) (percentage) 0.920 -39.47%
459.GemsFDTD 125.000 -
459.GemsFDTD (avg) 125.000 -
459.GemsFDTD (avg) (percentage) 1.770 -
459.GemsFDTD (max) 123.000 -3.91%
459.GemsFDTD (max) (percentage) 1.740 -4.92%
462.libquantum 3.000 -
462.libquantum (avg) 3.000 -
462.libquantum (avg) (percentage) 1.870 1.63%
462.libquantum (max) 6.000 100.00%
462.libquantum (max) (percentage) 2.970 53.09%
462.libquantum (unexplained diff vs previous) 6.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 2.880 45.45%
464.h264ref 76.000 1.33%
464.h264ref (avg) 76.000 1.33%
464.h264ref (avg) (percentage) 1.230 -
464.h264ref (max) 69.000 -8.00%
464.h264ref (max) (percentage) 1.120 -8.20%
465.tonto 122.000 -
465.tonto (avg) 122.000 -
465.tonto (avg) (percentage) 0.940 -
465.tonto (max) 138.000 -2.13%
465.tonto (max) (percentage) 1.060 -2.75%
470.lbm 68.000 -
470.lbm (avg) 68.000 -
470.lbm (avg) (percentage) 1.840 -
470.lbm (max) 63.000 -16.00%
470.lbm (max) (percentage) 1.710 -16.59%
470.lbm (unexplained diff vs previous) 48.000 -37.66%
470.lbm (unexplained diff vs previous) (percentage) 1.290 -38.28%
471.omnetpp 57.000 -1.72%
471.omnetpp (avg) 57.000 -1.72%
471.omnetpp (avg) (percentage) 2.050 -1.91%
471.omnetpp (max) 34.000 -5.56%
471.omnetpp (max) (percentage) 1.220 -6.15%
471.omnetpp (unexplained diff vs previous) 1.000 -93.33%
471.omnetpp (unexplained diff vs previous) (percentage) 0.040 -92.59%
473.astar 95.000 7.95%
473.astar (avg) 95.000 7.95%
473.astar (avg) (percentage) 1.950 2.63%
473.astar (max) 219.000 36.88%
473.astar (max) (percentage) 4.490 31.29%
473.astar (unexplained diff vs previous) 210.000 26.51%
473.astar (unexplained diff vs previous) (percentage) 4.290 20.85%
481.wrf 137.000 1.48%
481.wrf (avg) 137.000 1.48%
481.wrf (avg) (percentage) 2.150 -
481.wrf (max) 67.000 -4.29%
481.wrf (max) (percentage) 1.050 -5.41%
482.sphinx3 19.000 5.56%
482.sphinx3 (avg) 19.000 5.56%
482.sphinx3 (avg) (percentage) 2.110 -
482.sphinx3 (max) 16.000 -5.88%
482.sphinx3 (max) (percentage) 1.870 -5.08%
483.xalancbmk (avg) (percentage) 1.140 -
483.xalancbmk (max) (percentage) 1.560 -
Geometric Mean 10.662 1.10%