Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=628b136d6474df9c4bbf04b8ff1977ef7191c9e1 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/19cc61111120087619b496732b249b48b1fbe27e (+ 16 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=46b5e98ef6f1b9f4b53851f152ecb8209064b26c (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/200/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0200 (basepoints/gcc-15-00860-g19cc6111112) 2024-05-31T19:49:26 0:00:00
Previous 0197 (4-changed-components) 2022-12-26T18:06:32 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 70 73
Performance Improvements 136 133
Added Tests 2 2
Unchanged Tests 1028 1028
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 2.39% 48001.000 49148.000 - 2.39% -
453.povray 1.96% 489013.000 498617.000 - 1.96% -
473.astar 1.44% 15549.000 15773.000 - 1.44% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 9100.00% 0.010 0.920 0.000 1050.00% 0.000
462.libquantum (max) (percentage) 1611.11% 0.090 1.540 - 1825.00% -
450.soplex (max) (percentage) 1561.54% 0.260 4.320 - 881.82% -
450.soplex (avg) (percentage) 1277.27% 0.220 3.030 - 1162.50% -
403.gcc (max) (percentage) 1218.75% 0.640 8.440 - 1330.51% -
429.mcf (avg) (percentage) 964.71% 0.510 5.430 - 1031.25% -
401.bzip2 (unexplained diff vs previous) (percentage) 953.85% 0.130 1.370 0.000 234.15% 0.000
401.bzip2 (avg) (percentage) 752.00% 0.250 2.130 - 688.89% -
429.mcf (max) (percentage) 722.86% 0.350 2.880 - 800.00% -
429.mcf (unexplained diff vs previous) (percentage) 700.00% 0.340 2.720 0.000 2922.22% 0.000
462.libquantum (avg) (percentage) 700.00% 0.200 1.600 - 742.11% -
473.astar (max) (percentage) 600.00% 0.520 3.640 - 674.47% -
458.sjeng (max) (percentage) 478.26% 0.230 1.330 - 343.33% -
403.gcc (avg) (percentage) 464.29% 0.420 2.370 - 451.16% -
401.bzip2 (max) (percentage) 455.17% 0.290 1.610 - 302.50% -
450.soplex (unexplained diff vs previous) (percentage) 407.69% 0.260 1.320 0.000 200.00% 0.000
400.perlbench (avg) (percentage) 370.00% 0.400 1.880 - 382.05% -
445.gobmk (avg) (percentage) 365.22% 0.230 1.070 - 386.36% -
473.astar (avg) (percentage) 348.72% 0.390 1.750 - 337.50% -
458.sjeng (avg) (percentage) 300.00% 0.220 0.880 - 282.61% -
445.gobmk (max) (percentage) 275.00% 0.320 1.200 - 344.44% -
454.calculix (max) (percentage) 261.39% 1.010 3.650 - 334.52% -
437.leslie3d (max) (percentage) 261.18% 3.400 12.280 - 296.13% -
458.sjeng (max) 188.89% 36.000 104.000 - 116.67% -
464.h264ref (max) (percentage) 187.50% 0.400 1.150 - 194.87% -
437.leslie3d (avg) (percentage) 175.00% 1.720 4.730 - 183.23% -
456.hmmer (avg) (percentage) 171.43% 0.280 0.760 - 153.33% -
473.astar (max) 164.18% 67.000 177.000 - 190.16% -
464.h264ref (avg) (percentage) 153.85% 0.390 0.990 - 153.85% -
437.leslie3d (max) 129.52% 620.000 1423.000 - 154.11% -
435.gromacs (max) (percentage) 124.28% 1.730 3.880 - 120.45% -
400.perlbench (unexplained diff vs previous) (percentage) 122.73% 0.220 0.490 0.000 58.06% 0.000
435.gromacs (avg) (percentage) 120.69% 0.870 1.920 - 102.11% -
400.perlbench (max) (percentage) 114.77% 0.880 1.890 - 136.25% -
433.milc (avg) (percentage) 114.71% 0.680 1.460 - 111.59% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 103.57% -
447.dealII (avg) (percentage) 103.37% 0.890 1.810 - 108.05% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 0.000 -85.71% 0.000
458.sjeng 94.29% 35.000 68.000 - 88.89% -
458.sjeng (avg) 94.29% 35.000 68.000 - 88.89% -
445.gobmk 92.86% 28.000 54.000 - 100.00% -
445.gobmk (avg) 92.86% 28.000 54.000 - 100.00% -
437.leslie3d 74.52% 314.000 548.000 - 82.06% -
437.leslie3d (avg) 74.52% 314.000 548.000 - 82.06% -
401.bzip2 (unexplained diff vs previous) 73.91% 23.000 40.000 0.000 -42.03% 0.000
473.astar 70.00% 50.000 85.000 - 66.67% -
473.astar (avg) 70.00% 50.000 85.000 - 66.67% -
454.calculix (avg) (percentage) 60.00% 2.150 3.440 - 69.46% -
471.omnetpp (avg) (percentage) 54.10% 1.220 1.880 - 59.32% -
445.gobmk (max) 53.85% 39.000 60.000 - 81.82% -
456.hmmer (unexplained diff vs previous) (percentage) 51.35% 0.370 0.560 0.000 7.69% 0.000
483.xalancbmk (max) (percentage) 50.98% 1.020 1.540 - 67.39% -
401.bzip2 47.62% 42.000 62.000 - 37.78% -
401.bzip2 (avg) 47.62% 42.000 62.000 - 37.78% -
464.h264ref (unexplained diff vs previous) (percentage) 44.83% 0.290 0.420 0.000 10.53% 0.000
456.hmmer (max) (percentage) 33.33% 0.420 0.560 - 7.69% -
433.milc (max) (percentage) 21.33% 0.750 0.910 - 28.17% -
464.h264ref (max) 16.67% 60.000 70.000 - 18.64% -
434.zeusmp (avg) (percentage) 15.04% 1.130 1.300 - 6.56% -
459.GemsFDTD (avg) (percentage) 13.74% 1.310 1.490 - 7.19% -
429.mcf 13.56% 59.000 67.000 - 19.64% -
429.mcf (avg) 13.56% 59.000 67.000 - 19.64% -
453.povray (avg) (percentage) 10.88% 1.470 1.630 - 6.54% -
435.gromacs (max) 2.80% 286.000 294.000 - -0.68% -
459.GemsFDTD (max) (percentage) 2.56% 2.340 2.400 - 5.26% -
464.h264ref 1.69% 59.000 60.000 - 1.69% -
464.h264ref (avg) 1.69% 59.000 60.000 - 1.69% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.90% 10845.000 10205.000 - -5.90% -
434.zeusmp -1.42% 141060.000 139050.000 - -1.42% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.72% 16991.000 218.000 - -98.72% -
482.sphinx3 -97.56% 37704.000 920.000 - -97.49% -
450.soplex -96.14% 15640.000 604.000 - -96.16% -
444.namd -93.98% 15123.000 911.000 - -94.29% -
453.povray -92.81% 7564.000 544.000 - -92.64% -
433.milc -91.96% 13572.000 1091.000 - -92.02% -
429.mcf -89.33% 11717.000 1250.000 - -89.34% -
436.cactusADM -88.71% 23223.000 2621.000 - -89.26% -
434.zeusmp -86.42% 20462.000 2778.000 - -86.73% -
400.perlbench -85.40% 11250.000 1643.000 - -85.35% -
401.bzip2 -82.82% 17040.000 2927.000 - -82.75% -
470.lbm -78.13% 17134.000 3747.000 - -77.03% -
447.dealII -77.90% 9033.000 1996.000 - -78.07% -
456.hmmer -77.29% 18897.000 4292.000 - -77.40% -
459.GemsFDTD -73.32% 25948.000 6923.000 - -72.71% -
471.omnetpp -68.93% 9203.000 2859.000 - -69.14% -
473.astar -62.24% 12922.000 4879.000 - -62.42% -
464.h264ref -59.33% 15150.000 6161.000 - -59.49% -
445.gobmk -59.21% 12414.000 5064.000 - -59.15% -
410.bwaves -59.06% 14488.000 5932.000 - -59.77% -
435.gromacs -54.18% 16561.000 7589.000 - -54.97% -
458.sjeng -50.93% 15970.000 7837.000 - -51.07% -
437.leslie3d -36.52% 18257.000 11589.000 - -35.87% -
465.tonto -2.24% 13192.000 12896.000 - -1.13% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -99.84% 1274.000 2.000 0.000 -99.82% 0.000
470.lbm (unexplained diff vs previous) -99.48% 1165.000 6.000 0.000 -99.27% 0.000
444.namd (unexplained diff vs previous) -99.26% 812.000 6.000 0.000 -99.28% 0.000
436.cactusADM (unexplained diff vs previous) -98.58% 1194.000 17.000 0.000 -98.55% 0.000
444.namd (max) -98.57% 771.000 11.000 - -98.75% -
459.GemsFDTD (unexplained diff vs previous) -98.42% 443.000 7.000 0.000 -98.80% 0.000
482.sphinx3 (max) -98.41% 1319.000 21.000 - -98.18% -
453.povray (max) -98.16% 217.000 4.000 - -97.91% -
436.cactusADM (max) -98.15% 1135.000 21.000 - -98.29% -
453.povray (unexplained diff vs previous) -98.11% 212.000 4.000 0.000 -97.63% 0.000
482.sphinx3 -98.04% 867.000 17.000 - -98.02% -
482.sphinx3 (avg) -98.04% 867.000 17.000 - -98.02% -
470.lbm (unexplained diff vs previous) (percentage) -97.65% 6.800 0.160 0.000 -96.83% 0.000
470.lbm (max) -97.52% 1250.000 31.000 - -96.53% -
434.zeusmp (unexplained diff vs previous) -97.50% 480.000 12.000 0.000 -97.45% 0.000
444.namd -96.63% 356.000 12.000 - -97.10% -
444.namd (avg) -96.63% 356.000 12.000 - -97.10% -
416.gamess (max) (percentage) -95.69% 3.250 0.140 - -95.54% -
473.astar (unexplained diff vs previous) -95.59% 68.000 3.000 0.000 -95.08% 0.000
445.gobmk (unexplained diff vs previous) -95.00% 40.000 2.000 0.000 -88.89% 0.000
481.wrf (max) (percentage) -94.37% 4.620 0.260 - -93.75% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -94.15% 1.710 0.100 0.000 -95.65% 0.000
436.cactusADM -93.76% 513.000 32.000 - -94.53% -
436.cactusADM (avg) -93.76% 513.000 32.000 - -94.53% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.49% 3.380 0.220 0.000 -92.81% 0.000
453.povray -92.79% 111.000 8.000 - -92.92% -
453.povray (avg) -92.79% 111.000 8.000 - -92.92% -
410.bwaves (unexplained diff vs previous) -91.72% 314.000 26.000 0.000 -89.88% 0.000
434.zeusmp (max) -91.67% 468.000 39.000 - -91.89% -
470.lbm -91.20% 625.000 55.000 - -90.95% -
470.lbm (avg) -91.20% 625.000 55.000 - -90.95% -
433.milc (max) -91.09% 101.000 9.000 - -90.72% -
462.libquantum -90.91% 33.000 3.000 - -90.62% -
462.libquantum (avg) -90.91% 33.000 3.000 - -90.62% -
458.sjeng (unexplained diff vs previous) -89.19% 37.000 4.000 0.000 -91.67% 0.000
473.astar (unexplained diff vs previous) (percentage) -88.68% 0.530 0.060 0.000 -87.23% 0.000
470.lbm (max) (percentage) -88.36% 7.300 0.850 - -84.49% -
444.namd (unexplained diff vs previous) (percentage) -87.71% 5.370 0.660 0.000 -87.38% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -87.50% 0.320 0.040 0.000 -73.33% 0.000
447.dealII (unexplained diff vs previous) -87.50% 168.000 21.000 0.000 -69.12% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -87.35% 5.140 0.650 0.000 -86.49% 0.000
435.gromacs (unexplained diff vs previous) -84.54% 291.000 45.000 0.000 -84.59% 0.000
434.zeusmp -84.42% 231.000 36.000 - -85.88% -
434.zeusmp (avg) -84.42% 231.000 36.000 - -85.88% -
447.dealII (max) -84.24% 165.000 26.000 - -82.67% -
433.milc -83.70% 92.000 15.000 - -84.04% -
433.milc (avg) -83.70% 92.000 15.000 - -84.04% -
436.cactusADM (max) (percentage) -83.23% 4.890 0.820 - -83.76% -
434.zeusmp (unexplained diff vs previous) (percentage) -81.70% 2.350 0.430 0.000 -80.89% 0.000
450.soplex (unexplained diff vs previous) -80.00% 40.000 8.000 0.000 -88.41% 0.000
462.libquantum (max) -80.00% 15.000 3.000 - -76.92% -
410.bwaves (unexplained diff vs previous) (percentage) -79.72% 2.170 0.440 0.000 -74.71% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -78.26% 0.230 0.050 0.000 -83.33% 0.000
444.namd (max) (percentage) -75.69% 5.100 1.240 - -77.50% -
471.omnetpp (max) -74.87% 195.000 49.000 - -71.51% -
410.bwaves -74.48% 286.000 73.000 - -74.74% -
410.bwaves (avg) -74.48% 286.000 73.000 - -74.74% -
471.omnetpp (unexplained diff vs previous) -74.35% 191.000 49.000 0.000 -20.97% 0.000
410.bwaves (max) -74.27% 307.000 79.000 - -69.62% -
453.povray (unexplained diff vs previous) (percentage) -73.57% 2.800 0.740 0.000 -67.69% 0.000
459.GemsFDTD (max) -72.65% 607.000 166.000 - -71.28% -
456.hmmer (max) -69.62% 79.000 24.000 - -75.51% -
459.GemsFDTD -69.62% 339.000 103.000 - -70.74% -
459.GemsFDTD (avg) -69.62% 339.000 103.000 - -70.74% -
400.perlbench (max) -68.69% 99.000 31.000 - -65.17% -
453.povray (max) (percentage) -68.40% 2.880 0.910 - -64.86% -
400.perlbench (unexplained diff vs previous) -68.00% 25.000 8.000 0.000 -77.14% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -66.48% 1.760 0.590 0.000 -65.90% 0.000
456.hmmer (unexplained diff vs previous) -65.71% 70.000 24.000 0.000 -75.51% 0.000
470.lbm (avg) (percentage) -59.73% 3.650 1.470 - -60.59% -
447.dealII -55.00% 80.000 36.000 - -54.43% -
447.dealII (avg) -55.00% 80.000 36.000 - -54.43% -
471.omnetpp -52.68% 112.000 53.000 - -51.38% -
471.omnetpp (avg) -52.68% 112.000 53.000 - -51.38% -
437.leslie3d (unexplained diff vs previous) -48.68% 604.000 310.000 0.000 65.78% 0.000
450.soplex -47.06% 34.000 18.000 - -51.35% -
450.soplex (avg) -47.06% 34.000 18.000 - -51.35% -
416.gamess (avg) (percentage) -44.44% 1.530 0.850 - -48.48% -
436.cactusADM (avg) (percentage) -44.34% 2.210 1.230 - -48.75% -
447.dealII (unexplained diff vs previous) (percentage) -43.55% 1.860 1.050 0.000 40.00% 0.000
464.h264ref (unexplained diff vs previous) -40.91% 44.000 26.000 0.000 -55.17% 0.000
444.namd (avg) (percentage) -39.83% 2.360 1.420 - -45.38% -
456.hmmer -38.46% 52.000 32.000 - -42.86% -
456.hmmer (avg) -38.46% 52.000 32.000 - -42.86% -
434.zeusmp (max) (percentage) -37.99% 2.290 1.420 - -38.26% -
410.bwaves (avg) (percentage) -37.37% 1.980 1.240 - -36.73% -
410.bwaves (max) (percentage) -36.79% 2.120 1.340 - -24.29% -
450.soplex (max) -35.00% 40.000 26.000 - -62.32% -
482.sphinx3 (max) (percentage) -33.43% 3.500 2.330 - -26.03% -
400.perlbench -33.33% 45.000 30.000 - -30.23% -
400.perlbench (avg) -33.33% 45.000 30.000 - -30.23% -
447.dealII (max) (percentage) -28.42% 1.830 1.310 - -20.61% -
481.wrf (avg) (percentage) -24.49% 2.450 1.850 - -28.02% -
465.tonto -21.33% 150.000 118.000 - -20.27% -
465.tonto (avg) -21.33% 150.000 118.000 - -20.27% -
465.tonto (unexplained diff vs previous) -19.70% 132.000 106.000 0.000 -28.38% 0.000
482.sphinx3 (avg) (percentage) -19.57% 2.300 1.850 - -21.28% -
437.leslie3d (unexplained diff vs previous) (percentage) -19.34% 3.310 2.670 0.000 159.22% 0.000
465.tonto (avg) (percentage) -19.30% 1.140 0.920 - -19.30% -
465.tonto (unexplained diff vs previous) (percentage) -18.00% 1.000 0.820 0.000 -27.43% 0.000
471.omnetpp (max) (percentage) -17.92% 2.120 1.740 - -6.45% -
471.omnetpp (unexplained diff vs previous) (percentage) -17.79% 2.080 1.710 0.000 155.22% 0.000
429.mcf (unexplained diff vs previous) -15.00% 40.000 34.000 0.000 240.00% 0.000
429.mcf (max) -12.20% 41.000 36.000 - -2.70% -
401.bzip2 (max) -4.08% 49.000 47.000 - -29.85% -
465.tonto (max) -3.45% 232.000 224.000 - 0.45% -
465.tonto (max) (percentage) -1.14% 1.760 1.740 - 1.75% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 2.39% 48001.000 49148.000 - 2.39% -
453.povray 1.96% 489013.000 498617.000 - 1.96% -
473.astar 1.44% 15549.000 15773.000 - 1.44% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 2922.22% 0.090 2.720 0.000 700.00% 0.000
462.libquantum (max) (percentage) 1825.00% 0.080 1.540 - 1611.11% -
403.gcc (max) (percentage) 1330.51% 0.590 8.440 - 1218.75% -
450.soplex (avg) (percentage) 1162.50% 0.240 3.030 - 1277.27% -
462.libquantum (unexplained diff vs previous) (percentage) 1050.00% 0.080 0.920 0.000 9100.00% 0.000
429.mcf (avg) (percentage) 1031.25% 0.480 5.430 - 964.71% -
450.soplex (max) (percentage) 881.82% 0.440 4.320 - 1561.54% -
429.mcf (max) (percentage) 800.00% 0.320 2.880 - 722.86% -
462.libquantum (avg) (percentage) 742.11% 0.190 1.600 - 700.00% -
401.bzip2 (avg) (percentage) 688.89% 0.270 2.130 - 752.00% -
473.astar (max) (percentage) 674.47% 0.470 3.640 - 600.00% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 464.29% -
445.gobmk (avg) (percentage) 386.36% 0.220 1.070 - 365.22% -
400.perlbench (avg) (percentage) 382.05% 0.390 1.880 - 370.00% -
445.gobmk (max) (percentage) 344.44% 0.270 1.200 - 275.00% -
458.sjeng (max) (percentage) 343.33% 0.300 1.330 - 478.26% -
473.astar (avg) (percentage) 337.50% 0.400 1.750 - 348.72% -
454.calculix (max) (percentage) 334.52% 0.840 3.650 - 261.39% -
401.bzip2 (max) (percentage) 302.50% 0.400 1.610 - 455.17% -
437.leslie3d (max) (percentage) 296.13% 3.100 12.280 - 261.18% -
458.sjeng (avg) (percentage) 282.61% 0.230 0.880 - 300.00% -
429.mcf (unexplained diff vs previous) 240.00% 10.000 34.000 0.000 -15.00% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 234.15% 0.410 1.370 0.000 953.85% 0.000
450.soplex (unexplained diff vs previous) (percentage) 200.00% 0.440 1.320 0.000 407.69% 0.000
464.h264ref (max) (percentage) 194.87% 0.390 1.150 - 187.50% -
473.astar (max) 190.16% 61.000 177.000 - 164.18% -
437.leslie3d (avg) (percentage) 183.23% 1.670 4.730 - 175.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 159.22% 1.030 2.670 0.000 -19.34% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 155.22% 0.670 1.710 0.000 -17.79% 0.000
437.leslie3d (max) 154.11% 560.000 1423.000 - 129.52% -
464.h264ref (avg) (percentage) 153.85% 0.390 0.990 - 153.85% -
456.hmmer (avg) (percentage) 153.33% 0.300 0.760 - 171.43% -
400.perlbench (max) (percentage) 136.25% 0.800 1.890 - 114.77% -
435.gromacs (max) (percentage) 120.45% 1.760 3.880 - 124.28% -
458.sjeng (max) 116.67% 48.000 104.000 - 188.89% -
433.milc (avg) (percentage) 111.59% 0.690 1.460 - 114.71% -
447.dealII (avg) (percentage) 108.05% 0.870 1.810 - 103.37% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 103.57% -
435.gromacs (avg) (percentage) 102.11% 0.950 1.920 - 120.69% -
445.gobmk 100.00% 27.000 54.000 - 92.86% -
445.gobmk (avg) 100.00% 27.000 54.000 - 92.86% -
458.sjeng 88.89% 36.000 68.000 - 94.29% -
458.sjeng (avg) 88.89% 36.000 68.000 - 94.29% -
437.leslie3d 82.06% 301.000 548.000 - 74.52% -
437.leslie3d (avg) 82.06% 301.000 548.000 - 74.52% -
445.gobmk (max) 81.82% 33.000 60.000 - 53.85% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 60.00% -
483.xalancbmk (max) (percentage) 67.39% 0.920 1.540 - 50.98% -
473.astar 66.67% 51.000 85.000 - 70.00% -
473.astar (avg) 66.67% 51.000 85.000 - 70.00% -
437.leslie3d (unexplained diff vs previous) 65.78% 187.000 310.000 0.000 -48.68% 0.000
471.omnetpp (avg) (percentage) 59.32% 1.180 1.880 - 54.10% -
400.perlbench (unexplained diff vs previous) (percentage) 58.06% 0.310 0.490 0.000 122.73% 0.000
447.dealII (unexplained diff vs previous) (percentage) 40.00% 0.750 1.050 0.000 -43.55% 0.000
401.bzip2 37.78% 45.000 62.000 - 47.62% -
401.bzip2 (avg) 37.78% 45.000 62.000 - 47.62% -
433.milc (max) (percentage) 28.17% 0.710 0.910 - 21.33% -
429.mcf 19.64% 56.000 67.000 - 13.56% -
429.mcf (avg) 19.64% 56.000 67.000 - 13.56% -
464.h264ref (max) 18.64% 59.000 70.000 - 16.67% -
464.h264ref (unexplained diff vs previous) (percentage) 10.53% 0.380 0.420 0.000 44.83% 0.000
456.hmmer (max) (percentage) 7.69% 0.520 0.560 - 33.33% -
456.hmmer (unexplained diff vs previous) (percentage) 7.69% 0.520 0.560 0.000 51.35% 0.000
459.GemsFDTD (avg) (percentage) 7.19% 1.390 1.490 - 13.74% -
434.zeusmp (avg) (percentage) 6.56% 1.220 1.300 - 15.04% -
453.povray (avg) (percentage) 6.54% 1.530 1.630 - 10.88% -
459.GemsFDTD (max) (percentage) 5.26% 2.280 2.400 - 2.56% -
465.tonto (max) (percentage) 1.75% 1.710 1.740 - -1.14% -
464.h264ref 1.69% 59.000 60.000 - 1.69% -
464.h264ref (avg) 1.69% 59.000 60.000 - 1.69% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.90% 10845.000 10205.000 - -5.90% -
434.zeusmp -1.42% 141060.000 139050.000 - -1.42% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.72% 17005.000 218.000 - -98.72% -
482.sphinx3 -97.49% 36586.000 920.000 - -97.56% -
450.soplex -96.16% 15709.000 604.000 - -96.14% -
444.namd -94.29% 15957.000 911.000 - -93.98% -
453.povray -92.64% 7395.000 544.000 - -92.81% -
433.milc -92.02% 13668.000 1091.000 - -91.96% -
429.mcf -89.34% 11727.000 1250.000 - -89.33% -
436.cactusADM -89.26% 24396.000 2621.000 - -88.71% -
434.zeusmp -86.73% 20932.000 2778.000 - -86.42% -
400.perlbench -85.35% 11215.000 1643.000 - -85.40% -
401.bzip2 -82.75% 16971.000 2927.000 - -82.82% -
447.dealII -78.07% 9101.000 1996.000 - -77.90% -
456.hmmer -77.40% 18995.000 4292.000 - -77.29% -
470.lbm -77.03% 16312.000 3747.000 - -78.13% -
459.GemsFDTD -72.71% 25364.000 6923.000 - -73.32% -
471.omnetpp -69.14% 9265.000 2859.000 - -68.93% -
473.astar -62.42% 12983.000 4879.000 - -62.24% -
410.bwaves -59.77% 14745.000 5932.000 - -59.06% -
464.h264ref -59.49% 15208.000 6161.000 - -59.33% -
445.gobmk -59.15% 12396.000 5064.000 - -59.21% -
435.gromacs -54.97% 16853.000 7589.000 - -54.18% -
458.sjeng -51.07% 16018.000 7837.000 - -50.93% -
437.leslie3d -35.87% 18070.000 11589.000 - -36.52% -
465.tonto -1.13% 13044.000 12896.000 - -2.24% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.82% 1118.000 2.000 0.000 -99.84% 0.000
444.namd (unexplained diff vs previous) -99.28% 834.000 6.000 0.000 -99.26% 0.000
470.lbm (unexplained diff vs previous) -99.27% 822.000 6.000 0.000 -99.48% 0.000
459.GemsFDTD (unexplained diff vs previous) -98.80% 584.000 7.000 0.000 -98.42% 0.000
444.namd (max) -98.75% 879.000 11.000 - -98.57% -
436.cactusADM (unexplained diff vs previous) -98.55% 1173.000 17.000 0.000 -98.58% 0.000
436.cactusADM (max) -98.29% 1231.000 21.000 - -98.15% -
482.sphinx3 (max) -98.18% 1152.000 21.000 - -98.41% -
482.sphinx3 -98.02% 859.000 17.000 - -98.04% -
482.sphinx3 (avg) -98.02% 859.000 17.000 - -98.04% -
453.povray (max) -97.91% 191.000 4.000 - -98.16% -
453.povray (unexplained diff vs previous) -97.63% 169.000 4.000 0.000 -98.11% 0.000
434.zeusmp (unexplained diff vs previous) -97.45% 470.000 12.000 0.000 -97.50% 0.000
444.namd -97.10% 414.000 12.000 - -96.63% -
444.namd (avg) -97.10% 414.000 12.000 - -96.63% -
470.lbm (unexplained diff vs previous) (percentage) -96.83% 5.040 0.160 0.000 -97.65% 0.000
470.lbm (max) -96.53% 893.000 31.000 - -97.52% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -95.65% 2.300 0.100 0.000 -94.15% 0.000
416.gamess (max) (percentage) -95.54% 3.140 0.140 - -95.69% -
473.astar (unexplained diff vs previous) -95.08% 61.000 3.000 0.000 -95.59% 0.000
436.cactusADM -94.53% 585.000 32.000 - -93.76% -
436.cactusADM (avg) -94.53% 585.000 32.000 - -93.76% -
481.wrf (max) (percentage) -93.75% 4.160 0.260 - -94.37% -
453.povray -92.92% 113.000 8.000 - -92.79% -
453.povray (avg) -92.92% 113.000 8.000 - -92.79% -
482.sphinx3 (unexplained diff vs previous) (percentage) -92.81% 3.060 0.220 0.000 -93.49% 0.000
434.zeusmp (max) -91.89% 481.000 39.000 - -91.67% -
458.sjeng (unexplained diff vs previous) -91.67% 48.000 4.000 0.000 -89.19% 0.000
470.lbm -90.95% 608.000 55.000 - -91.20% -
470.lbm (avg) -90.95% 608.000 55.000 - -91.20% -
433.milc (max) -90.72% 97.000 9.000 - -91.09% -
462.libquantum -90.62% 32.000 3.000 - -90.91% -
462.libquantum (avg) -90.62% 32.000 3.000 - -90.91% -
410.bwaves (unexplained diff vs previous) -89.88% 257.000 26.000 0.000 -91.72% 0.000
445.gobmk (unexplained diff vs previous) -88.89% 18.000 2.000 0.000 -95.00% 0.000
450.soplex (unexplained diff vs previous) -88.41% 69.000 8.000 0.000 -80.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -87.38% 5.230 0.660 0.000 -87.71% 0.000
473.astar (unexplained diff vs previous) (percentage) -87.23% 0.470 0.060 0.000 -88.68% 0.000
436.cactusADM (unexplained diff vs previous) (percentage) -86.49% 4.810 0.650 0.000 -87.35% 0.000
434.zeusmp -85.88% 255.000 36.000 - -84.42% -
434.zeusmp (avg) -85.88% 255.000 36.000 - -84.42% -
462.libquantum (unexplained diff vs previous) -85.71% 14.000 2.000 0.000 100.00% 0.000
435.gromacs (unexplained diff vs previous) -84.59% 292.000 45.000 0.000 -84.54% 0.000
470.lbm (max) (percentage) -84.49% 5.480 0.850 - -88.36% -
433.milc -84.04% 94.000 15.000 - -83.70% -
433.milc (avg) -84.04% 94.000 15.000 - -83.70% -
436.cactusADM (max) (percentage) -83.76% 5.050 0.820 - -83.23% -
458.sjeng (unexplained diff vs previous) (percentage) -83.33% 0.300 0.050 0.000 -78.26% 0.000
447.dealII (max) -82.67% 150.000 26.000 - -84.24% -
434.zeusmp (unexplained diff vs previous) (percentage) -80.89% 2.250 0.430 0.000 -81.70% 0.000
444.namd (max) (percentage) -77.50% 5.510 1.240 - -75.69% -
400.perlbench (unexplained diff vs previous) -77.14% 35.000 8.000 0.000 -68.00% 0.000
462.libquantum (max) -76.92% 13.000 3.000 - -80.00% -
456.hmmer (max) -75.51% 98.000 24.000 - -69.62% -
456.hmmer (unexplained diff vs previous) -75.51% 98.000 24.000 0.000 -65.71% 0.000
410.bwaves -74.74% 289.000 73.000 - -74.48% -
410.bwaves (avg) -74.74% 289.000 73.000 - -74.48% -
410.bwaves (unexplained diff vs previous) (percentage) -74.71% 1.740 0.440 0.000 -79.72% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -73.33% 0.150 0.040 0.000 -87.50% 0.000
471.omnetpp (max) -71.51% 172.000 49.000 - -74.87% -
459.GemsFDTD (max) -71.28% 578.000 166.000 - -72.65% -
459.GemsFDTD -70.74% 352.000 103.000 - -69.62% -
459.GemsFDTD (avg) -70.74% 352.000 103.000 - -69.62% -
410.bwaves (max) -69.62% 260.000 79.000 - -74.27% -
447.dealII (unexplained diff vs previous) -69.12% 68.000 21.000 0.000 -87.50% 0.000
453.povray (unexplained diff vs previous) (percentage) -67.69% 2.290 0.740 0.000 -73.57% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -65.90% 1.730 0.590 0.000 -66.48% 0.000
400.perlbench (max) -65.17% 89.000 31.000 - -68.69% -
453.povray (max) (percentage) -64.86% 2.590 0.910 - -68.40% -
450.soplex (max) -62.32% 69.000 26.000 - -35.00% -
470.lbm (avg) (percentage) -60.59% 3.730 1.470 - -59.73% -
464.h264ref (unexplained diff vs previous) -55.17% 58.000 26.000 0.000 -40.91% 0.000
447.dealII -54.43% 79.000 36.000 - -55.00% -
447.dealII (avg) -54.43% 79.000 36.000 - -55.00% -
471.omnetpp -51.38% 109.000 53.000 - -52.68% -
471.omnetpp (avg) -51.38% 109.000 53.000 - -52.68% -
450.soplex -51.35% 37.000 18.000 - -47.06% -
450.soplex (avg) -51.35% 37.000 18.000 - -47.06% -
436.cactusADM (avg) (percentage) -48.75% 2.400 1.230 - -44.34% -
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - -44.44% -
444.namd (avg) (percentage) -45.38% 2.600 1.420 - -39.83% -
456.hmmer -42.86% 56.000 32.000 - -38.46% -
456.hmmer (avg) -42.86% 56.000 32.000 - -38.46% -
401.bzip2 (unexplained diff vs previous) -42.03% 69.000 40.000 0.000 73.91% 0.000
434.zeusmp (max) (percentage) -38.26% 2.300 1.420 - -37.99% -
410.bwaves (avg) (percentage) -36.73% 1.960 1.240 - -37.37% -
400.perlbench -30.23% 43.000 30.000 - -33.33% -
400.perlbench (avg) -30.23% 43.000 30.000 - -33.33% -
401.bzip2 (max) -29.85% 67.000 47.000 - -4.08% -
465.tonto (unexplained diff vs previous) -28.38% 148.000 106.000 0.000 -19.70% 0.000
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - -24.49% -
465.tonto (unexplained diff vs previous) (percentage) -27.43% 1.130 0.820 0.000 -18.00% 0.000
482.sphinx3 (max) (percentage) -26.03% 3.150 2.330 - -33.43% -
410.bwaves (max) (percentage) -24.29% 1.770 1.340 - -36.79% -
482.sphinx3 (avg) (percentage) -21.28% 2.350 1.850 - -19.57% -
471.omnetpp (unexplained diff vs previous) -20.97% 62.000 49.000 0.000 -74.35% 0.000
447.dealII (max) (percentage) -20.61% 1.650 1.310 - -28.42% -
465.tonto -20.27% 148.000 118.000 - -21.33% -
465.tonto (avg) -20.27% 148.000 118.000 - -21.33% -
465.tonto (avg) (percentage) -19.30% 1.140 0.920 - -19.30% -
435.gromacs -9.38% 160.000 145.000 - 0.69% -
435.gromacs (avg) -9.38% 160.000 145.000 - 0.69% -
471.omnetpp (max) (percentage) -6.45% 1.860 1.740 - -17.92% -
429.mcf (max) -2.70% 37.000 36.000 - -12.20% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)

Report Time: 0.39s
Execution (seconds)
Name Current %
400.perlbench 1643.000 -85.40%
401.bzip2 2927.000 -82.82%
410.bwaves 5932.000 -59.06%
429.mcf 1250.000 -89.33%
433.milc 1091.000 -91.96%
434.zeusmp 2778.000 -86.42%
435.gromacs 7589.000 -54.18%
436.cactusADM 2621.000 -88.71%
437.leslie3d 11589.000 -36.52%
444.namd 911.000 -93.98%
445.gobmk 5064.000 -59.21%
447.dealII 1996.000 -77.90%
450.soplex 604.000 -96.14%
453.povray 544.000 -92.81%
456.hmmer 4292.000 -77.29%
458.sjeng 7837.000 -50.93%
459.GemsFDTD 6923.000 -73.32%
462.libquantum 218.000 -98.72%
464.h264ref 6161.000 -59.33%
465.tonto 12896.000 -2.24%
470.lbm 3747.000 -78.13%
471.omnetpp 2859.000 -68.93%
473.astar 4879.000 -62.24%
482.sphinx3 920.000 -97.56%
Geometric Mean 2651.785 -82.64%
Code Size (bytes)
Name Current %
400.perlbench 566574.000 -
401.bzip2 33510.000 -
410.bwaves 14683.000 -
429.mcf 7701.000 -
433.milc 47893.000 -
434.zeusmp 139050.000 -1.42%
435.gromacs 394046.000 -
436.cactusADM 257954.000 -
437.leslie3d 49148.000 2.39%
444.namd 163211.000 -
445.gobmk 1089616.000 -
447.dealII 192502.000 -
450.soplex 136204.000 -
453.povray 498617.000 1.96%
456.hmmer 74741.000 -
458.sjeng 81605.000 -
459.GemsFDTD 196923.000 -
462.libquantum 13134.000 -
464.h264ref 301698.000 -
465.tonto 1435593.000 -
470.lbm 10205.000 -5.90%
471.omnetpp 297217.000 -
473.astar 15773.000 1.44%
482.sphinx3 79750.000 -
Geometric Mean 106295.435 -
Score
Name Current %
nb_compile_successful 48.000 65.52%
nb_execution_successful 48.000 65.52%
nb_total_tests 68.000 134.48%
Geometric Mean 53.909 85.89%
sample variability
Name Current %
400.perlbench 30.000 -33.33%
400.perlbench (avg) 30.000 -33.33%
400.perlbench (avg) (percentage) 1.880 370.00%
400.perlbench (max) 31.000 -68.69%
400.perlbench (max) (percentage) 1.890 114.77%
400.perlbench (unexplained diff vs previous) 8.000 -68.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.490 122.73%
401.bzip2 62.000 47.62%
401.bzip2 (avg) 62.000 47.62%
401.bzip2 (avg) (percentage) 2.130 752.00%
401.bzip2 (max) 47.000 -4.08%
401.bzip2 (max) (percentage) 1.610 455.17%
401.bzip2 (unexplained diff vs previous) 40.000 73.91%
401.bzip2 (unexplained diff vs previous) (percentage) 1.370 953.85%
403.gcc (avg) (percentage) 2.370 464.29%
403.gcc (max) (percentage) 8.440 1218.75%
410.bwaves 73.000 -74.48%
410.bwaves (avg) 73.000 -74.48%
410.bwaves (avg) (percentage) 1.240 -37.37%
410.bwaves (max) 79.000 -74.27%
410.bwaves (max) (percentage) 1.340 -36.79%
410.bwaves (unexplained diff vs previous) 26.000 -91.72%
410.bwaves (unexplained diff vs previous) (percentage) 0.440 -79.72%
416.gamess (avg) (percentage) 0.850 -44.44%
416.gamess (max) (percentage) 0.140 -95.69%
429.mcf 67.000 13.56%
429.mcf (avg) 67.000 13.56%
429.mcf (avg) (percentage) 5.430 964.71%
429.mcf (max) 36.000 -12.20%
429.mcf (max) (percentage) 2.880 722.86%
429.mcf (unexplained diff vs previous) 34.000 -15.00%
429.mcf (unexplained diff vs previous) (percentage) 2.720 700.00%
433.milc 15.000 -83.70%
433.milc (avg) 15.000 -83.70%
433.milc (avg) (percentage) 1.460 114.71%
433.milc (max) 9.000 -91.09%
433.milc (max) (percentage) 0.910 21.33%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
434.zeusmp 36.000 -84.42%
434.zeusmp (avg) 36.000 -84.42%
434.zeusmp (avg) (percentage) 1.300 15.04%
434.zeusmp (max) 39.000 -91.67%
434.zeusmp (max) (percentage) 1.420 -37.99%
434.zeusmp (unexplained diff vs previous) 12.000 -97.50%
434.zeusmp (unexplained diff vs previous) (percentage) 0.430 -81.70%
435.gromacs 145.000 -
435.gromacs (avg) 145.000 -
435.gromacs (avg) (percentage) 1.920 120.69%
435.gromacs (max) 294.000 2.80%
435.gromacs (max) (percentage) 3.880 124.28%
435.gromacs (unexplained diff vs previous) 45.000 -84.54%
435.gromacs (unexplained diff vs previous) (percentage) 0.590 -66.48%
436.cactusADM 32.000 -93.76%
436.cactusADM (avg) 32.000 -93.76%
436.cactusADM (avg) (percentage) 1.230 -44.34%
436.cactusADM (max) 21.000 -98.15%
436.cactusADM (max) (percentage) 0.820 -83.23%
436.cactusADM (unexplained diff vs previous) 17.000 -98.58%
436.cactusADM (unexplained diff vs previous) (percentage) 0.650 -87.35%
437.leslie3d 548.000 74.52%
437.leslie3d (avg) 548.000 74.52%
437.leslie3d (avg) (percentage) 4.730 175.00%
437.leslie3d (max) 1423.000 129.52%
437.leslie3d (max) (percentage) 12.280 261.18%
437.leslie3d (unexplained diff vs previous) 310.000 -48.68%
437.leslie3d (unexplained diff vs previous) (percentage) 2.670 -19.34%
444.namd 12.000 -96.63%
444.namd (avg) 12.000 -96.63%
444.namd (avg) (percentage) 1.420 -39.83%
444.namd (max) 11.000 -98.57%
444.namd (max) (percentage) 1.240 -75.69%
444.namd (unexplained diff vs previous) 6.000 -99.26%
444.namd (unexplained diff vs previous) (percentage) 0.660 -87.71%
445.gobmk 54.000 92.86%
445.gobmk (avg) 54.000 92.86%
445.gobmk (avg) (percentage) 1.070 365.22%
445.gobmk (max) 60.000 53.85%
445.gobmk (max) (percentage) 1.200 275.00%
445.gobmk (unexplained diff vs previous) 2.000 -95.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.040 -87.50%
447.dealII 36.000 -55.00%
447.dealII (avg) 36.000 -55.00%
447.dealII (avg) (percentage) 1.810 103.37%
447.dealII (max) 26.000 -84.24%
447.dealII (max) (percentage) 1.310 -28.42%
447.dealII (unexplained diff vs previous) 21.000 -87.50%
447.dealII (unexplained diff vs previous) (percentage) 1.050 -43.55%
450.soplex 18.000 -47.06%
450.soplex (avg) 18.000 -47.06%
450.soplex (avg) (percentage) 3.030 1277.27%
450.soplex (max) 26.000 -35.00%
450.soplex (max) (percentage) 4.320 1561.54%
450.soplex (unexplained diff vs previous) 8.000 -80.00%
450.soplex (unexplained diff vs previous) (percentage) 1.320 407.69%
453.povray 8.000 -92.79%
453.povray (avg) 8.000 -92.79%
453.povray (avg) (percentage) 1.630 10.88%
453.povray (max) 4.000 -98.16%
453.povray (max) (percentage) 0.910 -68.40%
453.povray (unexplained diff vs previous) 4.000 -98.11%
453.povray (unexplained diff vs previous) (percentage) 0.740 -73.57%
454.calculix (avg) (percentage) 3.440 60.00%
454.calculix (max) (percentage) 3.650 261.39%
456.hmmer 32.000 -38.46%
456.hmmer (avg) 32.000 -38.46%
456.hmmer (avg) (percentage) 0.760 171.43%
456.hmmer (max) 24.000 -69.62%
456.hmmer (max) (percentage) 0.560 33.33%
456.hmmer (unexplained diff vs previous) 24.000 -65.71%
456.hmmer (unexplained diff vs previous) (percentage) 0.560 51.35%
458.sjeng 68.000 94.29%
458.sjeng (avg) 68.000 94.29%
458.sjeng (avg) (percentage) 0.880 300.00%
458.sjeng (max) 104.000 188.89%
458.sjeng (max) (percentage) 1.330 478.26%
458.sjeng (unexplained diff vs previous) 4.000 -89.19%
458.sjeng (unexplained diff vs previous) (percentage) 0.050 -78.26%
459.GemsFDTD 103.000 -69.62%
459.GemsFDTD (avg) 103.000 -69.62%
459.GemsFDTD (avg) (percentage) 1.490 13.74%
459.GemsFDTD (max) 166.000 -72.65%
459.GemsFDTD (max) (percentage) 2.400 2.56%
459.GemsFDTD (unexplained diff vs previous) 7.000 -98.42%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.100 -94.15%
462.libquantum 3.000 -90.91%
462.libquantum (avg) 3.000 -90.91%
462.libquantum (avg) (percentage) 1.600 700.00%
462.libquantum (max) 3.000 -80.00%
462.libquantum (max) (percentage) 1.540 1611.11%
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.920 9100.00%
464.h264ref 60.000 1.69%
464.h264ref (avg) 60.000 1.69%
464.h264ref (avg) (percentage) 0.990 153.85%
464.h264ref (max) 70.000 16.67%
464.h264ref (max) (percentage) 1.150 187.50%
464.h264ref (unexplained diff vs previous) 26.000 -40.91%
464.h264ref (unexplained diff vs previous) (percentage) 0.420 44.83%
465.tonto 118.000 -21.33%
465.tonto (avg) 118.000 -21.33%
465.tonto (avg) (percentage) 0.920 -19.30%
465.tonto (max) 224.000 -3.45%
465.tonto (max) (percentage) 1.740 -1.14%
465.tonto (unexplained diff vs previous) 106.000 -19.70%
465.tonto (unexplained diff vs previous) (percentage) 0.820 -18.00%
470.lbm 55.000 -91.20%
470.lbm (avg) 55.000 -91.20%
470.lbm (avg) (percentage) 1.470 -59.73%
470.lbm (max) 31.000 -97.52%
470.lbm (max) (percentage) 0.850 -88.36%
470.lbm (unexplained diff vs previous) 6.000 -99.48%
470.lbm (unexplained diff vs previous) (percentage) 0.160 -97.65%
471.omnetpp 53.000 -52.68%
471.omnetpp (avg) 53.000 -52.68%
471.omnetpp (avg) (percentage) 1.880 54.10%
471.omnetpp (max) 49.000 -74.87%
471.omnetpp (max) (percentage) 1.740 -17.92%
471.omnetpp (unexplained diff vs previous) 49.000 -74.35%
471.omnetpp (unexplained diff vs previous) (percentage) 1.710 -17.79%
473.astar 85.000 70.00%
473.astar (avg) 85.000 70.00%
473.astar (avg) (percentage) 1.750 348.72%
473.astar (max) 177.000 164.18%
473.astar (max) (percentage) 3.640 600.00%
473.astar (unexplained diff vs previous) 3.000 -95.59%
473.astar (unexplained diff vs previous) (percentage) 0.060 -88.68%
481.wrf (avg) (percentage) 1.850 -24.49%
481.wrf (max) (percentage) 0.260 -94.37%
482.sphinx3 17.000 -98.04%
482.sphinx3 (avg) 17.000 -98.04%
482.sphinx3 (avg) (percentage) 1.850 -19.57%
482.sphinx3 (max) 21.000 -98.41%
482.sphinx3 (max) (percentage) 2.330 -33.43%
482.sphinx3 (unexplained diff vs previous) 2.000 -99.84%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.220 -93.49%
483.xalancbmk (avg) (percentage) 1.140 103.57%
483.xalancbmk (max) (percentage) 1.540 50.98%
Geometric Mean 6.059 -54.91%