Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1485a3fb63619cced99dd7a4a043cf01a0f423d9 (+ 68 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/370432688259aed1c99f9b29d8d09e534fb94037 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b6e3898194bbae78910bbe9cd086937014961e45 (+ 31 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=168ae884213784273f58b77c07df2c1b8c68ae18 (+ 338 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/151/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0151 (3-changed-components) 2024-02-24T21:37:40 0:00:00
Previous 0150 (2-changed-components) 2022-09-10T23:06:38 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 46 80
Performance Improvements 189 158
Added Tests 1 1
Unchanged Tests 1000 997
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 3.10% 48073.000 49564.000 - 3.26% -
453.povray 2.04% 489143.000 499105.000 - 2.06% -
416.gamess 1.69% 4554584.000 4631717.000 - 1.69% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
403.gcc 1.14% 1585641.000 1603710.000 - 0.86% -
447.dealII 1.08% 191138.000 193202.000 - 1.08% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 24.18% 10460.000 12989.000 - -0.42% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) (percentage) 725.00% 0.200 1.650 - 432.26% -
429.mcf (unexplained diff vs previous) (percentage) 692.16% 0.510 4.040 - 4388.89% -
450.soplex (unexplained diff vs previous) (percentage) 665.38% 0.260 1.990 - 352.27% -
400.perlbench (avg) (percentage) 447.22% 0.360 1.970 - 405.13% -
437.leslie3d (max) (percentage) 388.24% 2.380 11.620 - 274.84% -
400.perlbench (max) (percentage) 342.11% 0.380 1.680 - 110.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 326.64% 2.440 10.410 - 910.68% -
403.gcc (max) (percentage) 319.73% 2.230 9.360 - 1486.44% -
462.libquantum (unexplained diff vs previous) (percentage) 308.33% 0.120 0.490 - 512.50% -
450.soplex (avg) (percentage) 307.59% 0.790 3.220 - 1241.67% -
471.omnetpp (unexplained diff vs previous) (percentage) 290.91% 0.440 1.720 - 156.72% -
445.gobmk (avg) (percentage) 278.12% 0.320 1.210 - 450.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 258.73% 0.630 2.260 - 451.22% -
437.leslie3d (max) 252.26% 421.000 1483.000 - 164.82% -
437.leslie3d (unexplained diff vs previous) 206.93% 433.000 1329.000 - 610.70% -
437.leslie3d (avg) (percentage) 175.33% 1.500 4.130 - 147.31% -
403.gcc (avg) (percentage) 141.84% 0.980 2.370 - 451.16% -
403.gcc (unexplained diff vs previous) (percentage) 120.51% 0.780 1.720 - 196.55% -
437.leslie3d 98.87% 265.000 527.000 - 75.08% -
437.leslie3d (avg) 98.87% 265.000 527.000 - 75.08% -
473.astar (unexplained diff vs previous) (percentage) 93.88% 0.490 0.950 - 102.13% -
462.libquantum (avg) (percentage) 93.26% 0.890 1.720 - 805.26% -
401.bzip2 (avg) (percentage) 87.20% 1.250 2.340 - 766.67% -
473.astar (avg) (percentage) 83.33% 1.020 1.870 - 367.50% -
450.soplex (max) (percentage) 79.67% 2.460 4.420 - 904.55% -
429.mcf (avg) (percentage) 67.03% 3.640 6.080 - 1166.67% -
445.gobmk 56.41% 39.000 61.000 - 125.93% -
445.gobmk (avg) 56.41% 39.000 61.000 - 125.93% -
456.hmmer (avg) (percentage) 54.55% 0.550 0.850 - 183.33% -
445.gobmk (max) (percentage) 52.94% 0.340 0.520 - 92.59% -
447.dealII (avg) (percentage) 43.66% 1.420 2.040 - 134.48% -
447.dealII (unexplained diff vs previous) (percentage) 36.64% 1.310 1.790 - 138.67% -
429.mcf (max) (percentage) 21.27% 15.330 18.590 - 5709.38% -
471.omnetpp (unexplained diff vs previous) 20.00% 40.000 48.000 - -22.58% -
400.perlbench (unexplained diff vs previous) 17.39% 23.000 27.000 - -22.86% -
433.milc (avg) (percentage) 11.46% 1.570 1.750 - 153.62% -
434.zeusmp (avg) (percentage) 6.43% 1.400 1.490 - 22.13% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.75% 10845.000 10221.000 - -5.75% -
434.zeusmp -3.58% 144364.000 139198.000 - -1.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -99.80% 30087.000 59.000 - -99.82% -
403.gcc -99.36% 9059.000 58.000 - -99.35% -
462.libquantum -98.79% 16959.000 206.000 - -98.79% -
482.sphinx3 -97.58% 37666.000 912.000 - -97.51% -
450.soplex -96.15% 15682.000 604.000 - -96.16% -
444.namd -94.05% 15138.000 901.000 - -94.35% -
453.povray -92.83% 7561.000 542.000 - -92.67% -
433.milc -91.94% 13638.000 1099.000 - -91.96% -
429.mcf -91.84% 11842.000 966.000 - -91.76% -
436.cactusADM -88.76% 23266.000 2614.000 - -89.29% -
434.zeusmp -86.41% 20612.000 2801.000 - -86.62% -
400.perlbench -85.58% 11345.000 1636.000 - -85.41% -
401.bzip2 -82.41% 17089.000 3006.000 - -82.29% -
447.dealII -78.83% 8991.000 1903.000 - -79.09% -
470.lbm -78.13% 17146.000 3749.000 - -77.02% -
456.hmmer -77.01% 19761.000 4544.000 - -76.08% -
459.GemsFDTD -72.48% 25964.000 7146.000 - -71.83% -
481.wrf -71.92% 22918.000 6435.000 - -70.74% -
471.omnetpp -69.22% 9063.000 2790.000 - -69.89% -
473.astar -62.43% 12939.000 4861.000 - -62.56% -
410.bwaves -60.94% 15163.000 5922.000 - -59.84% -
445.gobmk -58.88% 12427.000 5110.000 - -58.78% -
464.h264ref -58.72% 15025.000 6202.000 - -59.22% -
435.gromacs -54.95% 16656.000 7504.000 - -55.47% -
458.sjeng -51.29% 16179.000 7881.000 - -50.80% -
416.gamess -48.15% 28556.000 14807.000 - -49.65% -
437.leslie3d -27.98% 17728.000 12768.000 - -29.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (max) -99.94% 1751.000 1.000 - -99.63% -
454.calculix (unexplained diff vs previous) -99.94% 1656.000 1.000 - -99.59% -
454.calculix -99.85% 1377.000 2.000 - -99.70% -
454.calculix (avg) -99.85% 1377.000 2.000 - -99.70% -
482.sphinx3 (max) -99.62% 3461.000 13.000 - -98.87% -
433.milc (unexplained diff vs previous) -99.57% 231.000 1.000 - -98.96% -
470.lbm (unexplained diff vs previous) -99.17% 839.000 7.000 - -99.15% -
444.namd (unexplained diff vs previous) -99.11% 784.000 7.000 - -99.16% -
444.namd (max) -99.06% 744.000 7.000 - -99.20% -
482.sphinx3 -98.93% 1676.000 18.000 - -97.90% -
482.sphinx3 (avg) -98.93% 1676.000 18.000 - -97.90% -
403.gcc -98.86% 88.000 1.000 - -97.37% -
403.gcc (avg) -98.86% 88.000 1.000 - -97.37% -
436.cactusADM (unexplained diff vs previous) -98.86% 1144.000 13.000 - -98.89% -
482.sphinx3 (unexplained diff vs previous) -98.82% 1190.000 14.000 - -98.75% -
436.cactusADM (max) -98.81% 1091.000 13.000 - -98.94% -
453.povray (unexplained diff vs previous) -98.60% 143.000 2.000 - -98.82% -
403.gcc (unexplained diff vs previous) -98.59% 71.000 1.000 - -98.08% -
481.wrf (unexplained diff vs previous) -98.27% 865.000 15.000 - -98.32% -
456.hmmer (unexplained diff vs previous) -98.08% 156.000 3.000 - -96.94% -
462.libquantum -98.00% 150.000 3.000 - -90.62% -
462.libquantum (avg) -98.00% 150.000 3.000 - -90.62% -
444.namd -97.81% 638.000 14.000 - -96.62% -
444.namd (avg) -97.81% 638.000 14.000 - -96.62% -
403.gcc (max) -97.52% 202.000 5.000 - -90.38% -
470.lbm (max) -97.28% 883.000 24.000 - -97.31% -
453.povray (max) -97.04% 406.000 12.000 - -93.72% -
434.zeusmp (unexplained diff vs previous) -96.72% 396.000 13.000 - -97.23% -
471.omnetpp (max) -96.70% 1424.000 47.000 - -72.67% -
416.gamess (unexplained diff vs previous) -96.59% 908.000 31.000 - -96.54% -
464.h264ref (max) -96.56% 931.000 32.000 - -45.76% -
416.gamess (max) -96.47% 879.000 31.000 - -96.64% -
470.lbm (unexplained diff vs previous) (percentage) -96.11% 4.890 0.190 - -96.23% -
453.povray -96.07% 229.000 9.000 - -92.04% -
453.povray (avg) -96.07% 229.000 9.000 - -92.04% -
481.wrf (max) -95.99% 898.000 36.000 - -96.06% -
433.milc (max) -95.99% 274.000 11.000 - -88.66% -
462.libquantum (unexplained diff vs previous) -95.24% 21.000 1.000 - -92.86% -
433.milc (unexplained diff vs previous) (percentage) -94.67% 1.690 0.090 - -87.14% -
459.GemsFDTD (max) -94.54% 1025.000 56.000 - -90.31% -
456.hmmer (max) -94.16% 154.000 9.000 - -90.82% -
436.cactusADM -94.11% 611.000 36.000 - -93.85% -
436.cactusADM (avg) -94.11% 611.000 36.000 - -93.85% -
481.wrf (unexplained diff vs previous) (percentage) -93.90% 3.770 0.230 - -94.35% -
464.h264ref (unexplained diff vs previous) -93.59% 78.000 5.000 - -91.38% -
416.gamess (unexplained diff vs previous) (percentage) -93.40% 3.180 0.210 - -93.11% -
450.soplex (max) -93.25% 385.000 26.000 - -62.32% -
416.gamess (max) (percentage) -93.18% 3.080 0.210 - -93.31% -
434.zeusmp (max) -92.76% 387.000 28.000 - -94.18% -
459.GemsFDTD (unexplained diff vs previous) -92.44% 582.000 44.000 - -92.47% -
410.bwaves (max) -91.63% 621.000 52.000 - -80.00% -
464.h264ref (max) (percentage) -91.61% 6.200 0.520 - 33.33% -
456.hmmer (unexplained diff vs previous) (percentage) -91.14% 0.790 0.070 - -86.54% -
433.milc -91.12% 214.000 19.000 - -79.79% -
433.milc (avg) -91.12% 214.000 19.000 - -79.79% -
401.bzip2 (max) -90.51% 727.000 69.000 - 2.99% -
429.mcf (max) -90.14% 1815.000 179.000 - 383.78% -
436.cactusADM (unexplained diff vs previous) (percentage) -89.84% 4.920 0.500 - -89.60% -
436.cactusADM (max) (percentage) -89.34% 4.690 0.500 - -90.10% -
471.omnetpp (max) (percentage) -89.25% 15.720 1.690 - -9.14% -
435.gromacs (max) -88.91% 1082.000 120.000 - -59.46% -
458.sjeng (max) -88.40% 474.000 55.000 - 14.58% -
470.lbm -88.14% 531.000 63.000 - -89.64% -
470.lbm (avg) -88.14% 531.000 63.000 - -89.64% -
470.lbm (max) (percentage) -87.18% 5.150 0.660 - -87.96% -
429.mcf -86.54% 431.000 58.000 - 3.57% -
429.mcf (avg) -86.54% 431.000 58.000 - 3.57% -
434.zeusmp -85.76% 288.000 41.000 - -83.92% -
434.zeusmp (avg) -85.76% 288.000 41.000 - -83.92% -
481.wrf (max) (percentage) -85.46% 3.920 0.570 - -86.30% -
481.wrf -85.33% 845.000 124.000 - -78.05% -
481.wrf (avg) -85.33% 845.000 124.000 - -78.05% -
471.omnetpp -85.29% 374.000 55.000 - -49.54% -
471.omnetpp (avg) -85.29% 374.000 55.000 - -49.54% -
462.libquantum (max) (percentage) -85.14% 3.230 0.480 - 500.00% -
444.namd (unexplained diff vs previous) (percentage) -84.94% 5.180 0.780 - -85.09% -
473.astar (max) -84.66% 339.000 52.000 - -14.75% -
464.h264ref (unexplained diff vs previous) (percentage) -84.62% 0.520 0.080 - -78.95% -
450.soplex -84.55% 123.000 19.000 - -48.65% -
450.soplex (avg) -84.55% 123.000 19.000 - -48.65% -
444.namd (max) (percentage) -84.15% 4.920 0.780 - -85.84% -
482.sphinx3 (max) (percentage) -83.57% 9.190 1.510 - -52.06% -
459.GemsFDTD -81.89% 646.000 117.000 - -66.76% -
459.GemsFDTD (avg) -81.89% 646.000 117.000 - -66.76% -
447.dealII (max) -80.79% 177.000 34.000 - -77.33% -
453.povray (unexplained diff vs previous) (percentage) -80.42% 1.890 0.370 - -83.84% -
459.GemsFDTD (max) (percentage) -80.00% 3.950 0.790 - -65.35% -
410.bwaves (max) (percentage) -78.54% 4.100 0.880 - -50.28% -
416.gamess -77.14% 573.000 131.000 - -72.99% -
416.gamess (avg) -77.14% 573.000 131.000 - -72.99% -
458.sjeng (max) (percentage) -76.11% 2.930 0.700 - 133.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -76.04% 1.920 0.460 - -79.56% -
464.h264ref -75.44% 285.000 70.000 - 18.64% -
464.h264ref (avg) -75.44% 285.000 70.000 - 18.64% -
435.gromacs (max) (percentage) -75.23% 6.500 1.610 - -8.52% -
456.hmmer (max) (percentage) -74.36% 0.780 0.200 - -61.54% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -72.32% 2.240 0.620 - -73.04% -
483.xalancbmk (max) (percentage) -71.92% 5.520 1.550 - 68.48% -
410.bwaves -71.38% 283.000 81.000 - -71.97% -
410.bwaves (avg) -71.38% 283.000 81.000 - -71.97% -
447.dealII (unexplained diff vs previous) -71.19% 118.000 34.000 - -50.00% -
450.soplex (unexplained diff vs previous) -70.73% 41.000 12.000 - -82.61% -
447.dealII -70.08% 127.000 38.000 - -51.90% -
447.dealII (avg) -70.08% 127.000 38.000 - -51.90% -
454.calculix (unexplained diff vs previous) (percentage) -69.27% 5.500 1.690 - 125.33% -
401.bzip2 -67.14% 213.000 70.000 - 55.56% -
401.bzip2 (avg) -67.14% 213.000 70.000 - 55.56% -
445.gobmk (unexplained diff vs previous) -65.79% 38.000 13.000 - -27.78% -
435.gromacs -65.31% 441.000 153.000 - -4.38% -
435.gromacs (avg) -65.31% 441.000 153.000 - -4.38% -
410.bwaves (unexplained diff vs previous) -65.19% 135.000 47.000 - -81.71% -
465.tonto (max) (percentage) -64.84% 2.190 0.770 - -54.97% -
456.hmmer -64.81% 108.000 38.000 - -32.14% -
456.hmmer (avg) -64.81% 108.000 38.000 - -32.14% -
435.gromacs (unexplained diff vs previous) -64.08% 245.000 88.000 - -69.86% -
465.tonto (unexplained diff vs previous) (percentage) -62.19% 2.010 0.760 - -32.74% -
444.namd (avg) (percentage) -62.09% 4.220 1.600 - -38.46% -
473.astar (max) (percentage) -58.78% 2.620 1.080 - 129.79% -
453.povray (max) (percentage) -58.10% 5.370 2.250 - -13.13% -
465.tonto (max) -56.33% 229.000 100.000 - -55.16% -
458.sjeng -56.32% 174.000 76.000 - 111.11% -
458.sjeng (avg) -56.32% 174.000 76.000 - 111.11% -
416.gamess (avg) (percentage) -55.72% 2.010 0.890 - -46.06% -
482.sphinx3 (avg) (percentage) -54.83% 4.450 2.010 - -14.47% -
465.tonto (unexplained diff vs previous) -52.86% 210.000 99.000 - -33.11% -
458.sjeng (unexplained diff vs previous) -51.61% 93.000 45.000 - -6.25% -
471.omnetpp (avg) (percentage) -51.57% 4.130 2.000 - 69.49% -
482.sphinx3 (unexplained diff vs previous) (percentage) -51.27% 3.160 1.540 - -49.67% -
433.milc (max) (percentage) -49.25% 2.010 1.020 - 43.66% -
481.wrf (avg) (percentage) -47.70% 3.690 1.930 - -24.90% -
454.calculix (max) (percentage) -47.25% 5.820 3.070 - 265.48% -
436.cactusADM (avg) (percentage) -46.39% 2.630 1.410 - -41.25% -
401.bzip2 (max) (percentage) -45.77% 4.260 2.310 - 477.50% -
434.zeusmp (max) (percentage) -45.74% 1.880 1.020 - -55.65% -
483.xalancbmk (avg) (percentage) -45.71% 2.100 1.140 - 103.57% -
470.lbm (avg) (percentage) -45.48% 3.100 1.690 - -54.69% -
465.tonto (avg) (percentage) -42.31% 1.560 0.900 - -21.05% -
464.h264ref (avg) (percentage) -40.53% 1.900 1.130 - 189.74% -
453.povray (avg) (percentage) -39.27% 3.030 1.840 - 20.26% -
445.gobmk (max) -38.10% 42.000 26.000 - -21.21% -
400.perlbench (max) -37.21% 43.000 27.000 - -69.66% -
401.bzip2 (unexplained diff vs previous) -37.04% 108.000 68.000 - -1.45% -
429.mcf (unexplained diff vs previous) -35.00% 60.000 39.000 - 290.00% -
459.GemsFDTD (avg) (percentage) -33.73% 2.490 1.650 - 18.71% -
473.astar -31.30% 131.000 90.000 - 76.47% -
473.astar (avg) -31.30% 131.000 90.000 - 76.47% -
465.tonto -28.83% 163.000 116.000 - -21.62% -
465.tonto (avg) -28.83% 163.000 116.000 - -21.62% -
473.astar (unexplained diff vs previous) -28.12% 64.000 46.000 - -24.59% -
410.bwaves (avg) (percentage) -26.20% 1.870 1.380 - -29.59% -
454.calculix (avg) (percentage) -24.89% 4.580 3.440 - 69.46% -
435.gromacs (avg) (percentage) -22.64% 2.650 2.050 - 115.79% -
435.gromacs (unexplained diff vs previous) (percentage) -20.41% 1.470 1.170 - -32.37% -
400.perlbench -20.00% 40.000 32.000 - -25.58% -
400.perlbench (avg) -20.00% 40.000 32.000 - -25.58% -
445.gobmk (unexplained diff vs previous) (percentage) -19.35% 0.310 0.250 - 66.67% -
410.bwaves (unexplained diff vs previous) (percentage) -11.24% 0.890 0.790 - -54.60% -
458.sjeng (avg) (percentage) -10.19% 1.080 0.970 - 321.74% -
447.dealII (max) (percentage) -7.61% 1.970 1.820 - 10.30% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.45% 29.000 30.000 - 3.45% -

Added Tests - sample variability
462.libquantum (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 3.26% 48001.000 49564.000 - 3.10% -
453.povray 2.06% 489013.000 499105.000 - 2.04% -
416.gamess 1.69% 4554728.000 4631717.000 - 1.69% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
459.GemsFDTD 1.44% 195766.000 198587.000 - 0.35% -
471.omnetpp 1.26% 295652.000 299385.000 - 0.71% -
462.libquantum 1.13% 13066.000 13214.000 - 0.82% -
447.dealII 1.08% 191136.000 193202.000 - 1.08% -
450.soplex 1.04% 135596.000 137008.000 - -0.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 5709.38% 0.320 18.590 - 21.27% -
429.mcf (unexplained diff vs previous) (percentage) 4388.89% 0.090 4.040 - 692.16% -
403.gcc (max) (percentage) 1486.44% 0.590 9.360 - 319.73% -
450.soplex (avg) (percentage) 1241.67% 0.240 3.220 - 307.59% -
429.mcf (avg) (percentage) 1166.67% 0.480 6.080 - 67.03% -
437.leslie3d (unexplained diff vs previous) (percentage) 910.68% 1.030 10.410 - 326.64% -
450.soplex (max) (percentage) 904.55% 0.440 4.420 - 79.67% -
462.libquantum (avg) (percentage) 805.26% 0.190 1.720 - 93.26% -
401.bzip2 (avg) (percentage) 766.67% 0.270 2.340 - 87.20% -
437.leslie3d (unexplained diff vs previous) 610.70% 187.000 1329.000 - 206.93% -
462.libquantum (unexplained diff vs previous) (percentage) 512.50% 0.080 0.490 - 308.33% -
462.libquantum (max) (percentage) 500.00% 0.080 0.480 - -85.14% -
401.bzip2 (max) (percentage) 477.50% 0.400 2.310 - -45.77% -
401.bzip2 (unexplained diff vs previous) (percentage) 451.22% 0.410 2.260 - 258.73% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 141.84% -
445.gobmk (avg) (percentage) 450.00% 0.220 1.210 - 278.12% -
400.perlbench (unexplained diff vs previous) (percentage) 432.26% 0.310 1.650 - 725.00% -
400.perlbench (avg) (percentage) 405.13% 0.390 1.970 - 447.22% -
429.mcf (max) 383.78% 37.000 179.000 - -90.14% -
473.astar (avg) (percentage) 367.50% 0.400 1.870 - 83.33% -
450.soplex (unexplained diff vs previous) (percentage) 352.27% 0.440 1.990 - 665.38% -
458.sjeng (avg) (percentage) 321.74% 0.230 0.970 - -10.19% -
429.mcf (unexplained diff vs previous) 290.00% 10.000 39.000 - -35.00% -
437.leslie3d (max) (percentage) 274.84% 3.100 11.620 - 388.24% -
454.calculix (max) (percentage) 265.48% 0.840 3.070 - -47.25% -
403.gcc (unexplained diff vs previous) (percentage) 196.55% 0.580 1.720 - 120.51% -
464.h264ref (avg) (percentage) 189.74% 0.390 1.130 - -40.53% -
456.hmmer (avg) (percentage) 183.33% 0.300 0.850 - 54.55% -
437.leslie3d (max) 164.82% 560.000 1483.000 - 252.26% -
471.omnetpp (unexplained diff vs previous) (percentage) 156.72% 0.670 1.720 - 290.91% -
433.milc (avg) (percentage) 153.62% 0.690 1.750 - 11.46% -
437.leslie3d (avg) (percentage) 147.31% 1.670 4.130 - 175.33% -
447.dealII (unexplained diff vs previous) (percentage) 138.67% 0.750 1.790 - 36.64% -
447.dealII (avg) (percentage) 134.48% 0.870 2.040 - 43.66% -
458.sjeng (max) (percentage) 133.33% 0.300 0.700 - -76.11% -
473.astar (max) (percentage) 129.79% 0.470 1.080 - -58.78% -
445.gobmk 125.93% 27.000 61.000 - 56.41% -
445.gobmk (avg) 125.93% 27.000 61.000 - 56.41% -
454.calculix (unexplained diff vs previous) (percentage) 125.33% 0.750 1.690 - -69.27% -
435.gromacs (avg) (percentage) 115.79% 0.950 2.050 - -22.64% -
458.sjeng 111.11% 36.000 76.000 - -56.32% -
458.sjeng (avg) 111.11% 36.000 76.000 - -56.32% -
400.perlbench (max) (percentage) 110.00% 0.800 1.680 - 342.11% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - -45.71% -
473.astar (unexplained diff vs previous) (percentage) 102.13% 0.470 0.950 - 93.88% -
445.gobmk (max) (percentage) 92.59% 0.270 0.520 - 52.94% -
458.sjeng (unexplained diff vs previous) (percentage) 90.00% 0.300 0.570 - 0.00% -
473.astar 76.47% 51.000 90.000 - -31.30% -
473.astar (avg) 76.47% 51.000 90.000 - -31.30% -
437.leslie3d 75.08% 301.000 527.000 - 98.87% -
437.leslie3d (avg) 75.08% 301.000 527.000 - 98.87% -
471.omnetpp (avg) (percentage) 69.49% 1.180 2.000 - -51.57% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - -24.89% -
483.xalancbmk (max) (percentage) 68.48% 0.920 1.550 - -71.92% -
445.gobmk (unexplained diff vs previous) (percentage) 66.67% 0.150 0.250 - -19.35% -
401.bzip2 55.56% 45.000 70.000 - -67.14% -
401.bzip2 (avg) 55.56% 45.000 70.000 - -67.14% -
433.milc (max) (percentage) 43.66% 0.710 1.020 - -49.25% -
464.h264ref (max) (percentage) 33.33% 0.390 0.520 - -91.61% -
434.zeusmp (avg) (percentage) 22.13% 1.220 1.490 - 6.43% -
453.povray (avg) (percentage) 20.26% 1.530 1.840 - -39.27% -
459.GemsFDTD (avg) (percentage) 18.71% 1.390 1.650 - -33.73% -
464.h264ref 18.64% 59.000 70.000 - -75.44% -
464.h264ref (avg) 18.64% 59.000 70.000 - -75.44% -
458.sjeng (max) 14.58% 48.000 55.000 - -88.40% -
447.dealII (max) (percentage) 10.30% 1.650 1.820 - -7.61% -
429.mcf 3.57% 56.000 58.000 - -86.54% -
429.mcf (avg) 3.57% 56.000 58.000 - -86.54% -
401.bzip2 (max) 2.99% 67.000 69.000 - -90.51% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.75% 10845.000 10221.000 - -5.75% -
434.zeusmp -1.32% 141060.000 139198.000 - -3.58% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.82% 32491.000 59.000 - -99.80% -
403.gcc -99.35% 8890.000 58.000 - -99.36% -
462.libquantum -98.79% 17005.000 206.000 - -98.79% -
482.sphinx3 -97.51% 36586.000 912.000 - -97.58% -
450.soplex -96.16% 15709.000 604.000 - -96.15% -
444.namd -94.35% 15957.000 901.000 - -94.05% -
453.povray -92.67% 7395.000 542.000 - -92.83% -
433.milc -91.96% 13668.000 1099.000 - -91.94% -
429.mcf -91.76% 11727.000 966.000 - -91.84% -
436.cactusADM -89.29% 24396.000 2614.000 - -88.76% -
434.zeusmp -86.62% 20932.000 2801.000 - -86.41% -
400.perlbench -85.41% 11215.000 1636.000 - -85.58% -
401.bzip2 -82.29% 16971.000 3006.000 - -82.41% -
447.dealII -79.09% 9101.000 1903.000 - -78.83% -
470.lbm -77.02% 16312.000 3749.000 - -78.13% -
456.hmmer -76.08% 18995.000 4544.000 - -77.01% -
459.GemsFDTD -71.83% 25364.000 7146.000 - -72.48% -
481.wrf -70.74% 21991.000 6435.000 - -71.92% -
471.omnetpp -69.89% 9265.000 2790.000 - -69.22% -
473.astar -62.56% 12983.000 4861.000 - -62.43% -
410.bwaves -59.84% 14745.000 5922.000 - -60.94% -
464.h264ref -59.22% 15208.000 6202.000 - -58.72% -
445.gobmk -58.78% 12396.000 5110.000 - -58.88% -
435.gromacs -55.47% 16853.000 7504.000 - -54.95% -
458.sjeng -50.80% 16018.000 7881.000 - -51.29% -
416.gamess -49.65% 29409.000 14807.000 - -48.15% -
437.leslie3d -29.34% 18070.000 12768.000 - -27.98% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.70% 659.000 2.000 - -99.85% -
454.calculix (avg) -99.70% 659.000 2.000 - -99.85% -
454.calculix (max) -99.63% 272.000 1.000 - -99.94% -
454.calculix (unexplained diff vs previous) -99.59% 244.000 1.000 - -99.94% -
444.namd (max) -99.20% 879.000 7.000 - -99.06% -
444.namd (unexplained diff vs previous) -99.16% 834.000 7.000 - -99.11% -
470.lbm (unexplained diff vs previous) -99.15% 822.000 7.000 - -99.17% -
433.milc (unexplained diff vs previous) -98.96% 96.000 1.000 - -99.57% -
436.cactusADM (max) -98.94% 1231.000 13.000 - -98.81% -
436.cactusADM (unexplained diff vs previous) -98.89% 1173.000 13.000 - -98.86% -
482.sphinx3 (max) -98.87% 1152.000 13.000 - -99.62% -
453.povray (unexplained diff vs previous) -98.82% 169.000 2.000 - -98.60% -
482.sphinx3 (unexplained diff vs previous) -98.75% 1118.000 14.000 - -98.82% -
481.wrf (unexplained diff vs previous) -98.32% 894.000 15.000 - -98.27% -
403.gcc (unexplained diff vs previous) -98.08% 52.000 1.000 - -98.59% -
482.sphinx3 -97.90% 859.000 18.000 - -98.93% -
482.sphinx3 (avg) -97.90% 859.000 18.000 - -98.93% -
403.gcc -97.37% 38.000 1.000 - -98.86% -
403.gcc (avg) -97.37% 38.000 1.000 - -98.86% -
470.lbm (max) -97.31% 893.000 24.000 - -97.28% -
434.zeusmp (unexplained diff vs previous) -97.23% 470.000 13.000 - -96.72% -
456.hmmer (unexplained diff vs previous) -96.94% 98.000 3.000 - -98.08% -
416.gamess (max) -96.64% 923.000 31.000 - -96.47% -
444.namd -96.62% 414.000 14.000 - -97.81% -
444.namd (avg) -96.62% 414.000 14.000 - -97.81% -
416.gamess (unexplained diff vs previous) -96.54% 896.000 31.000 - -96.59% -
470.lbm (unexplained diff vs previous) (percentage) -96.23% 5.040 0.190 - -96.11% -
481.wrf (max) -96.06% 914.000 36.000 - -95.99% -
481.wrf (unexplained diff vs previous) (percentage) -94.35% 4.070 0.230 - -93.90% -
434.zeusmp (max) -94.18% 481.000 28.000 - -92.76% -
436.cactusADM -93.85% 585.000 36.000 - -94.11% -
436.cactusADM (avg) -93.85% 585.000 36.000 - -94.11% -
453.povray (max) -93.72% 191.000 12.000 - -97.04% -
416.gamess (max) (percentage) -93.31% 3.140 0.210 - -93.18% -
416.gamess (unexplained diff vs previous) (percentage) -93.11% 3.050 0.210 - -93.40% -
462.libquantum (unexplained diff vs previous) -92.86% 14.000 1.000 - -95.24% -
459.GemsFDTD (unexplained diff vs previous) -92.47% 584.000 44.000 - -92.44% -
453.povray -92.04% 113.000 9.000 - -96.07% -
453.povray (avg) -92.04% 113.000 9.000 - -96.07% -
464.h264ref (unexplained diff vs previous) -91.38% 58.000 5.000 - -93.59% -
456.hmmer (max) -90.82% 98.000 9.000 - -94.16% -
462.libquantum -90.62% 32.000 3.000 - -98.00% -
462.libquantum (avg) -90.62% 32.000 3.000 - -98.00% -
403.gcc (max) -90.38% 52.000 5.000 - -97.52% -
459.GemsFDTD (max) -90.31% 578.000 56.000 - -94.54% -
436.cactusADM (max) (percentage) -90.10% 5.050 0.500 - -89.34% -
470.lbm -89.64% 608.000 63.000 - -88.14% -
470.lbm (avg) -89.64% 608.000 63.000 - -88.14% -
436.cactusADM (unexplained diff vs previous) (percentage) -89.60% 4.810 0.500 - -89.84% -
433.milc (max) -88.66% 97.000 11.000 - -95.99% -
470.lbm (max) (percentage) -87.96% 5.480 0.660 - -87.18% -
433.milc (unexplained diff vs previous) (percentage) -87.14% 0.700 0.090 - -94.67% -
456.hmmer (unexplained diff vs previous) (percentage) -86.54% 0.520 0.070 - -91.14% -
481.wrf (max) (percentage) -86.30% 4.160 0.570 - -85.46% -
444.namd (max) (percentage) -85.84% 5.510 0.780 - -84.15% -
444.namd (unexplained diff vs previous) (percentage) -85.09% 5.230 0.780 - -84.94% -
434.zeusmp -83.92% 255.000 41.000 - -85.76% -
434.zeusmp (avg) -83.92% 255.000 41.000 - -85.76% -
453.povray (unexplained diff vs previous) (percentage) -83.84% 2.290 0.370 - -80.42% -
450.soplex (unexplained diff vs previous) -82.61% 69.000 12.000 - -70.73% -
410.bwaves (unexplained diff vs previous) -81.71% 257.000 47.000 - -65.19% -
410.bwaves (max) -80.00% 260.000 52.000 - -91.63% -
433.milc -79.79% 94.000 19.000 - -91.12% -
433.milc (avg) -79.79% 94.000 19.000 - -91.12% -
434.zeusmp (unexplained diff vs previous) (percentage) -79.56% 2.250 0.460 - -76.04% -
464.h264ref (unexplained diff vs previous) (percentage) -78.95% 0.380 0.080 - -84.62% -
481.wrf -78.05% 565.000 124.000 - -85.33% -
481.wrf (avg) -78.05% 565.000 124.000 - -85.33% -
447.dealII (max) -77.33% 150.000 34.000 - -80.79% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -73.04% 2.300 0.620 - -72.32% -
416.gamess -72.99% 485.000 131.000 - -77.14% -
416.gamess (avg) -72.99% 485.000 131.000 - -77.14% -
471.omnetpp (max) -72.67% 172.000 47.000 - -96.70% -
410.bwaves -71.97% 289.000 81.000 - -71.38% -
410.bwaves (avg) -71.97% 289.000 81.000 - -71.38% -
435.gromacs (unexplained diff vs previous) -69.86% 292.000 88.000 - -64.08% -
400.perlbench (max) -69.66% 89.000 27.000 - -37.21% -
459.GemsFDTD -66.76% 352.000 117.000 - -81.89% -
459.GemsFDTD (avg) -66.76% 352.000 117.000 - -81.89% -
459.GemsFDTD (max) (percentage) -65.35% 2.280 0.790 - -80.00% -
450.soplex (max) -62.32% 69.000 26.000 - -93.25% -
456.hmmer (max) (percentage) -61.54% 0.520 0.200 - -74.36% -
435.gromacs (max) -59.46% 296.000 120.000 - -88.91% -
434.zeusmp (max) (percentage) -55.65% 2.300 1.020 - -45.74% -
465.tonto (max) -55.16% 223.000 100.000 - -56.33% -
465.tonto (max) (percentage) -54.97% 1.710 0.770 - -64.84% -
470.lbm (avg) (percentage) -54.69% 3.730 1.690 - -45.48% -
410.bwaves (unexplained diff vs previous) (percentage) -54.60% 1.740 0.790 - -11.24% -
482.sphinx3 (max) (percentage) -52.06% 3.150 1.510 - -83.57% -
447.dealII -51.90% 79.000 38.000 - -70.08% -
447.dealII (avg) -51.90% 79.000 38.000 - -70.08% -
410.bwaves (max) (percentage) -50.28% 1.770 0.880 - -78.54% -
447.dealII (unexplained diff vs previous) -50.00% 68.000 34.000 - -71.19% -
482.sphinx3 (unexplained diff vs previous) (percentage) -49.67% 3.060 1.540 - -51.27% -
471.omnetpp -49.54% 109.000 55.000 - -85.29% -
471.omnetpp (avg) -49.54% 109.000 55.000 - -85.29% -
450.soplex -48.65% 37.000 19.000 - -84.55% -
450.soplex (avg) -48.65% 37.000 19.000 - -84.55% -
416.gamess (avg) (percentage) -46.06% 1.650 0.890 - -55.72% -
464.h264ref (max) -45.76% 59.000 32.000 - -96.56% -
436.cactusADM (avg) (percentage) -41.25% 2.400 1.410 - -46.39% -
444.namd (avg) (percentage) -38.46% 2.600 1.600 - -62.09% -
465.tonto (unexplained diff vs previous) -33.11% 148.000 99.000 - -52.86% -
465.tonto (unexplained diff vs previous) (percentage) -32.74% 1.130 0.760 - -62.19% -
435.gromacs (unexplained diff vs previous) (percentage) -32.37% 1.730 1.170 - -20.41% -
456.hmmer -32.14% 56.000 38.000 - -64.81% -
456.hmmer (avg) -32.14% 56.000 38.000 - -64.81% -
410.bwaves (avg) (percentage) -29.59% 1.960 1.380 - -26.20% -
445.gobmk (unexplained diff vs previous) -27.78% 18.000 13.000 - -65.79% -
400.perlbench -25.58% 43.000 32.000 - -20.00% -
400.perlbench (avg) -25.58% 43.000 32.000 - -20.00% -
481.wrf (avg) (percentage) -24.90% 2.570 1.930 - -47.70% -
473.astar (unexplained diff vs previous) -24.59% 61.000 46.000 - -28.12% -
400.perlbench (unexplained diff vs previous) -22.86% 35.000 27.000 - 17.39% -
471.omnetpp (unexplained diff vs previous) -22.58% 62.000 48.000 - 20.00% -
465.tonto -21.62% 148.000 116.000 - -28.83% -
465.tonto (avg) -21.62% 148.000 116.000 - -28.83% -
445.gobmk (max) -21.21% 33.000 26.000 - -38.10% -
465.tonto (avg) (percentage) -21.05% 1.140 0.900 - -42.31% -
473.astar (max) -14.75% 61.000 52.000 - -84.66% -
482.sphinx3 (avg) (percentage) -14.47% 2.350 2.010 - -54.83% -
453.povray (max) (percentage) -13.13% 2.590 2.250 - -58.10% -
471.omnetpp (max) (percentage) -9.14% 1.860 1.690 - -89.25% -
435.gromacs (max) (percentage) -8.52% 1.760 1.610 - -75.23% -
458.sjeng (unexplained diff vs previous) -6.25% 48.000 45.000 - -51.61% -
435.gromacs -4.38% 160.000 153.000 - -65.31% -
435.gromacs (avg) -4.38% 160.000 153.000 - -65.31% -
401.bzip2 (unexplained diff vs previous) -1.45% 69.000 68.000 - -37.04% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.45% 29.000 30.000 - 3.45% -

Added Tests - sample variability
462.libquantum (max)

Report Time: 0.51s
Execution (seconds)
Name Current %
400.perlbench 1636.000 -85.58%
401.bzip2 3006.000 -82.41%
403.gcc 58.000 -99.36%
410.bwaves 5922.000 -60.94%
416.gamess 14807.000 -48.15%
429.mcf 966.000 -91.84%
433.milc 1099.000 -91.94%
434.zeusmp 2801.000 -86.41%
435.gromacs 7504.000 -54.95%
436.cactusADM 2614.000 -88.76%
437.leslie3d 12768.000 -27.98%
444.namd 901.000 -94.05%
445.gobmk 5110.000 -58.88%
447.dealII 1903.000 -78.83%
450.soplex 604.000 -96.15%
453.povray 542.000 -92.83%
454.calculix 59.000 -99.80%
456.hmmer 4544.000 -77.01%
458.sjeng 7881.000 -51.29%
459.GemsFDTD 7146.000 -72.48%
462.libquantum 206.000 -98.79%
464.h264ref 6202.000 -58.72%
465.tonto 12989.000 24.18%
470.lbm 3749.000 -78.13%
471.omnetpp 2790.000 -69.22%
473.astar 4861.000 -62.43%
481.wrf 6435.000 -71.92%
482.sphinx3 912.000 -97.58%
Geometric Mean 2202.467 -86.11%
Code Size (bytes)
Name Current %
400.perlbench 567102.000 -
401.bzip2 33542.000 -
403.gcc 1603710.000 1.14%
410.bwaves 14723.000 -
416.gamess 4631717.000 1.69%
429.mcf 7701.000 -
433.milc 47965.000 -
434.zeusmp 139198.000 -3.58%
435.gromacs 394950.000 -
436.cactusADM 258202.000 -
437.leslie3d 49564.000 3.10%
444.namd 162891.000 -
445.gobmk 1089944.000 -
447.dealII 193202.000 1.08%
450.soplex 137008.000 -
453.povray 499105.000 2.04%
454.calculix 687701.000 -
456.hmmer 74805.000 -
458.sjeng 81765.000 -
459.GemsFDTD 198587.000 -
462.libquantum 13214.000 -
464.h264ref 302154.000 -
465.tonto 1450245.000 -
470.lbm 10221.000 -5.75%
471.omnetpp 299385.000 -
473.astar 15781.000 1.49%
481.wrf 1537684.000 -
482.sphinx3 79862.000 -
Geometric Mean 157978.654 -
Score
Name Current %
nb_compile_successful 28.000 -3.45%
nb_execution_successful 28.000 -3.45%
nb_total_tests 30.000 3.45%
Geometric Mean 28.651 -1.20%
sample variability
Name Current %
400.perlbench 32.000 -20.00%
400.perlbench (avg) 32.000 -20.00%
400.perlbench (avg) (percentage) 1.970 447.22%
400.perlbench (max) 27.000 -37.21%
400.perlbench (max) (percentage) 1.680 342.11%
400.perlbench (unexplained diff vs previous) 27.000 17.39%
400.perlbench (unexplained diff vs previous) (percentage) 1.650 725.00%
401.bzip2 70.000 -67.14%
401.bzip2 (avg) 70.000 -67.14%
401.bzip2 (avg) (percentage) 2.340 87.20%
401.bzip2 (max) 69.000 -90.51%
401.bzip2 (max) (percentage) 2.310 -45.77%
401.bzip2 (unexplained diff vs previous) 68.000 -37.04%
401.bzip2 (unexplained diff vs previous) (percentage) 2.260 258.73%
403.gcc 1.000 -98.86%
403.gcc (avg) 1.000 -98.86%
403.gcc (avg) (percentage) 2.370 141.84%
403.gcc (max) 5.000 -97.52%
403.gcc (max) (percentage) 9.360 319.73%
403.gcc (unexplained diff vs previous) 1.000 -98.59%
403.gcc (unexplained diff vs previous) (percentage) 1.720 120.51%
410.bwaves 81.000 -71.38%
410.bwaves (avg) 81.000 -71.38%
410.bwaves (avg) (percentage) 1.380 -26.20%
410.bwaves (max) 52.000 -91.63%
410.bwaves (max) (percentage) 0.880 -78.54%
410.bwaves (unexplained diff vs previous) 47.000 -65.19%
410.bwaves (unexplained diff vs previous) (percentage) 0.790 -11.24%
416.gamess 131.000 -77.14%
416.gamess (avg) 131.000 -77.14%
416.gamess (avg) (percentage) 0.890 -55.72%
416.gamess (max) 31.000 -96.47%
416.gamess (max) (percentage) 0.210 -93.18%
416.gamess (unexplained diff vs previous) 31.000 -96.59%
416.gamess (unexplained diff vs previous) (percentage) 0.210 -93.40%
429.mcf 58.000 -86.54%
429.mcf (avg) 58.000 -86.54%
429.mcf (avg) (percentage) 6.080 67.03%
429.mcf (max) 179.000 -90.14%
429.mcf (max) (percentage) 18.590 21.27%
429.mcf (unexplained diff vs previous) 39.000 -35.00%
429.mcf (unexplained diff vs previous) (percentage) 4.040 692.16%
433.milc 19.000 -91.12%
433.milc (avg) 19.000 -91.12%
433.milc (avg) (percentage) 1.750 11.46%
433.milc (max) 11.000 -95.99%
433.milc (max) (percentage) 1.020 -49.25%
433.milc (unexplained diff vs previous) 1.000 -99.57%
433.milc (unexplained diff vs previous) (percentage) 0.090 -94.67%
434.zeusmp 41.000 -85.76%
434.zeusmp (avg) 41.000 -85.76%
434.zeusmp (avg) (percentage) 1.490 6.43%
434.zeusmp (max) 28.000 -92.76%
434.zeusmp (max) (percentage) 1.020 -45.74%
434.zeusmp (unexplained diff vs previous) 13.000 -96.72%
434.zeusmp (unexplained diff vs previous) (percentage) 0.460 -76.04%
435.gromacs 153.000 -65.31%
435.gromacs (avg) 153.000 -65.31%
435.gromacs (avg) (percentage) 2.050 -22.64%
435.gromacs (max) 120.000 -88.91%
435.gromacs (max) (percentage) 1.610 -75.23%
435.gromacs (unexplained diff vs previous) 88.000 -64.08%
435.gromacs (unexplained diff vs previous) (percentage) 1.170 -20.41%
436.cactusADM 36.000 -94.11%
436.cactusADM (avg) 36.000 -94.11%
436.cactusADM (avg) (percentage) 1.410 -46.39%
436.cactusADM (max) 13.000 -98.81%
436.cactusADM (max) (percentage) 0.500 -89.34%
436.cactusADM (unexplained diff vs previous) 13.000 -98.86%
436.cactusADM (unexplained diff vs previous) (percentage) 0.500 -89.84%
437.leslie3d 527.000 98.87%
437.leslie3d (avg) 527.000 98.87%
437.leslie3d (avg) (percentage) 4.130 175.33%
437.leslie3d (max) 1483.000 252.26%
437.leslie3d (max) (percentage) 11.620 388.24%
437.leslie3d (unexplained diff vs previous) 1329.000 206.93%
437.leslie3d (unexplained diff vs previous) (percentage) 10.410 326.64%
444.namd 14.000 -97.81%
444.namd (avg) 14.000 -97.81%
444.namd (avg) (percentage) 1.600 -62.09%
444.namd (max) 7.000 -99.06%
444.namd (max) (percentage) 0.780 -84.15%
444.namd (unexplained diff vs previous) 7.000 -99.11%
444.namd (unexplained diff vs previous) (percentage) 0.780 -84.94%
445.gobmk 61.000 56.41%
445.gobmk (avg) 61.000 56.41%
445.gobmk (avg) (percentage) 1.210 278.12%
445.gobmk (max) 26.000 -38.10%
445.gobmk (max) (percentage) 0.520 52.94%
445.gobmk (unexplained diff vs previous) 13.000 -65.79%
445.gobmk (unexplained diff vs previous) (percentage) 0.250 -19.35%
447.dealII 38.000 -70.08%
447.dealII (avg) 38.000 -70.08%
447.dealII (avg) (percentage) 2.040 43.66%
447.dealII (max) 34.000 -80.79%
447.dealII (max) (percentage) 1.820 -7.61%
447.dealII (unexplained diff vs previous) 34.000 -71.19%
447.dealII (unexplained diff vs previous) (percentage) 1.790 36.64%
450.soplex 19.000 -84.55%
450.soplex (avg) 19.000 -84.55%
450.soplex (avg) (percentage) 3.220 307.59%
450.soplex (max) 26.000 -93.25%
450.soplex (max) (percentage) 4.420 79.67%
450.soplex (unexplained diff vs previous) 12.000 -70.73%
450.soplex (unexplained diff vs previous) (percentage) 1.990 665.38%
453.povray 9.000 -96.07%
453.povray (avg) 9.000 -96.07%
453.povray (avg) (percentage) 1.840 -39.27%
453.povray (max) 12.000 -97.04%
453.povray (max) (percentage) 2.250 -58.10%
453.povray (unexplained diff vs previous) 2.000 -98.60%
453.povray (unexplained diff vs previous) (percentage) 0.370 -80.42%
454.calculix 2.000 -99.85%
454.calculix (avg) 2.000 -99.85%
454.calculix (avg) (percentage) 3.440 -24.89%
454.calculix (max) 1.000 -99.94%
454.calculix (max) (percentage) 3.070 -47.25%
454.calculix (unexplained diff vs previous) 1.000 -99.94%
454.calculix (unexplained diff vs previous) (percentage) 1.690 -69.27%
456.hmmer 38.000 -64.81%
456.hmmer (avg) 38.000 -64.81%
456.hmmer (avg) (percentage) 0.850 54.55%
456.hmmer (max) 9.000 -94.16%
456.hmmer (max) (percentage) 0.200 -74.36%
456.hmmer (unexplained diff vs previous) 3.000 -98.08%
456.hmmer (unexplained diff vs previous) (percentage) 0.070 -91.14%
458.sjeng 76.000 -56.32%
458.sjeng (avg) 76.000 -56.32%
458.sjeng (avg) (percentage) 0.970 -10.19%
458.sjeng (max) 55.000 -88.40%
458.sjeng (max) (percentage) 0.700 -76.11%
458.sjeng (unexplained diff vs previous) 45.000 -51.61%
458.sjeng (unexplained diff vs previous) (percentage) 0.570 -
459.GemsFDTD 117.000 -81.89%
459.GemsFDTD (avg) 117.000 -81.89%
459.GemsFDTD (avg) (percentage) 1.650 -33.73%
459.GemsFDTD (max) 56.000 -94.54%
459.GemsFDTD (max) (percentage) 0.790 -80.00%
459.GemsFDTD (unexplained diff vs previous) 44.000 -92.44%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.620 -72.32%
462.libquantum 3.000 -98.00%
462.libquantum (avg) 3.000 -98.00%
462.libquantum (avg) (percentage) 1.720 93.26%
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.480 -85.14%
462.libquantum (unexplained diff vs previous) 1.000 -95.24%
462.libquantum (unexplained diff vs previous) (percentage) 0.490 308.33%
464.h264ref 70.000 -75.44%
464.h264ref (avg) 70.000 -75.44%
464.h264ref (avg) (percentage) 1.130 -40.53%
464.h264ref (max) 32.000 -96.56%
464.h264ref (max) (percentage) 0.520 -91.61%
464.h264ref (unexplained diff vs previous) 5.000 -93.59%
464.h264ref (unexplained diff vs previous) (percentage) 0.080 -84.62%
465.tonto 116.000 -28.83%
465.tonto (avg) 116.000 -28.83%
465.tonto (avg) (percentage) 0.900 -42.31%
465.tonto (max) 100.000 -56.33%
465.tonto (max) (percentage) 0.770 -64.84%
465.tonto (unexplained diff vs previous) 99.000 -52.86%
465.tonto (unexplained diff vs previous) (percentage) 0.760 -62.19%
470.lbm 63.000 -88.14%
470.lbm (avg) 63.000 -88.14%
470.lbm (avg) (percentage) 1.690 -45.48%
470.lbm (max) 24.000 -97.28%
470.lbm (max) (percentage) 0.660 -87.18%
470.lbm (unexplained diff vs previous) 7.000 -99.17%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -96.11%
471.omnetpp 55.000 -85.29%
471.omnetpp (avg) 55.000 -85.29%
471.omnetpp (avg) (percentage) 2.000 -51.57%
471.omnetpp (max) 47.000 -96.70%
471.omnetpp (max) (percentage) 1.690 -89.25%
471.omnetpp (unexplained diff vs previous) 48.000 20.00%
471.omnetpp (unexplained diff vs previous) (percentage) 1.720 290.91%
473.astar 90.000 -31.30%
473.astar (avg) 90.000 -31.30%
473.astar (avg) (percentage) 1.870 83.33%
473.astar (max) 52.000 -84.66%
473.astar (max) (percentage) 1.080 -58.78%
473.astar (unexplained diff vs previous) 46.000 -28.12%
473.astar (unexplained diff vs previous) (percentage) 0.950 93.88%
481.wrf 124.000 -85.33%
481.wrf (avg) 124.000 -85.33%
481.wrf (avg) (percentage) 1.930 -47.70%
481.wrf (max) 36.000 -95.99%
481.wrf (max) (percentage) 0.570 -85.46%
481.wrf (unexplained diff vs previous) 15.000 -98.27%
481.wrf (unexplained diff vs previous) (percentage) 0.230 -93.90%
482.sphinx3 18.000 -98.93%
482.sphinx3 (avg) 18.000 -98.93%
482.sphinx3 (avg) (percentage) 2.010 -54.83%
482.sphinx3 (max) 13.000 -99.62%
482.sphinx3 (max) (percentage) 1.510 -83.57%
482.sphinx3 (unexplained diff vs previous) 14.000 -98.82%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.540 -51.27%
483.xalancbmk (avg) (percentage) 1.140 -45.71%
483.xalancbmk (max) (percentage) 1.550 -71.92%
Geometric Mean 6.688 -78.95%