Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=80313193b0f6c63000672b876e4f08e71df310b7 (+ 135 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/370432688259aed1c99f9b29d8d09e534fb94037 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=1ea051145612f199d8716ecdf78b084b00b5a727 (+ 19 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=dd22391461d1c15b8296f13695365005f8be2e90 (+ 162 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/154/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0154 (3-changed-components) 2024-03-08T10:49:20 0:00:00
Previous 0153 (4-changed-components) 2022-09-17T10:25:40 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 52 76
Performance Improvements 180 159
Added Tests 2 0
Unchanged Tests 1002 1001
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 3.10% 48073.000 49564.000 - 3.26% -
453.povray 2.04% 489103.000 499105.000 - 2.06% -
416.gamess 1.70% 4554432.000 4631717.000 - 1.69% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
403.gcc 1.14% 1585625.000 1603710.000 - 0.86% -
447.dealII 1.08% 191138.000 193202.000 - 1.08% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 27.47% 10227.000 13036.000 - -0.06% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) 4800.00% 0.010 0.490 - 512.50% -
445.gobmk (unexplained diff vs previous) (percentage) 3650.00% 0.020 0.750 - 400.00% -
429.mcf (max) (percentage) 1912.24% 0.490 9.860 - 2981.25% -
445.gobmk (unexplained diff vs previous) 1800.00% 2.000 38.000 - 111.11% -
403.gcc (max) (percentage) 1205.63% 0.710 9.270 - 1471.19% -
429.mcf (unexplained diff vs previous) (percentage) 817.07% 0.410 3.760 - 4077.78% -
400.perlbench (avg) (percentage) 476.47% 0.340 1.960 - 402.56% -
400.perlbench (unexplained diff vs previous) (percentage) 410.71% 0.280 1.430 - 361.29% -
445.gobmk (avg) (percentage) 400.00% 0.240 1.200 - 445.45% -
401.bzip2 (max) (percentage) 393.02% 0.430 2.120 - 430.00% -
450.soplex (avg) (percentage) 389.23% 0.650 3.180 - 1225.00% -
437.leslie3d (max) (percentage) 332.77% 2.350 10.170 - 228.06% -
400.perlbench (max) (percentage) 314.71% 0.340 1.410 - 76.25% -
401.bzip2 (unexplained diff vs previous) (percentage) 253.66% 0.410 1.450 - 253.66% -
445.gobmk (max) (percentage) 252.38% 0.210 0.740 - 174.07% -
437.leslie3d (unexplained diff vs previous) (percentage) 240.25% 2.410 8.200 - 696.12% -
462.libquantum (avg) (percentage) 203.57% 0.560 1.700 - 794.74% -
437.leslie3d (max) 187.77% 417.000 1200.000 - 114.29% -
403.gcc (avg) (percentage) 163.33% 0.900 2.370 - 451.16% -
401.bzip2 (avg) (percentage) 152.17% 0.920 2.320 - 759.26% -
473.astar (avg) (percentage) 147.30% 0.740 1.830 - 357.50% -
429.mcf (avg) (percentage) 146.12% 2.450 6.030 - 1156.25% -
450.soplex (unexplained diff vs previous) (percentage) 127.12% 0.590 1.340 - 204.55% -
437.leslie3d (unexplained diff vs previous) 126.70% 427.000 968.000 - 417.65% -
437.leslie3d (avg) (percentage) 126.34% 1.860 4.210 - 152.10% -
445.gobmk 106.90% 29.000 60.000 - 122.22% -
445.gobmk (avg) 106.90% 29.000 60.000 - 122.22% -
447.dealII (unexplained diff vs previous) (percentage) 104.49% 0.890 1.820 - 142.67% -
483.xalancbmk (max) (percentage) 80.23% 0.860 1.550 - 68.48% -
471.omnetpp (unexplained diff vs previous) (percentage) 62.50% 0.480 0.780 - 16.42% -
429.mcf (max) 59.65% 57.000 91.000 - 145.95% -
437.leslie3d 50.30% 330.000 496.000 - 64.78% -
437.leslie3d (avg) 50.30% 330.000 496.000 - 64.78% -
447.dealII (avg) (percentage) 45.00% 1.400 2.030 - 133.33% -
445.gobmk (max) 42.31% 26.000 37.000 - 12.12% -
456.hmmer (avg) (percentage) 36.07% 0.610 0.830 - 176.67% -
465.tonto (unexplained diff vs previous) 23.68% 38.000 47.000 - -68.24% -
454.calculix (max) (percentage) 13.57% 5.970 6.780 - 707.14% -
433.milc (avg) (percentage) 13.16% 1.520 1.720 - 149.28% -
454.calculix (unexplained diff vs previous) (percentage) 12.79% 5.630 6.350 - 746.67% -
447.dealII (max) (percentage) 12.58% 1.590 1.790 - 8.48% -
453.povray (max) (percentage) 11.11% 1.890 2.100 - -18.92% -
458.sjeng (avg) (percentage) 3.26% 0.920 0.950 - 313.04% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.75% 10845.000 10221.000 - -5.75% -
434.zeusmp -3.58% 144364.000 139198.000 - -1.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
454.calculix -99.79% 30078.000 63.000 - -99.81% -
403.gcc -99.35% 9043.000 59.000 - -99.34% -
462.libquantum -98.79% 16959.000 205.000 - -98.79% -
482.sphinx3 -97.57% 37647.000 913.000 - -97.50% -
450.soplex -96.19% 15635.000 596.000 - -96.21% -
444.namd -94.07% 15163.000 899.000 - -94.37% -
453.povray -92.73% 7501.000 545.000 - -92.63% -
429.mcf -92.12% 11820.000 931.000 - -92.06% -
433.milc -91.96% 13722.000 1103.000 - -91.93% -
436.cactusADM -88.81% 23255.000 2602.000 - -89.33% -
434.zeusmp -86.49% 20564.000 2779.000 - -86.72% -
400.perlbench -85.76% 11329.000 1613.000 - -85.62% -
401.bzip2 -82.53% 16963.000 2963.000 - -82.54% -
447.dealII -79.42% 9082.000 1869.000 - -79.46% -
470.lbm -78.20% 17141.000 3736.000 - -77.10% -
456.hmmer -77.00% 19802.000 4554.000 - -76.03% -
459.GemsFDTD -72.26% 25956.000 7201.000 - -71.61% -
481.wrf -72.10% 22970.000 6409.000 - -70.86% -
471.omnetpp -68.73% 8994.000 2812.000 - -69.65% -
473.astar -62.38% 12927.000 4863.000 - -62.54% -
410.bwaves -59.49% 14678.000 5946.000 - -59.67% -
445.gobmk -59.14% 12412.000 5072.000 - -59.08% -
464.h264ref -58.67% 15034.000 6214.000 - -59.14% -
435.gromacs -54.49% 16540.000 7528.000 - -55.33% -
458.sjeng -51.30% 16146.000 7863.000 - -50.91% -
416.gamess -48.18% 28586.000 14813.000 - -49.63% -
437.leslie3d -33.52% 17750.000 11800.000 - -34.70% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (unexplained diff vs previous) -99.93% 1400.000 1.000 - -99.91% -
454.calculix -99.87% 1491.000 2.000 - -99.70% -
454.calculix (avg) -99.87% 1491.000 2.000 - -99.70% -
462.libquantum (max) -99.79% 486.000 1.000 - -92.31% -
454.calculix (max) -99.78% 1795.000 4.000 - -98.53% -
454.calculix (unexplained diff vs previous) -99.76% 1694.000 4.000 - -98.36% -
444.namd (unexplained diff vs previous) -99.74% 772.000 2.000 - -99.76% -
482.sphinx3 (max) -99.61% 3075.000 12.000 - -98.96% -
416.gamess (unexplained diff vs previous) -99.35% 928.000 6.000 - -99.33% -
444.namd (max) -99.18% 733.000 6.000 - -99.32% -
436.cactusADM (max) -99.01% 1111.000 11.000 - -99.11% -
436.cactusADM (unexplained diff vs previous) -98.97% 1167.000 12.000 - -98.98% -
482.sphinx3 -98.93% 1584.000 17.000 - -98.02% -
482.sphinx3 (avg) -98.93% 1584.000 17.000 - -98.02% -
416.gamess (unexplained diff vs previous) (percentage) -98.77% 3.250 0.040 - -98.69% -
403.gcc -98.77% 81.000 1.000 - -97.37% -
403.gcc (avg) -98.77% 81.000 1.000 - -97.37% -
470.lbm (unexplained diff vs previous) -98.48% 855.000 13.000 - -98.42% -
444.namd -97.97% 691.000 14.000 - -96.62% -
444.namd (avg) -97.97% 691.000 14.000 - -96.62% -
453.povray (unexplained diff vs previous) -97.84% 139.000 3.000 - -98.22% -
433.milc (unexplained diff vs previous) -97.45% 157.000 4.000 - -95.83% -
450.soplex (max) -97.41% 348.000 9.000 - -86.96% -
470.lbm (max) -97.33% 899.000 24.000 - -97.31% -
416.gamess (max) -97.10% 897.000 26.000 - -97.18% -
482.sphinx3 (unexplained diff vs previous) (percentage) -97.04% 3.720 0.110 - -96.41% -
471.omnetpp (max) -96.91% 1262.000 39.000 - -77.33% -
462.libquantum -96.81% 94.000 3.000 - -90.62% -
462.libquantum (avg) -96.81% 94.000 3.000 - -90.62% -
464.h264ref (max) -96.38% 828.000 30.000 - -49.15% -
444.namd (unexplained diff vs previous) (percentage) -95.68% 5.090 0.220 - -95.79% -
453.povray -95.59% 204.000 9.000 - -92.04% -
453.povray (avg) -95.59% 204.000 9.000 - -92.04% -
436.cactusADM -95.53% 806.000 36.000 - -93.85% -
436.cactusADM (avg) -95.53% 806.000 36.000 - -93.85% -
473.astar (unexplained diff vs previous) -95.35% 43.000 2.000 - -96.72% -
434.zeusmp (unexplained diff vs previous) -95.25% 463.000 22.000 - -95.32% -
481.wrf (max) -95.15% 721.000 35.000 - -96.17% -
433.milc (max) -94.53% 201.000 11.000 - -88.66% -
416.gamess (max) (percentage) -94.27% 3.140 0.180 - -94.27% -
434.zeusmp (max) -93.81% 452.000 28.000 - -94.18% -
470.lbm (unexplained diff vs previous) (percentage) -92.99% 4.990 0.350 - -93.06% -
410.bwaves (unexplained diff vs previous) -92.92% 339.000 24.000 - -90.66% -
456.hmmer (max) -92.65% 136.000 10.000 - -89.80% -
453.povray (max) -92.20% 141.000 11.000 - -94.24% -
403.gcc (max) -92.19% 64.000 5.000 - -90.38% -
435.gromacs (unexplained diff vs previous) -92.18% 307.000 24.000 - -91.78% -
435.gromacs (max) -92.03% 954.000 76.000 - -74.32% -
456.hmmer (unexplained diff vs previous) -91.94% 124.000 10.000 - -89.80% -
410.bwaves (max) -91.43% 537.000 46.000 - -82.31% -
433.milc -91.35% 208.000 18.000 - -80.85% -
433.milc (avg) -91.35% 208.000 18.000 - -80.85% -
450.soplex (unexplained diff vs previous) -91.30% 92.000 8.000 - -88.41% -
464.h264ref (max) (percentage) -91.11% 5.510 0.490 - 25.64% -
436.cactusADM (unexplained diff vs previous) (percentage) -90.84% 5.020 0.460 - -90.44% -
470.lbm -90.65% 663.000 62.000 - -89.80% -
470.lbm (avg) -90.65% 663.000 62.000 - -89.80% -
436.cactusADM (max) (percentage) -90.38% 4.780 0.460 - -90.89% -
459.GemsFDTD (max) -90.37% 571.000 55.000 - -90.48% -
459.GemsFDTD (unexplained diff vs previous) -90.14% 558.000 55.000 - -90.58% -
471.omnetpp (max) (percentage) -89.96% 14.040 1.410 - -24.19% -
434.zeusmp -88.34% 343.000 40.000 - -84.31% -
434.zeusmp (avg) -88.34% 343.000 40.000 - -84.31% -
458.sjeng (max) -87.89% 421.000 51.000 - 6.25% -
473.astar (unexplained diff vs previous) (percentage) -87.88% 0.330 0.040 - -91.49% -
470.lbm (max) (percentage) -87.43% 5.250 0.660 - -87.96% -
481.wrf -85.71% 847.000 121.000 - -78.58% -
481.wrf (avg) -85.71% 847.000 121.000 - -78.58% -
464.h264ref (unexplained diff vs previous) -85.37% 82.000 12.000 - -79.31% -
444.namd (max) (percentage) -85.33% 4.840 0.710 - -87.11% -
473.astar (max) -84.26% 305.000 48.000 - -21.31% -
482.sphinx3 (max) (percentage) -83.11% 8.170 1.380 - -56.19% -
462.libquantum (max) (percentage) -82.93% 2.870 0.490 - 512.50% -
435.gromacs (unexplained diff vs previous) (percentage) -82.80% 1.860 0.320 - -81.50% -
410.bwaves (unexplained diff vs previous) (percentage) -82.68% 2.310 0.400 - -77.01% -
435.gromacs (max) (percentage) -82.50% 5.770 1.010 - -42.61% -
481.wrf (max) (percentage) -82.48% 3.140 0.550 - -86.78% -
450.soplex -82.18% 101.000 18.000 - -51.35% -
450.soplex (avg) -82.18% 101.000 18.000 - -51.35% -
416.gamess -81.87% 706.000 128.000 - -73.61% -
416.gamess (avg) -81.87% 706.000 128.000 - -73.61% -
459.GemsFDTD -81.37% 628.000 117.000 - -66.76% -
459.GemsFDTD (avg) -81.37% 628.000 117.000 - -66.76% -
429.mcf -80.62% 289.000 56.000 - 0.00% -
429.mcf (avg) -80.62% 289.000 56.000 - 0.00% -
410.bwaves (max) (percentage) -78.69% 3.660 0.780 - -55.93% -
471.omnetpp -77.46% 244.000 55.000 - -49.54% -
471.omnetpp (avg) -77.46% 244.000 55.000 - -49.54% -
447.dealII (max) -77.08% 144.000 33.000 - -78.00% -
458.sjeng (max) (percentage) -75.10% 2.610 0.650 - 116.67% -
458.sjeng (unexplained diff vs previous) -73.53% 68.000 18.000 - -62.50% -
464.h264ref -70.94% 234.000 68.000 - 15.25% -
464.h264ref (avg) -70.94% 234.000 68.000 - 15.25% -
447.dealII -70.87% 127.000 37.000 - -53.16% -
447.dealII (avg) -70.87% 127.000 37.000 - -53.16% -
453.povray (unexplained diff vs previous) (percentage) -70.27% 1.850 0.550 - -75.98% -
410.bwaves -69.47% 262.000 80.000 - -72.32% -
410.bwaves (avg) -69.47% 262.000 80.000 - -72.32% -
456.hmmer -69.17% 120.000 37.000 - -33.93% -
456.hmmer (avg) -69.17% 120.000 37.000 - -33.93% -
433.milc (unexplained diff vs previous) (percentage) -68.42% 1.140 0.360 - -48.57% -
456.hmmer (max) (percentage) -68.12% 0.690 0.220 - -57.69% -
444.namd (avg) (percentage) -65.57% 4.560 1.570 - -39.62% -
464.h264ref (unexplained diff vs previous) (percentage) -65.45% 0.550 0.190 - -50.00% -
456.hmmer (unexplained diff vs previous) (percentage) -65.08% 0.630 0.220 - -57.69% -
459.GemsFDTD (max) (percentage) -65.00% 2.200 0.770 - -66.23% -
434.zeusmp (unexplained diff vs previous) (percentage) -64.89% 2.250 0.790 - -64.89% -
416.gamess (avg) (percentage) -64.78% 2.470 0.870 - -47.27% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -64.65% 2.150 0.760 - -66.96% -
435.gromacs -62.34% 401.000 151.000 - -5.62% -
435.gromacs (avg) -62.34% 401.000 151.000 - -5.62% -
436.cactusADM (avg) (percentage) -59.65% 3.470 1.400 - -41.67% -
473.astar (max) (percentage) -58.05% 2.360 0.990 - 110.64% -
447.dealII (unexplained diff vs previous) -58.02% 81.000 34.000 - -50.00% -
465.tonto (max) (percentage) -57.66% 1.370 0.580 - -66.08% -
470.lbm (avg) (percentage) -56.85% 3.870 1.670 - -55.23% -
401.bzip2 -56.41% 156.000 68.000 - 51.11% -
401.bzip2 (avg) -56.41% 156.000 68.000 - 51.11% -
434.zeusmp (max) (percentage) -54.09% 2.200 1.010 - -56.09% -
482.sphinx3 (avg) (percentage) -53.21% 4.210 1.970 - -16.17% -
458.sjeng -50.00% 148.000 74.000 - 105.56% -
458.sjeng (avg) -50.00% 148.000 74.000 - 105.56% -
471.omnetpp (unexplained diff vs previous) -48.84% 43.000 22.000 - -64.52% -
481.wrf (avg) (percentage) -48.78% 3.690 1.890 - -26.46% -
465.tonto (max) -46.43% 140.000 75.000 - -66.37% -
458.sjeng (unexplained diff vs previous) (percentage) -45.24% 0.420 0.230 - -23.33% -
400.perlbench (max) -42.11% 38.000 22.000 - -75.28% -
401.bzip2 (unexplained diff vs previous) -37.68% 69.000 43.000 - -37.68% -
453.povray (avg) (percentage) -33.46% 2.720 1.810 - 18.30% -
459.GemsFDTD (avg) (percentage) -32.64% 2.420 1.630 - 17.27% -
450.soplex (max) (percentage) -31.84% 2.230 1.520 - 245.45% -
433.milc (max) (percentage) -30.61% 1.470 1.020 - 43.66% -
483.xalancbmk (avg) (percentage) -30.06% 1.630 1.140 - 103.57% -
464.h264ref (avg) (percentage) -28.85% 1.560 1.110 - 184.62% -
454.calculix (avg) (percentage) -28.83% 4.960 3.530 - 73.89% -
465.tonto (avg) (percentage) -28.80% 1.250 0.890 - -21.93% -
400.perlbench (unexplained diff vs previous) -28.12% 32.000 23.000 - -34.29% -
471.omnetpp (avg) (percentage) -27.21% 2.720 1.980 - 67.80% -
429.mcf (unexplained diff vs previous) -27.08% 48.000 35.000 - 250.00% -
410.bwaves (avg) (percentage) -24.02% 1.790 1.360 - -30.61% -
400.perlbench -18.42% 38.000 31.000 - -27.91% -
400.perlbench (avg) -18.42% 38.000 31.000 - -27.91% -
435.gromacs (avg) (percentage) -17.28% 2.430 2.010 - 111.58% -
401.bzip2 (max) -13.89% 72.000 62.000 - -7.46% -
434.zeusmp (avg) (percentage) -11.98% 1.670 1.470 - 20.49% -
465.tonto -8.66% 127.000 116.000 - -21.62% -
465.tonto (avg) -8.66% 127.000 116.000 - -21.62% -
473.astar -7.37% 95.000 88.000 - 72.55% -
473.astar (avg) -7.37% 95.000 88.000 - 72.55% -
465.tonto (unexplained diff vs previous) (percentage) -2.70% 0.370 0.360 - -68.14% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 3.45% 29.000 30.000 - 3.45% -

Added Tests - sample variability
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 3.26% 48001.000 49564.000 - 3.10% -
453.povray 2.06% 489013.000 499105.000 - 2.04% -
416.gamess 1.69% 4554728.000 4631717.000 - 1.70% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
459.GemsFDTD 1.44% 195766.000 198587.000 - 0.31% -
471.omnetpp 1.26% 295652.000 299385.000 - 0.71% -
462.libquantum 1.13% 13066.000 13214.000 - 0.82% -
447.dealII 1.08% 191136.000 193202.000 - 1.08% -
450.soplex 1.04% 135596.000 137008.000 - -0.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (unexplained diff vs previous) (percentage) 4077.78% 0.090 3.760 - 817.07% -
429.mcf (max) (percentage) 2981.25% 0.320 9.860 - 1912.24% -
403.gcc (max) (percentage) 1471.19% 0.590 9.270 - 1205.63% -
450.soplex (avg) (percentage) 1225.00% 0.240 3.180 - 389.23% -
429.mcf (avg) (percentage) 1156.25% 0.480 6.030 - 146.12% -
462.libquantum (avg) (percentage) 794.74% 0.190 1.700 - 203.57% -
401.bzip2 (avg) (percentage) 759.26% 0.270 2.320 - 152.17% -
454.calculix (unexplained diff vs previous) (percentage) 746.67% 0.750 6.350 - 12.79% -
454.calculix (max) (percentage) 707.14% 0.840 6.780 - 13.57% -
437.leslie3d (unexplained diff vs previous) (percentage) 696.12% 1.030 8.200 - 240.25% -
462.libquantum (max) (percentage) 512.50% 0.080 0.490 - -82.93% -
462.libquantum (unexplained diff vs previous) (percentage) 512.50% 0.080 0.490 - 4800.00% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 163.33% -
445.gobmk (avg) (percentage) 445.45% 0.220 1.200 - 400.00% -
401.bzip2 (max) (percentage) 430.00% 0.400 2.120 - 393.02% -
437.leslie3d (unexplained diff vs previous) 417.65% 187.000 968.000 - 126.70% -
400.perlbench (avg) (percentage) 402.56% 0.390 1.960 - 476.47% -
445.gobmk (unexplained diff vs previous) (percentage) 400.00% 0.150 0.750 - 3650.00% -
400.perlbench (unexplained diff vs previous) (percentage) 361.29% 0.310 1.430 - 410.71% -
473.astar (avg) (percentage) 357.50% 0.400 1.830 - 147.30% -
458.sjeng (avg) (percentage) 313.04% 0.230 0.950 - 3.26% -
401.bzip2 (unexplained diff vs previous) (percentage) 253.66% 0.410 1.450 - 253.66% -
429.mcf (unexplained diff vs previous) 250.00% 10.000 35.000 - -27.08% -
450.soplex (max) (percentage) 245.45% 0.440 1.520 - -31.84% -
437.leslie3d (max) (percentage) 228.06% 3.100 10.170 - 332.77% -
450.soplex (unexplained diff vs previous) (percentage) 204.55% 0.440 1.340 - 127.12% -
464.h264ref (avg) (percentage) 184.62% 0.390 1.110 - -28.85% -
456.hmmer (avg) (percentage) 176.67% 0.300 0.830 - 36.07% -
445.gobmk (max) (percentage) 174.07% 0.270 0.740 - 252.38% -
437.leslie3d (avg) (percentage) 152.10% 1.670 4.210 - 126.34% -
433.milc (avg) (percentage) 149.28% 0.690 1.720 - 13.16% -
429.mcf (max) 145.95% 37.000 91.000 - 59.65% -
447.dealII (unexplained diff vs previous) (percentage) 142.67% 0.750 1.820 - 104.49% -
447.dealII (avg) (percentage) 133.33% 0.870 2.030 - 45.00% -
445.gobmk 122.22% 27.000 60.000 - 106.90% -
445.gobmk (avg) 122.22% 27.000 60.000 - 106.90% -
458.sjeng (max) (percentage) 116.67% 0.300 0.650 - -75.10% -
437.leslie3d (max) 114.29% 560.000 1200.000 - 187.77% -
435.gromacs (avg) (percentage) 111.58% 0.950 2.010 - -17.28% -
445.gobmk (unexplained diff vs previous) 111.11% 18.000 38.000 - 1800.00% -
473.astar (max) (percentage) 110.64% 0.470 0.990 - -58.05% -
458.sjeng 105.56% 36.000 74.000 - -50.00% -
458.sjeng (avg) 105.56% 36.000 74.000 - -50.00% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - -30.06% -
400.perlbench (max) (percentage) 76.25% 0.800 1.410 - 314.71% -
454.calculix (avg) (percentage) 73.89% 2.030 3.530 - -28.83% -
473.astar 72.55% 51.000 88.000 - -7.37% -
473.astar (avg) 72.55% 51.000 88.000 - -7.37% -
483.xalancbmk (max) (percentage) 68.48% 0.920 1.550 - 80.23% -
471.omnetpp (avg) (percentage) 67.80% 1.180 1.980 - -27.21% -
437.leslie3d 64.78% 301.000 496.000 - 50.30% -
437.leslie3d (avg) 64.78% 301.000 496.000 - 50.30% -
401.bzip2 51.11% 45.000 68.000 - -56.41% -
401.bzip2 (avg) 51.11% 45.000 68.000 - -56.41% -
433.milc (max) (percentage) 43.66% 0.710 1.020 - -30.61% -
464.h264ref (max) (percentage) 25.64% 0.390 0.490 - -91.11% -
434.zeusmp (avg) (percentage) 20.49% 1.220 1.470 - -11.98% -
453.povray (avg) (percentage) 18.30% 1.530 1.810 - -33.46% -
459.GemsFDTD (avg) (percentage) 17.27% 1.390 1.630 - -32.64% -
471.omnetpp (unexplained diff vs previous) (percentage) 16.42% 0.670 0.780 - 62.50% -
464.h264ref 15.25% 59.000 68.000 - -70.94% -
464.h264ref (avg) 15.25% 59.000 68.000 - -70.94% -
445.gobmk (max) 12.12% 33.000 37.000 - 42.31% -
447.dealII (max) (percentage) 8.48% 1.650 1.790 - 12.58% -
458.sjeng (max) 6.25% 48.000 51.000 - -87.89% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -3.45% 29.000 28.000 - -3.45% -
nb_execution_successful -3.45% 29.000 28.000 - -3.45% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.75% 10845.000 10221.000 - -5.75% -
434.zeusmp -1.32% 141060.000 139198.000 - -3.58% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix -99.81% 32491.000 63.000 - -99.79% -
403.gcc -99.34% 8890.000 59.000 - -99.35% -
462.libquantum -98.79% 17005.000 205.000 - -98.79% -
482.sphinx3 -97.50% 36586.000 913.000 - -97.57% -
450.soplex -96.21% 15709.000 596.000 - -96.19% -
444.namd -94.37% 15957.000 899.000 - -94.07% -
453.povray -92.63% 7395.000 545.000 - -92.73% -
429.mcf -92.06% 11727.000 931.000 - -92.12% -
433.milc -91.93% 13668.000 1103.000 - -91.96% -
436.cactusADM -89.33% 24396.000 2602.000 - -88.81% -
434.zeusmp -86.72% 20932.000 2779.000 - -86.49% -
400.perlbench -85.62% 11215.000 1613.000 - -85.76% -
401.bzip2 -82.54% 16971.000 2963.000 - -82.53% -
447.dealII -79.46% 9101.000 1869.000 - -79.42% -
470.lbm -77.10% 16312.000 3736.000 - -78.20% -
456.hmmer -76.03% 18995.000 4554.000 - -77.00% -
459.GemsFDTD -71.61% 25364.000 7201.000 - -72.26% -
481.wrf -70.86% 21991.000 6409.000 - -72.10% -
471.omnetpp -69.65% 9265.000 2812.000 - -68.73% -
473.astar -62.54% 12983.000 4863.000 - -62.38% -
410.bwaves -59.67% 14745.000 5946.000 - -59.49% -
464.h264ref -59.14% 15208.000 6214.000 - -58.67% -
445.gobmk -59.08% 12396.000 5072.000 - -59.14% -
435.gromacs -55.33% 16853.000 7528.000 - -54.49% -
458.sjeng -50.91% 16018.000 7863.000 - -51.30% -
416.gamess -49.63% 29409.000 14813.000 - -48.18% -
437.leslie3d -34.70% 18070.000 11800.000 - -33.52% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.91% 1118.000 1.000 - -99.93% -
444.namd (unexplained diff vs previous) -99.76% 834.000 2.000 - -99.74% -
454.calculix -99.70% 659.000 2.000 - -99.87% -
454.calculix (avg) -99.70% 659.000 2.000 - -99.87% -
416.gamess (unexplained diff vs previous) -99.33% 896.000 6.000 - -99.35% -
444.namd (max) -99.32% 879.000 6.000 - -99.18% -
436.cactusADM (max) -99.11% 1231.000 11.000 - -99.01% -
436.cactusADM (unexplained diff vs previous) -98.98% 1173.000 12.000 - -98.97% -
482.sphinx3 (max) -98.96% 1152.000 12.000 - -99.61% -
416.gamess (unexplained diff vs previous) (percentage) -98.69% 3.050 0.040 - -98.77% -
454.calculix (max) -98.53% 272.000 4.000 - -99.78% -
470.lbm (unexplained diff vs previous) -98.42% 822.000 13.000 - -98.48% -
454.calculix (unexplained diff vs previous) -98.36% 244.000 4.000 - -99.76% -
453.povray (unexplained diff vs previous) -98.22% 169.000 3.000 - -97.84% -
482.sphinx3 -98.02% 859.000 17.000 - -98.93% -
482.sphinx3 (avg) -98.02% 859.000 17.000 - -98.93% -
403.gcc -97.37% 38.000 1.000 - -98.77% -
403.gcc (avg) -97.37% 38.000 1.000 - -98.77% -
470.lbm (max) -97.31% 893.000 24.000 - -97.33% -
416.gamess (max) -97.18% 923.000 26.000 - -97.10% -
481.wrf (unexplained diff vs previous) -97.09% 894.000 26.000 - 0.00% -
473.astar (unexplained diff vs previous) -96.72% 61.000 2.000 - -95.35% -
444.namd -96.62% 414.000 14.000 - -97.97% -
444.namd (avg) -96.62% 414.000 14.000 - -97.97% -
482.sphinx3 (unexplained diff vs previous) (percentage) -96.41% 3.060 0.110 - -97.04% -
481.wrf (max) -96.17% 914.000 35.000 - -95.15% -
433.milc (unexplained diff vs previous) -95.83% 96.000 4.000 - -97.45% -
444.namd (unexplained diff vs previous) (percentage) -95.79% 5.230 0.220 - -95.68% -
434.zeusmp (unexplained diff vs previous) -95.32% 470.000 22.000 - -95.25% -
416.gamess (max) (percentage) -94.27% 3.140 0.180 - -94.27% -
453.povray (max) -94.24% 191.000 11.000 - -92.20% -
434.zeusmp (max) -94.18% 481.000 28.000 - -93.81% -
436.cactusADM -93.85% 585.000 36.000 - -95.53% -
436.cactusADM (avg) -93.85% 585.000 36.000 - -95.53% -
470.lbm (unexplained diff vs previous) (percentage) -93.06% 5.040 0.350 - -92.99% -
462.libquantum (unexplained diff vs previous) -92.86% 14.000 1.000 - 0.00% -
462.libquantum (max) -92.31% 13.000 1.000 - -99.79% -
453.povray -92.04% 113.000 9.000 - -95.59% -
453.povray (avg) -92.04% 113.000 9.000 - -95.59% -
435.gromacs (unexplained diff vs previous) -91.78% 292.000 24.000 - -92.18% -
473.astar (unexplained diff vs previous) (percentage) -91.49% 0.470 0.040 - -87.88% -
436.cactusADM (max) (percentage) -90.89% 5.050 0.460 - -90.38% -
410.bwaves (unexplained diff vs previous) -90.66% 257.000 24.000 - -92.92% -
462.libquantum -90.62% 32.000 3.000 - -96.81% -
462.libquantum (avg) -90.62% 32.000 3.000 - -96.81% -
459.GemsFDTD (unexplained diff vs previous) -90.58% 584.000 55.000 - -90.14% -
459.GemsFDTD (max) -90.48% 578.000 55.000 - -90.37% -
436.cactusADM (unexplained diff vs previous) (percentage) -90.44% 4.810 0.460 - -90.84% -
403.gcc (max) -90.38% 52.000 5.000 - -92.19% -
481.wrf (unexplained diff vs previous) (percentage) -89.93% 4.070 0.410 - 0.00% -
470.lbm -89.80% 608.000 62.000 - -90.65% -
470.lbm (avg) -89.80% 608.000 62.000 - -90.65% -
456.hmmer (max) -89.80% 98.000 10.000 - -92.65% -
456.hmmer (unexplained diff vs previous) -89.80% 98.000 10.000 - -91.94% -
433.milc (max) -88.66% 97.000 11.000 - -94.53% -
450.soplex (unexplained diff vs previous) -88.41% 69.000 8.000 - -91.30% -
470.lbm (max) (percentage) -87.96% 5.480 0.660 - -87.43% -
444.namd (max) (percentage) -87.11% 5.510 0.710 - -85.33% -
450.soplex (max) -86.96% 69.000 9.000 - -97.41% -
481.wrf (max) (percentage) -86.78% 4.160 0.550 - -82.48% -
434.zeusmp -84.31% 255.000 40.000 - -88.34% -
434.zeusmp (avg) -84.31% 255.000 40.000 - -88.34% -
410.bwaves (max) -82.31% 260.000 46.000 - -91.43% -
435.gromacs (unexplained diff vs previous) (percentage) -81.50% 1.730 0.320 - -82.80% -
433.milc -80.85% 94.000 18.000 - -91.35% -
433.milc (avg) -80.85% 94.000 18.000 - -91.35% -
464.h264ref (unexplained diff vs previous) -79.31% 58.000 12.000 - -85.37% -
481.wrf -78.58% 565.000 121.000 - -85.71% -
481.wrf (avg) -78.58% 565.000 121.000 - -85.71% -
447.dealII (max) -78.00% 150.000 33.000 - -77.08% -
471.omnetpp (max) -77.33% 172.000 39.000 - -96.91% -
410.bwaves (unexplained diff vs previous) (percentage) -77.01% 1.740 0.400 - -82.68% -
453.povray (unexplained diff vs previous) (percentage) -75.98% 2.290 0.550 - -70.27% -
400.perlbench (max) -75.28% 89.000 22.000 - -42.11% -
435.gromacs (max) -74.32% 296.000 76.000 - -92.03% -
416.gamess -73.61% 485.000 128.000 - -81.87% -
416.gamess (avg) -73.61% 485.000 128.000 - -81.87% -
410.bwaves -72.32% 289.000 80.000 - -69.47% -
410.bwaves (avg) -72.32% 289.000 80.000 - -69.47% -
465.tonto (unexplained diff vs previous) -68.24% 148.000 47.000 - 23.68% -
465.tonto (unexplained diff vs previous) (percentage) -68.14% 1.130 0.360 - -2.70% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -66.96% 2.300 0.760 - -64.65% -
459.GemsFDTD -66.76% 352.000 117.000 - -81.37% -
459.GemsFDTD (avg) -66.76% 352.000 117.000 - -81.37% -
465.tonto (max) -66.37% 223.000 75.000 - -46.43% -
459.GemsFDTD (max) (percentage) -66.23% 2.280 0.770 - -65.00% -
465.tonto (max) (percentage) -66.08% 1.710 0.580 - -57.66% -
434.zeusmp (unexplained diff vs previous) (percentage) -64.89% 2.250 0.790 - -64.89% -
471.omnetpp (unexplained diff vs previous) -64.52% 62.000 22.000 - -48.84% -
458.sjeng (unexplained diff vs previous) -62.50% 48.000 18.000 - -73.53% -
456.hmmer (max) (percentage) -57.69% 0.520 0.220 - -68.12% -
456.hmmer (unexplained diff vs previous) (percentage) -57.69% 0.520 0.220 - -65.08% -
482.sphinx3 (max) (percentage) -56.19% 3.150 1.380 - -83.11% -
434.zeusmp (max) (percentage) -56.09% 2.300 1.010 - -54.09% -
410.bwaves (max) (percentage) -55.93% 1.770 0.780 - -78.69% -
470.lbm (avg) (percentage) -55.23% 3.730 1.670 - -56.85% -
447.dealII -53.16% 79.000 37.000 - -70.87% -
447.dealII (avg) -53.16% 79.000 37.000 - -70.87% -
450.soplex -51.35% 37.000 18.000 - -82.18% -
450.soplex (avg) -51.35% 37.000 18.000 - -82.18% -
447.dealII (unexplained diff vs previous) -50.00% 68.000 34.000 - -58.02% -
464.h264ref (unexplained diff vs previous) (percentage) -50.00% 0.380 0.190 - -65.45% -
471.omnetpp -49.54% 109.000 55.000 - -77.46% -
471.omnetpp (avg) -49.54% 109.000 55.000 - -77.46% -
464.h264ref (max) -49.15% 59.000 30.000 - -96.38% -
433.milc (unexplained diff vs previous) (percentage) -48.57% 0.700 0.360 - -68.42% -
416.gamess (avg) (percentage) -47.27% 1.650 0.870 - -64.78% -
435.gromacs (max) (percentage) -42.61% 1.760 1.010 - -82.50% -
436.cactusADM (avg) (percentage) -41.67% 2.400 1.400 - -59.65% -
444.namd (avg) (percentage) -39.62% 2.600 1.570 - -65.57% -
401.bzip2 (unexplained diff vs previous) -37.68% 69.000 43.000 - -37.68% -
400.perlbench (unexplained diff vs previous) -34.29% 35.000 23.000 - -28.12% -
456.hmmer -33.93% 56.000 37.000 - -69.17% -
456.hmmer (avg) -33.93% 56.000 37.000 - -69.17% -
410.bwaves (avg) (percentage) -30.61% 1.960 1.360 - -24.02% -
400.perlbench -27.91% 43.000 31.000 - -18.42% -
400.perlbench (avg) -27.91% 43.000 31.000 - -18.42% -
481.wrf (avg) (percentage) -26.46% 2.570 1.890 - -48.78% -
471.omnetpp (max) (percentage) -24.19% 1.860 1.410 - -89.96% -
458.sjeng (unexplained diff vs previous) (percentage) -23.33% 0.300 0.230 - -45.24% -
465.tonto (avg) (percentage) -21.93% 1.140 0.890 - -28.80% -
465.tonto -21.62% 148.000 116.000 - -8.66% -
465.tonto (avg) -21.62% 148.000 116.000 - -8.66% -
473.astar (max) -21.31% 61.000 48.000 - -84.26% -
453.povray (max) (percentage) -18.92% 2.590 2.100 - 11.11% -
482.sphinx3 (avg) (percentage) -16.17% 2.350 1.970 - -53.21% -
401.bzip2 (max) -7.46% 67.000 62.000 - -13.89% -
435.gromacs -5.62% 160.000 151.000 - -62.34% -
435.gromacs (avg) -5.62% 160.000 151.000 - -62.34% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 3.45% 29.000 30.000 - 3.45% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1613.000 -85.76%
401.bzip2 2963.000 -82.53%
403.gcc 59.000 -99.35%
410.bwaves 5946.000 -59.49%
416.gamess 14813.000 -48.18%
429.mcf 931.000 -92.12%
433.milc 1103.000 -91.96%
434.zeusmp 2779.000 -86.49%
435.gromacs 7528.000 -54.49%
436.cactusADM 2602.000 -88.81%
437.leslie3d 11800.000 -33.52%
444.namd 899.000 -94.07%
445.gobmk 5072.000 -59.14%
447.dealII 1869.000 -79.42%
450.soplex 596.000 -96.19%
453.povray 545.000 -92.73%
454.calculix 63.000 -99.79%
456.hmmer 4554.000 -77.00%
458.sjeng 7863.000 -51.30%
459.GemsFDTD 7201.000 -72.26%
462.libquantum 205.000 -98.79%
464.h264ref 6214.000 -58.67%
465.tonto 13036.000 27.47%
470.lbm 3736.000 -78.20%
471.omnetpp 2812.000 -68.73%
473.astar 4863.000 -62.38%
481.wrf 6409.000 -72.10%
482.sphinx3 913.000 -97.57%
Geometric Mean 2195.535 -86.12%
Code Size (bytes)
Name Current %
400.perlbench 567102.000 -
401.bzip2 33542.000 -
403.gcc 1603710.000 1.14%
410.bwaves 14723.000 -
416.gamess 4631717.000 1.70%
429.mcf 7701.000 -
433.milc 47965.000 -
434.zeusmp 139198.000 -3.58%
435.gromacs 394950.000 -
436.cactusADM 258202.000 -
437.leslie3d 49564.000 3.10%
444.namd 162891.000 -
445.gobmk 1089944.000 -
447.dealII 193202.000 1.08%
450.soplex 137008.000 -
453.povray 499105.000 2.04%
454.calculix 687701.000 -
456.hmmer 74805.000 -
458.sjeng 81765.000 -
459.GemsFDTD 198587.000 -
462.libquantum 13214.000 -
464.h264ref 302154.000 -
465.tonto 1450245.000 -
470.lbm 10221.000 -5.75%
471.omnetpp 299385.000 -
473.astar 15781.000 1.49%
481.wrf 1537684.000 -
482.sphinx3 79862.000 -
Geometric Mean 157978.654 -
Score
Name Current %
nb_compile_successful 28.000 -3.45%
nb_execution_successful 28.000 -3.45%
nb_total_tests 30.000 3.45%
Geometric Mean 28.651 -1.20%
sample variability
Name Current %
400.perlbench 31.000 -18.42%
400.perlbench (avg) 31.000 -18.42%
400.perlbench (avg) (percentage) 1.960 476.47%
400.perlbench (max) 22.000 -42.11%
400.perlbench (max) (percentage) 1.410 314.71%
400.perlbench (unexplained diff vs previous) 23.000 -28.12%
400.perlbench (unexplained diff vs previous) (percentage) 1.430 410.71%
401.bzip2 68.000 -56.41%
401.bzip2 (avg) 68.000 -56.41%
401.bzip2 (avg) (percentage) 2.320 152.17%
401.bzip2 (max) 62.000 -13.89%
401.bzip2 (max) (percentage) 2.120 393.02%
401.bzip2 (unexplained diff vs previous) 43.000 -37.68%
401.bzip2 (unexplained diff vs previous) (percentage) 1.450 253.66%
403.gcc 1.000 -98.77%
403.gcc (avg) 1.000 -98.77%
403.gcc (avg) (percentage) 2.370 163.33%
403.gcc (max) 5.000 -92.19%
403.gcc (max) (percentage) 9.270 1205.63%
410.bwaves 80.000 -69.47%
410.bwaves (avg) 80.000 -69.47%
410.bwaves (avg) (percentage) 1.360 -24.02%
410.bwaves (max) 46.000 -91.43%
410.bwaves (max) (percentage) 0.780 -78.69%
410.bwaves (unexplained diff vs previous) 24.000 -92.92%
410.bwaves (unexplained diff vs previous) (percentage) 0.400 -82.68%
416.gamess 128.000 -81.87%
416.gamess (avg) 128.000 -81.87%
416.gamess (avg) (percentage) 0.870 -64.78%
416.gamess (max) 26.000 -97.10%
416.gamess (max) (percentage) 0.180 -94.27%
416.gamess (unexplained diff vs previous) 6.000 -99.35%
416.gamess (unexplained diff vs previous) (percentage) 0.040 -98.77%
429.mcf 56.000 -80.62%
429.mcf (avg) 56.000 -80.62%
429.mcf (avg) (percentage) 6.030 146.12%
429.mcf (max) 91.000 59.65%
429.mcf (max) (percentage) 9.860 1912.24%
429.mcf (unexplained diff vs previous) 35.000 -27.08%
429.mcf (unexplained diff vs previous) (percentage) 3.760 817.07%
433.milc 18.000 -91.35%
433.milc (avg) 18.000 -91.35%
433.milc (avg) (percentage) 1.720 13.16%
433.milc (max) 11.000 -94.53%
433.milc (max) (percentage) 1.020 -30.61%
433.milc (unexplained diff vs previous) 4.000 -97.45%
433.milc (unexplained diff vs previous) (percentage) 0.360 -68.42%
434.zeusmp 40.000 -88.34%
434.zeusmp (avg) 40.000 -88.34%
434.zeusmp (avg) (percentage) 1.470 -11.98%
434.zeusmp (max) 28.000 -93.81%
434.zeusmp (max) (percentage) 1.010 -54.09%
434.zeusmp (unexplained diff vs previous) 22.000 -95.25%
434.zeusmp (unexplained diff vs previous) (percentage) 0.790 -64.89%
435.gromacs 151.000 -62.34%
435.gromacs (avg) 151.000 -62.34%
435.gromacs (avg) (percentage) 2.010 -17.28%
435.gromacs (max) 76.000 -92.03%
435.gromacs (max) (percentage) 1.010 -82.50%
435.gromacs (unexplained diff vs previous) 24.000 -92.18%
435.gromacs (unexplained diff vs previous) (percentage) 0.320 -82.80%
436.cactusADM 36.000 -95.53%
436.cactusADM (avg) 36.000 -95.53%
436.cactusADM (avg) (percentage) 1.400 -59.65%
436.cactusADM (max) 11.000 -99.01%
436.cactusADM (max) (percentage) 0.460 -90.38%
436.cactusADM (unexplained diff vs previous) 12.000 -98.97%
436.cactusADM (unexplained diff vs previous) (percentage) 0.460 -90.84%
437.leslie3d 496.000 50.30%
437.leslie3d (avg) 496.000 50.30%
437.leslie3d (avg) (percentage) 4.210 126.34%
437.leslie3d (max) 1200.000 187.77%
437.leslie3d (max) (percentage) 10.170 332.77%
437.leslie3d (unexplained diff vs previous) 968.000 126.70%
437.leslie3d (unexplained diff vs previous) (percentage) 8.200 240.25%
444.namd 14.000 -97.97%
444.namd (avg) 14.000 -97.97%
444.namd (avg) (percentage) 1.570 -65.57%
444.namd (max) 6.000 -99.18%
444.namd (max) (percentage) 0.710 -85.33%
444.namd (unexplained diff vs previous) 2.000 -99.74%
444.namd (unexplained diff vs previous) (percentage) 0.220 -95.68%
445.gobmk 60.000 106.90%
445.gobmk (avg) 60.000 106.90%
445.gobmk (avg) (percentage) 1.200 400.00%
445.gobmk (max) 37.000 42.31%
445.gobmk (max) (percentage) 0.740 252.38%
445.gobmk (unexplained diff vs previous) 38.000 1800.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.750 3650.00%
447.dealII 37.000 -70.87%
447.dealII (avg) 37.000 -70.87%
447.dealII (avg) (percentage) 2.030 45.00%
447.dealII (max) 33.000 -77.08%
447.dealII (max) (percentage) 1.790 12.58%
447.dealII (unexplained diff vs previous) 34.000 -58.02%
447.dealII (unexplained diff vs previous) (percentage) 1.820 104.49%
450.soplex 18.000 -82.18%
450.soplex (avg) 18.000 -82.18%
450.soplex (avg) (percentage) 3.180 389.23%
450.soplex (max) 9.000 -97.41%
450.soplex (max) (percentage) 1.520 -31.84%
450.soplex (unexplained diff vs previous) 8.000 -91.30%
450.soplex (unexplained diff vs previous) (percentage) 1.340 127.12%
453.povray 9.000 -95.59%
453.povray (avg) 9.000 -95.59%
453.povray (avg) (percentage) 1.810 -33.46%
453.povray (max) 11.000 -92.20%
453.povray (max) (percentage) 2.100 11.11%
453.povray (unexplained diff vs previous) 3.000 -97.84%
453.povray (unexplained diff vs previous) (percentage) 0.550 -70.27%
454.calculix 2.000 -99.87%
454.calculix (avg) 2.000 -99.87%
454.calculix (avg) (percentage) 3.530 -28.83%
454.calculix (max) 4.000 -99.78%
454.calculix (max) (percentage) 6.780 13.57%
454.calculix (unexplained diff vs previous) 4.000 -99.76%
454.calculix (unexplained diff vs previous) (percentage) 6.350 12.79%
456.hmmer 37.000 -69.17%
456.hmmer (avg) 37.000 -69.17%
456.hmmer (avg) (percentage) 0.830 36.07%
456.hmmer (max) 10.000 -92.65%
456.hmmer (max) (percentage) 0.220 -68.12%
456.hmmer (unexplained diff vs previous) 10.000 -91.94%
456.hmmer (unexplained diff vs previous) (percentage) 0.220 -65.08%
458.sjeng 74.000 -50.00%
458.sjeng (avg) 74.000 -50.00%
458.sjeng (avg) (percentage) 0.950 3.26%
458.sjeng (max) 51.000 -87.89%
458.sjeng (max) (percentage) 0.650 -75.10%
458.sjeng (unexplained diff vs previous) 18.000 -73.53%
458.sjeng (unexplained diff vs previous) (percentage) 0.230 -45.24%
459.GemsFDTD 117.000 -81.37%
459.GemsFDTD (avg) 117.000 -81.37%
459.GemsFDTD (avg) (percentage) 1.630 -32.64%
459.GemsFDTD (max) 55.000 -90.37%
459.GemsFDTD (max) (percentage) 0.770 -65.00%
459.GemsFDTD (unexplained diff vs previous) 55.000 -90.14%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.760 -64.65%
462.libquantum 3.000 -96.81%
462.libquantum (avg) 3.000 -96.81%
462.libquantum (avg) (percentage) 1.700 203.57%
462.libquantum (max) 1.000 -99.79%
462.libquantum (max) (percentage) 0.490 -82.93%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.490 4800.00%
464.h264ref 68.000 -70.94%
464.h264ref (avg) 68.000 -70.94%
464.h264ref (avg) (percentage) 1.110 -28.85%
464.h264ref (max) 30.000 -96.38%
464.h264ref (max) (percentage) 0.490 -91.11%
464.h264ref (unexplained diff vs previous) 12.000 -85.37%
464.h264ref (unexplained diff vs previous) (percentage) 0.190 -65.45%
465.tonto 116.000 -8.66%
465.tonto (avg) 116.000 -8.66%
465.tonto (avg) (percentage) 0.890 -28.80%
465.tonto (max) 75.000 -46.43%
465.tonto (max) (percentage) 0.580 -57.66%
465.tonto (unexplained diff vs previous) 47.000 23.68%
465.tonto (unexplained diff vs previous) (percentage) 0.360 -2.70%
470.lbm 62.000 -90.65%
470.lbm (avg) 62.000 -90.65%
470.lbm (avg) (percentage) 1.670 -56.85%
470.lbm (max) 24.000 -97.33%
470.lbm (max) (percentage) 0.660 -87.43%
470.lbm (unexplained diff vs previous) 13.000 -98.48%
470.lbm (unexplained diff vs previous) (percentage) 0.350 -92.99%
471.omnetpp 55.000 -77.46%
471.omnetpp (avg) 55.000 -77.46%
471.omnetpp (avg) (percentage) 1.980 -27.21%
471.omnetpp (max) 39.000 -96.91%
471.omnetpp (max) (percentage) 1.410 -89.96%
471.omnetpp (unexplained diff vs previous) 22.000 -48.84%
471.omnetpp (unexplained diff vs previous) (percentage) 0.780 62.50%
473.astar 88.000 -7.37%
473.astar (avg) 88.000 -7.37%
473.astar (avg) (percentage) 1.830 147.30%
473.astar (max) 48.000 -84.26%
473.astar (max) (percentage) 0.990 -58.05%
473.astar (unexplained diff vs previous) 2.000 -95.35%
473.astar (unexplained diff vs previous) (percentage) 0.040 -87.88%
481.wrf 121.000 -85.71%
481.wrf (avg) 121.000 -85.71%
481.wrf (avg) (percentage) 1.890 -48.78%
481.wrf (max) 35.000 -95.15%
481.wrf (max) (percentage) 0.550 -82.48%
481.wrf (unexplained diff vs previous) 26.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.410 -
482.sphinx3 17.000 -98.93%
482.sphinx3 (avg) 17.000 -98.93%
482.sphinx3 (avg) (percentage) 1.970 -53.21%
482.sphinx3 (max) 12.000 -99.61%
482.sphinx3 (max) (percentage) 1.380 -83.11%
482.sphinx3 (unexplained diff vs previous) 1.000 -99.93%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -97.04%
483.xalancbmk (avg) (percentage) 1.140 -30.06%
483.xalancbmk (max) (percentage) 1.550 80.23%
Geometric Mean 6.458 -74.96%