Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ee7af0e7107e918d37bd2686fea1db8f88d2242a (+ 431 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/3cefe91b74f65f0db71472e01ca83c69e2cd81cc (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=8d7b6b4cb27d4dec1dd5f7960298c1699275f962 (+ 82 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=30e92e8838a078df359a97e36d048f06bbd5bec1 (+ 1333 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-arm-master-Os_LTO-build/188/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0188 (3-changed-components) 2024-05-10T07:15:29 0:00:00
Previous 0188 (glibc-2.36.9000-00340-g8fb923ddc38) 2022-11-28T08:17:41 0:00:00
Baseline 0001 (3-changed-components) 2022-12-30T06:27:35 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 85 72
Performance Improvements 125 140
Unchanged Tests 1026 1024
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 2.92% 48001.000 49404.000 - 2.92% -
453.povray 2.08% 489083.000 499261.000 - 2.10% -
459.GemsFDTD 1.56% 195782.000 198835.000 - 1.57% -
447.dealII 1.53% 190250.000 193162.000 - 1.06% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
465.tonto 1.05% 1437933.000 1453097.000 - 1.07% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 20.36% 10203.000 12280.000 - -5.86% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
400.perlbench (unexplained diff vs previous) (percentage) 8033.33% 0.030 2.440 0.000 687.10% 0.000
433.milc (unexplained diff vs previous) (percentage) 4500.00% 0.010 0.460 0.000 -34.29% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 4083.33% 0.060 2.510 0.000 512.20% 0.000
437.leslie3d (unexplained diff vs previous) (percentage) 3102.94% 0.340 10.890 0.000 957.28% 0.000
435.gromacs (unexplained diff vs previous) (percentage) 2700.00% 0.010 0.280 0.000 -83.82% 0.000
429.mcf (max) (percentage) 2494.74% 0.380 9.860 - 2981.25% -
403.gcc (max) (percentage) 2457.14% 0.350 8.950 - 1416.95% -
462.libquantum (unexplained diff vs previous) (percentage) 2200.00% 0.020 0.460 0.000 475.00% 0.000
437.leslie3d (unexplained diff vs previous) 1904.84% 62.000 1243.000 0.000 564.71% 0.000
473.astar (unexplained diff vs previous) (percentage) 1466.67% 0.030 0.470 0.000 0.00% 0.000
400.perlbench (unexplained diff vs previous) 1266.67% 3.000 41.000 0.000 17.14% 0.000
450.soplex (avg) (percentage) 1208.70% 0.230 3.010 - 1154.17% -
435.gromacs (unexplained diff vs previous) 950.00% 2.000 21.000 0.000 -92.81% 0.000
429.mcf (avg) (percentage) 923.21% 0.560 5.730 - 1093.75% -
401.bzip2 (avg) (percentage) 646.67% 0.300 2.240 - 729.63% -
401.bzip2 (unexplained diff vs previous) 630.00% 10.000 73.000 0.000 5.80% 0.000
462.libquantum (avg) (percentage) 579.17% 0.240 1.630 - 757.89% -
401.bzip2 (max) (percentage) 562.16% 0.370 2.450 - 512.50% -
473.astar (unexplained diff vs previous) 475.00% 4.000 23.000 0.000 -62.30% 0.000
445.gobmk (avg) (percentage) 470.00% 0.200 1.140 - 418.18% -
454.calculix (max) (percentage) 457.53% 0.730 4.070 - 384.52% -
400.perlbench (avg) (percentage) 457.14% 0.350 1.950 - 400.00% -
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 451.16% -
458.sjeng (max) (percentage) 418.18% 0.110 0.570 - 90.00% -
433.milc (unexplained diff vs previous) 400.00% 1.000 5.000 0.000 -94.79% 0.000
450.soplex (max) (percentage) 391.67% 0.240 1.180 - 168.18% -
436.cactusADM (unexplained diff vs previous) (percentage) 354.55% 0.110 0.500 0.000 -89.60% 0.000
429.mcf (unexplained diff vs previous) (percentage) 344.44% 0.090 0.400 0.000 344.44% 0.000
400.perlbench (max) (percentage) 332.76% 0.580 2.510 - 213.75% -
473.astar (avg) (percentage) 311.63% 0.430 1.770 - 342.50% -
437.leslie3d (max) (percentage) 273.38% 2.630 9.820 - 216.77% -
453.povray (unexplained diff vs previous) (percentage) 246.15% 0.260 0.900 0.000 -60.70% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 233.33% 0.060 0.200 0.000 -33.33% 0.000
458.sjeng (avg) (percentage) 233.33% 0.270 0.900 - 291.30% -
473.astar (max) (percentage) 220.69% 0.290 0.930 - 97.87% -
444.namd (unexplained diff vs previous) (percentage) 205.56% 0.180 0.550 0.000 -89.48% 0.000
456.hmmer (avg) (percentage) 196.30% 0.270 0.800 - 166.67% -
462.libquantum (max) (percentage) 192.86% 0.280 0.820 - 925.00% -
429.mcf (max) 179.55% 44.000 123.000 - 232.43% -
450.soplex (unexplained diff vs previous) (percentage) 175.00% 0.240 0.660 0.000 50.00% 0.000
437.leslie3d (avg) (percentage) 167.68% 1.640 4.390 - 162.87% -
458.sjeng (max) 158.82% 17.000 44.000 - -8.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) 148.72% 0.390 0.970 0.000 -68.30% 0.000
483.xalancbmk (max) (percentage) 148.39% 0.620 1.540 - 67.39% -
445.gobmk 141.67% 24.000 58.000 - 114.81% -
445.gobmk (avg) 141.67% 24.000 58.000 - 114.81% -
464.h264ref (avg) (percentage) 136.36% 0.440 1.040 - 166.67% -
437.leslie3d (max) 135.01% 477.000 1121.000 - 100.18% -
465.tonto (unexplained diff vs previous) 132.22% 90.000 209.000 0.000 41.22% 0.000
447.dealII (avg) (percentage) 106.45% 0.930 1.920 - 120.69% -
435.gromacs (avg) (percentage) 103.19% 0.940 1.910 - 101.05% -
433.milc (avg) (percentage) 102.53% 0.790 1.600 - 131.88% -
465.tonto (unexplained diff vs previous) (percentage) 93.18% 0.880 1.700 0.000 50.44% 0.000
483.xalancbmk (avg) (percentage) 90.00% 0.600 1.140 - 103.57% -
470.lbm (unexplained diff vs previous) (percentage) 83.33% 0.060 0.110 0.000 -97.82% 0.000
445.gobmk (max) (percentage) 81.48% 0.270 0.490 - 81.48% -
437.leslie3d 68.12% 298.000 501.000 - 66.45% -
437.leslie3d (avg) 68.12% 298.000 501.000 - 66.45% -
458.sjeng 62.79% 43.000 70.000 - 94.44% -
458.sjeng (avg) 62.79% 43.000 70.000 - 94.44% -
458.sjeng (unexplained diff vs previous) 60.00% 10.000 16.000 0.000 -66.67% 0.000
471.omnetpp (avg) (percentage) 57.38% 1.220 1.920 - 62.71% -
473.astar 54.55% 55.000 85.000 - 66.67% -
473.astar (avg) 54.55% 55.000 85.000 - 66.67% -
456.hmmer (unexplained diff vs previous) (percentage) 46.15% 0.260 0.380 0.000 -26.92% 0.000
410.bwaves (unexplained diff vs previous) (percentage) 41.27% 0.630 0.890 0.000 -48.85% 0.000
401.bzip2 27.45% 51.000 65.000 - 44.44% -
401.bzip2 (avg) 27.45% 51.000 65.000 - 44.44% -
454.calculix (avg) (percentage) 25.55% 2.740 3.440 - 69.46% -
473.astar (max) 21.62% 37.000 45.000 - -26.23% -
465.tonto (max) 15.62% 224.000 259.000 - 16.14% -
434.zeusmp (avg) (percentage) 14.88% 1.210 1.390 - 13.93% -
401.bzip2 (max) 12.70% 63.000 71.000 - 5.97% -
456.hmmer (max) (percentage) 11.43% 0.350 0.390 - -25.00% -
429.mcf 9.23% 65.000 71.000 - 26.79% -
429.mcf (avg) 9.23% 65.000 71.000 - 26.79% -
453.povray (avg) (percentage) 8.18% 1.590 1.720 - 12.42% -
459.GemsFDTD (avg) (percentage) 6.94% 1.440 1.540 - 10.79% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm -5.90% 10845.000 10205.000 - -5.90% -
434.zeusmp -1.85% 141896.000 139266.000 - -1.27% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -98.71% 16945.000 218.000 - -98.72% -
482.sphinx3 -97.55% 37838.000 926.000 - -97.47% -
450.soplex -96.17% 15708.000 602.000 - -96.17% -
444.namd -94.35% 15941.000 901.000 - -94.35% -
453.povray -92.89% 7806.000 555.000 - -92.49% -
433.milc -91.98% 13697.000 1098.000 - -91.97% -
429.mcf -89.39% 11761.000 1248.000 - -89.36% -
436.cactusADM -89.27% 24422.000 2621.000 - -89.26% -
434.zeusmp -86.80% 20983.000 2770.000 - -86.77% -
400.perlbench -85.04% 11213.000 1677.000 - -85.05% -
401.bzip2 -82.94% 17072.000 2912.000 - -82.84% -
447.dealII -78.21% 9196.000 2004.000 - -77.98% -
470.lbm -78.00% 17128.000 3769.000 - -76.89% -
456.hmmer -76.32% 19755.000 4678.000 - -75.37% -
459.GemsFDTD -73.43% 26066.000 6927.000 - -72.69% -
471.omnetpp -69.31% 9166.000 2813.000 - -69.64% -
473.astar -62.45% 12913.000 4849.000 - -62.65% -
410.bwaves -59.85% 14898.000 5981.000 - -59.44% -
445.gobmk -58.94% 12410.000 5095.000 - -58.90% -
464.h264ref -58.85% 14959.000 6156.000 - -59.52% -
435.gromacs -55.29% 16839.000 7528.000 - -55.33% -
458.sjeng -51.31% 16115.000 7847.000 - -51.01% -
437.leslie3d -37.17% 18174.000 11418.000 - -36.81% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) -99.46% 1475.000 8.000 - -99.31% -
444.namd (max) -99.28% 696.000 5.000 - -99.43% -
434.zeusmp (max) -98.61% 432.000 6.000 - -98.75% -
436.cactusADM (max) -98.54% 893.000 13.000 - -98.94% -
482.sphinx3 -98.25% 972.000 17.000 - -98.02% -
482.sphinx3 (avg) -98.25% 972.000 17.000 - -98.02% -
470.lbm (max) -98.13% 642.000 12.000 - -98.66% -
462.libquantum (max) -97.87% 47.000 1.000 - -92.31% -
444.namd -96.77% 403.000 13.000 - -96.86% -
444.namd (avg) -96.77% 403.000 13.000 - -96.86% -
433.milc (max) -96.67% 120.000 4.000 - -95.88% -
453.povray (max) -95.83% 192.000 8.000 - -95.81% -
459.GemsFDTD (max) -95.72% 724.000 31.000 - -94.64% -
416.gamess (max) (percentage) -95.03% 3.020 0.150 - -95.22% -
436.cactusADM -94.26% 610.000 35.000 - -94.02% -
436.cactusADM (avg) -94.26% 610.000 35.000 - -94.02% -
482.sphinx3 (unexplained diff vs previous) -93.92% 148.000 9.000 0.000 -99.19% 0.000
481.wrf (max) (percentage) -92.87% 4.070 0.290 - -93.03% -
453.povray -92.74% 124.000 9.000 - -92.04% -
453.povray (avg) -92.74% 124.000 9.000 - -92.04% -
462.libquantum -92.50% 40.000 3.000 - -90.62% -
462.libquantum (avg) -92.50% 40.000 3.000 - -90.62% -
459.GemsFDTD (unexplained diff vs previous) -92.06% 63.000 5.000 0.000 -99.14% 0.000
470.lbm (max) (percentage) -91.20% 3.750 0.330 - -93.98% -
464.h264ref (unexplained diff vs previous) -91.09% 101.000 9.000 0.000 -84.48% 0.000
470.lbm -90.56% 625.000 59.000 - -90.30% -
470.lbm (avg) -90.56% 625.000 59.000 - -90.30% -
450.soplex (unexplained diff vs previous) -89.19% 37.000 4.000 0.000 -94.20% 0.000
434.zeusmp (max) (percentage) -88.35% 2.060 0.240 - -89.57% -
434.zeusmp (unexplained diff vs previous) -88.00% 25.000 3.000 0.000 -99.36% 0.000
444.namd (max) (percentage) -86.50% 4.370 0.590 - -89.29% -
436.cactusADM (max) (percentage) -86.34% 3.660 0.500 - -90.10% -
464.h264ref (max) -86.00% 100.000 14.000 - -76.27% -
434.zeusmp -84.98% 253.000 38.000 - -85.10% -
434.zeusmp (avg) -84.98% 253.000 38.000 - -85.10% -
433.milc -84.26% 108.000 17.000 - -81.91% -
433.milc (avg) -84.26% 108.000 17.000 - -81.91% -
459.GemsFDTD (max) (percentage) -83.45% 2.780 0.460 - -79.82% -
444.namd (unexplained diff vs previous) -82.14% 28.000 5.000 0.000 -99.40% 0.000
410.bwaves (max) -81.34% 284.000 53.000 - -79.62% -
450.soplex (max) -81.08% 37.000 7.000 - -89.86% -
447.dealII (unexplained diff vs previous) -80.49% 41.000 8.000 0.000 -88.24% 0.000
447.dealII (max) -80.00% 90.000 18.000 - -88.00% -
464.h264ref (unexplained diff vs previous) (percentage) -77.94% 0.680 0.150 0.000 -60.53% 0.000
435.gromacs (max) -76.03% 242.000 58.000 - -80.41% -
482.sphinx3 (max) (percentage) -75.38% 3.900 0.960 - -69.52% -
453.povray (unexplained diff vs previous) -75.00% 20.000 5.000 0.000 -97.04% 0.000
462.libquantum (unexplained diff vs previous) -75.00% 4.000 1.000 0.000 -92.86% 0.000
410.bwaves -74.26% 303.000 78.000 - -73.01% -
410.bwaves (avg) -74.26% 303.000 78.000 - -73.01% -
456.hmmer (max) -73.91% 69.000 18.000 - -81.63% -
459.GemsFDTD -71.73% 375.000 106.000 - -69.89% -
459.GemsFDTD (avg) -71.73% 375.000 106.000 - -69.89% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -70.83% 0.240 0.070 0.000 -96.96% 0.000
471.omnetpp (unexplained diff vs previous) -69.36% 173.000 53.000 0.000 -14.52% 0.000
471.omnetpp (max) -69.23% 169.000 52.000 - -69.77% -
456.hmmer (unexplained diff vs previous) -65.38% 52.000 18.000 0.000 -81.63% 0.000
464.h264ref (max) (percentage) -64.18% 0.670 0.240 - -38.46% -
445.gobmk (unexplained diff vs previous) -63.64% 33.000 12.000 0.000 -33.33% 0.000
470.lbm (unexplained diff vs previous) -63.64% 11.000 4.000 0.000 -99.51% 0.000
470.lbm (avg) (percentage) -56.44% 3.650 1.590 - -57.37% -
447.dealII -55.29% 85.000 38.000 - -51.90% -
447.dealII (avg) -55.29% 85.000 38.000 - -51.90% -
429.mcf (unexplained diff vs previous) -54.55% 11.000 5.000 0.000 -50.00% 0.000
410.bwaves (max) (percentage) -53.40% 1.910 0.890 - -49.72% -
436.cactusADM (unexplained diff vs previous) -51.85% 27.000 13.000 0.000 -98.89% 0.000
471.omnetpp -51.35% 111.000 54.000 - -50.46% -
471.omnetpp (avg) -51.35% 111.000 54.000 - -50.46% -
450.soplex -50.00% 36.000 18.000 - -51.35% -
450.soplex (avg) -50.00% 36.000 18.000 - -51.35% -
433.milc (max) (percentage) -48.86% 0.880 0.450 - -36.62% -
416.gamess (avg) (percentage) -47.85% 1.630 0.850 - -48.48% -
436.cactusADM (avg) (percentage) -46.40% 2.500 1.340 - -44.17% -
435.gromacs (max) (percentage) -45.83% 1.440 0.780 - -55.68% -
410.bwaves (unexplained diff vs previous) -43.62% 94.000 53.000 0.000 -79.38% 0.000
444.namd (avg) (percentage) -40.32% 2.530 1.510 - -41.92% -
453.povray (max) (percentage) -39.27% 2.470 1.500 - -42.08% -
400.perlbench (max) -35.38% 65.000 42.000 - -52.81% -
410.bwaves (avg) (percentage) -35.29% 2.040 1.320 - -32.65% -
481.wrf (avg) (percentage) -31.99% 2.720 1.850 - -28.02% -
465.tonto (avg) (percentage) -30.37% 1.350 0.940 - -17.54% -
456.hmmer -30.19% 53.000 37.000 - -33.93% -
456.hmmer (avg) -30.19% 53.000 37.000 - -33.93% -
445.gobmk (max) -27.27% 33.000 24.000 - -27.27% -
482.sphinx3 (avg) (percentage) -26.07% 2.570 1.900 - -19.15% -
400.perlbench -17.95% 39.000 32.000 - -25.58% -
400.perlbench (avg) -17.95% 39.000 32.000 - -25.58% -
465.tonto -16.06% 137.000 115.000 - -22.30% -
465.tonto (avg) -16.06% 137.000 115.000 - -22.30% -
445.gobmk (unexplained diff vs previous) (percentage) -11.11% 0.270 0.240 0.000 60.00% 0.000
447.dealII (unexplained diff vs previous) (percentage) -11.11% 0.450 0.400 0.000 -46.67% 0.000
435.gromacs -9.49% 158.000 143.000 - -10.62% -
435.gromacs (avg) -9.49% 158.000 143.000 - -10.62% -
447.dealII (max) (percentage) -8.16% 0.980 0.900 - -45.45% -
465.tonto (max) (percentage) -4.09% 2.200 2.110 - 23.39% -
464.h264ref -1.54% 65.000 64.000 - 8.47% -
464.h264ref (avg) -1.54% 65.000 64.000 - 8.47% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d 2.92% 48001.000 49404.000 - 2.92% -
453.povray 2.10% 489013.000 499261.000 - 2.08% -
459.GemsFDTD 1.57% 195766.000 198835.000 - 1.56% -
473.astar 1.49% 15549.000 15781.000 - 1.49% -
462.libquantum 1.13% 13066.000 13214.000 - 0.52% -
465.tonto 1.07% 1437761.000 1453097.000 - 1.05% -
447.dealII 1.06% 191136.000 193162.000 - 1.53% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) (percentage) 2981.25% 0.320 9.860 - 2494.74% -
403.gcc (max) (percentage) 1416.95% 0.590 8.950 - 2457.14% -
450.soplex (avg) (percentage) 1154.17% 0.240 3.010 - 1208.70% -
429.mcf (avg) (percentage) 1093.75% 0.480 5.730 - 923.21% -
437.leslie3d (unexplained diff vs previous) (percentage) 957.28% 1.030 10.890 0.000 3102.94% 0.000
462.libquantum (max) (percentage) 925.00% 0.080 0.820 - 192.86% -
462.libquantum (avg) (percentage) 757.89% 0.190 1.630 - 579.17% -
401.bzip2 (avg) (percentage) 729.63% 0.270 2.240 - 646.67% -
400.perlbench (unexplained diff vs previous) (percentage) 687.10% 0.310 2.440 0.000 8033.33% 0.000
437.leslie3d (unexplained diff vs previous) 564.71% 187.000 1243.000 0.000 1904.84% 0.000
401.bzip2 (max) (percentage) 512.50% 0.400 2.450 - 562.16% -
401.bzip2 (unexplained diff vs previous) (percentage) 512.20% 0.410 2.510 0.000 4083.33% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 475.00% 0.080 0.460 0.000 2200.00% 0.000
403.gcc (avg) (percentage) 451.16% 0.430 2.370 - 451.16% -
445.gobmk (avg) (percentage) 418.18% 0.220 1.140 - 470.00% -
400.perlbench (avg) (percentage) 400.00% 0.390 1.950 - 457.14% -
454.calculix (max) (percentage) 384.52% 0.840 4.070 - 457.53% -
429.mcf (unexplained diff vs previous) (percentage) 344.44% 0.090 0.400 0.000 344.44% 0.000
473.astar (avg) (percentage) 342.50% 0.400 1.770 - 311.63% -
458.sjeng (avg) (percentage) 291.30% 0.230 0.900 - 233.33% -
429.mcf (max) 232.43% 37.000 123.000 - 179.55% -
437.leslie3d (max) (percentage) 216.77% 3.100 9.820 - 273.38% -
400.perlbench (max) (percentage) 213.75% 0.800 2.510 - 332.76% -
471.omnetpp (unexplained diff vs previous) (percentage) 180.60% 0.670 1.880 0.000 -0.53% 0.000
450.soplex (max) (percentage) 168.18% 0.440 1.180 - 391.67% -
456.hmmer (avg) (percentage) 166.67% 0.300 0.800 - 196.30% -
464.h264ref (avg) (percentage) 166.67% 0.390 1.040 - 136.36% -
437.leslie3d (avg) (percentage) 162.87% 1.670 4.390 - 167.68% -
433.milc (avg) (percentage) 131.88% 0.690 1.600 - 102.53% -
447.dealII (avg) (percentage) 120.69% 0.870 1.920 - 106.45% -
445.gobmk 114.81% 27.000 58.000 - 141.67% -
445.gobmk (avg) 114.81% 27.000 58.000 - 141.67% -
483.xalancbmk (avg) (percentage) 103.57% 0.560 1.140 - 90.00% -
435.gromacs (avg) (percentage) 101.05% 0.950 1.910 - 103.19% -
437.leslie3d (max) 100.18% 560.000 1121.000 - 135.01% -
473.astar (max) (percentage) 97.87% 0.470 0.930 - 220.69% -
458.sjeng 94.44% 36.000 70.000 - 62.79% -
458.sjeng (avg) 94.44% 36.000 70.000 - 62.79% -
458.sjeng (max) (percentage) 90.00% 0.300 0.570 - 418.18% -
445.gobmk (max) (percentage) 81.48% 0.270 0.490 - 81.48% -
454.calculix (avg) (percentage) 69.46% 2.030 3.440 - 25.55% -
483.xalancbmk (max) (percentage) 67.39% 0.920 1.540 - 148.39% -
473.astar 66.67% 51.000 85.000 - 54.55% -
473.astar (avg) 66.67% 51.000 85.000 - 54.55% -
437.leslie3d 66.45% 301.000 501.000 - 68.12% -
437.leslie3d (avg) 66.45% 301.000 501.000 - 68.12% -
471.omnetpp (avg) (percentage) 62.71% 1.180 1.920 - 57.38% -
445.gobmk (unexplained diff vs previous) (percentage) 60.00% 0.150 0.240 0.000 -11.11% 0.000
465.tonto (unexplained diff vs previous) (percentage) 50.44% 1.130 1.700 0.000 93.18% 0.000
450.soplex (unexplained diff vs previous) (percentage) 50.00% 0.440 0.660 0.000 175.00% 0.000
401.bzip2 44.44% 45.000 65.000 - 27.45% -
401.bzip2 (avg) 44.44% 45.000 65.000 - 27.45% -
465.tonto (unexplained diff vs previous) 41.22% 148.000 209.000 0.000 132.22% 0.000
429.mcf 26.79% 56.000 71.000 - 9.23% -
429.mcf (avg) 26.79% 56.000 71.000 - 9.23% -
465.tonto (max) (percentage) 23.39% 1.710 2.110 - -4.09% -
400.perlbench (unexplained diff vs previous) 17.14% 35.000 41.000 0.000 1266.67% 0.000
465.tonto (max) 16.14% 223.000 259.000 - 15.62% -
434.zeusmp (avg) (percentage) 13.93% 1.220 1.390 - 14.88% -
453.povray (avg) (percentage) 12.42% 1.530 1.720 - 8.18% -
459.GemsFDTD (avg) (percentage) 10.79% 1.390 1.540 - 6.94% -
464.h264ref 8.47% 59.000 64.000 - -1.54% -
464.h264ref (avg) 8.47% 59.000 64.000 - -1.54% -
401.bzip2 (max) 5.97% 67.000 71.000 - 12.70% -
401.bzip2 (unexplained diff vs previous) 5.80% 69.000 73.000 0.000 630.00% 0.000

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
470.lbm -5.90% 10845.000 10205.000 - -5.90% -
434.zeusmp -1.27% 141060.000 139266.000 - -1.85% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -98.72% 17005.000 218.000 - -98.71% -
482.sphinx3 -97.47% 36586.000 926.000 - -97.55% -
450.soplex -96.17% 15709.000 602.000 - -96.17% -
444.namd -94.35% 15957.000 901.000 - -94.35% -
453.povray -92.49% 7395.000 555.000 - -92.89% -
433.milc -91.97% 13668.000 1098.000 - -91.98% -
429.mcf -89.36% 11727.000 1248.000 - -89.39% -
436.cactusADM -89.26% 24396.000 2621.000 - -89.27% -
434.zeusmp -86.77% 20932.000 2770.000 - -86.80% -
400.perlbench -85.05% 11215.000 1677.000 - -85.04% -
401.bzip2 -82.84% 16971.000 2912.000 - -82.94% -
447.dealII -77.98% 9101.000 2004.000 - -78.21% -
470.lbm -76.89% 16312.000 3769.000 - -78.00% -
456.hmmer -75.37% 18995.000 4678.000 - -76.32% -
459.GemsFDTD -72.69% 25364.000 6927.000 - -73.43% -
471.omnetpp -69.64% 9265.000 2813.000 - -69.31% -
473.astar -62.65% 12983.000 4849.000 - -62.45% -
464.h264ref -59.52% 15208.000 6156.000 - -58.85% -
410.bwaves -59.44% 14745.000 5981.000 - -59.85% -
445.gobmk -58.90% 12396.000 5095.000 - -58.94% -
435.gromacs -55.33% 16853.000 7528.000 - -55.29% -
458.sjeng -51.01% 16018.000 7847.000 - -51.31% -
437.leslie3d -36.81% 18070.000 11418.000 - -37.17% -
465.tonto -5.86% 13044.000 12280.000 - 20.36% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -99.51% 822.000 4.000 0.000 -63.64% 0.000
444.namd (max) -99.43% 879.000 5.000 - -99.28% -
444.namd (unexplained diff vs previous) -99.40% 834.000 5.000 0.000 -82.14% 0.000
434.zeusmp (unexplained diff vs previous) -99.36% 470.000 3.000 0.000 -88.00% 0.000
482.sphinx3 (max) -99.31% 1152.000 8.000 - -99.46% -
482.sphinx3 (unexplained diff vs previous) -99.19% 1118.000 9.000 0.000 -93.92% 0.000
459.GemsFDTD (unexplained diff vs previous) -99.14% 584.000 5.000 0.000 -92.06% 0.000
436.cactusADM (max) -98.94% 1231.000 13.000 - -98.54% -
436.cactusADM (unexplained diff vs previous) -98.89% 1173.000 13.000 0.000 -51.85% 0.000
434.zeusmp (max) -98.75% 481.000 6.000 - -98.61% -
470.lbm (max) -98.66% 893.000 12.000 - -98.13% -
482.sphinx3 -98.02% 859.000 17.000 - -98.25% -
482.sphinx3 (avg) -98.02% 859.000 17.000 - -98.25% -
470.lbm (unexplained diff vs previous) (percentage) -97.82% 5.040 0.110 0.000 83.33% 0.000
453.povray (unexplained diff vs previous) -97.04% 169.000 5.000 0.000 -75.00% 0.000
459.GemsFDTD (unexplained diff vs previous) (percentage) -96.96% 2.300 0.070 0.000 -70.83% 0.000
444.namd -96.86% 414.000 13.000 - -96.77% -
444.namd (avg) -96.86% 414.000 13.000 - -96.77% -
433.milc (max) -95.88% 97.000 4.000 - -96.67% -
453.povray (max) -95.81% 191.000 8.000 - -95.83% -
416.gamess (max) (percentage) -95.22% 3.140 0.150 - -95.03% -
434.zeusmp (unexplained diff vs previous) (percentage) -95.11% 2.250 0.110 0.000 -8.33% 0.000
433.milc (unexplained diff vs previous) -94.79% 96.000 5.000 0.000 400.00% 0.000
459.GemsFDTD (max) -94.64% 578.000 31.000 - -95.72% -
450.soplex (unexplained diff vs previous) -94.20% 69.000 4.000 0.000 -89.19% 0.000
436.cactusADM -94.02% 585.000 35.000 - -94.26% -
436.cactusADM (avg) -94.02% 585.000 35.000 - -94.26% -
470.lbm (max) (percentage) -93.98% 5.480 0.330 - -91.20% -
481.wrf (max) (percentage) -93.03% 4.160 0.290 - -92.87% -
462.libquantum (unexplained diff vs previous) -92.86% 14.000 1.000 0.000 -75.00% 0.000
435.gromacs (unexplained diff vs previous) -92.81% 292.000 21.000 0.000 950.00% 0.000
462.libquantum (max) -92.31% 13.000 1.000 - -97.87% -
453.povray -92.04% 113.000 9.000 - -92.74% -
453.povray (avg) -92.04% 113.000 9.000 - -92.74% -
462.libquantum -90.62% 32.000 3.000 - -92.50% -
462.libquantum (avg) -90.62% 32.000 3.000 - -92.50% -
470.lbm -90.30% 608.000 59.000 - -90.56% -
470.lbm (avg) -90.30% 608.000 59.000 - -90.56% -
436.cactusADM (max) (percentage) -90.10% 5.050 0.500 - -86.34% -
450.soplex (max) -89.86% 69.000 7.000 - -81.08% -
436.cactusADM (unexplained diff vs previous) (percentage) -89.60% 4.810 0.500 0.000 354.55% 0.000
434.zeusmp (max) (percentage) -89.57% 2.300 0.240 - -88.35% -
444.namd (unexplained diff vs previous) (percentage) -89.48% 5.230 0.550 0.000 205.56% 0.000
444.namd (max) (percentage) -89.29% 5.510 0.590 - -86.50% -
447.dealII (unexplained diff vs previous) -88.24% 68.000 8.000 0.000 -80.49% 0.000
447.dealII (max) -88.00% 150.000 18.000 - -80.00% -
434.zeusmp -85.10% 255.000 38.000 - -84.98% -
434.zeusmp (avg) -85.10% 255.000 38.000 - -84.98% -
464.h264ref (unexplained diff vs previous) -84.48% 58.000 9.000 0.000 -91.09% 0.000
435.gromacs (unexplained diff vs previous) (percentage) -83.82% 1.730 0.280 0.000 2700.00% 0.000
433.milc -81.91% 94.000 17.000 - -84.26% -
433.milc (avg) -81.91% 94.000 17.000 - -84.26% -
456.hmmer (max) -81.63% 98.000 18.000 - -73.91% -
456.hmmer (unexplained diff vs previous) -81.63% 98.000 18.000 0.000 -65.38% 0.000
435.gromacs (max) -80.41% 296.000 58.000 - -76.03% -
459.GemsFDTD (max) (percentage) -79.82% 2.280 0.460 - -83.45% -
410.bwaves (max) -79.62% 260.000 53.000 - -81.34% -
410.bwaves (unexplained diff vs previous) -79.38% 257.000 53.000 0.000 -43.62% 0.000
464.h264ref (max) -76.27% 59.000 14.000 - -86.00% -
410.bwaves -73.01% 289.000 78.000 - -74.26% -
410.bwaves (avg) -73.01% 289.000 78.000 - -74.26% -
459.GemsFDTD -69.89% 352.000 106.000 - -71.73% -
459.GemsFDTD (avg) -69.89% 352.000 106.000 - -71.73% -
471.omnetpp (max) -69.77% 172.000 52.000 - -69.23% -
482.sphinx3 (max) (percentage) -69.52% 3.150 0.960 - -75.38% -
482.sphinx3 (unexplained diff vs previous) (percentage) -68.30% 3.060 0.970 0.000 148.72% 0.000
458.sjeng (unexplained diff vs previous) -66.67% 48.000 16.000 0.000 60.00% 0.000
473.astar (unexplained diff vs previous) -62.30% 61.000 23.000 0.000 475.00% 0.000
453.povray (unexplained diff vs previous) (percentage) -60.70% 2.290 0.900 0.000 246.15% 0.000
464.h264ref (unexplained diff vs previous) (percentage) -60.53% 0.380 0.150 0.000 -77.94% 0.000
470.lbm (avg) (percentage) -57.37% 3.730 1.590 - -56.44% -
435.gromacs (max) (percentage) -55.68% 1.760 0.780 - -45.83% -
400.perlbench (max) -52.81% 89.000 42.000 - -35.38% -
447.dealII -51.90% 79.000 38.000 - -55.29% -
447.dealII (avg) -51.90% 79.000 38.000 - -55.29% -
450.soplex -51.35% 37.000 18.000 - -50.00% -
450.soplex (avg) -51.35% 37.000 18.000 - -50.00% -
471.omnetpp -50.46% 109.000 54.000 - -51.35% -
471.omnetpp (avg) -50.46% 109.000 54.000 - -51.35% -
429.mcf (unexplained diff vs previous) -50.00% 10.000 5.000 0.000 -54.55% 0.000
410.bwaves (max) (percentage) -49.72% 1.770 0.890 - -53.40% -
410.bwaves (unexplained diff vs previous) (percentage) -48.85% 1.740 0.890 0.000 41.27% 0.000
416.gamess (avg) (percentage) -48.48% 1.650 0.850 - -47.85% -
447.dealII (unexplained diff vs previous) (percentage) -46.67% 0.750 0.400 0.000 -11.11% 0.000
447.dealII (max) (percentage) -45.45% 1.650 0.900 - -8.16% -
436.cactusADM (avg) (percentage) -44.17% 2.400 1.340 - -46.40% -
453.povray (max) (percentage) -42.08% 2.590 1.500 - -39.27% -
444.namd (avg) (percentage) -41.92% 2.600 1.510 - -40.32% -
464.h264ref (max) (percentage) -38.46% 0.390 0.240 - -64.18% -
433.milc (max) (percentage) -36.62% 0.710 0.450 - -48.86% -
433.milc (unexplained diff vs previous) (percentage) -34.29% 0.700 0.460 0.000 4500.00% 0.000
456.hmmer -33.93% 56.000 37.000 - -30.19% -
456.hmmer (avg) -33.93% 56.000 37.000 - -30.19% -
445.gobmk (unexplained diff vs previous) -33.33% 18.000 12.000 0.000 -63.64% 0.000
458.sjeng (unexplained diff vs previous) (percentage) -33.33% 0.300 0.200 0.000 233.33% 0.000
410.bwaves (avg) (percentage) -32.65% 1.960 1.320 - -35.29% -
481.wrf (avg) (percentage) -28.02% 2.570 1.850 - -31.99% -
445.gobmk (max) -27.27% 33.000 24.000 - -27.27% -
456.hmmer (unexplained diff vs previous) (percentage) -26.92% 0.520 0.380 0.000 46.15% 0.000
473.astar (max) -26.23% 61.000 45.000 - 21.62% -
400.perlbench -25.58% 43.000 32.000 - -17.95% -
400.perlbench (avg) -25.58% 43.000 32.000 - -17.95% -
456.hmmer (max) (percentage) -25.00% 0.520 0.390 - 11.43% -
465.tonto -22.30% 148.000 115.000 - -16.06% -
465.tonto (avg) -22.30% 148.000 115.000 - -16.06% -
482.sphinx3 (avg) (percentage) -19.15% 2.350 1.900 - -26.07% -
465.tonto (avg) (percentage) -17.54% 1.140 0.940 - -30.37% -
471.omnetpp (unexplained diff vs previous) -14.52% 62.000 53.000 0.000 -69.36% 0.000
435.gromacs -10.62% 160.000 143.000 - -9.49% -
435.gromacs (avg) -10.62% 160.000 143.000 - -9.49% -
458.sjeng (max) -8.33% 48.000 44.000 - 158.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 134.48% 29.000 68.000 - 134.48% -
nb_compile_successful 65.52% 29.000 48.000 - 65.52% -
nb_execution_successful 65.52% 29.000 48.000 - 65.52% -

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1677.000 -85.04%
401.bzip2 2912.000 -82.94%
410.bwaves 5981.000 -59.85%
429.mcf 1248.000 -89.39%
433.milc 1098.000 -91.98%
434.zeusmp 2770.000 -86.80%
435.gromacs 7528.000 -55.29%
436.cactusADM 2621.000 -89.27%
437.leslie3d 11418.000 -37.17%
444.namd 901.000 -94.35%
445.gobmk 5095.000 -58.94%
447.dealII 2004.000 -78.21%
450.soplex 602.000 -96.17%
453.povray 555.000 -92.89%
456.hmmer 4678.000 -76.32%
458.sjeng 7847.000 -51.31%
459.GemsFDTD 6927.000 -73.43%
462.libquantum 218.000 -98.71%
464.h264ref 6156.000 -58.85%
465.tonto 12280.000 20.36%
470.lbm 3769.000 -78.00%
471.omnetpp 2813.000 -69.31%
473.astar 4849.000 -62.45%
482.sphinx3 926.000 -97.55%
Geometric Mean 2656.927 -82.62%
Code Size (bytes)
Name Current %
400.perlbench 566246.000 -
401.bzip2 33566.000 -
410.bwaves 14683.000 -
429.mcf 7701.000 -
433.milc 47949.000 -
434.zeusmp 139266.000 -1.85%
435.gromacs 394638.000 -
436.cactusADM 257818.000 -
437.leslie3d 49404.000 2.92%
444.namd 162591.000 -
445.gobmk 1090064.000 -
447.dealII 193162.000 1.53%
450.soplex 136925.000 -
453.povray 499261.000 2.08%
456.hmmer 74845.000 -
458.sjeng 81701.000 -
459.GemsFDTD 198835.000 1.56%
462.libquantum 13214.000 -
464.h264ref 302002.000 -
465.tonto 1453097.000 1.05%
470.lbm 10205.000 -5.90%
471.omnetpp 297549.000 -
473.astar 15781.000 1.49%
482.sphinx3 79846.000 -
Geometric Mean 106520.810 -
Score
Name Current %
nb_compile_successful 48.000 65.52%
nb_execution_successful 48.000 65.52%
nb_total_tests 68.000 134.48%
Geometric Mean 53.909 85.89%
sample variability
Name Current %
400.perlbench 32.000 -17.95%
400.perlbench (avg) 32.000 -17.95%
400.perlbench (avg) (percentage) 1.950 457.14%
400.perlbench (max) 42.000 -35.38%
400.perlbench (max) (percentage) 2.510 332.76%
400.perlbench (unexplained diff vs previous) 41.000 1266.67%
400.perlbench (unexplained diff vs previous) (percentage) 2.440 8033.33%
401.bzip2 65.000 27.45%
401.bzip2 (avg) 65.000 27.45%
401.bzip2 (avg) (percentage) 2.240 646.67%
401.bzip2 (max) 71.000 12.70%
401.bzip2 (max) (percentage) 2.450 562.16%
401.bzip2 (unexplained diff vs previous) 73.000 630.00%
401.bzip2 (unexplained diff vs previous) (percentage) 2.510 4083.33%
403.gcc (avg) (percentage) 2.370 451.16%
403.gcc (max) (percentage) 8.950 2457.14%
410.bwaves 78.000 -74.26%
410.bwaves (avg) 78.000 -74.26%
410.bwaves (avg) (percentage) 1.320 -35.29%
410.bwaves (max) 53.000 -81.34%
410.bwaves (max) (percentage) 0.890 -53.40%
410.bwaves (unexplained diff vs previous) 53.000 -43.62%
410.bwaves (unexplained diff vs previous) (percentage) 0.890 41.27%
416.gamess (avg) (percentage) 0.850 -47.85%
416.gamess (max) (percentage) 0.150 -95.03%
429.mcf 71.000 9.23%
429.mcf (avg) 71.000 9.23%
429.mcf (avg) (percentage) 5.730 923.21%
429.mcf (max) 123.000 179.55%
429.mcf (max) (percentage) 9.860 2494.74%
429.mcf (unexplained diff vs previous) 5.000 -54.55%
429.mcf (unexplained diff vs previous) (percentage) 0.400 344.44%
433.milc 17.000 -84.26%
433.milc (avg) 17.000 -84.26%
433.milc (avg) (percentage) 1.600 102.53%
433.milc (max) 4.000 -96.67%
433.milc (max) (percentage) 0.450 -48.86%
433.milc (unexplained diff vs previous) 5.000 400.00%
433.milc (unexplained diff vs previous) (percentage) 0.460 4500.00%
434.zeusmp 38.000 -84.98%
434.zeusmp (avg) 38.000 -84.98%
434.zeusmp (avg) (percentage) 1.390 14.88%
434.zeusmp (max) 6.000 -98.61%
434.zeusmp (max) (percentage) 0.240 -88.35%
434.zeusmp (unexplained diff vs previous) 3.000 -88.00%
434.zeusmp (unexplained diff vs previous) (percentage) 0.110 -
435.gromacs 143.000 -9.49%
435.gromacs (avg) 143.000 -9.49%
435.gromacs (avg) (percentage) 1.910 103.19%
435.gromacs (max) 58.000 -76.03%
435.gromacs (max) (percentage) 0.780 -45.83%
435.gromacs (unexplained diff vs previous) 21.000 950.00%
435.gromacs (unexplained diff vs previous) (percentage) 0.280 2700.00%
436.cactusADM 35.000 -94.26%
436.cactusADM (avg) 35.000 -94.26%
436.cactusADM (avg) (percentage) 1.340 -46.40%
436.cactusADM (max) 13.000 -98.54%
436.cactusADM (max) (percentage) 0.500 -86.34%
436.cactusADM (unexplained diff vs previous) 13.000 -51.85%
436.cactusADM (unexplained diff vs previous) (percentage) 0.500 354.55%
437.leslie3d 501.000 68.12%
437.leslie3d (avg) 501.000 68.12%
437.leslie3d (avg) (percentage) 4.390 167.68%
437.leslie3d (max) 1121.000 135.01%
437.leslie3d (max) (percentage) 9.820 273.38%
437.leslie3d (unexplained diff vs previous) 1243.000 1904.84%
437.leslie3d (unexplained diff vs previous) (percentage) 10.890 3102.94%
444.namd 13.000 -96.77%
444.namd (avg) 13.000 -96.77%
444.namd (avg) (percentage) 1.510 -40.32%
444.namd (max) 5.000 -99.28%
444.namd (max) (percentage) 0.590 -86.50%
444.namd (unexplained diff vs previous) 5.000 -82.14%
444.namd (unexplained diff vs previous) (percentage) 0.550 205.56%
445.gobmk 58.000 141.67%
445.gobmk (avg) 58.000 141.67%
445.gobmk (avg) (percentage) 1.140 470.00%
445.gobmk (max) 24.000 -27.27%
445.gobmk (max) (percentage) 0.490 81.48%
445.gobmk (unexplained diff vs previous) 12.000 -63.64%
445.gobmk (unexplained diff vs previous) (percentage) 0.240 -11.11%
447.dealII 38.000 -55.29%
447.dealII (avg) 38.000 -55.29%
447.dealII (avg) (percentage) 1.920 106.45%
447.dealII (max) 18.000 -80.00%
447.dealII (max) (percentage) 0.900 -8.16%
447.dealII (unexplained diff vs previous) 8.000 -80.49%
447.dealII (unexplained diff vs previous) (percentage) 0.400 -11.11%
450.soplex 18.000 -50.00%
450.soplex (avg) 18.000 -50.00%
450.soplex (avg) (percentage) 3.010 1208.70%
450.soplex (max) 7.000 -81.08%
450.soplex (max) (percentage) 1.180 391.67%
450.soplex (unexplained diff vs previous) 4.000 -89.19%
450.soplex (unexplained diff vs previous) (percentage) 0.660 175.00%
453.povray 9.000 -92.74%
453.povray (avg) 9.000 -92.74%
453.povray (avg) (percentage) 1.720 8.18%
453.povray (max) 8.000 -95.83%
453.povray (max) (percentage) 1.500 -39.27%
453.povray (unexplained diff vs previous) 5.000 -75.00%
453.povray (unexplained diff vs previous) (percentage) 0.900 246.15%
454.calculix (avg) (percentage) 3.440 25.55%
454.calculix (max) (percentage) 4.070 457.53%
456.hmmer 37.000 -30.19%
456.hmmer (avg) 37.000 -30.19%
456.hmmer (avg) (percentage) 0.800 196.30%
456.hmmer (max) 18.000 -73.91%
456.hmmer (max) (percentage) 0.390 11.43%
456.hmmer (unexplained diff vs previous) 18.000 -65.38%
456.hmmer (unexplained diff vs previous) (percentage) 0.380 46.15%
458.sjeng 70.000 62.79%
458.sjeng (avg) 70.000 62.79%
458.sjeng (avg) (percentage) 0.900 233.33%
458.sjeng (max) 44.000 158.82%
458.sjeng (max) (percentage) 0.570 418.18%
458.sjeng (unexplained diff vs previous) 16.000 60.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.200 233.33%
459.GemsFDTD 106.000 -71.73%
459.GemsFDTD (avg) 106.000 -71.73%
459.GemsFDTD (avg) (percentage) 1.540 6.94%
459.GemsFDTD (max) 31.000 -95.72%
459.GemsFDTD (max) (percentage) 0.460 -83.45%
459.GemsFDTD (unexplained diff vs previous) 5.000 -92.06%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.070 -70.83%
462.libquantum 3.000 -92.50%
462.libquantum (avg) 3.000 -92.50%
462.libquantum (avg) (percentage) 1.630 579.17%
462.libquantum (max) 1.000 -97.87%
462.libquantum (max) (percentage) 0.820 192.86%
462.libquantum (unexplained diff vs previous) 1.000 -75.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.460 2200.00%
464.h264ref 64.000 -1.54%
464.h264ref (avg) 64.000 -1.54%
464.h264ref (avg) (percentage) 1.040 136.36%
464.h264ref (max) 14.000 -86.00%
464.h264ref (max) (percentage) 0.240 -64.18%
464.h264ref (unexplained diff vs previous) 9.000 -91.09%
464.h264ref (unexplained diff vs previous) (percentage) 0.150 -77.94%
465.tonto 115.000 -16.06%
465.tonto (avg) 115.000 -16.06%
465.tonto (avg) (percentage) 0.940 -30.37%
465.tonto (max) 259.000 15.62%
465.tonto (max) (percentage) 2.110 -4.09%
465.tonto (unexplained diff vs previous) 209.000 132.22%
465.tonto (unexplained diff vs previous) (percentage) 1.700 93.18%
470.lbm 59.000 -90.56%
470.lbm (avg) 59.000 -90.56%
470.lbm (avg) (percentage) 1.590 -56.44%
470.lbm (max) 12.000 -98.13%
470.lbm (max) (percentage) 0.330 -91.20%
470.lbm (unexplained diff vs previous) 4.000 -63.64%
470.lbm (unexplained diff vs previous) (percentage) 0.110 83.33%
471.omnetpp 54.000 -51.35%
471.omnetpp (avg) 54.000 -51.35%
471.omnetpp (avg) (percentage) 1.920 57.38%
471.omnetpp (max) 52.000 -69.23%
471.omnetpp (max) (percentage) 1.850 -
471.omnetpp (unexplained diff vs previous) 53.000 -69.36%
471.omnetpp (unexplained diff vs previous) (percentage) 1.880 -
473.astar 85.000 54.55%
473.astar (avg) 85.000 54.55%
473.astar (avg) (percentage) 1.770 311.63%
473.astar (max) 45.000 21.62%
473.astar (max) (percentage) 0.930 220.69%
473.astar (unexplained diff vs previous) 23.000 475.00%
473.astar (unexplained diff vs previous) (percentage) 0.470 1466.67%
481.wrf (avg) (percentage) 1.850 -31.99%
481.wrf (max) (percentage) 0.290 -92.87%
482.sphinx3 17.000 -98.25%
482.sphinx3 (avg) 17.000 -98.25%
482.sphinx3 (avg) (percentage) 1.900 -26.07%
482.sphinx3 (max) 8.000 -99.46%
482.sphinx3 (max) (percentage) 0.960 -75.38%
482.sphinx3 (unexplained diff vs previous) 9.000 -93.92%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.970 148.72%
483.xalancbmk (avg) (percentage) 1.140 90.00%
483.xalancbmk (max) (percentage) 1.540 148.39%
Geometric Mean 6.057 -26.10%