Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f06b840b9a063aa33b8b50745bddc8e6845c8f29 (+ 30 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/5e812e8c1e8d65aee05cc3fbbe5727d4e365df57 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=db9b47e9f996bbdb831580ff7343542a017c80ee (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=06a6642c97bbf927195d2748ba2755a9a0c208de (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/19/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0019 (-00000-) 2023-03-22T18:20:39 0:00:00
Previous 0015 (3-changed-components) 2023-03-20T12:41:11 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 29 13
Performance Improvements 172 196
Added Tests 2 2
Unchanged Tests 1033 1025
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 7.27% 55.000 59.000 - 5.36% -
435.gromacs 2.43% 7321.000 7499.000 - 3.16% -
454.calculix 1.64% 61.000 62.000 - 0.00% -
400.perlbench 1.53% 1636.000 1661.000 - -0.12% -
429.mcf 1.34% 1416.000 1435.000 - 0.77% -
444.namd 1.08% 738.000 746.000 - -0.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 1633.33% 0.030 0.520 - -99.81% -
456.hmmer (unexplained diff vs previous) 1400.00% 1.000 15.000 - -99.81% -
410.bwaves (unexplained diff vs previous) (percentage) 1125.00% 0.120 1.470 - -98.93% -
410.bwaves (unexplained diff vs previous) 1085.71% 7.000 83.000 - -98.94% -
416.gamess (unexplained diff vs previous) (percentage) 800.00% 0.020 0.180 - -99.71% -
444.namd (unexplained diff vs previous) 700.00% 1.000 8.000 - -99.90% -
444.namd (unexplained diff vs previous) (percentage) 664.29% 0.140 1.070 - -99.90% -
416.gamess (unexplained diff vs previous) 633.33% 3.000 22.000 - -99.72% -
434.zeusmp (unexplained diff vs previous) 283.33% 6.000 23.000 - -99.80% -
434.zeusmp (unexplained diff vs previous) (percentage) 283.33% 0.240 0.920 - -99.79% -
433.milc (unexplained diff vs previous) (percentage) 126.67% 1.200 2.720 - -99.72% -
433.milc (unexplained diff vs previous) 121.43% 14.000 31.000 - -99.73% -
410.bwaves (max) (percentage) 52.63% 0.950 1.450 - -97.50% -
437.leslie3d (unexplained diff vs previous) (percentage) 50.20% 7.430 11.160 - -43.86% -
410.bwaves (max) 50.00% 54.000 81.000 - -97.53% -
437.leslie3d (unexplained diff vs previous) 35.17% 870.000 1176.000 - -49.18% -
437.leslie3d (max) (percentage) 25.03% 8.030 10.040 - -39.45% -
433.milc (max) (percentage) 12.77% 2.350 2.650 - -97.08% -
437.leslie3d (max) 12.45% 940.000 1057.000 - -45.20% -
433.milc (max) 11.11% 27.000 30.000 - -97.13% -
437.leslie3d (avg) (percentage) 7.90% 3.290 3.550 - 16.39% -
403.gcc (max) 5.88% 34.000 36.000 - -34.55% -
450.soplex (unexplained diff vs previous) (percentage) 1.97% 2.030 2.070 - -99.92% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -10.04% 11710.000 10534.000 - -9.50% -
433.milc -2.65% 1171.000 1140.000 - -0.96% -
450.soplex -2.03% 591.000 579.000 - 2.12% -
459.GemsFDTD -1.61% 6261.000 6160.000 - -0.21% -
410.bwaves -1.45% 5736.000 5653.000 - 0.02% -
481.wrf -1.23% 5538.000 5470.000 - -1.16% -
470.lbm -1.19% 3871.000 3825.000 - 0.98% -
482.sphinx3 -1.14% 963.000 952.000 - 0.74% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
436.cactusADM (unexplained diff vs previous) -98.72% 78.000 1.000 - -99.99% -
436.cactusADM (unexplained diff vs previous) (percentage) -98.66% 3.720 0.050 - -99.99% -
429.mcf (unexplained diff vs previous) (percentage) -95.97% 32.770 1.320 - -99.90% -
429.mcf (unexplained diff vs previous) -95.91% 464.000 19.000 - -99.90% -
464.h264ref (unexplained diff vs previous) (percentage) -90.56% 1.800 0.170 - -99.86% -
464.h264ref (unexplained diff vs previous) -90.38% 104.000 10.000 - -99.85% -
473.astar (unexplained diff vs previous) -85.76% 309.000 44.000 - -99.57% -
447.dealII (unexplained diff vs previous) -85.71% 14.000 2.000 - -99.97% -
473.astar (unexplained diff vs previous) (percentage) -85.64% 5.920 0.850 - -99.57% -
447.dealII (unexplained diff vs previous) (percentage) -85.37% 0.820 0.120 - -99.97% -
465.tonto (unexplained diff vs previous) -84.86% 436.000 66.000 - -96.27% -
465.tonto (unexplained diff vs previous) (percentage) -84.85% 3.960 0.600 - -96.29% -
483.xalancbmk (unexplained diff vs previous) -78.11% 169.000 37.000 - -99.56% -
483.xalancbmk (unexplained diff vs previous) (percentage) -77.90% 4.390 0.970 - -99.56% -
471.omnetpp (unexplained diff vs previous) -75.00% 40.000 10.000 - -99.91% -
471.omnetpp (unexplained diff vs previous) (percentage) -74.83% 1.470 0.370 - -99.91% -
482.sphinx3 (unexplained diff vs previous) -71.05% 38.000 11.000 - -99.96% -
482.sphinx3 (unexplained diff vs previous) (percentage) -70.63% 3.950 1.160 - -99.96% -
481.wrf (unexplained diff vs previous) -62.64% 182.000 68.000 - -99.44% -
481.wrf (unexplained diff vs previous) (percentage) -62.31% 3.290 1.240 - -99.44% -
401.bzip2 (unexplained diff vs previous) (percentage) -62.24% 0.980 0.370 - -99.90% -
401.bzip2 (unexplained diff vs previous) -62.07% 29.000 11.000 - -99.90% -
453.povray (max) (percentage) -60.14% 1.380 0.550 - -99.40% -
454.calculix (max) -60.00% 5.000 2.000 - -96.72% -
450.soplex (max) -57.69% 26.000 11.000 - -97.98% -
453.povray (max) -57.14% 7.000 3.000 - -99.40% -
470.lbm (unexplained diff vs previous) -57.01% 107.000 46.000 - -99.54% -
470.lbm (unexplained diff vs previous) (percentage) -56.52% 2.760 1.200 - -99.54% -
454.calculix (max) (percentage) -55.45% 8.620 3.840 - -96.15% -
459.GemsFDTD (unexplained diff vs previous) -55.31% 226.000 101.000 - -99.35% -
450.soplex (max) (percentage) -54.99% 4.510 2.030 - -97.89% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -54.57% 3.610 1.640 - -99.35% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.99% -
462.libquantum (unexplained diff vs previous) (percentage) -49.65% 1.430 0.720 - -99.99% -
471.omnetpp (max) -37.66% 77.000 48.000 - -97.79% -
471.omnetpp (max) (percentage) -37.28% 2.870 1.800 - -97.74% -
462.libquantum (max) -33.33% 3.000 2.000 - -98.55% -
400.perlbench (unexplained diff vs previous) (percentage) -31.36% 2.200 1.510 - -99.71% -
400.perlbench (unexplained diff vs previous) -30.56% 36.000 25.000 - -99.72% -
462.libquantum (max) (percentage) -28.23% 2.480 1.780 - -98.20% -
445.gobmk (unexplained diff vs previous) (percentage) -26.80% 0.970 0.710 - -99.36% -
445.gobmk (unexplained diff vs previous) -26.53% 49.000 36.000 - -99.35% -
473.astar (max) -25.61% 328.000 244.000 - -92.84% -
473.astar (max) (percentage) -25.08% 6.300 4.720 - -92.89% -
435.gromacs (unexplained diff vs previous) (percentage) -19.93% 2.960 2.370 - -97.55% -
458.sjeng (unexplained diff vs previous) (percentage) -18.80% 1.170 0.950 - -98.95% -
458.sjeng (unexplained diff vs previous) -18.18% 88.000 72.000 - -98.95% -
435.gromacs (unexplained diff vs previous) -17.97% 217.000 178.000 - -97.47% -
482.sphinx3 (max) -17.95% 39.000 32.000 - -96.49% -
464.h264ref (max) -17.14% 105.000 87.000 - -97.22% -
464.h264ref (max) (percentage) -16.94% 1.830 1.520 - -97.20% -
482.sphinx3 (max) (percentage) -16.79% 4.110 3.420 - -96.46% -
465.tonto (max) (percentage) -16.75% 4.120 3.430 - -82.24% -
465.tonto (max) -16.11% 453.000 380.000 - -82.01% -
481.wrf (max) -13.30% 188.000 163.000 - -95.71% -
483.xalancbmk (max) -13.07% 176.000 153.000 - -94.16% -
483.xalancbmk (max) (percentage) -12.42% 4.590 4.020 - -94.15% -
481.wrf (max) (percentage) -12.35% 3.400 2.980 - -95.66% -
459.GemsFDTD (max) -11.54% 234.000 207.000 - -95.31% -
429.mcf (max) (percentage) -11.10% 25.140 22.350 - -75.94% -
470.lbm (max) -11.01% 109.000 97.000 - -96.47% -
401.bzip2 (max) -10.34% 29.000 26.000 - -98.88% -
435.gromacs (max) (percentage) -10.08% 3.570 3.210 - -93.47% -
447.dealII (max) (percentage) -10.07% 1.490 1.340 - -98.33% -
401.bzip2 (max) (percentage) -9.90% 1.010 0.910 - -98.84% -
459.GemsFDTD (max) (percentage) -9.89% 3.740 3.370 - -95.28% -
458.sjeng (max) (percentage) -9.88% 1.620 1.460 - -96.93% -
429.mcf (max) -9.86% 355.000 320.000 - -75.79% -
470.lbm (max) (percentage) -9.86% 2.840 2.560 - -96.47% -
458.sjeng (max) -9.09% 121.000 110.000 - -96.95% -
435.gromacs (max) -8.05% 261.000 240.000 - -93.28% -
434.zeusmp (max) -8.00% 50.000 46.000 - -97.76% -
447.dealII (max) -8.00% 25.000 23.000 - -98.34% -
453.povray -7.14% 28.000 26.000 - -38.10% -
453.povray (avg) -7.14% 28.000 26.000 - -38.10% -
416.gamess (max) -7.02% 57.000 53.000 - -98.90% -
456.hmmer (max) -6.67% 15.000 14.000 - -99.34% -
434.zeusmp (max) (percentage) -6.53% 1.990 1.860 - -97.73% -
416.gamess (max) (percentage) -6.52% 0.460 0.430 - -98.88% -
400.perlbench (max) (percentage) -6.37% 2.510 2.350 - -97.20% -
436.cactusADM (max) -6.25% 80.000 75.000 - -95.94% -
436.cactusADM (max) (percentage) -5.74% 3.830 3.610 - -95.93% -
400.perlbench (max) -4.88% 41.000 39.000 - -97.21% -
445.gobmk (max) (percentage) -4.76% 1.470 1.400 - -97.34% -
483.xalancbmk -4.71% 191.000 182.000 - -26.61% -
483.xalancbmk (avg) -4.71% 191.000 182.000 - -26.61% -
416.gamess -4.53% 331.000 316.000 - -42.55% -
416.gamess (avg) -4.53% 331.000 316.000 - -42.55% -
481.wrf -4.51% 244.000 233.000 - -32.46% -
481.wrf (avg) -4.51% 244.000 233.000 - -32.46% -
453.povray (avg) (percentage) -4.50% 5.110 4.880 - -37.52% -
416.gamess (avg) (percentage) -4.49% 2.670 2.550 - -42.31% -
447.dealII (avg) (percentage) -4.46% 4.040 3.860 - -33.10% -
447.dealII -4.35% 69.000 66.000 - -33.33% -
447.dealII (avg) -4.35% 69.000 66.000 - -33.33% -
459.GemsFDTD -4.21% 285.000 273.000 - -24.17% -
459.GemsFDTD (avg) -4.21% 285.000 273.000 - -24.17% -
401.bzip2 -4.20% 119.000 114.000 - -29.19% -
401.bzip2 (avg) -4.20% 119.000 114.000 - -29.19% -
445.gobmk (max) -4.05% 74.000 71.000 - -97.31% -
465.tonto (avg) (percentage) -4.00% 3.000 2.880 - -13.77% -
464.h264ref -3.88% 206.000 198.000 - -32.42% -
464.h264ref (avg) -3.88% 206.000 198.000 - -32.42% -
434.zeusmp -3.70% 108.000 104.000 - -29.25% -
434.zeusmp (avg) -3.70% 108.000 104.000 - -29.25% -
464.h264ref (avg) (percentage) -3.64% 3.570 3.440 - -32.42% -
483.xalancbmk (avg) (percentage) -3.62% 4.970 4.790 - -26.31% -
471.omnetpp -3.61% 166.000 160.000 - -28.25% -
471.omnetpp (avg) -3.61% 166.000 160.000 - -28.25% -
444.namd (max) (percentage) -3.57% 1.120 1.080 - -98.82% -
450.soplex -3.57% 28.000 27.000 - -25.00% -
450.soplex (avg) -3.57% 28.000 27.000 - -25.00% -
456.hmmer -3.53% 85.000 82.000 - -35.43% -
456.hmmer (avg) -3.53% 85.000 82.000 - -35.43% -
433.milc -3.51% 57.000 55.000 - -20.29% -
433.milc (avg) -3.51% 57.000 55.000 - -20.29% -
482.sphinx3 -3.51% 57.000 55.000 - -25.68% -
482.sphinx3 (avg) -3.51% 57.000 55.000 - -25.68% -
473.astar -3.41% 205.000 198.000 - -7.04% -
473.astar (avg) -3.41% 205.000 198.000 - -7.04% -
429.mcf (avg) (percentage) -3.40% 12.630 12.200 - 59.06% -
481.wrf (avg) (percentage) -3.40% 4.410 4.260 - -31.73% -
436.cactusADM (avg) (percentage) -3.37% 5.040 4.870 - -18.56% -
465.tonto -3.33% 330.000 319.000 - -12.60% -
465.tonto (avg) -3.33% 330.000 319.000 - -12.60% -
470.lbm -3.33% 180.000 174.000 - -27.20% -
470.lbm (avg) -3.33% 180.000 174.000 - -27.20% -
444.namd (avg) (percentage) -3.29% 6.380 6.170 - -33.08% -
471.omnetpp (avg) (percentage) -3.26% 6.130 5.930 - -27.68% -
401.bzip2 (avg) (percentage) -3.23% 4.020 3.890 - -29.01% -
445.gobmk (avg) (percentage) -3.19% 2.820 2.730 - -30.18% -
454.calculix (avg) (percentage) -3.18% 5.970 5.780 - -27.93% -
482.sphinx3 (avg) (percentage) -3.16% 6.010 5.820 - -26.61% -
437.leslie3d -3.12% 385.000 373.000 - 5.07% -
437.leslie3d (avg) -3.12% 385.000 373.000 - 5.07% -
410.bwaves -3.11% 193.000 187.000 - -24.90% -
410.bwaves (avg) -3.11% 193.000 187.000 - -24.90% -
456.hmmer (avg) (percentage) -3.05% 2.950 2.860 - -35.15% -
462.libquantum (avg) (percentage) -2.91% 5.500 5.340 - -30.29% -
400.perlbench (avg) (percentage) -2.88% 4.520 4.390 - -30.87% -
436.cactusADM -2.86% 105.000 102.000 - -17.74% -
436.cactusADM (avg) -2.86% 105.000 102.000 - -17.74% -
434.zeusmp (avg) (percentage) -2.80% 4.280 4.160 - -28.89% -
459.GemsFDTD (avg) (percentage) -2.63% 4.560 4.440 - -23.97% -
470.lbm (avg) (percentage) -2.57% 4.670 4.550 - -28.12% -
473.astar (avg) (percentage) -2.54% 3.940 3.840 - -7.69% -
458.sjeng (avg) (percentage) -2.43% 2.470 2.410 - -24.45% -
450.soplex (avg) (percentage) -2.25% 4.880 4.770 - -25.82% -
444.namd -2.13% 47.000 46.000 - -32.35% -
444.namd (avg) -2.13% 47.000 46.000 - -32.35% -
445.gobmk -2.11% 142.000 139.000 - -29.08% -
445.gobmk (avg) -2.11% 142.000 139.000 - -29.08% -
435.gromacs (avg) (percentage) -1.95% 4.110 4.030 - -20.36% -
456.hmmer (max) (percentage) -1.89% 0.530 0.520 - -99.29% -
454.calculix (unexplained diff vs previous) (percentage) -1.83% 1.640 1.610 - -100.00% -
410.bwaves (avg) (percentage) -1.78% 3.370 3.310 - -24.94% -
429.mcf -1.69% 178.000 175.000 - 60.55% -
429.mcf (avg) -1.69% 178.000 175.000 - 60.55% -
433.milc (avg) (percentage) -1.62% 4.930 4.850 - -19.83% -
400.perlbench -1.37% 73.000 72.000 - -31.43% -
400.perlbench (avg) -1.37% 73.000 72.000 - -31.43% -
403.gcc (max) (percentage) -1.30% 62.920 62.100 - -37.50% -
458.sjeng -1.08% 185.000 183.000 - -24.07% -
458.sjeng (avg) -1.08% 185.000 183.000 - -24.07% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 1.73% 244728.000 248972.000 - 0.00% -
436.cactusADM 1.16% 352891.000 356967.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 5.36% 56.000 59.000 - 7.27% -
435.gromacs 3.16% 7269.000 7499.000 - 2.43% -
450.soplex 2.12% 567.000 579.000 - -2.03% -
445.gobmk 1.39% 5023.000 5093.000 - 0.71% -
465.tonto 1.31% 10941.000 11084.000 - 0.60% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf 60.55% 109.000 175.000 - -1.69% -
429.mcf (avg) 60.55% 109.000 175.000 - -1.69% -
429.mcf (avg) (percentage) 59.06% 7.670 12.200 - -3.40% -
437.leslie3d (avg) (percentage) 16.39% 3.050 3.550 - 7.90% -
437.leslie3d 5.07% 355.000 373.000 - -3.12% -
437.leslie3d (avg) 5.07% 355.000 373.000 - -3.12% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383408.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -9.50% 11640.000 10534.000 - -10.04% -
481.wrf -1.16% 5534.000 5470.000 - -1.23% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 1.610 - -1.83% -
454.calculix (unexplained diff vs previous) -100.00% 22953.000 1.000 - 0.00% -
436.cactusADM (unexplained diff vs previous) -99.99% 16396.000 1.000 - -98.72% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.99% 787.130 0.050 - -98.66% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 1.000 - -50.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 0.720 - -49.65% -
447.dealII (unexplained diff vs previous) -99.97% 7017.000 2.000 - -85.71% -
447.dealII (unexplained diff vs previous) (percentage) -99.97% 407.020 0.120 - -85.37% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.96% 2759.050 1.160 - -70.63% -
482.sphinx3 (unexplained diff vs previous) -99.96% 26073.000 11.000 - -71.05% -
450.soplex (unexplained diff vs previous) (percentage) -99.92% 2557.320 2.070 - 1.97% -
450.soplex (unexplained diff vs previous) -99.92% 14500.000 12.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -99.91% 10659.000 10.000 - -75.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.91% 391.300 0.370 - -74.83% -
444.namd (unexplained diff vs previous) (percentage) -99.90% 1118.610 1.070 - 664.29% -
444.namd (unexplained diff vs previous) -99.90% 8356.000 8.000 - 700.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.90% 368.340 0.370 - -62.24% -
429.mcf (unexplained diff vs previous) (percentage) -99.90% 1305.690 1.320 - -95.97% -
401.bzip2 (unexplained diff vs previous) -99.90% 10833.000 11.000 - -62.07% -
429.mcf (unexplained diff vs previous) -99.90% 18593.000 19.000 - -95.91% -
464.h264ref (unexplained diff vs previous) (percentage) -99.86% 118.780 0.170 - -90.56% -
464.h264ref (unexplained diff vs previous) -99.85% 6843.000 10.000 - -90.38% -
456.hmmer (unexplained diff vs previous) (percentage) -99.81% 278.630 0.520 - 1633.33% -
456.hmmer (unexplained diff vs previous) -99.81% 8030.000 15.000 - 1400.00% -
434.zeusmp (unexplained diff vs previous) -99.80% 11280.000 23.000 - 283.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.79% 448.690 0.920 - 283.33% -
433.milc (unexplained diff vs previous) -99.73% 11289.000 31.000 - 121.43% -
433.milc (unexplained diff vs previous) (percentage) -99.72% 980.800 2.720 - 126.67% -
416.gamess (unexplained diff vs previous) -99.72% 7819.000 22.000 - 633.33% -
400.perlbench (unexplained diff vs previous) -99.72% 8772.000 25.000 - -30.56% -
400.perlbench (unexplained diff vs previous) (percentage) -99.71% 527.480 1.510 - -31.36% -
416.gamess (unexplained diff vs previous) (percentage) -99.71% 62.730 0.180 - 800.00% -
473.astar (unexplained diff vs previous) (percentage) -99.57% 197.850 0.850 - -85.64% -
473.astar (unexplained diff vs previous) -99.57% 10146.000 44.000 - -85.76% -
483.xalancbmk (unexplained diff vs previous) -99.56% 8368.000 37.000 - -78.11% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.56% 219.170 0.970 - -77.90% -
470.lbm (unexplained diff vs previous) (percentage) -99.54% 263.730 1.200 - -56.52% -
470.lbm (unexplained diff vs previous) -99.54% 9990.000 46.000 - -57.01% -
481.wrf (unexplained diff vs previous) -99.44% 12149.000 68.000 - -62.64% -
481.wrf (unexplained diff vs previous) (percentage) -99.44% 219.530 1.240 - -62.31% -
453.povray (max) -99.40% 499.000 3.000 - -57.14% -
453.povray (max) (percentage) -99.40% 91.250 0.550 - -60.14% -
445.gobmk (unexplained diff vs previous) (percentage) -99.36% 111.110 0.710 - -26.80% -
445.gobmk (unexplained diff vs previous) -99.35% 5581.000 36.000 - -26.53% -
459.GemsFDTD (unexplained diff vs previous) -99.35% 15458.000 101.000 - -55.31% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.35% 250.410 1.640 - -54.57% -
456.hmmer (max) -99.34% 2120.000 14.000 - -6.67% -
456.hmmer (max) (percentage) -99.29% 73.590 0.520 - -1.89% -
458.sjeng (unexplained diff vs previous) (percentage) -98.95% 90.870 0.950 - -18.80% -
458.sjeng (unexplained diff vs previous) -98.95% 6876.000 72.000 - -18.18% -
410.bwaves (unexplained diff vs previous) -98.94% 7794.000 83.000 - 1085.71% -
410.bwaves (unexplained diff vs previous) (percentage) -98.93% 137.900 1.470 - 1125.00% -
416.gamess (max) -98.90% 4805.000 53.000 - -7.02% -
416.gamess (max) (percentage) -98.88% 38.550 0.430 - -6.52% -
401.bzip2 (max) -98.88% 2313.000 26.000 - -10.34% -
401.bzip2 (max) (percentage) -98.84% 78.650 0.910 - -9.90% -
444.namd (max) -98.83% 685.000 8.000 - 0.00% -
444.namd (max) (percentage) -98.82% 91.790 1.080 - -3.57% -
462.libquantum (max) -98.55% 138.000 2.000 - -33.33% -
447.dealII (max) -98.34% 1384.000 23.000 - -8.00% -
447.dealII (max) (percentage) -98.33% 80.280 1.340 - -10.07% -
462.libquantum (max) (percentage) -98.20% 98.970 1.780 - -28.23% -
450.soplex (max) -97.98% 545.000 11.000 - -57.69% -
450.soplex (max) (percentage) -97.89% 96.240 2.030 - -54.99% -
471.omnetpp (max) -97.79% 2169.000 48.000 - -37.66% -
434.zeusmp (max) -97.76% 2055.000 46.000 - -8.00% -
471.omnetpp (max) (percentage) -97.74% 79.650 1.800 - -37.28% -
434.zeusmp (max) (percentage) -97.73% 81.770 1.860 - -6.53% -
435.gromacs (unexplained diff vs previous) (percentage) -97.55% 96.680 2.370 - -19.93% -
410.bwaves (max) -97.53% 3276.000 81.000 - 50.00% -
410.bwaves (max) (percentage) -97.50% 57.970 1.450 - 52.63% -
435.gromacs (unexplained diff vs previous) -97.47% 7028.000 178.000 - -17.97% -
445.gobmk (max) (percentage) -97.34% 52.630 1.400 - -4.76% -
445.gobmk (max) -97.31% 2643.000 71.000 - -4.05% -
464.h264ref (max) -97.22% 3127.000 87.000 - -17.14% -
400.perlbench (max) -97.21% 1397.000 39.000 - -4.88% -
400.perlbench (max) (percentage) -97.20% 84.060 2.350 - -6.37% -
464.h264ref (max) (percentage) -97.20% 54.290 1.520 - -16.94% -
433.milc (max) -97.13% 1044.000 30.000 - 11.11% -
433.milc (max) (percentage) -97.08% 90.750 2.650 - 12.77% -
458.sjeng (max) -96.95% 3602.000 110.000 - -9.09% -
458.sjeng (max) (percentage) -96.93% 47.610 1.460 - -9.88% -
454.calculix (max) -96.72% 61.000 2.000 - -60.00% -
482.sphinx3 (max) -96.49% 911.000 32.000 - -17.95% -
470.lbm (max) (percentage) -96.47% 72.510 2.560 - -9.86% -
470.lbm (max) -96.47% 2746.000 97.000 - -11.01% -
482.sphinx3 (max) (percentage) -96.46% 96.500 3.420 - -16.79% -
465.tonto (unexplained diff vs previous) (percentage) -96.29% 16.190 0.600 - -84.85% -
465.tonto (unexplained diff vs previous) -96.27% 1771.000 66.000 - -84.86% -
454.calculix (max) (percentage) -96.15% 99.730 3.840 - -55.45% -
436.cactusADM (max) -95.94% 1848.000 75.000 - -6.25% -
436.cactusADM (max) (percentage) -95.93% 88.730 3.610 - -5.74% -
481.wrf (max) -95.71% 3801.000 163.000 - -13.30% -
481.wrf (max) (percentage) -95.66% 68.700 2.980 - -12.35% -
459.GemsFDTD (max) -95.31% 4411.000 207.000 - -11.54% -
459.GemsFDTD (max) (percentage) -95.28% 71.460 3.370 - -9.89% -
483.xalancbmk (max) -94.16% 2621.000 153.000 - -13.07% -
483.xalancbmk (max) (percentage) -94.15% 68.670 4.020 - -12.42% -
435.gromacs (max) (percentage) -93.47% 49.160 3.210 - -10.08% -
435.gromacs (max) -93.28% 3573.000 240.000 - -8.05% -
473.astar (max) (percentage) -92.89% 66.430 4.720 - -25.08% -
473.astar (max) -92.84% 3406.000 244.000 - -25.61% -
465.tonto (max) (percentage) -82.24% 19.310 3.430 - -16.75% -
465.tonto (max) -82.01% 2112.000 380.000 - -16.11% -
429.mcf (max) (percentage) -75.94% 92.890 22.350 - -11.10% -
429.mcf (max) -75.79% 1322.000 320.000 - -9.86% -
437.leslie3d (unexplained diff vs previous) -49.18% 2314.000 1176.000 - 35.17% -
437.leslie3d (max) -45.20% 1929.000 1057.000 - 12.45% -
437.leslie3d (unexplained diff vs previous) (percentage) -43.86% 19.880 11.160 - 50.20% -
416.gamess -42.55% 550.000 316.000 - -4.53% -
416.gamess (avg) -42.55% 550.000 316.000 - -4.53% -
416.gamess (avg) (percentage) -42.31% 4.420 2.550 - -4.49% -
437.leslie3d (max) (percentage) -39.45% 16.580 10.040 - 25.03% -
453.povray -38.10% 42.000 26.000 - -7.14% -
453.povray (avg) -38.10% 42.000 26.000 - -7.14% -
453.povray (avg) (percentage) -37.52% 7.810 4.880 - -4.50% -
403.gcc (max) (percentage) -37.50% 99.360 62.100 - -1.30% -
456.hmmer -35.43% 127.000 82.000 - -3.53% -
456.hmmer (avg) -35.43% 127.000 82.000 - -3.53% -
456.hmmer (avg) (percentage) -35.15% 4.410 2.860 - -3.05% -
403.gcc (max) -34.55% 55.000 36.000 - 5.88% -
447.dealII -33.33% 99.000 66.000 - -4.35% -
447.dealII (avg) -33.33% 99.000 66.000 - -4.35% -
447.dealII (avg) (percentage) -33.10% 5.770 3.860 - -4.46% -
444.namd (avg) (percentage) -33.08% 9.220 6.170 - -3.29% -
481.wrf -32.46% 345.000 233.000 - -4.51% -
481.wrf (avg) -32.46% 345.000 233.000 - -4.51% -
464.h264ref -32.42% 293.000 198.000 - -3.88% -
464.h264ref (avg) -32.42% 293.000 198.000 - -3.88% -
464.h264ref (avg) (percentage) -32.42% 5.090 3.440 - -3.64% -
444.namd -32.35% 68.000 46.000 - -2.13% -
444.namd (avg) -32.35% 68.000 46.000 - -2.13% -
481.wrf (avg) (percentage) -31.73% 6.240 4.260 - -3.40% -
400.perlbench -31.43% 105.000 72.000 - -1.37% -
400.perlbench (avg) -31.43% 105.000 72.000 - -1.37% -
400.perlbench (avg) (percentage) -30.87% 6.350 4.390 - -2.88% -
462.libquantum (avg) (percentage) -30.29% 7.660 5.340 - -2.91% -
445.gobmk (avg) (percentage) -30.18% 3.910 2.730 - -3.19% -
462.libquantum -30.00% 10.000 7.000 - 0.00% -
462.libquantum (avg) -30.00% 10.000 7.000 - 0.00% -
434.zeusmp -29.25% 147.000 104.000 - -3.70% -
434.zeusmp (avg) -29.25% 147.000 104.000 - -3.70% -
401.bzip2 -29.19% 161.000 114.000 - -4.20% -
401.bzip2 (avg) -29.19% 161.000 114.000 - -4.20% -
445.gobmk -29.08% 196.000 139.000 - -2.11% -
445.gobmk (avg) -29.08% 196.000 139.000 - -2.11% -
401.bzip2 (avg) (percentage) -29.01% 5.480 3.890 - -3.23% -
434.zeusmp (avg) (percentage) -28.89% 5.850 4.160 - -2.80% -
471.omnetpp -28.25% 223.000 160.000 - -3.61% -
471.omnetpp (avg) -28.25% 223.000 160.000 - -3.61% -
470.lbm (avg) (percentage) -28.12% 6.330 4.550 - -2.57% -
454.calculix (avg) (percentage) -27.93% 8.020 5.780 - -3.18% -
471.omnetpp (avg) (percentage) -27.68% 8.200 5.930 - -3.26% -
470.lbm -27.20% 239.000 174.000 - -3.33% -
470.lbm (avg) -27.20% 239.000 174.000 - -3.33% -
483.xalancbmk -26.61% 248.000 182.000 - -4.71% -
483.xalancbmk (avg) -26.61% 248.000 182.000 - -4.71% -
482.sphinx3 (avg) (percentage) -26.61% 7.930 5.820 - -3.16% -
483.xalancbmk (avg) (percentage) -26.31% 6.500 4.790 - -3.62% -
450.soplex (avg) (percentage) -25.82% 6.430 4.770 - -2.25% -
482.sphinx3 -25.68% 74.000 55.000 - -3.51% -
482.sphinx3 (avg) -25.68% 74.000 55.000 - -3.51% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
450.soplex -25.00% 36.000 27.000 - -3.57% -
450.soplex (avg) -25.00% 36.000 27.000 - -3.57% -
454.calculix -25.00% 4.000 3.000 - 0.00% -
454.calculix (avg) -25.00% 4.000 3.000 - 0.00% -
410.bwaves (avg) (percentage) -24.94% 4.410 3.310 - -1.78% -
410.bwaves -24.90% 249.000 187.000 - -3.11% -
410.bwaves (avg) -24.90% 249.000 187.000 - -3.11% -
458.sjeng (avg) (percentage) -24.45% 3.190 2.410 - -2.43% -
459.GemsFDTD -24.17% 360.000 273.000 - -4.21% -
459.GemsFDTD (avg) -24.17% 360.000 273.000 - -4.21% -
458.sjeng -24.07% 241.000 183.000 - -1.08% -
458.sjeng (avg) -24.07% 241.000 183.000 - -1.08% -
459.GemsFDTD (avg) (percentage) -23.97% 5.840 4.440 - -2.63% -
435.gromacs (avg) (percentage) -20.36% 5.060 4.030 - -1.95% -
433.milc -20.29% 69.000 55.000 - -3.51% -
433.milc (avg) -20.29% 69.000 55.000 - -3.51% -
433.milc (avg) (percentage) -19.83% 6.050 4.850 - -1.62% -
436.cactusADM (avg) (percentage) -18.56% 5.980 4.870 - -3.37% -
436.cactusADM -17.74% 124.000 102.000 - -2.86% -
436.cactusADM (avg) -17.74% 124.000 102.000 - -2.86% -
435.gromacs -17.71% 367.000 302.000 - 0.67% -
435.gromacs (avg) -17.71% 367.000 302.000 - 0.67% -
465.tonto (avg) (percentage) -13.77% 3.340 2.880 - -4.00% -
465.tonto -12.60% 365.000 319.000 - -3.33% -
465.tonto (avg) -12.60% 365.000 319.000 - -3.33% -
403.gcc (avg) (percentage) -7.79% 7.320 6.750 - 0.00% -
473.astar (avg) (percentage) -7.69% 4.160 3.840 - -2.54% -
473.astar -7.04% 213.000 198.000 - -3.41% -
473.astar (avg) -7.04% 213.000 198.000 - -3.41% -

Added Tests - sample variability
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)

Report Time: 0.38s
Execution (seconds)
Name Current %
400.perlbench 1661.000 1.53%
401.bzip2 2954.000 -
403.gcc 59.000 7.27%
410.bwaves 5653.000 -1.45%
416.gamess 12427.000 -
429.mcf 1435.000 1.34%
433.milc 1140.000 -2.65%
434.zeusmp 2508.000 -
435.gromacs 7499.000 2.43%
436.cactusADM 2095.000 -
437.leslie3d 10534.000 -10.04%
444.namd 746.000 1.08%
445.gobmk 5093.000 -
447.dealII 1718.000 -
450.soplex 579.000 -2.03%
453.povray 552.000 -
454.calculix 62.000 1.64%
456.hmmer 2883.000 -
458.sjeng 7599.000 -
459.GemsFDTD 6160.000 -1.61%
462.libquantum 139.000 -
464.h264ref 5768.000 -
465.tonto 11084.000 -
470.lbm 3825.000 -1.19%
471.omnetpp 2706.000 -
473.astar 5173.000 -
481.wrf 5470.000 -1.23%
482.sphinx3 952.000 -1.14%
483.xalancbmk 3814.000 -
Geometric Mean 2102.195 -
Code Size (bytes)
Name Current %
400.perlbench 893232.000 -
401.bzip2 44233.000 -
403.gcc 2452063.000 -
410.bwaves 16760.000 -
416.gamess 5751265.000 -
429.mcf 9123.000 -
433.milc 61378.000 -
434.zeusmp 152037.000 -
435.gromacs 499041.000 -
436.cactusADM 356967.000 -
437.leslie3d 59475.000 -
444.namd 188332.000 -
445.gobmk 1381674.000 -
447.dealII 312907.000 -
450.soplex 205081.000 -
453.povray 657113.000 -
454.calculix 845283.000 -
456.hmmer 108663.000 -
458.sjeng 104048.000 -
459.GemsFDTD 248972.000 -
462.libquantum 16085.000 -
464.h264ref 383408.000 -
465.tonto 1945995.000 -
470.lbm 9691.000 -
471.omnetpp 478051.000 -
473.astar 22956.000 -
481.wrf 1968639.000 -
482.sphinx3 112795.000 -
483.xalancbmk 2343598.000 -
Geometric Mean 224131.050 -
sample variability
Name Current %
400.perlbench 72.000 -1.37%
400.perlbench (avg) 72.000 -1.37%
400.perlbench (avg) (percentage) 4.390 -2.88%
400.perlbench (max) 39.000 -4.88%
400.perlbench (max) (percentage) 2.350 -6.37%
400.perlbench (unexplained diff vs previous) 25.000 -30.56%
400.perlbench (unexplained diff vs previous) (percentage) 1.510 -31.36%
401.bzip2 114.000 -4.20%
401.bzip2 (avg) 114.000 -4.20%
401.bzip2 (avg) (percentage) 3.890 -3.23%
401.bzip2 (max) 26.000 -10.34%
401.bzip2 (max) (percentage) 0.910 -9.90%
401.bzip2 (unexplained diff vs previous) 11.000 -62.07%
401.bzip2 (unexplained diff vs previous) (percentage) 0.370 -62.24%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.750 -
403.gcc (max) 36.000 5.88%
403.gcc (max) (percentage) 62.100 -1.30%
410.bwaves 187.000 -3.11%
410.bwaves (avg) 187.000 -3.11%
410.bwaves (avg) (percentage) 3.310 -1.78%
410.bwaves (max) 81.000 50.00%
410.bwaves (max) (percentage) 1.450 52.63%
410.bwaves (unexplained diff vs previous) 83.000 1085.71%
410.bwaves (unexplained diff vs previous) (percentage) 1.470 1125.00%
416.gamess 316.000 -4.53%
416.gamess (avg) 316.000 -4.53%
416.gamess (avg) (percentage) 2.550 -4.49%
416.gamess (max) 53.000 -7.02%
416.gamess (max) (percentage) 0.430 -6.52%
416.gamess (unexplained diff vs previous) 22.000 633.33%
416.gamess (unexplained diff vs previous) (percentage) 0.180 800.00%
429.mcf 175.000 -1.69%
429.mcf (avg) 175.000 -1.69%
429.mcf (avg) (percentage) 12.200 -3.40%
429.mcf (max) 320.000 -9.86%
429.mcf (max) (percentage) 22.350 -11.10%
429.mcf (unexplained diff vs previous) 19.000 -95.91%
429.mcf (unexplained diff vs previous) (percentage) 1.320 -95.97%
433.milc 55.000 -3.51%
433.milc (avg) 55.000 -3.51%
433.milc (avg) (percentage) 4.850 -1.62%
433.milc (max) 30.000 11.11%
433.milc (max) (percentage) 2.650 12.77%
433.milc (unexplained diff vs previous) 31.000 121.43%
433.milc (unexplained diff vs previous) (percentage) 2.720 126.67%
434.zeusmp 104.000 -3.70%
434.zeusmp (avg) 104.000 -3.70%
434.zeusmp (avg) (percentage) 4.160 -2.80%
434.zeusmp (max) 46.000 -8.00%
434.zeusmp (max) (percentage) 1.860 -6.53%
434.zeusmp (unexplained diff vs previous) 23.000 283.33%
434.zeusmp (unexplained diff vs previous) (percentage) 0.920 283.33%
435.gromacs 302.000 -
435.gromacs (avg) 302.000 -
435.gromacs (avg) (percentage) 4.030 -1.95%
435.gromacs (max) 240.000 -8.05%
435.gromacs (max) (percentage) 3.210 -10.08%
435.gromacs (unexplained diff vs previous) 178.000 -17.97%
435.gromacs (unexplained diff vs previous) (percentage) 2.370 -19.93%
436.cactusADM 102.000 -2.86%
436.cactusADM (avg) 102.000 -2.86%
436.cactusADM (avg) (percentage) 4.870 -3.37%
436.cactusADM (max) 75.000 -6.25%
436.cactusADM (max) (percentage) 3.610 -5.74%
436.cactusADM (unexplained diff vs previous) 1.000 -98.72%
436.cactusADM (unexplained diff vs previous) (percentage) 0.050 -98.66%
437.leslie3d 373.000 -3.12%
437.leslie3d (avg) 373.000 -3.12%
437.leslie3d (avg) (percentage) 3.550 7.90%
437.leslie3d (max) 1057.000 12.45%
437.leslie3d (max) (percentage) 10.040 25.03%
437.leslie3d (unexplained diff vs previous) 1176.000 35.17%
437.leslie3d (unexplained diff vs previous) (percentage) 11.160 50.20%
444.namd 46.000 -2.13%
444.namd (avg) 46.000 -2.13%
444.namd (avg) (percentage) 6.170 -3.29%
444.namd (max) 8.000 -
444.namd (max) (percentage) 1.080 -3.57%
444.namd (unexplained diff vs previous) 8.000 700.00%
444.namd (unexplained diff vs previous) (percentage) 1.070 664.29%
445.gobmk 139.000 -2.11%
445.gobmk (avg) 139.000 -2.11%
445.gobmk (avg) (percentage) 2.730 -3.19%
445.gobmk (max) 71.000 -4.05%
445.gobmk (max) (percentage) 1.400 -4.76%
445.gobmk (unexplained diff vs previous) 36.000 -26.53%
445.gobmk (unexplained diff vs previous) (percentage) 0.710 -26.80%
447.dealII 66.000 -4.35%
447.dealII (avg) 66.000 -4.35%
447.dealII (avg) (percentage) 3.860 -4.46%
447.dealII (max) 23.000 -8.00%
447.dealII (max) (percentage) 1.340 -10.07%
447.dealII (unexplained diff vs previous) 2.000 -85.71%
447.dealII (unexplained diff vs previous) (percentage) 0.120 -85.37%
450.soplex 27.000 -3.57%
450.soplex (avg) 27.000 -3.57%
450.soplex (avg) (percentage) 4.770 -2.25%
450.soplex (max) 11.000 -57.69%
450.soplex (max) (percentage) 2.030 -54.99%
450.soplex (unexplained diff vs previous) 12.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.070 1.97%
453.povray 26.000 -7.14%
453.povray (avg) 26.000 -7.14%
453.povray (avg) (percentage) 4.880 -4.50%
453.povray (max) 3.000 -57.14%
453.povray (max) (percentage) 0.550 -60.14%
453.povray (unexplained diff vs previous) 0.000 -
453.povray (unexplained diff vs previous) (percentage) 0.000 -
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.780 -3.18%
454.calculix (max) 2.000 -60.00%
454.calculix (max) (percentage) 3.840 -55.45%
454.calculix (unexplained diff vs previous) 1.000 -
454.calculix (unexplained diff vs previous) (percentage) 1.610 -1.83%
456.hmmer 82.000 -3.53%
456.hmmer (avg) 82.000 -3.53%
456.hmmer (avg) (percentage) 2.860 -3.05%
456.hmmer (max) 14.000 -6.67%
456.hmmer (max) (percentage) 0.520 -1.89%
456.hmmer (unexplained diff vs previous) 15.000 1400.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.520 1633.33%
458.sjeng 183.000 -1.08%
458.sjeng (avg) 183.000 -1.08%
458.sjeng (avg) (percentage) 2.410 -2.43%
458.sjeng (max) 110.000 -9.09%
458.sjeng (max) (percentage) 1.460 -9.88%
458.sjeng (unexplained diff vs previous) 72.000 -18.18%
458.sjeng (unexplained diff vs previous) (percentage) 0.950 -18.80%
459.GemsFDTD 273.000 -4.21%
459.GemsFDTD (avg) 273.000 -4.21%
459.GemsFDTD (avg) (percentage) 4.440 -2.63%
459.GemsFDTD (max) 207.000 -11.54%
459.GemsFDTD (max) (percentage) 3.370 -9.89%
459.GemsFDTD (unexplained diff vs previous) 101.000 -55.31%
459.GemsFDTD (unexplained diff vs previous) (percentage) 1.640 -54.57%
462.libquantum 7.000 -
462.libquantum (avg) 7.000 -
462.libquantum (avg) (percentage) 5.340 -2.91%
462.libquantum (max) 2.000 -33.33%
462.libquantum (max) (percentage) 1.780 -28.23%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.720 -49.65%
464.h264ref 198.000 -3.88%
464.h264ref (avg) 198.000 -3.88%
464.h264ref (avg) (percentage) 3.440 -3.64%
464.h264ref (max) 87.000 -17.14%
464.h264ref (max) (percentage) 1.520 -16.94%
464.h264ref (unexplained diff vs previous) 10.000 -90.38%
464.h264ref (unexplained diff vs previous) (percentage) 0.170 -90.56%
465.tonto 319.000 -3.33%
465.tonto (avg) 319.000 -3.33%
465.tonto (avg) (percentage) 2.880 -4.00%
465.tonto (max) 380.000 -16.11%
465.tonto (max) (percentage) 3.430 -16.75%
465.tonto (unexplained diff vs previous) 66.000 -84.86%
465.tonto (unexplained diff vs previous) (percentage) 0.600 -84.85%
470.lbm 174.000 -3.33%
470.lbm (avg) 174.000 -3.33%
470.lbm (avg) (percentage) 4.550 -2.57%
470.lbm (max) 97.000 -11.01%
470.lbm (max) (percentage) 2.560 -9.86%
470.lbm (unexplained diff vs previous) 46.000 -57.01%
470.lbm (unexplained diff vs previous) (percentage) 1.200 -56.52%
471.omnetpp 160.000 -3.61%
471.omnetpp (avg) 160.000 -3.61%
471.omnetpp (avg) (percentage) 5.930 -3.26%
471.omnetpp (max) 48.000 -37.66%
471.omnetpp (max) (percentage) 1.800 -37.28%
471.omnetpp (unexplained diff vs previous) 10.000 -75.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.370 -74.83%
473.astar 198.000 -3.41%
473.astar (avg) 198.000 -3.41%
473.astar (avg) (percentage) 3.840 -2.54%
473.astar (max) 244.000 -25.61%
473.astar (max) (percentage) 4.720 -25.08%
473.astar (unexplained diff vs previous) 44.000 -85.76%
473.astar (unexplained diff vs previous) (percentage) 0.850 -85.64%
481.wrf 233.000 -4.51%
481.wrf (avg) 233.000 -4.51%
481.wrf (avg) (percentage) 4.260 -3.40%
481.wrf (max) 163.000 -13.30%
481.wrf (max) (percentage) 2.980 -12.35%
481.wrf (unexplained diff vs previous) 68.000 -62.64%
481.wrf (unexplained diff vs previous) (percentage) 1.240 -62.31%
482.sphinx3 55.000 -3.51%
482.sphinx3 (avg) 55.000 -3.51%
482.sphinx3 (avg) (percentage) 5.820 -3.16%
482.sphinx3 (max) 32.000 -17.95%
482.sphinx3 (max) (percentage) 3.420 -16.79%
482.sphinx3 (unexplained diff vs previous) 11.000 -71.05%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.160 -70.63%
483.xalancbmk 182.000 -4.71%
483.xalancbmk (avg) 182.000 -4.71%
483.xalancbmk (avg) (percentage) 4.790 -3.62%
483.xalancbmk (max) 153.000 -13.07%
483.xalancbmk (max) (percentage) 4.020 -12.42%
483.xalancbmk (unexplained diff vs previous) 37.000 -78.11%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.970 -77.90%
Geometric Mean 12.089 -26.86%