Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fe8cdc8ec145a166414fc375cf2cb65d9a8085a1 (+ 46 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6a5cb782d1486b378d70857c8efae558da0eb2cc (+ 43 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=63550530d98db6e9c30dc96a3ea08411b873b23e (+ 8 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=657b3ebc26ae7bc5bb30e2d32e7c81ee17d087d9 (+ 209 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-gnu-aarch64-master-Os-build/15/
View Options
Report
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0015 (4-changed-components) 2023-02-03T19:04:24 0:00:00
Previous 0014 (4-changed-components) 2023-01-28T06:30:59 0:00:00
Baseline 0001 (3-changed-components) 2023-01-01T08:38:47 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 5 144
Performance Improvements 189 78
Added Tests 1 1
Unchanged Tests 1041 1013
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 1.54% 26899.000 27314.000 - -8.73% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
437.leslie3d (unexplained diff vs previous) (percentage) 50.00% 0.420 0.630 - -72.49% -
437.leslie3d (unexplained diff vs previous) 49.15% 59.000 88.000 - -74.34% -
482.sphinx3 1.48% 473.000 480.000 - 10.09% -
482.sphinx3 (avg) 1.48% 473.000 480.000 - 10.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
454.calculix (unexplained diff vs previous) -99.85% 660.000 1.000 - -80.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.57% 16.110 0.070 - -87.04% -
429.mcf (unexplained diff vs previous) -99.54% 3279.000 15.000 - -83.87% -
403.gcc (unexplained diff vs previous) (percentage) -99.47% 3.790 0.020 - -97.22% -
403.gcc (unexplained diff vs previous) -99.39% 328.000 2.000 - -96.92% -
462.libquantum (unexplained diff vs previous) -98.90% 2099.000 23.000 - 2200.00% -
462.libquantum (unexplained diff vs previous) (percentage) -98.89% 15.330 0.170 - 1600.00% -
435.gromacs (unexplained diff vs previous) -98.45% 1160.000 18.000 - -94.34% -
435.gromacs (unexplained diff vs previous) (percentage) -98.41% 8.190 0.130 - -93.69% -
444.namd (unexplained diff vs previous) (percentage) -98.18% 9.320 0.170 - -97.80% -
444.namd (unexplained diff vs previous) -98.16% 926.000 17.000 - -97.57% -
483.xalancbmk (unexplained diff vs previous) -97.75% 1198.000 27.000 - -41.30% -
483.xalancbmk (unexplained diff vs previous) (percentage) -97.71% 9.620 0.220 - -46.34% -
473.astar (unexplained diff vs previous) -97.68% 862.000 20.000 - 566.67% -
473.astar (unexplained diff vs previous) (percentage) -97.62% 5.460 0.130 - 550.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -97.38% 6.100 0.160 - -23.81% -
459.GemsFDTD (unexplained diff vs previous) -97.35% 1320.000 35.000 - -27.08% -
458.sjeng (unexplained diff vs previous) -97.22% 684.000 19.000 - 111.11% -
458.sjeng (unexplained diff vs previous) (percentage) -97.16% 4.570 0.130 - 116.67% -
401.bzip2 (unexplained diff vs previous) (percentage) -96.96% 6.570 0.200 - -77.01% -
401.bzip2 (unexplained diff vs previous) -96.89% 933.000 29.000 - -78.03% -
450.soplex (unexplained diff vs previous) (percentage) -96.20% 3.680 0.140 - -93.03% -
450.soplex (unexplained diff vs previous) -96.17% 549.000 21.000 - -93.25% -
481.wrf (unexplained diff vs previous) -95.91% 1223.000 50.000 - -55.36% -
471.omnetpp (unexplained diff vs previous) -95.88% 2622.000 108.000 - 315.38% -
481.wrf (unexplained diff vs previous) (percentage) -95.88% 7.040 0.290 - -56.72% -
471.omnetpp (unexplained diff vs previous) (percentage) -95.87% 19.360 0.800 - 233.33% -
434.zeusmp (unexplained diff vs previous) (percentage) -95.85% 4.340 0.180 - -92.27% -
434.zeusmp (unexplained diff vs previous) -95.83% 599.000 25.000 - -91.88% -
453.povray (unexplained diff vs previous) -95.22% 690.000 33.000 - 3200.00% -
453.povray (unexplained diff vs previous) (percentage) -95.19% 9.780 0.470 - 2250.00% -
436.cactusADM (unexplained diff vs previous) (percentage) -95.11% 4.090 0.200 - -93.85% -
436.cactusADM (unexplained diff vs previous) -95.07% 750.000 37.000 - -93.51% -
433.milc (unexplained diff vs previous) -94.30% 544.000 31.000 - -92.71% -
433.milc (unexplained diff vs previous) (percentage) -94.25% 4.350 0.250 - -92.38% -
464.h264ref (unexplained diff vs previous) -94.03% 1508.000 90.000 - 500.00% -
464.h264ref (unexplained diff vs previous) (percentage) -94.00% 11.500 0.690 - 590.00% -
445.gobmk (unexplained diff vs previous) (percentage) -92.94% 1.700 0.120 - -92.26% -
445.gobmk (unexplained diff vs previous) -92.82% 209.000 15.000 - -91.94% -
470.lbm (unexplained diff vs previous) (percentage) -91.84% 10.170 0.830 - 654.55% -
470.lbm (unexplained diff vs previous) -91.76% 1396.000 115.000 - 721.43% -
456.hmmer (unexplained diff vs previous) (percentage) -89.14% 3.130 0.340 - -54.67% -
456.hmmer (unexplained diff vs previous) -88.96% 335.000 37.000 - -55.42% -
416.gamess (unexplained diff vs previous) (percentage) -86.75% 0.830 0.110 - -96.31% -
416.gamess (unexplained diff vs previous) -86.63% 187.000 25.000 - -96.30% -
410.bwaves (unexplained diff vs previous) -69.27% 371.000 114.000 - 660.00% -
410.bwaves (unexplained diff vs previous) (percentage) -69.14% 2.560 0.790 - 690.00% -
447.dealII (unexplained diff vs previous) (percentage) -42.59% 0.540 0.310 - -60.26% -
447.dealII (unexplained diff vs previous) -42.31% 52.000 30.000 - -60.53% -
454.calculix (max) -37.25% 902.000 566.000 - -47.30% -
454.calculix (max) (percentage) -37.22% 4.030 2.530 - -46.17% -
436.cactusADM (max) -25.19% 782.000 585.000 - 5.98% -
433.milc (max) -25.14% 521.000 390.000 - -5.11% -
436.cactusADM (max) (percentage) -25.06% 4.270 3.200 - 1.59% -
429.mcf (max) -25.05% 3908.000 2929.000 - 3083.70% -
429.mcf (max) (percentage) -25.00% 19.200 14.400 - 2566.67% -
433.milc (max) (percentage) -24.94% 4.170 3.130 - -1.26% -
410.bwaves (max) -17.40% 362.000 299.000 - 896.67% -
458.sjeng (max) -16.90% 716.000 595.000 - 1819.35% -
481.wrf (max) -16.88% 1315.000 1093.000 - 106.23% -
456.hmmer (max) (percentage) -16.83% 3.030 2.520 - 98.43% -
410.bwaves (max) (percentage) -16.80% 2.500 2.080 - 890.48% -
462.libquantum (max) -16.79% 2478.000 2062.000 - 2686.49% -
458.sjeng (max) (percentage) -16.70% 4.790 3.990 - 1713.64% -
453.povray (max) (percentage) -16.70% 10.840 9.030 - 256.92% -
470.lbm (max) (percentage) -16.70% 11.320 9.430 - 84.90% -
462.libquantum (max) (percentage) -16.68% 18.110 15.090 - 2257.81% -
456.hmmer (max) -16.67% 324.000 270.000 - 92.86% -
481.wrf (max) (percentage) -16.64% 7.570 6.310 - 100.32% -
453.povray (max) -16.23% 764.000 640.000 - 287.88% -
470.lbm (max) -15.97% 1553.000 1305.000 - 99.85% -
400.perlbench (unexplained diff vs previous) -13.46% 52.000 45.000 - -87.39% -
400.perlbench (unexplained diff vs previous) (percentage) -12.24% 0.490 0.430 - -87.16% -
437.leslie3d (max) -11.53% 659.000 583.000 - 66.10% -
437.leslie3d (max) (percentage) -11.04% 4.710 4.190 - 79.06% -
401.bzip2 (max) -10.17% 875.000 786.000 - 490.98% -
401.bzip2 (max) (percentage) -10.05% 6.170 5.550 - 530.68% -
471.omnetpp (max) -9.07% 3251.000 2956.000 - 346.53% -
471.omnetpp (max) (percentage) -8.33% 24.000 22.000 - 256.56% -
473.astar (max) (percentage) -8.32% 5.770 5.290 - 3678.57% -
473.astar (max) -8.23% 911.000 836.000 - 4080.00% -
464.h264ref (max) -7.77% 1352.000 1247.000 - 1911.29% -
416.gamess (avg) (percentage) -7.32% 2.050 1.900 - -12.44% -
403.gcc (max) -7.28% 316.000 293.000 - 357.81% -
459.GemsFDTD (max) -7.23% 1244.000 1154.000 - 724.29% -
434.zeusmp (max) -7.19% 626.000 581.000 - 93.02% -
416.gamess -7.17% 460.000 427.000 - -13.21% -
416.gamess (avg) -7.17% 460.000 427.000 - -13.21% -
464.h264ref (max) (percentage) -7.17% 10.320 9.580 - 2127.91% -
435.gromacs (max) (percentage) -7.13% 7.570 7.030 - 248.02% -
459.GemsFDTD (max) (percentage) -7.13% 5.750 5.340 - 790.00% -
403.gcc (max) (percentage) -7.12% 3.650 3.390 - 370.83% -
482.sphinx3 (max) (percentage) -7.11% 7.450 6.920 - 370.75% -
444.namd (max) (percentage) -7.10% 10.280 9.550 - 33.01% -
445.gobmk (max) -7.08% 212.000 197.000 - 7.65% -
403.gcc (avg) (percentage) -7.06% 0.850 0.790 - 29.51% -
434.zeusmp (max) (percentage) -7.05% 4.540 4.220 - 85.09% -
450.soplex (max) (percentage) -7.04% 3.550 3.300 - 67.51% -
450.soplex (max) -7.01% 528.000 491.000 - 61.51% -
435.gromacs (max) -7.00% 1072.000 997.000 - 220.58% -
444.namd (max) -6.95% 1021.000 950.000 - 46.38% -
445.gobmk (max) (percentage) -6.94% 1.730 1.610 - 5.23% -
403.gcc -6.85% 73.000 68.000 - 25.93% -
403.gcc (avg) -6.85% 73.000 68.000 - 25.93% -
454.calculix (avg) (percentage) -6.25% 2.080 1.950 - -2.99% -
454.calculix -6.24% 465.000 436.000 - -5.01% -
454.calculix (avg) -6.24% 465.000 436.000 - -5.01% -
483.xalancbmk -5.85% 171.000 161.000 - 117.57% -
483.xalancbmk (avg) -5.85% 171.000 161.000 - 117.57% -
483.xalancbmk (avg) (percentage) -5.80% 1.380 1.300 - 94.03% -
483.xalancbmk (max) -5.74% 1324.000 1248.000 - 2673.33% -
435.gromacs -5.72% 297.000 280.000 - 5.26% -
435.gromacs (avg) -5.72% 297.000 280.000 - 5.26% -
435.gromacs (avg) (percentage) -5.71% 2.100 1.980 - 14.45% -
482.sphinx3 (max) -5.64% 2003.000 1890.000 - 330.52% -
483.xalancbmk (max) (percentage) -5.55% 10.640 10.050 - 2351.22% -
465.tonto (max) (percentage) -5.54% 15.170 14.330 - 300.28% -
400.perlbench -5.41% 148.000 140.000 - -10.26% -
400.perlbench (avg) -5.41% 148.000 140.000 - -10.26% -
450.soplex -5.37% 205.000 194.000 - 1.57% -
450.soplex (avg) -5.37% 205.000 194.000 - 1.57% -
400.perlbench (max) -5.32% 301.000 285.000 - -17.39% -
481.wrf -5.14% 389.000 369.000 - 16.04% -
481.wrf (avg) -5.14% 389.000 369.000 - 16.04% -
450.soplex (avg) (percentage) -5.07% 1.380 1.310 - 5.65% -
465.tonto (max) -5.00% 1399.000 1329.000 - 353.58% -
400.perlbench (avg) (percentage) -5.00% 1.400 1.330 - -9.52% -
444.namd -4.95% 424.000 403.000 - 13.52% -
444.namd (avg) -4.95% 424.000 403.000 - 13.52% -
445.gobmk -4.95% 101.000 96.000 - 4.35% -
445.gobmk (avg) -4.95% 101.000 96.000 - 4.35% -
400.perlbench (max) (percentage) -4.93% 2.840 2.700 - -16.67% -
444.namd (avg) (percentage) -4.92% 4.270 4.060 - 3.31% -
481.wrf (avg) (percentage) -4.91% 2.240 2.130 - 12.70% -
447.dealII (avg) (percentage) -4.85% 1.030 0.980 - -8.41% -
445.gobmk (avg) (percentage) -4.82% 0.830 0.790 - 2.60% -
416.gamess (max) -4.75% 568.000 541.000 - -17.53% -
416.gamess (max) (percentage) -4.74% 2.530 2.410 - -16.61% -
447.dealII (max) -4.69% 64.000 61.000 - -42.99% -
462.libquantum -4.57% 197.000 188.000 - 150.67% -
462.libquantum (avg) -4.57% 197.000 188.000 - 150.67% -
429.mcf (avg) (percentage) -4.48% 1.340 1.280 - 141.51% -
447.dealII (max) (percentage) -4.48% 0.670 0.640 - -41.82% -
436.cactusADM -4.47% 313.000 299.000 - 2.75% -
436.cactusADM (avg) -4.47% 313.000 299.000 - 2.75% -
434.zeusmp -4.42% 226.000 216.000 - 10.77% -
434.zeusmp (avg) -4.42% 226.000 216.000 - 10.77% -
429.mcf -4.41% 272.000 260.000 - 188.89% -
429.mcf (avg) -4.41% 272.000 260.000 - 188.89% -
459.GemsFDTD -4.35% 253.000 242.000 - 15.24% -
459.GemsFDTD (avg) -4.35% 253.000 242.000 - 15.24% -
437.leslie3d -4.32% 347.000 332.000 - -7.00% -
437.leslie3d (avg) -4.32% 347.000 332.000 - -7.00% -
453.povray (avg) (percentage) -4.28% 1.870 1.790 - 43.20% -
459.GemsFDTD (avg) (percentage) -4.27% 1.170 1.120 - 24.44% -
434.zeusmp (avg) (percentage) -4.27% 1.640 1.570 - 6.08% -
462.libquantum (avg) (percentage) -4.17% 1.440 1.380 - 112.31% -
436.cactusADM (avg) (percentage) -4.09% 1.710 1.640 - -1.20% -
447.dealII -4.08% 98.000 94.000 - -9.62% -
447.dealII (avg) -4.08% 98.000 94.000 - -9.62% -
471.omnetpp -4.02% 348.000 334.000 - 96.47% -
471.omnetpp (avg) -4.02% 348.000 334.000 - 96.47% -
453.povray -3.82% 131.000 126.000 - 55.56% -
453.povray (avg) -3.82% 131.000 126.000 - 55.56% -
433.milc -3.64% 220.000 212.000 - -3.64% -
433.milc (avg) -3.64% 220.000 212.000 - -3.64% -
437.leslie3d (avg) (percentage) -3.63% 2.480 2.390 - 0.42% -
458.sjeng -3.61% 83.000 80.000 - 70.21% -
458.sjeng (avg) -3.61% 83.000 80.000 - 70.21% -
458.sjeng (avg) (percentage) -3.57% 0.560 0.540 - 63.64% -
433.milc (avg) (percentage) -3.41% 1.760 1.700 - 0.00% -
464.h264ref -3.27% 153.000 148.000 - 89.74% -
464.h264ref (avg) -3.27% 153.000 148.000 - 89.74% -
470.lbm (avg) (percentage) -3.23% 2.790 2.700 - 13.92% -
471.omnetpp (avg) (percentage) -3.11% 2.570 2.490 - 56.60% -
401.bzip2 -2.86% 105.000 102.000 - 54.55% -
401.bzip2 (avg) -2.86% 105.000 102.000 - 54.55% -
401.bzip2 (avg) (percentage) -2.70% 0.740 0.720 - 63.64% -
456.hmmer (avg) (percentage) -2.60% 0.770 0.750 - 10.29% -
464.h264ref (avg) (percentage) -2.56% 1.170 1.140 - 111.11% -
456.hmmer -2.44% 82.000 80.000 - 6.67% -
456.hmmer (avg) -2.44% 82.000 80.000 - 6.67% -
470.lbm -2.36% 382.000 373.000 - 23.10% -
470.lbm (avg) -2.36% 382.000 373.000 - 23.10% -
473.astar (avg) (percentage) -2.33% 0.430 0.420 - 121.05% -
473.astar -1.49% 67.000 66.000 - 135.71% -
473.astar (avg) -1.49% 67.000 66.000 - 135.71% -
410.bwaves -1.23% 163.000 161.000 - 0.62% -
410.bwaves (avg) -1.23% 163.000 161.000 - 0.62% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp 25.13% 10739.000 13438.000 - -0.80% -
429.mcf 18.55% 17158.000 20341.000 - -0.07% -
462.libquantum 17.66% 11614.000 13665.000 - -0.17% -
465.tonto 13.09% 8205.000 9279.000 - 0.61% -
483.xalancbmk 11.22% 11172.000 12426.000 - -0.22% -
444.namd 9.94% 9050.000 9950.000 - 0.17% -
453.povray 8.33% 6544.000 7089.000 - 0.47% -
470.lbm 7.96% 12819.000 13839.000 - 0.84% -
473.astar 5.93% 14932.000 15818.000 - 0.13% -
458.sjeng 4.62% 14275.000 14935.000 - -0.13% -
434.zeusmp 4.31% 13211.000 13780.000 - -0.18% -
436.cactusADM 4.24% 17544.000 18287.000 - -0.20% -
481.wrf 2.94% 16834.000 17329.000 - -0.29% -
445.gobmk 2.26% 11995.000 12266.000 - -0.12% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
473.astar (max) 4080.00% 20.000 836.000 - -8.23% -
473.astar (max) (percentage) 3678.57% 0.140 5.290 - -8.32% -
453.povray (unexplained diff vs previous) 3200.00% 1.000 33.000 - -95.22% -
429.mcf (max) 3083.70% 92.000 2929.000 - -25.05% -
462.libquantum (max) 2686.49% 74.000 2062.000 - -16.79% -
483.xalancbmk (max) 2673.33% 45.000 1248.000 - -5.74% -
429.mcf (max) (percentage) 2566.67% 0.540 14.400 - -25.00% -
483.xalancbmk (max) (percentage) 2351.22% 0.410 10.050 - -5.55% -
462.libquantum (max) (percentage) 2257.81% 0.640 15.090 - -16.68% -
453.povray (unexplained diff vs previous) (percentage) 2250.00% 0.020 0.470 - -95.19% -
462.libquantum (unexplained diff vs previous) 2200.00% 1.000 23.000 - -98.90% -
464.h264ref (max) (percentage) 2127.91% 0.430 9.580 - -7.17% -
464.h264ref (max) 1911.29% 62.000 1247.000 - -7.77% -
458.sjeng (max) 1819.35% 31.000 595.000 - -16.90% -
458.sjeng (max) (percentage) 1713.64% 0.220 3.990 - -16.70% -
462.libquantum (unexplained diff vs previous) (percentage) 1600.00% 0.010 0.170 - -98.89% -
410.bwaves (max) 896.67% 30.000 299.000 - -17.40% -
410.bwaves (max) (percentage) 890.48% 0.210 2.080 - -16.80% -
459.GemsFDTD (max) (percentage) 790.00% 0.600 5.340 - -7.13% -
459.GemsFDTD (max) 724.29% 140.000 1154.000 - -7.23% -
470.lbm (unexplained diff vs previous) 721.43% 14.000 115.000 - -91.76% -
410.bwaves (unexplained diff vs previous) (percentage) 690.00% 0.100 0.790 - -69.14% -
410.bwaves (unexplained diff vs previous) 660.00% 15.000 114.000 - -69.27% -
470.lbm (unexplained diff vs previous) (percentage) 654.55% 0.110 0.830 - -91.84% -
464.h264ref (unexplained diff vs previous) (percentage) 590.00% 0.100 0.690 - -94.00% -
473.astar (unexplained diff vs previous) 566.67% 3.000 20.000 - -97.68% -
473.astar (unexplained diff vs previous) (percentage) 550.00% 0.020 0.130 - -97.62% -
401.bzip2 (max) (percentage) 530.68% 0.880 5.550 - -10.05% -
464.h264ref (unexplained diff vs previous) 500.00% 15.000 90.000 - -94.03% -
401.bzip2 (max) 490.98% 133.000 786.000 - -10.17% -
403.gcc (max) (percentage) 370.83% 0.720 3.390 - -7.12% -
482.sphinx3 (max) (percentage) 370.75% 1.470 6.920 - -7.11% -
403.gcc (max) 357.81% 64.000 293.000 - -7.28% -
465.tonto (max) 353.58% 293.000 1329.000 - -5.00% -
471.omnetpp (max) 346.53% 662.000 2956.000 - -9.07% -
482.sphinx3 (max) 330.52% 439.000 1890.000 - -5.64% -
471.omnetpp (unexplained diff vs previous) 315.38% 26.000 108.000 - -95.88% -
465.tonto (max) (percentage) 300.28% 3.580 14.330 - -5.54% -
453.povray (max) 287.88% 165.000 640.000 - -16.23% -
453.povray (max) (percentage) 256.92% 2.530 9.030 - -16.70% -
471.omnetpp (max) (percentage) 256.56% 6.170 22.000 - -8.33% -
435.gromacs (max) (percentage) 248.02% 2.020 7.030 - -7.13% -
471.omnetpp (unexplained diff vs previous) (percentage) 233.33% 0.240 0.800 - -95.87% -
435.gromacs (max) 220.58% 311.000 997.000 - -7.00% -
429.mcf 188.89% 90.000 260.000 - -4.41% -
429.mcf (avg) 188.89% 90.000 260.000 - -4.41% -
462.libquantum 150.67% 75.000 188.000 - -4.57% -
462.libquantum (avg) 150.67% 75.000 188.000 - -4.57% -
429.mcf (avg) (percentage) 141.51% 0.530 1.280 - -4.48% -
473.astar 135.71% 28.000 66.000 - -1.49% -
473.astar (avg) 135.71% 28.000 66.000 - -1.49% -
473.astar (avg) (percentage) 121.05% 0.190 0.420 - -2.33% -
483.xalancbmk 117.57% 74.000 161.000 - -5.85% -
483.xalancbmk (avg) 117.57% 74.000 161.000 - -5.85% -
458.sjeng (unexplained diff vs previous) (percentage) 116.67% 0.060 0.130 - -97.16% -
462.libquantum (avg) (percentage) 112.31% 0.650 1.380 - -4.17% -
458.sjeng (unexplained diff vs previous) 111.11% 9.000 19.000 - -97.22% -
464.h264ref (avg) (percentage) 111.11% 0.540 1.140 - -2.56% -
481.wrf (max) 106.23% 530.000 1093.000 - -16.88% -
481.wrf (max) (percentage) 100.32% 3.150 6.310 - -16.64% -
470.lbm (max) 99.85% 653.000 1305.000 - -15.97% -
456.hmmer (max) (percentage) 98.43% 1.270 2.520 - -16.83% -
471.omnetpp 96.47% 170.000 334.000 - -4.02% -
471.omnetpp (avg) 96.47% 170.000 334.000 - -4.02% -
483.xalancbmk (avg) (percentage) 94.03% 0.670 1.300 - -5.80% -
434.zeusmp (max) 93.02% 301.000 581.000 - -7.19% -
456.hmmer (max) 92.86% 140.000 270.000 - -16.67% -
464.h264ref 89.74% 78.000 148.000 - -3.27% -
464.h264ref (avg) 89.74% 78.000 148.000 - -3.27% -
434.zeusmp (max) (percentage) 85.09% 2.280 4.220 - -7.05% -
470.lbm (max) (percentage) 84.90% 5.100 9.430 - -16.70% -
437.leslie3d (max) (percentage) 79.06% 2.340 4.190 - -11.04% -
465.tonto 76.64% 137.000 242.000 - 0.83% -
465.tonto (avg) 76.64% 137.000 242.000 - 0.83% -
458.sjeng 70.21% 47.000 80.000 - -3.61% -
458.sjeng (avg) 70.21% 47.000 80.000 - -3.61% -
450.soplex (max) (percentage) 67.51% 1.970 3.300 - -7.04% -
437.leslie3d (max) 66.10% 351.000 583.000 - -11.53% -
458.sjeng (avg) (percentage) 63.64% 0.330 0.540 - -3.57% -
401.bzip2 (avg) (percentage) 63.64% 0.440 0.720 - -2.70% -
450.soplex (max) 61.51% 304.000 491.000 - -7.01% -
471.omnetpp (avg) (percentage) 56.60% 1.590 2.490 - -3.11% -
465.tonto (avg) (percentage) 56.29% 1.670 2.610 - 0.00% -
453.povray 55.56% 81.000 126.000 - -3.82% -
453.povray (avg) 55.56% 81.000 126.000 - -3.82% -
401.bzip2 54.55% 66.000 102.000 - -2.86% -
401.bzip2 (avg) 54.55% 66.000 102.000 - -2.86% -
444.namd (max) 46.38% 649.000 950.000 - -6.95% -
453.povray (avg) (percentage) 43.20% 1.250 1.790 - -4.28% -
444.namd (max) (percentage) 33.01% 7.180 9.550 - -7.10% -
403.gcc (avg) (percentage) 29.51% 0.610 0.790 - -7.06% -
403.gcc 25.93% 54.000 68.000 - -6.85% -
403.gcc (avg) 25.93% 54.000 68.000 - -6.85% -
459.GemsFDTD (avg) (percentage) 24.44% 0.900 1.120 - -4.27% -
470.lbm 23.10% 303.000 373.000 - -2.36% -
470.lbm (avg) 23.10% 303.000 373.000 - -2.36% -
482.sphinx3 (avg) (percentage) 20.55% 1.460 1.760 - 0.00% -
481.wrf 16.04% 318.000 369.000 - -5.14% -
481.wrf (avg) 16.04% 318.000 369.000 - -5.14% -
459.GemsFDTD 15.24% 210.000 242.000 - -4.35% -
459.GemsFDTD (avg) 15.24% 210.000 242.000 - -4.35% -
435.gromacs (avg) (percentage) 14.45% 1.730 1.980 - -5.71% -
470.lbm (avg) (percentage) 13.92% 2.370 2.700 - -3.23% -
444.namd 13.52% 355.000 403.000 - -4.95% -
444.namd (avg) 13.52% 355.000 403.000 - -4.95% -
481.wrf (avg) (percentage) 12.70% 1.890 2.130 - -4.91% -
434.zeusmp 10.77% 195.000 216.000 - -4.42% -
434.zeusmp (avg) 10.77% 195.000 216.000 - -4.42% -
456.hmmer (avg) (percentage) 10.29% 0.680 0.750 - -2.60% -
482.sphinx3 10.09% 436.000 480.000 - 1.48% -
482.sphinx3 (avg) 10.09% 436.000 480.000 - 1.48% -
445.gobmk (max) 7.65% 183.000 197.000 - -7.08% -
456.hmmer 6.67% 75.000 80.000 - -2.44% -
456.hmmer (avg) 6.67% 75.000 80.000 - -2.44% -
434.zeusmp (avg) (percentage) 6.08% 1.480 1.570 - -4.27% -
436.cactusADM (max) 5.98% 552.000 585.000 - -25.19% -
450.soplex (avg) (percentage) 5.65% 1.240 1.310 - -5.07% -
435.gromacs 5.26% 266.000 280.000 - -5.72% -
435.gromacs (avg) 5.26% 266.000 280.000 - -5.72% -
445.gobmk (max) (percentage) 5.23% 1.530 1.610 - -6.94% -
445.gobmk 4.35% 92.000 96.000 - -4.95% -
445.gobmk (avg) 4.35% 92.000 96.000 - -4.95% -
444.namd (avg) (percentage) 3.31% 3.930 4.060 - -4.92% -
410.bwaves (avg) (percentage) 2.75% 1.090 1.120 - -0.88% -
436.cactusADM 2.75% 291.000 299.000 - -4.47% -
436.cactusADM (avg) 2.75% 291.000 299.000 - -4.47% -
445.gobmk (avg) (percentage) 2.60% 0.770 0.790 - -4.82% -
436.cactusADM (max) (percentage) 1.59% 3.150 3.200 - -25.06% -
450.soplex 1.57% 191.000 194.000 - -5.37% -
450.soplex (avg) 1.57% 191.000 194.000 - -5.37% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.92% 428364.000 420124.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -10.56% 14556.000 13019.000 - -0.69% -
482.sphinx3 -8.73% 29928.000 27314.000 - 1.54% -
435.gromacs -7.98% 15419.000 14189.000 - 0.13% -
459.GemsFDTD -7.46% 23356.000 21613.000 - -0.16% -
437.leslie3d -7.26% 15005.000 13916.000 - -0.63% -
401.bzip2 -6.70% 15185.000 14167.000 - -0.20% -
403.gcc -3.90% 9010.000 8659.000 - -0.02% -
433.milc -3.84% 12976.000 12478.000 - -0.25% -
450.soplex -3.80% 15466.000 14879.000 - -0.14% -
456.hmmer -2.69% 11046.000 10749.000 - 0.35% -
410.bwaves -2.58% 14755.000 14375.000 - -0.79% -
454.calculix -2.03% 22860.000 22396.000 - -0.00% -
447.dealII -1.20% 9751.000 9634.000 - 0.31% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) (percentage) -97.80% 7.730 0.170 - -98.18% -
444.namd (unexplained diff vs previous) -97.57% 700.000 17.000 - -98.16% -
403.gcc (unexplained diff vs previous) (percentage) -97.22% 0.720 0.020 - -99.47% -
403.gcc (unexplained diff vs previous) -96.92% 65.000 2.000 - -99.39% -
416.gamess (unexplained diff vs previous) (percentage) -96.31% 2.980 0.110 - -86.75% -
416.gamess (unexplained diff vs previous) -96.30% 676.000 25.000 - -86.63% -
435.gromacs (unexplained diff vs previous) -94.34% 318.000 18.000 - -98.45% -
436.cactusADM (unexplained diff vs previous) (percentage) -93.85% 3.250 0.200 - -95.11% -
435.gromacs (unexplained diff vs previous) (percentage) -93.69% 2.060 0.130 - -98.41% -
436.cactusADM (unexplained diff vs previous) -93.51% 570.000 37.000 - -95.07% -
450.soplex (unexplained diff vs previous) -93.25% 311.000 21.000 - -96.17% -
450.soplex (unexplained diff vs previous) (percentage) -93.03% 2.010 0.140 - -96.20% -
433.milc (unexplained diff vs previous) -92.71% 425.000 31.000 - -94.30% -
433.milc (unexplained diff vs previous) (percentage) -92.38% 3.280 0.250 - -94.25% -
434.zeusmp (unexplained diff vs previous) (percentage) -92.27% 2.330 0.180 - -95.85% -
445.gobmk (unexplained diff vs previous) (percentage) -92.26% 1.550 0.120 - -92.94% -
445.gobmk (unexplained diff vs previous) -91.94% 186.000 15.000 - -92.82% -
434.zeusmp (unexplained diff vs previous) -91.88% 308.000 25.000 - -95.83% -
400.perlbench (unexplained diff vs previous) -87.39% 357.000 45.000 - -13.46% -
400.perlbench (unexplained diff vs previous) (percentage) -87.16% 3.350 0.430 - -12.24% -
429.mcf (unexplained diff vs previous) (percentage) -87.04% 0.540 0.070 - -99.57% -
429.mcf (unexplained diff vs previous) -83.87% 93.000 15.000 - -99.54% -
454.calculix (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.85% -
401.bzip2 (unexplained diff vs previous) -78.03% 132.000 29.000 - -96.89% -
401.bzip2 (unexplained diff vs previous) (percentage) -77.01% 0.870 0.200 - -96.96% -
437.leslie3d (unexplained diff vs previous) -74.34% 343.000 88.000 - 49.15% -
437.leslie3d (unexplained diff vs previous) (percentage) -72.49% 2.290 0.630 - 50.00% -
447.dealII (unexplained diff vs previous) -60.53% 76.000 30.000 - -42.31% -
447.dealII (unexplained diff vs previous) (percentage) -60.26% 0.780 0.310 - -42.59% -
481.wrf (unexplained diff vs previous) (percentage) -56.72% 0.670 0.290 - -95.88% -
456.hmmer (unexplained diff vs previous) -55.42% 83.000 37.000 - -88.96% -
481.wrf (unexplained diff vs previous) -55.36% 112.000 50.000 - -95.91% -
456.hmmer (unexplained diff vs previous) (percentage) -54.67% 0.750 0.340 - -89.14% -
454.calculix (max) -47.30% 1074.000 566.000 - -37.25% -
483.xalancbmk (unexplained diff vs previous) (percentage) -46.34% 0.410 0.220 - -97.71% -
454.calculix (max) (percentage) -46.17% 4.700 2.530 - -37.22% -
447.dealII (max) -42.99% 107.000 61.000 - -4.69% -
447.dealII (max) (percentage) -41.82% 1.100 0.640 - -4.48% -
483.xalancbmk (unexplained diff vs previous) -41.30% 46.000 27.000 - -97.75% -
459.GemsFDTD (unexplained diff vs previous) -27.08% 48.000 35.000 - -97.35% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -23.81% 0.210 0.160 - -97.38% -
416.gamess (max) -17.53% 656.000 541.000 - -4.75% -
400.perlbench (max) -17.39% 345.000 285.000 - -5.32% -
400.perlbench (max) (percentage) -16.67% 3.240 2.700 - -4.93% -
416.gamess (max) (percentage) -16.61% 2.890 2.410 - -4.74% -
416.gamess -13.21% 492.000 427.000 - -7.17% -
416.gamess (avg) -13.21% 492.000 427.000 - -7.17% -
416.gamess (avg) (percentage) -12.44% 2.170 1.900 - -7.32% -
400.perlbench -10.26% 156.000 140.000 - -5.41% -
400.perlbench (avg) -10.26% 156.000 140.000 - -5.41% -
447.dealII -9.62% 104.000 94.000 - -4.08% -
447.dealII (avg) -9.62% 104.000 94.000 - -4.08% -
400.perlbench (avg) (percentage) -9.52% 1.470 1.330 - -5.00% -
447.dealII (avg) (percentage) -8.41% 1.070 0.980 - -4.85% -
437.leslie3d -7.00% 357.000 332.000 - -4.32% -
437.leslie3d (avg) -7.00% 357.000 332.000 - -4.32% -
433.milc (max) -5.11% 411.000 390.000 - -25.14% -
454.calculix -5.01% 459.000 436.000 - -6.24% -
454.calculix (avg) -5.01% 459.000 436.000 - -6.24% -
433.milc -3.64% 220.000 212.000 - -3.64% -
433.milc (avg) -3.64% 220.000 212.000 - -3.64% -
454.calculix (avg) (percentage) -2.99% 2.010 1.950 - -6.25% -
433.milc (max) (percentage) -1.26% 3.170 3.130 - -24.94% -
436.cactusADM (avg) (percentage) -1.20% 1.660 1.640 - -4.09% -

Added Tests - sample variability
454.calculix (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 10568.000 -
401.bzip2 14167.000 -
403.gcc 8659.000 -
410.bwaves 14375.000 -
416.gamess 22486.000 -
429.mcf 20341.000 -
433.milc 12478.000 -
434.zeusmp 13780.000 -
435.gromacs 14189.000 -
436.cactusADM 18287.000 -
437.leslie3d 13916.000 -
444.namd 9950.000 -
445.gobmk 12266.000 -
447.dealII 9634.000 -
450.soplex 14879.000 -
453.povray 7089.000 -
454.calculix 22396.000 -
456.hmmer 10749.000 -
458.sjeng 14935.000 -
459.GemsFDTD 21613.000 -
462.libquantum 13665.000 -
464.h264ref 13019.000 -
465.tonto 9279.000 -
470.lbm 13839.000 -
471.omnetpp 13438.000 -
473.astar 15818.000 -
481.wrf 17329.000 -
482.sphinx3 27314.000 1.54%
483.xalancbmk 12426.000 -
Geometric Mean 13917.586 -
Code Size (bytes)
Name Current %
400.perlbench 922495.000 -
401.bzip2 49892.000 -
403.gcc 2691264.000 -
410.bwaves 17876.000 -
416.gamess 6270551.000 -
429.mcf 10951.000 -
433.milc 95866.000 -
434.zeusmp 165667.000 -
435.gromacs 678969.000 -
436.cactusADM 553942.000 -
437.leslie3d 65177.000 -
444.namd 191015.000 -
445.gobmk 1403715.000 -
447.dealII 2118848.000 -
450.soplex 260564.000 -
453.povray 708833.000 -
454.calculix 1273152.000 -
456.hmmer 231184.000 -
458.sjeng 120213.000 -
459.GemsFDTD 253809.000 -
462.libquantum 31297.000 -
464.h264ref 420124.000 -
465.tonto 2875542.000 -
470.lbm 10908.000 -
471.omnetpp 566566.000 -
473.astar 32068.000 -
481.wrf 2639089.000 -
482.sphinx3 152724.000 -
483.xalancbmk 3278274.000 -
Geometric Mean 297760.970 -
sample variability
Name Current %
400.perlbench 140.000 -5.41%
400.perlbench (avg) 140.000 -5.41%
400.perlbench (avg) (percentage) 1.330 -5.00%
400.perlbench (max) 285.000 -5.32%
400.perlbench (max) (percentage) 2.700 -4.93%
400.perlbench (unexplained diff vs previous) 45.000 -13.46%
400.perlbench (unexplained diff vs previous) (percentage) 0.430 -12.24%
401.bzip2 102.000 -2.86%
401.bzip2 (avg) 102.000 -2.86%
401.bzip2 (avg) (percentage) 0.720 -2.70%
401.bzip2 (max) 786.000 -10.17%
401.bzip2 (max) (percentage) 5.550 -10.05%
401.bzip2 (unexplained diff vs previous) 29.000 -96.89%
401.bzip2 (unexplained diff vs previous) (percentage) 0.200 -96.96%
403.gcc 68.000 -6.85%
403.gcc (avg) 68.000 -6.85%
403.gcc (avg) (percentage) 0.790 -7.06%
403.gcc (max) 293.000 -7.28%
403.gcc (max) (percentage) 3.390 -7.12%
403.gcc (unexplained diff vs previous) 2.000 -99.39%
403.gcc (unexplained diff vs previous) (percentage) 0.020 -99.47%
410.bwaves 161.000 -1.23%
410.bwaves (avg) 161.000 -1.23%
410.bwaves (avg) (percentage) 1.120 -
410.bwaves (max) 299.000 -17.40%
410.bwaves (max) (percentage) 2.080 -16.80%
410.bwaves (unexplained diff vs previous) 114.000 -69.27%
410.bwaves (unexplained diff vs previous) (percentage) 0.790 -69.14%
416.gamess 427.000 -7.17%
416.gamess (avg) 427.000 -7.17%
416.gamess (avg) (percentage) 1.900 -7.32%
416.gamess (max) 541.000 -4.75%
416.gamess (max) (percentage) 2.410 -4.74%
416.gamess (unexplained diff vs previous) 25.000 -86.63%
416.gamess (unexplained diff vs previous) (percentage) 0.110 -86.75%
429.mcf 260.000 -4.41%
429.mcf (avg) 260.000 -4.41%
429.mcf (avg) (percentage) 1.280 -4.48%
429.mcf (max) 2929.000 -25.05%
429.mcf (max) (percentage) 14.400 -25.00%
429.mcf (unexplained diff vs previous) 15.000 -99.54%
429.mcf (unexplained diff vs previous) (percentage) 0.070 -99.57%
433.milc 212.000 -3.64%
433.milc (avg) 212.000 -3.64%
433.milc (avg) (percentage) 1.700 -3.41%
433.milc (max) 390.000 -25.14%
433.milc (max) (percentage) 3.130 -24.94%
433.milc (unexplained diff vs previous) 31.000 -94.30%
433.milc (unexplained diff vs previous) (percentage) 0.250 -94.25%
434.zeusmp 216.000 -4.42%
434.zeusmp (avg) 216.000 -4.42%
434.zeusmp (avg) (percentage) 1.570 -4.27%
434.zeusmp (max) 581.000 -7.19%
434.zeusmp (max) (percentage) 4.220 -7.05%
434.zeusmp (unexplained diff vs previous) 25.000 -95.83%
434.zeusmp (unexplained diff vs previous) (percentage) 0.180 -95.85%
435.gromacs 280.000 -5.72%
435.gromacs (avg) 280.000 -5.72%
435.gromacs (avg) (percentage) 1.980 -5.71%
435.gromacs (max) 997.000 -7.00%
435.gromacs (max) (percentage) 7.030 -7.13%
435.gromacs (unexplained diff vs previous) 18.000 -98.45%
435.gromacs (unexplained diff vs previous) (percentage) 0.130 -98.41%
436.cactusADM 299.000 -4.47%
436.cactusADM (avg) 299.000 -4.47%
436.cactusADM (avg) (percentage) 1.640 -4.09%
436.cactusADM (max) 585.000 -25.19%
436.cactusADM (max) (percentage) 3.200 -25.06%
436.cactusADM (unexplained diff vs previous) 37.000 -95.07%
436.cactusADM (unexplained diff vs previous) (percentage) 0.200 -95.11%
437.leslie3d 332.000 -4.32%
437.leslie3d (avg) 332.000 -4.32%
437.leslie3d (avg) (percentage) 2.390 -3.63%
437.leslie3d (max) 583.000 -11.53%
437.leslie3d (max) (percentage) 4.190 -11.04%
437.leslie3d (unexplained diff vs previous) 88.000 49.15%
437.leslie3d (unexplained diff vs previous) (percentage) 0.630 50.00%
444.namd 403.000 -4.95%
444.namd (avg) 403.000 -4.95%
444.namd (avg) (percentage) 4.060 -4.92%
444.namd (max) 950.000 -6.95%
444.namd (max) (percentage) 9.550 -7.10%
444.namd (unexplained diff vs previous) 17.000 -98.16%
444.namd (unexplained diff vs previous) (percentage) 0.170 -98.18%
445.gobmk 96.000 -4.95%
445.gobmk (avg) 96.000 -4.95%
445.gobmk (avg) (percentage) 0.790 -4.82%
445.gobmk (max) 197.000 -7.08%
445.gobmk (max) (percentage) 1.610 -6.94%
445.gobmk (unexplained diff vs previous) 15.000 -92.82%
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -92.94%
447.dealII 94.000 -4.08%
447.dealII (avg) 94.000 -4.08%
447.dealII (avg) (percentage) 0.980 -4.85%
447.dealII (max) 61.000 -4.69%
447.dealII (max) (percentage) 0.640 -4.48%
447.dealII (unexplained diff vs previous) 30.000 -42.31%
447.dealII (unexplained diff vs previous) (percentage) 0.310 -42.59%
450.soplex 194.000 -5.37%
450.soplex (avg) 194.000 -5.37%
450.soplex (avg) (percentage) 1.310 -5.07%
450.soplex (max) 491.000 -7.01%
450.soplex (max) (percentage) 3.300 -7.04%
450.soplex (unexplained diff vs previous) 21.000 -96.17%
450.soplex (unexplained diff vs previous) (percentage) 0.140 -96.20%
453.povray 126.000 -3.82%
453.povray (avg) 126.000 -3.82%
453.povray (avg) (percentage) 1.790 -4.28%
453.povray (max) 640.000 -16.23%
453.povray (max) (percentage) 9.030 -16.70%
453.povray (unexplained diff vs previous) 33.000 -95.22%
453.povray (unexplained diff vs previous) (percentage) 0.470 -95.19%
454.calculix 436.000 -6.24%
454.calculix (avg) 436.000 -6.24%
454.calculix (avg) (percentage) 1.950 -6.25%
454.calculix (max) 566.000 -37.25%
454.calculix (max) (percentage) 2.530 -37.22%
454.calculix (unexplained diff vs previous) 1.000 -99.85%
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 80.000 -2.44%
456.hmmer (avg) 80.000 -2.44%
456.hmmer (avg) (percentage) 0.750 -2.60%
456.hmmer (max) 270.000 -16.67%
456.hmmer (max) (percentage) 2.520 -16.83%
456.hmmer (unexplained diff vs previous) 37.000 -88.96%
456.hmmer (unexplained diff vs previous) (percentage) 0.340 -89.14%
458.sjeng 80.000 -3.61%
458.sjeng (avg) 80.000 -3.61%
458.sjeng (avg) (percentage) 0.540 -3.57%
458.sjeng (max) 595.000 -16.90%
458.sjeng (max) (percentage) 3.990 -16.70%
458.sjeng (unexplained diff vs previous) 19.000 -97.22%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 -97.16%
459.GemsFDTD 242.000 -4.35%
459.GemsFDTD (avg) 242.000 -4.35%
459.GemsFDTD (avg) (percentage) 1.120 -4.27%
459.GemsFDTD (max) 1154.000 -7.23%
459.GemsFDTD (max) (percentage) 5.340 -7.13%
459.GemsFDTD (unexplained diff vs previous) 35.000 -97.35%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.160 -97.38%
462.libquantum 188.000 -4.57%
462.libquantum (avg) 188.000 -4.57%
462.libquantum (avg) (percentage) 1.380 -4.17%
462.libquantum (max) 2062.000 -16.79%
462.libquantum (max) (percentage) 15.090 -16.68%
462.libquantum (unexplained diff vs previous) 23.000 -98.90%
462.libquantum (unexplained diff vs previous) (percentage) 0.170 -98.89%
464.h264ref 148.000 -3.27%
464.h264ref (avg) 148.000 -3.27%
464.h264ref (avg) (percentage) 1.140 -2.56%
464.h264ref (max) 1247.000 -7.77%
464.h264ref (max) (percentage) 9.580 -7.17%
464.h264ref (unexplained diff vs previous) 90.000 -94.03%
464.h264ref (unexplained diff vs previous) (percentage) 0.690 -94.00%
465.tonto 242.000 -
465.tonto (avg) 242.000 -
465.tonto (avg) (percentage) 2.610 -
465.tonto (max) 1329.000 -5.00%
465.tonto (max) (percentage) 14.330 -5.54%
470.lbm 373.000 -2.36%
470.lbm (avg) 373.000 -2.36%
470.lbm (avg) (percentage) 2.700 -3.23%
470.lbm (max) 1305.000 -15.97%
470.lbm (max) (percentage) 9.430 -16.70%
470.lbm (unexplained diff vs previous) 115.000 -91.76%
470.lbm (unexplained diff vs previous) (percentage) 0.830 -91.84%
471.omnetpp 334.000 -4.02%
471.omnetpp (avg) 334.000 -4.02%
471.omnetpp (avg) (percentage) 2.490 -3.11%
471.omnetpp (max) 2956.000 -9.07%
471.omnetpp (max) (percentage) 22.000 -8.33%
471.omnetpp (unexplained diff vs previous) 108.000 -95.88%
471.omnetpp (unexplained diff vs previous) (percentage) 0.800 -95.87%
473.astar 66.000 -1.49%
473.astar (avg) 66.000 -1.49%
473.astar (avg) (percentage) 0.420 -2.33%
473.astar (max) 836.000 -8.23%
473.astar (max) (percentage) 5.290 -8.32%
473.astar (unexplained diff vs previous) 20.000 -97.68%
473.astar (unexplained diff vs previous) (percentage) 0.130 -97.62%
481.wrf 369.000 -5.14%
481.wrf (avg) 369.000 -5.14%
481.wrf (avg) (percentage) 2.130 -4.91%
481.wrf (max) 1093.000 -16.88%
481.wrf (max) (percentage) 6.310 -16.64%
481.wrf (unexplained diff vs previous) 50.000 -95.91%
481.wrf (unexplained diff vs previous) (percentage) 0.290 -95.88%
482.sphinx3 480.000 1.48%
482.sphinx3 (avg) 480.000 1.48%
482.sphinx3 (avg) (percentage) 1.760 -
482.sphinx3 (max) 1890.000 -5.64%
482.sphinx3 (max) (percentage) 6.920 -7.11%
483.xalancbmk 161.000 -5.85%
483.xalancbmk (avg) 161.000 -5.85%
483.xalancbmk (avg) (percentage) 1.300 -5.80%
483.xalancbmk (max) 1248.000 -5.74%
483.xalancbmk (max) (percentage) 10.050 -5.55%
483.xalancbmk (unexplained diff vs previous) 27.000 -97.75%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.220 -97.71%
Geometric Mean 19.642 -60.48%