Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3198c863f62ab2253a3405e677489b90c403cf1c (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/3b54cc9d04c2efb2c8f9a0b515e638917636630c (+ 19 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e2b68828fab4fdfa5595fa89180230cdc4373ec1 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=6f8a482afd392741964fb56590457f81e82b5a5a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_gnu-build-tcwg_bmk_apm-gnu-master-aarch64-spec2k6-Os_LTO/364/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0364 (-00000-) 2022-12-19T15:12:53 0:00:00
Previous 0363 (v6.0.15-41683-g6f8a482afd39) 2022-12-17T06:37:12 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 43 53
Performance Improvements 161 179
Added Tests 2 2
Unchanged Tests 1030 1002
Total Tests 1236

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
465.tonto 3.10% 8097.000 8348.000 - -23.70% -
482.sphinx3 2.46% 29317.000 30038.000 - 3078.62% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk 60.98% 41.000 66.000 - -73.39% -
483.xalancbmk (avg) 60.98% 41.000 66.000 - -73.39% -
483.xalancbmk (avg) (percentage) 60.53% 0.380 0.610 - -90.62% -
401.bzip2 (avg) (percentage) 40.74% 0.270 0.380 - -93.07% -
401.bzip2 40.00% 40.000 56.000 - -65.22% -
401.bzip2 (avg) 40.00% 40.000 56.000 - -65.22% -
471.omnetpp 28.40% 81.000 104.000 - -53.36% -
471.omnetpp (avg) 28.40% 81.000 104.000 - -53.36% -
471.omnetpp (avg) (percentage) 27.63% 0.760 0.970 - -88.17% -
400.perlbench (avg) (percentage) 20.91% 1.100 1.330 - -79.06% -
400.perlbench 20.66% 121.000 146.000 - 39.05% -
400.perlbench (avg) 20.66% 121.000 146.000 - 39.05% -
458.sjeng (avg) (percentage) 20.00% 0.150 0.180 - -94.36% -
482.sphinx3 (max) 20.00% 615.000 738.000 - -18.99% -
403.gcc (unexplained diff vs previous) (percentage) 20.00% 0.400 0.480 - -100.00% -
403.gcc (unexplained diff vs previous) 19.44% 36.000 43.000 - -99.50% -
458.sjeng 19.05% 21.000 25.000 - -89.63% -
458.sjeng (avg) 19.05% 21.000 25.000 - -89.63% -
403.gcc (max) (percentage) 17.50% 0.400 0.470 - -99.53% -
482.sphinx3 (max) (percentage) 17.14% 2.100 2.460 - -97.45% -
403.gcc 16.67% 24.000 28.000 - 600.00% -
403.gcc (avg) 16.67% 24.000 28.000 - 600.00% -
403.gcc (max) 16.67% 36.000 42.000 - -23.64% -
459.GemsFDTD 15.00% 160.000 184.000 - -48.89% -
459.GemsFDTD (avg) 15.00% 160.000 184.000 - -48.89% -
403.gcc (avg) (percentage) 14.81% 0.270 0.310 - -95.77% -
482.sphinx3 (unexplained diff vs previous) 14.81% 628.000 721.000 - -97.23% -
459.GemsFDTD (avg) (percentage) 14.49% 0.690 0.790 - -86.47% -
482.sphinx3 13.92% 474.000 540.000 - 629.73% -
482.sphinx3 (avg) 13.92% 474.000 540.000 - 629.73% -
482.sphinx3 (unexplained diff vs previous) (percentage) 12.15% 2.140 2.400 - -99.91% -
410.bwaves (avg) (percentage) 11.54% 1.560 1.740 - -60.54% -
482.sphinx3 (avg) (percentage) 11.11% 1.620 1.800 - -77.30% -
410.bwaves 9.50% 221.000 242.000 - -2.81% -
410.bwaves (avg) 9.50% 221.000 242.000 - -2.81% -
465.tonto 6.86% 102.000 109.000 - -70.14% -
465.tonto (avg) 6.86% 102.000 109.000 - -70.14% -
465.tonto (avg) (percentage) 3.97% 1.260 1.310 - -60.78% -
481.wrf (avg) (percentage) 1.30% 1.540 1.560 - -75.00% -
481.wrf 1.20% 249.000 252.000 - -26.96% -
481.wrf (avg) 1.20% 249.000 252.000 - -26.96% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
410.bwaves -1.90% 14193.000 13924.000 - 146.36% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
434.zeusmp (unexplained diff vs previous) (percentage) -99.54% 2.190 0.010 - -100.00% -
453.povray (unexplained diff vs previous) -99.41% 169.000 1.000 - -99.98% -
416.gamess (unexplained diff vs previous) -99.39% 660.000 4.000 - -99.95% -
416.gamess (unexplained diff vs previous) (percentage) -99.35% 3.100 0.020 - -99.97% -
434.zeusmp (unexplained diff vs previous) -99.34% 301.000 2.000 - -99.98% -
453.povray (unexplained diff vs previous) (percentage) -99.24% 2.640 0.020 - -100.00% -
470.lbm (unexplained diff vs previous) -98.93% 562.000 6.000 - -99.94% -
436.cactusADM (unexplained diff vs previous) (percentage) -98.91% 2.740 0.030 - -100.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.90% 4.560 0.050 - -99.98% -
436.cactusADM (unexplained diff vs previous) -98.80% 498.000 6.000 - -99.96% -
444.namd (unexplained diff vs previous) (percentage) -98.03% 7.630 0.150 - -99.99% -
444.namd (unexplained diff vs previous) -97.98% 742.000 15.000 - -99.82% -
481.wrf (unexplained diff vs previous) (percentage) -97.53% 4.450 0.110 - -99.95% -
481.wrf (unexplained diff vs previous) -97.50% 720.000 18.000 - -99.85% -
435.gromacs (unexplained diff vs previous) -97.16% 423.000 12.000 - -99.83% -
435.gromacs (unexplained diff vs previous) (percentage) -97.04% 2.700 0.080 - -99.92% -
462.libquantum (unexplained diff vs previous) (percentage) -96.33% 1.090 0.040 - -100.00% -
462.libquantum (unexplained diff vs previous) -96.00% 125.000 5.000 - -99.96% -
450.soplex (unexplained diff vs previous) -95.80% 333.000 14.000 - -99.90% -
450.soplex (unexplained diff vs previous) (percentage) -95.65% 2.070 0.090 - -100.00% -
454.calculix (unexplained diff vs previous) -94.32% 828.000 47.000 - -99.80% -
454.calculix (unexplained diff vs previous) (percentage) -94.23% 3.810 0.220 - -100.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -92.86% 1.120 0.080 - -99.98% -
471.omnetpp (unexplained diff vs previous) -92.50% 120.000 9.000 - -99.92% -
458.sjeng (unexplained diff vs previous) -91.07% 56.000 5.000 - -99.93% -
458.sjeng (unexplained diff vs previous) (percentage) -89.74% 0.390 0.040 - -99.96% -
445.gobmk (unexplained diff vs previous) -85.62% 153.000 22.000 - -99.61% -
445.gobmk (unexplained diff vs previous) (percentage) -85.50% 1.310 0.190 - -99.83% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -84.88% 1.720 0.260 - -99.90% -
459.GemsFDTD (unexplained diff vs previous) -84.83% 402.000 61.000 - -99.61% -
437.leslie3d (unexplained diff vs previous) -81.39% 446.000 83.000 - -96.41% -
437.leslie3d (unexplained diff vs previous) (percentage) -81.37% 3.060 0.570 - -97.13% -
400.perlbench (unexplained diff vs previous) (percentage) -73.85% 0.650 0.170 - -99.97% -
400.perlbench (unexplained diff vs previous) -73.24% 71.000 19.000 - -99.78% -
473.astar (unexplained diff vs previous) -70.00% 70.000 21.000 - -99.79% -
429.mcf (unexplained diff vs previous) (percentage) -69.77% 0.430 0.130 - -99.99% -
473.astar (unexplained diff vs previous) (percentage) -69.39% 0.490 0.150 - -99.92% -
429.mcf (unexplained diff vs previous) -69.33% 75.000 23.000 - -99.88% -
400.perlbench (max) -61.15% 157.000 61.000 - -95.63% -
400.perlbench (max) (percentage) -60.84% 1.430 0.560 - -99.33% -
464.h264ref (unexplained diff vs previous) (percentage) -53.33% 0.150 0.070 - -99.94% -
464.h264ref (unexplained diff vs previous) -52.38% 21.000 10.000 - -99.85% -
456.hmmer (unexplained diff vs previous) (percentage) -51.53% 1.960 0.950 - -99.66% -
456.hmmer (unexplained diff vs previous) -51.20% 209.000 102.000 - -98.73% -
483.xalancbmk (unexplained diff vs previous) (percentage) -51.11% 0.450 0.220 - -99.90% -
483.xalancbmk (unexplained diff vs previous) -51.02% 49.000 24.000 - -99.71% -
410.bwaves (unexplained diff vs previous) -35.65% 418.000 269.000 - -96.55% -
410.bwaves (unexplained diff vs previous) (percentage) -34.58% 2.950 1.930 - -98.60% -
483.xalancbmk (max) -25.00% 48.000 36.000 - -98.63% -
465.tonto (unexplained diff vs previous) (percentage) -24.75% 4.000 3.010 - -81.41% -
483.xalancbmk (max) (percentage) -24.44% 0.450 0.340 - -99.50% -
401.bzip2 (unexplained diff vs previous) -24.39% 41.000 31.000 - -99.71% -
445.gobmk -24.24% 99.000 75.000 - -61.73% -
445.gobmk (avg) -24.24% 99.000 75.000 - -61.73% -
454.calculix (avg) (percentage) -23.53% 1.360 1.040 - -87.03% -
445.gobmk (avg) (percentage) -23.53% 0.850 0.650 - -83.38% -
454.calculix -23.39% 295.000 226.000 - 5550.00% -
454.calculix (avg) -23.39% 295.000 226.000 - 5550.00% -
447.dealII (unexplained diff vs previous) -22.64% 53.000 41.000 - -99.42% -
465.tonto (unexplained diff vs previous) -22.53% 324.000 251.000 - -85.83% -
447.dealII (unexplained diff vs previous) (percentage) -22.41% 0.580 0.450 - -99.89% -
401.bzip2 (unexplained diff vs previous) (percentage) -22.22% 0.270 0.210 - -99.94% -
444.namd (avg) (percentage) -19.28% 4.980 4.020 - -56.40% -
444.namd -19.21% 484.000 391.000 - 475.00% -
444.namd (avg) -19.21% 484.000 391.000 - 475.00% -
456.hmmer (avg) (percentage) -18.82% 0.850 0.690 - -84.35% -
410.bwaves (max) -18.60% 430.000 350.000 - -89.32% -
456.hmmer -17.78% 90.000 74.000 - -41.73% -
456.hmmer (avg) -17.78% 90.000 74.000 - -41.73% -
450.soplex -17.48% 206.000 170.000 - 372.22% -
450.soplex (avg) -17.48% 206.000 170.000 - 372.22% -
450.soplex (avg) (percentage) -17.19% 1.280 1.060 - -83.51% -
410.bwaves (max) (percentage) -16.83% 3.030 2.520 - -95.65% -
481.wrf (max) (percentage) -16.67% 4.260 3.550 - -94.83% -
481.wrf (max) -16.55% 689.000 575.000 - -84.87% -
459.GemsFDTD (max) (percentage) -16.47% 1.700 1.420 - -98.01% -
459.GemsFDTD (max) -16.41% 396.000 331.000 - -92.50% -
437.leslie3d (avg) (percentage) -15.61% 2.690 2.270 - -25.57% -
458.sjeng (max) -15.52% 58.000 49.000 - -98.64% -
437.leslie3d -15.05% 392.000 333.000 - -6.20% -
437.leslie3d (avg) -15.05% 392.000 333.000 - -6.20% -
458.sjeng (max) (percentage) -14.63% 0.410 0.350 - -99.26% -
435.gromacs -14.39% 264.000 226.000 - -38.42% -
435.gromacs (avg) -14.39% 264.000 226.000 - -38.42% -
473.astar (avg) (percentage) -14.29% 0.210 0.180 - -95.67% -
435.gromacs (avg) (percentage) -14.20% 1.690 1.450 - -71.34% -
429.mcf -14.00% 50.000 43.000 - -60.55% -
429.mcf (avg) -14.00% 50.000 43.000 - -60.55% -
434.zeusmp (avg) (percentage) -13.94% 1.650 1.420 - -75.73% -
473.astar -13.79% 29.000 25.000 - -88.26% -
473.astar (avg) -13.79% 29.000 25.000 - -88.26% -
429.mcf (avg) (percentage) -13.79% 0.290 0.250 - -96.74% -
434.zeusmp -13.72% 226.000 195.000 - 32.65% -
434.zeusmp (avg) -13.72% 226.000 195.000 - 32.65% -
436.cactusADM -13.29% 331.000 287.000 - 131.45% -
436.cactusADM (avg) -13.29% 331.000 287.000 - 131.45% -
436.cactusADM (avg) (percentage) -13.19% 1.820 1.580 - -73.58% -
473.astar (max) -13.04% 69.000 60.000 - -98.24% -
445.gobmk (max) -12.90% 155.000 135.000 - -94.89% -
445.gobmk (max) (percentage) -12.78% 1.330 1.160 - -97.80% -
450.soplex (max) -12.65% 340.000 297.000 - -45.50% -
435.gromacs (max) -12.64% 435.000 380.000 - -89.36% -
435.gromacs (max) (percentage) -12.59% 2.780 2.430 - -95.06% -
454.calculix (max) (percentage) -12.53% 3.670 3.210 - -96.78% -
433.milc (max) -12.53% 375.000 328.000 - -68.58% -
436.cactusADM (max) -12.52% 511.000 447.000 - -75.81% -
416.gamess (max) (percentage) -12.50% 3.200 2.800 - -92.74% -
416.gamess (max) -12.50% 680.000 595.000 - -87.62% -
456.hmmer (max) (percentage) -12.50% 1.920 1.680 - -97.72% -
444.namd (max) (percentage) -12.48% 8.250 7.220 - -92.13% -
465.tonto (max) (percentage) -12.47% 3.850 3.370 - -82.55% -
436.cactusADM (max) (percentage) -12.46% 2.810 2.460 - -97.23% -
453.povray (max) (percentage) -12.40% 2.580 2.260 - -97.52% -
437.leslie3d (max) (percentage) -12.38% 3.150 2.760 - -83.35% -
433.milc (max) (percentage) -12.37% 2.830 2.480 - -97.27% -
444.namd (max) -12.34% 802.000 703.000 - 2.63% -
450.soplex (max) (percentage) -12.32% 2.110 1.850 - -98.08% -
454.calculix (max) -12.30% 797.000 699.000 - 1045.90% -
473.astar (max) (percentage) -12.24% 0.490 0.430 - -99.35% -
453.povray (max) -12.20% 164.000 144.000 - -71.14% -
437.leslie3d (max) -11.76% 459.000 405.000 - -79.00% -
456.hmmer (max) -11.76% 204.000 180.000 - -91.51% -
464.h264ref (max) -11.11% 63.000 56.000 - -98.21% -
464.h264ref (max) (percentage) -10.87% 0.460 0.410 - -99.24% -
416.gamess -10.82% 416.000 371.000 - -32.55% -
416.gamess (avg) -10.82% 416.000 371.000 - -32.55% -
401.bzip2 (max) (percentage) -10.71% 0.280 0.250 - -99.68% -
447.dealII (max) -10.71% 84.000 75.000 - -94.58% -
416.gamess (avg) (percentage) -10.71% 1.960 1.750 - -60.41% -
462.libquantum (max) -10.57% 123.000 110.000 - -20.29% -
434.zeusmp (max) -10.32% 310.000 278.000 - -86.47% -
462.libquantum (max) (percentage) -10.28% 1.070 0.960 - -99.03% -
434.zeusmp (max) (percentage) -10.18% 2.260 2.030 - -97.52% -
471.omnetpp (max) -10.17% 118.000 106.000 - -95.11% -
471.omnetpp (max) (percentage) -10.00% 1.100 0.990 - -98.76% -
447.dealII (max) (percentage) -9.78% 0.920 0.830 - -98.97% -
401.bzip2 (max) -9.76% 41.000 37.000 - -98.40% -
433.milc -9.76% 246.000 222.000 - 221.74% -
433.milc (avg) -9.76% 246.000 222.000 - 221.74% -
433.milc (avg) (percentage) -9.68% 1.860 1.680 - -72.23% -
465.tonto (max) -9.65% 311.000 281.000 - -86.70% -
429.mcf (max) -8.86% 79.000 72.000 - -94.55% -
429.mcf (max) (percentage) -8.70% 0.460 0.420 - -99.55% -
470.lbm (max) -8.38% 537.000 492.000 - -82.08% -
470.lbm (max) (percentage) -8.26% 4.360 4.000 - -94.48% -
447.dealII -7.89% 76.000 70.000 - -29.29% -
447.dealII (avg) -7.89% 76.000 70.000 - -29.29% -
447.dealII (avg) (percentage) -7.23% 0.830 0.770 - -86.66% -
464.h264ref -6.25% 48.000 45.000 - -84.64% -
464.h264ref (avg) -6.25% 48.000 45.000 - -84.64% -
464.h264ref (avg) (percentage) -5.71% 0.350 0.330 - -93.52% -
462.libquantum (avg) (percentage) -4.55% 0.440 0.420 - -94.52% -
453.povray (avg) (percentage) -4.17% 1.200 1.150 - -85.28% -
462.libquantum -4.00% 50.000 48.000 - 380.00% -
462.libquantum (avg) -4.00% 50.000 48.000 - 380.00% -
453.povray -3.95% 76.000 73.000 - 73.81% -
453.povray (avg) -3.95% 76.000 73.000 - 73.81% -
470.lbm -1.44% 209.000 206.000 - -13.81% -
470.lbm (avg) -1.44% 209.000 206.000 - -13.81% -
470.lbm (avg) (percentage) -1.18% 1.700 1.680 - -73.46% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
434.zeusmp 1.10% 152037.000 153713.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
454.calculix 35032.26% 62.000 21782.000 - 0.22% -
403.gcc 16035.71% 56.000 9036.000 - -0.47% -
462.libquantum 8127.14% 140.000 11518.000 - 0.04% -
482.sphinx3 3078.62% 945.000 30038.000 - 2.46% -
450.soplex 2740.92% 567.000 16108.000 - -0.09% -
444.namd 1204.69% 747.000 9746.000 - 0.15% -
429.mcf 1109.55% 1424.000 17224.000 - -0.13% -
453.povray 1068.01% 547.000 6389.000 - -0.02% -
433.milc 1052.30% 1151.000 13263.000 - 0.00% -
436.cactusADM 773.31% 2083.000 18191.000 - -0.03% -
400.perlbench 560.49% 1663.000 10984.000 - -0.17% -
434.zeusmp 446.30% 2514.000 13734.000 - -0.01% -
447.dealII 428.83% 1724.000 9117.000 - -0.45% -
401.bzip2 408.23% 2941.000 14947.000 - 0.21% -
471.omnetpp 295.23% 2724.000 10766.000 - 0.08% -
459.GemsFDTD 278.62% 6173.000 23372.000 - 0.26% -
456.hmmer 273.32% 2882.000 10759.000 - 0.96% -
470.lbm 225.24% 3788.000 12320.000 - -0.05% -
481.wrf 192.90% 5534.000 16209.000 - 0.11% -
483.xalancbmk 184.26% 3818.000 10853.000 - -0.22% -
473.astar 175.98% 5128.000 14152.000 - -0.15% -
410.bwaves 146.36% 5652.000 13924.000 - -1.90% -
464.h264ref 140.11% 5761.000 13833.000 - -0.07% -
445.gobmk 132.17% 5023.000 11662.000 - -0.19% -
435.gromacs 115.33% 7269.000 15652.000 - -0.08% -
458.sjeng 88.41% 7567.000 14257.000 - 0.04% -
416.gamess 70.52% 12465.000 21255.000 - -0.02% -
437.leslie3d 26.07% 11640.000 14675.000 - 0.57% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix 5550.00% 4.000 226.000 - -23.39% -
454.calculix (avg) 5550.00% 4.000 226.000 - -23.39% -
454.calculix (max) 1045.90% 61.000 699.000 - -12.30% -
482.sphinx3 629.73% 74.000 540.000 - 13.92% -
482.sphinx3 (avg) 629.73% 74.000 540.000 - 13.92% -
403.gcc 600.00% 4.000 28.000 - 16.67% -
403.gcc (avg) 600.00% 4.000 28.000 - 16.67% -
444.namd 475.00% 68.000 391.000 - -19.21% -
444.namd (avg) 475.00% 68.000 391.000 - -19.21% -
462.libquantum 380.00% 10.000 48.000 - -4.00% -
462.libquantum (avg) 380.00% 10.000 48.000 - -4.00% -
450.soplex 372.22% 36.000 170.000 - -17.48% -
450.soplex (avg) 372.22% 36.000 170.000 - -17.48% -
433.milc 221.74% 69.000 222.000 - -9.76% -
433.milc (avg) 221.74% 69.000 222.000 - -9.76% -
436.cactusADM 131.45% 124.000 287.000 - -13.29% -
436.cactusADM (avg) 131.45% 124.000 287.000 - -13.29% -
453.povray 73.81% 42.000 73.000 - -3.95% -
453.povray (avg) 73.81% 42.000 73.000 - -3.95% -
400.perlbench 39.05% 105.000 146.000 - 20.66% -
400.perlbench (avg) 39.05% 105.000 146.000 - 20.66% -
434.zeusmp 32.65% 147.000 195.000 - -13.72% -
434.zeusmp (avg) 32.65% 147.000 195.000 - -13.72% -
444.namd (max) 2.63% 685.000 703.000 - -12.34% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383416.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
465.tonto -23.70% 10941.000 8348.000 - 3.10% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) -100.00% 9655.710 0.040 - -96.33% -
454.calculix (unexplained diff vs previous) (percentage) -100.00% 37020.970 0.220 - -94.23% -
453.povray (unexplained diff vs previous) (percentage) -100.00% 1043.330 0.020 - -99.24% -
434.zeusmp (unexplained diff vs previous) (percentage) -100.00% 448.690 0.010 - -99.54% -
403.gcc (unexplained diff vs previous) (percentage) -100.00% 15435.710 0.480 - 20.00% -
450.soplex (unexplained diff vs previous) (percentage) -100.00% 2557.320 0.090 - -95.65% -
436.cactusADM (unexplained diff vs previous) (percentage) -100.00% 787.130 0.030 - -98.91% -
429.mcf (unexplained diff vs previous) (percentage) -99.99% 1305.690 0.130 - -69.77% -
444.namd (unexplained diff vs previous) (percentage) -99.99% 1118.610 0.150 - -98.03% -
453.povray (unexplained diff vs previous) -99.98% 5707.000 1.000 - -99.41% -
434.zeusmp (unexplained diff vs previous) -99.98% 11280.000 2.000 - -99.34% -
470.lbm (unexplained diff vs previous) (percentage) -99.98% 263.730 0.050 - -98.90% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.98% 391.300 0.080 - -92.86% -
416.gamess (unexplained diff vs previous) (percentage) -99.97% 62.730 0.020 - -99.35% -
400.perlbench (unexplained diff vs previous) (percentage) -99.97% 527.480 0.170 - -73.85% -
436.cactusADM (unexplained diff vs previous) -99.96% 16396.000 6.000 - -98.80% -
462.libquantum (unexplained diff vs previous) -99.96% 13518.000 5.000 - -96.00% -
458.sjeng (unexplained diff vs previous) (percentage) -99.96% 90.870 0.040 - -89.74% -
481.wrf (unexplained diff vs previous) (percentage) -99.95% 219.530 0.110 - -97.53% -
416.gamess (unexplained diff vs previous) -99.95% 7819.000 4.000 - -99.39% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.94% 368.340 0.210 - -22.22% -
464.h264ref (unexplained diff vs previous) (percentage) -99.94% 118.780 0.070 - -53.33% -
470.lbm (unexplained diff vs previous) -99.94% 9990.000 6.000 - -98.93% -
458.sjeng (unexplained diff vs previous) -99.93% 6876.000 5.000 - -91.07% -
473.astar (unexplained diff vs previous) (percentage) -99.92% 197.850 0.150 - -69.39% -
435.gromacs (unexplained diff vs previous) (percentage) -99.92% 96.680 0.080 - -97.04% -
471.omnetpp (unexplained diff vs previous) -99.92% 10659.000 9.000 - -92.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.91% 2759.050 2.400 - 12.15% -
450.soplex (unexplained diff vs previous) -99.90% 14500.000 14.000 - -95.80% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.90% 219.170 0.220 - -51.11% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.90% 250.410 0.260 - -84.88% -
447.dealII (unexplained diff vs previous) (percentage) -99.89% 407.020 0.450 - -22.41% -
429.mcf (unexplained diff vs previous) -99.88% 18593.000 23.000 - -69.33% -
464.h264ref (unexplained diff vs previous) -99.85% 6843.000 10.000 - -52.38% -
481.wrf (unexplained diff vs previous) -99.85% 12149.000 18.000 - -97.50% -
435.gromacs (unexplained diff vs previous) -99.83% 7028.000 12.000 - -97.16% -
445.gobmk (unexplained diff vs previous) (percentage) -99.83% 111.110 0.190 - -85.50% -
444.namd (unexplained diff vs previous) -99.82% 8356.000 15.000 - -97.98% -
454.calculix (unexplained diff vs previous) -99.80% 22953.000 47.000 - -94.32% -
473.astar (unexplained diff vs previous) -99.79% 10146.000 21.000 - -70.00% -
400.perlbench (unexplained diff vs previous) -99.78% 8772.000 19.000 - -73.24% -
401.bzip2 (unexplained diff vs previous) -99.71% 10833.000 31.000 - -24.39% -
483.xalancbmk (unexplained diff vs previous) -99.71% 8368.000 24.000 - -51.02% -
401.bzip2 (max) (percentage) -99.68% 78.650 0.250 - -10.71% -
456.hmmer (unexplained diff vs previous) (percentage) -99.66% 278.630 0.950 - -51.53% -
445.gobmk (unexplained diff vs previous) -99.61% 5581.000 22.000 - -85.62% -
459.GemsFDTD (unexplained diff vs previous) -99.61% 15458.000 61.000 - -84.83% -
429.mcf (max) (percentage) -99.55% 92.890 0.420 - -8.70% -
403.gcc (max) (percentage) -99.53% 99.360 0.470 - 17.50% -
483.xalancbmk (max) (percentage) -99.50% 68.670 0.340 - -24.44% -
403.gcc (unexplained diff vs previous) -99.50% 8644.000 43.000 - 19.44% -
447.dealII (unexplained diff vs previous) -99.42% 7017.000 41.000 - -22.64% -
473.astar (max) (percentage) -99.35% 66.430 0.430 - -12.24% -
400.perlbench (max) (percentage) -99.33% 84.060 0.560 - -60.84% -
458.sjeng (max) (percentage) -99.26% 47.610 0.350 - -14.63% -
464.h264ref (max) (percentage) -99.24% 54.290 0.410 - -10.87% -
462.libquantum (max) (percentage) -99.03% 98.970 0.960 - -10.28% -
447.dealII (max) (percentage) -98.97% 80.280 0.830 - -9.78% -
471.omnetpp (max) (percentage) -98.76% 79.650 0.990 - -10.00% -
456.hmmer (unexplained diff vs previous) -98.73% 8030.000 102.000 - -51.20% -
458.sjeng (max) -98.64% 3602.000 49.000 - -15.52% -
483.xalancbmk (max) -98.63% 2621.000 36.000 - -25.00% -
410.bwaves (unexplained diff vs previous) (percentage) -98.60% 137.900 1.930 - -34.58% -
401.bzip2 (max) -98.40% 2313.000 37.000 - -9.76% -
473.astar (max) -98.24% 3406.000 60.000 - -13.04% -
464.h264ref (max) -98.21% 3127.000 56.000 - -11.11% -
450.soplex (max) (percentage) -98.08% 96.240 1.850 - -12.32% -
459.GemsFDTD (max) (percentage) -98.01% 71.460 1.420 - -16.47% -
445.gobmk (max) (percentage) -97.80% 52.630 1.160 - -12.78% -
456.hmmer (max) (percentage) -97.72% 73.590 1.680 - -12.50% -
453.povray (max) (percentage) -97.52% 91.250 2.260 - -12.40% -
434.zeusmp (max) (percentage) -97.52% 81.770 2.030 - -10.18% -
482.sphinx3 (max) (percentage) -97.45% 96.500 2.460 - 17.14% -
433.milc (max) (percentage) -97.27% 90.750 2.480 - -12.37% -
482.sphinx3 (unexplained diff vs previous) -97.23% 26073.000 721.000 - 14.81% -
436.cactusADM (max) (percentage) -97.23% 88.730 2.460 - -12.46% -
437.leslie3d (unexplained diff vs previous) (percentage) -97.13% 19.880 0.570 - -81.37% -
454.calculix (max) (percentage) -96.78% 99.730 3.210 - -12.53% -
429.mcf (avg) (percentage) -96.74% 7.670 0.250 - -13.79% -
410.bwaves (unexplained diff vs previous) -96.55% 7794.000 269.000 - -35.65% -
437.leslie3d (unexplained diff vs previous) -96.41% 2314.000 83.000 - -81.39% -
403.gcc (avg) (percentage) -95.77% 7.320 0.310 - 14.81% -
473.astar (avg) (percentage) -95.67% 4.160 0.180 - -14.29% -
410.bwaves (max) (percentage) -95.65% 57.970 2.520 - -16.83% -
400.perlbench (max) -95.63% 1397.000 61.000 - -61.15% -
471.omnetpp (max) -95.11% 2169.000 106.000 - -10.17% -
435.gromacs (max) (percentage) -95.06% 49.160 2.430 - -12.59% -
445.gobmk (max) -94.89% 2643.000 135.000 - -12.90% -
481.wrf (max) (percentage) -94.83% 68.700 3.550 - -16.67% -
447.dealII (max) -94.58% 1384.000 75.000 - -10.71% -
429.mcf (max) -94.55% 1322.000 72.000 - -8.86% -
462.libquantum (avg) (percentage) -94.52% 7.660 0.420 - -4.55% -
470.lbm (max) (percentage) -94.48% 72.510 4.000 - -8.26% -
458.sjeng (avg) (percentage) -94.36% 3.190 0.180 - 20.00% -
464.h264ref (avg) (percentage) -93.52% 5.090 0.330 - -5.71% -
401.bzip2 (avg) (percentage) -93.07% 5.480 0.380 - 40.74% -
416.gamess (max) (percentage) -92.74% 38.550 2.800 - -12.50% -
459.GemsFDTD (max) -92.50% 4411.000 331.000 - -16.41% -
444.namd (max) (percentage) -92.13% 91.790 7.220 - -12.48% -
456.hmmer (max) -91.51% 2120.000 180.000 - -11.76% -
483.xalancbmk (avg) (percentage) -90.62% 6.500 0.610 - 60.53% -
458.sjeng -89.63% 241.000 25.000 - 19.05% -
458.sjeng (avg) -89.63% 241.000 25.000 - 19.05% -
435.gromacs (max) -89.36% 3573.000 380.000 - -12.64% -
410.bwaves (max) -89.32% 3276.000 350.000 - -18.60% -
473.astar -88.26% 213.000 25.000 - -13.79% -
473.astar (avg) -88.26% 213.000 25.000 - -13.79% -
471.omnetpp (avg) (percentage) -88.17% 8.200 0.970 - 27.63% -
416.gamess (max) -87.62% 4805.000 595.000 - -12.50% -
454.calculix (avg) (percentage) -87.03% 8.020 1.040 - -23.53% -
465.tonto (max) -86.70% 2112.000 281.000 - -9.65% -
447.dealII (avg) (percentage) -86.66% 5.770 0.770 - -7.23% -
459.GemsFDTD (avg) (percentage) -86.47% 5.840 0.790 - 14.49% -
434.zeusmp (max) -86.47% 2055.000 278.000 - -10.32% -
465.tonto (unexplained diff vs previous) -85.83% 1771.000 251.000 - -22.53% -
453.povray (avg) (percentage) -85.28% 7.810 1.150 - -4.17% -
481.wrf (max) -84.87% 3801.000 575.000 - -16.55% -
464.h264ref -84.64% 293.000 45.000 - -6.25% -
464.h264ref (avg) -84.64% 293.000 45.000 - -6.25% -
456.hmmer (avg) (percentage) -84.35% 4.410 0.690 - -18.82% -
450.soplex (avg) (percentage) -83.51% 6.430 1.060 - -17.19% -
445.gobmk (avg) (percentage) -83.38% 3.910 0.650 - -23.53% -
437.leslie3d (max) (percentage) -83.35% 16.580 2.760 - -12.38% -
465.tonto (max) (percentage) -82.55% 19.310 3.370 - -12.47% -
470.lbm (max) -82.08% 2746.000 492.000 - -8.38% -
465.tonto (unexplained diff vs previous) (percentage) -81.41% 16.190 3.010 - -24.75% -
400.perlbench (avg) (percentage) -79.06% 6.350 1.330 - 20.91% -
437.leslie3d (max) -79.00% 1929.000 405.000 - -11.76% -
482.sphinx3 (avg) (percentage) -77.30% 7.930 1.800 - 11.11% -
436.cactusADM (max) -75.81% 1848.000 447.000 - -12.52% -
434.zeusmp (avg) (percentage) -75.73% 5.850 1.420 - -13.94% -
481.wrf (avg) (percentage) -75.00% 6.240 1.560 - 1.30% -
436.cactusADM (avg) (percentage) -73.58% 5.980 1.580 - -13.19% -
470.lbm (avg) (percentage) -73.46% 6.330 1.680 - -1.18% -
483.xalancbmk -73.39% 248.000 66.000 - 60.98% -
483.xalancbmk (avg) -73.39% 248.000 66.000 - 60.98% -
433.milc (avg) (percentage) -72.23% 6.050 1.680 - -9.68% -
435.gromacs (avg) (percentage) -71.34% 5.060 1.450 - -14.20% -
453.povray (max) -71.14% 499.000 144.000 - -12.20% -
465.tonto -70.14% 365.000 109.000 - 6.86% -
465.tonto (avg) -70.14% 365.000 109.000 - 6.86% -
433.milc (max) -68.58% 1044.000 328.000 - -12.53% -
401.bzip2 -65.22% 161.000 56.000 - 40.00% -
401.bzip2 (avg) -65.22% 161.000 56.000 - 40.00% -
445.gobmk -61.73% 196.000 75.000 - -24.24% -
445.gobmk (avg) -61.73% 196.000 75.000 - -24.24% -
465.tonto (avg) (percentage) -60.78% 3.340 1.310 - 3.97% -
429.mcf -60.55% 109.000 43.000 - -14.00% -
429.mcf (avg) -60.55% 109.000 43.000 - -14.00% -
410.bwaves (avg) (percentage) -60.54% 4.410 1.740 - 11.54% -
416.gamess (avg) (percentage) -60.41% 4.420 1.750 - -10.71% -
444.namd (avg) (percentage) -56.40% 9.220 4.020 - -19.28% -
471.omnetpp -53.36% 223.000 104.000 - 28.40% -
471.omnetpp (avg) -53.36% 223.000 104.000 - 28.40% -
459.GemsFDTD -48.89% 360.000 184.000 - 15.00% -
459.GemsFDTD (avg) -48.89% 360.000 184.000 - 15.00% -
450.soplex (max) -45.50% 545.000 297.000 - -12.65% -
456.hmmer -41.73% 127.000 74.000 - -17.78% -
456.hmmer (avg) -41.73% 127.000 74.000 - -17.78% -
435.gromacs -38.42% 367.000 226.000 - -14.39% -
435.gromacs (avg) -38.42% 367.000 226.000 - -14.39% -
416.gamess -32.55% 550.000 371.000 - -10.82% -
416.gamess (avg) -32.55% 550.000 371.000 - -10.82% -
447.dealII -29.29% 99.000 70.000 - -7.89% -
447.dealII (avg) -29.29% 99.000 70.000 - -7.89% -
481.wrf -26.96% 345.000 252.000 - 1.20% -
481.wrf (avg) -26.96% 345.000 252.000 - 1.20% -
437.leslie3d (avg) (percentage) -25.57% 3.050 2.270 - -15.61% -
403.gcc (max) -23.64% 55.000 42.000 - 16.67% -
462.libquantum (max) -20.29% 138.000 110.000 - -10.57% -
482.sphinx3 (max) -18.99% 911.000 738.000 - 20.00% -
470.lbm -13.81% 239.000 206.000 - -1.44% -
470.lbm (avg) -13.81% 239.000 206.000 - -1.44% -
437.leslie3d -6.20% 355.000 333.000 - -15.05% -
437.leslie3d (avg) -6.20% 355.000 333.000 - -15.05% -
410.bwaves -2.81% 249.000 242.000 - 9.50% -
410.bwaves (avg) -2.81% 249.000 242.000 - 9.50% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)


Report Time: 0.37s
Name Current %
400.perlbench 10984.000 -
401.bzip2 14947.000 -
403.gcc 9036.000 -
410.bwaves 13924.000 -1.90%
416.gamess 21255.000 -
429.mcf 17224.000 -
433.milc 13263.000 -
434.zeusmp 13734.000 -
435.gromacs 15652.000 -
436.cactusADM 18191.000 -
437.leslie3d 14675.000 -
444.namd 9746.000 -
445.gobmk 11662.000 -
447.dealII 9117.000 -
450.soplex 16108.000 -
453.povray 6389.000 -
454.calculix 21782.000 -
456.hmmer 10759.000 -
458.sjeng 14257.000 -
459.GemsFDTD 23372.000 -
462.libquantum 11518.000 -
464.h264ref 13833.000 -
465.tonto 8348.000 3.10%
470.lbm 12320.000 -
471.omnetpp 10766.000 -
473.astar 14152.000 -
481.wrf 16209.000 -
482.sphinx3 30038.000 2.46%
483.xalancbmk 10853.000 -
Geometric Mean 13522.818 -
Name Current %
400.perlbench 892912.000 -
401.bzip2 44241.000 -
403.gcc 2446120.000 -
410.bwaves 16748.000 -
416.gamess 5732285.000 -
429.mcf 9123.000 -
433.milc 61222.000 -
434.zeusmp 153713.000 -
435.gromacs 500327.000 -
436.cactusADM 352867.000 -
437.leslie3d 59491.000 -
444.namd 188365.000 -
445.gobmk 1377606.000 -
447.dealII 312518.000 -
450.soplex 205068.000 -
453.povray 657755.000 -
454.calculix 845075.000 -
456.hmmer 108691.000 -
458.sjeng 104004.000 -
459.GemsFDTD 245040.000 -
462.libquantum 16117.000 -
464.h264ref 383416.000 -
465.tonto 1948611.000 -
470.lbm 9687.000 -
471.omnetpp 480176.000 -
473.astar 22944.000 -
481.wrf 1965892.000 -
482.sphinx3 112839.000 -
483.xalancbmk 2342986.000 -
Geometric Mean 223970.600 -
Name Current %
400.perlbench 146.000 20.66%
400.perlbench (avg) 146.000 20.66%
400.perlbench (avg) (percentage) 1.330 20.91%
400.perlbench (max) 61.000 -61.15%
400.perlbench (max) (percentage) 0.560 -60.84%
400.perlbench (unexplained diff vs previous) 19.000 -73.24%
400.perlbench (unexplained diff vs previous) (percentage) 0.170 -73.85%
401.bzip2 56.000 40.00%
401.bzip2 (avg) 56.000 40.00%
401.bzip2 (avg) (percentage) 0.380 40.74%
401.bzip2 (max) 37.000 -9.76%
401.bzip2 (max) (percentage) 0.250 -10.71%
401.bzip2 (unexplained diff vs previous) 31.000 -24.39%
401.bzip2 (unexplained diff vs previous) (percentage) 0.210 -22.22%
403.gcc 28.000 16.67%
403.gcc (avg) 28.000 16.67%
403.gcc (avg) (percentage) 0.310 14.81%
403.gcc (max) 42.000 16.67%
403.gcc (max) (percentage) 0.470 17.50%
403.gcc (unexplained diff vs previous) 43.000 19.44%
403.gcc (unexplained diff vs previous) (percentage) 0.480 20.00%
410.bwaves 242.000 9.50%
410.bwaves (avg) 242.000 9.50%
410.bwaves (avg) (percentage) 1.740 11.54%
410.bwaves (max) 350.000 -18.60%
410.bwaves (max) (percentage) 2.520 -16.83%
410.bwaves (unexplained diff vs previous) 269.000 -35.65%
410.bwaves (unexplained diff vs previous) (percentage) 1.930 -34.58%
416.gamess 371.000 -10.82%
416.gamess (avg) 371.000 -10.82%
416.gamess (avg) (percentage) 1.750 -10.71%
416.gamess (max) 595.000 -12.50%
416.gamess (max) (percentage) 2.800 -12.50%
416.gamess (unexplained diff vs previous) 4.000 -99.39%
416.gamess (unexplained diff vs previous) (percentage) 0.020 -99.35%
429.mcf 43.000 -14.00%
429.mcf (avg) 43.000 -14.00%
429.mcf (avg) (percentage) 0.250 -13.79%
429.mcf (max) 72.000 -8.86%
429.mcf (max) (percentage) 0.420 -8.70%
429.mcf (unexplained diff vs previous) 23.000 -69.33%
429.mcf (unexplained diff vs previous) (percentage) 0.130 -69.77%
433.milc 222.000 -9.76%
433.milc (avg) 222.000 -9.76%
433.milc (avg) (percentage) 1.680 -9.68%
433.milc (max) 328.000 -12.53%
433.milc (max) (percentage) 2.480 -12.37%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
434.zeusmp 195.000 -13.72%
434.zeusmp (avg) 195.000 -13.72%
434.zeusmp (avg) (percentage) 1.420 -13.94%
434.zeusmp (max) 278.000 -10.32%
434.zeusmp (max) (percentage) 2.030 -10.18%
434.zeusmp (unexplained diff vs previous) 2.000 -99.34%
434.zeusmp (unexplained diff vs previous) (percentage) 0.010 -99.54%
435.gromacs 226.000 -14.39%
435.gromacs (avg) 226.000 -14.39%
435.gromacs (avg) (percentage) 1.450 -14.20%
435.gromacs (max) 380.000 -12.64%
435.gromacs (max) (percentage) 2.430 -12.59%
435.gromacs (unexplained diff vs previous) 12.000 -97.16%
435.gromacs (unexplained diff vs previous) (percentage) 0.080 -97.04%
436.cactusADM 287.000 -13.29%
436.cactusADM (avg) 287.000 -13.29%
436.cactusADM (avg) (percentage) 1.580 -13.19%
436.cactusADM (max) 447.000 -12.52%
436.cactusADM (max) (percentage) 2.460 -12.46%
436.cactusADM (unexplained diff vs previous) 6.000 -98.80%
436.cactusADM (unexplained diff vs previous) (percentage) 0.030 -98.91%
437.leslie3d 333.000 -15.05%
437.leslie3d (avg) 333.000 -15.05%
437.leslie3d (avg) (percentage) 2.270 -15.61%
437.leslie3d (max) 405.000 -11.76%
437.leslie3d (max) (percentage) 2.760 -12.38%
437.leslie3d (unexplained diff vs previous) 83.000 -81.39%
437.leslie3d (unexplained diff vs previous) (percentage) 0.570 -81.37%
444.namd 391.000 -19.21%
444.namd (avg) 391.000 -19.21%
444.namd (avg) (percentage) 4.020 -19.28%
444.namd (max) 703.000 -12.34%
444.namd (max) (percentage) 7.220 -12.48%
444.namd (unexplained diff vs previous) 15.000 -97.98%
444.namd (unexplained diff vs previous) (percentage) 0.150 -98.03%
445.gobmk 75.000 -24.24%
445.gobmk (avg) 75.000 -24.24%
445.gobmk (avg) (percentage) 0.650 -23.53%
445.gobmk (max) 135.000 -12.90%
445.gobmk (max) (percentage) 1.160 -12.78%
445.gobmk (unexplained diff vs previous) 22.000 -85.62%
445.gobmk (unexplained diff vs previous) (percentage) 0.190 -85.50%
447.dealII 70.000 -7.89%
447.dealII (avg) 70.000 -7.89%
447.dealII (avg) (percentage) 0.770 -7.23%
447.dealII (max) 75.000 -10.71%
447.dealII (max) (percentage) 0.830 -9.78%
447.dealII (unexplained diff vs previous) 41.000 -22.64%
447.dealII (unexplained diff vs previous) (percentage) 0.450 -22.41%
450.soplex 170.000 -17.48%
450.soplex (avg) 170.000 -17.48%
450.soplex (avg) (percentage) 1.060 -17.19%
450.soplex (max) 297.000 -12.65%
450.soplex (max) (percentage) 1.850 -12.32%
450.soplex (unexplained diff vs previous) 14.000 -95.80%
450.soplex (unexplained diff vs previous) (percentage) 0.090 -95.65%
453.povray 73.000 -3.95%
453.povray (avg) 73.000 -3.95%
453.povray (avg) (percentage) 1.150 -4.17%
453.povray (max) 144.000 -12.20%
453.povray (max) (percentage) 2.260 -12.40%
453.povray (unexplained diff vs previous) 1.000 -99.41%
453.povray (unexplained diff vs previous) (percentage) 0.020 -99.24%
454.calculix 226.000 -23.39%
454.calculix (avg) 226.000 -23.39%
454.calculix (avg) (percentage) 1.040 -23.53%
454.calculix (max) 699.000 -12.30%
454.calculix (max) (percentage) 3.210 -12.53%
454.calculix (unexplained diff vs previous) 47.000 -94.32%
454.calculix (unexplained diff vs previous) (percentage) 0.220 -94.23%
456.hmmer 74.000 -17.78%
456.hmmer (avg) 74.000 -17.78%
456.hmmer (avg) (percentage) 0.690 -18.82%
456.hmmer (max) 180.000 -11.76%
456.hmmer (max) (percentage) 1.680 -12.50%
456.hmmer (unexplained diff vs previous) 102.000 -51.20%
456.hmmer (unexplained diff vs previous) (percentage) 0.950 -51.53%
458.sjeng 25.000 19.05%
458.sjeng (avg) 25.000 19.05%
458.sjeng (avg) (percentage) 0.180 20.00%
458.sjeng (max) 49.000 -15.52%
458.sjeng (max) (percentage) 0.350 -14.63%
458.sjeng (unexplained diff vs previous) 5.000 -91.07%
458.sjeng (unexplained diff vs previous) (percentage) 0.040 -89.74%
459.GemsFDTD 184.000 15.00%
459.GemsFDTD (avg) 184.000 15.00%
459.GemsFDTD (avg) (percentage) 0.790 14.49%
459.GemsFDTD (max) 331.000 -16.41%
459.GemsFDTD (max) (percentage) 1.420 -16.47%
459.GemsFDTD (unexplained diff vs previous) 61.000 -84.83%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.260 -84.88%
462.libquantum 48.000 -4.00%
462.libquantum (avg) 48.000 -4.00%
462.libquantum (avg) (percentage) 0.420 -4.55%
462.libquantum (max) 110.000 -10.57%
462.libquantum (max) (percentage) 0.960 -10.28%
462.libquantum (unexplained diff vs previous) 5.000 -96.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.040 -96.33%
464.h264ref 45.000 -6.25%
464.h264ref (avg) 45.000 -6.25%
464.h264ref (avg) (percentage) 0.330 -5.71%
464.h264ref (max) 56.000 -11.11%
464.h264ref (max) (percentage) 0.410 -10.87%
464.h264ref (unexplained diff vs previous) 10.000 -52.38%
464.h264ref (unexplained diff vs previous) (percentage) 0.070 -53.33%
465.tonto 109.000 6.86%
465.tonto (avg) 109.000 6.86%
465.tonto (avg) (percentage) 1.310 3.97%
465.tonto (max) 281.000 -9.65%
465.tonto (max) (percentage) 3.370 -12.47%
465.tonto (unexplained diff vs previous) 251.000 -22.53%
465.tonto (unexplained diff vs previous) (percentage) 3.010 -24.75%
470.lbm 206.000 -1.44%
470.lbm (avg) 206.000 -1.44%
470.lbm (avg) (percentage) 1.680 -1.18%
470.lbm (max) 492.000 -8.38%
470.lbm (max) (percentage) 4.000 -8.26%
470.lbm (unexplained diff vs previous) 6.000 -98.93%
470.lbm (unexplained diff vs previous) (percentage) 0.050 -98.90%
471.omnetpp 104.000 28.40%
471.omnetpp (avg) 104.000 28.40%
471.omnetpp (avg) (percentage) 0.970 27.63%
471.omnetpp (max) 106.000 -10.17%
471.omnetpp (max) (percentage) 0.990 -10.00%
471.omnetpp (unexplained diff vs previous) 9.000 -92.50%
471.omnetpp (unexplained diff vs previous) (percentage) 0.080 -92.86%
473.astar 25.000 -13.79%
473.astar (avg) 25.000 -13.79%
473.astar (avg) (percentage) 0.180 -14.29%
473.astar (max) 60.000 -13.04%
473.astar (max) (percentage) 0.430 -12.24%
473.astar (unexplained diff vs previous) 21.000 -70.00%
473.astar (unexplained diff vs previous) (percentage) 0.150 -69.39%
481.wrf 252.000 1.20%
481.wrf (avg) 252.000 1.20%
481.wrf (avg) (percentage) 1.560 1.30%
481.wrf (max) 575.000 -16.55%
481.wrf (max) (percentage) 3.550 -16.67%
481.wrf (unexplained diff vs previous) 18.000 -97.50%
481.wrf (unexplained diff vs previous) (percentage) 0.110 -97.53%
482.sphinx3 540.000 13.92%
482.sphinx3 (avg) 540.000 13.92%
482.sphinx3 (avg) (percentage) 1.800 11.11%
482.sphinx3 (max) 738.000 20.00%
482.sphinx3 (max) (percentage) 2.460 17.14%
482.sphinx3 (unexplained diff vs previous) 721.000 14.81%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.400 12.15%
483.xalancbmk 66.000 60.98%
483.xalancbmk (avg) 66.000 60.98%
483.xalancbmk (avg) (percentage) 0.610 60.53%
483.xalancbmk (max) 36.000 -25.00%
483.xalancbmk (max) (percentage) 0.340 -24.44%
483.xalancbmk (unexplained diff vs previous) 24.000 -51.02%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.220 -51.11%
Geometric Mean 9.119 -54.13%