Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8e72ee1de8df0789c0ac593467d34387af388c83 (+ 57 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/bd93ef7f1a178079c6cdaccdf953f79a3365b028 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=14126ff059e98e9236633741fd323a1116299872 (+ 18 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=44ec516fcb54477932225f71261c39cad7f532af (+ 230 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/82/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0082 (3-changed-components) 2023-07-22T22:13:59 0:00:00
Previous 0079 (3-changed-components) 2023-07-16T20:27:39 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 48 14
Performance Improvements 138 197
Added Tests 4 4
Unchanged Tests 1046 1021
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 5.26% 57.000 60.000 - 7.14% -
454.calculix 3.28% 61.000 63.000 - 1.61% -
429.mcf 1.43% 1396.000 1416.000 - -0.56% -
435.gromacs 1.39% 7217.000 7317.000 - 0.66% -
444.namd 1.35% 741.000 751.000 - 0.54% -
482.sphinx3 1.19% 926.000 937.000 - -0.85% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) 933.33% 0.030 0.310 - -99.89% -
456.hmmer (unexplained diff vs previous) 800.00% 1.000 9.000 - -99.89% -
435.gromacs (unexplained diff vs previous) (percentage) 621.05% 0.190 1.370 - -98.58% -
435.gromacs (unexplained diff vs previous) 614.29% 14.000 100.000 - -98.58% -
433.milc (unexplained diff vs previous) (percentage) 570.59% 0.170 1.140 - -99.88% -
434.zeusmp (unexplained diff vs previous) 566.67% 3.000 20.000 - -99.82% -
434.zeusmp (unexplained diff vs previous) (percentage) 558.33% 0.120 0.790 - -99.82% -
433.milc (unexplained diff vs previous) 550.00% 2.000 13.000 - -99.88% -
429.mcf (unexplained diff vs previous) 300.00% 5.000 20.000 - -99.89% -
433.milc (max) 300.00% 3.000 12.000 - -98.85% -
429.mcf (unexplained diff vs previous) (percentage) 291.67% 0.360 1.410 - -99.89% -
433.milc (max) (percentage) 264.52% 0.310 1.130 - -98.75% -
450.soplex (unexplained diff vs previous) (percentage) 239.22% 0.510 1.730 - -99.93% -
450.soplex (unexplained diff vs previous) 233.33% 3.000 10.000 - -99.93% -
416.gamess (unexplained diff vs previous) 200.00% 7.000 21.000 - -99.73% -
416.gamess (unexplained diff vs previous) (percentage) 183.33% 0.060 0.170 - -99.73% -
416.gamess (max) 162.50% 8.000 21.000 - -99.56% -
416.gamess (max) (percentage) 142.86% 0.070 0.170 - -99.56% -
453.povray (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.96% -
453.povray (unexplained diff vs previous) (percentage) 100.00% 0.180 0.360 - -99.97% -
454.calculix (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.99% -
458.sjeng (unexplained diff vs previous) 100.00% 5.000 10.000 - -99.85% -
454.calculix (unexplained diff vs previous) (percentage) 93.29% 1.640 3.170 - -99.99% -
458.sjeng (unexplained diff vs previous) (percentage) 85.71% 0.070 0.130 - -99.86% -
444.namd (max) 66.67% 6.000 10.000 - -98.54% -
429.mcf (max) 53.85% 13.000 20.000 - -98.49% -
429.mcf (max) (percentage) 50.53% 0.950 1.430 - -98.46% -
444.namd (max) (percentage) 43.62% 0.940 1.350 - -98.53% -
436.cactusADM (unexplained diff vs previous) 42.86% 7.000 10.000 - -99.94% -
444.namd (unexplained diff vs previous) 42.86% 7.000 10.000 - -99.88% -
436.cactusADM (unexplained diff vs previous) (percentage) 42.42% 0.330 0.470 - -99.94% -
444.namd (unexplained diff vs previous) (percentage) 41.49% 0.940 1.330 - -99.88% -
400.perlbench (unexplained diff vs previous) 40.00% 5.000 7.000 - -99.92% -
400.perlbench (unexplained diff vs previous) (percentage) 38.71% 0.310 0.430 - -99.92% -
435.gromacs (max) 24.69% 81.000 101.000 - -97.17% -
435.gromacs (max) (percentage) 23.01% 1.130 1.390 - -97.17% -
434.zeusmp (max) (percentage) 12.86% 0.700 0.790 - -99.03% -
434.zeusmp (max) 11.76% 17.000 19.000 - -99.08% -
445.gobmk (unexplained diff vs previous) (percentage) 3.95% 0.760 0.790 - -99.29% -
445.gobmk (unexplained diff vs previous) 2.56% 39.000 40.000 - -99.28% -
437.leslie3d (avg) (percentage) 1.64% 4.260 4.330 - 41.97% -
445.gobmk (max) (percentage) 1.30% 0.770 0.780 - -98.52% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d -6.71% 11705.000 10920.000 - -6.19% -
450.soplex -1.70% 587.000 577.000 - 1.76% -
483.xalancbmk -1.21% 3956.000 3908.000 - 2.36% -
433.milc -1.13% 1150.000 1137.000 - -1.22% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -76.19% 1.050 0.250 - -99.94% -
471.omnetpp (unexplained diff vs previous) -75.86% 29.000 7.000 - -99.93% -
473.astar (unexplained diff vs previous) (percentage) -71.64% 0.670 0.190 - -99.90% -
473.astar (unexplained diff vs previous) -71.43% 35.000 10.000 - -99.90% -
483.xalancbmk (unexplained diff vs previous) -66.90% 145.000 48.000 - -99.43% -
483.xalancbmk (unexplained diff vs previous) (percentage) -66.49% 3.670 1.230 - -99.44% -
464.h264ref (unexplained diff vs previous) (percentage) -66.07% 0.560 0.190 - -99.84% -
464.h264ref (unexplained diff vs previous) -65.62% 32.000 11.000 - -99.84% -
401.bzip2 (unexplained diff vs previous) (percentage) -62.07% 0.870 0.330 - -99.91% -
401.bzip2 (unexplained diff vs previous) -61.54% 26.000 10.000 - -99.91% -
470.lbm (unexplained diff vs previous) -55.56% 18.000 8.000 - -99.92% -
470.lbm (unexplained diff vs previous) (percentage) -55.32% 0.470 0.210 - -99.92% -
482.sphinx3 (unexplained diff vs previous) (percentage) -39.69% 1.940 1.170 - -99.96% -
482.sphinx3 (unexplained diff vs previous) -38.89% 18.000 11.000 - -99.96% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -33.78% 0.740 0.490 - -99.80% -
459.GemsFDTD (unexplained diff vs previous) -33.33% 45.000 30.000 - -99.81% -
462.libquantum -25.00% 4.000 3.000 - -70.00% -
462.libquantum (avg) -25.00% 4.000 3.000 - -70.00% -
437.leslie3d (max) -22.39% 1023.000 794.000 - -58.84% -
465.tonto (max) -17.86% 84.000 69.000 - -96.73% -
465.tonto (unexplained diff vs previous) -17.86% 84.000 69.000 - -96.10% -
470.lbm (max) -17.65% 17.000 14.000 - -99.49% -
465.tonto (max) (percentage) -17.11% 0.760 0.630 - -96.74% -
465.tonto (unexplained diff vs previous) (percentage) -17.11% 0.760 0.630 - -96.11% -
470.lbm (max) (percentage) -17.02% 0.470 0.390 - -99.46% -
437.leslie3d (max) (percentage) -16.70% 8.740 7.280 - -56.09% -
437.leslie3d (unexplained diff vs previous) -16.58% 941.000 785.000 - -66.08% -
459.GemsFDTD (max) (percentage) -16.44% 0.730 0.610 - -99.15% -
459.GemsFDTD (max) -15.91% 44.000 37.000 - -99.16% -
447.dealII (unexplained diff vs previous) (percentage) -14.63% 0.410 0.350 - -99.91% -
447.dealII (unexplained diff vs previous) -14.29% 7.000 6.000 - -99.91% -
462.libquantum (max) (percentage) -12.68% 1.420 1.240 - -98.75% -
410.bwaves (max) -11.43% 35.000 31.000 - -99.05% -
453.povray (max) -11.11% 9.000 8.000 - -98.40% -
473.astar (max) -11.11% 54.000 48.000 - -98.59% -
410.bwaves (max) (percentage) -11.11% 0.630 0.560 - -99.03% -
437.leslie3d (unexplained diff vs previous) (percentage) -10.57% 8.040 7.190 - -63.83% -
436.cactusADM (max) -10.00% 10.000 9.000 - -99.51% -
473.astar (max) (percentage) -9.62% 1.040 0.940 - -98.58% -
464.h264ref (max) -9.38% 32.000 29.000 - -99.07% -
450.soplex (max) -9.09% 11.000 10.000 - -98.17% -
458.sjeng (max) -9.09% 11.000 10.000 - -99.72% -
456.hmmer (max) -8.33% 12.000 11.000 - -99.48% -
401.bzip2 (max) (percentage) -7.95% 0.880 0.810 - -98.97% -
471.omnetpp (max) -7.94% 63.000 58.000 - -97.33% -
401.bzip2 (max) -7.69% 26.000 24.000 - -98.96% -
471.omnetpp (max) (percentage) -7.46% 2.280 2.110 - -97.35% -
482.sphinx3 (max) (percentage) -7.33% 1.910 1.770 - -98.17% -
464.h264ref (max) (percentage) -7.14% 0.560 0.520 - -99.04% -
450.soplex (max) (percentage) -6.81% 1.910 1.780 - -98.15% -
453.povray -6.67% 15.000 14.000 - -66.67% -
453.povray (avg) -6.67% 15.000 14.000 - -66.67% -
450.soplex -5.88% 17.000 16.000 - -55.56% -
450.soplex (avg) -5.88% 17.000 16.000 - -55.56% -
482.sphinx3 (max) -5.88% 17.000 16.000 - -98.24% -
437.leslie3d -5.22% 498.000 472.000 - 32.96% -
437.leslie3d (avg) -5.22% 498.000 472.000 - 32.96% -
483.xalancbmk (max) -4.88% 205.000 195.000 - -92.56% -
453.povray (max) (percentage) -4.79% 1.670 1.590 - -98.26% -
447.dealII (max) (percentage) -4.19% 1.670 1.600 - -98.01% -
400.perlbench (max) -4.08% 49.000 47.000 - -96.64% -
483.xalancbmk (max) (percentage) -3.85% 5.200 5.000 - -92.72% -
481.wrf (max) (percentage) -3.70% 1.080 1.040 - -98.49% -
483.xalancbmk -3.70% 135.000 130.000 - -47.58% -
483.xalancbmk (avg) -3.70% 135.000 130.000 - -47.58% -
481.wrf -3.60% 139.000 134.000 - -61.16% -
481.wrf (avg) -3.60% 139.000 134.000 - -61.16% -
400.perlbench (max) (percentage) -3.59% 3.060 2.950 - -96.49% -
447.dealII (max) -3.57% 28.000 27.000 - -98.05% -
481.wrf (max) -3.39% 59.000 57.000 - -98.50% -
465.tonto -3.09% 194.000 188.000 - -48.49% -
465.tonto (avg) -3.09% 194.000 188.000 - -48.49% -
454.calculix (max) (percentage) -3.08% 3.900 3.780 - -96.21% -
416.gamess (avg) (percentage) -3.03% 1.320 1.280 - -71.04% -
458.sjeng -3.03% 99.000 96.000 - -60.17% -
458.sjeng (avg) -3.03% 99.000 96.000 - -60.17% -
447.dealII (avg) (percentage) -2.92% 2.400 2.330 - -59.62% -
401.bzip2 -2.90% 69.000 67.000 - -58.39% -
401.bzip2 (avg) -2.90% 69.000 67.000 - -58.39% -
400.perlbench (avg) (percentage) -2.89% 3.110 3.020 - -52.44% -
453.povray (avg) (percentage) -2.87% 2.790 2.710 - -65.30% -
481.wrf (avg) (percentage) -2.78% 2.520 2.450 - -60.74% -
464.h264ref -2.73% 110.000 107.000 - -63.48% -
464.h264ref (avg) -2.73% 110.000 107.000 - -63.48% -
473.astar -2.63% 114.000 111.000 - -47.89% -
473.astar (avg) -2.63% 114.000 111.000 - -47.89% -
456.hmmer (avg) (percentage) -2.61% 1.530 1.490 - -66.21% -
401.bzip2 (avg) (percentage) -2.60% 2.310 2.250 - -58.94% -
464.h264ref (avg) (percentage) -2.59% 1.930 1.880 - -63.06% -
445.gobmk -2.53% 79.000 77.000 - -60.71% -
445.gobmk (avg) -2.53% 79.000 77.000 - -60.71% -
416.gamess -2.45% 163.000 159.000 - -71.09% -
416.gamess (avg) -2.45% 163.000 159.000 - -71.09% -
447.dealII -2.44% 41.000 40.000 - -59.60% -
447.dealII (avg) -2.44% 41.000 40.000 - -59.60% -
462.libquantum (avg) (percentage) -2.40% 2.920 2.850 - -62.79% -
456.hmmer (max) (percentage) -2.38% 0.420 0.410 - -99.44% -
470.lbm -2.38% 84.000 82.000 - -65.69% -
470.lbm (avg) -2.38% 84.000 82.000 - -65.69% -
465.tonto (avg) (percentage) -2.29% 1.750 1.710 - -48.80% -
473.astar (avg) (percentage) -2.27% 2.200 2.150 - -48.32% -
410.bwaves (avg) (percentage) -2.27% 1.760 1.720 - -61.00% -
458.sjeng (avg) (percentage) -2.27% 1.320 1.290 - -59.56% -
456.hmmer -2.27% 44.000 43.000 - -66.14% -
456.hmmer (avg) -2.27% 44.000 43.000 - -66.14% -
459.GemsFDTD (avg) (percentage) -2.25% 2.220 2.170 - -62.84% -
471.omnetpp -2.11% 95.000 93.000 - -58.30% -
471.omnetpp (avg) -2.11% 95.000 93.000 - -58.30% -
436.cactusADM (max) (percentage) -2.08% 0.480 0.470 - -99.47% -
483.xalancbmk (avg) (percentage) -2.05% 3.420 3.350 - -48.46% -
471.omnetpp (avg) (percentage) -2.03% 3.440 3.370 - -58.90% -
410.bwaves -2.02% 99.000 97.000 - -61.04% -
410.bwaves (avg) -2.02% 99.000 97.000 - -61.04% -
400.perlbench -2.00% 50.000 49.000 - -53.33% -
400.perlbench (avg) -2.00% 50.000 49.000 - -53.33% -
429.mcf (avg) (percentage) -1.93% 6.750 6.620 - -13.69% -
434.zeusmp -1.89% 53.000 52.000 - -64.63% -
434.zeusmp (avg) -1.89% 53.000 52.000 - -64.63% -
403.gcc (max) (percentage) -1.86% 8.060 7.910 - -92.04% -
436.cactusADM -1.85% 54.000 53.000 - -57.26% -
436.cactusADM (avg) -1.85% 54.000 53.000 - -57.26% -
470.lbm (avg) (percentage) -1.82% 2.200 2.160 - -65.88% -
482.sphinx3 (avg) (percentage) -1.62% 3.080 3.030 - -61.79% -
436.cactusADM (avg) (percentage) -1.55% 2.580 2.540 - -57.53% -
459.GemsFDTD -1.48% 135.000 133.000 - -63.06% -
459.GemsFDTD (avg) -1.48% 135.000 133.000 - -63.06% -
434.zeusmp (avg) (percentage) -1.42% 2.120 2.090 - -64.27% -
444.namd (avg) (percentage) -1.36% 2.950 2.910 - -68.44% -
450.soplex (avg) (percentage) -1.36% 2.950 2.910 - -54.74% -
445.gobmk (avg) (percentage) -1.29% 1.550 1.530 - -60.87% -
433.milc (avg) (percentage) -1.28% 2.340 2.310 - -61.82% -
435.gromacs (avg) (percentage) -1.18% 2.540 2.510 - -50.40% -
429.mcf -1.06% 94.000 93.000 - -14.68% -
429.mcf (avg) -1.06% 94.000 93.000 - -14.68% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 1.06% 387748.000 391872.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 7.14% 56.000 60.000 - 5.26% -
483.xalancbmk 2.36% 3818.000 3908.000 - -1.21% -
401.bzip2 2.24% 2941.000 3007.000 - 0.33% -
450.soplex 1.76% 567.000 577.000 - -1.70% -
436.cactusADM 1.68% 2083.000 2118.000 - 0.47% -
454.calculix 1.61% 62.000 63.000 - 3.28% -
456.hmmer 1.53% 2882.000 2926.000 - -0.31% -
473.astar 1.50% 5128.000 5205.000 - -0.19% -
471.omnetpp 1.43% 2724.000 2763.000 - -0.25% -
445.gobmk 1.02% 5023.000 5074.000 - -0.78% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d (avg) (percentage) 41.97% 3.050 4.330 - 1.64% -
437.leslie3d 32.96% 355.000 472.000 - -5.22% -
437.leslie3d (avg) 32.96% 355.000 472.000 - -5.22% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -6.19% 11640.000 10920.000 - -6.71% -
400.perlbench -2.41% 1663.000 1623.000 - 0.43% -
433.milc -1.22% 1151.000 1137.000 - -1.13% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
454.calculix (unexplained diff vs previous) (percentage) -99.99% 37020.970 3.170 - 93.29% -
454.calculix (unexplained diff vs previous) -99.99% 22953.000 2.000 - 100.00% -
453.povray (unexplained diff vs previous) (percentage) -99.97% 1043.330 0.360 - 100.00% -
453.povray (unexplained diff vs previous) -99.96% 5707.000 2.000 - 100.00% -
482.sphinx3 (unexplained diff vs previous) -99.96% 26073.000 11.000 - -38.89% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.96% 2759.050 1.170 - -39.69% -
436.cactusADM (unexplained diff vs previous) (percentage) -99.94% 787.130 0.470 - 42.42% -
436.cactusADM (unexplained diff vs previous) -99.94% 16396.000 10.000 - 42.86% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.94% 391.300 0.250 - -76.19% -
471.omnetpp (unexplained diff vs previous) -99.93% 10659.000 7.000 - -75.86% -
450.soplex (unexplained diff vs previous) (percentage) -99.93% 2557.320 1.730 - 239.22% -
450.soplex (unexplained diff vs previous) -99.93% 14500.000 10.000 - 233.33% -
470.lbm (unexplained diff vs previous) (percentage) -99.92% 263.730 0.210 - -55.32% -
400.perlbench (unexplained diff vs previous) -99.92% 8772.000 7.000 - 40.00% -
470.lbm (unexplained diff vs previous) -99.92% 9990.000 8.000 - -55.56% -
400.perlbench (unexplained diff vs previous) (percentage) -99.92% 527.480 0.430 - 38.71% -
447.dealII (unexplained diff vs previous) -99.91% 7017.000 6.000 - -14.29% -
447.dealII (unexplained diff vs previous) (percentage) -99.91% 407.020 0.350 - -14.63% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.91% 368.340 0.330 - -62.07% -
401.bzip2 (unexplained diff vs previous) -99.91% 10833.000 10.000 - -61.54% -
473.astar (unexplained diff vs previous) (percentage) -99.90% 197.850 0.190 - -71.64% -
473.astar (unexplained diff vs previous) -99.90% 10146.000 10.000 - -71.43% -
429.mcf (unexplained diff vs previous) -99.89% 18593.000 20.000 - 300.00% -
429.mcf (unexplained diff vs previous) (percentage) -99.89% 1305.690 1.410 - 291.67% -
456.hmmer (unexplained diff vs previous) (percentage) -99.89% 278.630 0.310 - 933.33% -
456.hmmer (unexplained diff vs previous) -99.89% 8030.000 9.000 - 800.00% -
433.milc (unexplained diff vs previous) -99.88% 11289.000 13.000 - 550.00% -
433.milc (unexplained diff vs previous) (percentage) -99.88% 980.800 1.140 - 570.59% -
444.namd (unexplained diff vs previous) (percentage) -99.88% 1118.610 1.330 - 41.49% -
444.namd (unexplained diff vs previous) -99.88% 8356.000 10.000 - 42.86% -
458.sjeng (unexplained diff vs previous) (percentage) -99.86% 90.870 0.130 - 85.71% -
458.sjeng (unexplained diff vs previous) -99.85% 6876.000 10.000 - 100.00% -
464.h264ref (unexplained diff vs previous) (percentage) -99.84% 118.780 0.190 - -66.07% -
464.h264ref (unexplained diff vs previous) -99.84% 6843.000 11.000 - -65.62% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.82% 448.690 0.790 - 558.33% -
434.zeusmp (unexplained diff vs previous) -99.82% 11280.000 20.000 - 566.67% -
459.GemsFDTD (unexplained diff vs previous) -99.81% 15458.000 30.000 - -33.33% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.80% 250.410 0.490 - -33.78% -
481.wrf (unexplained diff vs previous) (percentage) -99.80% 219.530 0.450 - 0.00% -
481.wrf (unexplained diff vs previous) -99.79% 12149.000 25.000 - 0.00% -
416.gamess (unexplained diff vs previous) -99.73% 7819.000 21.000 - 200.00% -
416.gamess (unexplained diff vs previous) (percentage) -99.73% 62.730 0.170 - 183.33% -
458.sjeng (max) -99.72% 3602.000 10.000 - -9.09% -
458.sjeng (max) (percentage) -99.71% 47.610 0.140 - -6.67% -
416.gamess (max) -99.56% 4805.000 21.000 - 162.50% -
416.gamess (max) (percentage) -99.56% 38.550 0.170 - 142.86% -
436.cactusADM (max) -99.51% 1848.000 9.000 - -10.00% -
470.lbm (max) -99.49% 2746.000 14.000 - -17.65% -
456.hmmer (max) -99.48% 2120.000 11.000 - -8.33% -
436.cactusADM (max) (percentage) -99.47% 88.730 0.470 - -2.08% -
470.lbm (max) (percentage) -99.46% 72.510 0.390 - -17.02% -
456.hmmer (max) (percentage) -99.44% 73.590 0.410 - -2.38% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.44% 219.170 1.230 - -66.49% -
483.xalancbmk (unexplained diff vs previous) -99.43% 8368.000 48.000 - -66.90% -
445.gobmk (unexplained diff vs previous) (percentage) -99.29% 111.110 0.790 - 3.95% -
445.gobmk (unexplained diff vs previous) -99.28% 5581.000 40.000 - 2.56% -
462.libquantum (max) -99.28% 138.000 1.000 - 0.00% -
459.GemsFDTD (max) -99.16% 4411.000 37.000 - -15.91% -
459.GemsFDTD (max) (percentage) -99.15% 71.460 0.610 - -16.44% -
434.zeusmp (max) -99.08% 2055.000 19.000 - 11.76% -
464.h264ref (max) -99.07% 3127.000 29.000 - -9.38% -
410.bwaves (max) -99.05% 3276.000 31.000 - -11.43% -
464.h264ref (max) (percentage) -99.04% 54.290 0.520 - -7.14% -
410.bwaves (max) (percentage) -99.03% 57.970 0.560 - -11.11% -
434.zeusmp (max) (percentage) -99.03% 81.770 0.790 - 12.86% -
401.bzip2 (max) (percentage) -98.97% 78.650 0.810 - -7.95% -
401.bzip2 (max) -98.96% 2313.000 24.000 - -7.69% -
433.milc (max) -98.85% 1044.000 12.000 - 300.00% -
433.milc (max) (percentage) -98.75% 90.750 1.130 - 264.52% -
462.libquantum (max) (percentage) -98.75% 98.970 1.240 - -12.68% -
473.astar (max) -98.59% 3406.000 48.000 - -11.11% -
473.astar (max) (percentage) -98.58% 66.430 0.940 - -9.62% -
435.gromacs (unexplained diff vs previous) (percentage) -98.58% 96.680 1.370 - 621.05% -
435.gromacs (unexplained diff vs previous) -98.58% 7028.000 100.000 - 614.29% -
444.namd (max) -98.54% 685.000 10.000 - 66.67% -
444.namd (max) (percentage) -98.53% 91.790 1.350 - 43.62% -
445.gobmk (max) -98.52% 2643.000 39.000 - 0.00% -
445.gobmk (max) (percentage) -98.52% 52.630 0.780 - 1.30% -
481.wrf (max) -98.50% 3801.000 57.000 - -3.39% -
429.mcf (max) -98.49% 1322.000 20.000 - 53.85% -
481.wrf (max) (percentage) -98.49% 68.700 1.040 - -3.70% -
429.mcf (max) (percentage) -98.46% 92.890 1.430 - 50.53% -
453.povray (max) -98.40% 499.000 8.000 - -11.11% -
453.povray (max) (percentage) -98.26% 91.250 1.590 - -4.79% -
482.sphinx3 (max) -98.24% 911.000 16.000 - -5.88% -
482.sphinx3 (max) (percentage) -98.17% 96.500 1.770 - -7.33% -
450.soplex (max) -98.17% 545.000 10.000 - -9.09% -
450.soplex (max) (percentage) -98.15% 96.240 1.780 - -6.81% -
447.dealII (max) -98.05% 1384.000 27.000 - -3.57% -
447.dealII (max) (percentage) -98.01% 80.280 1.600 - -4.19% -
471.omnetpp (max) (percentage) -97.35% 79.650 2.110 - -7.46% -
471.omnetpp (max) -97.33% 2169.000 58.000 - -7.94% -
435.gromacs (max) -97.17% 3573.000 101.000 - 24.69% -
435.gromacs (max) (percentage) -97.17% 49.160 1.390 - 23.01% -
465.tonto (max) (percentage) -96.74% 19.310 0.630 - -17.11% -
465.tonto (max) -96.73% 2112.000 69.000 - -17.86% -
454.calculix (max) -96.72% 61.000 2.000 - 0.00% -
400.perlbench (max) -96.64% 1397.000 47.000 - -4.08% -
400.perlbench (max) (percentage) -96.49% 84.060 2.950 - -3.59% -
454.calculix (max) (percentage) -96.21% 99.730 3.780 - -3.08% -
465.tonto (unexplained diff vs previous) (percentage) -96.11% 16.190 0.630 - -17.11% -
465.tonto (unexplained diff vs previous) -96.10% 1771.000 69.000 - -17.86% -
403.gcc (max) -92.73% 55.000 4.000 - 0.00% -
483.xalancbmk (max) (percentage) -92.72% 68.670 5.000 - -3.85% -
483.xalancbmk (max) -92.56% 2621.000 195.000 - -4.88% -
403.gcc (max) (percentage) -92.04% 99.360 7.910 - -1.86% -
416.gamess -71.09% 550.000 159.000 - -2.45% -
416.gamess (avg) -71.09% 550.000 159.000 - -2.45% -
416.gamess (avg) (percentage) -71.04% 4.420 1.280 - -3.03% -
462.libquantum -70.00% 10.000 3.000 - -25.00% -
462.libquantum (avg) -70.00% 10.000 3.000 - -25.00% -
444.namd -69.12% 68.000 21.000 - 0.00% -
444.namd (avg) -69.12% 68.000 21.000 - 0.00% -
444.namd (avg) (percentage) -68.44% 9.220 2.910 - -1.36% -
453.povray -66.67% 42.000 14.000 - -6.67% -
453.povray (avg) -66.67% 42.000 14.000 - -6.67% -
456.hmmer (avg) (percentage) -66.21% 4.410 1.490 - -2.61% -
456.hmmer -66.14% 127.000 43.000 - -2.27% -
456.hmmer (avg) -66.14% 127.000 43.000 - -2.27% -
437.leslie3d (unexplained diff vs previous) -66.08% 2314.000 785.000 - -16.58% -
470.lbm (avg) (percentage) -65.88% 6.330 2.160 - -1.82% -
470.lbm -65.69% 239.000 82.000 - -2.38% -
470.lbm (avg) -65.69% 239.000 82.000 - -2.38% -
453.povray (avg) (percentage) -65.30% 7.810 2.710 - -2.87% -
434.zeusmp -64.63% 147.000 52.000 - -1.89% -
434.zeusmp (avg) -64.63% 147.000 52.000 - -1.89% -
434.zeusmp (avg) (percentage) -64.27% 5.850 2.090 - -1.42% -
437.leslie3d (unexplained diff vs previous) (percentage) -63.83% 19.880 7.190 - -10.57% -
464.h264ref -63.48% 293.000 107.000 - -2.73% -
464.h264ref (avg) -63.48% 293.000 107.000 - -2.73% -
464.h264ref (avg) (percentage) -63.06% 5.090 1.880 - -2.59% -
459.GemsFDTD -63.06% 360.000 133.000 - -1.48% -
459.GemsFDTD (avg) -63.06% 360.000 133.000 - -1.48% -
459.GemsFDTD (avg) (percentage) -62.84% 5.840 2.170 - -2.25% -
462.libquantum (avg) (percentage) -62.79% 7.660 2.850 - -2.40% -
433.milc -62.32% 69.000 26.000 - 0.00% -
433.milc (avg) -62.32% 69.000 26.000 - 0.00% -
482.sphinx3 -62.16% 74.000 28.000 - 0.00% -
482.sphinx3 (avg) -62.16% 74.000 28.000 - 0.00% -
433.milc (avg) (percentage) -61.82% 6.050 2.310 - -1.28% -
482.sphinx3 (avg) (percentage) -61.79% 7.930 3.030 - -1.62% -
481.wrf -61.16% 345.000 134.000 - -3.60% -
481.wrf (avg) -61.16% 345.000 134.000 - -3.60% -
410.bwaves -61.04% 249.000 97.000 - -2.02% -
410.bwaves (avg) -61.04% 249.000 97.000 - -2.02% -
410.bwaves (avg) (percentage) -61.00% 4.410 1.720 - -2.27% -
445.gobmk (avg) (percentage) -60.87% 3.910 1.530 - -1.29% -
481.wrf (avg) (percentage) -60.74% 6.240 2.450 - -2.78% -
445.gobmk -60.71% 196.000 77.000 - -2.53% -
445.gobmk (avg) -60.71% 196.000 77.000 - -2.53% -
458.sjeng -60.17% 241.000 96.000 - -3.03% -
458.sjeng (avg) -60.17% 241.000 96.000 - -3.03% -
447.dealII (avg) (percentage) -59.62% 5.770 2.330 - -2.92% -
447.dealII -59.60% 99.000 40.000 - -2.44% -
447.dealII (avg) -59.60% 99.000 40.000 - -2.44% -
458.sjeng (avg) (percentage) -59.56% 3.190 1.290 - -2.27% -
401.bzip2 (avg) (percentage) -58.94% 5.480 2.250 - -2.60% -
471.omnetpp (avg) (percentage) -58.90% 8.200 3.370 - -2.03% -
437.leslie3d (max) -58.84% 1929.000 794.000 - -22.39% -
401.bzip2 -58.39% 161.000 67.000 - -2.90% -
401.bzip2 (avg) -58.39% 161.000 67.000 - -2.90% -
471.omnetpp -58.30% 223.000 93.000 - -2.11% -
471.omnetpp (avg) -58.30% 223.000 93.000 - -2.11% -
436.cactusADM (avg) (percentage) -57.53% 5.980 2.540 - -1.55% -
436.cactusADM -57.26% 124.000 53.000 - -1.85% -
436.cactusADM (avg) -57.26% 124.000 53.000 - -1.85% -
437.leslie3d (max) (percentage) -56.09% 16.580 7.280 - -16.70% -
450.soplex -55.56% 36.000 16.000 - -5.88% -
450.soplex (avg) -55.56% 36.000 16.000 - -5.88% -
450.soplex (avg) (percentage) -54.74% 6.430 2.910 - -1.36% -
400.perlbench -53.33% 105.000 49.000 - -2.00% -
400.perlbench (avg) -53.33% 105.000 49.000 - -2.00% -
400.perlbench (avg) (percentage) -52.44% 6.350 3.020 - -2.89% -
435.gromacs (avg) (percentage) -50.40% 5.060 2.510 - -1.18% -
435.gromacs -50.14% 367.000 183.000 - 0.00% -
435.gromacs (avg) -50.14% 367.000 183.000 - 0.00% -
454.calculix -50.00% 4.000 2.000 - 0.00% -
454.calculix (avg) -50.00% 4.000 2.000 - 0.00% -
465.tonto (avg) (percentage) -48.80% 3.340 1.710 - -2.29% -
465.tonto -48.49% 365.000 188.000 - -3.09% -
465.tonto (avg) -48.49% 365.000 188.000 - -3.09% -
483.xalancbmk (avg) (percentage) -48.46% 6.500 3.350 - -2.05% -
473.astar (avg) (percentage) -48.32% 4.160 2.150 - -2.27% -
473.astar -47.89% 213.000 111.000 - -2.63% -
473.astar (avg) -47.89% 213.000 111.000 - -2.63% -
483.xalancbmk -47.58% 248.000 130.000 - -3.70% -
483.xalancbmk (avg) -47.58% 248.000 130.000 - -3.70% -
454.calculix (avg) (percentage) -45.14% 8.020 4.400 - -0.90% -
403.gcc -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) -25.00% 4.000 3.000 - 0.00% -
403.gcc (avg) (percentage) -17.35% 7.320 6.050 - 0.00% -
429.mcf -14.68% 109.000 93.000 - -1.06% -
429.mcf (avg) -14.68% 109.000 93.000 - -1.06% -
429.mcf (avg) (percentage) -13.69% 7.670 6.620 - -1.93% -

Added Tests - sample variability
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.41s
Execution (seconds)
Name Current %
400.perlbench 1623.000 -
401.bzip2 3007.000 -
403.gcc 60.000 5.26%
410.bwaves 5665.000 -
416.gamess 12445.000 -
429.mcf 1416.000 1.43%
433.milc 1137.000 -1.13%
434.zeusmp 2517.000 -
435.gromacs 7317.000 1.39%
436.cactusADM 2118.000 -
437.leslie3d 10920.000 -6.71%
444.namd 751.000 1.35%
445.gobmk 5074.000 -
447.dealII 1719.000 -
450.soplex 577.000 -1.70%
453.povray 550.000 -
454.calculix 63.000 3.28%
456.hmmer 2926.000 -
458.sjeng 7492.000 -
459.GemsFDTD 6130.000 -
462.libquantum 139.000 -
464.h264ref 5727.000 -
465.tonto 11031.000 -
470.lbm 3812.000 -
471.omnetpp 2763.000 -
473.astar 5205.000 -
481.wrf 5502.000 -
482.sphinx3 937.000 1.19%
483.xalancbmk 3908.000 -1.21%
Geometric Mean 2106.485 -
Code Size (bytes)
Name Current %
400.perlbench 896971.000 -
401.bzip2 44225.000 -
403.gcc 2443171.000 -
410.bwaves 16720.000 -
416.gamess 5732909.000 -
429.mcf 9119.000 -
433.milc 61394.000 -
434.zeusmp 152057.000 -
435.gromacs 502685.000 -
436.cactusADM 353267.000 -
437.leslie3d 59383.000 -
444.namd 188208.000 -
445.gobmk 1377710.000 -
447.dealII 311838.000 -
450.soplex 204737.000 -
453.povray 657057.000 -
454.calculix 840858.000 -
456.hmmer 108419.000 -
458.sjeng 103968.000 -
459.GemsFDTD 244464.000 -
462.libquantum 16045.000 -
464.h264ref 391872.000 -
465.tonto 1936254.000 -
470.lbm 9739.000 -
471.omnetpp 480640.000 -
473.astar 22916.000 -
481.wrf 1964918.000 -
482.sphinx3 112739.000 -
483.xalancbmk 2338583.000 -
Geometric Mean 223923.844 -
sample variability
Name Current %
400.perlbench 49.000 -2.00%
400.perlbench (avg) 49.000 -2.00%
400.perlbench (avg) (percentage) 3.020 -2.89%
400.perlbench (max) 47.000 -4.08%
400.perlbench (max) (percentage) 2.950 -3.59%
400.perlbench (unexplained diff vs previous) 7.000 40.00%
400.perlbench (unexplained diff vs previous) (percentage) 0.430 38.71%
401.bzip2 67.000 -2.90%
401.bzip2 (avg) 67.000 -2.90%
401.bzip2 (avg) (percentage) 2.250 -2.60%
401.bzip2 (max) 24.000 -7.69%
401.bzip2 (max) (percentage) 0.810 -7.95%
401.bzip2 (unexplained diff vs previous) 10.000 -61.54%
401.bzip2 (unexplained diff vs previous) (percentage) 0.330 -62.07%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 6.050 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 7.910 -1.86%
410.bwaves 97.000 -2.02%
410.bwaves (avg) 97.000 -2.02%
410.bwaves (avg) (percentage) 1.720 -2.27%
410.bwaves (max) 31.000 -11.43%
410.bwaves (max) (percentage) 0.560 -11.11%
410.bwaves (unexplained diff vs previous) 0.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.000 -
416.gamess 159.000 -2.45%
416.gamess (avg) 159.000 -2.45%
416.gamess (avg) (percentage) 1.280 -3.03%
416.gamess (max) 21.000 162.50%
416.gamess (max) (percentage) 0.170 142.86%
416.gamess (unexplained diff vs previous) 21.000 200.00%
416.gamess (unexplained diff vs previous) (percentage) 0.170 183.33%
429.mcf 93.000 -1.06%
429.mcf (avg) 93.000 -1.06%
429.mcf (avg) (percentage) 6.620 -1.93%
429.mcf (max) 20.000 53.85%
429.mcf (max) (percentage) 1.430 50.53%
429.mcf (unexplained diff vs previous) 20.000 300.00%
429.mcf (unexplained diff vs previous) (percentage) 1.410 291.67%
433.milc 26.000 -
433.milc (avg) 26.000 -
433.milc (avg) (percentage) 2.310 -1.28%
433.milc (max) 12.000 300.00%
433.milc (max) (percentage) 1.130 264.52%
433.milc (unexplained diff vs previous) 13.000 550.00%
433.milc (unexplained diff vs previous) (percentage) 1.140 570.59%
434.zeusmp 52.000 -1.89%
434.zeusmp (avg) 52.000 -1.89%
434.zeusmp (avg) (percentage) 2.090 -1.42%
434.zeusmp (max) 19.000 11.76%
434.zeusmp (max) (percentage) 0.790 12.86%
434.zeusmp (unexplained diff vs previous) 20.000 566.67%
434.zeusmp (unexplained diff vs previous) (percentage) 0.790 558.33%
435.gromacs 183.000 -
435.gromacs (avg) 183.000 -
435.gromacs (avg) (percentage) 2.510 -1.18%
435.gromacs (max) 101.000 24.69%
435.gromacs (max) (percentage) 1.390 23.01%
435.gromacs (unexplained diff vs previous) 100.000 614.29%
435.gromacs (unexplained diff vs previous) (percentage) 1.370 621.05%
436.cactusADM 53.000 -1.85%
436.cactusADM (avg) 53.000 -1.85%
436.cactusADM (avg) (percentage) 2.540 -1.55%
436.cactusADM (max) 9.000 -10.00%
436.cactusADM (max) (percentage) 0.470 -2.08%
436.cactusADM (unexplained diff vs previous) 10.000 42.86%
436.cactusADM (unexplained diff vs previous) (percentage) 0.470 42.42%
437.leslie3d 472.000 -5.22%
437.leslie3d (avg) 472.000 -5.22%
437.leslie3d (avg) (percentage) 4.330 1.64%
437.leslie3d (max) 794.000 -22.39%
437.leslie3d (max) (percentage) 7.280 -16.70%
437.leslie3d (unexplained diff vs previous) 785.000 -16.58%
437.leslie3d (unexplained diff vs previous) (percentage) 7.190 -10.57%
444.namd 21.000 -
444.namd (avg) 21.000 -
444.namd (avg) (percentage) 2.910 -1.36%
444.namd (max) 10.000 66.67%
444.namd (max) (percentage) 1.350 43.62%
444.namd (unexplained diff vs previous) 10.000 42.86%
444.namd (unexplained diff vs previous) (percentage) 1.330 41.49%
445.gobmk 77.000 -2.53%
445.gobmk (avg) 77.000 -2.53%
445.gobmk (avg) (percentage) 1.530 -1.29%
445.gobmk (max) 39.000 -
445.gobmk (max) (percentage) 0.780 1.30%
445.gobmk (unexplained diff vs previous) 40.000 2.56%
445.gobmk (unexplained diff vs previous) (percentage) 0.790 3.95%
447.dealII 40.000 -2.44%
447.dealII (avg) 40.000 -2.44%
447.dealII (avg) (percentage) 2.330 -2.92%
447.dealII (max) 27.000 -3.57%
447.dealII (max) (percentage) 1.600 -4.19%
447.dealII (unexplained diff vs previous) 6.000 -14.29%
447.dealII (unexplained diff vs previous) (percentage) 0.350 -14.63%
450.soplex 16.000 -5.88%
450.soplex (avg) 16.000 -5.88%
450.soplex (avg) (percentage) 2.910 -1.36%
450.soplex (max) 10.000 -9.09%
450.soplex (max) (percentage) 1.780 -6.81%
450.soplex (unexplained diff vs previous) 10.000 233.33%
450.soplex (unexplained diff vs previous) (percentage) 1.730 239.22%
453.povray 14.000 -6.67%
453.povray (avg) 14.000 -6.67%
453.povray (avg) (percentage) 2.710 -2.87%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.590 -4.79%
453.povray (unexplained diff vs previous) 2.000 100.00%
453.povray (unexplained diff vs previous) (percentage) 0.360 100.00%
454.calculix 2.000 -
454.calculix (avg) 2.000 -
454.calculix (avg) (percentage) 4.400 -
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.780 -3.08%
454.calculix (unexplained diff vs previous) 2.000 100.00%
454.calculix (unexplained diff vs previous) (percentage) 3.170 93.29%
456.hmmer 43.000 -2.27%
456.hmmer (avg) 43.000 -2.27%
456.hmmer (avg) (percentage) 1.490 -2.61%
456.hmmer (max) 11.000 -8.33%
456.hmmer (max) (percentage) 0.410 -2.38%
456.hmmer (unexplained diff vs previous) 9.000 800.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.310 933.33%
458.sjeng 96.000 -3.03%
458.sjeng (avg) 96.000 -3.03%
458.sjeng (avg) (percentage) 1.290 -2.27%
458.sjeng (max) 10.000 -9.09%
458.sjeng (max) (percentage) 0.140 -
458.sjeng (unexplained diff vs previous) 10.000 100.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.130 85.71%
459.GemsFDTD 133.000 -1.48%
459.GemsFDTD (avg) 133.000 -1.48%
459.GemsFDTD (avg) (percentage) 2.170 -2.25%
459.GemsFDTD (max) 37.000 -15.91%
459.GemsFDTD (max) (percentage) 0.610 -16.44%
459.GemsFDTD (unexplained diff vs previous) 30.000 -33.33%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.490 -33.78%
462.libquantum 3.000 -25.00%
462.libquantum (avg) 3.000 -25.00%
462.libquantum (avg) (percentage) 2.850 -2.40%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.240 -12.68%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 107.000 -2.73%
464.h264ref (avg) 107.000 -2.73%
464.h264ref (avg) (percentage) 1.880 -2.59%
464.h264ref (max) 29.000 -9.38%
464.h264ref (max) (percentage) 0.520 -7.14%
464.h264ref (unexplained diff vs previous) 11.000 -65.62%
464.h264ref (unexplained diff vs previous) (percentage) 0.190 -66.07%
465.tonto 188.000 -3.09%
465.tonto (avg) 188.000 -3.09%
465.tonto (avg) (percentage) 1.710 -2.29%
465.tonto (max) 69.000 -17.86%
465.tonto (max) (percentage) 0.630 -17.11%
465.tonto (unexplained diff vs previous) 69.000 -17.86%
465.tonto (unexplained diff vs previous) (percentage) 0.630 -17.11%
470.lbm 82.000 -2.38%
470.lbm (avg) 82.000 -2.38%
470.lbm (avg) (percentage) 2.160 -1.82%
470.lbm (max) 14.000 -17.65%
470.lbm (max) (percentage) 0.390 -17.02%
470.lbm (unexplained diff vs previous) 8.000 -55.56%
470.lbm (unexplained diff vs previous) (percentage) 0.210 -55.32%
471.omnetpp 93.000 -2.11%
471.omnetpp (avg) 93.000 -2.11%
471.omnetpp (avg) (percentage) 3.370 -2.03%
471.omnetpp (max) 58.000 -7.94%
471.omnetpp (max) (percentage) 2.110 -7.46%
471.omnetpp (unexplained diff vs previous) 7.000 -75.86%
471.omnetpp (unexplained diff vs previous) (percentage) 0.250 -76.19%
473.astar 111.000 -2.63%
473.astar (avg) 111.000 -2.63%
473.astar (avg) (percentage) 2.150 -2.27%
473.astar (max) 48.000 -11.11%
473.astar (max) (percentage) 0.940 -9.62%
473.astar (unexplained diff vs previous) 10.000 -71.43%
473.astar (unexplained diff vs previous) (percentage) 0.190 -71.64%
481.wrf 134.000 -3.60%
481.wrf (avg) 134.000 -3.60%
481.wrf (avg) (percentage) 2.450 -2.78%
481.wrf (max) 57.000 -3.39%
481.wrf (max) (percentage) 1.040 -3.70%
481.wrf (unexplained diff vs previous) 25.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.450 -
482.sphinx3 28.000 -
482.sphinx3 (avg) 28.000 -
482.sphinx3 (avg) (percentage) 3.030 -1.62%
482.sphinx3 (max) 16.000 -5.88%
482.sphinx3 (max) (percentage) 1.770 -7.33%
482.sphinx3 (unexplained diff vs previous) 11.000 -38.89%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.170 -39.69%
483.xalancbmk 130.000 -3.70%
483.xalancbmk (avg) 130.000 -3.70%
483.xalancbmk (avg) (percentage) 3.350 -2.05%
483.xalancbmk (max) 195.000 -4.88%
483.xalancbmk (max) (percentage) 5.000 -3.85%
483.xalancbmk (unexplained diff vs previous) 48.000 -66.90%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.230 -66.49%
Geometric Mean 6.260 -14.17%