Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f06b840b9a063aa33b8b50745bddc8e6845c8f29 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/5e812e8c1e8d65aee05cc3fbbe5727d4e365df57 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=db9b47e9f996bbdb831580ff7343542a017c80ee (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f130cb3a5bbed9c62474d814fc2bfec5ac66b81b (+ 216 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--gnu-aarch64-master-Os_LTO-build/20/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0020 (v6.2.8-48461-gf130cb3a5bbed) 2023-03-23T21:10:23 0:00:00
Previous 0019 (-00000-) 2023-03-22T18:20:39 0:00:00
Baseline 0001 (4-changed-components) 2023-02-20T22:48:24 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 28 14
Performance Improvements 161 195
Added Tests 4 4
Unchanged Tests 1043 1023
Total Tests 1236

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.39% 59.000 61.000 - 8.93% -
437.leslie3d 2.19% 10534.000 10765.000 - -7.52% -
462.libquantum 1.44% 139.000 141.000 - 0.71% -
401.bzip2 1.35% 2954.000 2994.000 - 1.80% -
481.wrf 1.02% 5470.000 5526.000 - -0.14% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) 263.64% 11.000 40.000 - -99.63% -
401.bzip2 (unexplained diff vs previous) (percentage) 262.16% 0.370 1.340 - -99.64% -
464.h264ref (unexplained diff vs previous) (percentage) 182.35% 0.170 0.480 - -99.60% -
464.h264ref (unexplained diff vs previous) 180.00% 10.000 28.000 - -99.59% -
465.tonto (unexplained diff vs previous) (percentage) 153.33% 0.600 1.520 - -90.61% -
465.tonto (unexplained diff vs previous) 151.52% 66.000 166.000 - -90.63% -
471.omnetpp (unexplained diff vs previous) (percentage) 121.62% 0.370 0.820 - -99.79% -
471.omnetpp (unexplained diff vs previous) 120.00% 10.000 22.000 - -99.79% -
462.libquantum (unexplained diff vs previous) 100.00% 1.000 2.000 - -99.99% -
462.libquantum (unexplained diff vs previous) (percentage) 97.22% 0.720 1.420 - -99.99% -
400.perlbench (unexplained diff vs previous) (percentage) 84.11% 1.510 2.780 - -99.47% -
429.mcf (unexplained diff vs previous) (percentage) 84.09% 1.320 2.430 - -99.81% -
400.perlbench (unexplained diff vs previous) 80.00% 25.000 45.000 - -99.49% -
429.mcf (unexplained diff vs previous) 78.95% 19.000 34.000 - -99.82% -
401.bzip2 (max) 53.85% 26.000 40.000 - -98.27% -
401.bzip2 (max) (percentage) 48.35% 0.910 1.350 - -98.28% -
403.gcc 33.33% 3.000 4.000 - 0.00% -
403.gcc (avg) 33.33% 3.000 4.000 - 0.00% -
400.perlbench (max) (percentage) 15.32% 2.350 2.710 - -96.78% -
483.xalancbmk (unexplained diff vs previous) (percentage) 14.43% 0.970 1.110 - -99.49% -
483.xalancbmk (unexplained diff vs previous) 13.51% 37.000 42.000 - -99.50% -
400.perlbench (max) 10.26% 39.000 43.000 - -96.92% -
403.gcc (max) 2.78% 36.000 37.000 - -32.73% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
400.perlbench -2.71% 1661.000 1616.000 - -2.83% -
429.mcf -2.37% 1435.000 1401.000 - -1.62% -
465.tonto -1.50% 11084.000 10918.000 - -0.21% -
435.gromacs -1.29% 7499.000 7402.000 - 1.83% -
483.xalancbmk -1.10% 3814.000 3772.000 - -1.20% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
416.gamess (unexplained diff vs previous) (percentage) -88.89% 0.180 0.020 - -99.97% -
416.gamess (unexplained diff vs previous) -86.36% 22.000 3.000 - -99.96% -
434.zeusmp (unexplained diff vs previous) -82.61% 23.000 4.000 - -99.96% -
434.zeusmp (unexplained diff vs previous) (percentage) -82.61% 0.920 0.160 - -99.96% -
437.leslie3d (unexplained diff vs previous) (percentage) -80.73% 11.160 2.150 - -89.19% -
437.leslie3d (unexplained diff vs previous) -80.36% 1176.000 231.000 - -90.02% -
459.GemsFDTD (unexplained diff vs previous) -80.20% 101.000 20.000 - -99.87% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -79.88% 1.640 0.330 - -99.87% -
473.astar (unexplained diff vs previous) (percentage) -77.65% 0.850 0.190 - -99.90% -
473.astar (unexplained diff vs previous) -77.27% 44.000 10.000 - -99.90% -
433.milc (unexplained diff vs previous) (percentage) -74.26% 2.720 0.700 - -99.93% -
433.milc (unexplained diff vs previous) -74.19% 31.000 8.000 - -99.93% -
470.lbm (unexplained diff vs previous) (percentage) -74.17% 1.200 0.310 - -99.88% -
470.lbm (unexplained diff vs previous) -73.91% 46.000 12.000 - -99.88% -
482.sphinx3 (unexplained diff vs previous) (percentage) -63.79% 1.160 0.420 - -99.98% -
482.sphinx3 (unexplained diff vs previous) -63.64% 11.000 4.000 - -99.98% -
410.bwaves (unexplained diff vs previous) (percentage) -59.18% 1.470 0.600 - -99.56% -
434.zeusmp (max) (percentage) -59.14% 1.860 0.760 - -99.07% -
410.bwaves (unexplained diff vs previous) -59.04% 83.000 34.000 - -99.56% -
434.zeusmp (max) -58.70% 46.000 19.000 - -99.08% -
445.gobmk (unexplained diff vs previous) -58.33% 36.000 15.000 - -99.73% -
450.soplex (unexplained diff vs previous) -58.33% 12.000 5.000 - -99.97% -
450.soplex (unexplained diff vs previous) (percentage) -57.97% 2.070 0.870 - -99.97% -
445.gobmk (unexplained diff vs previous) (percentage) -57.75% 0.710 0.300 - -99.73% -
416.gamess (max) (percentage) -51.16% 0.430 0.210 - -99.46% -
416.gamess (max) -50.94% 53.000 26.000 - -99.46% -
447.dealII (unexplained diff vs previous) -50.00% 2.000 1.000 - -99.99% -
447.dealII (unexplained diff vs previous) (percentage) -50.00% 0.120 0.060 - -99.99% -
435.gromacs (unexplained diff vs previous) -45.51% 178.000 97.000 - -98.62% -
435.gromacs (unexplained diff vs previous) (percentage) -44.73% 2.370 1.310 - -98.65% -
444.namd (unexplained diff vs previous) -37.50% 8.000 5.000 - -99.94% -
458.sjeng (unexplained diff vs previous) -37.50% 72.000 45.000 - -99.35% -
444.namd (unexplained diff vs previous) (percentage) -37.38% 1.070 0.670 - -99.94% -
458.sjeng (unexplained diff vs previous) (percentage) -36.84% 0.950 0.600 - -99.34% -
453.povray (max) -33.33% 3.000 2.000 - -99.60% -
433.milc (max) -26.67% 30.000 22.000 - -97.89% -
444.namd (max) -25.00% 8.000 6.000 - -99.12% -
433.milc (max) (percentage) -24.91% 2.650 1.990 - -97.81% -
481.wrf (unexplained diff vs previous) (percentage) -18.55% 1.240 1.010 - -99.54% -
481.wrf (unexplained diff vs previous) -17.65% 68.000 56.000 - -99.54% -
444.namd (max) (percentage) -16.67% 1.080 0.900 - -99.02% -
437.leslie3d (max) (percentage) -12.55% 10.040 8.780 - -47.04% -
410.bwaves (max) (percentage) -12.41% 1.450 1.270 - -97.81% -
465.tonto (max) -11.32% 380.000 337.000 - -84.04% -
410.bwaves (max) -11.11% 81.000 72.000 - -97.80% -
473.astar (max) -11.07% 244.000 217.000 - -93.63% -
473.astar (max) (percentage) -11.02% 4.720 4.200 - -93.68% -
453.povray (max) (percentage) -10.91% 0.550 0.490 - -99.46% -
437.leslie3d (max) -10.60% 1057.000 945.000 - -51.01% -
482.sphinx3 (max) (percentage) -9.94% 3.420 3.080 - -96.81% -
465.tonto (max) (percentage) -9.91% 3.430 3.090 - -84.00% -
464.h264ref (max) (percentage) -9.87% 1.520 1.370 - -97.48% -
483.xalancbmk (max) -9.80% 153.000 138.000 - -94.73% -
482.sphinx3 (max) -9.38% 32.000 29.000 - -96.82% -
464.h264ref (max) -9.20% 87.000 79.000 - -97.47% -
450.soplex (max) -9.09% 11.000 10.000 - -98.17% -
481.wrf (max) (percentage) -8.72% 2.980 2.720 - -96.04% -
483.xalancbmk (max) (percentage) -8.71% 4.020 3.670 - -94.66% -
447.dealII (max) -8.70% 23.000 21.000 - -98.48% -
429.mcf (max) -8.44% 320.000 293.000 - -77.84% -
450.soplex (max) (percentage) -8.37% 2.030 1.860 - -98.07% -
481.wrf (max) -7.98% 163.000 150.000 - -96.05% -
459.GemsFDTD (max) -7.73% 207.000 191.000 - -95.67% -
456.hmmer (unexplained diff vs previous) (percentage) -7.69% 0.520 0.480 - -99.83% -
435.gromacs (max) -7.50% 240.000 222.000 - -93.79% -
470.lbm (max) (percentage) -7.42% 2.560 2.370 - -96.73% -
459.GemsFDTD (max) (percentage) -7.42% 3.370 3.120 - -95.63% -
458.sjeng (max) -7.27% 110.000 102.000 - -97.17% -
470.lbm (max) -7.22% 97.000 90.000 - -96.72% -
458.sjeng (max) (percentage) -6.85% 1.460 1.360 - -97.14% -
447.dealII (max) (percentage) -6.72% 1.340 1.250 - -98.44% -
456.hmmer (unexplained diff vs previous) -6.67% 15.000 14.000 - -99.83% -
435.gromacs (max) (percentage) -6.54% 3.210 3.000 - -93.90% -
429.mcf (max) (percentage) -6.26% 22.350 20.950 - -77.45% -
456.hmmer (max) (percentage) -5.77% 0.520 0.490 - -99.33% -
429.mcf -5.71% 175.000 165.000 - 51.38% -
429.mcf (avg) -5.71% 175.000 165.000 - 51.38% -
416.gamess (avg) (percentage) -5.10% 2.550 2.420 - -45.25% -
416.gamess -5.06% 316.000 300.000 - -45.45% -
416.gamess (avg) -5.06% 316.000 300.000 - -45.45% -
447.dealII -4.55% 66.000 63.000 - -36.36% -
447.dealII (avg) -4.55% 66.000 63.000 - -36.36% -
436.cactusADM (max) (percentage) -4.43% 3.610 3.450 - -96.11% -
483.xalancbmk -4.40% 182.000 174.000 - -29.84% -
483.xalancbmk (avg) -4.40% 182.000 174.000 - -29.84% -
444.namd -4.35% 46.000 44.000 - -35.29% -
444.namd (avg) -4.35% 46.000 44.000 - -35.29% -
445.gobmk -4.32% 139.000 133.000 - -32.14% -
445.gobmk (avg) -4.32% 139.000 133.000 - -32.14% -
435.gromacs -4.30% 302.000 289.000 - -21.25% -
435.gromacs (avg) -4.30% 302.000 289.000 - -21.25% -
445.gobmk (max) -4.23% 71.000 68.000 - -97.43% -
400.perlbench -4.17% 72.000 69.000 - -34.29% -
400.perlbench (avg) -4.17% 72.000 69.000 - -34.29% -
454.calculix (avg) (percentage) -4.15% 5.780 5.540 - -30.92% -
447.dealII (avg) (percentage) -4.15% 3.860 3.700 - -35.88% -
459.GemsFDTD -4.03% 273.000 262.000 - -27.22% -
459.GemsFDTD (avg) -4.03% 273.000 262.000 - -27.22% -
470.lbm -4.02% 174.000 167.000 - -30.13% -
470.lbm (avg) -4.02% 174.000 167.000 - -30.13% -
436.cactusADM (max) -4.00% 75.000 72.000 - -96.10% -
436.cactusADM -3.92% 102.000 98.000 - -20.97% -
436.cactusADM (avg) -3.92% 102.000 98.000 - -20.97% -
453.povray (avg) (percentage) -3.89% 4.880 4.690 - -39.95% -
434.zeusmp -3.85% 104.000 100.000 - -31.97% -
434.zeusmp (avg) -3.85% 104.000 100.000 - -31.97% -
453.povray -3.85% 26.000 25.000 - -40.48% -
453.povray (avg) -3.85% 26.000 25.000 - -40.48% -
458.sjeng -3.83% 183.000 176.000 - -26.97% -
458.sjeng (avg) -3.83% 183.000 176.000 - -26.97% -
465.tonto -3.76% 319.000 307.000 - -15.89% -
465.tonto (avg) -3.76% 319.000 307.000 - -15.89% -
471.omnetpp -3.75% 160.000 154.000 - -30.94% -
471.omnetpp (avg) -3.75% 160.000 154.000 - -30.94% -
450.soplex -3.70% 27.000 26.000 - -27.78% -
450.soplex (avg) -3.70% 27.000 26.000 - -27.78% -
445.gobmk (avg) (percentage) -3.66% 2.730 2.630 - -32.74% -
482.sphinx3 -3.64% 55.000 53.000 - -28.38% -
482.sphinx3 (avg) -3.64% 55.000 53.000 - -28.38% -
459.GemsFDTD (avg) (percentage) -3.60% 4.440 4.280 - -26.71% -
445.gobmk (max) (percentage) -3.57% 1.400 1.350 - -97.43% -
464.h264ref (avg) (percentage) -3.49% 3.440 3.320 - -34.77% -
482.sphinx3 (avg) (percentage) -3.44% 5.820 5.620 - -29.13% -
444.namd (avg) (percentage) -3.40% 6.170 5.960 - -35.36% -
434.zeusmp (avg) (percentage) -3.37% 4.160 4.020 - -31.28% -
483.xalancbmk (avg) (percentage) -3.34% 4.790 4.630 - -28.77% -
470.lbm (avg) (percentage) -3.30% 4.550 4.400 - -30.49% -
481.wrf (avg) (percentage) -3.29% 4.260 4.120 - -33.97% -
456.hmmer (avg) (percentage) -3.15% 2.860 2.770 - -37.19% -
473.astar (avg) (percentage) -3.12% 3.840 3.720 - -10.58% -
436.cactusADM (avg) (percentage) -3.08% 4.870 4.720 - -21.07% -
464.h264ref -3.03% 198.000 192.000 - -34.47% -
464.h264ref (avg) -3.03% 198.000 192.000 - -34.47% -
473.astar -3.03% 198.000 192.000 - -9.86% -
473.astar (avg) -3.03% 198.000 192.000 - -9.86% -
410.bwaves (avg) (percentage) -3.02% 3.310 3.210 - -27.21% -
435.gromacs (avg) (percentage) -2.98% 4.030 3.910 - -22.73% -
429.mcf (avg) (percentage) -2.95% 12.200 11.840 - 54.37% -
450.soplex (avg) (percentage) -2.94% 4.770 4.630 - -27.99% -
458.sjeng (avg) (percentage) -2.90% 2.410 2.340 - -26.65% -
471.omnetpp (avg) (percentage) -2.87% 5.930 5.760 - -29.76% -
433.milc (avg) (percentage) -2.68% 4.850 4.720 - -21.98% -
410.bwaves -2.67% 187.000 182.000 - -26.91% -
410.bwaves (avg) -2.67% 187.000 182.000 - -26.91% -
481.wrf -2.58% 233.000 227.000 - -34.20% -
481.wrf (avg) -2.58% 233.000 227.000 - -34.20% -
456.hmmer -2.44% 82.000 80.000 - -37.01% -
456.hmmer (avg) -2.44% 82.000 80.000 - -37.01% -
462.libquantum (avg) (percentage) -2.43% 5.340 5.210 - -31.98% -
401.bzip2 (avg) (percentage) -2.31% 3.890 3.800 - -30.66% -
465.tonto (avg) (percentage) -2.08% 2.880 2.820 - -15.57% -
433.milc -1.82% 55.000 54.000 - -21.74% -
433.milc (avg) -1.82% 55.000 54.000 - -21.74% -
400.perlbench (avg) (percentage) -1.59% 4.390 4.320 - -31.97% -
437.leslie3d (avg) (percentage) -1.41% 3.550 3.500 - 14.75% -
403.gcc (max) (percentage) -1.19% 62.100 61.360 - -38.24% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
459.GemsFDTD 1.73% 244728.000 248972.000 - 0.00% -
436.cactusADM 1.16% 352891.000 356967.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc 8.93% 56.000 61.000 - 3.39% -
435.gromacs 1.83% 7269.000 7402.000 - -1.29% -
401.bzip2 1.80% 2941.000 2994.000 - 1.35% -
450.soplex 1.23% 567.000 574.000 - -0.86% -
445.gobmk 1.09% 5023.000 5078.000 - -0.29% -
473.astar 1.07% 5128.000 5183.000 - 0.19% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (avg) (percentage) 54.37% 7.670 11.840 - -2.95% -
429.mcf 51.38% 109.000 165.000 - -5.71% -
429.mcf (avg) 51.38% 109.000 165.000 - -5.71% -
437.leslie3d (avg) (percentage) 14.75% 3.050 3.500 - -1.41% -
437.leslie3d 5.92% 355.000 376.000 - 0.80% -
437.leslie3d (avg) 5.92% 355.000 376.000 - 0.80% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
464.h264ref -1.12% 387748.000 383408.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
437.leslie3d -7.52% 11640.000 10765.000 - 2.19% -
400.perlbench -2.83% 1663.000 1616.000 - -2.71% -
429.mcf -1.62% 1424.000 1401.000 - -2.37% -
471.omnetpp -1.47% 2724.000 2684.000 - -0.81% -
483.xalancbmk -1.20% 3818.000 3772.000 - -1.10% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
447.dealII (unexplained diff vs previous) -99.99% 7017.000 1.000 - -50.00% -
462.libquantum (unexplained diff vs previous) (percentage) -99.99% 9655.710 1.420 - 97.22% -
447.dealII (unexplained diff vs previous) (percentage) -99.99% 407.020 0.060 - -50.00% -
462.libquantum (unexplained diff vs previous) -99.99% 13518.000 2.000 - 100.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -99.98% 2759.050 0.420 - -63.79% -
482.sphinx3 (unexplained diff vs previous) -99.98% 26073.000 4.000 - -63.64% -
416.gamess (unexplained diff vs previous) (percentage) -99.97% 62.730 0.020 - -88.89% -
450.soplex (unexplained diff vs previous) (percentage) -99.97% 2557.320 0.870 - -57.97% -
450.soplex (unexplained diff vs previous) -99.97% 14500.000 5.000 - -58.33% -
453.povray (unexplained diff vs previous) (percentage) -99.97% 1043.330 0.360 - 0.00% -
453.povray (unexplained diff vs previous) -99.96% 5707.000 2.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) -99.96% 11280.000 4.000 - -82.61% -
434.zeusmp (unexplained diff vs previous) (percentage) -99.96% 448.690 0.160 - -82.61% -
416.gamess (unexplained diff vs previous) -99.96% 7819.000 3.000 - -86.36% -
444.namd (unexplained diff vs previous) -99.94% 8356.000 5.000 - -37.50% -
444.namd (unexplained diff vs previous) (percentage) -99.94% 1118.610 0.670 - -37.38% -
433.milc (unexplained diff vs previous) -99.93% 11289.000 8.000 - -74.19% -
433.milc (unexplained diff vs previous) (percentage) -99.93% 980.800 0.700 - -74.26% -
473.astar (unexplained diff vs previous) (percentage) -99.90% 197.850 0.190 - -77.65% -
473.astar (unexplained diff vs previous) -99.90% 10146.000 10.000 - -77.27% -
470.lbm (unexplained diff vs previous) (percentage) -99.88% 263.730 0.310 - -74.17% -
470.lbm (unexplained diff vs previous) -99.88% 9990.000 12.000 - -73.91% -
459.GemsFDTD (unexplained diff vs previous) -99.87% 15458.000 20.000 - -80.20% -
459.GemsFDTD (unexplained diff vs previous) (percentage) -99.87% 250.410 0.330 - -79.88% -
456.hmmer (unexplained diff vs previous) (percentage) -99.83% 278.630 0.480 - -7.69% -
456.hmmer (unexplained diff vs previous) -99.83% 8030.000 14.000 - -6.67% -
429.mcf (unexplained diff vs previous) -99.82% 18593.000 34.000 - 78.95% -
429.mcf (unexplained diff vs previous) (percentage) -99.81% 1305.690 2.430 - 84.09% -
471.omnetpp (unexplained diff vs previous) -99.79% 10659.000 22.000 - 120.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -99.79% 391.300 0.820 - 121.62% -
445.gobmk (unexplained diff vs previous) -99.73% 5581.000 15.000 - -58.33% -
445.gobmk (unexplained diff vs previous) (percentage) -99.73% 111.110 0.300 - -57.75% -
401.bzip2 (unexplained diff vs previous) (percentage) -99.64% 368.340 1.340 - 262.16% -
401.bzip2 (unexplained diff vs previous) -99.63% 10833.000 40.000 - 263.64% -
453.povray (max) -99.60% 499.000 2.000 - -33.33% -
464.h264ref (unexplained diff vs previous) (percentage) -99.60% 118.780 0.480 - 182.35% -
464.h264ref (unexplained diff vs previous) -99.59% 6843.000 28.000 - 180.00% -
410.bwaves (unexplained diff vs previous) (percentage) -99.56% 137.900 0.600 - -59.18% -
410.bwaves (unexplained diff vs previous) -99.56% 7794.000 34.000 - -59.04% -
481.wrf (unexplained diff vs previous) (percentage) -99.54% 219.530 1.010 - -18.55% -
481.wrf (unexplained diff vs previous) -99.54% 12149.000 56.000 - -17.65% -
483.xalancbmk (unexplained diff vs previous) -99.50% 8368.000 42.000 - 13.51% -
483.xalancbmk (unexplained diff vs previous) (percentage) -99.49% 219.170 1.110 - 14.43% -
400.perlbench (unexplained diff vs previous) -99.49% 8772.000 45.000 - 80.00% -
400.perlbench (unexplained diff vs previous) (percentage) -99.47% 527.480 2.780 - 84.11% -
453.povray (max) (percentage) -99.46% 91.250 0.490 - -10.91% -
416.gamess (max) -99.46% 4805.000 26.000 - -50.94% -
416.gamess (max) (percentage) -99.46% 38.550 0.210 - -51.16% -
458.sjeng (unexplained diff vs previous) -99.35% 6876.000 45.000 - -37.50% -
458.sjeng (unexplained diff vs previous) (percentage) -99.34% 90.870 0.600 - -36.84% -
456.hmmer (max) -99.34% 2120.000 14.000 - 0.00% -
456.hmmer (max) (percentage) -99.33% 73.590 0.490 - -5.77% -
444.namd (max) -99.12% 685.000 6.000 - -25.00% -
434.zeusmp (max) -99.08% 2055.000 19.000 - -58.70% -
434.zeusmp (max) (percentage) -99.07% 81.770 0.760 - -59.14% -
444.namd (max) (percentage) -99.02% 91.790 0.900 - -16.67% -
435.gromacs (unexplained diff vs previous) (percentage) -98.65% 96.680 1.310 - -44.73% -
435.gromacs (unexplained diff vs previous) -98.62% 7028.000 97.000 - -45.51% -
462.libquantum (max) -98.55% 138.000 2.000 - 0.00% -
447.dealII (max) -98.48% 1384.000 21.000 - -8.70% -
447.dealII (max) (percentage) -98.44% 80.280 1.250 - -6.72% -
401.bzip2 (max) (percentage) -98.28% 78.650 1.350 - 48.35% -
401.bzip2 (max) -98.27% 2313.000 40.000 - 53.85% -
462.libquantum (max) (percentage) -98.20% 98.970 1.780 - 0.00% -
450.soplex (max) -98.17% 545.000 10.000 - -9.09% -
450.soplex (max) (percentage) -98.07% 96.240 1.860 - -8.37% -
433.milc (max) -97.89% 1044.000 22.000 - -26.67% -
410.bwaves (max) (percentage) -97.81% 57.970 1.270 - -12.41% -
433.milc (max) (percentage) -97.81% 90.750 1.990 - -24.91% -
410.bwaves (max) -97.80% 3276.000 72.000 - -11.11% -
471.omnetpp (max) -97.79% 2169.000 48.000 - 0.00% -
471.omnetpp (max) (percentage) -97.74% 79.650 1.800 - 0.00% -
464.h264ref (max) (percentage) -97.48% 54.290 1.370 - -9.87% -
464.h264ref (max) -97.47% 3127.000 79.000 - -9.20% -
445.gobmk (max) (percentage) -97.43% 52.630 1.350 - -3.57% -
445.gobmk (max) -97.43% 2643.000 68.000 - -4.23% -
458.sjeng (max) -97.17% 3602.000 102.000 - -7.27% -
458.sjeng (max) (percentage) -97.14% 47.610 1.360 - -6.85% -
400.perlbench (max) -96.92% 1397.000 43.000 - 10.26% -
482.sphinx3 (max) -96.82% 911.000 29.000 - -9.38% -
482.sphinx3 (max) (percentage) -96.81% 96.500 3.080 - -9.94% -
400.perlbench (max) (percentage) -96.78% 84.060 2.710 - 15.32% -
470.lbm (max) (percentage) -96.73% 72.510 2.370 - -7.42% -
470.lbm (max) -96.72% 2746.000 90.000 - -7.22% -
454.calculix (max) -96.72% 61.000 2.000 - 0.00% -
454.calculix (max) (percentage) -96.15% 99.730 3.840 - 0.00% -
436.cactusADM (max) (percentage) -96.11% 88.730 3.450 - -4.43% -
436.cactusADM (max) -96.10% 1848.000 72.000 - -4.00% -
481.wrf (max) -96.05% 3801.000 150.000 - -7.98% -
481.wrf (max) (percentage) -96.04% 68.700 2.720 - -8.72% -
459.GemsFDTD (max) -95.67% 4411.000 191.000 - -7.73% -
459.GemsFDTD (max) (percentage) -95.63% 71.460 3.120 - -7.42% -
483.xalancbmk (max) -94.73% 2621.000 138.000 - -9.80% -
483.xalancbmk (max) (percentage) -94.66% 68.670 3.670 - -8.71% -
435.gromacs (max) (percentage) -93.90% 49.160 3.000 - -6.54% -
435.gromacs (max) -93.79% 3573.000 222.000 - -7.50% -
473.astar (max) (percentage) -93.68% 66.430 4.200 - -11.02% -
473.astar (max) -93.63% 3406.000 217.000 - -11.07% -
465.tonto (unexplained diff vs previous) -90.63% 1771.000 166.000 - 151.52% -
465.tonto (unexplained diff vs previous) (percentage) -90.61% 16.190 1.520 - 153.33% -
437.leslie3d (unexplained diff vs previous) -90.02% 2314.000 231.000 - -80.36% -
437.leslie3d (unexplained diff vs previous) (percentage) -89.19% 19.880 2.150 - -80.73% -
465.tonto (max) -84.04% 2112.000 337.000 - -11.32% -
465.tonto (max) (percentage) -84.00% 19.310 3.090 - -9.91% -
429.mcf (max) -77.84% 1322.000 293.000 - -8.44% -
429.mcf (max) (percentage) -77.45% 92.890 20.950 - -6.26% -
437.leslie3d (max) -51.01% 1929.000 945.000 - -10.60% -
437.leslie3d (max) (percentage) -47.04% 16.580 8.780 - -12.55% -
416.gamess -45.45% 550.000 300.000 - -5.06% -
416.gamess (avg) -45.45% 550.000 300.000 - -5.06% -
416.gamess (avg) (percentage) -45.25% 4.420 2.420 - -5.10% -
453.povray -40.48% 42.000 25.000 - -3.85% -
453.povray (avg) -40.48% 42.000 25.000 - -3.85% -
453.povray (avg) (percentage) -39.95% 7.810 4.690 - -3.89% -
403.gcc (max) (percentage) -38.24% 99.360 61.360 - -1.19% -
456.hmmer (avg) (percentage) -37.19% 4.410 2.770 - -3.15% -
456.hmmer -37.01% 127.000 80.000 - -2.44% -
456.hmmer (avg) -37.01% 127.000 80.000 - -2.44% -
447.dealII -36.36% 99.000 63.000 - -4.55% -
447.dealII (avg) -36.36% 99.000 63.000 - -4.55% -
447.dealII (avg) (percentage) -35.88% 5.770 3.700 - -4.15% -
444.namd (avg) (percentage) -35.36% 9.220 5.960 - -3.40% -
444.namd -35.29% 68.000 44.000 - -4.35% -
444.namd (avg) -35.29% 68.000 44.000 - -4.35% -
464.h264ref (avg) (percentage) -34.77% 5.090 3.320 - -3.49% -
464.h264ref -34.47% 293.000 192.000 - -3.03% -
464.h264ref (avg) -34.47% 293.000 192.000 - -3.03% -
400.perlbench -34.29% 105.000 69.000 - -4.17% -
400.perlbench (avg) -34.29% 105.000 69.000 - -4.17% -
481.wrf -34.20% 345.000 227.000 - -2.58% -
481.wrf (avg) -34.20% 345.000 227.000 - -2.58% -
481.wrf (avg) (percentage) -33.97% 6.240 4.120 - -3.29% -
445.gobmk (avg) (percentage) -32.74% 3.910 2.630 - -3.66% -
403.gcc (max) -32.73% 55.000 37.000 - 2.78% -
445.gobmk -32.14% 196.000 133.000 - -4.32% -
445.gobmk (avg) -32.14% 196.000 133.000 - -4.32% -
462.libquantum (avg) (percentage) -31.98% 7.660 5.210 - -2.43% -
434.zeusmp -31.97% 147.000 100.000 - -3.85% -
434.zeusmp (avg) -31.97% 147.000 100.000 - -3.85% -
400.perlbench (avg) (percentage) -31.97% 6.350 4.320 - -1.59% -
434.zeusmp (avg) (percentage) -31.28% 5.850 4.020 - -3.37% -
471.omnetpp -30.94% 223.000 154.000 - -3.75% -
471.omnetpp (avg) -30.94% 223.000 154.000 - -3.75% -
454.calculix (avg) (percentage) -30.92% 8.020 5.540 - -4.15% -
401.bzip2 (avg) (percentage) -30.66% 5.480 3.800 - -2.31% -
470.lbm (avg) (percentage) -30.49% 6.330 4.400 - -3.30% -
470.lbm -30.13% 239.000 167.000 - -4.02% -
470.lbm (avg) -30.13% 239.000 167.000 - -4.02% -
462.libquantum -30.00% 10.000 7.000 - 0.00% -
462.libquantum (avg) -30.00% 10.000 7.000 - 0.00% -
483.xalancbmk -29.84% 248.000 174.000 - -4.40% -
483.xalancbmk (avg) -29.84% 248.000 174.000 - -4.40% -
401.bzip2 -29.81% 161.000 113.000 - -0.88% -
401.bzip2 (avg) -29.81% 161.000 113.000 - -0.88% -
471.omnetpp (avg) (percentage) -29.76% 8.200 5.760 - -2.87% -
482.sphinx3 (avg) (percentage) -29.13% 7.930 5.620 - -3.44% -
483.xalancbmk (avg) (percentage) -28.77% 6.500 4.630 - -3.34% -
482.sphinx3 -28.38% 74.000 53.000 - -3.64% -
482.sphinx3 (avg) -28.38% 74.000 53.000 - -3.64% -
450.soplex (avg) (percentage) -27.99% 6.430 4.630 - -2.94% -
450.soplex -27.78% 36.000 26.000 - -3.70% -
450.soplex (avg) -27.78% 36.000 26.000 - -3.70% -
459.GemsFDTD -27.22% 360.000 262.000 - -4.03% -
459.GemsFDTD (avg) -27.22% 360.000 262.000 - -4.03% -
410.bwaves (avg) (percentage) -27.21% 4.410 3.210 - -3.02% -
458.sjeng -26.97% 241.000 176.000 - -3.83% -
458.sjeng (avg) -26.97% 241.000 176.000 - -3.83% -
410.bwaves -26.91% 249.000 182.000 - -2.67% -
410.bwaves (avg) -26.91% 249.000 182.000 - -2.67% -
459.GemsFDTD (avg) (percentage) -26.71% 5.840 4.280 - -3.60% -
458.sjeng (avg) (percentage) -26.65% 3.190 2.340 - -2.90% -
454.calculix -25.00% 4.000 3.000 - 0.00% -
454.calculix (avg) -25.00% 4.000 3.000 - 0.00% -
435.gromacs (avg) (percentage) -22.73% 5.060 3.910 - -2.98% -
433.milc (avg) (percentage) -21.98% 6.050 4.720 - -2.68% -
433.milc -21.74% 69.000 54.000 - -1.82% -
433.milc (avg) -21.74% 69.000 54.000 - -1.82% -
435.gromacs -21.25% 367.000 289.000 - -4.30% -
435.gromacs (avg) -21.25% 367.000 289.000 - -4.30% -
436.cactusADM (avg) (percentage) -21.07% 5.980 4.720 - -3.08% -
436.cactusADM -20.97% 124.000 98.000 - -3.92% -
436.cactusADM (avg) -20.97% 124.000 98.000 - -3.92% -
465.tonto -15.89% 365.000 307.000 - -3.76% -
465.tonto (avg) -15.89% 365.000 307.000 - -3.76% -
465.tonto (avg) (percentage) -15.57% 3.340 2.820 - -2.08% -
473.astar (avg) (percentage) -10.58% 4.160 3.720 - -3.12% -
473.astar -9.86% 213.000 192.000 - -3.03% -
473.astar (avg) -9.86% 213.000 192.000 - -3.03% -
403.gcc (avg) (percentage) -7.79% 7.320 6.750 - 0.00% -

Added Tests - sample variability
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
454.calculix (unexplained diff vs previous)
454.calculix (unexplained diff vs previous) (percentage)

Report Time: 0.40s
Execution (seconds)
Name Current %
400.perlbench 1616.000 -2.71%
401.bzip2 2994.000 1.35%
403.gcc 61.000 3.39%
410.bwaves 5687.000 -
416.gamess 12424.000 -
429.mcf 1401.000 -2.37%
433.milc 1148.000 -
434.zeusmp 2504.000 -
435.gromacs 7402.000 -1.29%
436.cactusADM 2095.000 -
437.leslie3d 10765.000 2.19%
444.namd 741.000 -
445.gobmk 5078.000 -
447.dealII 1719.000 -
450.soplex 574.000 -
453.povray 550.000 -
454.calculix 62.000 -
456.hmmer 2897.000 -
458.sjeng 7554.000 -
459.GemsFDTD 6140.000 -
462.libquantum 141.000 1.44%
464.h264ref 5796.000 -
465.tonto 10918.000 -1.50%
470.lbm 3813.000 -
471.omnetpp 2684.000 -
473.astar 5183.000 -
481.wrf 5526.000 1.02%
482.sphinx3 948.000 -
483.xalancbmk 3772.000 -1.10%
Geometric Mean 2100.672 -
Code Size (bytes)
Name Current %
400.perlbench 893232.000 -
401.bzip2 44233.000 -
403.gcc 2452063.000 -
410.bwaves 16760.000 -
416.gamess 5751265.000 -
429.mcf 9123.000 -
433.milc 61378.000 -
434.zeusmp 152037.000 -
435.gromacs 499041.000 -
436.cactusADM 356967.000 -
437.leslie3d 59475.000 -
444.namd 188332.000 -
445.gobmk 1381674.000 -
447.dealII 312907.000 -
450.soplex 205081.000 -
453.povray 657113.000 -
454.calculix 845283.000 -
456.hmmer 108663.000 -
458.sjeng 104048.000 -
459.GemsFDTD 248972.000 -
462.libquantum 16085.000 -
464.h264ref 383408.000 -
465.tonto 1945995.000 -
470.lbm 9691.000 -
471.omnetpp 478051.000 -
473.astar 22956.000 -
481.wrf 1968639.000 -
482.sphinx3 112795.000 -
483.xalancbmk 2343598.000 -
Geometric Mean 224131.050 -
sample variability
Name Current %
400.perlbench 69.000 -4.17%
400.perlbench (avg) 69.000 -4.17%
400.perlbench (avg) (percentage) 4.320 -1.59%
400.perlbench (max) 43.000 10.26%
400.perlbench (max) (percentage) 2.710 15.32%
400.perlbench (unexplained diff vs previous) 45.000 80.00%
400.perlbench (unexplained diff vs previous) (percentage) 2.780 84.11%
401.bzip2 113.000 -
401.bzip2 (avg) 113.000 -
401.bzip2 (avg) (percentage) 3.800 -2.31%
401.bzip2 (max) 40.000 53.85%
401.bzip2 (max) (percentage) 1.350 48.35%
401.bzip2 (unexplained diff vs previous) 40.000 263.64%
401.bzip2 (unexplained diff vs previous) (percentage) 1.340 262.16%
403.gcc 4.000 33.33%
403.gcc (avg) 4.000 33.33%
403.gcc (avg) (percentage) 6.750 -
403.gcc (max) 37.000 2.78%
403.gcc (max) (percentage) 61.360 -1.19%
410.bwaves 182.000 -2.67%
410.bwaves (avg) 182.000 -2.67%
410.bwaves (avg) (percentage) 3.210 -3.02%
410.bwaves (max) 72.000 -11.11%
410.bwaves (max) (percentage) 1.270 -12.41%
410.bwaves (unexplained diff vs previous) 34.000 -59.04%
410.bwaves (unexplained diff vs previous) (percentage) 0.600 -59.18%
416.gamess 300.000 -5.06%
416.gamess (avg) 300.000 -5.06%
416.gamess (avg) (percentage) 2.420 -5.10%
416.gamess (max) 26.000 -50.94%
416.gamess (max) (percentage) 0.210 -51.16%
416.gamess (unexplained diff vs previous) 3.000 -86.36%
416.gamess (unexplained diff vs previous) (percentage) 0.020 -88.89%
429.mcf 165.000 -5.71%
429.mcf (avg) 165.000 -5.71%
429.mcf (avg) (percentage) 11.840 -2.95%
429.mcf (max) 293.000 -8.44%
429.mcf (max) (percentage) 20.950 -6.26%
429.mcf (unexplained diff vs previous) 34.000 78.95%
429.mcf (unexplained diff vs previous) (percentage) 2.430 84.09%
433.milc 54.000 -1.82%
433.milc (avg) 54.000 -1.82%
433.milc (avg) (percentage) 4.720 -2.68%
433.milc (max) 22.000 -26.67%
433.milc (max) (percentage) 1.990 -24.91%
433.milc (unexplained diff vs previous) 8.000 -74.19%
433.milc (unexplained diff vs previous) (percentage) 0.700 -74.26%
434.zeusmp 100.000 -3.85%
434.zeusmp (avg) 100.000 -3.85%
434.zeusmp (avg) (percentage) 4.020 -3.37%
434.zeusmp (max) 19.000 -58.70%
434.zeusmp (max) (percentage) 0.760 -59.14%
434.zeusmp (unexplained diff vs previous) 4.000 -82.61%
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -82.61%
435.gromacs 289.000 -4.30%
435.gromacs (avg) 289.000 -4.30%
435.gromacs (avg) (percentage) 3.910 -2.98%
435.gromacs (max) 222.000 -7.50%
435.gromacs (max) (percentage) 3.000 -6.54%
435.gromacs (unexplained diff vs previous) 97.000 -45.51%
435.gromacs (unexplained diff vs previous) (percentage) 1.310 -44.73%
436.cactusADM 98.000 -3.92%
436.cactusADM (avg) 98.000 -3.92%
436.cactusADM (avg) (percentage) 4.720 -3.08%
436.cactusADM (max) 72.000 -4.00%
436.cactusADM (max) (percentage) 3.450 -4.43%
436.cactusADM (unexplained diff vs previous) 0.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.000 -
437.leslie3d 376.000 -
437.leslie3d (avg) 376.000 -
437.leslie3d (avg) (percentage) 3.500 -1.41%
437.leslie3d (max) 945.000 -10.60%
437.leslie3d (max) (percentage) 8.780 -12.55%
437.leslie3d (unexplained diff vs previous) 231.000 -80.36%
437.leslie3d (unexplained diff vs previous) (percentage) 2.150 -80.73%
444.namd 44.000 -4.35%
444.namd (avg) 44.000 -4.35%
444.namd (avg) (percentage) 5.960 -3.40%
444.namd (max) 6.000 -25.00%
444.namd (max) (percentage) 0.900 -16.67%
444.namd (unexplained diff vs previous) 5.000 -37.50%
444.namd (unexplained diff vs previous) (percentage) 0.670 -37.38%
445.gobmk 133.000 -4.32%
445.gobmk (avg) 133.000 -4.32%
445.gobmk (avg) (percentage) 2.630 -3.66%
445.gobmk (max) 68.000 -4.23%
445.gobmk (max) (percentage) 1.350 -3.57%
445.gobmk (unexplained diff vs previous) 15.000 -58.33%
445.gobmk (unexplained diff vs previous) (percentage) 0.300 -57.75%
447.dealII 63.000 -4.55%
447.dealII (avg) 63.000 -4.55%
447.dealII (avg) (percentage) 3.700 -4.15%
447.dealII (max) 21.000 -8.70%
447.dealII (max) (percentage) 1.250 -6.72%
447.dealII (unexplained diff vs previous) 1.000 -50.00%
447.dealII (unexplained diff vs previous) (percentage) 0.060 -50.00%
450.soplex 26.000 -3.70%
450.soplex (avg) 26.000 -3.70%
450.soplex (avg) (percentage) 4.630 -2.94%
450.soplex (max) 10.000 -9.09%
450.soplex (max) (percentage) 1.860 -8.37%
450.soplex (unexplained diff vs previous) 5.000 -58.33%
450.soplex (unexplained diff vs previous) (percentage) 0.870 -57.97%
453.povray 25.000 -3.85%
453.povray (avg) 25.000 -3.85%
453.povray (avg) (percentage) 4.690 -3.89%
453.povray (max) 2.000 -33.33%
453.povray (max) (percentage) 0.490 -10.91%
453.povray (unexplained diff vs previous) 2.000 -
453.povray (unexplained diff vs previous) (percentage) 0.360 -
454.calculix 3.000 -
454.calculix (avg) 3.000 -
454.calculix (avg) (percentage) 5.540 -4.15%
454.calculix (max) 2.000 -
454.calculix (max) (percentage) 3.840 -
454.calculix (unexplained diff vs previous) 0.000 -
454.calculix (unexplained diff vs previous) (percentage) 0.000 -
456.hmmer 80.000 -2.44%
456.hmmer (avg) 80.000 -2.44%
456.hmmer (avg) (percentage) 2.770 -3.15%
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.490 -5.77%
456.hmmer (unexplained diff vs previous) 14.000 -6.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.480 -7.69%
458.sjeng 176.000 -3.83%
458.sjeng (avg) 176.000 -3.83%
458.sjeng (avg) (percentage) 2.340 -2.90%
458.sjeng (max) 102.000 -7.27%
458.sjeng (max) (percentage) 1.360 -6.85%
458.sjeng (unexplained diff vs previous) 45.000 -37.50%
458.sjeng (unexplained diff vs previous) (percentage) 0.600 -36.84%
459.GemsFDTD 262.000 -4.03%
459.GemsFDTD (avg) 262.000 -4.03%
459.GemsFDTD (avg) (percentage) 4.280 -3.60%
459.GemsFDTD (max) 191.000 -7.73%
459.GemsFDTD (max) (percentage) 3.120 -7.42%
459.GemsFDTD (unexplained diff vs previous) 20.000 -80.20%
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.330 -79.88%
462.libquantum 7.000 -
462.libquantum (avg) 7.000 -
462.libquantum (avg) (percentage) 5.210 -2.43%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 1.780 -
462.libquantum (unexplained diff vs previous) 2.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.420 97.22%
464.h264ref 192.000 -3.03%
464.h264ref (avg) 192.000 -3.03%
464.h264ref (avg) (percentage) 3.320 -3.49%
464.h264ref (max) 79.000 -9.20%
464.h264ref (max) (percentage) 1.370 -9.87%
464.h264ref (unexplained diff vs previous) 28.000 180.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.480 182.35%
465.tonto 307.000 -3.76%
465.tonto (avg) 307.000 -3.76%
465.tonto (avg) (percentage) 2.820 -2.08%
465.tonto (max) 337.000 -11.32%
465.tonto (max) (percentage) 3.090 -9.91%
465.tonto (unexplained diff vs previous) 166.000 151.52%
465.tonto (unexplained diff vs previous) (percentage) 1.520 153.33%
470.lbm 167.000 -4.02%
470.lbm (avg) 167.000 -4.02%
470.lbm (avg) (percentage) 4.400 -3.30%
470.lbm (max) 90.000 -7.22%
470.lbm (max) (percentage) 2.370 -7.42%
470.lbm (unexplained diff vs previous) 12.000 -73.91%
470.lbm (unexplained diff vs previous) (percentage) 0.310 -74.17%
471.omnetpp 154.000 -3.75%
471.omnetpp (avg) 154.000 -3.75%
471.omnetpp (avg) (percentage) 5.760 -2.87%
471.omnetpp (max) 48.000 -
471.omnetpp (max) (percentage) 1.800 -
471.omnetpp (unexplained diff vs previous) 22.000 120.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.820 121.62%
473.astar 192.000 -3.03%
473.astar (avg) 192.000 -3.03%
473.astar (avg) (percentage) 3.720 -3.12%
473.astar (max) 217.000 -11.07%
473.astar (max) (percentage) 4.200 -11.02%
473.astar (unexplained diff vs previous) 10.000 -77.27%
473.astar (unexplained diff vs previous) (percentage) 0.190 -77.65%
481.wrf 227.000 -2.58%
481.wrf (avg) 227.000 -2.58%
481.wrf (avg) (percentage) 4.120 -3.29%
481.wrf (max) 150.000 -7.98%
481.wrf (max) (percentage) 2.720 -8.72%
481.wrf (unexplained diff vs previous) 56.000 -17.65%
481.wrf (unexplained diff vs previous) (percentage) 1.010 -18.55%
482.sphinx3 53.000 -3.64%
482.sphinx3 (avg) 53.000 -3.64%
482.sphinx3 (avg) (percentage) 5.620 -3.44%
482.sphinx3 (max) 29.000 -9.38%
482.sphinx3 (max) (percentage) 3.080 -9.94%
482.sphinx3 (unexplained diff vs previous) 4.000 -63.64%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.420 -63.79%
483.xalancbmk 174.000 -4.40%
483.xalancbmk (avg) 174.000 -4.40%
483.xalancbmk (avg) (percentage) 4.630 -3.34%
483.xalancbmk (max) 138.000 -9.80%
483.xalancbmk (max) (percentage) 3.670 -8.71%
483.xalancbmk (unexplained diff vs previous) 42.000 13.51%
483.xalancbmk (unexplained diff vs previous) (percentage) 1.110 14.43%
Geometric Mean 9.524 -26.05%