Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/65642c73089c9a06946e10f521a6d7acca2cc4cb (+ 803 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/64/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0064 (llvmorg-18-init-04391-g65642c73089c) 2023-08-22T15:28:36 0:00:00
Previous 0063 (llvmorg-18-init-03588-gac0072602c9d) 2023-08-11T09:33:31 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 29 41
Performance Improvements 69 99
Added Tests 4 2
Unchanged Tests 678 638
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 4.23% 520.000 542.000 - -96.24% -
462.libquantum 2.08% 96.000 98.000 - -99.25% -
429.mcf 1.20% 1163.000 1177.000 - -90.19% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 3600.00% 0.010 0.370 - 48.00% -
458.sjeng (unexplained diff vs previous) 2900.00% 1.000 30.000 - -26.83% -
470.lbm (unexplained diff vs previous) (percentage) 2300.00% 0.030 0.720 - -79.89% -
470.lbm (unexplained diff vs previous) 2200.00% 1.000 23.000 - -95.37% -
450.soplex (unexplained diff vs previous) 450.00% 4.000 22.000 - -73.17% -
450.soplex (unexplained diff vs previous) (percentage) 427.27% 0.770 4.060 - 612.28% -
473.astar (unexplained diff vs previous) (percentage) 237.50% 0.080 0.270 - -64.47% -
473.astar (unexplained diff vs previous) 225.00% 4.000 13.000 - -87.96% -
450.soplex (max) 175.00% 8.000 22.000 - -73.17% -
450.soplex (max) (percentage) 171.15% 1.560 4.230 - 642.11% -
483.xalancbmk (unexplained diff vs previous) 137.50% 8.000 19.000 - -68.85% -
483.xalancbmk (unexplained diff vs previous) (percentage) 134.78% 0.230 0.540 - -16.92% -
401.bzip2 (unexplained diff vs previous) 128.57% 7.000 16.000 - -67.35% -
401.bzip2 (unexplained diff vs previous) (percentage) 126.92% 0.260 0.590 - 90.32% -
462.libquantum (max) 100.00% 1.000 2.000 - -92.31% -
401.bzip2 (max) (percentage) 59.46% 0.370 0.590 - 90.32% -
401.bzip2 (max) 50.00% 10.000 15.000 - -68.75% -
450.soplex 33.33% 3.000 4.000 - -92.16% -
450.soplex (avg) 33.33% 3.000 4.000 - -92.16% -
429.mcf (unexplained diff vs previous) 27.27% 11.000 14.000 - -79.10% -
429.mcf (unexplained diff vs previous) (percentage) 25.26% 0.950 1.190 - 112.50% -
445.gobmk (max) 20.00% 10.000 12.000 - -58.62% -
450.soplex (avg) (percentage) 17.11% 0.760 0.890 - 147.22% -
445.gobmk (max) (percentage) 15.00% 0.200 0.230 - -4.17% -
473.astar (max) (percentage) 3.85% 0.260 0.270 - -66.25% -
462.libquantum (max) (percentage) 1.96% 2.040 2.080 - 940.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) -93.33% 15.000 1.000 - -88.89% -
456.hmmer (unexplained diff vs previous) (percentage) -92.86% 0.420 0.030 - -57.14% -
471.omnetpp (max) -69.23% 26.000 8.000 - -95.77% -
471.omnetpp (max) (percentage) -68.75% 0.960 0.300 - -82.95% -
471.omnetpp (unexplained diff vs previous) (percentage) -64.10% 0.390 0.140 - -83.72% -
471.omnetpp (unexplained diff vs previous) -63.64% 11.000 4.000 - -95.65% -
464.h264ref (unexplained diff vs previous) -52.94% 17.000 8.000 - -86.67% -
464.h264ref (unexplained diff vs previous) (percentage) -51.61% 0.310 0.150 - -61.54% -
482.sphinx3 (unexplained diff vs previous) -45.45% 11.000 6.000 - -99.34% -
482.sphinx3 (unexplained diff vs previous) (percentage) -45.16% 1.240 0.680 - -80.23% -
444.namd (unexplained diff vs previous) -42.86% 7.000 4.000 - -99.52% -
444.namd (unexplained diff vs previous) (percentage) -42.27% 0.970 0.560 - -90.88% -
444.namd (max) (percentage) -28.00% 1.250 0.900 - -86.24% -
444.namd (max) -25.00% 8.000 6.000 - -99.32% -
433.milc (max) -16.67% 6.000 5.000 - -97.28% -
464.h264ref (max) -11.76% 17.000 15.000 - -75.00% -
464.h264ref (max) (percentage) -9.68% 0.310 0.280 - -28.21% -
482.sphinx3 (max) -9.09% 11.000 10.000 - -98.85% -
482.sphinx3 (max) (percentage) -7.94% 1.260 1.160 - -65.06% -
456.hmmer (max) -7.14% 14.000 13.000 - -67.50% -
456.hmmer (max) (percentage) -7.14% 0.420 0.390 - 30.00% -
483.xalancbmk (max) -6.48% 108.000 101.000 - 65.57% -
482.sphinx3 -6.25% 16.000 15.000 - -96.93% -
482.sphinx3 (avg) -6.25% 16.000 15.000 - -96.93% -
483.xalancbmk (max) (percentage) -5.90% 3.050 2.870 - 341.54% -
433.milc (max) (percentage) -5.77% 0.520 0.490 - -64.23% -
444.namd -5.56% 18.000 17.000 - -96.69% -
444.namd (avg) -5.56% 18.000 17.000 - -96.69% -
401.bzip2 -5.00% 20.000 19.000 - -44.12% -
401.bzip2 (avg) -5.00% 20.000 19.000 - -44.12% -
429.mcf (max) -5.00% 20.000 19.000 - -71.64% -
458.sjeng -4.55% 88.000 84.000 - -11.58% -
458.sjeng (avg) -4.55% 88.000 84.000 - -11.58% -
483.xalancbmk -4.43% 158.000 151.000 - 221.28% -
483.xalancbmk (avg) -4.43% 158.000 151.000 - 221.28% -
445.gobmk (avg) (percentage) -4.35% 0.920 0.880 - 388.89% -
473.astar -4.22% 166.000 159.000 - 123.94% -
473.astar (avg) -4.22% 166.000 159.000 - 123.94% -
445.gobmk -4.17% 48.000 46.000 - 109.09% -
445.gobmk (avg) -4.17% 48.000 46.000 - 109.09% -
464.h264ref (avg) (percentage) -4.07% 1.230 1.180 - 257.58% -
456.hmmer (avg) (percentage) -4.02% 1.740 1.670 - 363.89% -
470.lbm (max) (percentage) -3.95% 0.760 0.730 - -86.82% -
444.namd (avg) (percentage) -3.83% 2.610 2.510 - -34.12% -
458.sjeng (avg) (percentage) -3.70% 1.080 1.040 - 79.31% -
473.astar (avg) (percentage) -3.70% 3.510 3.380 - 576.00% -
483.xalancbmk (avg) (percentage) -3.59% 4.460 4.300 - 760.00% -
453.povray (max) (percentage) -3.51% 1.140 1.100 - -43.01% -
429.mcf (max) (percentage) -3.45% 1.740 1.680 - 200.00% -
456.hmmer -3.28% 61.000 59.000 - 22.92% -
456.hmmer (avg) -3.28% 61.000 59.000 - 22.92% -
482.sphinx3 (avg) (percentage) -3.24% 1.850 1.790 - -3.76% -
471.omnetpp (avg) (percentage) -3.17% 3.790 3.670 - 370.51% -
458.sjeng (max) (percentage) -3.06% 0.980 0.950 - 137.50% -
464.h264ref -2.99% 67.000 65.000 - 27.45% -
464.h264ref (avg) -2.99% 67.000 65.000 - 27.45% -
471.omnetpp -2.86% 105.000 102.000 - 22.89% -
471.omnetpp (avg) -2.86% 105.000 102.000 - 22.89% -
429.mcf (avg) (percentage) -2.53% 4.340 4.230 - 840.00% -
458.sjeng (max) -2.53% 79.000 77.000 - 18.46% -
470.lbm (avg) (percentage) -2.20% 2.270 2.220 - -4.31% -
447.dealII (max) (percentage) -2.04% 0.490 0.480 - -69.62% -
429.mcf -2.00% 50.000 49.000 - -7.55% -
429.mcf (avg) -2.00% 50.000 49.000 - -7.55% -
462.libquantum (unexplained diff vs previous) (percentage) -1.92% 2.080 2.040 - 1600.00% -
403.gcc (max) (percentage) -1.91% 4.720 4.630 - 1118.42% -
470.lbm -1.41% 71.000 70.000 - -78.26% -
470.lbm (avg) -1.41% 71.000 70.000 - -78.26% -
401.bzip2 (avg) (percentage) -1.35% 0.740 0.730 - 231.82% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.68% 198708.000 202050.000 - 0.02% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 1600.00% 0.120 2.040 - -1.92% -
403.gcc (max) (percentage) 1118.42% 0.380 4.630 - -1.91% -
462.libquantum (avg) (percentage) 1060.00% 0.150 1.740 - 0.58% -
462.libquantum (max) (percentage) 940.00% 0.200 2.080 - 1.96% -
429.mcf (avg) (percentage) 840.00% 0.450 4.230 - -2.53% -
483.xalancbmk (avg) (percentage) 760.00% 0.500 4.300 - -3.59% -
450.soplex (max) (percentage) 642.11% 0.570 4.230 - 171.15% -
450.soplex (unexplained diff vs previous) (percentage) 612.28% 0.570 4.060 - 427.27% -
473.astar (avg) (percentage) 576.00% 0.500 3.380 - -3.70% -
445.gobmk (avg) (percentage) 388.89% 0.180 0.880 - -4.35% -
471.omnetpp (avg) (percentage) 370.51% 0.780 3.670 - -3.17% -
456.hmmer (avg) (percentage) 363.89% 0.360 1.670 - -4.02% -
483.xalancbmk (max) (percentage) 341.54% 0.650 2.870 - -5.90% -
464.h264ref (avg) (percentage) 257.58% 0.330 1.180 - -4.07% -
403.gcc (avg) (percentage) 245.83% 0.480 1.660 - 0.00% -
401.bzip2 (avg) (percentage) 231.82% 0.220 0.730 - -1.35% -
483.xalancbmk 221.28% 47.000 151.000 - -4.43% -
483.xalancbmk (avg) 221.28% 47.000 151.000 - -4.43% -
429.mcf (max) (percentage) 200.00% 0.560 1.680 - -3.45% -
450.soplex (avg) (percentage) 147.22% 0.360 0.890 - 17.11% -
458.sjeng (max) (percentage) 137.50% 0.400 0.950 - -3.06% -
473.astar 123.94% 71.000 159.000 - -4.22% -
473.astar (avg) 123.94% 71.000 159.000 - -4.22% -
429.mcf (unexplained diff vs previous) (percentage) 112.50% 0.560 1.190 - 25.26% -
445.gobmk 109.09% 22.000 46.000 - -4.17% -
445.gobmk (avg) 109.09% 22.000 46.000 - -4.17% -
401.bzip2 (max) (percentage) 90.32% 0.310 0.590 - 59.46% -
401.bzip2 (unexplained diff vs previous) (percentage) 90.32% 0.310 0.590 - 126.92% -
458.sjeng (avg) (percentage) 79.31% 0.580 1.040 - -3.70% -
483.xalancbmk (max) 65.57% 61.000 101.000 - -6.48% -
458.sjeng (unexplained diff vs previous) (percentage) 48.00% 0.250 0.370 - 3600.00% -
456.hmmer (max) (percentage) 30.00% 0.300 0.390 - -7.14% -
464.h264ref 27.45% 51.000 65.000 - -2.99% -
464.h264ref (avg) 27.45% 51.000 65.000 - -2.99% -
456.hmmer 22.92% 48.000 59.000 - -3.28% -
456.hmmer (avg) 22.92% 48.000 59.000 - -3.28% -
471.omnetpp 22.89% 83.000 102.000 - -2.86% -
471.omnetpp (avg) 22.89% 83.000 102.000 - -2.86% -
458.sjeng (max) 18.46% 65.000 77.000 - -2.53% -
453.povray (avg) (percentage) 5.84% 1.370 1.450 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.71% 26756.000 25227.000 - 0.00% -
401.bzip2 -2.74% 39458.000 38377.000 - 0.00% -
453.povray -2.72% 593097.000 576938.000 - -0.00% -
433.milc -2.49% 74971.000 73106.000 - -0.01% -
447.dealII -1.83% 1777992.000 1745483.000 - 0.02% -
482.sphinx3 -1.20% 115736.000 114347.000 - 0.00% -
456.hmmer -1.09% 168072.000 166246.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.37% 9099.000 57.000 - 0.00% -
462.libquantum -99.25% 13126.000 98.000 - 2.08% -
482.sphinx3 -96.65% 26310.000 881.000 - -0.68% -
450.soplex -96.24% 14429.000 542.000 - 4.23% -
444.namd -94.71% 13495.000 714.000 - -0.56% -
453.povray -93.20% 6857.000 466.000 - -0.64% -
433.milc -91.43% 13482.000 1155.000 - -0.77% -
429.mcf -90.19% 11999.000 1177.000 - 1.20% -
401.bzip2 -82.82% 15683.000 2694.000 - -0.59% -
447.dealII -78.59% 8196.000 1755.000 - 0.23% -
470.lbm -77.14% 13882.000 3173.000 - 0.73% -
471.omnetpp -74.08% 10746.000 2785.000 - -0.14% -
456.hmmer -73.36% 13365.000 3560.000 - 0.03% -
473.astar -66.83% 14262.000 4731.000 - -0.27% -
464.h264ref -64.42% 15493.000 5513.000 - 0.15% -
483.xalancbmk -62.58% 9427.000 3528.000 - -0.54% -
445.gobmk -57.68% 12400.000 5248.000 - 0.23% -
458.sjeng -50.48% 16406.000 8124.000 - -0.37% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.52% 828.000 4.000 - -42.86% -
482.sphinx3 (unexplained diff vs previous) -99.34% 904.000 6.000 - -45.45% -
444.namd (max) -99.32% 882.000 6.000 - -25.00% -
482.sphinx3 (max) -98.85% 873.000 10.000 - -9.09% -
433.milc (max) -97.28% 184.000 5.000 - -16.67% -
470.lbm (max) -97.01% 769.000 23.000 - 0.00% -
482.sphinx3 -96.93% 489.000 15.000 - -6.25% -
482.sphinx3 (avg) -96.93% 489.000 15.000 - -6.25% -
444.namd -96.69% 514.000 17.000 - -5.56% -
444.namd (avg) -96.69% 514.000 17.000 - -5.56% -
453.povray (max) -96.21% 132.000 5.000 - 0.00% -
471.omnetpp (max) -95.77% 189.000 8.000 - -69.23% -
471.omnetpp (unexplained diff vs previous) -95.65% 92.000 4.000 - -63.64% -
470.lbm (unexplained diff vs previous) -95.37% 497.000 23.000 - 2200.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
447.dealII (max) -93.80% 129.000 8.000 - 0.00% -
453.povray -93.55% 93.000 6.000 - 0.00% -
453.povray (avg) -93.55% 93.000 6.000 - 0.00% -
433.milc -93.38% 136.000 9.000 - 0.00% -
433.milc (avg) -93.38% 136.000 9.000 - 0.00% -
462.libquantum (max) -92.31% 26.000 2.000 - 100.00% -
450.soplex -92.16% 51.000 4.000 - 33.33% -
450.soplex (avg) -92.16% 51.000 4.000 - 33.33% -
444.namd (unexplained diff vs previous) (percentage) -90.88% 6.140 0.560 - -42.27% -
473.astar (max) -89.47% 114.000 12.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -88.89% 9.000 1.000 - -93.33% -
473.astar (unexplained diff vs previous) -87.96% 108.000 13.000 - 225.00% -
462.libquantum (unexplained diff vs previous) -87.50% 16.000 2.000 - 0.00% -
470.lbm (max) (percentage) -86.82% 5.540 0.730 - -3.95% -
464.h264ref (unexplained diff vs previous) -86.67% 60.000 8.000 - -52.94% -
444.namd (max) (percentage) -86.24% 6.540 0.900 - -28.00% -
447.dealII -85.83% 120.000 17.000 - 0.00% -
447.dealII (avg) -85.83% 120.000 17.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -83.72% 0.860 0.140 - -64.10% -
471.omnetpp (max) (percentage) -82.95% 1.760 0.300 - -68.75% -
482.sphinx3 (unexplained diff vs previous) (percentage) -80.23% 3.440 0.680 - -45.16% -
470.lbm (unexplained diff vs previous) (percentage) -79.89% 3.580 0.720 - 2300.00% -
429.mcf (unexplained diff vs previous) -79.10% 67.000 14.000 - 27.27% -
470.lbm -78.26% 322.000 70.000 - -1.41% -
470.lbm (avg) -78.26% 322.000 70.000 - -1.41% -
464.h264ref (max) -75.00% 60.000 15.000 - -11.76% -
450.soplex (max) -73.17% 82.000 22.000 - 175.00% -
450.soplex (unexplained diff vs previous) -73.17% 82.000 22.000 - 450.00% -
429.mcf (max) -71.64% 67.000 19.000 - -5.00% -
447.dealII (max) (percentage) -69.62% 1.580 0.480 - -2.04% -
483.xalancbmk (unexplained diff vs previous) -68.85% 61.000 19.000 - 137.50% -
401.bzip2 (max) -68.75% 48.000 15.000 - 50.00% -
456.hmmer (max) -67.50% 40.000 13.000 - -7.14% -
401.bzip2 (unexplained diff vs previous) -67.35% 49.000 16.000 - 128.57% -
473.astar (max) (percentage) -66.25% 0.800 0.270 - 3.85% -
482.sphinx3 (max) (percentage) -65.06% 3.320 1.160 - -7.94% -
473.astar (unexplained diff vs previous) (percentage) -64.47% 0.760 0.270 - 237.50% -
433.milc (max) (percentage) -64.23% 1.370 0.490 - -5.77% -
464.h264ref (unexplained diff vs previous) (percentage) -61.54% 0.390 0.150 - -51.61% -
445.gobmk (unexplained diff vs previous) -60.00% 30.000 12.000 - 0.00% -
445.gobmk (max) -58.62% 29.000 12.000 - 20.00% -
456.hmmer (unexplained diff vs previous) (percentage) -57.14% 0.070 0.030 - -92.86% -
401.bzip2 -44.12% 34.000 19.000 - -5.00% -
401.bzip2 (avg) -44.12% 34.000 19.000 - -5.00% -
453.povray (max) (percentage) -43.01% 1.930 1.100 - -3.51% -
444.namd (avg) (percentage) -34.12% 3.810 2.510 - -3.83% -
447.dealII (avg) (percentage) -31.29% 1.470 1.010 - 0.00% -
464.h264ref (max) (percentage) -28.21% 0.390 0.280 - -9.68% -
458.sjeng (unexplained diff vs previous) -26.83% 41.000 30.000 - 2900.00% -
433.milc (avg) (percentage) -22.77% 1.010 0.780 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -16.92% 0.650 0.540 - 134.78% -
458.sjeng -11.58% 95.000 84.000 - -4.55% -
458.sjeng (avg) -11.58% 95.000 84.000 - -4.55% -
429.mcf -7.55% 53.000 49.000 - -2.00% -
429.mcf (avg) -7.55% 53.000 49.000 - -2.00% -
470.lbm (avg) (percentage) -4.31% 2.320 2.220 - -2.20% -
482.sphinx3 (avg) (percentage) -3.76% 1.860 1.790 - -3.24% -

Added Tests - sample variability
403.gcc
403.gcc (avg)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2694.000 -
403.gcc 57.000 -
429.mcf 1177.000 1.20%
433.milc 1155.000 -
444.namd 714.000 -
445.gobmk 5248.000 -
447.dealII 1755.000 -
450.soplex 542.000 4.23%
453.povray 466.000 -
456.hmmer 3560.000 -
458.sjeng 8124.000 -
462.libquantum 98.000 2.08%
464.h264ref 5513.000 -
470.lbm 3173.000 -
471.omnetpp 2785.000 -
473.astar 4731.000 -
482.sphinx3 881.000 -
483.xalancbmk 3528.000 -
Geometric Mean 1439.456 -
Code Size (bytes)
Name Current %
401.bzip2 38377.000 -
403.gcc 1957873.000 -
429.mcf 7914.000 -
433.milc 73106.000 -
444.namd 174897.000 -
445.gobmk 1310240.000 -
447.dealII 1745483.000 -
450.soplex 202050.000 -
453.povray 576938.000 -
456.hmmer 166246.000 -
458.sjeng 96937.000 -
462.libquantum 25227.000 -
464.h264ref 352518.000 -
470.lbm 9734.000 -
471.omnetpp 376643.000 -
473.astar 23123.000 -
482.sphinx3 114347.000 -
483.xalancbmk 2286336.000 -
Geometric Mean 162778.763 -
sample variability
Name Current %
401.bzip2 19.000 -5.00%
401.bzip2 (avg) 19.000 -5.00%
401.bzip2 (avg) (percentage) 0.730 -1.35%
401.bzip2 (max) 15.000 50.00%
401.bzip2 (max) (percentage) 0.590 59.46%
401.bzip2 (unexplained diff vs previous) 16.000 128.57%
401.bzip2 (unexplained diff vs previous) (percentage) 0.590 126.92%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.660 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.630 -1.91%
429.mcf 49.000 -2.00%
429.mcf (avg) 49.000 -2.00%
429.mcf (avg) (percentage) 4.230 -2.53%
429.mcf (max) 19.000 -5.00%
429.mcf (max) (percentage) 1.680 -3.45%
429.mcf (unexplained diff vs previous) 14.000 27.27%
429.mcf (unexplained diff vs previous) (percentage) 1.190 25.26%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.780 -
433.milc (max) 5.000 -16.67%
433.milc (max) (percentage) 0.490 -5.77%
444.namd 17.000 -5.56%
444.namd (avg) 17.000 -5.56%
444.namd (avg) (percentage) 2.510 -3.83%
444.namd (max) 6.000 -25.00%
444.namd (max) (percentage) 0.900 -28.00%
444.namd (unexplained diff vs previous) 4.000 -42.86%
444.namd (unexplained diff vs previous) (percentage) 0.560 -42.27%
445.gobmk 46.000 -4.17%
445.gobmk (avg) 46.000 -4.17%
445.gobmk (avg) (percentage) 0.880 -4.35%
445.gobmk (max) 12.000 20.00%
445.gobmk (max) (percentage) 0.230 15.00%
445.gobmk (unexplained diff vs previous) 12.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.230 -
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.010 -
447.dealII (max) 8.000 -
447.dealII (max) (percentage) 0.480 -2.04%
450.soplex 4.000 33.33%
450.soplex (avg) 4.000 33.33%
450.soplex (avg) (percentage) 0.890 17.11%
450.soplex (max) 22.000 175.00%
450.soplex (max) (percentage) 4.230 171.15%
450.soplex (unexplained diff vs previous) 22.000 450.00%
450.soplex (unexplained diff vs previous) (percentage) 4.060 427.27%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.450 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.100 -3.51%
456.hmmer 59.000 -3.28%
456.hmmer (avg) 59.000 -3.28%
456.hmmer (avg) (percentage) 1.670 -4.02%
456.hmmer (max) 13.000 -7.14%
456.hmmer (max) (percentage) 0.390 -7.14%
456.hmmer (unexplained diff vs previous) 1.000 -93.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.030 -92.86%
458.sjeng 84.000 -4.55%
458.sjeng (avg) 84.000 -4.55%
458.sjeng (avg) (percentage) 1.040 -3.70%
458.sjeng (max) 77.000 -2.53%
458.sjeng (max) (percentage) 0.950 -3.06%
458.sjeng (unexplained diff vs previous) 30.000 2900.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.370 3600.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.740 -
462.libquantum (max) 2.000 100.00%
462.libquantum (max) (percentage) 2.080 1.96%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.040 -1.92%
464.h264ref 65.000 -2.99%
464.h264ref (avg) 65.000 -2.99%
464.h264ref (avg) (percentage) 1.180 -4.07%
464.h264ref (max) 15.000 -11.76%
464.h264ref (max) (percentage) 0.280 -9.68%
464.h264ref (unexplained diff vs previous) 8.000 -52.94%
464.h264ref (unexplained diff vs previous) (percentage) 0.150 -51.61%
470.lbm 70.000 -1.41%
470.lbm (avg) 70.000 -1.41%
470.lbm (avg) (percentage) 2.220 -2.20%
470.lbm (max) 23.000 -
470.lbm (max) (percentage) 0.730 -3.95%
470.lbm (unexplained diff vs previous) 23.000 2200.00%
470.lbm (unexplained diff vs previous) (percentage) 0.720 2300.00%
471.omnetpp 102.000 -2.86%
471.omnetpp (avg) 102.000 -2.86%
471.omnetpp (avg) (percentage) 3.670 -3.17%
471.omnetpp (max) 8.000 -69.23%
471.omnetpp (max) (percentage) 0.300 -68.75%
471.omnetpp (unexplained diff vs previous) 4.000 -63.64%
471.omnetpp (unexplained diff vs previous) (percentage) 0.140 -64.10%
473.astar 159.000 -4.22%
473.astar (avg) 159.000 -4.22%
473.astar (avg) (percentage) 3.380 -3.70%
473.astar (max) 12.000 -
473.astar (max) (percentage) 0.270 3.85%
473.astar (unexplained diff vs previous) 13.000 225.00%
473.astar (unexplained diff vs previous) (percentage) 0.270 237.50%
482.sphinx3 15.000 -6.25%
482.sphinx3 (avg) 15.000 -6.25%
482.sphinx3 (avg) (percentage) 1.790 -3.24%
482.sphinx3 (max) 10.000 -9.09%
482.sphinx3 (max) (percentage) 1.160 -7.94%
482.sphinx3 (unexplained diff vs previous) 6.000 -45.45%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.680 -45.16%
483.xalancbmk 151.000 -4.43%
483.xalancbmk (avg) 151.000 -4.43%
483.xalancbmk (avg) (percentage) 4.300 -3.59%
483.xalancbmk (max) 101.000 -6.48%
483.xalancbmk (max) (percentage) 2.870 -5.90%
483.xalancbmk (unexplained diff vs previous) 19.000 137.50%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.540 134.78%
Geometric Mean 3.969 -10.00%