Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a5f54175dcf120180c3d91bbc13062bbf8f42f61 (+ 167 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/145/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0145 (llvmorg-19-init-08215-ga5f54175dcf1) 2024-04-10T16:35:40 0:00:00
Previous 0144 (llvmorg-19-init-08048-g4036a6946e54) 2024-04-06T10:50:15 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 23 27
Performance Improvements 53 121
Added Tests 11 1
Unchanged Tests 693 631
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
447.dealII 1.07% 1783.000 1802.000 - -78.01% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 300.00% 1.000 4.000 - -95.65% -
471.omnetpp (unexplained diff vs previous) (percentage) 250.00% 0.040 0.140 - -83.72% -
445.gobmk (unexplained diff vs previous) 200.00% 4.000 12.000 - -60.00% -
445.gobmk (unexplained diff vs previous) (percentage) 187.50% 0.080 0.230 - -4.17% -
450.soplex (unexplained diff vs previous) (percentage) 102.63% 0.760 1.540 - 170.18% -
450.soplex (unexplained diff vs previous) 100.00% 4.000 8.000 - -90.24% -
433.milc (max) (percentage) 67.31% 0.520 0.870 - -36.50% -
433.milc (unexplained diff vs previous) (percentage) 67.31% 0.520 0.870 - -35.56% -
433.milc (unexplained diff vs previous) 66.67% 6.000 10.000 - -94.51% -
433.milc (max) 50.00% 6.000 9.000 - -95.11% -
473.astar (max) 45.83% 24.000 35.000 - -69.30% -
473.astar (max) (percentage) 45.10% 0.510 0.740 - -7.50% -
473.astar (unexplained diff vs previous) (percentage) 45.10% 0.510 0.740 - -2.63% -
473.astar (unexplained diff vs previous) 44.00% 25.000 36.000 - -66.67% -
445.gobmk (max) 33.33% 9.000 12.000 - -58.62% -
445.gobmk (max) (percentage) 21.05% 0.190 0.230 - -4.17% -
458.sjeng (max) 18.18% 11.000 13.000 - -80.00% -
458.sjeng (max) (percentage) 14.29% 0.140 0.160 - -60.00% -
450.soplex (max) (percentage) 11.76% 1.360 1.520 - 166.67% -
447.dealII (max) 5.56% 18.000 19.000 - -85.27% -
447.dealII (max) (percentage) 4.90% 1.020 1.070 - -32.28% -
447.dealII (avg) (percentage) 3.13% 0.640 0.660 - -55.10% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.39% 59.000 57.000 - -99.37% -
450.soplex -1.52% 526.000 518.000 - -96.41% -
462.libquantum -1.01% 99.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) -77.78% 18.000 4.000 - -99.20% -
470.lbm (unexplained diff vs previous) (percentage) -77.19% 0.570 0.130 - -96.37% -
401.bzip2 (unexplained diff vs previous) (percentage) -65.08% 0.630 0.220 - -29.03% -
401.bzip2 (unexplained diff vs previous) -64.71% 17.000 6.000 - -87.76% -
429.mcf (unexplained diff vs previous) -62.50% 8.000 3.000 - -95.52% -
429.mcf (unexplained diff vs previous) (percentage) -62.32% 0.690 0.260 - -53.57% -
456.hmmer (unexplained diff vs previous) (percentage) -56.90% 1.160 0.500 - 614.29% -
483.xalancbmk (unexplained diff vs previous) (percentage) -56.38% 0.940 0.410 - -36.92% -
456.hmmer (unexplained diff vs previous) -56.10% 41.000 18.000 - 100.00% -
483.xalancbmk (unexplained diff vs previous) -55.88% 34.000 15.000 - -75.41% -
483.xalancbmk (max) -51.92% 52.000 25.000 - -59.02% -
483.xalancbmk (max) (percentage) -51.72% 1.450 0.700 - 7.69% -
429.mcf (max) -50.00% 12.000 6.000 - -91.04% -
429.mcf (max) (percentage) -43.93% 1.070 0.600 - 7.14% -
444.namd (unexplained diff vs previous) (percentage) -40.58% 0.690 0.410 - -93.32% -
444.namd (unexplained diff vs previous) -40.00% 5.000 3.000 - -99.64% -
462.libquantum (max) (percentage) -33.99% 1.530 1.010 - 405.00% -
403.gcc (max) -20.00% 5.000 4.000 - -88.24% -
470.lbm (max) -17.65% 17.000 14.000 - -98.18% -
470.lbm (max) (percentage) -17.54% 0.570 0.470 - -91.52% -
403.gcc (max) (percentage) -13.55% 10.110 8.740 - 2200.00% -
444.namd (max) (percentage) -8.43% 0.830 0.760 - -88.38% -
456.hmmer (max) -7.50% 40.000 37.000 - -7.50% -
471.omnetpp (max) -7.41% 54.000 50.000 - -73.54% -
456.hmmer (max) (percentage) -7.02% 1.140 1.060 - 253.33% -
401.bzip2 (max) (percentage) -6.80% 1.030 0.960 - 209.68% -
471.omnetpp (max) (percentage) -6.67% 1.950 1.820 - 3.41% -
464.h264ref (max) (percentage) -5.26% 0.380 0.360 - -7.69% -
464.h264ref (max) -4.76% 21.000 20.000 - -66.67% -
456.hmmer -4.17% 24.000 23.000 - -52.08% -
456.hmmer (avg) -4.17% 24.000 23.000 - -52.08% -
482.sphinx3 (max) (percentage) -3.80% 0.790 0.760 - -77.11% -
401.bzip2 (max) -3.70% 27.000 26.000 - -45.83% -
464.h264ref -3.33% 30.000 29.000 - -43.14% -
464.h264ref (avg) -3.33% 30.000 29.000 - -43.14% -
458.sjeng -2.78% 36.000 35.000 - -63.16% -
458.sjeng (avg) -2.78% 36.000 35.000 - -63.16% -
458.sjeng (avg) (percentage) -2.27% 0.440 0.430 - -25.86% -
453.povray (max) (percentage) -2.20% 0.910 0.890 - -53.89% -
471.omnetpp -2.08% 48.000 47.000 - -43.37% -
471.omnetpp (avg) -2.08% 48.000 47.000 - -43.37% -
429.mcf (avg) (percentage) -1.97% 2.030 1.990 - 342.22% -
482.sphinx3 (avg) (percentage) -1.92% 1.040 1.020 - -45.16% -
464.h264ref (avg) (percentage) -1.85% 0.540 0.530 - 60.61% -
473.astar -1.79% 56.000 55.000 - -22.54% -
473.astar (avg) -1.79% 56.000 55.000 - -22.54% -
471.omnetpp (avg) (percentage) -1.72% 1.740 1.710 - 119.23% -
401.bzip2 (avg) (percentage) -1.69% 0.590 0.580 - 163.64% -
444.namd (avg) (percentage) -1.49% 1.340 1.320 - -65.35% -
456.hmmer (avg) (percentage) -1.47% 0.680 0.670 - 86.11% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
462.libquantum (max)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.22% 39458.000 40333.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 2200.00% 0.380 8.740 - -13.55% -
403.gcc (unexplained diff vs previous) (percentage) 848.65% 0.370 3.510 - 0.00% -
462.libquantum (avg) (percentage) 766.67% 0.150 1.300 - -0.76% -
462.libquantum (unexplained diff vs previous) (percentage) 750.00% 0.120 1.020 - 0.99% -
403.gcc (avg) (percentage) 685.42% 0.480 3.770 - -0.53% -
456.hmmer (unexplained diff vs previous) (percentage) 614.29% 0.070 0.500 - -56.90% -
462.libquantum (max) (percentage) 405.00% 0.200 1.010 - -33.99% -
429.mcf (avg) (percentage) 342.22% 0.450 1.990 - -1.97% -
456.hmmer (max) (percentage) 253.33% 0.300 1.060 - -7.02% -
450.soplex (avg) (percentage) 241.67% 0.360 1.230 - 0.82% -
401.bzip2 (max) (percentage) 209.68% 0.310 0.960 - -6.80% -
483.xalancbmk (avg) (percentage) 184.00% 0.500 1.420 - -0.70% -
450.soplex (unexplained diff vs previous) (percentage) 170.18% 0.570 1.540 - 102.63% -
450.soplex (max) (percentage) 166.67% 0.570 1.520 - 11.76% -
401.bzip2 (avg) (percentage) 163.64% 0.220 0.580 - -1.69% -
473.astar (avg) (percentage) 130.00% 0.500 1.150 - 0.00% -
445.gobmk (avg) (percentage) 127.78% 0.180 0.410 - 0.00% -
471.omnetpp (avg) (percentage) 119.23% 0.780 1.710 - -1.72% -
456.hmmer (unexplained diff vs previous) 100.00% 9.000 18.000 - -56.10% -
456.hmmer (avg) (percentage) 86.11% 0.360 0.670 - -1.47% -
464.h264ref (avg) (percentage) 60.61% 0.330 0.530 - -1.85% -
483.xalancbmk 8.51% 47.000 51.000 - 0.00% -
483.xalancbmk (avg) 8.51% 47.000 51.000 - 0.00% -
483.xalancbmk (max) (percentage) 7.69% 0.650 0.700 - -51.72% -
429.mcf (max) (percentage) 7.14% 0.560 0.600 - -43.93% -
471.omnetpp (max) (percentage) 3.41% 1.760 1.820 - -6.67% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.47% 26756.000 23955.000 - 0.00% -
444.namd -3.21% 175160.000 169537.000 - 0.00% -
447.dealII -2.86% 1777992.000 1727183.000 - 0.00% -
453.povray -2.79% 593097.000 576526.000 - 0.01% -
433.milc -2.77% 74971.000 72894.000 - 0.00% -
464.h264ref -1.44% 354618.000 349518.000 - 0.00% -
482.sphinx3 -1.36% 115736.000 114159.000 - 0.00% -
429.mcf -1.02% 7915.000 7834.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.37% 9099.000 57.000 - -3.39% -
462.libquantum -99.25% 13126.000 98.000 - -1.01% -
482.sphinx3 -96.64% 26310.000 884.000 - 0.45% -
450.soplex -96.41% 14429.000 518.000 - -1.52% -
444.namd -94.63% 13495.000 725.000 - 0.42% -
453.povray -93.20% 6857.000 466.000 - -0.21% -
433.milc -91.51% 13482.000 1144.000 - -0.87% -
429.mcf -90.30% 11999.000 1164.000 - -0.26% -
401.bzip2 -82.73% 15683.000 2709.000 - 0.22% -
447.dealII -78.01% 8196.000 1802.000 - 1.07% -
470.lbm -77.29% 13882.000 3153.000 - -0.13% -
471.omnetpp -74.06% 10746.000 2787.000 - 0.14% -
456.hmmer -73.32% 13365.000 3566.000 - 0.51% -
473.astar -66.01% 14262.000 4848.000 - -0.74% -
464.h264ref -64.03% 15493.000 5573.000 - 0.04% -
483.xalancbmk -61.61% 9427.000 3619.000 - -0.41% -
445.gobmk -57.61% 12400.000 5256.000 - 0.23% -
458.sjeng -49.95% 16406.000 8212.000 - -0.16% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.64% 828.000 3.000 - -40.00% -
482.sphinx3 (unexplained diff vs previous) -99.56% 904.000 4.000 - 0.00% -
444.namd (max) -99.43% 882.000 5.000 - 0.00% -
482.sphinx3 (max) -99.31% 873.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) -99.20% 497.000 4.000 - -77.78% -
444.namd -98.25% 514.000 9.000 - 0.00% -
444.namd (avg) -98.25% 514.000 9.000 - 0.00% -
470.lbm (max) -98.18% 769.000 14.000 - -17.65% -
482.sphinx3 -98.16% 489.000 9.000 - 0.00% -
482.sphinx3 (avg) -98.16% 489.000 9.000 - 0.00% -
453.povray (max) -96.97% 132.000 4.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -96.67% 60.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -96.37% 3.580 0.130 - -77.19% -
471.omnetpp (unexplained diff vs previous) -95.65% 92.000 4.000 - 300.00% -
429.mcf (unexplained diff vs previous) -95.52% 67.000 3.000 - -62.50% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc (max) -95.11% 184.000 9.000 - 50.00% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
433.milc (unexplained diff vs previous) -94.51% 182.000 10.000 - 66.67% -
403.gcc (unexplained diff vs previous) -94.12% 34.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -93.32% 6.140 0.410 - -40.58% -
470.lbm (max) (percentage) -91.52% 5.540 0.470 - -17.54% -
450.soplex (max) -91.46% 82.000 7.000 - 0.00% -
429.mcf (max) -91.04% 67.000 6.000 - -50.00% -
447.dealII -90.83% 120.000 11.000 - 0.00% -
447.dealII (avg) -90.83% 120.000 11.000 - 0.00% -
470.lbm -90.37% 322.000 31.000 - 0.00% -
470.lbm (avg) -90.37% 322.000 31.000 - 0.00% -
450.soplex (unexplained diff vs previous) -90.24% 82.000 8.000 - 100.00% -
464.h264ref (unexplained diff vs previous) (percentage) -89.74% 0.390 0.040 - 0.00% -
444.namd (max) (percentage) -88.38% 6.540 0.760 - -8.43% -
403.gcc (max) -88.24% 34.000 4.000 - -20.00% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -87.76% 49.000 6.000 - -64.71% -
482.sphinx3 (unexplained diff vs previous) (percentage) -86.92% 3.440 0.450 - 0.00% -
447.dealII (max) -85.27% 129.000 19.000 - 5.56% -
447.dealII (unexplained diff vs previous) -84.30% 121.000 19.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -83.72% 0.860 0.140 - 250.00% -
458.sjeng (max) -80.00% 65.000 13.000 - 18.18% -
482.sphinx3 (max) (percentage) -77.11% 3.320 0.760 - -3.80% -
483.xalancbmk (unexplained diff vs previous) -75.41% 61.000 15.000 - -55.88% -
471.omnetpp (max) -73.54% 189.000 50.000 - -7.41% -
473.astar (max) -69.30% 114.000 35.000 - 45.83% -
458.sjeng (unexplained diff vs previous) -68.29% 41.000 13.000 - 0.00% -
464.h264ref (max) -66.67% 60.000 20.000 - -4.76% -
473.astar (unexplained diff vs previous) -66.67% 108.000 36.000 - 44.00% -
444.namd (avg) (percentage) -65.35% 3.810 1.320 - -1.49% -
458.sjeng -63.16% 95.000 35.000 - -2.78% -
458.sjeng (avg) -63.16% 95.000 35.000 - -2.78% -
445.gobmk (unexplained diff vs previous) -60.00% 30.000 12.000 - 200.00% -
458.sjeng (max) (percentage) -60.00% 0.400 0.160 - 14.29% -
483.xalancbmk (max) -59.02% 61.000 25.000 - -51.92% -
445.gobmk (max) -58.62% 29.000 12.000 - 33.33% -
470.lbm (avg) (percentage) -56.90% 2.320 1.000 - -0.99% -
429.mcf -56.60% 53.000 23.000 - 0.00% -
429.mcf (avg) -56.60% 53.000 23.000 - 0.00% -
401.bzip2 -55.88% 34.000 15.000 - 0.00% -
401.bzip2 (avg) -55.88% 34.000 15.000 - 0.00% -
447.dealII (avg) (percentage) -55.10% 1.470 0.660 - 3.13% -
453.povray (max) (percentage) -53.89% 1.930 0.890 - -2.20% -
429.mcf (unexplained diff vs previous) (percentage) -53.57% 0.560 0.260 - -62.32% -
456.hmmer -52.08% 48.000 23.000 - -4.17% -
456.hmmer (avg) -52.08% 48.000 23.000 - -4.17% -
401.bzip2 (max) -45.83% 48.000 26.000 - -3.70% -
482.sphinx3 (avg) (percentage) -45.16% 1.860 1.020 - -1.92% -
471.omnetpp -43.37% 83.000 47.000 - -2.08% -
471.omnetpp (avg) -43.37% 83.000 47.000 - -2.08% -
464.h264ref -43.14% 51.000 29.000 - -3.33% -
464.h264ref (avg) -43.14% 51.000 29.000 - -3.33% -
483.xalancbmk (unexplained diff vs previous) (percentage) -36.92% 0.650 0.410 - -56.38% -
433.milc (avg) (percentage) -36.63% 1.010 0.640 - 0.00% -
433.milc (max) (percentage) -36.50% 1.370 0.870 - 67.31% -
458.sjeng (unexplained diff vs previous) (percentage) -36.00% 0.250 0.160 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -35.56% 1.350 0.870 - 67.31% -
447.dealII (max) (percentage) -32.28% 1.580 1.070 - 4.90% -
447.dealII (unexplained diff vs previous) (percentage) -29.05% 1.480 1.050 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -29.03% 0.310 0.220 - -65.08% -
458.sjeng (avg) (percentage) -25.86% 0.580 0.430 - -2.27% -
473.astar -22.54% 71.000 55.000 - -1.79% -
473.astar (avg) -22.54% 71.000 55.000 - -1.79% -
453.povray (avg) (percentage) -19.71% 1.370 1.100 - 0.00% -
464.h264ref (max) (percentage) -7.69% 0.390 0.360 - -5.26% -
473.astar (max) (percentage) -7.50% 0.800 0.740 - 45.10% -
456.hmmer (max) -7.50% 40.000 37.000 - -7.50% -
445.gobmk -4.55% 22.000 21.000 - 0.00% -
445.gobmk (avg) -4.55% 22.000 21.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -2.63% 0.760 0.740 - 45.10% -

Added Tests - sample variability
462.libquantum (max)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2709.000 -
403.gcc 57.000 -3.39%
429.mcf 1164.000 -
433.milc 1144.000 -
444.namd 725.000 -
445.gobmk 5256.000 -
447.dealII 1802.000 1.07%
450.soplex 518.000 -1.52%
453.povray 466.000 -
456.hmmer 3566.000 -
458.sjeng 8212.000 -
462.libquantum 98.000 -1.01%
464.h264ref 5573.000 -
470.lbm 3153.000 -
471.omnetpp 2787.000 -
473.astar 4848.000 -
482.sphinx3 884.000 -
483.xalancbmk 3619.000 -
Geometric Mean 1443.765 -
Code Size (bytes)
Name Current %
401.bzip2 40333.000 -
403.gcc 1954713.000 -
429.mcf 7834.000 -
433.milc 72894.000 -
444.namd 169537.000 -
445.gobmk 1308216.000 -
447.dealII 1727183.000 -
450.soplex 198335.000 -
453.povray 576526.000 -
456.hmmer 166422.000 -
458.sjeng 96893.000 -
462.libquantum 23955.000 -
464.h264ref 349518.000 -
470.lbm 9702.000 -
471.omnetpp 376219.000 -
473.astar 23315.000 -
482.sphinx3 114159.000 -
483.xalancbmk 2284952.000 -
Geometric Mean 162007.102 -
sample variability
Name Current %
401.bzip2 15.000 -
401.bzip2 (avg) 15.000 -
401.bzip2 (avg) (percentage) 0.580 -1.69%
401.bzip2 (max) 26.000 -3.70%
401.bzip2 (max) (percentage) 0.960 -6.80%
401.bzip2 (unexplained diff vs previous) 6.000 -64.71%
401.bzip2 (unexplained diff vs previous) (percentage) 0.220 -65.08%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.770 -
403.gcc (max) 4.000 -20.00%
403.gcc (max) (percentage) 8.740 -13.55%
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 3.510 -
429.mcf 23.000 -
429.mcf (avg) 23.000 -
429.mcf (avg) (percentage) 1.990 -1.97%
429.mcf (max) 6.000 -50.00%
429.mcf (max) (percentage) 0.600 -43.93%
429.mcf (unexplained diff vs previous) 3.000 -62.50%
429.mcf (unexplained diff vs previous) (percentage) 0.260 -62.32%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 -
433.milc (max) 9.000 50.00%
433.milc (max) (percentage) 0.870 67.31%
433.milc (unexplained diff vs previous) 10.000 66.67%
433.milc (unexplained diff vs previous) (percentage) 0.870 67.31%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.320 -1.49%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.760 -8.43%
444.namd (unexplained diff vs previous) 3.000 -40.00%
444.namd (unexplained diff vs previous) (percentage) 0.410 -40.58%
445.gobmk 21.000 -
445.gobmk (avg) 21.000 -
445.gobmk (avg) (percentage) 0.410 -
445.gobmk (max) 12.000 33.33%
445.gobmk (max) (percentage) 0.230 21.05%
445.gobmk (unexplained diff vs previous) 12.000 200.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.230 187.50%
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 0.660 3.13%
447.dealII (max) 19.000 5.56%
447.dealII (max) (percentage) 1.070 4.90%
447.dealII (unexplained diff vs previous) 19.000 -
447.dealII (unexplained diff vs previous) (percentage) 1.050 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.230 -
450.soplex (max) 7.000 -
450.soplex (max) (percentage) 1.520 11.76%
450.soplex (unexplained diff vs previous) 8.000 100.00%
450.soplex (unexplained diff vs previous) (percentage) 1.540 102.63%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.100 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.890 -2.20%
456.hmmer 23.000 -4.17%
456.hmmer (avg) 23.000 -4.17%
456.hmmer (avg) (percentage) 0.670 -1.47%
456.hmmer (max) 37.000 -7.50%
456.hmmer (max) (percentage) 1.060 -7.02%
456.hmmer (unexplained diff vs previous) 18.000 -56.10%
456.hmmer (unexplained diff vs previous) (percentage) 0.500 -56.90%
458.sjeng 35.000 -2.78%
458.sjeng (avg) 35.000 -2.78%
458.sjeng (avg) (percentage) 0.430 -2.27%
458.sjeng (max) 13.000 18.18%
458.sjeng (max) (percentage) 0.160 14.29%
458.sjeng (unexplained diff vs previous) 13.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.160 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.300 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 1.010 -33.99%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.020 -
464.h264ref 29.000 -3.33%
464.h264ref (avg) 29.000 -3.33%
464.h264ref (avg) (percentage) 0.530 -1.85%
464.h264ref (max) 20.000 -4.76%
464.h264ref (max) (percentage) 0.360 -5.26%
464.h264ref (unexplained diff vs previous) 2.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.040 -
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 1.000 -
470.lbm (max) 14.000 -17.65%
470.lbm (max) (percentage) 0.470 -17.54%
470.lbm (unexplained diff vs previous) 4.000 -77.78%
470.lbm (unexplained diff vs previous) (percentage) 0.130 -77.19%
471.omnetpp 47.000 -2.08%
471.omnetpp (avg) 47.000 -2.08%
471.omnetpp (avg) (percentage) 1.710 -1.72%
471.omnetpp (max) 50.000 -7.41%
471.omnetpp (max) (percentage) 1.820 -6.67%
471.omnetpp (unexplained diff vs previous) 4.000 300.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.140 250.00%
473.astar 55.000 -1.79%
473.astar (avg) 55.000 -1.79%
473.astar (avg) (percentage) 1.150 -
473.astar (max) 35.000 45.83%
473.astar (max) (percentage) 0.740 45.10%
473.astar (unexplained diff vs previous) 36.000 44.00%
473.astar (unexplained diff vs previous) (percentage) 0.740 45.10%
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.020 -1.92%
482.sphinx3 (max) 6.000 -
482.sphinx3 (max) (percentage) 0.760 -3.80%
482.sphinx3 (unexplained diff vs previous) 4.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.450 -
483.xalancbmk 51.000 -
483.xalancbmk (avg) 51.000 -
483.xalancbmk (avg) (percentage) 1.420 -
483.xalancbmk (max) 25.000 -51.92%
483.xalancbmk (max) (percentage) 0.700 -51.72%
483.xalancbmk (unexplained diff vs previous) 15.000 -55.88%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.410 -56.38%
Geometric Mean 3.088 -18.85%