Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/097b68ff067565af744b5b0327732d7c199710ab (+ 440 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/146/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0146 (llvmorg-19-init-08655-g097b68ff0675) 2024-04-14T09:10:05 0:00:00
Previous 0145 (llvmorg-19-init-08215-ga5f54175dcf1) 2024-04-10T16:35:40 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 10 21
Performance Improvements 69 119
Added Tests 1 1
Unchanged Tests 700 639
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 1.75% 57.000 58.000 - -99.36% -
462.libquantum 1.02% 98.000 99.000 - -99.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
470.lbm (unexplained diff vs previous) 425.00% 4.000 21.000 - -95.77% -
470.lbm (unexplained diff vs previous) (percentage) 407.69% 0.130 0.660 - -81.56% -
464.h264ref (unexplained diff vs previous) 100.00% 2.000 4.000 - -93.33% -
464.h264ref (unexplained diff vs previous) (percentage) 75.00% 0.040 0.070 - -82.05% -
470.lbm (max) 50.00% 14.000 21.000 - -97.27% -
470.lbm (max) (percentage) 42.55% 0.470 0.670 - -87.91% -
429.mcf (unexplained diff vs previous) 33.33% 3.000 4.000 - -94.03% -
429.mcf (unexplained diff vs previous) (percentage) 30.77% 0.260 0.340 - -39.29% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) -91.67% 12.000 1.000 - -96.67% -
445.gobmk (unexplained diff vs previous) (percentage) -91.30% 0.230 0.020 - -91.67% -
482.sphinx3 (unexplained diff vs previous) (percentage) -75.56% 0.450 0.110 - -96.80% -
482.sphinx3 (unexplained diff vs previous) -75.00% 4.000 1.000 - -99.89% -
444.namd (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.88% -
444.namd (unexplained diff vs previous) (percentage) -65.85% 0.410 0.140 - -97.72% -
450.soplex (unexplained diff vs previous) -62.50% 8.000 3.000 - -96.34% -
450.soplex (unexplained diff vs previous) (percentage) -62.34% 1.540 0.580 - 1.75% -
456.hmmer (unexplained diff vs previous) -61.11% 18.000 7.000 - -22.22% -
456.hmmer (unexplained diff vs previous) (percentage) -60.00% 0.500 0.200 - 185.71% -
473.astar (unexplained diff vs previous) -55.56% 36.000 16.000 - -85.19% -
473.astar (unexplained diff vs previous) (percentage) -55.41% 0.740 0.330 - -56.58% -
471.omnetpp (max) (percentage) -50.55% 1.820 0.900 - -48.86% -
471.omnetpp (max) -50.00% 50.000 25.000 - -86.77% -
471.omnetpp (unexplained diff vs previous) -50.00% 4.000 2.000 - -97.83% -
471.omnetpp (unexplained diff vs previous) (percentage) -50.00% 0.140 0.070 - -91.86% -
483.xalancbmk (unexplained diff vs previous) -46.67% 15.000 8.000 - -86.89% -
483.xalancbmk (unexplained diff vs previous) (percentage) -46.34% 0.410 0.220 - -66.15% -
458.sjeng (unexplained diff vs previous) (percentage) -31.25% 0.160 0.110 - -56.00% -
458.sjeng (unexplained diff vs previous) -30.77% 13.000 9.000 - -78.05% -
458.sjeng (max) -15.38% 13.000 11.000 - -83.08% -
450.soplex (max) -14.29% 7.000 6.000 - -92.68% -
462.libquantum (max) (percentage) -12.87% 1.010 0.880 - 340.00% -
450.soplex (max) (percentage) -12.50% 1.520 1.330 - 133.33% -
458.sjeng (max) (percentage) -12.50% 0.160 0.140 - -65.00% -
483.xalancbmk (max) -12.00% 25.000 22.000 - -63.93% -
482.sphinx3 -11.11% 9.000 8.000 - -98.36% -
482.sphinx3 (avg) -11.11% 9.000 8.000 - -98.36% -
483.xalancbmk (max) (percentage) -10.00% 0.700 0.630 - -3.08% -
473.astar (max) (percentage) -9.46% 0.740 0.670 - -16.25% -
445.gobmk (max) (percentage) -8.70% 0.230 0.210 - -12.50% -
473.astar (max) -8.57% 35.000 32.000 - -71.93% -
445.gobmk (max) -8.33% 12.000 11.000 - -62.07% -
429.mcf (max) (percentage) -8.33% 0.600 0.550 - -1.79% -
433.milc (max) (percentage) -8.05% 0.870 0.800 - -41.61% -
401.bzip2 (max) -7.69% 26.000 24.000 - -50.00% -
456.hmmer (max) (percentage) -5.66% 1.060 1.000 - 233.33% -
456.hmmer (max) -5.41% 37.000 35.000 - -12.50% -
447.dealII (max) -5.26% 19.000 18.000 - -86.05% -
401.bzip2 (max) (percentage) -5.21% 0.960 0.910 - 193.55% -
464.h264ref (max) -5.00% 20.000 19.000 - -68.33% -
429.mcf -4.35% 23.000 22.000 - -58.49% -
429.mcf (avg) -4.35% 23.000 22.000 - -58.49% -
482.sphinx3 (max) (percentage) -3.95% 0.760 0.730 - -78.01% -
447.dealII (max) (percentage) -3.74% 1.070 1.030 - -34.81% -
464.h264ref -3.45% 29.000 28.000 - -45.10% -
464.h264ref (avg) -3.45% 29.000 28.000 - -45.10% -
458.sjeng -2.86% 35.000 34.000 - -64.21% -
458.sjeng (avg) -2.86% 35.000 34.000 - -64.21% -
464.h264ref (max) (percentage) -2.78% 0.360 0.350 - -10.26% -
458.sjeng (avg) (percentage) -2.33% 0.430 0.420 - -27.59% -
471.omnetpp -2.13% 47.000 46.000 - -44.58% -
471.omnetpp (avg) -2.13% 47.000 46.000 - -44.58% -
483.xalancbmk (avg) (percentage) -2.11% 1.420 1.390 - 178.00% -
482.sphinx3 (avg) (percentage) -1.96% 1.020 1.000 - -46.24% -
483.xalancbmk -1.96% 51.000 50.000 - 6.38% -
483.xalancbmk (avg) -1.96% 51.000 50.000 - 6.38% -
464.h264ref (avg) (percentage) -1.89% 0.530 0.520 - 57.58% -
473.astar -1.82% 55.000 54.000 - -23.94% -
473.astar (avg) -1.82% 55.000 54.000 - -23.94% -
471.omnetpp (avg) (percentage) -1.75% 1.710 1.680 - 115.38% -
473.astar (avg) (percentage) -1.74% 1.150 1.130 - 126.00% -
444.namd (avg) (percentage) -1.52% 1.320 1.300 - -65.88% -
429.mcf (avg) (percentage) -1.51% 1.990 1.960 - 335.56% -
456.hmmer (avg) (percentage) -1.49% 0.670 0.660 - 83.33% -
403.gcc (max) (percentage) -1.49% 8.740 8.610 - 2165.79% -
444.namd (max) (percentage) -1.32% 0.760 0.750 - -88.53% -
453.povray (max) (percentage) -1.12% 0.890 0.880 - -54.40% -
470.lbm (avg) (percentage) -1.00% 1.000 0.990 - -57.33% -

Added Tests - sample variability
462.libquantum (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.22% 39458.000 40333.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 2165.79% 0.380 8.610 - -1.49% -
462.libquantum (avg) (percentage) 766.67% 0.150 1.300 - 0.00% -
403.gcc (avg) (percentage) 685.42% 0.480 3.770 - 0.00% -
462.libquantum (max) (percentage) 340.00% 0.200 0.880 - -12.87% -
429.mcf (avg) (percentage) 335.56% 0.450 1.960 - -1.51% -
450.soplex (avg) (percentage) 238.89% 0.360 1.220 - -0.81% -
456.hmmer (max) (percentage) 233.33% 0.300 1.000 - -5.66% -
401.bzip2 (max) (percentage) 193.55% 0.310 0.910 - -5.21% -
456.hmmer (unexplained diff vs previous) (percentage) 185.71% 0.070 0.200 - -60.00% -
483.xalancbmk (avg) (percentage) 178.00% 0.500 1.390 - -2.11% -
401.bzip2 (avg) (percentage) 163.64% 0.220 0.580 - 0.00% -
450.soplex (max) (percentage) 133.33% 0.570 1.330 - -12.50% -
473.astar (avg) (percentage) 126.00% 0.500 1.130 - -1.74% -
445.gobmk (avg) (percentage) 122.22% 0.180 0.400 - -2.44% -
471.omnetpp (avg) (percentage) 115.38% 0.780 1.680 - -1.75% -
456.hmmer (avg) (percentage) 83.33% 0.360 0.660 - -1.49% -
464.h264ref (avg) (percentage) 57.58% 0.330 0.520 - -1.89% -
483.xalancbmk 6.38% 47.000 50.000 - -1.96% -
483.xalancbmk (avg) 6.38% 47.000 50.000 - -1.96% -
450.soplex (unexplained diff vs previous) (percentage) 1.75% 0.570 0.580 - -62.34% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.56% 26756.000 23931.000 - -0.10% -
444.namd -3.21% 175160.000 169537.000 - 0.00% -
447.dealII -2.86% 1777992.000 1727167.000 - -0.00% -
433.milc -2.81% 74971.000 72866.000 - -0.04% -
453.povray -2.80% 593097.000 576486.000 - -0.01% -
464.h264ref -1.38% 354618.000 349710.000 - 0.05% -
482.sphinx3 -1.36% 115736.000 114159.000 - 0.00% -
429.mcf -1.02% 7915.000 7834.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - 1.75% -
462.libquantum -99.25% 13126.000 99.000 - 1.02% -
482.sphinx3 -96.64% 26310.000 885.000 - 0.11% -
450.soplex -96.43% 14429.000 515.000 - -0.58% -
444.namd -94.64% 13495.000 724.000 - -0.14% -
453.povray -93.23% 6857.000 464.000 - -0.43% -
433.milc -91.52% 13482.000 1143.000 - -0.09% -
429.mcf -90.33% 11999.000 1160.000 - -0.34% -
401.bzip2 -82.70% 15683.000 2713.000 - 0.15% -
447.dealII -78.20% 8196.000 1787.000 - -0.83% -
470.lbm -77.14% 13882.000 3174.000 - 0.67% -
471.omnetpp -74.08% 10746.000 2785.000 - -0.07% -
456.hmmer -73.37% 13365.000 3559.000 - -0.20% -
473.astar -65.90% 14262.000 4864.000 - 0.33% -
464.h264ref -64.05% 15493.000 5569.000 - -0.07% -
483.xalancbmk -61.53% 9427.000 3627.000 - 0.22% -
445.gobmk -57.62% 12400.000 5255.000 - -0.02% -
458.sjeng -50.00% 16406.000 8203.000 - -0.11% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.89% 904.000 1.000 - -75.00% -
444.namd (unexplained diff vs previous) -99.88% 828.000 1.000 - -66.67% -
444.namd (max) -99.43% 882.000 5.000 - 0.00% -
482.sphinx3 (max) -99.31% 873.000 6.000 - 0.00% -
482.sphinx3 -98.36% 489.000 8.000 - -11.11% -
482.sphinx3 (avg) -98.36% 489.000 8.000 - -11.11% -
444.namd -98.25% 514.000 9.000 - 0.00% -
444.namd (avg) -98.25% 514.000 9.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -97.83% 92.000 2.000 - -50.00% -
444.namd (unexplained diff vs previous) (percentage) -97.72% 6.140 0.140 - -65.85% -
470.lbm (max) -97.27% 769.000 21.000 - 50.00% -
453.povray (max) -96.97% 132.000 4.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -96.80% 3.440 0.110 - -75.56% -
445.gobmk (unexplained diff vs previous) -96.67% 30.000 1.000 - -91.67% -
450.soplex (unexplained diff vs previous) -96.34% 82.000 3.000 - -62.50% -
470.lbm (unexplained diff vs previous) -95.77% 497.000 21.000 - 425.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc (max) -95.11% 184.000 9.000 - 0.00% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
429.mcf (unexplained diff vs previous) -94.03% 67.000 4.000 - 33.33% -
464.h264ref (unexplained diff vs previous) -93.33% 60.000 4.000 - 100.00% -
450.soplex (max) -92.68% 82.000 6.000 - -14.29% -
471.omnetpp (unexplained diff vs previous) (percentage) -91.86% 0.860 0.070 - -50.00% -
445.gobmk (unexplained diff vs previous) (percentage) -91.67% 0.240 0.020 - -91.30% -
429.mcf (max) -91.04% 67.000 6.000 - 0.00% -
447.dealII -90.83% 120.000 11.000 - 0.00% -
447.dealII (avg) -90.83% 120.000 11.000 - 0.00% -
470.lbm -90.37% 322.000 31.000 - 0.00% -
470.lbm (avg) -90.37% 322.000 31.000 - 0.00% -
444.namd (max) (percentage) -88.53% 6.540 0.750 - -1.32% -
403.gcc (max) -88.24% 34.000 4.000 - 0.00% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
470.lbm (max) (percentage) -87.91% 5.540 0.670 - 42.55% -
483.xalancbmk (unexplained diff vs previous) -86.89% 61.000 8.000 - -46.67% -
471.omnetpp (max) -86.77% 189.000 25.000 - -50.00% -
447.dealII (max) -86.05% 129.000 18.000 - -5.26% -
473.astar (unexplained diff vs previous) -85.19% 108.000 16.000 - -55.56% -
458.sjeng (max) -83.08% 65.000 11.000 - -15.38% -
464.h264ref (unexplained diff vs previous) (percentage) -82.05% 0.390 0.070 - 75.00% -
470.lbm (unexplained diff vs previous) (percentage) -81.56% 3.580 0.660 - 407.69% -
458.sjeng (unexplained diff vs previous) -78.05% 41.000 9.000 - -30.77% -
482.sphinx3 (max) (percentage) -78.01% 3.320 0.730 - -3.95% -
473.astar (max) -71.93% 114.000 32.000 - -8.57% -
464.h264ref (max) -68.33% 60.000 19.000 - -5.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -66.15% 0.650 0.220 - -46.34% -
444.namd (avg) (percentage) -65.88% 3.810 1.300 - -1.52% -
458.sjeng (max) (percentage) -65.00% 0.400 0.140 - -12.50% -
458.sjeng -64.21% 95.000 34.000 - -2.86% -
458.sjeng (avg) -64.21% 95.000 34.000 - -2.86% -
483.xalancbmk (max) -63.93% 61.000 22.000 - -12.00% -
445.gobmk (max) -62.07% 29.000 11.000 - -8.33% -
429.mcf -58.49% 53.000 22.000 - -4.35% -
429.mcf (avg) -58.49% 53.000 22.000 - -4.35% -
470.lbm (avg) (percentage) -57.33% 2.320 0.990 - -1.00% -
473.astar (unexplained diff vs previous) (percentage) -56.58% 0.760 0.330 - -55.41% -
458.sjeng (unexplained diff vs previous) (percentage) -56.00% 0.250 0.110 - -31.25% -
401.bzip2 -55.88% 34.000 15.000 - 0.00% -
401.bzip2 (avg) -55.88% 34.000 15.000 - 0.00% -
447.dealII (avg) (percentage) -55.10% 1.470 0.660 - 0.00% -
453.povray (max) (percentage) -54.40% 1.930 0.880 - -1.12% -
456.hmmer -52.08% 48.000 23.000 - 0.00% -
456.hmmer (avg) -52.08% 48.000 23.000 - 0.00% -
401.bzip2 (max) -50.00% 48.000 24.000 - -7.69% -
471.omnetpp (max) (percentage) -48.86% 1.760 0.900 - -50.55% -
482.sphinx3 (avg) (percentage) -46.24% 1.860 1.000 - -1.96% -
464.h264ref -45.10% 51.000 28.000 - -3.45% -
464.h264ref (avg) -45.10% 51.000 28.000 - -3.45% -
471.omnetpp -44.58% 83.000 46.000 - -2.13% -
471.omnetpp (avg) -44.58% 83.000 46.000 - -2.13% -
433.milc (max) (percentage) -41.61% 1.370 0.800 - -8.05% -
429.mcf (unexplained diff vs previous) (percentage) -39.29% 0.560 0.340 - 30.77% -
433.milc (avg) (percentage) -36.63% 1.010 0.640 - 0.00% -
447.dealII (max) (percentage) -34.81% 1.580 1.030 - -3.74% -
458.sjeng (avg) (percentage) -27.59% 0.580 0.420 - -2.33% -
473.astar -23.94% 71.000 54.000 - -1.82% -
473.astar (avg) -23.94% 71.000 54.000 - -1.82% -
456.hmmer (unexplained diff vs previous) -22.22% 9.000 7.000 - -61.11% -
453.povray (avg) (percentage) -19.71% 1.370 1.100 - 0.00% -
473.astar (max) (percentage) -16.25% 0.800 0.670 - -9.46% -
445.gobmk (max) (percentage) -12.50% 0.240 0.210 - -8.70% -
456.hmmer (max) -12.50% 40.000 35.000 - -5.41% -
464.h264ref (max) (percentage) -10.26% 0.390 0.350 - -2.78% -
445.gobmk -4.55% 22.000 21.000 - 0.00% -
445.gobmk (avg) -4.55% 22.000 21.000 - 0.00% -
483.xalancbmk (max) (percentage) -3.08% 0.650 0.630 - -10.00% -
429.mcf (max) (percentage) -1.79% 0.560 0.550 - -8.33% -

Added Tests - sample variability
462.libquantum (max)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2713.000 -
403.gcc 58.000 1.75%
429.mcf 1160.000 -
433.milc 1143.000 -
444.namd 724.000 -
445.gobmk 5255.000 -
447.dealII 1787.000 -
450.soplex 515.000 -
453.povray 464.000 -
456.hmmer 3559.000 -
458.sjeng 8203.000 -
462.libquantum 99.000 1.02%
464.h264ref 5569.000 -
470.lbm 3174.000 -
471.omnetpp 2785.000 -
473.astar 4864.000 -
482.sphinx3 885.000 -
483.xalancbmk 3627.000 -
Geometric Mean 1444.843 -
Code Size (bytes)
Name Current %
401.bzip2 40333.000 -
403.gcc 1954721.000 -
429.mcf 7834.000 -
433.milc 72866.000 -
444.namd 169537.000 -
445.gobmk 1308216.000 -
447.dealII 1727167.000 -
450.soplex 198335.000 -
453.povray 576486.000 -
456.hmmer 166422.000 -
458.sjeng 96893.000 -
462.libquantum 23931.000 -
464.h264ref 349710.000 -
470.lbm 9702.000 -
471.omnetpp 376219.000 -
473.astar 23315.000 -
482.sphinx3 114159.000 -
483.xalancbmk 2284952.000 -
Geometric Mean 161998.894 -
sample variability
Name Current %
401.bzip2 15.000 -
401.bzip2 (avg) 15.000 -
401.bzip2 (avg) (percentage) 0.580 -
401.bzip2 (max) 24.000 -7.69%
401.bzip2 (max) (percentage) 0.910 -5.21%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.770 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.610 -1.49%
429.mcf 22.000 -4.35%
429.mcf (avg) 22.000 -4.35%
429.mcf (avg) (percentage) 1.960 -1.51%
429.mcf (max) 6.000 -
429.mcf (max) (percentage) 0.550 -8.33%
429.mcf (unexplained diff vs previous) 4.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 0.340 30.77%
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.640 -
433.milc (max) 9.000 -
433.milc (max) (percentage) 0.800 -8.05%
444.namd 9.000 -
444.namd (avg) 9.000 -
444.namd (avg) (percentage) 1.300 -1.52%
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.750 -1.32%
444.namd (unexplained diff vs previous) 1.000 -66.67%
444.namd (unexplained diff vs previous) (percentage) 0.140 -65.85%
445.gobmk 21.000 -
445.gobmk (avg) 21.000 -
445.gobmk (avg) (percentage) 0.400 -
445.gobmk (max) 11.000 -8.33%
445.gobmk (max) (percentage) 0.210 -8.70%
445.gobmk (unexplained diff vs previous) 1.000 -91.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.020 -91.30%
447.dealII 11.000 -
447.dealII (avg) 11.000 -
447.dealII (avg) (percentage) 0.660 -
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.030 -3.74%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.220 -
450.soplex (max) 6.000 -14.29%
450.soplex (max) (percentage) 1.330 -12.50%
450.soplex (unexplained diff vs previous) 3.000 -62.50%
450.soplex (unexplained diff vs previous) (percentage) 0.580 -62.34%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.100 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.880 -1.12%
456.hmmer 23.000 -
456.hmmer (avg) 23.000 -
456.hmmer (avg) (percentage) 0.660 -1.49%
456.hmmer (max) 35.000 -5.41%
456.hmmer (max) (percentage) 1.000 -5.66%
456.hmmer (unexplained diff vs previous) 7.000 -61.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.200 -60.00%
458.sjeng 34.000 -2.86%
458.sjeng (avg) 34.000 -2.86%
458.sjeng (avg) (percentage) 0.420 -2.33%
458.sjeng (max) 11.000 -15.38%
458.sjeng (max) (percentage) 0.140 -12.50%
458.sjeng (unexplained diff vs previous) 9.000 -30.77%
458.sjeng (unexplained diff vs previous) (percentage) 0.110 -31.25%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.300 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.880 -12.87%
464.h264ref 28.000 -3.45%
464.h264ref (avg) 28.000 -3.45%
464.h264ref (avg) (percentage) 0.520 -1.89%
464.h264ref (max) 19.000 -5.00%
464.h264ref (max) (percentage) 0.350 -2.78%
464.h264ref (unexplained diff vs previous) 4.000 100.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.070 75.00%
470.lbm 31.000 -
470.lbm (avg) 31.000 -
470.lbm (avg) (percentage) 0.990 -1.00%
470.lbm (max) 21.000 50.00%
470.lbm (max) (percentage) 0.670 42.55%
470.lbm (unexplained diff vs previous) 21.000 425.00%
470.lbm (unexplained diff vs previous) (percentage) 0.660 407.69%
471.omnetpp 46.000 -2.13%
471.omnetpp (avg) 46.000 -2.13%
471.omnetpp (avg) (percentage) 1.680 -1.75%
471.omnetpp (max) 25.000 -50.00%
471.omnetpp (max) (percentage) 0.900 -50.55%
471.omnetpp (unexplained diff vs previous) 2.000 -50.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.070 -50.00%
473.astar 54.000 -1.82%
473.astar (avg) 54.000 -1.82%
473.astar (avg) (percentage) 1.130 -1.74%
473.astar (max) 32.000 -8.57%
473.astar (max) (percentage) 0.670 -9.46%
473.astar (unexplained diff vs previous) 16.000 -55.56%
473.astar (unexplained diff vs previous) (percentage) 0.330 -55.41%
482.sphinx3 8.000 -11.11%
482.sphinx3 (avg) 8.000 -11.11%
482.sphinx3 (avg) (percentage) 1.000 -1.96%
482.sphinx3 (max) 6.000 -
482.sphinx3 (max) (percentage) 0.730 -3.95%
482.sphinx3 (unexplained diff vs previous) 1.000 -75.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.110 -75.56%
483.xalancbmk 50.000 -1.96%
483.xalancbmk (avg) 50.000 -1.96%
483.xalancbmk (avg) (percentage) 1.390 -2.11%
483.xalancbmk (max) 22.000 -12.00%
483.xalancbmk (max) (percentage) 0.630 -10.00%
483.xalancbmk (unexplained diff vs previous) 8.000 -46.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.220 -46.34%
Geometric Mean 2.751 -21.43%