Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b072ec5ec670b1de356efa23ebfb3165389e81b9 (+ 602 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/100/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0100 (llvmorg-18-init-12380-gb072ec5ec670) 2023-11-16T20:54:29 0:00:00
Previous 0099 (llvmorg-18-init-11778-gfe2bd1239658) 2023-11-11T22:56:57 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 26 33
Performance Improvements 51 110
Added Tests 4 2
Unchanged Tests 699 635
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 11.32% 53.000 59.000 - -99.35% -
429.mcf 1.04% 1152.000 1164.000 - -90.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) 714.29% 0.070 0.570 - -33.72% -
471.omnetpp (unexplained diff vs previous) 700.00% 2.000 16.000 - -82.61% -
453.povray (unexplained diff vs previous) (percentage) 628.57% 0.210 1.530 - -19.47% -
453.povray (unexplained diff vs previous) 600.00% 1.000 7.000 - -94.62% -
429.mcf (unexplained diff vs previous) 200.00% 4.000 12.000 - -82.09% -
429.mcf (unexplained diff vs previous) (percentage) 194.29% 0.350 1.030 - 83.93% -
464.h264ref (unexplained diff vs previous) (percentage) 50.00% 0.300 0.450 - 15.38% -
429.mcf (max) 50.00% 8.000 12.000 - -82.09% -
464.h264ref (unexplained diff vs previous) 47.06% 17.000 25.000 - -58.33% -
444.namd (unexplained diff vs previous) (percentage) 42.46% 1.790 2.550 - -58.47% -
473.astar (unexplained diff vs previous) (percentage) 41.38% 0.870 1.230 - 61.84% -
473.astar (unexplained diff vs previous) 39.53% 43.000 60.000 - -44.44% -
473.astar (max) (percentage) 38.64% 0.880 1.220 - 52.50% -
444.namd (unexplained diff vs previous) 38.46% 13.000 18.000 - -97.83% -
483.xalancbmk (unexplained diff vs previous) 37.50% 8.000 11.000 - -81.97% -
473.astar (max) 37.21% 43.000 59.000 - -48.25% -
483.xalancbmk (unexplained diff vs previous) (percentage) 36.36% 0.220 0.300 - -53.85% -
444.namd (max) (percentage) 35.52% 1.830 2.480 - -62.08% -
429.mcf (max) (percentage) 35.06% 0.770 1.040 - 85.71% -
444.namd (max) 30.77% 13.000 17.000 - -98.07% -
453.povray (max) (percentage) 21.95% 1.230 1.500 - -22.28% -
453.povray (max) 20.00% 5.000 6.000 - -95.45% -
470.lbm (max) 4.17% 24.000 25.000 - -96.75% -
444.namd (avg) (percentage) 1.08% 1.860 1.880 - -50.66% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
444.namd -2.48% 725.000 707.000 - -94.76% -
453.povray -1.50% 466.000 459.000 - -93.31% -
473.astar -1.22% 4933.000 4873.000 - -65.83% -
462.libquantum -1.01% 99.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (unexplained diff vs previous) (percentage) -91.14% 0.790 0.070 - -77.42% -
401.bzip2 (unexplained diff vs previous) -90.48% 21.000 2.000 - -95.92% -
450.soplex (unexplained diff vs previous) -75.00% 8.000 2.000 - -97.56% -
450.soplex (unexplained diff vs previous) (percentage) -74.83% 1.510 0.380 - -33.33% -
433.milc -14.29% 7.000 6.000 - -95.59% -
433.milc (avg) -14.29% 7.000 6.000 - -95.59% -
450.soplex (max) -12.50% 8.000 7.000 - -91.46% -
456.hmmer (unexplained diff vs previous) (percentage) -12.00% 0.250 0.220 - 214.29% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -11.11% -
471.omnetpp (max) -10.00% 30.000 27.000 - -85.71% -
450.soplex (max) (percentage) -9.80% 1.530 1.380 - 142.11% -
471.omnetpp (max) (percentage) -9.26% 1.080 0.980 - -44.32% -
456.hmmer (max) (percentage) -7.14% 0.280 0.260 - -13.33% -
447.dealII (max) -7.14% 14.000 13.000 - -89.92% -
458.sjeng (max) -7.14% 14.000 13.000 - -80.00% -
401.bzip2 -6.25% 16.000 15.000 - -55.88% -
401.bzip2 (avg) -6.25% 16.000 15.000 - -55.88% -
462.libquantum (max) (percentage) -5.17% 2.900 2.750 - 1275.00% -
401.bzip2 (max) (percentage) -5.13% 0.780 0.740 - 138.71% -
401.bzip2 (max) -5.00% 20.000 19.000 - -60.42% -
433.milc (max) (percentage) -4.88% 0.410 0.390 - -71.53% -
445.gobmk (max) (percentage) -4.65% 0.430 0.410 - 70.83% -
445.gobmk (max) -4.55% 22.000 21.000 - -27.59% -
447.dealII (max) (percentage) -3.80% 0.790 0.760 - -51.90% -
433.milc (avg) (percentage) -3.17% 0.630 0.610 - -39.60% -
473.astar -3.09% 97.000 94.000 - 32.39% -
473.astar (avg) -3.09% 97.000 94.000 - 32.39% -
456.hmmer (avg) (percentage) -2.88% 1.040 1.010 - 180.56% -
456.hmmer -2.78% 36.000 35.000 - -27.08% -
456.hmmer (avg) -2.78% 36.000 35.000 - -27.08% -
482.sphinx3 (max) (percentage) -2.70% 0.740 0.720 - -78.31% -
483.xalancbmk (avg) (percentage) -2.52% 2.380 2.320 - 364.00% -
483.xalancbmk -2.33% 86.000 84.000 - 78.72% -
483.xalancbmk (avg) -2.33% 86.000 84.000 - 78.72% -
450.soplex (avg) (percentage) -1.96% 1.020 1.000 - 177.78% -
429.mcf (avg) (percentage) -1.89% 2.640 2.590 - 475.56% -
464.h264ref (max) (percentage) -1.81% 2.770 2.720 - 597.44% -
403.gcc (max) (percentage) -1.78% 3.940 3.870 - 918.42% -
401.bzip2 (avg) (percentage) -1.67% 0.600 0.590 - 168.18% -
471.omnetpp (avg) (percentage) -1.65% 2.420 2.380 - 205.13% -
482.sphinx3 (avg) (percentage) -1.54% 1.300 1.280 - -31.18% -
473.astar (avg) (percentage) -1.52% 1.970 1.940 - 288.00% -
471.omnetpp -1.49% 67.000 66.000 - -20.48% -
471.omnetpp (avg) -1.49% 67.000 66.000 - -20.48% -
470.lbm (avg) (percentage) -1.45% 1.380 1.360 - -41.38% -
464.h264ref (max) -1.30% 154.000 152.000 - 153.33% -
464.h264ref (avg) (percentage) -1.28% 0.780 0.770 - 133.33% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.50% 198708.000 201698.000 - -0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) (percentage) 1275.00% 0.200 2.750 - -5.17% -
403.gcc (max) (percentage) 918.42% 0.380 3.870 - -1.78% -
462.libquantum (avg) (percentage) 800.00% 0.150 1.350 - -0.74% -
462.libquantum (unexplained diff vs previous) (percentage) 750.00% 0.120 1.020 - 0.99% -
464.h264ref (max) (percentage) 597.44% 0.390 2.720 - -1.81% -
429.mcf (avg) (percentage) 475.56% 0.450 2.590 - -1.89% -
403.gcc (avg) (percentage) 454.17% 0.480 2.660 - 0.00% -
483.xalancbmk (avg) (percentage) 364.00% 0.500 2.320 - -2.52% -
473.astar (avg) (percentage) 288.00% 0.500 1.940 - -1.52% -
445.gobmk (avg) (percentage) 222.22% 0.180 0.580 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 214.29% 0.070 0.220 - -12.00% -
471.omnetpp (avg) (percentage) 205.13% 0.780 2.380 - -1.65% -
456.hmmer (avg) (percentage) 180.56% 0.360 1.010 - -2.88% -
450.soplex (avg) (percentage) 177.78% 0.360 1.000 - -1.96% -
401.bzip2 (avg) (percentage) 168.18% 0.220 0.590 - -1.67% -
464.h264ref (max) 153.33% 60.000 152.000 - -1.30% -
450.soplex (max) (percentage) 142.11% 0.570 1.380 - -9.80% -
401.bzip2 (max) (percentage) 138.71% 0.310 0.740 - -5.13% -
464.h264ref (avg) (percentage) 133.33% 0.330 0.770 - -1.28% -
429.mcf (max) (percentage) 85.71% 0.560 1.040 - 35.06% -
429.mcf (unexplained diff vs previous) (percentage) 83.93% 0.560 1.030 - 194.29% -
483.xalancbmk 78.72% 47.000 84.000 - -2.33% -
483.xalancbmk (avg) 78.72% 47.000 84.000 - -2.33% -
445.gobmk (max) (percentage) 70.83% 0.240 0.410 - -4.65% -
473.astar (unexplained diff vs previous) (percentage) 61.84% 0.760 1.230 - 41.38% -
473.astar (max) (percentage) 52.50% 0.800 1.220 - 38.64% -
445.gobmk 36.36% 22.000 30.000 - 0.00% -
445.gobmk (avg) 36.36% 22.000 30.000 - 0.00% -
473.astar 32.39% 71.000 94.000 - -3.09% -
473.astar (avg) 32.39% 71.000 94.000 - -3.09% -
464.h264ref (unexplained diff vs previous) (percentage) 15.38% 0.390 0.450 - 50.00% -
458.sjeng (avg) (percentage) 13.79% 0.580 0.660 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.36% 26756.000 24251.000 - 0.00% -
401.bzip2 -2.82% 39458.000 38345.000 - 0.00% -
453.povray -2.72% 593097.000 576974.000 - 0.00% -
433.milc -2.56% 74971.000 73050.000 - 0.00% -
447.dealII -1.84% 1777992.000 1745295.000 - 0.00% -
444.namd -1.34% 175160.000 172817.000 - 0.00% -
482.sphinx3 -1.25% 115736.000 114291.000 - 0.00% -
456.hmmer -1.05% 168072.000 166310.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.35% 9099.000 59.000 - 11.32% -
462.libquantum -99.25% 13126.000 98.000 - -1.01% -
482.sphinx3 -96.66% 26310.000 879.000 - -0.68% -
450.soplex -96.34% 14429.000 528.000 - -0.38% -
444.namd -94.76% 13495.000 707.000 - -2.48% -
453.povray -93.31% 6857.000 459.000 - -1.50% -
433.milc -91.52% 13482.000 1143.000 - 0.00% -
429.mcf -90.30% 11999.000 1164.000 - 1.04% -
401.bzip2 -82.96% 15683.000 2672.000 - -0.07% -
447.dealII -78.22% 8196.000 1785.000 - -0.22% -
470.lbm -77.09% 13882.000 3181.000 - 0.79% -
471.omnetpp -74.09% 10746.000 2784.000 - -0.57% -
456.hmmer -73.35% 13365.000 3562.000 - 0.23% -
473.astar -65.83% 14262.000 4873.000 - -1.22% -
464.h264ref -63.84% 15493.000 5603.000 - 0.45% -
483.xalancbmk -61.30% 9427.000 3648.000 - 0.30% -
445.gobmk -57.42% 12400.000 5280.000 - 0.23% -
458.sjeng -50.37% 16406.000 8142.000 - 0.10% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.34% 904.000 6.000 - 0.00% -
482.sphinx3 (max) -99.31% 873.000 6.000 - 0.00% -
444.namd (max) -98.07% 882.000 17.000 - 30.77% -
433.milc (max) -97.83% 184.000 4.000 - 0.00% -
444.namd (unexplained diff vs previous) -97.83% 828.000 18.000 - 38.46% -
482.sphinx3 -97.75% 489.000 11.000 - 0.00% -
482.sphinx3 (avg) -97.75% 489.000 11.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
450.soplex (unexplained diff vs previous) -97.56% 82.000 2.000 - -75.00% -
444.namd -97.47% 514.000 13.000 - 0.00% -
444.namd (avg) -97.47% 514.000 13.000 - 0.00% -
470.lbm (max) -96.75% 769.000 25.000 - 4.17% -
401.bzip2 (unexplained diff vs previous) -95.92% 49.000 2.000 - -90.48% -
433.milc -95.59% 136.000 6.000 - -14.29% -
433.milc (avg) -95.59% 136.000 6.000 - -14.29% -
453.povray (max) -95.45% 132.000 6.000 - 20.00% -
470.lbm (unexplained diff vs previous) -94.97% 497.000 25.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) -94.62% 130.000 7.000 - 600.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - 0.00% -
462.libquantum (max) -92.31% 26.000 2.000 - 0.00% -
450.soplex (max) -91.46% 82.000 7.000 - -12.50% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII (max) -89.92% 129.000 13.000 - -7.14% -
447.dealII -88.33% 120.000 14.000 - 0.00% -
447.dealII (avg) -88.33% 120.000 14.000 - 0.00% -
470.lbm -86.65% 322.000 43.000 - 0.00% -
470.lbm (avg) -86.65% 322.000 43.000 - 0.00% -
470.lbm (max) (percentage) -85.74% 5.540 0.790 - 0.00% -
471.omnetpp (max) -85.71% 189.000 27.000 - -10.00% -
471.omnetpp (unexplained diff vs previous) -82.61% 92.000 16.000 - 700.00% -
429.mcf (max) -82.09% 67.000 12.000 - 50.00% -
429.mcf (unexplained diff vs previous) -82.09% 67.000 12.000 - 200.00% -
483.xalancbmk (unexplained diff vs previous) -81.97% 61.000 11.000 - 37.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) -80.23% 3.440 0.680 - 0.00% -
458.sjeng (max) -80.00% 65.000 13.000 - -7.14% -
482.sphinx3 (max) (percentage) -78.31% 3.320 0.720 - -2.70% -
470.lbm (unexplained diff vs previous) (percentage) -77.93% 3.580 0.790 - 0.00% -
456.hmmer (max) -77.50% 40.000 9.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -77.42% 0.310 0.070 - -91.14% -
483.xalancbmk (max) -75.41% 61.000 15.000 - 0.00% -
433.milc (max) (percentage) -71.53% 1.370 0.390 - -4.88% -
444.namd (max) (percentage) -62.08% 6.540 2.480 - 35.52% -
401.bzip2 (max) -60.42% 48.000 19.000 - -5.00% -
444.namd (unexplained diff vs previous) (percentage) -58.47% 6.140 2.550 - 42.46% -
464.h264ref (unexplained diff vs previous) -58.33% 60.000 25.000 - 47.06% -
458.sjeng (max) (percentage) -57.50% 0.400 0.170 - -5.56% -
401.bzip2 -55.88% 34.000 15.000 - -6.25% -
401.bzip2 (avg) -55.88% 34.000 15.000 - -6.25% -
483.xalancbmk (unexplained diff vs previous) (percentage) -53.85% 0.650 0.300 - 36.36% -
447.dealII (max) (percentage) -51.90% 1.580 0.760 - -3.80% -
444.namd (avg) (percentage) -50.66% 3.810 1.880 - 1.08% -
473.astar (max) -48.25% 114.000 59.000 - 37.21% -
447.dealII (avg) (percentage) -45.58% 1.470 0.800 - 0.00% -
473.astar (unexplained diff vs previous) -44.44% 108.000 60.000 - 39.53% -
471.omnetpp (max) (percentage) -44.32% 1.760 0.980 - -9.26% -
458.sjeng -44.21% 95.000 53.000 - 0.00% -
458.sjeng (avg) -44.21% 95.000 53.000 - 0.00% -
429.mcf -43.40% 53.000 30.000 - 0.00% -
429.mcf (avg) -43.40% 53.000 30.000 - 0.00% -
470.lbm (avg) (percentage) -41.38% 2.320 1.360 - -1.45% -
433.milc (avg) (percentage) -39.60% 1.010 0.610 - -3.17% -
483.xalancbmk (max) (percentage) -35.38% 0.650 0.420 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -33.72% 0.860 0.570 - 714.29% -
450.soplex (unexplained diff vs previous) (percentage) -33.33% 0.570 0.380 - -74.83% -
482.sphinx3 (avg) (percentage) -31.18% 1.860 1.280 - -1.54% -
445.gobmk (max) -27.59% 29.000 21.000 - -4.55% -
456.hmmer -27.08% 48.000 35.000 - -2.78% -
456.hmmer (avg) -27.08% 48.000 35.000 - -2.78% -
453.povray (max) (percentage) -22.28% 1.930 1.500 - 21.95% -
471.omnetpp -20.48% 83.000 66.000 - -1.49% -
471.omnetpp (avg) -20.48% 83.000 66.000 - -1.49% -
453.povray (unexplained diff vs previous) (percentage) -19.47% 1.900 1.530 - 628.57% -
464.h264ref -15.69% 51.000 43.000 - 0.00% -
464.h264ref (avg) -15.69% 51.000 43.000 - 0.00% -
456.hmmer (max) (percentage) -13.33% 0.300 0.260 - -7.14% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - -11.11% -
453.povray (avg) (percentage) -10.22% 1.370 1.230 - 0.82% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2672.000 -
403.gcc 59.000 11.32%
429.mcf 1164.000 1.04%
433.milc 1143.000 -
444.namd 707.000 -2.48%
445.gobmk 5280.000 -
447.dealII 1785.000 -
450.soplex 528.000 -
453.povray 459.000 -1.50%
456.hmmer 3562.000 -
458.sjeng 8142.000 -
462.libquantum 98.000 -1.01%
464.h264ref 5603.000 -
470.lbm 3181.000 -
471.omnetpp 2784.000 -
473.astar 4873.000 -1.22%
482.sphinx3 879.000 -
483.xalancbmk 3648.000 -
Geometric Mean 1444.141 -
Code Size (bytes)
Name Current %
401.bzip2 38345.000 -
403.gcc 1958345.000 -
429.mcf 7842.000 -
433.milc 73050.000 -
444.namd 172817.000 -
445.gobmk 1310320.000 -
447.dealII 1745295.000 -
450.soplex 201698.000 -
453.povray 576974.000 -
456.hmmer 166310.000 -
458.sjeng 96953.000 -
462.libquantum 24251.000 -
464.h264ref 353726.000 -
470.lbm 9702.000 -
471.omnetpp 376715.000 -
473.astar 23375.000 -
482.sphinx3 114291.000 -
483.xalancbmk 2284920.000 -
Geometric Mean 162299.735 -
sample variability
Name Current %
401.bzip2 15.000 -6.25%
401.bzip2 (avg) 15.000 -6.25%
401.bzip2 (avg) (percentage) 0.590 -1.67%
401.bzip2 (max) 19.000 -5.00%
401.bzip2 (max) (percentage) 0.740 -5.13%
401.bzip2 (unexplained diff vs previous) 2.000 -90.48%
401.bzip2 (unexplained diff vs previous) (percentage) 0.070 -91.14%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.660 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.870 -1.78%
429.mcf 30.000 -
429.mcf (avg) 30.000 -
429.mcf (avg) (percentage) 2.590 -1.89%
429.mcf (max) 12.000 50.00%
429.mcf (max) (percentage) 1.040 35.06%
429.mcf (unexplained diff vs previous) 12.000 200.00%
429.mcf (unexplained diff vs previous) (percentage) 1.030 194.29%
433.milc 6.000 -14.29%
433.milc (avg) 6.000 -14.29%
433.milc (avg) (percentage) 0.610 -3.17%
433.milc (max) 4.000 -
433.milc (max) (percentage) 0.390 -4.88%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
444.namd 13.000 -
444.namd (avg) 13.000 -
444.namd (avg) (percentage) 1.880 1.08%
444.namd (max) 17.000 30.77%
444.namd (max) (percentage) 2.480 35.52%
444.namd (unexplained diff vs previous) 18.000 38.46%
444.namd (unexplained diff vs previous) (percentage) 2.550 42.46%
445.gobmk 30.000 -
445.gobmk (avg) 30.000 -
445.gobmk (avg) (percentage) 0.580 -
445.gobmk (max) 21.000 -4.55%
445.gobmk (max) (percentage) 0.410 -4.65%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.800 -
447.dealII (max) 13.000 -7.14%
447.dealII (max) (percentage) 0.760 -3.80%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.000 -1.96%
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.380 -9.80%
450.soplex (unexplained diff vs previous) 2.000 -75.00%
450.soplex (unexplained diff vs previous) (percentage) 0.380 -74.83%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.230 -
453.povray (max) 6.000 20.00%
453.povray (max) (percentage) 1.500 21.95%
453.povray (unexplained diff vs previous) 7.000 600.00%
453.povray (unexplained diff vs previous) (percentage) 1.530 628.57%
456.hmmer 35.000 -2.78%
456.hmmer (avg) 35.000 -2.78%
456.hmmer (avg) (percentage) 1.010 -2.88%
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.260 -7.14%
456.hmmer (unexplained diff vs previous) 8.000 -11.11%
456.hmmer (unexplained diff vs previous) (percentage) 0.220 -12.00%
458.sjeng 53.000 -
458.sjeng (avg) 53.000 -
458.sjeng (avg) (percentage) 0.660 -
458.sjeng (max) 13.000 -7.14%
458.sjeng (max) (percentage) 0.170 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.350 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.750 -5.17%
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.020 -
464.h264ref 43.000 -
464.h264ref (avg) 43.000 -
464.h264ref (avg) (percentage) 0.770 -1.28%
464.h264ref (max) 152.000 -1.30%
464.h264ref (max) (percentage) 2.720 -1.81%
464.h264ref (unexplained diff vs previous) 25.000 47.06%
464.h264ref (unexplained diff vs previous) (percentage) 0.450 50.00%
470.lbm 43.000 -
470.lbm (avg) 43.000 -
470.lbm (avg) (percentage) 1.360 -1.45%
470.lbm (max) 25.000 4.17%
470.lbm (max) (percentage) 0.790 -
470.lbm (unexplained diff vs previous) 25.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.790 -
471.omnetpp 66.000 -1.49%
471.omnetpp (avg) 66.000 -1.49%
471.omnetpp (avg) (percentage) 2.380 -1.65%
471.omnetpp (max) 27.000 -10.00%
471.omnetpp (max) (percentage) 0.980 -9.26%
471.omnetpp (unexplained diff vs previous) 16.000 700.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.570 714.29%
473.astar 94.000 -3.09%
473.astar (avg) 94.000 -3.09%
473.astar (avg) (percentage) 1.940 -1.52%
473.astar (max) 59.000 37.21%
473.astar (max) (percentage) 1.220 38.64%
473.astar (unexplained diff vs previous) 60.000 39.53%
473.astar (unexplained diff vs previous) (percentage) 1.230 41.38%
482.sphinx3 11.000 -
482.sphinx3 (avg) 11.000 -
482.sphinx3 (avg) (percentage) 1.280 -1.54%
482.sphinx3 (max) 6.000 -
482.sphinx3 (max) (percentage) 0.720 -2.70%
482.sphinx3 (unexplained diff vs previous) 6.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.680 -
483.xalancbmk 84.000 -2.33%
483.xalancbmk (avg) 84.000 -2.33%
483.xalancbmk (avg) (percentage) 2.320 -2.52%
483.xalancbmk (max) 15.000 -
483.xalancbmk (max) (percentage) 0.420 -
483.xalancbmk (unexplained diff vs previous) 11.000 37.50%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.300 36.36%
Geometric Mean 3.592 -13.46%