Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/52d35345b268a85844de6fbe63f616c5cd93e500 (+ 562 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/79/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0079 (llvmorg-18-init-07548-g52d35345b268) 2023-09-28T18:38:50 0:00:00
Previous 0078 (llvmorg-18-init-06986-g1002a1d058e3) 2023-09-24T14:44:05 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 34
Performance Improvements 65 113
Added Tests 8 0
Unchanged Tests 688 633
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex 1.34% 521.000 528.000 - -96.34% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
450.soplex (unexplained diff vs previous) (percentage) 600.00% 0.190 1.330 - 133.33% -
450.soplex (unexplained diff vs previous) 600.00% 1.000 7.000 - -91.46% -
433.milc (unexplained diff vs previous) 400.00% 1.000 5.000 - -97.25% -
433.milc (unexplained diff vs previous) (percentage) 377.78% 0.090 0.430 - -68.15% -
401.bzip2 (unexplained diff vs previous) 200.00% 6.000 18.000 - -63.27% -
401.bzip2 (unexplained diff vs previous) (percentage) 195.45% 0.220 0.650 - 109.68% -
453.povray (max) 100.00% 2.000 4.000 - -96.97% -
458.sjeng (max) 100.00% 17.000 34.000 - -47.69% -
458.sjeng (max) (percentage) 90.91% 0.220 0.420 - 5.00% -
473.astar (unexplained diff vs previous) (percentage) 65.22% 0.230 0.380 - -50.00% -
473.astar (unexplained diff vs previous) 63.64% 11.000 18.000 - -83.33% -
453.povray (max) (percentage) 35.38% 0.650 0.880 - -54.40% -
453.povray (unexplained diff vs previous) 33.33% 3.000 4.000 - -96.92% -
453.povray (unexplained diff vs previous) (percentage) 31.82% 0.660 0.870 - -54.21% -
401.bzip2 (max) 20.00% 15.000 18.000 - -62.50% -
401.bzip2 (max) (percentage) 14.04% 0.570 0.650 - 109.68% -
462.libquantum (max) (percentage) 12.36% 1.780 2.000 - 900.00% -
462.libquantum (avg) (percentage) 1.40% 1.430 1.450 - 866.67% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -6.78% 59.000 55.000 - -99.40% -
462.libquantum -2.00% 100.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) -97.37% 38.000 1.000 - -98.91% -
471.omnetpp (unexplained diff vs previous) (percentage) -97.10% 1.380 0.040 - -95.35% -
482.sphinx3 (unexplained diff vs previous) -83.33% 12.000 2.000 - -99.78% -
482.sphinx3 (unexplained diff vs previous) (percentage) -83.09% 1.360 0.230 - -93.31% -
483.xalancbmk (unexplained diff vs previous) -68.00% 75.000 24.000 - -60.66% -
483.xalancbmk (unexplained diff vs previous) (percentage) -67.94% 2.090 0.670 - 3.08% -
470.lbm (unexplained diff vs previous) (percentage) -62.75% 0.510 0.190 - -94.69% -
464.h264ref (unexplained diff vs previous) (percentage) -62.50% 0.240 0.090 - -76.92% -
470.lbm (unexplained diff vs previous) -62.50% 16.000 6.000 - -98.79% -
464.h264ref (unexplained diff vs previous) -61.54% 13.000 5.000 - -91.67% -
429.mcf (max) -33.33% 3.000 2.000 - -97.01% -
483.xalancbmk (max) (percentage) -25.23% 2.140 1.600 - 146.15% -
483.xalancbmk (max) -25.00% 76.000 57.000 - -6.56% -
470.lbm (max) (percentage) -23.64% 0.550 0.420 - -92.42% -
470.lbm (max) -23.53% 17.000 13.000 - -98.31% -
482.sphinx3 (max) -16.67% 12.000 10.000 - -98.85% -
464.h264ref (max) (percentage) -16.67% 0.240 0.200 - -48.72% -
464.h264ref (max) -15.38% 13.000 11.000 - -81.67% -
482.sphinx3 (max) (percentage) -12.41% 1.370 1.200 - -63.86% -
429.mcf (max) (percentage) -11.54% 0.260 0.230 - -58.93% -
471.omnetpp (max) -11.43% 70.000 62.000 - -67.20% -
471.omnetpp (max) (percentage) -11.33% 2.560 2.270 - 28.98% -
447.dealII -6.67% 15.000 14.000 - -88.33% -
447.dealII (avg) -6.67% 15.000 14.000 - -88.33% -
450.soplex (max) (percentage) -6.49% 3.080 2.880 - 405.26% -
450.soplex (max) -6.25% 16.000 15.000 - -81.71% -
447.dealII (avg) (percentage) -5.62% 0.890 0.840 - -42.86% -
433.milc (max) (percentage) -4.44% 0.450 0.430 - -68.61% -
464.h264ref -4.35% 46.000 44.000 - -13.73% -
464.h264ref (avg) -4.35% 46.000 44.000 - -13.73% -
445.gobmk (avg) (percentage) -4.17% 0.720 0.690 - 283.33% -
456.hmmer -4.17% 48.000 46.000 - -4.17% -
456.hmmer (avg) -4.17% 48.000 46.000 - -4.17% -
444.namd (max) (percentage) -3.85% 2.340 2.250 - -65.60% -
456.hmmer (avg) (percentage) -3.68% 1.360 1.310 - 263.89% -
473.astar (max) (percentage) -3.61% 0.830 0.800 - 0.00% -
464.h264ref (avg) (percentage) -3.57% 0.840 0.810 - 145.45% -
456.hmmer (max) (percentage) -3.33% 0.300 0.290 - -3.33% -
482.sphinx3 (avg) (percentage) -3.25% 1.540 1.490 - -19.89% -
473.astar (avg) (percentage) -3.13% 2.560 2.480 - 396.00% -
471.omnetpp (avg) (percentage) -2.96% 3.040 2.950 - 278.21% -
445.gobmk (max) (percentage) -2.94% 0.340 0.330 - 37.50% -
429.mcf (avg) (percentage) -2.79% 3.230 3.140 - 597.78% -
429.mcf -2.70% 37.000 36.000 - -32.08% -
429.mcf (avg) -2.70% 37.000 36.000 - -32.08% -
445.gobmk -2.70% 37.000 36.000 - 63.64% -
445.gobmk (avg) -2.70% 37.000 36.000 - 63.64% -
473.astar (max) -2.56% 39.000 38.000 - -66.67% -
483.xalancbmk (avg) (percentage) -2.52% 3.170 3.090 - 518.00% -
473.astar -2.48% 121.000 118.000 - 66.20% -
473.astar (avg) -2.48% 121.000 118.000 - 66.20% -
471.omnetpp -2.41% 83.000 81.000 - -2.41% -
471.omnetpp (avg) -2.41% 83.000 81.000 - -2.41% -
447.dealII (max) (percentage) -2.41% 0.830 0.810 - -48.73% -
470.lbm (avg) (percentage) -2.35% 1.700 1.660 - -28.45% -
403.gcc (max) (percentage) -2.02% 3.960 3.880 - 921.05% -
470.lbm -1.89% 53.000 52.000 - -83.85% -
470.lbm (avg) -1.89% 53.000 52.000 - -83.85% -
483.xalancbmk -1.77% 113.000 111.000 - 136.17% -
483.xalancbmk (avg) -1.77% 113.000 111.000 - 136.17% -
453.povray (avg) (percentage) -1.57% 1.270 1.250 - -8.76% -
433.milc (avg) (percentage) -1.49% 0.670 0.660 - -34.65% -
458.sjeng (avg) (percentage) -1.25% 0.800 0.790 - 36.21% -

Added Tests - sample variability
445.gobmk (unexplained diff vs previous)
445.gobmk (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.98% 39458.000 41817.000 - 0.00% -
450.soplex 1.78% 198708.000 202254.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 1600.00% 0.120 2.040 - 0.00% -
403.gcc (max) (percentage) 921.05% 0.380 3.880 - -2.02% -
462.libquantum (max) (percentage) 900.00% 0.200 2.000 - 12.36% -
462.libquantum (avg) (percentage) 866.67% 0.150 1.450 - 1.40% -
429.mcf (avg) (percentage) 597.78% 0.450 3.140 - -2.79% -
483.xalancbmk (avg) (percentage) 518.00% 0.500 3.090 - -2.52% -
450.soplex (max) (percentage) 405.26% 0.570 2.880 - -6.49% -
473.astar (avg) (percentage) 396.00% 0.500 2.480 - -3.13% -
403.gcc (avg) (percentage) 368.75% 0.480 2.250 - 0.00% -
445.gobmk (avg) (percentage) 283.33% 0.180 0.690 - -4.17% -
471.omnetpp (avg) (percentage) 278.21% 0.780 2.950 - -2.96% -
456.hmmer (avg) (percentage) 263.89% 0.360 1.310 - -3.68% -
450.soplex (avg) (percentage) 188.89% 0.360 1.040 - 0.97% -
401.bzip2 (avg) (percentage) 186.36% 0.220 0.630 - 0.00% -
483.xalancbmk (max) (percentage) 146.15% 0.650 1.600 - -25.23% -
464.h264ref (avg) (percentage) 145.45% 0.330 0.810 - -3.57% -
483.xalancbmk 136.17% 47.000 111.000 - -1.77% -
483.xalancbmk (avg) 136.17% 47.000 111.000 - -1.77% -
450.soplex (unexplained diff vs previous) (percentage) 133.33% 0.570 1.330 - 600.00% -
401.bzip2 (max) (percentage) 109.68% 0.310 0.650 - 14.04% -
401.bzip2 (unexplained diff vs previous) (percentage) 109.68% 0.310 0.650 - 195.45% -
456.hmmer (unexplained diff vs previous) (percentage) 100.00% 0.070 0.140 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 68.00% 0.250 0.420 - 0.00% -
473.astar 66.20% 71.000 118.000 - -2.48% -
473.astar (avg) 66.20% 71.000 118.000 - -2.48% -
445.gobmk 63.64% 22.000 36.000 - -2.70% -
445.gobmk (avg) 63.64% 22.000 36.000 - -2.70% -
445.gobmk (max) (percentage) 37.50% 0.240 0.330 - -2.94% -
458.sjeng (avg) (percentage) 36.21% 0.580 0.790 - -1.25% -
471.omnetpp (max) (percentage) 28.98% 1.760 2.270 - -11.33% -
458.sjeng (max) (percentage) 5.00% 0.400 0.420 - 90.91% -
483.xalancbmk (unexplained diff vs previous) (percentage) 3.08% 0.650 0.670 - -67.94% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.00% 26756.000 24347.000 - 0.00% -
453.povray -2.66% 593097.000 577326.000 - 0.00% -
433.milc -2.52% 74971.000 73078.000 - 0.00% -
447.dealII -1.79% 1777992.000 1746195.000 - 0.00% -
482.sphinx3 -1.09% 115736.000 114471.000 - 0.00% -
456.hmmer -1.06% 168072.000 166298.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9099.000 55.000 - -6.78% -
462.libquantum -99.25% 13126.000 98.000 - -2.00% -
482.sphinx3 -96.64% 26310.000 883.000 - -0.23% -
450.soplex -96.34% 14429.000 528.000 - 1.34% -
444.namd -94.71% 13495.000 714.000 - 0.28% -
453.povray -93.29% 6857.000 460.000 - 0.88% -
433.milc -91.37% 13482.000 1163.000 - 0.43% -
429.mcf -90.21% 11999.000 1175.000 - 0.17% -
401.bzip2 -82.30% 15683.000 2776.000 - 0.65% -
447.dealII -78.67% 8196.000 1748.000 - -0.06% -
470.lbm -77.15% 13882.000 3172.000 - 0.19% -
471.omnetpp -74.42% 10746.000 2749.000 - 0.04% -
456.hmmer -73.29% 13365.000 3570.000 - 0.14% -
473.astar -66.60% 14262.000 4763.000 - 0.38% -
464.h264ref -64.41% 15493.000 5514.000 - -0.09% -
483.xalancbmk -61.76% 9427.000 3605.000 - 0.67% -
445.gobmk -57.80% 12400.000 5233.000 - -0.06% -
458.sjeng -50.53% 16406.000 8116.000 - 0.42% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.78% 904.000 2.000 - -83.33% -
447.dealII (unexplained diff vs previous) -99.17% 121.000 1.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -98.91% 92.000 1.000 - -97.37% -
482.sphinx3 (max) -98.85% 873.000 10.000 - -16.67% -
470.lbm (unexplained diff vs previous) -98.79% 497.000 6.000 - -62.50% -
470.lbm (max) -98.31% 769.000 13.000 - -23.53% -
444.namd (max) -98.19% 882.000 16.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
482.sphinx3 -97.34% 489.000 13.000 - 0.00% -
482.sphinx3 (avg) -97.34% 489.000 13.000 - 0.00% -
433.milc (max) -97.28% 184.000 5.000 - 0.00% -
444.namd -97.28% 514.000 14.000 - 0.00% -
444.namd (avg) -97.28% 514.000 14.000 - 0.00% -
433.milc (unexplained diff vs previous) -97.25% 182.000 5.000 - 400.00% -
429.mcf (max) -97.01% 67.000 2.000 - -33.33% -
429.mcf (unexplained diff vs previous) -97.01% 67.000 2.000 - 0.00% -
453.povray (max) -96.97% 132.000 4.000 - 100.00% -
453.povray (unexplained diff vs previous) -96.92% 130.000 4.000 - 33.33% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -95.95% 1.480 0.060 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -95.35% 0.860 0.040 - -97.10% -
433.milc -94.85% 136.000 7.000 - 0.00% -
433.milc (avg) -94.85% 136.000 7.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -94.69% 3.580 0.190 - -62.75% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.31% 3.440 0.230 - -83.09% -
470.lbm (max) (percentage) -92.42% 5.540 0.420 - -23.64% -
464.h264ref (unexplained diff vs previous) -91.67% 60.000 5.000 - -61.54% -
450.soplex (unexplained diff vs previous) -91.46% 82.000 7.000 - 600.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -90.00% 30.000 3.000 - 0.00% -
447.dealII (max) -89.15% 129.000 14.000 - 0.00% -
447.dealII -88.33% 120.000 14.000 - -6.67% -
447.dealII (avg) -88.33% 120.000 14.000 - -6.67% -
462.libquantum (unexplained diff vs previous) -87.50% 16.000 2.000 - 0.00% -
470.lbm -83.85% 322.000 52.000 - -1.89% -
470.lbm (avg) -83.85% 322.000 52.000 - -1.89% -
473.astar (unexplained diff vs previous) -83.33% 108.000 18.000 - 63.64% -
450.soplex (max) -81.71% 82.000 15.000 - -6.25% -
464.h264ref (max) -81.67% 60.000 11.000 - -15.38% -
464.h264ref (unexplained diff vs previous) (percentage) -76.92% 0.390 0.090 - -62.50% -
445.gobmk (unexplained diff vs previous) (percentage) -75.00% 0.240 0.060 - 0.00% -
456.hmmer (max) -75.00% 40.000 10.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -69.64% 0.560 0.170 - 0.00% -
433.milc (max) (percentage) -68.61% 1.370 0.430 - -4.44% -
433.milc (unexplained diff vs previous) (percentage) -68.15% 1.350 0.430 - 377.78% -
471.omnetpp (max) -67.20% 189.000 62.000 - -11.43% -
473.astar (max) -66.67% 114.000 38.000 - -2.56% -
444.namd (max) (percentage) -65.60% 6.540 2.250 - -3.85% -
482.sphinx3 (max) (percentage) -63.86% 3.320 1.200 - -12.41% -
401.bzip2 (unexplained diff vs previous) -63.27% 49.000 18.000 - 200.00% -
401.bzip2 (max) -62.50% 48.000 18.000 - 20.00% -
483.xalancbmk (unexplained diff vs previous) -60.66% 61.000 24.000 - -68.00% -
429.mcf (max) (percentage) -58.93% 0.560 0.230 - -11.54% -
453.povray (max) (percentage) -54.40% 1.930 0.880 - 35.38% -
453.povray (unexplained diff vs previous) (percentage) -54.21% 1.900 0.870 - 31.82% -
401.bzip2 -50.00% 34.000 17.000 - 0.00% -
401.bzip2 (avg) -50.00% 34.000 17.000 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -50.00% 0.760 0.380 - 65.22% -
447.dealII (max) (percentage) -48.73% 1.580 0.810 - -2.41% -
464.h264ref (max) (percentage) -48.72% 0.390 0.200 - -16.67% -
458.sjeng (max) -47.69% 65.000 34.000 - 100.00% -
444.namd (avg) (percentage) -45.14% 3.810 2.090 - 0.00% -
456.hmmer (unexplained diff vs previous) -44.44% 9.000 5.000 - 0.00% -
447.dealII (avg) (percentage) -42.86% 1.470 0.840 - -5.62% -
445.gobmk (max) -41.38% 29.000 17.000 - 0.00% -
433.milc (avg) (percentage) -34.65% 1.010 0.660 - -1.49% -
458.sjeng -32.63% 95.000 64.000 - 0.00% -
458.sjeng (avg) -32.63% 95.000 64.000 - 0.00% -
429.mcf -32.08% 53.000 36.000 - -2.70% -
429.mcf (avg) -32.08% 53.000 36.000 - -2.70% -
470.lbm (avg) (percentage) -28.45% 2.320 1.660 - -2.35% -
482.sphinx3 (avg) (percentage) -19.89% 1.860 1.490 - -3.25% -
458.sjeng (unexplained diff vs previous) -17.07% 41.000 34.000 - 0.00% -
464.h264ref -13.73% 51.000 44.000 - -4.35% -
464.h264ref (avg) -13.73% 51.000 44.000 - -4.35% -
453.povray (avg) (percentage) -8.76% 1.370 1.250 - -1.57% -
483.xalancbmk (max) -6.56% 61.000 57.000 - -25.00% -
456.hmmer -4.17% 48.000 46.000 - -4.17% -
456.hmmer (avg) -4.17% 48.000 46.000 - -4.17% -
456.hmmer (max) (percentage) -3.33% 0.300 0.290 - -3.33% -
471.omnetpp -2.41% 83.000 81.000 - -2.41% -
471.omnetpp (avg) -2.41% 83.000 81.000 - -2.41% -


Report Time: 0.35s
Name Current %
401.bzip2 2776.000 -
403.gcc 55.000 -6.78%
429.mcf 1175.000 -
433.milc 1163.000 -
444.namd 714.000 -
445.gobmk 5233.000 -
447.dealII 1748.000 -
450.soplex 528.000 1.34%
453.povray 460.000 -
456.hmmer 3570.000 -
458.sjeng 8116.000 -
462.libquantum 98.000 -2.00%
464.h264ref 5514.000 -
470.lbm 3172.000 -
471.omnetpp 2749.000 -
473.astar 4763.000 -
482.sphinx3 883.000 -
483.xalancbmk 3605.000 -
Geometric Mean 1437.279 -
Name Current %
401.bzip2 41817.000 -
403.gcc 1960957.000 -
429.mcf 7922.000 -
433.milc 73078.000 -
444.namd 174849.000 -
445.gobmk 1309848.000 -
447.dealII 1746195.000 -
450.soplex 202254.000 -
453.povray 577326.000 -
456.hmmer 166298.000 -
458.sjeng 97073.000 -
462.libquantum 24347.000 -
464.h264ref 352126.000 -
470.lbm 9750.000 -
471.omnetpp 376711.000 -
473.astar 23183.000 -
482.sphinx3 114471.000 -
483.xalancbmk 2286572.000 -
Geometric Mean 163324.612 -
Name Current %
401.bzip2 17.000 -
401.bzip2 (avg) 17.000 -
401.bzip2 (avg) (percentage) 0.630 -
401.bzip2 (max) 18.000 20.00%
401.bzip2 (max) (percentage) 0.650 14.04%
401.bzip2 (unexplained diff vs previous) 18.000 200.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.650 195.45%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.250 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.880 -2.02%
429.mcf 36.000 -2.70%
429.mcf (avg) 36.000 -2.70%
429.mcf (avg) (percentage) 3.140 -2.79%
429.mcf (max) 2.000 -33.33%
429.mcf (max) (percentage) 0.230 -11.54%
429.mcf (unexplained diff vs previous) 2.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.170 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.660 -1.49%
433.milc (max) 5.000 -
433.milc (max) (percentage) 0.430 -4.44%
433.milc (unexplained diff vs previous) 5.000 400.00%
433.milc (unexplained diff vs previous) (percentage) 0.430 377.78%
444.namd 14.000 -
444.namd (avg) 14.000 -
444.namd (avg) (percentage) 2.090 -
444.namd (max) 16.000 -
444.namd (max) (percentage) 2.250 -3.85%
445.gobmk 36.000 -2.70%
445.gobmk (avg) 36.000 -2.70%
445.gobmk (avg) (percentage) 0.690 -4.17%
445.gobmk (max) 17.000 -
445.gobmk (max) (percentage) 0.330 -2.94%
445.gobmk (unexplained diff vs previous) 3.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.060 -
447.dealII 14.000 -6.67%
447.dealII (avg) 14.000 -6.67%
447.dealII (avg) (percentage) 0.840 -5.62%
447.dealII (max) 14.000 -
447.dealII (max) (percentage) 0.810 -2.41%
447.dealII (unexplained diff vs previous) 1.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.060 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.040 -
450.soplex (max) 15.000 -6.25%
450.soplex (max) (percentage) 2.880 -6.49%
450.soplex (unexplained diff vs previous) 7.000 600.00%
450.soplex (unexplained diff vs previous) (percentage) 1.330 600.00%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.250 -1.57%
453.povray (max) 4.000 100.00%
453.povray (max) (percentage) 0.880 35.38%
453.povray (unexplained diff vs previous) 4.000 33.33%
453.povray (unexplained diff vs previous) (percentage) 0.870 31.82%
456.hmmer 46.000 -4.17%
456.hmmer (avg) 46.000 -4.17%
456.hmmer (avg) (percentage) 1.310 -3.68%
456.hmmer (max) 10.000 -
456.hmmer (max) (percentage) 0.290 -3.33%
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.140 -
458.sjeng 64.000 -
458.sjeng (avg) 64.000 -
458.sjeng (avg) (percentage) 0.790 -1.25%
458.sjeng (max) 34.000 100.00%
458.sjeng (max) (percentage) 0.420 90.91%
458.sjeng (unexplained diff vs previous) 34.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.420 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.450 1.40%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 2.000 12.36%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.040 -
464.h264ref 44.000 -4.35%
464.h264ref (avg) 44.000 -4.35%
464.h264ref (avg) (percentage) 0.810 -3.57%
464.h264ref (max) 11.000 -15.38%
464.h264ref (max) (percentage) 0.200 -16.67%
464.h264ref (unexplained diff vs previous) 5.000 -61.54%
464.h264ref (unexplained diff vs previous) (percentage) 0.090 -62.50%
470.lbm 52.000 -1.89%
470.lbm (avg) 52.000 -1.89%
470.lbm (avg) (percentage) 1.660 -2.35%
470.lbm (max) 13.000 -23.53%
470.lbm (max) (percentage) 0.420 -23.64%
470.lbm (unexplained diff vs previous) 6.000 -62.50%
470.lbm (unexplained diff vs previous) (percentage) 0.190 -62.75%
471.omnetpp 81.000 -2.41%
471.omnetpp (avg) 81.000 -2.41%
471.omnetpp (avg) (percentage) 2.950 -2.96%
471.omnetpp (max) 62.000 -11.43%
471.omnetpp (max) (percentage) 2.270 -11.33%
471.omnetpp (unexplained diff vs previous) 1.000 -97.37%
471.omnetpp (unexplained diff vs previous) (percentage) 0.040 -97.10%
473.astar 118.000 -2.48%
473.astar (avg) 118.000 -2.48%
473.astar (avg) (percentage) 2.480 -3.13%
473.astar (max) 38.000 -2.56%
473.astar (max) (percentage) 0.800 -3.61%
473.astar (unexplained diff vs previous) 18.000 63.64%
473.astar (unexplained diff vs previous) (percentage) 0.380 65.22%
482.sphinx3 13.000 -
482.sphinx3 (avg) 13.000 -
482.sphinx3 (avg) (percentage) 1.490 -3.25%
482.sphinx3 (max) 10.000 -16.67%
482.sphinx3 (max) (percentage) 1.200 -12.41%
482.sphinx3 (unexplained diff vs previous) 2.000 -83.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.230 -83.09%
483.xalancbmk 111.000 -1.77%
483.xalancbmk (avg) 111.000 -1.77%
483.xalancbmk (avg) (percentage) 3.090 -2.52%
483.xalancbmk (max) 57.000 -25.00%
483.xalancbmk (max) (percentage) 1.600 -25.23%
483.xalancbmk (unexplained diff vs previous) 24.000 -68.00%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.670 -67.94%
Geometric Mean 3.572 -