Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8fb8ad66c95a51b82e5c2876ed925b5512ce6b83 (+ 391 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/115/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0115 (llvmorg-18-init-16910-g8fb8ad66c95a) 2024-01-06T08:51:03 0:00:00
Previous 0114 (llvmorg-18-init-16519-ga0ae5258065a) 2023-12-31T19:06:29 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 35
Performance Improvements 54 112
Added Tests 14 0
Unchanged Tests 692 633
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray 1.75% 457.000 465.000 - -93.22% -
450.soplex 1.34% 521.000 528.000 - -96.34% -
444.namd 1.13% 705.000 713.000 - -94.72% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (max) 200.00% 8.000 24.000 - -60.00% -
464.h264ref (max) (percentage) 168.75% 0.160 0.430 - 10.26% -
471.omnetpp (unexplained diff vs previous) 111.11% 9.000 19.000 - -79.35% -
471.omnetpp (unexplained diff vs previous) (percentage) 109.09% 0.330 0.690 - -19.77% -
444.namd (max) 60.00% 5.000 8.000 - -99.09% -
473.astar (max) 45.83% 24.000 35.000 - -69.30% -
473.astar (unexplained diff vs previous) 45.83% 24.000 35.000 - -67.59% -
473.astar (max) (percentage) 44.90% 0.490 0.710 - -11.25% -
473.astar (unexplained diff vs previous) (percentage) 44.90% 0.490 0.710 - -6.58% -
444.namd (max) (percentage) 44.87% 0.780 1.130 - -82.72% -
401.bzip2 (max) 44.44% 9.000 13.000 - -72.92% -
401.bzip2 (unexplained diff vs previous) (percentage) 43.24% 0.370 0.530 - 70.97% -
401.bzip2 (max) (percentage) 40.54% 0.370 0.520 - 67.74% -
401.bzip2 (unexplained diff vs previous) 40.00% 10.000 14.000 - -71.43% -
429.mcf (max) 37.50% 16.000 22.000 - -67.16% -
429.mcf (max) (percentage) 36.11% 1.440 1.960 - 250.00% -
453.povray (avg) (percentage) 1.57% 1.270 1.290 - -5.84% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.33% 60.000 58.000 - -99.36% -
429.mcf -1.96% 1173.000 1150.000 - -90.42% -
462.libquantum -1.00% 100.000 99.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -80.00% 5.000 1.000 - -99.45% -
433.milc (unexplained diff vs previous) (percentage) -79.55% 0.440 0.090 - -93.33% -
483.xalancbmk (unexplained diff vs previous) -77.08% 48.000 11.000 - -81.97% -
483.xalancbmk (unexplained diff vs previous) (percentage) -77.04% 1.350 0.310 - -52.31% -
433.milc (max) -57.14% 7.000 3.000 - -98.37% -
462.libquantum (max) -50.00% 2.000 1.000 - -96.15% -
462.libquantum (unexplained diff vs previous) -50.00% 2.000 1.000 - -93.75% -
462.libquantum (unexplained diff vs previous) (percentage) -49.50% 2.000 1.010 - 741.67% -
433.milc (max) (percentage) -47.62% 0.630 0.330 - -75.91% -
483.xalancbmk (max) -25.53% 47.000 35.000 - -42.62% -
483.xalancbmk (max) (percentage) -24.81% 1.330 1.000 - 53.85% -
450.soplex (unexplained diff vs previous) (percentage) -23.12% 1.730 1.330 - 133.33% -
450.soplex (unexplained diff vs previous) -22.22% 9.000 7.000 - -91.46% -
456.hmmer (max) (percentage) -18.57% 0.700 0.570 - 90.00% -
456.hmmer (max) -16.67% 24.000 20.000 - -50.00% -
470.lbm (unexplained diff vs previous) (percentage) -16.67% 0.600 0.500 - -86.03% -
470.lbm (unexplained diff vs previous) -15.79% 19.000 16.000 - -96.78% -
462.libquantum (max) (percentage) -12.75% 2.040 1.780 - 790.00% -
450.soplex (max) (percentage) -12.50% 1.760 1.540 - 170.18% -
450.soplex (max) -11.11% 9.000 8.000 - -90.24% -
470.lbm (max) -8.70% 23.000 21.000 - -97.27% -
470.lbm (max) (percentage) -8.00% 0.750 0.690 - -87.55% -
471.omnetpp (max) -7.89% 38.000 35.000 - -81.48% -
471.omnetpp (max) (percentage) -7.86% 1.400 1.290 - -26.70% -
482.sphinx3 (max) (percentage) -7.55% 0.530 0.490 - -85.24% -
447.dealII -7.14% 14.000 13.000 - -89.17% -
447.dealII (avg) -7.14% 14.000 13.000 - -89.17% -
445.gobmk (max) -5.88% 17.000 16.000 - -44.83% -
447.dealII (max) -5.26% 19.000 18.000 - -86.05% -
453.povray (max) (percentage) -4.76% 2.100 2.000 - 3.63% -
458.sjeng (max) (percentage) -3.33% 0.600 0.580 - 45.00% -
456.hmmer -3.12% 32.000 31.000 - -35.42% -
456.hmmer (avg) -3.12% 32.000 31.000 - -35.42% -
445.gobmk (max) (percentage) -3.03% 0.330 0.320 - 33.33% -
456.hmmer (avg) (percentage) -2.22% 0.900 0.880 - 144.44% -
458.sjeng -2.22% 45.000 44.000 - -53.68% -
458.sjeng (avg) -2.22% 45.000 44.000 - -53.68% -
458.sjeng (max) -2.08% 48.000 47.000 - -27.69% -
483.xalancbmk (avg) (percentage) -2.04% 1.960 1.920 - 284.00% -
447.dealII (max) (percentage) -1.89% 1.060 1.040 - -34.18% -
433.milc (avg) (percentage) -1.82% 0.550 0.540 - -46.53% -
458.sjeng (avg) (percentage) -1.79% 0.560 0.550 - -5.17% -
482.sphinx3 (avg) (percentage) -1.77% 1.130 1.110 - -40.32% -
471.omnetpp -1.75% 57.000 56.000 - -32.53% -
471.omnetpp (avg) -1.75% 57.000 56.000 - -32.53% -
403.gcc (max) (percentage) -1.68% 4.760 4.680 - 1131.58% -
470.lbm (avg) (percentage) -1.67% 1.200 1.180 - -49.14% -
483.xalancbmk -1.45% 69.000 68.000 - 44.68% -
483.xalancbmk (avg) -1.45% 69.000 68.000 - 44.68% -
471.omnetpp (avg) (percentage) -1.43% 2.100 2.070 - 165.38% -
473.astar (avg) (percentage) -1.23% 1.630 1.610 - 222.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.41% 198708.000 201502.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1131.58% 0.380 4.680 - -1.68% -
462.libquantum (max) (percentage) 790.00% 0.200 1.780 - -12.75% -
462.libquantum (avg) (percentage) 766.67% 0.150 1.300 - -0.76% -
462.libquantum (unexplained diff vs previous) (percentage) 741.67% 0.120 1.010 - -49.50% -
403.gcc (avg) (percentage) 500.00% 0.480 2.880 - 0.00% -
429.mcf (avg) (percentage) 422.22% 0.450 2.350 - -0.42% -
483.xalancbmk (avg) (percentage) 284.00% 0.500 1.920 - -2.04% -
429.mcf (unexplained diff vs previous) (percentage) 257.14% 0.560 2.000 - 0.00% -
429.mcf (max) (percentage) 250.00% 0.560 1.960 - 36.11% -
473.astar (avg) (percentage) 222.00% 0.500 1.610 - -1.23% -
445.gobmk (avg) (percentage) 194.44% 0.180 0.530 - 0.00% -
450.soplex (avg) (percentage) 183.33% 0.360 1.020 - 0.99% -
450.soplex (max) (percentage) 170.18% 0.570 1.540 - -12.50% -
471.omnetpp (avg) (percentage) 165.38% 0.780 2.070 - -1.43% -
401.bzip2 (avg) (percentage) 150.00% 0.220 0.550 - 0.00% -
456.hmmer (avg) (percentage) 144.44% 0.360 0.880 - -2.22% -
456.hmmer (unexplained diff vs previous) (percentage) 142.86% 0.070 0.170 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 133.33% 0.570 1.330 - -23.12% -
464.h264ref (avg) (percentage) 109.09% 0.330 0.690 - 0.00% -
456.hmmer (max) (percentage) 90.00% 0.300 0.570 - -18.57% -
401.bzip2 (unexplained diff vs previous) (percentage) 70.97% 0.310 0.530 - 43.24% -
401.bzip2 (max) (percentage) 67.74% 0.310 0.520 - 40.54% -
483.xalancbmk (max) (percentage) 53.85% 0.650 1.000 - -24.81% -
458.sjeng (max) (percentage) 45.00% 0.400 0.580 - -3.33% -
483.xalancbmk 44.68% 47.000 68.000 - -1.45% -
483.xalancbmk (avg) 44.68% 47.000 68.000 - -1.45% -
445.gobmk (max) (percentage) 33.33% 0.240 0.320 - -3.03% -
445.gobmk 22.73% 22.000 27.000 - 0.00% -
445.gobmk (avg) 22.73% 22.000 27.000 - 0.00% -
473.astar 11.27% 71.000 79.000 - 0.00% -
473.astar (avg) 11.27% 71.000 79.000 - 0.00% -
464.h264ref (max) (percentage) 10.26% 0.390 0.430 - 168.75% -
464.h264ref (unexplained diff vs previous) (percentage) 10.26% 0.390 0.430 - 0.00% -
453.povray (max) (percentage) 3.63% 1.930 2.000 - -4.76% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.36% 26756.000 24251.000 - -0.07% -
401.bzip2 -2.86% 39458.000 38329.000 - 0.00% -
453.povray -2.76% 593097.000 576710.000 - 0.00% -
433.milc -2.55% 74971.000 73062.000 - 0.00% -
447.dealII -1.97% 1777992.000 1743047.000 - -0.01% -
444.namd -1.41% 175160.000 172689.000 - 0.00% -
482.sphinx3 -1.30% 115736.000 114227.000 - 0.00% -
456.hmmer -1.05% 168072.000 166302.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - -3.33% -
462.libquantum -99.25% 13126.000 99.000 - -1.00% -
482.sphinx3 -96.67% 26310.000 876.000 - -0.45% -
450.soplex -96.34% 14429.000 528.000 - 1.34% -
444.namd -94.72% 13495.000 713.000 - 1.13% -
453.povray -93.22% 6857.000 465.000 - 1.75% -
433.milc -91.58% 13482.000 1135.000 - -0.09% -
429.mcf -90.42% 11999.000 1150.000 - -1.96% -
401.bzip2 -83.01% 15683.000 2664.000 - -0.52% -
447.dealII -78.11% 8196.000 1794.000 - -0.55% -
470.lbm -77.11% 13882.000 3178.000 - 0.51% -
471.omnetpp -74.42% 10746.000 2749.000 - 0.70% -
456.hmmer -73.26% 13365.000 3574.000 - 0.17% -
473.astar -65.41% 14262.000 4933.000 - 0.71% -
464.h264ref -63.97% 15493.000 5582.000 - -0.43% -
483.xalancbmk -62.10% 9427.000 3573.000 - 0.31% -
445.gobmk -57.49% 12400.000 5271.000 - -0.11% -
458.sjeng -50.43% 16406.000 8132.000 - -0.18% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.56% 904.000 4.000 - 0.00% -
482.sphinx3 (max) -99.54% 873.000 4.000 - 0.00% -
433.milc (unexplained diff vs previous) -99.45% 182.000 1.000 - -80.00% -
444.namd (max) -99.09% 882.000 8.000 - 60.00% -
444.namd (unexplained diff vs previous) -99.03% 828.000 8.000 - 0.00% -
433.milc (max) -98.37% 184.000 3.000 - -57.14% -
482.sphinx3 -98.16% 489.000 9.000 - 0.00% -
482.sphinx3 (avg) -98.16% 489.000 9.000 - 0.00% -
444.namd -97.86% 514.000 11.000 - 0.00% -
444.namd (avg) -97.86% 514.000 11.000 - 0.00% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
470.lbm (max) -97.27% 769.000 21.000 - -8.70% -
470.lbm (unexplained diff vs previous) -96.78% 497.000 16.000 - -15.79% -
462.libquantum (max) -96.15% 26.000 1.000 - -50.00% -
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
453.povray (unexplained diff vs previous) -93.85% 130.000 8.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -93.75% 16.000 1.000 - -50.00% -
433.milc (unexplained diff vs previous) (percentage) -93.33% 1.350 0.090 - -79.55% -
453.povray (max) -93.18% 132.000 9.000 - 0.00% -
450.soplex (unexplained diff vs previous) -91.46% 82.000 7.000 - -22.22% -
450.soplex (max) -90.24% 82.000 8.000 - -11.11% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII -89.17% 120.000 13.000 - -7.14% -
447.dealII (avg) -89.17% 120.000 13.000 - -7.14% -
470.lbm -88.51% 322.000 37.000 - 0.00% -
470.lbm (avg) -88.51% 322.000 37.000 - 0.00% -
470.lbm (max) (percentage) -87.55% 5.540 0.690 - -8.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -86.63% 3.440 0.460 - 0.00% -
447.dealII (max) -86.05% 129.000 18.000 - -5.26% -
470.lbm (unexplained diff vs previous) (percentage) -86.03% 3.580 0.500 - -16.67% -
482.sphinx3 (max) (percentage) -85.24% 3.320 0.490 - -7.55% -
444.namd (max) (percentage) -82.72% 6.540 1.130 - 44.87% -
483.xalancbmk (unexplained diff vs previous) -81.97% 61.000 11.000 - -77.08% -
444.namd (unexplained diff vs previous) (percentage) -81.76% 6.140 1.120 - 0.00% -
471.omnetpp (max) -81.48% 189.000 35.000 - -7.89% -
471.omnetpp (unexplained diff vs previous) -79.35% 92.000 19.000 - 111.11% -
433.milc (max) (percentage) -75.91% 1.370 0.330 - -47.62% -
401.bzip2 (max) -72.92% 48.000 13.000 - 44.44% -
401.bzip2 (unexplained diff vs previous) -71.43% 49.000 14.000 - 40.00% -
473.astar (max) -69.30% 114.000 35.000 - 45.83% -
473.astar (unexplained diff vs previous) -67.59% 108.000 35.000 - 45.83% -
429.mcf (max) -67.16% 67.000 22.000 - 37.50% -
429.mcf (unexplained diff vs previous) -65.67% 67.000 23.000 - 0.00% -
458.sjeng (unexplained diff vs previous) -63.41% 41.000 15.000 - 0.00% -
464.h264ref (max) -60.00% 60.000 24.000 - 200.00% -
464.h264ref (unexplained diff vs previous) -60.00% 60.000 24.000 - 0.00% -
401.bzip2 -58.82% 34.000 14.000 - 0.00% -
401.bzip2 (avg) -58.82% 34.000 14.000 - 0.00% -
444.namd (avg) (percentage) -56.43% 3.810 1.660 - -0.60% -
458.sjeng -53.68% 95.000 44.000 - -2.22% -
458.sjeng (avg) -53.68% 95.000 44.000 - -2.22% -
483.xalancbmk (unexplained diff vs previous) (percentage) -52.31% 0.650 0.310 - -77.04% -
456.hmmer (max) -50.00% 40.000 20.000 - -16.67% -
470.lbm (avg) (percentage) -49.14% 2.320 1.180 - -1.67% -
429.mcf -49.06% 53.000 27.000 - 0.00% -
429.mcf (avg) -49.06% 53.000 27.000 - 0.00% -
447.dealII (avg) (percentage) -46.94% 1.470 0.780 - 0.00% -
433.milc (avg) (percentage) -46.53% 1.010 0.540 - -1.82% -
445.gobmk (max) -44.83% 29.000 16.000 - -5.88% -
483.xalancbmk (max) -42.62% 61.000 35.000 - -25.53% -
482.sphinx3 (avg) (percentage) -40.32% 1.860 1.110 - -1.77% -
456.hmmer -35.42% 48.000 31.000 - -3.12% -
456.hmmer (avg) -35.42% 48.000 31.000 - -3.12% -
447.dealII (max) (percentage) -34.18% 1.580 1.040 - -1.89% -
456.hmmer (unexplained diff vs previous) -33.33% 9.000 6.000 - 0.00% -
471.omnetpp -32.53% 83.000 56.000 - -1.75% -
471.omnetpp (avg) -32.53% 83.000 56.000 - -1.75% -
458.sjeng (unexplained diff vs previous) (percentage) -28.00% 0.250 0.180 - 0.00% -
458.sjeng (max) -27.69% 65.000 47.000 - -2.08% -
471.omnetpp (max) (percentage) -26.70% 1.760 1.290 - -7.86% -
464.h264ref -25.49% 51.000 38.000 - 0.00% -
464.h264ref (avg) -25.49% 51.000 38.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -19.77% 0.860 0.690 - 109.09% -
473.astar (max) (percentage) -11.25% 0.800 0.710 - 44.90% -
453.povray (unexplained diff vs previous) (percentage) -9.47% 1.900 1.720 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -6.58% 0.760 0.710 - 44.90% -
453.povray (avg) (percentage) -5.84% 1.370 1.290 - 1.57% -
458.sjeng (avg) (percentage) -5.17% 0.580 0.550 - -1.79% -


Report Time: 0.36s
Name Current %
401.bzip2 2664.000 -
403.gcc 58.000 -3.33%
429.mcf 1150.000 -1.96%
433.milc 1135.000 -
444.namd 713.000 1.13%
445.gobmk 5271.000 -
447.dealII 1794.000 -
450.soplex 528.000 1.34%
453.povray 465.000 1.75%
456.hmmer 3574.000 -
458.sjeng 8132.000 -
462.libquantum 99.000 -1.00%
464.h264ref 5582.000 -
470.lbm 3178.000 -
471.omnetpp 2749.000 -
473.astar 4933.000 -
482.sphinx3 876.000 -
483.xalancbmk 3573.000 -
Geometric Mean 1441.618 -
Name Current %
401.bzip2 38329.000 -
403.gcc 1958537.000 -
429.mcf 7846.000 -
433.milc 73062.000 -
444.namd 172689.000 -
445.gobmk 1310280.000 -
447.dealII 1743047.000 -
450.soplex 201502.000 -
453.povray 576710.000 -
456.hmmer 166302.000 -
458.sjeng 97113.000 -
462.libquantum 24251.000 -
464.h264ref 353030.000 -
470.lbm 9702.000 -
471.omnetpp 376307.000 -
473.astar 23367.000 -
482.sphinx3 114227.000 -
483.xalancbmk 2283388.000 -
Geometric Mean 162244.195 -
Name Current %
401.bzip2 14.000 -
401.bzip2 (avg) 14.000 -
401.bzip2 (avg) (percentage) 0.550 -
401.bzip2 (max) 13.000 44.44%
401.bzip2 (max) (percentage) 0.520 40.54%
401.bzip2 (unexplained diff vs previous) 14.000 40.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.530 43.24%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.880 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.680 -1.68%
429.mcf 27.000 -
429.mcf (avg) 27.000 -
429.mcf (avg) (percentage) 2.350 -
429.mcf (max) 22.000 37.50%
429.mcf (max) (percentage) 1.960 36.11%
429.mcf (unexplained diff vs previous) 23.000 -
429.mcf (unexplained diff vs previous) (percentage) 2.000 -
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.540 -1.82%
433.milc (max) 3.000 -57.14%
433.milc (max) (percentage) 0.330 -47.62%
433.milc (unexplained diff vs previous) 1.000 -80.00%
433.milc (unexplained diff vs previous) (percentage) 0.090 -79.55%
444.namd 11.000 -
444.namd (avg) 11.000 -
444.namd (avg) (percentage) 1.660 -
444.namd (max) 8.000 60.00%
444.namd (max) (percentage) 1.130 44.87%
444.namd (unexplained diff vs previous) 8.000 -
444.namd (unexplained diff vs previous) (percentage) 1.120 -
445.gobmk 27.000 -
445.gobmk (avg) 27.000 -
445.gobmk (avg) (percentage) 0.530 -
445.gobmk (max) 16.000 -5.88%
445.gobmk (max) (percentage) 0.320 -3.03%
447.dealII 13.000 -7.14%
447.dealII (avg) 13.000 -7.14%
447.dealII (avg) (percentage) 0.780 -
447.dealII (max) 18.000 -5.26%
447.dealII (max) (percentage) 1.040 -1.89%
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.020 -
450.soplex (max) 8.000 -11.11%
450.soplex (max) (percentage) 1.540 -12.50%
450.soplex (unexplained diff vs previous) 7.000 -22.22%
450.soplex (unexplained diff vs previous) (percentage) 1.330 -23.12%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.290 1.57%
453.povray (max) 9.000 -
453.povray (max) (percentage) 2.000 -4.76%
453.povray (unexplained diff vs previous) 8.000 -
453.povray (unexplained diff vs previous) (percentage) 1.720 -
456.hmmer 31.000 -3.12%
456.hmmer (avg) 31.000 -3.12%
456.hmmer (avg) (percentage) 0.880 -2.22%
456.hmmer (max) 20.000 -16.67%
456.hmmer (max) (percentage) 0.570 -18.57%
456.hmmer (unexplained diff vs previous) 6.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.170 -
458.sjeng 44.000 -2.22%
458.sjeng (avg) 44.000 -2.22%
458.sjeng (avg) (percentage) 0.550 -1.79%
458.sjeng (max) 47.000 -2.08%
458.sjeng (max) (percentage) 0.580 -3.33%
458.sjeng (unexplained diff vs previous) 15.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.180 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.300 -
462.libquantum (max) 1.000 -50.00%
462.libquantum (max) (percentage) 1.780 -12.75%
462.libquantum (unexplained diff vs previous) 1.000 -50.00%
462.libquantum (unexplained diff vs previous) (percentage) 1.010 -49.50%
464.h264ref 38.000 -
464.h264ref (avg) 38.000 -
464.h264ref (avg) (percentage) 0.690 -
464.h264ref (max) 24.000 200.00%
464.h264ref (max) (percentage) 0.430 168.75%
464.h264ref (unexplained diff vs previous) 24.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.430 -
470.lbm 37.000 -
470.lbm (avg) 37.000 -
470.lbm (avg) (percentage) 1.180 -1.67%
470.lbm (max) 21.000 -8.70%
470.lbm (max) (percentage) 0.690 -8.00%
470.lbm (unexplained diff vs previous) 16.000 -15.79%
470.lbm (unexplained diff vs previous) (percentage) 0.500 -16.67%
471.omnetpp 56.000 -1.75%
471.omnetpp (avg) 56.000 -1.75%
471.omnetpp (avg) (percentage) 2.070 -1.43%
471.omnetpp (max) 35.000 -7.89%
471.omnetpp (max) (percentage) 1.290 -7.86%
471.omnetpp (unexplained diff vs previous) 19.000 111.11%
471.omnetpp (unexplained diff vs previous) (percentage) 0.690 109.09%
473.astar 79.000 -
473.astar (avg) 79.000 -
473.astar (avg) (percentage) 1.610 -1.23%
473.astar (max) 35.000 45.83%
473.astar (max) (percentage) 0.710 44.90%
473.astar (unexplained diff vs previous) 35.000 45.83%
473.astar (unexplained diff vs previous) (percentage) 0.710 44.90%
482.sphinx3 9.000 -
482.sphinx3 (avg) 9.000 -
482.sphinx3 (avg) (percentage) 1.110 -1.77%
482.sphinx3 (max) 4.000 -
482.sphinx3 (max) (percentage) 0.490 -7.55%
482.sphinx3 (unexplained diff vs previous) 4.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.460 -
483.xalancbmk 68.000 -1.45%
483.xalancbmk (avg) 68.000 -1.45%
483.xalancbmk (avg) (percentage) 1.920 -2.04%
483.xalancbmk (max) 35.000 -25.53%
483.xalancbmk (max) (percentage) 1.000 -24.81%
483.xalancbmk (unexplained diff vs previous) 11.000 -77.08%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.310 -77.04%
Geometric Mean 3.956 -10.53%