Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ae2012d701827f224df04d0ae57e89472c1322d2 (+ 392 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/185/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0185 (llvmorg-19-init-18365-gae2012d70182) 2024-07-17T11:47:32 0:00:00
Previous 0184 (llvmorg-19-init-17973-g7647174738bf) 2024-07-14T01:04:33 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 20 25
Performance Improvements 48 118
Added Tests 4 2
Unchanged Tests 708 635
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 9.09% 55.000 60.000 - -99.34% -
462.libquantum 4.26% 94.000 98.000 - -99.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 400.00% 1.000 5.000 0.000 -92.54% 0.000
429.mcf (unexplained diff vs previous) (percentage) 377.78% 0.090 0.430 0.000 -23.21% 0.000
471.omnetpp (unexplained diff vs previous) 160.00% 10.000 26.000 0.000 -71.74% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 158.33% 0.360 0.930 0.000 8.14% 0.000
470.lbm (unexplained diff vs previous) (percentage) 86.36% 0.220 0.410 0.000 -88.55% 0.000
470.lbm (unexplained diff vs previous) 85.71% 7.000 13.000 0.000 -97.38% 0.000
444.namd (unexplained diff vs previous) (percentage) 50.91% 0.550 0.830 0.000 -86.48% 0.000
444.namd (unexplained diff vs previous) 50.00% 4.000 6.000 0.000 -99.28% 0.000
470.lbm (max) (percentage) 41.38% 0.290 0.410 - -92.60% -
444.namd (max) (percentage) 36.07% 0.610 0.830 - -87.31% -
462.libquantum (max) 33.33% 3.000 4.000 - -84.62% -
462.libquantum (unexplained diff vs previous) 33.33% 3.000 4.000 0.000 -75.00% 0.000
470.lbm (max) 33.33% 9.000 12.000 - -98.44% -
462.libquantum (unexplained diff vs previous) (percentage) 27.90% 3.190 4.080 0.000 3300.00% 0.000
444.namd (max) 25.00% 4.000 5.000 - -99.43% -
462.libquantum (max) (percentage) 15.76% 3.680 4.260 - 2030.00% -
462.libquantum (avg) (percentage) 2.50% 1.600 1.640 - 993.33% -
447.dealII (max) (percentage) 1.15% 0.870 0.880 - -44.30% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
453.povray -1.08% 463.000 458.000 - -93.32% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
456.hmmer (unexplained diff vs previous) (percentage) -84.31% 0.510 0.080 0.000 14.29% 0.000
456.hmmer (unexplained diff vs previous) -83.33% 18.000 3.000 0.000 -66.67% 0.000
482.sphinx3 (unexplained diff vs previous) -83.33% 12.000 2.000 0.000 -99.78% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -83.21% 1.370 0.230 0.000 -93.31% 0.000
445.gobmk (unexplained diff vs previous) -75.00% 24.000 6.000 0.000 -80.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -73.91% 0.460 0.120 0.000 -50.00% 0.000
473.astar (unexplained diff vs previous) -43.48% 23.000 13.000 0.000 -87.96% 0.000
473.astar (unexplained diff vs previous) (percentage) -42.55% 0.470 0.270 0.000 -64.47% 0.000
433.milc (unexplained diff vs previous) (percentage) -34.62% 0.260 0.170 0.000 -87.41% 0.000
433.milc (unexplained diff vs previous) -33.33% 3.000 2.000 0.000 -98.90% 0.000
464.h264ref (unexplained diff vs previous) -33.33% 3.000 2.000 0.000 -96.67% 0.000
482.sphinx3 (max) -27.27% 11.000 8.000 - -99.08% -
482.sphinx3 (max) (percentage) -25.19% 1.350 1.010 - -69.58% -
464.h264ref (unexplained diff vs previous) (percentage) -20.00% 0.050 0.040 0.000 -89.74% 0.000
445.gobmk (max) (percentage) -17.39% 0.460 0.380 - 58.33% -
445.gobmk (max) -17.39% 23.000 19.000 - -34.48% -
458.sjeng (max) (percentage) -15.62% 0.320 0.270 - -32.50% -
458.sjeng (max) -15.38% 26.000 22.000 - -66.15% -
458.sjeng (unexplained diff vs previous) -15.38% 26.000 22.000 0.000 -46.34% 0.000
473.astar (max) -13.64% 22.000 19.000 - -83.33% -
458.sjeng (unexplained diff vs previous) (percentage) -12.90% 0.310 0.270 0.000 8.00% 0.000
473.astar (max) (percentage) -12.77% 0.470 0.410 - -48.75% -
433.milc (max) -12.50% 8.000 7.000 - -96.20% -
401.bzip2 (max) -11.11% 18.000 16.000 - -66.67% -
401.bzip2 (max) (percentage) -7.46% 0.670 0.620 - 100.00% -
429.mcf (max) -7.14% 14.000 13.000 - -80.60% -
429.mcf (max) (percentage) -6.45% 1.240 1.160 - 107.14% -
450.soplex (max) (percentage) -6.25% 0.640 0.600 - 5.26% -
456.hmmer (max) (percentage) -6.00% 0.500 0.470 - 56.67% -
445.gobmk -5.88% 17.000 16.000 - -27.27% -
445.gobmk (avg) -5.88% 17.000 16.000 - -27.27% -
456.hmmer (max) -5.88% 17.000 16.000 - -60.00% -
453.povray (max) (percentage) -5.88% 1.190 1.120 - -41.97% -
456.hmmer -5.56% 18.000 17.000 - -64.58% -
456.hmmer (avg) -5.56% 18.000 17.000 - -64.58% -
433.milc (max) (percentage) -5.48% 0.730 0.690 - -49.64% -
471.omnetpp (max) (percentage) -3.42% 1.170 1.130 - -35.80% -
471.omnetpp (max) -3.12% 32.000 31.000 - -83.60% -
445.gobmk (avg) (percentage) -3.03% 0.330 0.320 - 77.78% -
403.gcc (max) (percentage) -2.85% 3.860 3.750 - 886.84% -
473.astar -2.63% 38.000 37.000 - -47.89% -
473.astar (avg) -2.63% 38.000 37.000 - -47.89% -
401.bzip2 (avg) (percentage) -2.04% 0.490 0.480 - 118.18% -
456.hmmer (avg) (percentage) -1.96% 0.510 0.500 - 38.89% -
429.mcf (avg) (percentage) -1.40% 1.430 1.410 - 213.33% -
473.astar (avg) (percentage) -1.28% 0.780 0.770 - 54.00% -
482.sphinx3 (avg) (percentage) -1.12% 0.890 0.880 - -52.69% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.53% 39458.000 41641.000 - 0.00% -
450.soplex 1.93% 198708.000 202543.000 - 0.00% -
471.omnetpp 1.21% 373579.000 378100.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 3300.00% 0.120 4.080 0.000 27.90% 0.000
462.libquantum (max) (percentage) 2030.00% 0.200 4.260 - 15.76% -
462.libquantum (avg) (percentage) 993.33% 0.150 1.640 - 2.50% -
403.gcc (max) (percentage) 886.84% 0.380 3.750 - -2.85% -
403.gcc (avg) (percentage) 670.83% 0.480 3.700 - 0.00% -
450.soplex (avg) (percentage) 216.67% 0.360 1.140 - -0.87% -
429.mcf (avg) (percentage) 213.33% 0.450 1.410 - -1.40% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
401.bzip2 (avg) (percentage) 118.18% 0.220 0.480 - -2.04% -
429.mcf (max) (percentage) 107.14% 0.560 1.160 - -6.45% -
401.bzip2 (max) (percentage) 100.00% 0.310 0.620 - -7.46% -
445.gobmk (avg) (percentage) 77.78% 0.180 0.320 - -3.03% -
471.omnetpp (avg) (percentage) 75.64% 0.780 1.370 - -0.72% -
445.gobmk (max) (percentage) 58.33% 0.240 0.380 - -17.39% -
456.hmmer (max) (percentage) 56.67% 0.300 0.470 - -6.00% -
473.astar (avg) (percentage) 54.00% 0.500 0.770 - -1.28% -
456.hmmer (avg) (percentage) 38.89% 0.360 0.500 - -1.96% -
464.h264ref (avg) (percentage) 12.12% 0.330 0.370 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 8.14% 0.860 0.930 0.000 158.33% 0.000
458.sjeng (unexplained diff vs previous) (percentage) 8.00% 0.250 0.270 0.000 -12.90% 0.000
450.soplex (max) (percentage) 5.26% 0.570 0.600 - -6.25% -
483.xalancbmk (max) (percentage) 4.62% 0.650 0.680 - -1.45% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.45% 26756.000 23959.000 - 0.00% -
433.milc -2.78% 74971.000 72890.000 - 0.00% -
453.povray -2.33% 593097.000 579275.000 - -0.00% -
447.dealII -2.12% 1777992.000 1740291.000 - 0.00% -
444.namd -1.34% 175160.000 172809.000 - 0.00% -
464.h264ref -1.26% 354618.000 350136.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.34% 9099.000 60.000 - 9.09% -
462.libquantum -99.25% 13126.000 98.000 - 4.26% -
482.sphinx3 -96.66% 26310.000 880.000 - 0.23% -
450.soplex -96.39% 14429.000 521.000 - 0.00% -
444.namd -94.66% 13495.000 721.000 - -0.83% -
453.povray -93.32% 6857.000 458.000 - -1.08% -
433.milc -91.48% 13482.000 1148.000 - 0.17% -
429.mcf -90.37% 11999.000 1155.000 - -0.43% -
401.bzip2 -82.73% 15683.000 2709.000 - 0.04% -
447.dealII -77.99% 8196.000 1804.000 - -0.88% -
470.lbm -77.17% 13882.000 3169.000 - 0.41% -
471.omnetpp -74.06% 10746.000 2787.000 - 0.94% -
456.hmmer -73.45% 13365.000 3549.000 - -0.08% -
473.astar -65.86% 14262.000 4869.000 - -0.27% -
464.h264ref -64.13% 15493.000 5558.000 - 0.04% -
445.gobmk -58.10% 12400.000 5196.000 - -0.12% -
458.sjeng -49.68% 16406.000 8255.000 - -0.27% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (unexplained diff vs previous) -99.78% 904.000 2.000 0.000 -83.33% 0.000
444.namd (max) -99.43% 882.000 5.000 - 25.00% -
444.namd (unexplained diff vs previous) -99.28% 828.000 6.000 0.000 50.00% 0.000
482.sphinx3 (max) -99.08% 873.000 8.000 - -27.27% -
433.milc (unexplained diff vs previous) -98.90% 182.000 2.000 0.000 -33.33% 0.000
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
470.lbm (max) -98.44% 769.000 12.000 - 33.33% -
401.bzip2 (unexplained diff vs previous) -97.96% 49.000 1.000 0.000 0.00% 0.000
470.lbm (unexplained diff vs previous) -97.38% 497.000 13.000 0.000 85.71% 0.000
464.h264ref (unexplained diff vs previous) -96.67% 60.000 2.000 0.000 -33.33% 0.000
450.soplex (max) -96.34% 82.000 3.000 - 0.00% -
453.povray (max) -96.21% 132.000 5.000 - 0.00% -
433.milc (max) -96.20% 184.000 7.000 - -12.50% -
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
464.h264ref (max) -95.00% 60.000 3.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.31% 3.440 0.230 0.000 -83.21% 0.000
470.lbm -92.86% 322.000 23.000 - 0.00% -
470.lbm (avg) -92.86% 322.000 23.000 - 0.00% -
470.lbm (max) (percentage) -92.60% 5.540 0.410 - 41.38% -
429.mcf (unexplained diff vs previous) -92.54% 67.000 5.000 0.000 400.00% 0.000
447.dealII -91.67% 120.000 10.000 - 0.00% -
447.dealII (avg) -91.67% 120.000 10.000 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -89.74% 0.390 0.040 0.000 -20.00% 0.000
470.lbm (unexplained diff vs previous) (percentage) -88.55% 3.580 0.410 0.000 86.36% 0.000
447.dealII (max) -88.37% 129.000 15.000 - 0.00% -
473.astar (unexplained diff vs previous) -87.96% 108.000 13.000 0.000 -43.48% 0.000
433.milc (unexplained diff vs previous) (percentage) -87.41% 1.350 0.170 0.000 -34.62% 0.000
444.namd (max) (percentage) -87.31% 6.540 0.830 - 36.07% -
401.bzip2 (unexplained diff vs previous) (percentage) -87.10% 0.310 0.040 0.000 0.00% 0.000
447.dealII (unexplained diff vs previous) -86.78% 121.000 16.000 0.000 0.00% 0.000
444.namd (unexplained diff vs previous) (percentage) -86.48% 6.140 0.830 0.000 50.91% 0.000
462.libquantum (max) -84.62% 26.000 4.000 - 33.33% -
471.omnetpp (max) -83.60% 189.000 31.000 - -3.12% -
473.astar (max) -83.33% 114.000 19.000 - -13.64% -
464.h264ref (max) (percentage) -82.05% 0.390 0.070 - 0.00% -
429.mcf (max) -80.60% 67.000 13.000 - -7.14% -
445.gobmk (unexplained diff vs previous) -80.00% 30.000 6.000 0.000 -75.00% 0.000
444.namd (avg) (percentage) -75.59% 3.810 0.930 - 0.00% -
462.libquantum (unexplained diff vs previous) -75.00% 16.000 4.000 0.000 33.33% 0.000
471.omnetpp (unexplained diff vs previous) -71.74% 92.000 26.000 0.000 160.00% 0.000
429.mcf -69.81% 53.000 16.000 - 0.00% -
429.mcf (avg) -69.81% 53.000 16.000 - 0.00% -
482.sphinx3 (max) (percentage) -69.58% 3.320 1.010 - -25.19% -
458.sjeng -69.47% 95.000 29.000 - 0.00% -
458.sjeng (avg) -69.47% 95.000 29.000 - 0.00% -
470.lbm (avg) (percentage) -68.10% 2.320 0.740 - 0.00% -
401.bzip2 (max) -66.67% 48.000 16.000 - -11.11% -
456.hmmer (unexplained diff vs previous) -66.67% 9.000 3.000 0.000 -83.33% 0.000
458.sjeng (max) -66.15% 65.000 22.000 - -15.38% -
456.hmmer -64.58% 48.000 17.000 - -5.56% -
456.hmmer (avg) -64.58% 48.000 17.000 - -5.56% -
473.astar (unexplained diff vs previous) (percentage) -64.47% 0.760 0.270 0.000 -42.55% 0.000
401.bzip2 -61.76% 34.000 13.000 - 0.00% -
401.bzip2 (avg) -61.76% 34.000 13.000 - 0.00% -
464.h264ref -60.78% 51.000 20.000 - 0.00% -
464.h264ref (avg) -60.78% 51.000 20.000 - 0.00% -
456.hmmer (max) -60.00% 40.000 16.000 - -5.88% -
447.dealII (avg) (percentage) -59.86% 1.470 0.590 - 0.00% -
471.omnetpp -54.22% 83.000 38.000 - 0.00% -
471.omnetpp (avg) -54.22% 83.000 38.000 - 0.00% -
482.sphinx3 (avg) (percentage) -52.69% 1.860 0.880 - -1.12% -
445.gobmk (unexplained diff vs previous) (percentage) -50.00% 0.240 0.120 0.000 -73.91% 0.000
433.milc (max) (percentage) -49.64% 1.370 0.690 - -5.48% -
473.astar (max) (percentage) -48.75% 0.800 0.410 - -12.77% -
473.astar -47.89% 71.000 37.000 - -2.63% -
473.astar (avg) -47.89% 71.000 37.000 - -2.63% -
458.sjeng (unexplained diff vs previous) -46.34% 41.000 22.000 0.000 -15.38% 0.000
433.milc (avg) (percentage) -44.55% 1.010 0.560 - -1.75% -
447.dealII (max) (percentage) -44.30% 1.580 0.880 - 1.15% -
453.povray (max) (percentage) -41.97% 1.930 1.120 - -5.88% -
447.dealII (unexplained diff vs previous) (percentage) -39.86% 1.480 0.890 0.000 0.00% 0.000
458.sjeng (avg) (percentage) -37.93% 0.580 0.360 - 0.00% -
471.omnetpp (max) (percentage) -35.80% 1.760 1.130 - -3.42% -
445.gobmk (max) -34.48% 29.000 19.000 - -17.39% -
458.sjeng (max) (percentage) -32.50% 0.400 0.270 - -15.62% -
445.gobmk -27.27% 22.000 16.000 - -5.88% -
445.gobmk (avg) -27.27% 22.000 16.000 - -5.88% -
453.povray (avg) (percentage) -24.82% 1.370 1.030 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -23.21% 0.560 0.430 0.000 377.78% 0.000

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
450.soplex (unexplained diff vs previous)
450.soplex (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2709.000 -
403.gcc 60.000 9.09%
429.mcf 1155.000 -
433.milc 1148.000 -
444.namd 721.000 -
445.gobmk 5196.000 -
447.dealII 1804.000 -
450.soplex 521.000 -
453.povray 458.000 -1.08%
456.hmmer 3549.000 -
458.sjeng 8255.000 -
462.libquantum 98.000 4.26%
464.h264ref 5558.000 -
470.lbm 3169.000 -
471.omnetpp 2787.000 -
473.astar 4869.000 -
482.sphinx3 880.000 -
Geometric Mean 1369.579 -
Code Size (bytes)
Name Current %
401.bzip2 41641.000 -
403.gcc 1955813.000 -
429.mcf 7958.000 -
433.milc 72890.000 -
444.namd 172809.000 -
445.gobmk 1308860.000 -
447.dealII 1740291.000 -
450.soplex 202543.000 -
453.povray 579275.000 -
456.hmmer 167622.000 -
458.sjeng 96961.000 -
462.libquantum 23959.000 -
464.h264ref 350136.000 -
470.lbm 9714.000 -
471.omnetpp 378100.000 -
473.astar 23351.000 -
482.sphinx3 115267.000 -
Geometric Mean 139702.152 -
sample variability
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.480 -2.04%
401.bzip2 (max) 16.000 -11.11%
401.bzip2 (max) (percentage) 0.620 -7.46%
401.bzip2 (unexplained diff vs previous) 1.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.700 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 3.750 -2.85%
429.mcf 16.000 -
429.mcf (avg) 16.000 -
429.mcf (avg) (percentage) 1.410 -1.40%
429.mcf (max) 13.000 -7.14%
429.mcf (max) (percentage) 1.160 -6.45%
429.mcf (unexplained diff vs previous) 5.000 400.00%
429.mcf (unexplained diff vs previous) (percentage) 0.430 377.78%
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.560 -
433.milc (max) 7.000 -12.50%
433.milc (max) (percentage) 0.690 -5.48%
433.milc (unexplained diff vs previous) 2.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.170 -34.62%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.930 -
444.namd (max) 5.000 25.00%
444.namd (max) (percentage) 0.830 36.07%
444.namd (unexplained diff vs previous) 6.000 50.00%
444.namd (unexplained diff vs previous) (percentage) 0.830 50.91%
445.gobmk 16.000 -5.88%
445.gobmk (avg) 16.000 -5.88%
445.gobmk (avg) (percentage) 0.320 -3.03%
445.gobmk (max) 19.000 -17.39%
445.gobmk (max) (percentage) 0.380 -17.39%
445.gobmk (unexplained diff vs previous) 6.000 -75.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -73.91%
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 0.590 -
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 0.880 1.15%
447.dealII (unexplained diff vs previous) 16.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.890 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.140 -
450.soplex (max) 3.000 -
450.soplex (max) (percentage) 0.600 -6.25%
450.soplex (unexplained diff vs previous) 0.000 -
450.soplex (unexplained diff vs previous) (percentage) 0.000 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.030 -
453.povray (max) 5.000 -
453.povray (max) (percentage) 1.120 -5.88%
456.hmmer 17.000 -5.56%
456.hmmer (avg) 17.000 -5.56%
456.hmmer (avg) (percentage) 0.500 -1.96%
456.hmmer (max) 16.000 -5.88%
456.hmmer (max) (percentage) 0.470 -6.00%
456.hmmer (unexplained diff vs previous) 3.000 -83.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.080 -84.31%
458.sjeng 29.000 -
458.sjeng (avg) 29.000 -
458.sjeng (avg) (percentage) 0.360 -
458.sjeng (max) 22.000 -15.38%
458.sjeng (max) (percentage) 0.270 -15.62%
458.sjeng (unexplained diff vs previous) 22.000 -15.38%
458.sjeng (unexplained diff vs previous) (percentage) 0.270 -12.90%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.640 2.50%
462.libquantum (max) 4.000 33.33%
462.libquantum (max) (percentage) 4.260 15.76%
462.libquantum (unexplained diff vs previous) 4.000 33.33%
462.libquantum (unexplained diff vs previous) (percentage) 4.080 27.90%
464.h264ref 20.000 -
464.h264ref (avg) 20.000 -
464.h264ref (avg) (percentage) 0.370 -
464.h264ref (max) 3.000 -
464.h264ref (max) (percentage) 0.070 -
464.h264ref (unexplained diff vs previous) 2.000 -33.33%
464.h264ref (unexplained diff vs previous) (percentage) 0.040 -20.00%
470.lbm 23.000 -
470.lbm (avg) 23.000 -
470.lbm (avg) (percentage) 0.740 -
470.lbm (max) 12.000 33.33%
470.lbm (max) (percentage) 0.410 41.38%
470.lbm (unexplained diff vs previous) 13.000 85.71%
470.lbm (unexplained diff vs previous) (percentage) 0.410 86.36%
471.omnetpp 38.000 -
471.omnetpp (avg) 38.000 -
471.omnetpp (avg) (percentage) 1.370 -
471.omnetpp (max) 31.000 -3.12%
471.omnetpp (max) (percentage) 1.130 -3.42%
471.omnetpp (unexplained diff vs previous) 26.000 160.00%
471.omnetpp (unexplained diff vs previous) (percentage) 0.930 158.33%
473.astar 37.000 -2.63%
473.astar (avg) 37.000 -2.63%
473.astar (avg) (percentage) 0.770 -1.28%
473.astar (max) 19.000 -13.64%
473.astar (max) (percentage) 0.410 -12.77%
473.astar (unexplained diff vs previous) 13.000 -43.48%
473.astar (unexplained diff vs previous) (percentage) 0.270 -42.55%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.880 -1.12%
482.sphinx3 (max) 8.000 -27.27%
482.sphinx3 (max) (percentage) 1.010 -25.19%
482.sphinx3 (unexplained diff vs previous) 2.000 -83.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.230 -83.21%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.680 -
Geometric Mean 2.227 -20.15%