Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6b21cf8ccad84e2670e458d8bdaccbd0ae37b46b (+ 435 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/229/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0229 (llvmorg-20-init-11631-g6b21cf8ccad8) 2024-11-02T08:11:10 0:00:00
Previous 0228 (llvmorg-20-init-11196-gc1cec8c0dc5b) 2024-10-26T17:47:54 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 15 26
Performance Improvements 44 118
Added Tests 10 0
Unchanged Tests 711 636
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) 1300.00% 1.000 14.000 - -76.67% -
464.h264ref (unexplained diff vs previous) (percentage) 1150.00% 0.020 0.250 - -35.90% -
470.lbm (unexplained diff vs previous) (percentage) 145.45% 0.220 0.540 - -84.92% -
470.lbm (unexplained diff vs previous) 142.86% 7.000 17.000 - -96.58% -
471.omnetpp (unexplained diff vs previous) (percentage) 63.31% 1.690 2.760 - 220.93% -
471.omnetpp (unexplained diff vs previous) 58.33% 48.000 76.000 - -17.39% -
471.omnetpp (max) (percentage) 55.81% 1.720 2.680 - 52.27% -
462.libquantum (unexplained diff vs previous) (percentage) 54.90% 2.040 3.160 - 2533.33% -
471.omnetpp (max) 52.08% 48.000 73.000 - -61.38% -
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 - -81.25% -
462.libquantum (max) (percentage) 45.02% 2.110 3.060 - 1430.00% -
464.h264ref (max) (percentage) 8.70% 0.230 0.250 - -35.90% -
464.h264ref (max) 8.33% 12.000 13.000 - -78.33% -
471.omnetpp (avg) (percentage) 1.50% 1.330 1.350 - 73.08% -
462.libquantum (avg) (percentage) 1.23% 1.630 1.650 - 1000.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.08% 59.000 56.000 - -99.38% -
462.libquantum -3.06% 98.000 95.000 - -99.28% -
471.omnetpp -2.68% 2833.000 2757.000 - -74.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -80.00% 5.000 1.000 - -98.51% -
429.mcf (unexplained diff vs previous) (percentage) -79.55% 0.440 0.090 - -83.93% -
450.soplex (unexplained diff vs previous) -71.43% 7.000 2.000 - -97.56% -
450.soplex (unexplained diff vs previous) (percentage) -71.43% 1.330 0.380 - -33.33% -
429.mcf (max) -69.23% 13.000 4.000 - -94.03% -
429.mcf (max) (percentage) -68.91% 1.190 0.370 - -33.93% -
433.milc (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.45% -
433.milc (unexplained diff vs previous) (percentage) -65.38% 0.260 0.090 - -93.33% -
456.hmmer (unexplained diff vs previous) (percentage) -60.71% 0.280 0.110 - 57.14% -
456.hmmer (unexplained diff vs previous) -60.00% 10.000 4.000 - -55.56% -
473.astar (max) -52.50% 40.000 19.000 - -83.33% -
473.astar (max) (percentage) -50.60% 0.830 0.410 - -48.75% -
433.milc (max) -33.33% 3.000 2.000 - -98.91% -
433.milc (max) (percentage) -25.81% 0.310 0.230 - -83.21% -
473.astar (unexplained diff vs previous) (percentage) -19.57% 0.460 0.370 - -51.32% -
473.astar (unexplained diff vs previous) -18.18% 22.000 18.000 - -83.33% -
450.soplex (max) -14.29% 7.000 6.000 - -92.68% -
450.soplex (max) (percentage) -12.59% 1.350 1.180 - 107.02% -
456.hmmer (max) -11.11% 9.000 8.000 - -80.00% -
456.hmmer (max) (percentage) -10.71% 0.280 0.250 - -16.67% -
458.sjeng (max) (percentage) -10.00% 0.500 0.450 - 12.50% -
458.sjeng (max) -9.76% 41.000 37.000 - -43.08% -
453.povray (max) (percentage) -8.43% 0.830 0.760 - -60.62% -
401.bzip2 -7.69% 13.000 12.000 - -64.71% -
401.bzip2 (avg) -7.69% 13.000 12.000 - -64.71% -
401.bzip2 (max) -5.56% 18.000 17.000 - -64.58% -
445.gobmk (max) (percentage) -5.26% 0.190 0.180 - -25.00% -
444.namd (max) (percentage) -4.80% 1.250 1.190 - -81.80% -
470.lbm (max) -4.76% 21.000 20.000 - -97.40% -
401.bzip2 (max) (percentage) -4.55% 0.660 0.630 - 103.23% -
470.lbm -4.55% 22.000 21.000 - -93.48% -
470.lbm (avg) -4.55% 22.000 21.000 - -93.48% -
470.lbm (max) (percentage) -4.48% 0.670 0.640 - -88.45% -
447.dealII (max) (percentage) -4.38% 1.600 1.530 - -3.16% -
447.dealII (max) -3.57% 28.000 27.000 - -79.07% -
482.sphinx3 (max) (percentage) -3.53% 0.850 0.820 - -75.30% -
456.hmmer (avg) (percentage) -2.17% 0.460 0.450 - 25.00% -
401.bzip2 (avg) (percentage) -2.08% 0.480 0.470 - 113.64% -
403.gcc (max) (percentage) -2.00% 2.500 2.450 - 544.74% -
453.povray (avg) (percentage) -1.96% 1.020 1.000 - -27.01% -
473.astar (avg) (percentage) -1.47% 0.680 0.670 - 34.00% -

Added Tests - sample variability
401.bzip2 (unexplained diff vs previous)
401.bzip2 (unexplained diff vs previous) (percentage)
444.namd (unexplained diff vs previous)
444.namd (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 9.82% 39458.000 43333.000 - 0.00% -
450.soplex 1.89% 198708.000 202463.000 - -0.02% -
471.omnetpp 1.10% 373579.000 377700.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 2533.33% 0.120 3.160 - 54.90% -
462.libquantum (max) (percentage) 1430.00% 0.200 3.060 - 45.02% -
462.libquantum (avg) (percentage) 1000.00% 0.150 1.650 - 1.23% -
403.gcc (avg) (percentage) 683.33% 0.480 3.760 - 0.00% -
403.gcc (max) (percentage) 544.74% 0.380 2.450 - -2.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 220.93% 0.860 2.760 - 63.31% -
450.soplex (avg) (percentage) 194.44% 0.360 1.060 - -0.93% -
429.mcf (avg) (percentage) 191.11% 0.450 1.310 - -0.76% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
401.bzip2 (avg) (percentage) 113.64% 0.220 0.470 - -2.08% -
450.soplex (max) (percentage) 107.02% 0.570 1.180 - -12.59% -
401.bzip2 (max) (percentage) 103.23% 0.310 0.630 - -4.55% -
471.omnetpp (avg) (percentage) 73.08% 0.780 1.350 - 1.50% -
445.gobmk (avg) (percentage) 61.11% 0.180 0.290 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 57.14% 0.070 0.110 - -60.71% -
471.omnetpp (max) (percentage) 52.27% 1.760 2.680 - 55.81% -
473.astar (avg) (percentage) 34.00% 0.500 0.670 - -1.47% -
456.hmmer (avg) (percentage) 25.00% 0.360 0.450 - -2.17% -
458.sjeng (max) (percentage) 12.50% 0.400 0.450 - -10.00% -
458.sjeng (unexplained diff vs previous) (percentage) 8.00% 0.250 0.270 - 0.00% -
483.xalancbmk (max) (percentage) 3.08% 0.650 0.670 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.04% 26756.000 24071.000 - 0.00% -
433.milc -2.86% 74971.000 72830.000 - 0.00% -
453.povray -2.33% 593097.000 579303.000 - 0.00% -
447.dealII -2.26% 1777992.000 1737839.000 - 0.00% -
444.namd -2.05% 175160.000 171573.000 - 0.00% -
464.h264ref -1.36% 354618.000 349788.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9099.000 56.000 - -5.08% -
462.libquantum -99.28% 13126.000 95.000 - -3.06% -
482.sphinx3 -96.65% 26310.000 881.000 - 0.34% -
450.soplex -96.33% 14429.000 529.000 - 0.38% -
444.namd -94.76% 13495.000 707.000 - -0.70% -
453.povray -93.20% 6857.000 466.000 - 0.22% -
433.milc -91.56% 13482.000 1138.000 - -0.09% -
429.mcf -90.43% 11999.000 1148.000 - 0.09% -
401.bzip2 -82.62% 15683.000 2725.000 - -0.22% -
447.dealII -77.83% 8196.000 1817.000 - 0.33% -
470.lbm -77.37% 13882.000 3142.000 - -0.54% -
471.omnetpp -74.34% 10746.000 2757.000 - -2.68% -
456.hmmer -73.33% 13365.000 3564.000 - 0.11% -
473.astar -65.97% 14262.000 4853.000 - 0.37% -
464.h264ref -64.20% 15493.000 5546.000 - -0.25% -
445.gobmk -57.84% 12400.000 5228.000 - -0.31% -
458.sjeng -49.41% 16406.000 8299.000 - -0.26% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -99.45% 182.000 1.000 - -66.67% -
444.namd (unexplained diff vs previous) -99.40% 828.000 5.000 - 0.00% -
453.povray (unexplained diff vs previous) -99.23% 130.000 1.000 - 0.00% -
482.sphinx3 (max) -99.20% 873.000 7.000 - 0.00% -
444.namd (max) -99.09% 882.000 8.000 - 0.00% -
433.milc (max) -98.91% 184.000 2.000 - -33.33% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
429.mcf (unexplained diff vs previous) -98.51% 67.000 1.000 - -80.00% -
453.povray (max) -97.73% 132.000 3.000 - 0.00% -
450.soplex (unexplained diff vs previous) -97.56% 82.000 2.000 - -71.43% -
470.lbm (max) -97.40% 769.000 20.000 - -4.76% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -96.58% 497.000 17.000 - 142.86% -
433.milc -96.32% 136.000 5.000 - 0.00% -
433.milc (avg) -96.32% 136.000 5.000 - 0.00% -
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
447.dealII (unexplained diff vs previous) -95.04% 121.000 6.000 - 0.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
429.mcf (max) -94.03% 67.000 4.000 - -69.23% -
470.lbm -93.48% 322.000 21.000 - -4.55% -
470.lbm (avg) -93.48% 322.000 21.000 - -4.55% -
433.milc (unexplained diff vs previous) (percentage) -93.33% 1.350 0.090 - -65.38% -
450.soplex (max) -92.68% 82.000 6.000 - -14.29% -
462.libquantum (max) -92.31% 26.000 2.000 - 0.00% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
447.dealII -90.00% 120.000 12.000 - 0.00% -
447.dealII (avg) -90.00% 120.000 12.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -88.95% 1.900 0.210 - 0.00% -
470.lbm (max) (percentage) -88.45% 5.540 0.640 - -4.48% -
444.namd (unexplained diff vs previous) (percentage) -88.44% 6.140 0.710 - 0.00% -
401.bzip2 (unexplained diff vs previous) -87.76% 49.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -84.92% 3.580 0.540 - 145.45% -
429.mcf (unexplained diff vs previous) (percentage) -83.93% 0.560 0.090 - -79.55% -
473.astar (max) -83.33% 114.000 19.000 - -52.50% -
473.astar (unexplained diff vs previous) -83.33% 108.000 18.000 - -18.18% -
433.milc (max) (percentage) -83.21% 1.370 0.230 - -25.81% -
444.namd (max) (percentage) -81.80% 6.540 1.190 - -4.80% -
462.libquantum (unexplained diff vs previous) -81.25% 16.000 3.000 - 50.00% -
456.hmmer (max) -80.00% 40.000 8.000 - -11.11% -
447.dealII (max) -79.07% 129.000 27.000 - -3.57% -
464.h264ref (max) -78.33% 60.000 13.000 - 8.33% -
447.dealII (unexplained diff vs previous) (percentage) -77.70% 1.480 0.330 - 0.00% -
464.h264ref (unexplained diff vs previous) -76.67% 60.000 14.000 - 1300.00% -
482.sphinx3 (max) (percentage) -75.30% 3.320 0.820 - -3.53% -
444.namd (avg) (percentage) -75.07% 3.810 0.950 - 0.00% -
429.mcf -71.70% 53.000 15.000 - 0.00% -
429.mcf (avg) -71.70% 53.000 15.000 - 0.00% -
470.lbm (avg) (percentage) -69.83% 2.320 0.700 - 0.00% -
445.gobmk (max) -68.97% 29.000 9.000 - 0.00% -
458.sjeng -68.42% 95.000 30.000 - 0.00% -
458.sjeng (avg) -68.42% 95.000 30.000 - 0.00% -
456.hmmer -66.67% 48.000 16.000 - 0.00% -
456.hmmer (avg) -66.67% 48.000 16.000 - 0.00% -
464.h264ref -66.67% 51.000 17.000 - 0.00% -
464.h264ref (avg) -66.67% 51.000 17.000 - 0.00% -
401.bzip2 -64.71% 34.000 12.000 - -7.69% -
401.bzip2 (avg) -64.71% 34.000 12.000 - -7.69% -
401.bzip2 (max) -64.58% 48.000 17.000 - -5.56% -
471.omnetpp (max) -61.38% 189.000 73.000 - 52.08% -
453.povray (max) (percentage) -60.62% 1.930 0.760 - -8.43% -
482.sphinx3 (avg) (percentage) -55.91% 1.860 0.820 - 0.00% -
456.hmmer (unexplained diff vs previous) -55.56% 9.000 4.000 - -60.00% -
471.omnetpp -55.42% 83.000 37.000 - 0.00% -
471.omnetpp (avg) -55.42% 83.000 37.000 - 0.00% -
473.astar -54.93% 71.000 32.000 - 0.00% -
473.astar (avg) -54.93% 71.000 32.000 - 0.00% -
447.dealII (avg) (percentage) -53.74% 1.470 0.680 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) -51.32% 0.760 0.370 - -19.57% -
473.astar (max) (percentage) -48.75% 0.800 0.410 - -50.60% -
433.milc (avg) (percentage) -48.51% 1.010 0.520 - 0.00% -
458.sjeng (unexplained diff vs previous) -46.34% 41.000 22.000 - 0.00% -
458.sjeng (max) -43.08% 65.000 37.000 - -9.76% -
458.sjeng (avg) (percentage) -36.21% 0.580 0.370 - 0.00% -
464.h264ref (max) (percentage) -35.90% 0.390 0.250 - 8.70% -
464.h264ref (unexplained diff vs previous) (percentage) -35.90% 0.390 0.250 - 1150.00% -
429.mcf (max) (percentage) -33.93% 0.560 0.370 - -68.91% -
450.soplex (unexplained diff vs previous) (percentage) -33.33% 0.570 0.380 - -71.43% -
445.gobmk -31.82% 22.000 15.000 - 0.00% -
445.gobmk (avg) -31.82% 22.000 15.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) -29.03% 0.310 0.220 - 0.00% -
453.povray (avg) (percentage) -27.01% 1.370 1.000 - -1.96% -
445.gobmk (max) (percentage) -25.00% 0.240 0.180 - -5.26% -
471.omnetpp (unexplained diff vs previous) -17.39% 92.000 76.000 - 58.33% -
456.hmmer (max) (percentage) -16.67% 0.300 0.250 - -10.71% -
447.dealII (max) (percentage) -3.16% 1.580 1.530 - -4.38% -
464.h264ref (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2725.000 -
403.gcc 56.000 -5.08%
429.mcf 1148.000 -
433.milc 1138.000 -
444.namd 707.000 -
445.gobmk 5228.000 -
447.dealII 1817.000 -
450.soplex 529.000 -
453.povray 466.000 -
456.hmmer 3564.000 -
458.sjeng 8299.000 -
462.libquantum 95.000 -3.06%
464.h264ref 5546.000 -
470.lbm 3142.000 -
471.omnetpp 2757.000 -2.68%
473.astar 4853.000 -
482.sphinx3 881.000 -
Geometric Mean 1361.793 -
Code Size (bytes)
Name Current %
401.bzip2 43333.000 -
403.gcc 1955333.000 -
429.mcf 7974.000 -
433.milc 72830.000 -
444.namd 171573.000 -
445.gobmk 1308092.000 -
447.dealII 1737839.000 -
450.soplex 202463.000 -
453.povray 579303.000 -
456.hmmer 166814.000 -
458.sjeng 96921.000 -
462.libquantum 24071.000 -
464.h264ref 349788.000 -
470.lbm 9802.000 -
471.omnetpp 377700.000 -
473.astar 23287.000 -
482.sphinx3 114899.000 -
Geometric Mean 139962.811 -
sample variability
Name Current %
401.bzip2 12.000 -7.69%
401.bzip2 (avg) 12.000 -7.69%
401.bzip2 (avg) (percentage) 0.470 -2.08%
401.bzip2 (max) 17.000 -5.56%
401.bzip2 (max) (percentage) 0.630 -4.55%
401.bzip2 (unexplained diff vs previous) 6.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.220 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.760 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 2.450 -2.00%
429.mcf 15.000 -
429.mcf (avg) 15.000 -
429.mcf (avg) (percentage) 1.310 -
429.mcf (max) 4.000 -69.23%
429.mcf (max) (percentage) 0.370 -68.91%
429.mcf (unexplained diff vs previous) 1.000 -80.00%
429.mcf (unexplained diff vs previous) (percentage) 0.090 -79.55%
433.milc 5.000 -
433.milc (avg) 5.000 -
433.milc (avg) (percentage) 0.520 -
433.milc (max) 2.000 -33.33%
433.milc (max) (percentage) 0.230 -25.81%
433.milc (unexplained diff vs previous) 1.000 -66.67%
433.milc (unexplained diff vs previous) (percentage) 0.090 -65.38%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 -
444.namd (max) 8.000 -
444.namd (max) (percentage) 1.190 -4.80%
444.namd (unexplained diff vs previous) 5.000 -
444.namd (unexplained diff vs previous) (percentage) 0.710 -
445.gobmk 15.000 -
445.gobmk (avg) 15.000 -
445.gobmk (avg) (percentage) 0.290 -
445.gobmk (max) 9.000 -
445.gobmk (max) (percentage) 0.180 -5.26%
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.680 -
447.dealII (max) 27.000 -3.57%
447.dealII (max) (percentage) 1.530 -4.38%
447.dealII (unexplained diff vs previous) 6.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.330 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.060 -
450.soplex (max) 6.000 -14.29%
450.soplex (max) (percentage) 1.180 -12.59%
450.soplex (unexplained diff vs previous) 2.000 -71.43%
450.soplex (unexplained diff vs previous) (percentage) 0.380 -71.43%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.000 -1.96%
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.760 -8.43%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.210 -
456.hmmer 16.000 -
456.hmmer (avg) 16.000 -
456.hmmer (avg) (percentage) 0.450 -2.17%
456.hmmer (max) 8.000 -11.11%
456.hmmer (max) (percentage) 0.250 -10.71%
456.hmmer (unexplained diff vs previous) 4.000 -60.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.110 -60.71%
458.sjeng 30.000 -
458.sjeng (avg) 30.000 -
458.sjeng (avg) (percentage) 0.370 -
458.sjeng (max) 37.000 -9.76%
458.sjeng (max) (percentage) 0.450 -10.00%
458.sjeng (unexplained diff vs previous) 22.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.270 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.650 1.23%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 3.060 45.02%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 3.160 54.90%
464.h264ref 17.000 -
464.h264ref (avg) 17.000 -
464.h264ref (avg) (percentage) 0.320 -
464.h264ref (max) 13.000 8.33%
464.h264ref (max) (percentage) 0.250 8.70%
464.h264ref (unexplained diff vs previous) 14.000 1300.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.250 1150.00%
470.lbm 21.000 -4.55%
470.lbm (avg) 21.000 -4.55%
470.lbm (avg) (percentage) 0.700 -
470.lbm (max) 20.000 -4.76%
470.lbm (max) (percentage) 0.640 -4.48%
470.lbm (unexplained diff vs previous) 17.000 142.86%
470.lbm (unexplained diff vs previous) (percentage) 0.540 145.45%
471.omnetpp 37.000 -
471.omnetpp (avg) 37.000 -
471.omnetpp (avg) (percentage) 1.350 1.50%
471.omnetpp (max) 73.000 52.08%
471.omnetpp (max) (percentage) 2.680 55.81%
471.omnetpp (unexplained diff vs previous) 76.000 58.33%
471.omnetpp (unexplained diff vs previous) (percentage) 2.760 63.31%
473.astar 32.000 -
473.astar (avg) 32.000 -
473.astar (avg) (percentage) 0.670 -1.47%
473.astar (max) 19.000 -52.50%
473.astar (max) (percentage) 0.410 -50.60%
473.astar (unexplained diff vs previous) 18.000 -18.18%
473.astar (unexplained diff vs previous) (percentage) 0.370 -19.57%
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.820 -
482.sphinx3 (max) 7.000 -
482.sphinx3 (max) (percentage) 0.820 -3.53%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.670 -
Geometric Mean 2.653 -11.96%