Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/a292e7edf8b2fc51d3e86a96ff5dff45d16bd264 (+ 1 commits)
regression LLVM-929
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/75/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0075 (llvmorg-18-init-06129-ga292e7edf8b2) 2023-09-18T17:08:53 0:00:00
Previous 0074 (llvmorg-18-init-06128-g6d1c6ecbdc4e) 2023-09-17T21:04:44 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 33 40
Performance Improvements 49 84
Added Tests 1 1
Unchanged Tests 697 655
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
470.lbm 1.96% 9563.000 9750.000 - 0.28% -
462.libquantum 1.16% 25049.000 25339.000 - -5.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
445.gobmk (unexplained diff vs previous) 866.67% 3.000 29.000 - -3.33% -
445.gobmk (unexplained diff vs previous) (percentage) 816.67% 0.060 0.550 - 129.17% -
471.omnetpp (unexplained diff vs previous) (percentage) 537.50% 0.320 2.040 - 137.21% -
471.omnetpp (unexplained diff vs previous) 522.22% 9.000 56.000 - -39.13% -
401.bzip2 (unexplained diff vs previous) 200.00% 1.000 3.000 - -93.88% -
401.bzip2 (unexplained diff vs previous) (percentage) 175.00% 0.040 0.110 - -64.52% -
450.soplex (unexplained diff vs previous) (percentage) 128.57% 0.770 1.760 - 208.77% -
450.soplex (unexplained diff vs previous) 125.00% 4.000 9.000 - -89.02% -
470.lbm (unexplained diff vs previous) 108.33% 12.000 25.000 - -94.97% -
470.lbm (unexplained diff vs previous) (percentage) 107.89% 0.380 0.790 - -77.93% -
471.omnetpp (max) (percentage) 104.08% 0.980 2.000 - 13.64% -
471.omnetpp (max) 100.00% 27.000 54.000 - -71.43% -
450.soplex (max) (percentage) 47.86% 1.170 1.730 - 203.51% -
470.lbm (max) (percentage) 36.21% 0.580 0.790 - -85.74% -
429.mcf (unexplained diff vs previous) (percentage) 34.21% 0.760 1.020 - 82.14% -
429.mcf (unexplained diff vs previous) 33.33% 9.000 12.000 - -82.09% -
450.soplex (max) 33.33% 6.000 8.000 - -90.24% -
470.lbm (max) 33.33% 18.000 24.000 - -96.88% -
464.h264ref (unexplained diff vs previous) 27.27% 11.000 14.000 - -76.67% -
464.h264ref (max) (percentage) 25.00% 0.200 0.250 - -35.90% -
464.h264ref (unexplained diff vs previous) (percentage) 25.00% 0.200 0.250 - -35.90% -
429.mcf (max) (percentage) 23.17% 0.820 1.010 - 80.36% -
429.mcf (max) 22.22% 9.000 11.000 - -83.58% -
445.gobmk (max) 20.83% 24.000 29.000 - 0.00% -
445.gobmk (max) (percentage) 19.57% 0.460 0.550 - 129.17% -
464.h264ref (max) 18.18% 11.000 13.000 - -78.33% -
483.xalancbmk (unexplained diff vs previous) (percentage) 12.00% 0.250 0.280 - -56.92% -
483.xalancbmk (unexplained diff vs previous) 11.11% 9.000 10.000 - -83.61% -
450.soplex (avg) (percentage) 3.33% 0.900 0.930 - 158.33% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -11.11% 18.000 16.000 - -11.11% -
nb_compile_successful -10.53% 19.000 17.000 - -10.53% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp -2.00% 2800.000 2744.000 - -74.46% -
450.soplex -1.73% 520.000 511.000 - -96.46% -
429.mcf -1.01% 1184.000 1172.000 - -90.23% -
462.libquantum -1.01% 99.000 98.000 - -99.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) -69.57% 0.230 0.070 - -72.00% -
458.sjeng (unexplained diff vs previous) -68.42% 19.000 6.000 - -85.37% -
458.sjeng (max) -50.00% 34.000 17.000 - -73.85% -
458.sjeng (max) (percentage) -50.00% 0.420 0.210 - -47.50% -
401.bzip2 (max) -14.29% 14.000 12.000 - -75.00% -
456.hmmer (max) -12.50% 16.000 14.000 - -65.00% -
483.xalancbmk (max) (percentage) -11.43% 0.350 0.310 - -52.31% -
401.bzip2 (max) (percentage) -9.80% 0.510 0.460 - 48.39% -
456.hmmer (max) (percentage) -8.89% 0.450 0.410 - 36.67% -
433.milc (max) (percentage) -8.77% 0.570 0.520 - -62.04% -
444.namd (max) -8.70% 23.000 21.000 - -97.62% -
483.xalancbmk (max) -8.33% 12.000 11.000 - -81.97% -
482.sphinx3 (max) -7.69% 13.000 12.000 - -98.63% -
462.libquantum (max) (percentage) -6.52% 0.920 0.860 - 330.00% -
447.dealII -6.25% 16.000 15.000 - -87.50% -
447.dealII (avg) -6.25% 16.000 15.000 - -87.50% -
444.namd (max) (percentage) -6.12% 3.270 3.070 - -53.06% -
482.sphinx3 (max) (percentage) -6.04% 1.490 1.400 - -57.83% -
447.dealII (max) -5.88% 17.000 16.000 - -87.60% -
473.astar (max) -5.88% 51.000 48.000 - -57.89% -
401.bzip2 -5.56% 18.000 17.000 - -50.00% -
401.bzip2 (avg) -5.56% 18.000 17.000 - -50.00% -
473.astar (max) (percentage) -4.67% 1.070 1.020 - 27.50% -
458.sjeng (avg) (percentage) -4.55% 0.880 0.840 - 44.83% -
458.sjeng -4.23% 71.000 68.000 - -28.42% -
458.sjeng (avg) -4.23% 71.000 68.000 - -28.42% -
483.xalancbmk (avg) (percentage) -3.44% 3.490 3.370 - 574.00% -
483.xalancbmk -3.23% 124.000 120.000 - 155.32% -
483.xalancbmk (avg) -3.23% 124.000 120.000 - 155.32% -
453.povray (max) (percentage) -3.20% 2.190 2.120 - 9.84% -
447.dealII (max) (percentage) -3.09% 0.970 0.940 - -40.51% -
401.bzip2 (avg) (percentage) -3.03% 0.660 0.640 - 190.91% -
429.mcf -2.38% 42.000 41.000 - -22.64% -
429.mcf (avg) -2.38% 42.000 41.000 - -22.64% -
471.omnetpp -2.30% 87.000 85.000 - 2.41% -
471.omnetpp (avg) -2.30% 87.000 85.000 - 2.41% -
429.mcf (avg) (percentage) -2.22% 3.600 3.520 - 682.22% -
464.h264ref (avg) (percentage) -2.15% 0.930 0.910 - 175.76% -
464.h264ref -1.96% 51.000 50.000 - -1.96% -
464.h264ref (avg) -1.96% 51.000 50.000 - -1.96% -
470.lbm -1.72% 58.000 57.000 - -82.30% -
470.lbm (avg) -1.72% 58.000 57.000 - -82.30% -
470.lbm (avg) (percentage) -1.62% 1.850 1.820 - -21.55% -
403.gcc (max) (percentage) -1.42% 4.920 4.850 - 1176.32% -
445.gobmk (avg) (percentage) -1.30% 0.770 0.760 - 322.22% -

Added Tests - sample variability
462.libquantum (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.98% 39458.000 41817.000 - 0.00% -
450.soplex 1.77% 198708.000 202230.000 - 0.04% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1176.32% 0.380 4.850 - -1.42% -
462.libquantum (avg) (percentage) 880.00% 0.150 1.470 - 0.00% -
429.mcf (avg) (percentage) 682.22% 0.450 3.520 - -2.22% -
483.xalancbmk (avg) (percentage) 574.00% 0.500 3.370 - -3.44% -
473.astar (avg) (percentage) 466.00% 0.500 2.830 - 0.00% -
403.gcc (avg) (percentage) 345.83% 0.480 2.140 - 0.00% -
462.libquantum (max) (percentage) 330.00% 0.200 0.860 - -6.52% -
445.gobmk (avg) (percentage) 322.22% 0.180 0.760 - -1.30% -
471.omnetpp (avg) (percentage) 298.72% 0.780 3.110 - -0.96% -
456.hmmer (avg) (percentage) 291.67% 0.360 1.410 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 208.77% 0.570 1.760 - 128.57% -
450.soplex (max) (percentage) 203.51% 0.570 1.730 - 47.86% -
401.bzip2 (avg) (percentage) 190.91% 0.220 0.640 - -3.03% -
464.h264ref (avg) (percentage) 175.76% 0.330 0.910 - -2.15% -
450.soplex (avg) (percentage) 158.33% 0.360 0.930 - 3.33% -
483.xalancbmk 155.32% 47.000 120.000 - -3.23% -
483.xalancbmk (avg) 155.32% 47.000 120.000 - -3.23% -
471.omnetpp (unexplained diff vs previous) (percentage) 137.21% 0.860 2.040 - 537.50% -
445.gobmk (max) (percentage) 129.17% 0.240 0.550 - 19.57% -
445.gobmk (unexplained diff vs previous) (percentage) 129.17% 0.240 0.550 - 816.67% -
473.astar 88.73% 71.000 134.000 - -0.74% -
473.astar (avg) 88.73% 71.000 134.000 - -0.74% -
429.mcf (unexplained diff vs previous) (percentage) 82.14% 0.560 1.020 - 34.21% -
445.gobmk 81.82% 22.000 40.000 - 0.00% -
445.gobmk (avg) 81.82% 22.000 40.000 - 0.00% -
429.mcf (max) (percentage) 80.36% 0.560 1.010 - 23.17% -
401.bzip2 (max) (percentage) 48.39% 0.310 0.460 - -9.80% -
458.sjeng (avg) (percentage) 44.83% 0.580 0.840 - -4.55% -
456.hmmer (max) (percentage) 36.67% 0.300 0.410 - -8.89% -
473.astar (max) (percentage) 27.50% 0.800 1.020 - -4.67% -
471.omnetpp (max) (percentage) 13.64% 1.760 2.000 - 104.08% -
453.povray (max) (percentage) 9.84% 1.930 2.120 - -3.20% -
456.hmmer 4.17% 48.000 50.000 - 0.00% -
456.hmmer (avg) 4.17% 48.000 50.000 - 0.00% -
471.omnetpp 2.41% 83.000 85.000 - -2.30% -
471.omnetpp (avg) 2.41% 83.000 85.000 - -2.30% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -11.11% 18.000 16.000 - -11.11% -
nb_compile_successful -10.53% 19.000 17.000 - -10.53% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.30% 26756.000 25339.000 - 1.16% -
433.milc -2.52% 74971.000 73078.000 - 0.27% -
447.dealII -1.77% 1777992.000 1746435.000 - 0.25% -
482.sphinx3 -1.09% 115736.000 114479.000 - 0.10% -
456.hmmer -1.03% 168072.000 166346.000 - -0.17% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -99.25% 13126.000 98.000 - -1.01% -
482.sphinx3 -96.63% 26310.000 886.000 - 0.34% -
450.soplex -96.46% 14429.000 511.000 - -1.73% -
444.namd -94.72% 13495.000 713.000 - 0.28% -
433.milc -91.37% 13482.000 1163.000 - 0.17% -
429.mcf -90.23% 11999.000 1172.000 - -1.01% -
401.bzip2 -82.39% 15683.000 2761.000 - 0.11% -
447.dealII -78.59% 8196.000 1755.000 - -0.74% -
470.lbm -77.33% 13882.000 3147.000 - -0.79% -
471.omnetpp -74.46% 10746.000 2744.000 - -2.00% -
456.hmmer -73.36% 13365.000 3561.000 - -0.59% -
473.astar -66.62% 14262.000 4761.000 - -0.92% -
464.h264ref -64.36% 15493.000 5521.000 - 0.25% -
483.xalancbmk -62.09% 9427.000 3574.000 - 0.28% -
445.gobmk -57.36% 12400.000 5287.000 - 0.55% -
458.sjeng -50.40% 16406.000 8138.000 - -0.07% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 (max) -98.63% 873.000 12.000 - -7.69% -
444.namd (max) -97.62% 882.000 21.000 - -8.70% -
482.sphinx3 -97.14% 489.000 14.000 - 0.00% -
482.sphinx3 (avg) -97.14% 489.000 14.000 - 0.00% -
444.namd -96.89% 514.000 16.000 - 0.00% -
444.namd (avg) -96.89% 514.000 16.000 - 0.00% -
470.lbm (max) -96.88% 769.000 24.000 - 33.33% -
433.milc (max) -96.74% 184.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) -94.97% 497.000 25.000 - 108.33% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
433.milc -94.12% 136.000 8.000 - 0.00% -
433.milc (avg) -94.12% 136.000 8.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -93.88% 49.000 3.000 - 200.00% -
450.soplex -92.16% 51.000 4.000 - 0.00% -
450.soplex (avg) -92.16% 51.000 4.000 - 0.00% -
450.soplex (max) -90.24% 82.000 8.000 - 33.33% -
450.soplex (unexplained diff vs previous) -89.02% 82.000 9.000 - 125.00% -
447.dealII (max) -87.60% 129.000 16.000 - -5.88% -
447.dealII -87.50% 120.000 15.000 - -6.25% -
447.dealII (avg) -87.50% 120.000 15.000 - -6.25% -
470.lbm (max) (percentage) -85.74% 5.540 0.790 - 36.21% -
458.sjeng (unexplained diff vs previous) -85.37% 41.000 6.000 - -68.42% -
483.xalancbmk (unexplained diff vs previous) -83.61% 61.000 10.000 - 11.11% -
429.mcf (max) -83.58% 67.000 11.000 - 22.22% -
470.lbm -82.30% 322.000 57.000 - -1.72% -
470.lbm (avg) -82.30% 322.000 57.000 - -1.72% -
429.mcf (unexplained diff vs previous) -82.09% 67.000 12.000 - 33.33% -
483.xalancbmk (max) -81.97% 61.000 11.000 - -8.33% -
464.h264ref (max) -78.33% 60.000 13.000 - 18.18% -
470.lbm (unexplained diff vs previous) (percentage) -77.93% 3.580 0.790 - 107.89% -
464.h264ref (unexplained diff vs previous) -76.67% 60.000 14.000 - 27.27% -
401.bzip2 (max) -75.00% 48.000 12.000 - -14.29% -
458.sjeng (max) -73.85% 65.000 17.000 - -50.00% -
458.sjeng (unexplained diff vs previous) (percentage) -72.00% 0.250 0.070 - -69.57% -
471.omnetpp (max) -71.43% 189.000 54.000 - 100.00% -
456.hmmer (max) -65.00% 40.000 14.000 - -12.50% -
401.bzip2 (unexplained diff vs previous) (percentage) -64.52% 0.310 0.110 - 175.00% -
433.milc (max) (percentage) -62.04% 1.370 0.520 - -8.77% -
473.astar (max) -57.89% 114.000 48.000 - -5.88% -
482.sphinx3 (max) (percentage) -57.83% 3.320 1.400 - -6.04% -
483.xalancbmk (unexplained diff vs previous) (percentage) -56.92% 0.650 0.280 - 12.00% -
444.namd (max) (percentage) -53.06% 6.540 3.070 - -6.12% -
483.xalancbmk (max) (percentage) -52.31% 0.650 0.310 - -11.43% -
401.bzip2 -50.00% 34.000 17.000 - -5.56% -
401.bzip2 (avg) -50.00% 34.000 17.000 - -5.56% -
458.sjeng (max) (percentage) -47.50% 0.400 0.210 - -50.00% -
447.dealII (max) (percentage) -40.51% 1.580 0.940 - -3.09% -
444.namd (avg) (percentage) -39.37% 3.810 2.310 - 0.00% -
471.omnetpp (unexplained diff vs previous) -39.13% 92.000 56.000 - 522.22% -
447.dealII (avg) (percentage) -38.10% 1.470 0.910 - 0.00% -
464.h264ref (max) (percentage) -35.90% 0.390 0.250 - 25.00% -
464.h264ref (unexplained diff vs previous) (percentage) -35.90% 0.390 0.250 - 25.00% -
433.milc (avg) (percentage) -29.70% 1.010 0.710 - 0.00% -
458.sjeng -28.42% 95.000 68.000 - -4.23% -
458.sjeng (avg) -28.42% 95.000 68.000 - -4.23% -
429.mcf -22.64% 53.000 41.000 - -2.38% -
429.mcf (avg) -22.64% 53.000 41.000 - -2.38% -
470.lbm (avg) (percentage) -21.55% 2.320 1.820 - -1.62% -
482.sphinx3 (avg) (percentage) -13.44% 1.860 1.610 - 0.00% -
445.gobmk (unexplained diff vs previous) -3.33% 30.000 29.000 - 866.67% -
464.h264ref -1.96% 51.000 50.000 - -1.96% -
464.h264ref (avg) -1.96% 51.000 50.000 - -1.96% -

Added Tests - sample variability
462.libquantum (max)

Report Time: 0.33s
Execution (seconds)
Name Current %
401.bzip2 2761.000 -
429.mcf 1172.000 -1.01%
433.milc 1163.000 -
444.namd 713.000 -
445.gobmk 5287.000 -
447.dealII 1755.000 -
450.soplex 511.000 -1.73%
456.hmmer 3561.000 -
458.sjeng 8138.000 -
462.libquantum 98.000 -1.01%
464.h264ref 5521.000 -
470.lbm 3147.000 -
471.omnetpp 2744.000 -2.00%
473.astar 4761.000 -
482.sphinx3 886.000 -
483.xalancbmk 3574.000 -
Geometric Mean 1887.576 -
Code Size (bytes)
Name Current %
401.bzip2 41817.000 -
429.mcf 7922.000 -
433.milc 73078.000 -
444.namd 174873.000 -
445.gobmk 1309880.000 -
447.dealII 1746435.000 -
450.soplex 202230.000 -
456.hmmer 166346.000 -
458.sjeng 97097.000 -
462.libquantum 25339.000 1.16%
464.h264ref 352334.000 -
470.lbm 9750.000 1.96%
471.omnetpp 376751.000 -
473.astar 23179.000 -
482.sphinx3 114479.000 -
483.xalancbmk 2287296.000 -
Geometric Mean 129551.717 -
Score
Name Current %
nb_compile_successful 17.000 -10.53%
nb_execution_successful 16.000 -11.11%
nb_total_tests 19.000 -
Geometric Mean 17.289 -7.35%
sample variability
Name Current %
401.bzip2 17.000 -5.56%
401.bzip2 (avg) 17.000 -5.56%
401.bzip2 (avg) (percentage) 0.640 -3.03%
401.bzip2 (max) 12.000 -14.29%
401.bzip2 (max) (percentage) 0.460 -9.80%
401.bzip2 (unexplained diff vs previous) 3.000 200.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 175.00%
403.gcc (avg) (percentage) 2.140 -
403.gcc (max) (percentage) 4.850 -1.42%
429.mcf 41.000 -2.38%
429.mcf (avg) 41.000 -2.38%
429.mcf (avg) (percentage) 3.520 -2.22%
429.mcf (max) 11.000 22.22%
429.mcf (max) (percentage) 1.010 23.17%
429.mcf (unexplained diff vs previous) 12.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 1.020 34.21%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.710 -
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.520 -8.77%
444.namd 16.000 -
444.namd (avg) 16.000 -
444.namd (avg) (percentage) 2.310 -
444.namd (max) 21.000 -8.70%
444.namd (max) (percentage) 3.070 -6.12%
445.gobmk 40.000 -
445.gobmk (avg) 40.000 -
445.gobmk (avg) (percentage) 0.760 -1.30%
445.gobmk (max) 29.000 20.83%
445.gobmk (max) (percentage) 0.550 19.57%
445.gobmk (unexplained diff vs previous) 29.000 866.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.550 816.67%
447.dealII 15.000 -6.25%
447.dealII (avg) 15.000 -6.25%
447.dealII (avg) (percentage) 0.910 -
447.dealII (max) 16.000 -5.88%
447.dealII (max) (percentage) 0.940 -3.09%
450.soplex 4.000 -
450.soplex (avg) 4.000 -
450.soplex (avg) (percentage) 0.930 3.33%
450.soplex (max) 8.000 33.33%
450.soplex (max) (percentage) 1.730 47.86%
450.soplex (unexplained diff vs previous) 9.000 125.00%
450.soplex (unexplained diff vs previous) (percentage) 1.760 128.57%
453.povray (avg) (percentage) 1.370 -
453.povray (max) (percentage) 2.120 -3.20%
456.hmmer 50.000 -
456.hmmer (avg) 50.000 -
456.hmmer (avg) (percentage) 1.410 -
456.hmmer (max) 14.000 -12.50%
456.hmmer (max) (percentage) 0.410 -8.89%
458.sjeng 68.000 -4.23%
458.sjeng (avg) 68.000 -4.23%
458.sjeng (avg) (percentage) 0.840 -4.55%
458.sjeng (max) 17.000 -50.00%
458.sjeng (max) (percentage) 0.210 -50.00%
458.sjeng (unexplained diff vs previous) 6.000 -68.42%
458.sjeng (unexplained diff vs previous) (percentage) 0.070 -69.57%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.470 -
462.libquantum (max) 0.000 -
462.libquantum (max) (percentage) 0.860 -6.52%
464.h264ref 50.000 -1.96%
464.h264ref (avg) 50.000 -1.96%
464.h264ref (avg) (percentage) 0.910 -2.15%
464.h264ref (max) 13.000 18.18%
464.h264ref (max) (percentage) 0.250 25.00%
464.h264ref (unexplained diff vs previous) 14.000 27.27%
464.h264ref (unexplained diff vs previous) (percentage) 0.250 25.00%
470.lbm 57.000 -1.72%
470.lbm (avg) 57.000 -1.72%
470.lbm (avg) (percentage) 1.820 -1.62%
470.lbm (max) 24.000 33.33%
470.lbm (max) (percentage) 0.790 36.21%
470.lbm (unexplained diff vs previous) 25.000 108.33%
470.lbm (unexplained diff vs previous) (percentage) 0.790 107.89%
471.omnetpp 85.000 -2.30%
471.omnetpp (avg) 85.000 -2.30%
471.omnetpp (avg) (percentage) 3.110 -
471.omnetpp (max) 54.000 100.00%
471.omnetpp (max) (percentage) 2.000 104.08%
471.omnetpp (unexplained diff vs previous) 56.000 522.22%
471.omnetpp (unexplained diff vs previous) (percentage) 2.040 537.50%
473.astar 134.000 -
473.astar (avg) 134.000 -
473.astar (avg) (percentage) 2.830 -
473.astar (max) 48.000 -5.88%
473.astar (max) (percentage) 1.020 -4.67%
482.sphinx3 14.000 -
482.sphinx3 (avg) 14.000 -
482.sphinx3 (avg) (percentage) 1.610 -
482.sphinx3 (max) 12.000 -7.69%
482.sphinx3 (max) (percentage) 1.400 -6.04%
483.xalancbmk 120.000 -3.23%
483.xalancbmk (avg) 120.000 -3.23%
483.xalancbmk (avg) (percentage) 3.370 -3.44%
483.xalancbmk (max) 11.000 -8.33%
483.xalancbmk (max) (percentage) 0.310 -11.43%
483.xalancbmk (unexplained diff vs previous) 10.000 11.11%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.280 12.00%
Geometric Mean 4.673 1.87%