Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6e4fbd2f511cbfbabb516570f8406739f0e26148 (+ 573 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/165/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0165 (llvmorg-16-init-05002-g6e4fbd2f511c) 2022-09-14T05:09:33 0:00:00
Previous 0164 (llvmorg-19-init-13085-gab08df229233) 2024-05-28T22:09:49 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 78 24
Performance Improvements 28 80
Added Tests 9 0
Unchanged Tests 665 676
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.69% 23931.000 26728.000 - -0.10% -
447.dealII 3.07% 1733127.000 1786325.000 - 0.47% -
433.milc 2.89% 72858.000 74963.000 - -0.01% -
464.h264ref 1.49% 350068.000 355282.000 - 0.19% -
429.mcf 1.34% 7830.000 7935.000 - 0.25% -
458.sjeng 1.07% 97029.000 98070.000 - 0.28% -
450.soplex 1.05% 200963.000 203068.000 - 2.19% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15844.44% 54.000 8610.000 - -5.37% -
462.libquantum 13337.50% 96.000 12900.000 - -1.72% -
482.sphinx3 2867.51% 874.000 25936.000 - -1.42% -
450.soplex 2542.64% 523.000 13821.000 - -4.21% -
433.milc 1045.59% 1145.000 13117.000 - -2.71% -
429.mcf 892.35% 1151.000 11422.000 - -4.81% -
447.dealII 346.65% 1820.000 8129.000 - -0.82% -
470.lbm 325.23% 3171.000 13484.000 - -2.87% -
471.omnetpp 275.67% 2803.000 10530.000 - -2.01% -
473.astar 187.15% 4878.000 14007.000 - -1.79% -
464.h264ref 178.03% 5572.000 15492.000 - -0.01% -
445.gobmk 137.07% 5203.000 12335.000 - -0.52% -
458.sjeng 130.19% 8260.000 19014.000 - 15.90% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) 12300.00% 6.000 744.000 - -14.78% -
482.sphinx3 10662.50% 8.000 861.000 - 76.07% -
482.sphinx3 (avg) 10662.50% 8.000 861.000 - 76.07% -
403.gcc (max) 5400.00% 1.000 55.000 - 61.76% -
403.gcc 3800.00% 1.000 39.000 - -9.30% -
403.gcc (avg) 3800.00% 1.000 39.000 - -9.30% -
433.milc (max) 3483.33% 6.000 215.000 - 16.85% -
470.lbm (max) 3384.62% 13.000 453.000 - -41.09% -
433.milc 2400.00% 6.000 150.000 - 10.29% -
433.milc (avg) 2400.00% 6.000 150.000 - 10.29% -
473.astar (unexplained diff vs previous) 1700.00% 1.000 18.000 - -83.33% -
450.soplex (unexplained diff vs previous) 1400.00% 3.000 45.000 - -45.12% -
450.soplex (max) 1125.00% 4.000 49.000 - -40.24% -
470.lbm 976.92% 26.000 280.000 - -13.04% -
470.lbm (avg) 976.92% 26.000 280.000 - -13.04% -
447.dealII (max) 970.59% 17.000 182.000 - 41.09% -
447.dealII 945.45% 11.000 115.000 - -4.17% -
447.dealII (avg) 945.45% 11.000 115.000 - -4.17% -
462.libquantum 800.00% 1.000 9.000 - -52.63% -
462.libquantum (avg) 800.00% 1.000 9.000 - -52.63% -
470.lbm (max) (percentage) 663.64% 0.440 3.360 - -39.35% -
473.astar (max) 613.33% 15.000 107.000 - -6.14% -
471.omnetpp (max) 570.83% 24.000 161.000 - -14.81% -
471.omnetpp (unexplained diff vs previous) 562.50% 24.000 159.000 - 72.83% -
473.astar (unexplained diff vs previous) (percentage) 550.00% 0.020 0.130 - -82.89% -
429.mcf (max) 525.00% 8.000 50.000 - -25.37% -
450.soplex 520.00% 5.000 31.000 - -39.22% -
450.soplex (avg) 520.00% 5.000 31.000 - -39.22% -
464.h264ref (unexplained diff vs previous) 440.00% 10.000 54.000 - -10.00% -
470.lbm (unexplained diff vs previous) 400.00% 1.000 5.000 - -98.99% -
482.sphinx3 (max) (percentage) 315.94% 0.690 2.870 - -13.55% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - -75.00% -
464.h264ref (max) 285.71% 14.000 54.000 - -10.00% -
471.omnetpp 260.98% 41.000 148.000 - 78.31% -
471.omnetpp (avg) 260.98% 41.000 148.000 - 78.31% -
482.sphinx3 (avg) (percentage) 256.99% 0.930 3.320 - 78.49% -
433.milc (max) (percentage) 192.86% 0.560 1.640 - 19.71% -
473.astar (max) (percentage) 148.39% 0.310 0.770 - -3.75% -
470.lbm (avg) (percentage) 144.71% 0.850 2.080 - -10.34% -
447.dealII (max) (percentage) 138.30% 0.940 2.240 - 41.77% -
447.dealII (avg) (percentage) 132.79% 0.610 1.420 - -3.40% -
462.libquantum (max) 100.00% 6.000 12.000 - -53.85% -
464.h264ref (unexplained diff vs previous) (percentage) 94.44% 0.180 0.350 - -10.26% -
433.milc (avg) (percentage) 91.67% 0.600 1.150 - 13.86% -
464.h264ref 86.96% 23.000 43.000 - -15.69% -
464.h264ref (avg) 86.96% 23.000 43.000 - -15.69% -
471.omnetpp (max) (percentage) 77.91% 0.860 1.530 - -13.07% -
471.omnetpp (unexplained diff vs previous) (percentage) 75.58% 0.860 1.510 - 75.58% -
473.astar 67.44% 43.000 72.000 - 1.41% -
473.astar (avg) 67.44% 43.000 72.000 - 1.41% -
447.dealII (unexplained diff vs previous) 58.82% 17.000 27.000 - -77.69% -
464.h264ref (max) (percentage) 34.62% 0.260 0.350 - -10.26% -
470.lbm (unexplained diff vs previous) (percentage) 33.33% 0.030 0.040 - -98.88% -
429.mcf 22.22% 18.000 22.000 - -58.49% -
429.mcf (avg) 22.22% 18.000 22.000 - -58.49% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -58.82% 34.000 14.000 - -22.22% -
nb_compile_successful -58.33% 36.000 15.000 - -21.05% -
nb_total_tests -52.50% 40.000 19.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) (percentage) -98.47% 6.530 0.100 - -50.00% -
429.mcf (unexplained diff vs previous) (percentage) -97.44% 0.780 0.020 - -96.43% -
462.libquantum (unexplained diff vs previous) (percentage) -97.12% 1.040 0.030 - -75.00% -
462.libquantum (avg) (percentage) -95.21% 1.460 0.070 - -53.33% -
429.mcf (avg) (percentage) -87.58% 1.610 0.200 - -55.56% -
403.gcc (avg) (percentage) -86.86% 3.500 0.460 - -4.17% -
483.xalancbmk (avg) (percentage) -80.45% 1.330 0.260 - -48.00% -
445.gobmk (avg) (percentage) -80.00% 0.350 0.070 - -61.11% -
450.soplex (avg) (percentage) -79.65% 1.130 0.230 - -36.11% -
458.sjeng (avg) (percentage) -78.38% 0.370 0.080 - -86.21% -
429.mcf (unexplained diff vs previous) -77.78% 9.000 2.000 - -97.01% -
403.gcc (max) (percentage) -74.60% 2.520 0.640 - 68.42% -
447.dealII (unexplained diff vs previous) (percentage) -64.52% 0.930 0.330 - -77.70% -
458.sjeng (max) (percentage) -64.29% 0.280 0.100 - -75.00% -
445.gobmk (max) (percentage) -63.16% 0.380 0.140 - -41.67% -
450.soplex (max) (percentage) -56.63% 0.830 0.360 - -36.84% -
445.gobmk -55.56% 18.000 8.000 - -63.64% -
445.gobmk (avg) -55.56% 18.000 8.000 - -63.64% -
458.sjeng -50.00% 30.000 15.000 - -84.21% -
458.sjeng (avg) -50.00% 30.000 15.000 - -84.21% -
429.mcf (max) (percentage) -43.59% 0.780 0.440 - -21.43% -
473.astar (avg) (percentage) -42.22% 0.900 0.520 - 4.00% -
450.soplex (unexplained diff vs previous) (percentage) -42.11% 0.570 0.330 - -42.11% -
483.xalancbmk (max) (percentage) -40.54% 0.740 0.440 - -32.31% -
464.h264ref (avg) (percentage) -34.88% 0.430 0.280 - -15.15% -
458.sjeng (max) -17.39% 23.000 19.000 - -70.77% -
445.gobmk (max) -10.53% 19.000 17.000 - -41.38% -
471.omnetpp (avg) (percentage) -4.08% 1.470 1.410 - 80.77% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 198708.000 203068.000 - 1.05% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 15.90% 16406.000 19014.000 - 130.19% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (avg) (percentage) 80.77% 0.780 1.410 - -4.08% -
482.sphinx3 (avg) (percentage) 78.49% 1.860 3.320 - 256.99% -
471.omnetpp 78.31% 83.000 148.000 - 260.98% -
471.omnetpp (avg) 78.31% 83.000 148.000 - 260.98% -
482.sphinx3 76.07% 489.000 861.000 - 10662.50% -
482.sphinx3 (avg) 76.07% 489.000 861.000 - 10662.50% -
471.omnetpp (unexplained diff vs previous) (percentage) 75.58% 0.860 1.510 - 75.58% -
471.omnetpp (unexplained diff vs previous) 72.83% 92.000 159.000 - 562.50% -
403.gcc (max) (percentage) 68.42% 0.380 0.640 - -74.60% -
403.gcc (max) 61.76% 34.000 55.000 - 5400.00% -
447.dealII (max) (percentage) 41.77% 1.580 2.240 - 138.30% -
447.dealII (max) 41.09% 129.000 182.000 - 970.59% -
433.milc (max) (percentage) 19.71% 1.370 1.640 - 192.86% -
433.milc (max) 16.85% 184.000 215.000 - 3483.33% -
433.milc (avg) (percentage) 13.86% 1.010 1.150 - 91.67% -
433.milc 10.29% 136.000 150.000 - 2400.00% -
433.milc (avg) 10.29% 136.000 150.000 - 2400.00% -
473.astar (avg) (percentage) 4.00% 0.500 0.520 - -42.22% -
473.astar 1.41% 71.000 72.000 - 67.44% -
473.astar (avg) 1.41% 71.000 72.000 - 67.44% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -22.22% 18.000 14.000 - -58.82% -
nb_compile_successful -21.05% 19.000 15.000 - -58.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -5.37% 9099.000 8610.000 - 15844.44% -
429.mcf -4.81% 11999.000 11422.000 - 892.35% -
450.soplex -4.21% 14429.000 13821.000 - 2542.64% -
470.lbm -2.87% 13882.000 13484.000 - 325.23% -
433.milc -2.71% 13482.000 13117.000 - 1045.59% -
483.xalancbmk -2.65% 9427.000 9177.000 - 0.00% -
471.omnetpp -2.01% 10746.000 10530.000 - 275.67% -
473.astar -1.79% 14262.000 14007.000 - 187.15% -
462.libquantum -1.72% 13126.000 12900.000 - 13337.50% -
482.sphinx3 -1.42% 26310.000 25936.000 - 2867.51% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -98.99% 497.000 5.000 - 400.00% -
470.lbm (unexplained diff vs previous) (percentage) -98.88% 3.580 0.040 - 33.33% -
429.mcf (unexplained diff vs previous) -97.01% 67.000 2.000 - -77.78% -
429.mcf (unexplained diff vs previous) (percentage) -96.43% 0.560 0.020 - -97.44% -
458.sjeng (avg) (percentage) -86.21% 0.580 0.080 - -78.38% -
458.sjeng -84.21% 95.000 15.000 - -50.00% -
458.sjeng (avg) -84.21% 95.000 15.000 - -50.00% -
473.astar (unexplained diff vs previous) -83.33% 108.000 18.000 - 1700.00% -
473.astar (unexplained diff vs previous) (percentage) -82.89% 0.760 0.130 - 550.00% -
433.milc (unexplained diff vs previous) -79.12% 182.000 38.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -78.52% 1.350 0.290 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) -77.70% 1.480 0.330 - -64.52% -
447.dealII (unexplained diff vs previous) -77.69% 121.000 27.000 - 58.82% -
458.sjeng (max) (percentage) -75.00% 0.400 0.100 - -64.29% -
462.libquantum (unexplained diff vs previous) -75.00% 16.000 4.000 - 300.00% -
462.libquantum (unexplained diff vs previous) (percentage) -75.00% 0.120 0.030 - -97.12% -
458.sjeng (max) -70.77% 65.000 19.000 - -17.39% -
445.gobmk -63.64% 22.000 8.000 - -55.56% -
445.gobmk (avg) -63.64% 22.000 8.000 - -55.56% -
483.xalancbmk (unexplained diff vs previous) -62.30% 61.000 23.000 - 0.00% -
483.xalancbmk (unexplained diff vs previous) (percentage) -61.54% 0.650 0.250 - 0.00% -
445.gobmk (avg) (percentage) -61.11% 0.180 0.070 - -80.00% -
429.mcf -58.49% 53.000 22.000 - 22.22% -
429.mcf (avg) -58.49% 53.000 22.000 - 22.22% -
429.mcf (avg) (percentage) -55.56% 0.450 0.200 - -87.58% -
462.libquantum (max) -53.85% 26.000 12.000 - 100.00% -
462.libquantum (avg) (percentage) -53.33% 0.150 0.070 - -95.21% -
462.libquantum -52.63% 19.000 9.000 - 800.00% -
462.libquantum (avg) -52.63% 19.000 9.000 - 800.00% -
483.xalancbmk -51.06% 47.000 23.000 - 0.00% -
483.xalancbmk (avg) -51.06% 47.000 23.000 - 0.00% -
462.libquantum (max) (percentage) -50.00% 0.200 0.100 - -98.47% -
483.xalancbmk (avg) (percentage) -48.00% 0.500 0.260 - -80.45% -
450.soplex (unexplained diff vs previous) -45.12% 82.000 45.000 - 1400.00% -
450.soplex (unexplained diff vs previous) (percentage) -42.11% 0.570 0.330 - -42.11% -
445.gobmk (max) (percentage) -41.67% 0.240 0.140 - -63.16% -
445.gobmk (max) -41.38% 29.000 17.000 - -10.53% -
470.lbm (max) -41.09% 769.000 453.000 - 3384.62% -
450.soplex (max) -40.24% 82.000 49.000 - 1125.00% -
470.lbm (max) (percentage) -39.35% 5.540 3.360 - 663.64% -
450.soplex -39.22% 51.000 31.000 - 520.00% -
450.soplex (avg) -39.22% 51.000 31.000 - 520.00% -
450.soplex (max) (percentage) -36.84% 0.570 0.360 - -56.63% -
450.soplex (avg) (percentage) -36.11% 0.360 0.230 - -79.65% -
483.xalancbmk (max) -34.43% 61.000 40.000 - 0.00% -
483.xalancbmk (max) (percentage) -32.31% 0.650 0.440 - -40.54% -
429.mcf (max) -25.37% 67.000 50.000 - 525.00% -
429.mcf (max) (percentage) -21.43% 0.560 0.440 - -43.59% -
464.h264ref -15.69% 51.000 43.000 - 86.96% -
464.h264ref (avg) -15.69% 51.000 43.000 - 86.96% -
464.h264ref (avg) (percentage) -15.15% 0.330 0.280 - -34.88% -
471.omnetpp (max) -14.81% 189.000 161.000 - 570.83% -
482.sphinx3 (max) -14.78% 873.000 744.000 - 12300.00% -
482.sphinx3 (max) (percentage) -13.55% 3.320 2.870 - 315.94% -
471.omnetpp (max) (percentage) -13.07% 1.760 1.530 - 77.91% -
470.lbm -13.04% 322.000 280.000 - 976.92% -
470.lbm (avg) -13.04% 322.000 280.000 - 976.92% -
470.lbm (avg) (percentage) -10.34% 2.320 2.080 - 144.71% -
464.h264ref (max) (percentage) -10.26% 0.390 0.350 - 34.62% -
464.h264ref (unexplained diff vs previous) (percentage) -10.26% 0.390 0.350 - 94.44% -
464.h264ref (max) -10.00% 60.000 54.000 - 285.71% -
464.h264ref (unexplained diff vs previous) -10.00% 60.000 54.000 - 440.00% -
403.gcc -9.30% 43.000 39.000 - 3800.00% -
403.gcc (avg) -9.30% 43.000 39.000 - 3800.00% -
473.astar (max) -6.14% 114.000 107.000 - 613.33% -
447.dealII -4.17% 120.000 115.000 - 945.45% -
447.dealII (avg) -4.17% 120.000 115.000 - 945.45% -
403.gcc (avg) (percentage) -4.17% 0.480 0.460 - -86.86% -
473.astar (max) (percentage) -3.75% 0.800 0.770 - 148.39% -
447.dealII (avg) (percentage) -3.40% 1.470 1.420 - 132.79% -

Report Time: 0.37s
Execution (seconds)
Name Current %
403.gcc 8610.000 15844.44%
429.mcf 11422.000 892.35%
433.milc 13117.000 1045.59%
445.gobmk 12335.000 137.07%
447.dealII 8129.000 346.65%
450.soplex 13821.000 2542.64%
458.sjeng 19014.000 130.19%
462.libquantum 12900.000 13337.50%
464.h264ref 15492.000 178.03%
470.lbm 13484.000 325.23%
471.omnetpp 10530.000 275.67%
473.astar 14007.000 187.15%
482.sphinx3 25936.000 2867.51%
483.xalancbmk 9177.000 -
Geometric Mean 12813.318 836.34%
Code Size (bytes)
Name Current %
403.gcc 1960410.000 -
429.mcf 7935.000 1.34%
433.milc 74963.000 2.89%
445.gobmk 1313268.000 -
447.dealII 1786325.000 3.07%
450.soplex 203068.000 1.05%
458.sjeng 98070.000 1.07%
462.libquantum 26728.000 11.69%
464.h264ref 355282.000 1.49%
470.lbm 9739.000 -
471.omnetpp 377239.000 -
473.astar 23263.000 -
482.sphinx3 115840.000 -
483.xalancbmk 2288393.000 -
Geometric Mean 165657.565 24.55%
Score
Name Current %
nb_compile_successful 15.000 -58.33%
nb_execution_successful 14.000 -58.82%
nb_total_tests 19.000 -52.50%
Geometric Mean 15.861 -56.64%
sample variability
Name Current %
403.gcc 39.000 3800.00%
403.gcc (avg) 39.000 3800.00%
403.gcc (avg) (percentage) 0.460 -86.86%
403.gcc (max) 55.000 5400.00%
403.gcc (max) (percentage) 0.640 -74.60%
429.mcf 22.000 22.22%
429.mcf (avg) 22.000 22.22%
429.mcf (avg) (percentage) 0.200 -87.58%
429.mcf (max) 50.000 525.00%
429.mcf (max) (percentage) 0.440 -43.59%
429.mcf (unexplained diff vs previous) 2.000 -77.78%
429.mcf (unexplained diff vs previous) (percentage) 0.020 -97.44%
433.milc 150.000 2400.00%
433.milc (avg) 150.000 2400.00%
433.milc (avg) (percentage) 1.150 91.67%
433.milc (max) 215.000 3483.33%
433.milc (max) (percentage) 1.640 192.86%
433.milc (unexplained diff vs previous) 38.000 -
433.milc (unexplained diff vs previous) (percentage) 0.290 -
445.gobmk 8.000 -55.56%
445.gobmk (avg) 8.000 -55.56%
445.gobmk (avg) (percentage) 0.070 -80.00%
445.gobmk (max) 17.000 -10.53%
445.gobmk (max) (percentage) 0.140 -63.16%
447.dealII 115.000 945.45%
447.dealII (avg) 115.000 945.45%
447.dealII (avg) (percentage) 1.420 132.79%
447.dealII (max) 182.000 970.59%
447.dealII (max) (percentage) 2.240 138.30%
447.dealII (unexplained diff vs previous) 27.000 58.82%
447.dealII (unexplained diff vs previous) (percentage) 0.330 -64.52%
450.soplex 31.000 520.00%
450.soplex (avg) 31.000 520.00%
450.soplex (avg) (percentage) 0.230 -79.65%
450.soplex (max) 49.000 1125.00%
450.soplex (max) (percentage) 0.360 -56.63%
450.soplex (unexplained diff vs previous) 45.000 1400.00%
450.soplex (unexplained diff vs previous) (percentage) 0.330 -42.11%
458.sjeng 15.000 -50.00%
458.sjeng (avg) 15.000 -50.00%
458.sjeng (avg) (percentage) 0.080 -78.38%
458.sjeng (max) 19.000 -17.39%
458.sjeng (max) (percentage) 0.100 -64.29%
462.libquantum 9.000 800.00%
462.libquantum (avg) 9.000 800.00%
462.libquantum (avg) (percentage) 0.070 -95.21%
462.libquantum (max) 12.000 100.00%
462.libquantum (max) (percentage) 0.100 -98.47%
462.libquantum (unexplained diff vs previous) 4.000 300.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.030 -97.12%
464.h264ref 43.000 86.96%
464.h264ref (avg) 43.000 86.96%
464.h264ref (avg) (percentage) 0.280 -34.88%
464.h264ref (max) 54.000 285.71%
464.h264ref (max) (percentage) 0.350 34.62%
464.h264ref (unexplained diff vs previous) 54.000 440.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.350 94.44%
470.lbm 280.000 976.92%
470.lbm (avg) 280.000 976.92%
470.lbm (avg) (percentage) 2.080 144.71%
470.lbm (max) 453.000 3384.62%
470.lbm (max) (percentage) 3.360 663.64%
470.lbm (unexplained diff vs previous) 5.000 400.00%
470.lbm (unexplained diff vs previous) (percentage) 0.040 33.33%
471.omnetpp 148.000 260.98%
471.omnetpp (avg) 148.000 260.98%
471.omnetpp (avg) (percentage) 1.410 -4.08%
471.omnetpp (max) 161.000 570.83%
471.omnetpp (max) (percentage) 1.530 77.91%
471.omnetpp (unexplained diff vs previous) 159.000 562.50%
471.omnetpp (unexplained diff vs previous) (percentage) 1.510 75.58%
473.astar 72.000 67.44%
473.astar (avg) 72.000 67.44%
473.astar (avg) (percentage) 0.520 -42.22%
473.astar (max) 107.000 613.33%
473.astar (max) (percentage) 0.770 148.39%
473.astar (unexplained diff vs previous) 18.000 1700.00%
473.astar (unexplained diff vs previous) (percentage) 0.130 550.00%
482.sphinx3 861.000 10662.50%
482.sphinx3 (avg) 861.000 10662.50%
482.sphinx3 (avg) (percentage) 3.320 256.99%
482.sphinx3 (max) 744.000 12300.00%
482.sphinx3 (max) (percentage) 2.870 315.94%
483.xalancbmk 23.000 -
483.xalancbmk (avg) 23.000 -
483.xalancbmk (avg) (percentage) 0.260 -80.45%
483.xalancbmk (max) 40.000 -
483.xalancbmk (max) (percentage) 0.440 -40.54%
483.xalancbmk (unexplained diff vs previous) 23.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.250 -
Geometric Mean 6.183 118.91%