Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/94896994386d2a6a9e7bc310de83ee1491f194ef (+ 357 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/167/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0167 (llvmorg-16-init-05648-g94896994386d) 2022-09-20T17:21:50 0:00:00
Previous 0166 (llvmorg-19-init-13797-g715a5d8d93a8) 2024-06-05T14:16:52 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 82 38
Performance Improvements 26 63
Added Tests 5 0
Unchanged Tests 667 679
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.69% 23931.000 26728.000 - -0.10% -
447.dealII 3.07% 1733127.000 1786325.000 - 0.47% -
433.milc 2.91% 72842.000 74963.000 - -0.01% -
464.h264ref 1.48% 350084.000 355266.000 - 0.18% -
429.mcf 1.34% 7830.000 7935.000 - 0.25% -
458.sjeng 1.11% 97029.000 98102.000 - 0.31% -
450.soplex 1.05% 200963.000 203068.000 - 2.19% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15003.51% 57.000 8609.000 - -5.39% -
462.libquantum 13501.05% 95.000 12921.000 - -1.56% -
482.sphinx3 2867.84% 877.000 26028.000 - -1.07% -
450.soplex 2551.15% 520.000 13786.000 - -4.46% -
433.milc 1028.80% 1146.000 12936.000 - -4.05% -
429.mcf 877.68% 1165.000 11390.000 - -5.08% -
447.dealII 345.93% 1820.000 8116.000 - -0.98% -
470.lbm 321.64% 3174.000 13383.000 - -3.59% -
471.omnetpp 284.65% 2717.000 10451.000 - -2.75% -
473.astar 189.01% 4852.000 14023.000 - -1.68% -
464.h264ref 177.26% 5571.000 15446.000 - -0.30% -
445.gobmk 137.90% 5180.000 12323.000 - -0.62% -
458.sjeng 129.60% 8281.000 19013.000 - 15.89% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) 14383.33% 6.000 869.000 - -0.46% -
482.sphinx3 (unexplained diff vs previous) 14383.33% 6.000 869.000 - -3.87% -
482.sphinx3 12571.43% 7.000 887.000 - 81.39% -
482.sphinx3 (avg) 12571.43% 7.000 887.000 - 81.39% -
470.lbm (unexplained diff vs previous) 10883.33% 6.000 659.000 - 32.60% -
470.lbm (max) 5125.00% 12.000 627.000 - -18.47% -
433.milc (max) 3820.00% 5.000 196.000 - 6.52% -
470.lbm (unexplained diff vs previous) (percentage) 2489.47% 0.190 4.920 - 37.43% -
433.milc 1850.00% 6.000 117.000 - -13.97% -
433.milc (avg) 1850.00% 6.000 117.000 - -13.97% -
433.milc (unexplained diff vs previous) 1800.00% 1.000 19.000 - -89.56% -
447.dealII (unexplained diff vs previous) 1780.00% 10.000 188.000 - 55.37% -
470.lbm 1700.00% 26.000 468.000 - 45.34% -
470.lbm (avg) 1700.00% 26.000 468.000 - 45.34% -
447.dealII 1381.82% 11.000 163.000 - 35.83% -
447.dealII (avg) 1381.82% 11.000 163.000 - 35.83% -
403.gcc (max) 1275.00% 4.000 55.000 - 61.76% -
447.dealII (max) 1271.43% 14.000 192.000 - 48.84% -
470.lbm (max) (percentage) 1072.50% 0.400 4.690 - -15.34% -
403.gcc 1000.00% 2.000 22.000 - -48.84% -
403.gcc (avg) 1000.00% 2.000 22.000 - -48.84% -
462.libquantum 900.00% 1.000 10.000 - -47.37% -
462.libquantum (avg) 900.00% 1.000 10.000 - -47.37% -
473.astar (unexplained diff vs previous) 683.33% 12.000 94.000 - -12.96% -
473.astar (max) 675.00% 12.000 93.000 - -18.42% -
462.libquantum (unexplained diff vs previous) 533.33% 3.000 19.000 - 18.75% -
450.soplex 440.00% 5.000 27.000 - -47.06% -
450.soplex (avg) 440.00% 5.000 27.000 - -47.06% -
464.h264ref (max) 418.75% 16.000 83.000 - 38.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) 391.18% 0.680 3.340 - -2.91% -
450.soplex (max) 390.00% 10.000 49.000 - -40.24% -
482.sphinx3 (max) (percentage) 384.06% 0.690 3.340 - 0.60% -
447.dealII (unexplained diff vs previous) (percentage) 321.82% 0.550 2.320 - 56.76% -
470.lbm (avg) (percentage) 321.69% 0.830 3.500 - 50.86% -
462.libquantum (max) 280.00% 5.000 19.000 - -26.92% -
482.sphinx3 (avg) (percentage) 274.73% 0.910 3.410 - 83.33% -
471.omnetpp 272.50% 40.000 149.000 - 79.52% -
471.omnetpp (avg) 272.50% 40.000 149.000 - 79.52% -
464.h264ref (unexplained diff vs previous) 243.75% 16.000 55.000 - -8.33% -
447.dealII (avg) (percentage) 231.15% 0.610 2.020 - 37.41% -
433.milc (max) (percentage) 204.00% 0.500 1.520 - 10.95% -
447.dealII (max) (percentage) 192.59% 0.810 2.370 - 50.00% -
473.astar (max) (percentage) 168.00% 0.250 0.670 - -16.25% -
473.astar (unexplained diff vs previous) (percentage) 168.00% 0.250 0.670 - -11.84% -
464.h264ref 165.22% 23.000 61.000 - 19.61% -
464.h264ref (avg) 165.22% 23.000 61.000 - 19.61% -
473.astar 111.90% 42.000 89.000 - 25.35% -
473.astar (avg) 111.90% 42.000 89.000 - 25.35% -
471.omnetpp (max) 97.85% 93.000 184.000 - -2.65% -
471.omnetpp (unexplained diff vs previous) 93.81% 97.000 188.000 - 104.35% -
458.sjeng (max) 89.47% 19.000 36.000 - -44.62% -
464.h264ref (max) (percentage) 86.21% 0.290 0.540 - 38.46% -
433.milc (unexplained diff vs previous) (percentage) 66.67% 0.090 0.150 - -88.89% -
429.mcf (max) 65.22% 23.000 38.000 - -43.28% -
429.mcf 61.11% 18.000 29.000 - -45.28% -
429.mcf (avg) 61.11% 18.000 29.000 - -45.28% -
433.milc (avg) (percentage) 54.24% 0.590 0.910 - -9.90% -
464.h264ref (unexplained diff vs previous) (percentage) 24.14% 0.290 0.360 - -7.69% -
445.gobmk (max) 17.65% 17.000 20.000 - -31.03% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -58.82% 34.000 14.000 - -22.22% -
nb_compile_successful -58.33% 36.000 15.000 - -21.05% -
nb_total_tests -52.50% 40.000 19.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) (percentage) -97.43% 5.830 0.150 - -25.00% -
450.soplex (unexplained diff vs previous) (percentage) -96.70% 2.120 0.070 - -87.72% -
462.libquantum (unexplained diff vs previous) (percentage) -95.25% 3.160 0.150 - 25.00% -
462.libquantum (avg) (percentage) -94.63% 1.490 0.080 - -46.67% -
403.gcc (avg) (percentage) -93.03% 3.730 0.260 - -45.83% -
403.gcc (max) (percentage) -91.21% 7.280 0.640 - 68.42% -
429.mcf (unexplained diff vs previous) (percentage) -90.86% 1.970 0.180 - -67.86% -
429.mcf (avg) (percentage) -83.75% 1.600 0.260 - -42.22% -
429.mcf (max) (percentage) -83.08% 2.010 0.340 - -39.29% -
450.soplex (avg) (percentage) -82.61% 1.150 0.200 - -44.44% -
450.soplex (max) (percentage) -82.61% 2.070 0.360 - -36.84% -
483.xalancbmk (avg) (percentage) -80.45% 1.330 0.260 - -48.00% -
445.gobmk (avg) (percentage) -58.82% 0.340 0.140 - -22.22% -
458.sjeng (avg) (percentage) -58.33% 0.360 0.150 - -74.14% -
471.omnetpp (unexplained diff vs previous) (percentage) -49.58% 3.570 1.800 - 109.30% -
471.omnetpp (max) (percentage) -48.70% 3.450 1.770 - 0.57% -
445.gobmk (max) (percentage) -48.48% 0.330 0.170 - -29.17% -
483.xalancbmk (max) (percentage) -45.21% 0.730 0.400 - -38.46% -
473.astar (avg) (percentage) -27.27% 0.880 0.640 - 28.00% -
458.sjeng (max) (percentage) -20.83% 0.240 0.190 - -52.50% -
450.soplex (unexplained diff vs previous) -9.09% 11.000 10.000 - -87.80% -
429.mcf (unexplained diff vs previous) -8.70% 23.000 21.000 - -68.66% -
464.h264ref (avg) (percentage) -4.76% 0.420 0.400 - 21.21% -
458.sjeng -3.45% 29.000 28.000 - -70.53% -
458.sjeng (avg) -3.45% 29.000 28.000 - -70.53% -
471.omnetpp (avg) (percentage) -3.38% 1.480 1.430 - 83.33% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 198708.000 203068.000 - 1.05% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng 15.89% 16406.000 19013.000 - 129.60% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
471.omnetpp (unexplained diff vs previous) (percentage) 109.30% 0.860 1.800 - -49.58% -
471.omnetpp (unexplained diff vs previous) 104.35% 92.000 188.000 - 93.81% -
482.sphinx3 (avg) (percentage) 83.33% 1.860 3.410 - 274.73% -
471.omnetpp (avg) (percentage) 83.33% 0.780 1.430 - -3.38% -
482.sphinx3 81.39% 489.000 887.000 - 12571.43% -
482.sphinx3 (avg) 81.39% 489.000 887.000 - 12571.43% -
471.omnetpp 79.52% 83.000 149.000 - 272.50% -
471.omnetpp (avg) 79.52% 83.000 149.000 - 272.50% -
403.gcc (max) (percentage) 68.42% 0.380 0.640 - -91.21% -
403.gcc (max) 61.76% 34.000 55.000 - 1275.00% -
447.dealII (unexplained diff vs previous) (percentage) 56.76% 1.480 2.320 - 321.82% -
447.dealII (unexplained diff vs previous) 55.37% 121.000 188.000 - 1780.00% -
470.lbm (avg) (percentage) 50.86% 2.320 3.500 - 321.69% -
447.dealII (max) (percentage) 50.00% 1.580 2.370 - 192.59% -
447.dealII (max) 48.84% 129.000 192.000 - 1271.43% -
470.lbm 45.34% 322.000 468.000 - 1700.00% -
470.lbm (avg) 45.34% 322.000 468.000 - 1700.00% -
464.h264ref (max) (percentage) 38.46% 0.390 0.540 - 86.21% -
464.h264ref (max) 38.33% 60.000 83.000 - 418.75% -
470.lbm (unexplained diff vs previous) (percentage) 37.43% 3.580 4.920 - 2489.47% -
447.dealII (avg) (percentage) 37.41% 1.470 2.020 - 231.15% -
447.dealII 35.83% 120.000 163.000 - 1381.82% -
447.dealII (avg) 35.83% 120.000 163.000 - 1381.82% -
470.lbm (unexplained diff vs previous) 32.60% 497.000 659.000 - 10883.33% -
473.astar (avg) (percentage) 28.00% 0.500 0.640 - -27.27% -
473.astar 25.35% 71.000 89.000 - 111.90% -
473.astar (avg) 25.35% 71.000 89.000 - 111.90% -
462.libquantum (unexplained diff vs previous) (percentage) 25.00% 0.120 0.150 - -95.25% -
464.h264ref (avg) (percentage) 21.21% 0.330 0.400 - -4.76% -
464.h264ref 19.61% 51.000 61.000 - 165.22% -
464.h264ref (avg) 19.61% 51.000 61.000 - 165.22% -
462.libquantum (unexplained diff vs previous) 18.75% 16.000 19.000 - 533.33% -
433.milc (max) (percentage) 10.95% 1.370 1.520 - 204.00% -
433.milc (max) 6.52% 184.000 196.000 - 3820.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -22.22% 18.000 14.000 - -58.82% -
nb_compile_successful -21.05% 19.000 15.000 - -58.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -5.39% 9099.000 8609.000 - 15003.51% -
429.mcf -5.08% 11999.000 11390.000 - 877.68% -
450.soplex -4.46% 14429.000 13786.000 - 2551.15% -
433.milc -4.05% 13482.000 12936.000 - 1028.80% -
470.lbm -3.59% 13882.000 13383.000 - 321.64% -
471.omnetpp -2.75% 10746.000 10451.000 - 284.65% -
473.astar -1.68% 14262.000 14023.000 - 189.01% -
462.libquantum -1.56% 13126.000 12921.000 - 13501.05% -
483.xalancbmk -1.26% 9427.000 9308.000 - 0.00% -
482.sphinx3 -1.07% 26310.000 26028.000 - 2867.84% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
433.milc (unexplained diff vs previous) -89.56% 182.000 19.000 - 1800.00% -
433.milc (unexplained diff vs previous) (percentage) -88.89% 1.350 0.150 - 66.67% -
450.soplex (unexplained diff vs previous) -87.80% 82.000 10.000 - -9.09% -
450.soplex (unexplained diff vs previous) (percentage) -87.72% 0.570 0.070 - -96.70% -
458.sjeng (avg) (percentage) -74.14% 0.580 0.150 - -58.33% -
458.sjeng -70.53% 95.000 28.000 - -3.45% -
458.sjeng (avg) -70.53% 95.000 28.000 - -3.45% -
429.mcf (unexplained diff vs previous) -68.66% 67.000 21.000 - -8.70% -
429.mcf (unexplained diff vs previous) (percentage) -67.86% 0.560 0.180 - -90.86% -
458.sjeng (max) (percentage) -52.50% 0.400 0.190 - -20.83% -
483.xalancbmk -48.94% 47.000 24.000 - 0.00% -
483.xalancbmk (avg) -48.94% 47.000 24.000 - 0.00% -
403.gcc -48.84% 43.000 22.000 - 1000.00% -
403.gcc (avg) -48.84% 43.000 22.000 - 1000.00% -
483.xalancbmk (avg) (percentage) -48.00% 0.500 0.260 - -80.45% -
462.libquantum -47.37% 19.000 10.000 - 900.00% -
462.libquantum (avg) -47.37% 19.000 10.000 - 900.00% -
450.soplex -47.06% 51.000 27.000 - 440.00% -
450.soplex (avg) -47.06% 51.000 27.000 - 440.00% -
462.libquantum (avg) (percentage) -46.67% 0.150 0.080 - -94.63% -
403.gcc (avg) (percentage) -45.83% 0.480 0.260 - -93.03% -
429.mcf -45.28% 53.000 29.000 - 61.11% -
429.mcf (avg) -45.28% 53.000 29.000 - 61.11% -
458.sjeng (max) -44.62% 65.000 36.000 - 89.47% -
450.soplex (avg) (percentage) -44.44% 0.360 0.200 - -82.61% -
429.mcf (max) -43.28% 67.000 38.000 - 65.22% -
429.mcf (avg) (percentage) -42.22% 0.450 0.260 - -83.75% -
450.soplex (max) -40.24% 82.000 49.000 - 390.00% -
483.xalancbmk (max) -39.34% 61.000 37.000 - 0.00% -
429.mcf (max) (percentage) -39.29% 0.560 0.340 - -83.08% -
483.xalancbmk (max) (percentage) -38.46% 0.650 0.400 - -45.21% -
450.soplex (max) (percentage) -36.84% 0.570 0.360 - -82.61% -
445.gobmk (max) -31.03% 29.000 20.000 - 17.65% -
445.gobmk (max) (percentage) -29.17% 0.240 0.170 - -48.48% -
462.libquantum (max) -26.92% 26.000 19.000 - 280.00% -
462.libquantum (max) (percentage) -25.00% 0.200 0.150 - -97.43% -
445.gobmk -22.73% 22.000 17.000 - 0.00% -
445.gobmk (avg) -22.73% 22.000 17.000 - 0.00% -
445.gobmk (avg) (percentage) -22.22% 0.180 0.140 - -58.82% -
470.lbm (max) -18.47% 769.000 627.000 - 5125.00% -
473.astar (max) -18.42% 114.000 93.000 - 675.00% -
473.astar (max) (percentage) -16.25% 0.800 0.670 - 168.00% -
470.lbm (max) (percentage) -15.34% 5.540 4.690 - 1072.50% -
433.milc -13.97% 136.000 117.000 - 1850.00% -
433.milc (avg) -13.97% 136.000 117.000 - 1850.00% -
473.astar (unexplained diff vs previous) -12.96% 108.000 94.000 - 683.33% -
473.astar (unexplained diff vs previous) (percentage) -11.84% 0.760 0.670 - 168.00% -
433.milc (avg) (percentage) -9.90% 1.010 0.910 - 54.24% -
464.h264ref (unexplained diff vs previous) -8.33% 60.000 55.000 - 243.75% -
464.h264ref (unexplained diff vs previous) (percentage) -7.69% 0.390 0.360 - 24.14% -
482.sphinx3 (unexplained diff vs previous) -3.87% 904.000 869.000 - 14383.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -2.91% 3.440 3.340 - 391.18% -
471.omnetpp (max) -2.65% 189.000 184.000 - 97.85% -

Report Time: 0.37s
Execution (seconds)
Name Current %
403.gcc 8609.000 15003.51%
429.mcf 11390.000 877.68%
433.milc 12936.000 1028.80%
445.gobmk 12323.000 137.90%
447.dealII 8116.000 345.93%
450.soplex 13786.000 2551.15%
458.sjeng 19013.000 129.60%
462.libquantum 12921.000 13501.05%
464.h264ref 15446.000 177.26%
470.lbm 13383.000 321.64%
471.omnetpp 10451.000 284.65%
473.astar 14023.000 189.01%
482.sphinx3 26028.000 2867.84%
483.xalancbmk 9308.000 -
Geometric Mean 12795.466 833.85%
Code Size (bytes)
Name Current %
403.gcc 1960490.000 -
429.mcf 7935.000 1.34%
433.milc 74963.000 2.91%
445.gobmk 1313284.000 -
447.dealII 1786325.000 3.07%
450.soplex 203068.000 1.05%
458.sjeng 98102.000 1.11%
462.libquantum 26728.000 11.69%
464.h264ref 355266.000 1.48%
470.lbm 9739.000 -
471.omnetpp 377239.000 -
473.astar 23263.000 -
482.sphinx3 115840.000 -
483.xalancbmk 2288369.000 -
Geometric Mean 165661.395 24.55%
Score
Name Current %
nb_compile_successful 15.000 -58.33%
nb_execution_successful 14.000 -58.82%
nb_total_tests 19.000 -52.50%
Geometric Mean 15.861 -56.64%
sample variability
Name Current %
403.gcc 22.000 1000.00%
403.gcc (avg) 22.000 1000.00%
403.gcc (avg) (percentage) 0.260 -93.03%
403.gcc (max) 55.000 1275.00%
403.gcc (max) (percentage) 0.640 -91.21%
429.mcf 29.000 61.11%
429.mcf (avg) 29.000 61.11%
429.mcf (avg) (percentage) 0.260 -83.75%
429.mcf (max) 38.000 65.22%
429.mcf (max) (percentage) 0.340 -83.08%
429.mcf (unexplained diff vs previous) 21.000 -8.70%
429.mcf (unexplained diff vs previous) (percentage) 0.180 -90.86%
433.milc 117.000 1850.00%
433.milc (avg) 117.000 1850.00%
433.milc (avg) (percentage) 0.910 54.24%
433.milc (max) 196.000 3820.00%
433.milc (max) (percentage) 1.520 204.00%
433.milc (unexplained diff vs previous) 19.000 1800.00%
433.milc (unexplained diff vs previous) (percentage) 0.150 66.67%
445.gobmk 17.000 -
445.gobmk (avg) 17.000 -
445.gobmk (avg) (percentage) 0.140 -58.82%
445.gobmk (max) 20.000 17.65%
445.gobmk (max) (percentage) 0.170 -48.48%
447.dealII 163.000 1381.82%
447.dealII (avg) 163.000 1381.82%
447.dealII (avg) (percentage) 2.020 231.15%
447.dealII (max) 192.000 1271.43%
447.dealII (max) (percentage) 2.370 192.59%
447.dealII (unexplained diff vs previous) 188.000 1780.00%
447.dealII (unexplained diff vs previous) (percentage) 2.320 321.82%
450.soplex 27.000 440.00%
450.soplex (avg) 27.000 440.00%
450.soplex (avg) (percentage) 0.200 -82.61%
450.soplex (max) 49.000 390.00%
450.soplex (max) (percentage) 0.360 -82.61%
450.soplex (unexplained diff vs previous) 10.000 -9.09%
450.soplex (unexplained diff vs previous) (percentage) 0.070 -96.70%
458.sjeng 28.000 -3.45%
458.sjeng (avg) 28.000 -3.45%
458.sjeng (avg) (percentage) 0.150 -58.33%
458.sjeng (max) 36.000 89.47%
458.sjeng (max) (percentage) 0.190 -20.83%
462.libquantum 10.000 900.00%
462.libquantum (avg) 10.000 900.00%
462.libquantum (avg) (percentage) 0.080 -94.63%
462.libquantum (max) 19.000 280.00%
462.libquantum (max) (percentage) 0.150 -97.43%
462.libquantum (unexplained diff vs previous) 19.000 533.33%
462.libquantum (unexplained diff vs previous) (percentage) 0.150 -95.25%
464.h264ref 61.000 165.22%
464.h264ref (avg) 61.000 165.22%
464.h264ref (avg) (percentage) 0.400 -4.76%
464.h264ref (max) 83.000 418.75%
464.h264ref (max) (percentage) 0.540 86.21%
464.h264ref (unexplained diff vs previous) 55.000 243.75%
464.h264ref (unexplained diff vs previous) (percentage) 0.360 24.14%
470.lbm 468.000 1700.00%
470.lbm (avg) 468.000 1700.00%
470.lbm (avg) (percentage) 3.500 321.69%
470.lbm (max) 627.000 5125.00%
470.lbm (max) (percentage) 4.690 1072.50%
470.lbm (unexplained diff vs previous) 659.000 10883.33%
470.lbm (unexplained diff vs previous) (percentage) 4.920 2489.47%
471.omnetpp 149.000 272.50%
471.omnetpp (avg) 149.000 272.50%
471.omnetpp (avg) (percentage) 1.430 -3.38%
471.omnetpp (max) 184.000 97.85%
471.omnetpp (max) (percentage) 1.770 -48.70%
471.omnetpp (unexplained diff vs previous) 188.000 93.81%
471.omnetpp (unexplained diff vs previous) (percentage) 1.800 -49.58%
473.astar 89.000 111.90%
473.astar (avg) 89.000 111.90%
473.astar (avg) (percentage) 0.640 -27.27%
473.astar (max) 93.000 675.00%
473.astar (max) (percentage) 0.670 168.00%
473.astar (unexplained diff vs previous) 94.000 683.33%
473.astar (unexplained diff vs previous) (percentage) 0.670 168.00%
482.sphinx3 887.000 12571.43%
482.sphinx3 (avg) 887.000 12571.43%
482.sphinx3 (avg) (percentage) 3.410 274.73%
482.sphinx3 (max) 869.000 14383.33%
482.sphinx3 (max) (percentage) 3.340 384.06%
482.sphinx3 (unexplained diff vs previous) 869.000 14383.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 3.340 391.18%
483.xalancbmk 24.000 -
483.xalancbmk (avg) 24.000 -
483.xalancbmk (avg) (percentage) 0.260 -80.45%
483.xalancbmk (max) 37.000 -
483.xalancbmk (max) (percentage) 0.400 -45.21%
Geometric Mean 9.349 160.71%