Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1ba2768c638a3e0f98ccd002d3f328a18739f7a9 (+ 353 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/170/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0170 (llvmorg-19-init-15034-g1ba2768c638a) 2024-06-17T21:37:03 0:00:00
Previous 0169 (llvmorg-19-init-14681-gc6049e67efaa) 2024-06-14T21:50:31 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 22 28
Performance Improvements 37 110
Added Tests 6 2
Unchanged Tests 715 640
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.39% 59.000 61.000 - -99.33% -
450.soplex 1.17% 511.000 517.000 - -96.42% -
453.povray 1.09% 458.000 463.000 - -93.25% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) (percentage) 157.14% 0.070 0.180 0.000 -53.85% 0.000
464.h264ref (unexplained diff vs previous) 150.00% 4.000 10.000 0.000 -83.33% 0.000
401.bzip2 (max) 66.67% 9.000 15.000 - -68.75% -
470.lbm (max) 60.00% 5.000 8.000 - -98.96% -
401.bzip2 (max) (percentage) 59.46% 0.370 0.590 - 90.32% -
470.lbm (max) (percentage) 55.56% 0.180 0.280 - -94.95% -
462.libquantum (max) 50.00% 2.000 3.000 - -88.46% -
482.sphinx3 (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 -99.67% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 47.83% 0.230 0.340 0.000 -90.12% 0.000
471.omnetpp (unexplained diff vs previous) (percentage) 44.00% 0.250 0.360 0.000 -58.14% 0.000
462.libquantum (max) (percentage) 43.88% 2.780 4.000 - 1900.00% -
471.omnetpp (unexplained diff vs previous) 42.86% 7.000 10.000 0.000 -89.13% 0.000
456.hmmer (max) 33.33% 12.000 16.000 - -60.00% -
456.hmmer (unexplained diff vs previous) 33.33% 12.000 16.000 0.000 77.78% 0.000
456.hmmer (max) (percentage) 32.35% 0.340 0.450 - 50.00% -
456.hmmer (unexplained diff vs previous) (percentage) 32.35% 0.340 0.450 0.000 542.86% 0.000
450.soplex 20.00% 5.000 6.000 - -88.24% -
450.soplex (avg) 20.00% 5.000 6.000 - -88.24% -
462.libquantum (avg) (percentage) 2.70% 1.480 1.520 - 913.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -4.00% 100.000 96.000 - -99.27% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) -71.43% 7.000 2.000 0.000 -99.76% 0.000
444.namd (unexplained diff vs previous) (percentage) -71.13% 0.970 0.280 0.000 -95.44% 0.000
429.mcf (unexplained diff vs previous) (percentage) -66.67% 1.050 0.350 0.000 -37.50% 0.000
429.mcf (unexplained diff vs previous) -66.67% 12.000 4.000 0.000 -94.03% 0.000
429.mcf (max) -52.63% 19.000 9.000 - -86.57% -
429.mcf (max) (percentage) -47.90% 1.670 0.870 - 55.36% -
444.namd (max) -28.57% 7.000 5.000 - -99.43% -
445.gobmk (max) -18.18% 11.000 9.000 - -68.97% -
482.sphinx3 (max) -16.67% 6.000 5.000 - -99.43% -
444.namd (max) (percentage) -16.33% 0.980 0.820 - -87.46% -
450.soplex (unexplained diff vs previous) (percentage) -15.33% 1.370 1.160 0.000 103.51% 0.000
450.soplex (unexplained diff vs previous) -14.29% 7.000 6.000 0.000 -92.68% 0.000
445.gobmk (max) (percentage) -13.64% 0.220 0.190 - -20.83% -
450.soplex (max) (percentage) -13.33% 1.350 1.170 - 105.26% -
464.h264ref (max) (percentage) -12.50% 0.320 0.280 - -28.21% -
464.h264ref (max) -11.76% 17.000 15.000 - -75.00% -
482.sphinx3 (max) (percentage) -11.59% 0.690 0.610 - -81.63% -
433.milc (max) -11.11% 9.000 8.000 - -95.65% -
473.astar (max) (percentage) -7.69% 0.390 0.360 - -55.00% -
433.milc (max) (percentage) -6.25% 0.800 0.750 - -45.26% -
458.sjeng (max) -5.66% 53.000 50.000 - -23.08% -
473.astar (max) -5.56% 18.000 17.000 - -85.09% -
471.omnetpp (max) -5.00% 60.000 57.000 - -69.84% -
458.sjeng (max) (percentage) -4.69% 0.640 0.610 - 52.50% -
453.povray (max) (percentage) -4.26% 0.940 0.900 - -53.37% -
471.omnetpp (max) (percentage) -4.17% 2.160 2.070 - 17.61% -
470.lbm -4.00% 25.000 24.000 - -92.55% -
470.lbm (avg) -4.00% 25.000 24.000 - -92.55% -
447.dealII (max) (percentage) -2.86% 0.700 0.680 - -56.96% -
403.gcc (max) (percentage) -2.42% 8.280 8.080 - 2026.32% -
433.milc (avg) (percentage) -1.72% 0.580 0.570 - -43.56% -
471.omnetpp (avg) (percentage) -1.37% 1.460 1.440 - 84.62% -
429.mcf (avg) (percentage) -1.28% 1.560 1.540 - 242.22% -
470.lbm (avg) (percentage) -1.25% 0.800 0.790 - -65.95% -
473.astar (avg) (percentage) -1.16% 0.860 0.850 - 70.00% -
482.sphinx3 (avg) (percentage) -1.12% 0.890 0.880 - -52.69% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.53% 39458.000 41641.000 - 0.00% -
471.omnetpp 1.25% 373579.000 378240.000 - 0.00% -
450.soplex 1.15% 198708.000 200991.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 3375.00% 0.120 4.170 0.000 0.00% 0.000
403.gcc (max) (percentage) 2026.32% 0.380 8.080 - -2.42% -
462.libquantum (max) (percentage) 1900.00% 0.200 4.000 - 43.88% -
462.libquantum (avg) (percentage) 913.33% 0.150 1.520 - 2.70% -
403.gcc (avg) (percentage) 708.33% 0.480 3.880 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 542.86% 0.070 0.450 0.000 32.35% 0.000
429.mcf (avg) (percentage) 242.22% 0.450 1.540 - -1.28% -
450.soplex (avg) (percentage) 225.00% 0.360 1.170 - 0.86% -
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
401.bzip2 (avg) (percentage) 131.82% 0.220 0.510 - 0.00% -
450.soplex (max) (percentage) 105.26% 0.570 1.170 - -13.33% -
450.soplex (unexplained diff vs previous) (percentage) 103.51% 0.570 1.160 0.000 -15.33% 0.000
401.bzip2 (max) (percentage) 90.32% 0.310 0.590 - 59.46% -
401.bzip2 (unexplained diff vs previous) (percentage) 90.32% 0.310 0.590 0.000 0.00% 0.000
471.omnetpp (avg) (percentage) 84.62% 0.780 1.440 - -1.37% -
445.gobmk (avg) (percentage) 83.33% 0.180 0.330 - 0.00% -
456.hmmer (unexplained diff vs previous) 77.78% 9.000 16.000 0.000 33.33% 0.000
473.astar (avg) (percentage) 70.00% 0.500 0.850 - -1.16% -
429.mcf (max) (percentage) 55.36% 0.560 0.870 - -47.90% -
458.sjeng (max) (percentage) 52.50% 0.400 0.610 - -4.69% -
456.hmmer (avg) (percentage) 50.00% 0.360 0.540 - 0.00% -
456.hmmer (max) (percentage) 50.00% 0.300 0.450 - 32.35% -
464.h264ref (avg) (percentage) 24.24% 0.330 0.410 - 0.00% -
471.omnetpp (max) (percentage) 17.61% 1.760 2.070 - -4.17% -
483.xalancbmk (max) (percentage) 9.23% 0.650 0.710 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.45% 26756.000 23959.000 - 0.00% -
433.milc -2.79% 74971.000 72882.000 - -0.01% -
447.dealII -2.54% 1777992.000 1732827.000 - -0.01% -
453.povray -2.52% 593097.000 578155.000 - -0.01% -
464.h264ref -1.32% 354618.000 349952.000 - 0.00% -
444.namd -1.30% 175160.000 172889.000 - 0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.33% 9099.000 61.000 - 3.39% -
462.libquantum -99.27% 13126.000 96.000 - -4.00% -
482.sphinx3 -96.65% 26310.000 881.000 - 0.34% -
450.soplex -96.42% 14429.000 517.000 - 1.17% -
444.namd -94.65% 13495.000 722.000 - -0.28% -
453.povray -93.25% 6857.000 463.000 - 1.09% -
433.milc -91.54% 13482.000 1140.000 - 0.00% -
429.mcf -90.51% 11999.000 1139.000 - -0.35% -
401.bzip2 -82.73% 15683.000 2708.000 - 0.59% -
447.dealII -77.99% 8196.000 1804.000 - -0.93% -
470.lbm -77.23% 13882.000 3161.000 - -0.28% -
471.omnetpp -74.11% 10746.000 2782.000 - -0.36% -
456.hmmer -73.39% 13365.000 3556.000 - -0.45% -
473.astar -65.96% 14262.000 4855.000 - -0.14% -
464.h264ref -64.11% 15493.000 5560.000 - 0.18% -
445.gobmk -58.13% 12400.000 5192.000 - 0.02% -
458.sjeng -49.60% 16406.000 8269.000 - -0.36% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.76% 828.000 2.000 0.000 -71.43% 0.000
482.sphinx3 (unexplained diff vs previous) -99.67% 904.000 3.000 0.000 50.00% 0.000
444.namd (max) -99.43% 882.000 5.000 - -28.57% -
482.sphinx3 (max) -99.43% 873.000 5.000 - -16.67% -
470.lbm (max) -98.96% 769.000 8.000 - 60.00% -
444.namd -98.64% 514.000 7.000 - 0.00% -
444.namd (avg) -98.64% 514.000 7.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.19% 497.000 9.000 0.000 0.00% 0.000
453.povray (max) -96.97% 132.000 4.000 - 0.00% -
433.milc (max) -95.65% 184.000 8.000 - -11.11% -
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) -95.44% 6.140 0.280 0.000 -71.13% 0.000
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
470.lbm (max) (percentage) -94.95% 5.540 0.280 - 55.56% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
453.povray -94.62% 93.000 5.000 - 0.00% -
453.povray (avg) -94.62% 93.000 5.000 - 0.00% -
429.mcf (unexplained diff vs previous) -94.03% 67.000 4.000 0.000 -66.67% 0.000
473.astar (unexplained diff vs previous) -93.52% 108.000 7.000 0.000 0.00% 0.000
450.soplex (max) -92.68% 82.000 6.000 - 0.00% -
450.soplex (unexplained diff vs previous) -92.68% 82.000 6.000 0.000 -14.29% 0.000
470.lbm -92.55% 322.000 24.000 - -4.00% -
470.lbm (avg) -92.55% 322.000 24.000 - -4.00% -
470.lbm (unexplained diff vs previous) (percentage) -92.18% 3.580 0.280 0.000 0.00% 0.000
447.dealII -91.67% 120.000 10.000 - 0.00% -
447.dealII (avg) -91.67% 120.000 10.000 - 0.00% -
447.dealII (max) -90.70% 129.000 12.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -90.12% 3.440 0.340 0.000 47.83% 0.000
471.omnetpp (unexplained diff vs previous) -89.13% 92.000 10.000 0.000 42.86% 0.000
462.libquantum (max) -88.46% 26.000 3.000 - 50.00% -
403.gcc (max) -88.24% 34.000 4.000 - 0.00% -
450.soplex -88.24% 51.000 6.000 - 20.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 20.00% -
444.namd (max) (percentage) -87.46% 6.540 0.820 - -16.33% -
429.mcf (max) -86.57% 67.000 9.000 - -52.63% -
473.astar (max) -85.09% 114.000 17.000 - -5.56% -
464.h264ref (unexplained diff vs previous) -83.33% 60.000 10.000 0.000 150.00% 0.000
482.sphinx3 (max) (percentage) -81.63% 3.320 0.610 - -11.59% -
473.astar (unexplained diff vs previous) (percentage) -81.58% 0.760 0.140 0.000 0.00% 0.000
462.libquantum (unexplained diff vs previous) -75.00% 16.000 4.000 0.000 0.00% 0.000
464.h264ref (max) -75.00% 60.000 15.000 - -11.76% -
444.namd (avg) (percentage) -73.49% 3.810 1.010 - -0.98% -
471.omnetpp (max) -69.84% 189.000 57.000 - -5.00% -
445.gobmk (max) -68.97% 29.000 9.000 - -18.18% -
401.bzip2 (max) -68.75% 48.000 15.000 - 66.67% -
458.sjeng -68.42% 95.000 30.000 - 0.00% -
458.sjeng (avg) -68.42% 95.000 30.000 - 0.00% -
429.mcf -67.92% 53.000 17.000 - 0.00% -
429.mcf (avg) -67.92% 53.000 17.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -67.35% 49.000 16.000 0.000 0.00% 0.000
470.lbm (avg) (percentage) -65.95% 2.320 0.790 - -1.25% -
401.bzip2 -61.76% 34.000 13.000 - 0.00% -
401.bzip2 (avg) -61.76% 34.000 13.000 - 0.00% -
456.hmmer -60.42% 48.000 19.000 - 0.00% -
456.hmmer (avg) -60.42% 48.000 19.000 - 0.00% -
456.hmmer (max) -60.00% 40.000 16.000 - 33.33% -
447.dealII (avg) (percentage) -59.18% 1.470 0.600 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -58.14% 0.860 0.360 0.000 44.00% 0.000
447.dealII (max) (percentage) -56.96% 1.580 0.680 - -2.86% -
464.h264ref -56.86% 51.000 22.000 - 0.00% -
464.h264ref (avg) -56.86% 51.000 22.000 - 0.00% -
473.astar (max) (percentage) -55.00% 0.800 0.360 - -7.69% -
464.h264ref (unexplained diff vs previous) (percentage) -53.85% 0.390 0.180 0.000 157.14% 0.000
453.povray (max) (percentage) -53.37% 1.930 0.900 - -4.26% -
482.sphinx3 (avg) (percentage) -52.69% 1.860 0.880 - -1.12% -
471.omnetpp -51.81% 83.000 40.000 - 0.00% -
471.omnetpp (avg) -51.81% 83.000 40.000 - 0.00% -
433.milc (max) (percentage) -45.26% 1.370 0.750 - -6.25% -
433.milc (avg) (percentage) -43.56% 1.010 0.570 - -1.72% -
473.astar -42.25% 71.000 41.000 - 0.00% -
473.astar (avg) -42.25% 71.000 41.000 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -37.50% 0.560 0.350 0.000 -66.67% 0.000
458.sjeng (avg) (percentage) -36.21% 0.580 0.370 - 0.00% -
464.h264ref (max) (percentage) -28.21% 0.390 0.280 - -12.50% -
458.sjeng (max) -23.08% 65.000 50.000 - -5.66% -
445.gobmk -22.73% 22.000 17.000 - 0.00% -
445.gobmk (avg) -22.73% 22.000 17.000 - 0.00% -
445.gobmk (max) (percentage) -20.83% 0.240 0.190 - -13.64% -
453.povray (avg) (percentage) -19.71% 1.370 1.100 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
433.milc (unexplained diff vs previous)
433.milc (unexplained diff vs previous) (percentage)


Report Time: 0.36s
Name Current %
401.bzip2 2708.000 -
403.gcc 61.000 3.39%
429.mcf 1139.000 -
433.milc 1140.000 -
444.namd 722.000 -
445.gobmk 5192.000 -
447.dealII 1804.000 -
450.soplex 517.000 1.17%
453.povray 463.000 1.09%
456.hmmer 3556.000 -
458.sjeng 8269.000 -
462.libquantum 96.000 -4.00%
464.h264ref 5560.000 -
470.lbm 3161.000 -
471.omnetpp 2782.000 -
473.astar 4855.000 -
482.sphinx3 881.000 -
Geometric Mean 1367.672 -
Name Current %
401.bzip2 41641.000 -
403.gcc 1955925.000 -
429.mcf 7842.000 -
433.milc 72882.000 -
444.namd 172889.000 -
445.gobmk 1308620.000 -
447.dealII 1732827.000 -
450.soplex 200991.000 -
453.povray 578155.000 -
456.hmmer 167638.000 -
458.sjeng 96961.000 -
462.libquantum 23959.000 -
464.h264ref 349952.000 -
470.lbm 9714.000 -
471.omnetpp 378240.000 -
473.astar 23351.000 -
482.sphinx3 115267.000 -
Geometric Mean 139468.614 -
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.510 -
401.bzip2 (max) 15.000 66.67%
401.bzip2 (max) (percentage) 0.590 59.46%
401.bzip2 (unexplained diff vs previous) 16.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.590 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.880 -
403.gcc (max) 4.000 -
403.gcc (max) (percentage) 8.080 -2.42%
429.mcf 17.000 -
429.mcf (avg) 17.000 -
429.mcf (avg) (percentage) 1.540 -1.28%
429.mcf (max) 9.000 -52.63%
429.mcf (max) (percentage) 0.870 -47.90%
429.mcf (unexplained diff vs previous) 4.000 -66.67%
429.mcf (unexplained diff vs previous) (percentage) 0.350 -66.67%
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.570 -1.72%
433.milc (max) 8.000 -11.11%
433.milc (max) (percentage) 0.750 -6.25%
433.milc (unexplained diff vs previous) 0.000 -
433.milc (unexplained diff vs previous) (percentage) 0.000 -
444.namd 7.000 -
444.namd (avg) 7.000 -
444.namd (avg) (percentage) 1.010 -
444.namd (max) 5.000 -28.57%
444.namd (max) (percentage) 0.820 -16.33%
444.namd (unexplained diff vs previous) 2.000 -71.43%
444.namd (unexplained diff vs previous) (percentage) 0.280 -71.13%
445.gobmk 17.000 -
445.gobmk (avg) 17.000 -
445.gobmk (avg) (percentage) 0.330 -
445.gobmk (max) 9.000 -18.18%
445.gobmk (max) (percentage) 0.190 -13.64%
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 0.600 -
447.dealII (max) 12.000 -
447.dealII (max) (percentage) 0.680 -2.86%
450.soplex 6.000 20.00%
450.soplex (avg) 6.000 20.00%
450.soplex (avg) (percentage) 1.170 -
450.soplex (max) 6.000 -
450.soplex (max) (percentage) 1.170 -13.33%
450.soplex (unexplained diff vs previous) 6.000 -14.29%
450.soplex (unexplained diff vs previous) (percentage) 1.160 -15.33%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.100 -
453.povray (max) 4.000 -
453.povray (max) (percentage) 0.900 -4.26%
456.hmmer 19.000 -
456.hmmer (avg) 19.000 -
456.hmmer (avg) (percentage) 0.540 -
456.hmmer (max) 16.000 33.33%
456.hmmer (max) (percentage) 0.450 32.35%
456.hmmer (unexplained diff vs previous) 16.000 33.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.450 32.35%
458.sjeng 30.000 -
458.sjeng (avg) 30.000 -
458.sjeng (avg) (percentage) 0.370 -
458.sjeng (max) 50.000 -5.66%
458.sjeng (max) (percentage) 0.610 -4.69%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.520 2.70%
462.libquantum (max) 3.000 50.00%
462.libquantum (max) (percentage) 4.000 43.88%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 4.170 -
464.h264ref 22.000 -
464.h264ref (avg) 22.000 -
464.h264ref (avg) (percentage) 0.410 -
464.h264ref (max) 15.000 -11.76%
464.h264ref (max) (percentage) 0.280 -12.50%
464.h264ref (unexplained diff vs previous) 10.000 150.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.180 157.14%
470.lbm 24.000 -4.00%
470.lbm (avg) 24.000 -4.00%
470.lbm (avg) (percentage) 0.790 -1.25%
470.lbm (max) 8.000 60.00%
470.lbm (max) (percentage) 0.280 55.56%
470.lbm (unexplained diff vs previous) 9.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.280 -
471.omnetpp 40.000 -
471.omnetpp (avg) 40.000 -
471.omnetpp (avg) (percentage) 1.440 -1.37%
471.omnetpp (max) 57.000 -5.00%
471.omnetpp (max) (percentage) 2.070 -4.17%
471.omnetpp (unexplained diff vs previous) 10.000 42.86%
471.omnetpp (unexplained diff vs previous) (percentage) 0.360 44.00%
473.astar 41.000 -
473.astar (avg) 41.000 -
473.astar (avg) (percentage) 0.850 -1.16%
473.astar (max) 17.000 -5.56%
473.astar (max) (percentage) 0.360 -7.69%
473.astar (unexplained diff vs previous) 7.000 -
473.astar (unexplained diff vs previous) (percentage) 0.140 -
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.880 -1.12%
482.sphinx3 (max) 5.000 -16.67%
482.sphinx3 (max) (percentage) 0.610 -11.59%
482.sphinx3 (unexplained diff vs previous) 3.000 50.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.340 47.83%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.710 -
Geometric Mean 2.581 18.13%