Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8d17824890f668cca654a6b821d642bd3192dc81 (+ 325 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/181/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0181 (llvmorg-19-init-17040-g8d17824890f6) 2024-07-08T08:53:07 0:00:00
Previous 0180 (llvmorg-19-init-16715-g29b8b7211784) 2024-07-06T09:17:15 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 26
Performance Improvements 41 111
Added Tests 8 4
Unchanged Tests 713 639
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.65% 1153.000 1172.000 - -90.23% -
482.sphinx3 1.03% 875.000 884.000 - -96.64% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) 1800.00% 1.000 19.000 - -71.64% -
458.sjeng (unexplained diff vs previous) (percentage) 1350.00% 0.020 0.290 0.000 16.00% 0.000
429.mcf (max) (percentage) 1169.23% 0.130 1.650 - 194.64% -
458.sjeng (unexplained diff vs previous) 1100.00% 2.000 24.000 0.000 -41.46% 0.000
450.soplex (unexplained diff vs previous) (percentage) 410.53% 0.190 0.970 0.000 70.18% 0.000
450.soplex (unexplained diff vs previous) 400.00% 1.000 5.000 0.000 -93.90% 0.000
401.bzip2 (unexplained diff vs previous) (percentage) 57.14% 0.070 0.110 0.000 -64.52% 0.000
462.libquantum (unexplained diff vs previous) (percentage) 54.90% 2.040 3.160 0.000 2533.33% 0.000
401.bzip2 (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 -93.88% 0.000
462.libquantum (unexplained diff vs previous) 50.00% 2.000 3.000 0.000 -81.25% 0.000
462.libquantum (max) (percentage) 47.12% 2.080 3.060 - 1430.00% -
482.sphinx3 (unexplained diff vs previous) 28.57% 7.000 9.000 0.000 -99.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) 27.50% 0.800 1.020 0.000 -70.35% 0.000
470.lbm (unexplained diff vs previous) 27.27% 11.000 14.000 0.000 -97.18% 0.000
470.lbm (unexplained diff vs previous) (percentage) 25.71% 0.350 0.440 0.000 -87.71% 0.000
462.libquantum (avg) (percentage) 1.32% 1.510 1.530 - 920.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -5.08% 59.000 56.000 - -99.38% -
462.libquantum -3.06% 98.000 95.000 - -99.28% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) (percentage) -81.58% 0.760 0.140 0.000 -83.72% 0.000
471.omnetpp (unexplained diff vs previous) -80.95% 21.000 4.000 0.000 -95.65% 0.000
445.gobmk (unexplained diff vs previous) -76.00% 25.000 6.000 0.000 -80.00% 0.000
445.gobmk (unexplained diff vs previous) (percentage) -75.00% 0.480 0.120 0.000 -50.00% 0.000
433.milc (unexplained diff vs previous) (percentage) -25.71% 1.050 0.780 0.000 -42.22% 0.000
433.milc (unexplained diff vs previous) -25.00% 12.000 9.000 0.000 -95.05% 0.000
464.h264ref (max) -22.22% 9.000 7.000 - -88.33% -
433.milc (max) -18.18% 11.000 9.000 - -95.11% -
464.h264ref (max) (percentage) -17.65% 0.170 0.140 - -64.10% -
445.gobmk (max) -16.67% 24.000 20.000 - -31.03% -
445.gobmk (max) (percentage) -16.67% 0.480 0.400 - 66.67% -
433.milc (max) (percentage) -16.35% 1.040 0.870 - -36.50% -
444.namd (max) -14.29% 7.000 6.000 - -99.32% -
450.soplex (max) -12.50% 8.000 7.000 - -91.46% -
456.hmmer (max) -11.76% 17.000 15.000 - -62.50% -
470.lbm (max) -11.76% 17.000 15.000 - -98.05% -
473.astar (max) -11.11% 27.000 24.000 - -78.95% -
470.lbm (max) (percentage) -10.71% 0.560 0.500 - -90.97% -
473.astar (max) (percentage) -10.53% 0.570 0.510 - -36.25% -
471.omnetpp (max) (percentage) -10.27% 1.460 1.310 - -25.57% -
450.soplex (max) (percentage) -10.19% 1.570 1.410 - 147.37% -
401.bzip2 (max) -10.00% 10.000 9.000 - -81.25% -
471.omnetpp (max) -10.00% 40.000 36.000 - -80.95% -
482.sphinx3 (max) -10.00% 10.000 9.000 - -98.97% -
444.namd (max) (percentage) -7.22% 0.970 0.900 - -86.24% -
482.sphinx3 (max) (percentage) -6.78% 1.180 1.100 - -66.87% -
456.hmmer (max) (percentage) -6.25% 0.480 0.450 - 50.00% -
447.dealII (max) -5.88% 17.000 16.000 - -87.60% -
403.gcc (max) (percentage) -4.79% 4.380 4.170 - 997.37% -
470.lbm -4.17% 24.000 23.000 - -92.86% -
470.lbm (avg) -4.17% 24.000 23.000 - -92.86% -
447.dealII (avg) (percentage) -3.33% 0.600 0.580 - -60.54% -
453.povray (max) (percentage) -3.23% 0.620 0.600 - -68.91% -
447.dealII (max) (percentage) -3.12% 0.960 0.930 - -41.14% -
401.bzip2 (max) (percentage) -2.63% 0.380 0.370 - 19.35% -
464.h264ref (avg) (percentage) -2.56% 0.390 0.380 - 15.15% -
401.bzip2 (avg) (percentage) -2.00% 0.500 0.490 - 122.73% -
471.omnetpp (avg) (percentage) -1.40% 1.430 1.410 - 80.77% -
473.astar (avg) (percentage) -1.25% 0.800 0.790 - 58.00% -

Added Tests - sample variability
429.mcf (unexplained diff vs previous)
429.mcf (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.53% 39458.000 41641.000 - 0.00% -
450.soplex 1.93% 198708.000 202543.000 - 0.00% -
471.omnetpp 1.25% 373579.000 378232.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 2533.33% 0.120 3.160 0.000 54.90% 0.000
462.libquantum (max) (percentage) 1430.00% 0.200 3.060 - 47.12% -
403.gcc (max) (percentage) 997.37% 0.380 4.170 - -4.79% -
462.libquantum (avg) (percentage) 920.00% 0.150 1.530 - 1.32% -
403.gcc (avg) (percentage) 708.33% 0.480 3.880 - 0.00% -
450.soplex (avg) (percentage) 225.00% 0.360 1.170 - 0.00% -
429.mcf (avg) (percentage) 222.22% 0.450 1.450 - 0.00% -
429.mcf (max) (percentage) 194.64% 0.560 1.650 - 1169.23% -
429.mcf (unexplained diff vs previous) (percentage) 189.29% 0.560 1.620 0.000 0.00% 0.000
483.xalancbmk (avg) (percentage) 166.00% 0.500 1.330 - 0.00% -
450.soplex (max) (percentage) 147.37% 0.570 1.410 - -10.19% -
401.bzip2 (avg) (percentage) 122.73% 0.220 0.490 - -2.00% -
471.omnetpp (avg) (percentage) 80.77% 0.780 1.410 - -1.40% -
445.gobmk (avg) (percentage) 77.78% 0.180 0.320 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 70.18% 0.570 0.970 0.000 410.53% 0.000
445.gobmk (max) (percentage) 66.67% 0.240 0.400 - -16.67% -
473.astar (avg) (percentage) 58.00% 0.500 0.790 - -1.25% -
456.hmmer (max) (percentage) 50.00% 0.300 0.450 - -6.25% -
456.hmmer (avg) (percentage) 41.67% 0.360 0.510 - 0.00% -
401.bzip2 (max) (percentage) 19.35% 0.310 0.370 - -2.63% -
458.sjeng (unexplained diff vs previous) (percentage) 16.00% 0.250 0.290 0.000 1350.00% 0.000
464.h264ref (avg) (percentage) 15.15% 0.330 0.380 - -2.56% -
483.xalancbmk (max) (percentage) 6.15% 0.650 0.690 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -10.45% 26756.000 23959.000 - 0.00% -
433.milc -2.78% 74971.000 72890.000 - 0.00% -
453.povray -2.33% 593097.000 579291.000 - -0.01% -
447.dealII -2.07% 1777992.000 1741187.000 - 0.00% -
444.namd -1.34% 175160.000 172809.000 - 0.04% -
464.h264ref -1.23% 354618.000 350248.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.38% 9099.000 56.000 - -5.08% -
462.libquantum -99.28% 13126.000 95.000 - -3.06% -
482.sphinx3 -96.64% 26310.000 884.000 - 1.03% -
450.soplex -96.43% 14429.000 515.000 - -0.96% -
444.namd -94.65% 13495.000 722.000 - -0.41% -
453.povray -93.17% 6857.000 468.000 - -0.43% -
433.milc -91.48% 13482.000 1148.000 - 0.79% -
429.mcf -90.23% 11999.000 1172.000 - 1.65% -
401.bzip2 -82.87% 15683.000 2687.000 - -0.11% -
447.dealII -77.71% 8196.000 1827.000 - 0.00% -
470.lbm -77.28% 13882.000 3154.000 - -0.44% -
471.omnetpp -74.21% 10746.000 2771.000 - -0.14% -
456.hmmer -73.44% 13365.000 3550.000 - -0.17% -
473.astar -65.83% 14262.000 4873.000 - 0.00% -
464.h264ref -64.13% 15493.000 5558.000 - 0.05% -
445.gobmk -58.06% 12400.000 5200.000 - -0.12% -
458.sjeng -49.66% 16406.000 8259.000 - -0.29% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.32% 882.000 6.000 - -14.29% -
482.sphinx3 (unexplained diff vs previous) -99.00% 904.000 9.000 0.000 28.57% 0.000
482.sphinx3 (max) -98.97% 873.000 9.000 - -10.00% -
444.namd -98.83% 514.000 6.000 - 0.00% -
444.namd (avg) -98.83% 514.000 6.000 - 0.00% -
482.sphinx3 -98.57% 489.000 7.000 - 0.00% -
482.sphinx3 (avg) -98.57% 489.000 7.000 - 0.00% -
453.povray (max) -98.48% 132.000 2.000 - 0.00% -
470.lbm (max) -98.05% 769.000 15.000 - -11.76% -
470.lbm (unexplained diff vs previous) -97.18% 497.000 14.000 0.000 27.27% 0.000
453.povray -95.70% 93.000 4.000 - 0.00% -
453.povray (avg) -95.70% 93.000 4.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -95.65% 92.000 4.000 0.000 -80.95% 0.000
433.milc -95.59% 136.000 6.000 - 0.00% -
433.milc (avg) -95.59% 136.000 6.000 - 0.00% -
403.gcc -95.35% 43.000 2.000 - 0.00% -
403.gcc (avg) -95.35% 43.000 2.000 - 0.00% -
433.milc (max) -95.11% 184.000 9.000 - -18.18% -
433.milc (unexplained diff vs previous) -95.05% 182.000 9.000 0.000 -25.00% 0.000
464.h264ref (unexplained diff vs previous) -95.00% 60.000 3.000 0.000 0.00% 0.000
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
450.soplex (unexplained diff vs previous) -93.90% 82.000 5.000 0.000 400.00% 0.000
401.bzip2 (unexplained diff vs previous) -93.88% 49.000 3.000 0.000 50.00% 0.000
470.lbm -92.86% 322.000 23.000 - -4.17% -
470.lbm (avg) -92.86% 322.000 23.000 - -4.17% -
462.libquantum (max) -92.31% 26.000 2.000 - 0.00% -
447.dealII -91.67% 120.000 10.000 - 0.00% -
447.dealII (avg) -91.67% 120.000 10.000 - 0.00% -
450.soplex (max) -91.46% 82.000 7.000 - -12.50% -
470.lbm (max) (percentage) -90.97% 5.540 0.500 - -10.71% -
464.h264ref (max) -88.33% 60.000 7.000 - -22.22% -
450.soplex -88.24% 51.000 6.000 - 0.00% -
450.soplex (avg) -88.24% 51.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -87.71% 3.580 0.440 0.000 25.71% 0.000
447.dealII (max) -87.60% 129.000 16.000 - -5.88% -
464.h264ref (unexplained diff vs previous) (percentage) -87.18% 0.390 0.050 0.000 0.00% 0.000
444.namd (max) (percentage) -86.24% 6.540 0.900 - -7.22% -
471.omnetpp (unexplained diff vs previous) (percentage) -83.72% 0.860 0.140 0.000 -81.58% 0.000
401.bzip2 (max) -81.25% 48.000 9.000 - -10.00% -
462.libquantum (unexplained diff vs previous) -81.25% 16.000 3.000 0.000 50.00% 0.000
471.omnetpp (max) -80.95% 189.000 36.000 - -10.00% -
445.gobmk (unexplained diff vs previous) -80.00% 30.000 6.000 0.000 -76.00% 0.000
473.astar (max) -78.95% 114.000 24.000 - -11.11% -
444.namd (avg) (percentage) -75.07% 3.810 0.950 - 0.00% -
429.mcf (max) -71.64% 67.000 19.000 - 1800.00% -
429.mcf (unexplained diff vs previous) -71.64% 67.000 19.000 0.000 0.00% 0.000
482.sphinx3 (unexplained diff vs previous) (percentage) -70.35% 3.440 1.020 0.000 27.50% 0.000
429.mcf -69.81% 53.000 16.000 - 0.00% -
429.mcf (avg) -69.81% 53.000 16.000 - 0.00% -
453.povray (max) (percentage) -68.91% 1.930 0.600 - -3.23% -
458.sjeng -68.42% 95.000 30.000 - 0.00% -
458.sjeng (avg) -68.42% 95.000 30.000 - 0.00% -
470.lbm (avg) (percentage) -67.24% 2.320 0.760 - 0.00% -
482.sphinx3 (max) (percentage) -66.87% 3.320 1.100 - -6.78% -
401.bzip2 (unexplained diff vs previous) (percentage) -64.52% 0.310 0.110 0.000 57.14% 0.000
464.h264ref (max) (percentage) -64.10% 0.390 0.140 - -17.65% -
456.hmmer -62.50% 48.000 18.000 - 0.00% -
456.hmmer (avg) -62.50% 48.000 18.000 - 0.00% -
456.hmmer (max) -62.50% 40.000 15.000 - -11.76% -
401.bzip2 -61.76% 34.000 13.000 - 0.00% -
401.bzip2 (avg) -61.76% 34.000 13.000 - 0.00% -
447.dealII (avg) (percentage) -60.54% 1.470 0.580 - -3.33% -
464.h264ref -58.82% 51.000 21.000 - 0.00% -
464.h264ref (avg) -58.82% 51.000 21.000 - 0.00% -
471.omnetpp -53.01% 83.000 39.000 - 0.00% -
471.omnetpp (avg) -53.01% 83.000 39.000 - 0.00% -
482.sphinx3 (avg) (percentage) -52.69% 1.860 0.880 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) -50.00% 0.240 0.120 0.000 -75.00% 0.000
458.sjeng (max) -49.23% 65.000 33.000 - 0.00% -
473.astar -46.48% 71.000 38.000 - 0.00% -
473.astar (avg) -46.48% 71.000 38.000 - 0.00% -
433.milc (avg) (percentage) -43.56% 1.010 0.570 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -42.22% 1.350 0.780 0.000 -25.71% 0.000
458.sjeng (unexplained diff vs previous) -41.46% 41.000 24.000 0.000 1100.00% 0.000
447.dealII (max) (percentage) -41.14% 1.580 0.930 - -3.12% -
433.milc (max) (percentage) -36.50% 1.370 0.870 - -16.35% -
473.astar (max) (percentage) -36.25% 0.800 0.510 - -10.53% -
458.sjeng (avg) (percentage) -36.21% 0.580 0.370 - 0.00% -
445.gobmk (max) -31.03% 29.000 20.000 - -16.67% -
445.gobmk -27.27% 22.000 16.000 - 0.00% -
445.gobmk (avg) -27.27% 22.000 16.000 - 0.00% -
471.omnetpp (max) (percentage) -25.57% 1.760 1.310 - -10.27% -
453.povray (avg) (percentage) -23.36% 1.370 1.050 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
473.astar (unexplained diff vs previous)
473.astar (unexplained diff vs previous) (percentage)


Report Time: 0.41s
Name Current %
401.bzip2 2687.000 -
403.gcc 56.000 -5.08%
429.mcf 1172.000 1.65%
433.milc 1148.000 -
444.namd 722.000 -
445.gobmk 5200.000 -
447.dealII 1827.000 -
450.soplex 515.000 -
453.povray 468.000 -
456.hmmer 3550.000 -
458.sjeng 8259.000 -
462.libquantum 95.000 -3.06%
464.h264ref 5558.000 -
470.lbm 3154.000 -
471.omnetpp 2771.000 -
473.astar 4873.000 -
482.sphinx3 884.000 1.03%
Geometric Mean 1363.697 -
Name Current %
401.bzip2 41641.000 -
403.gcc 1955789.000 -
429.mcf 7958.000 -
433.milc 72890.000 -
444.namd 172809.000 -
445.gobmk 1308860.000 -
447.dealII 1741187.000 -
450.soplex 202543.000 -
453.povray 579291.000 -
456.hmmer 167654.000 -
458.sjeng 96961.000 -
462.libquantum 23959.000 -
464.h264ref 350248.000 -
470.lbm 9714.000 -
471.omnetpp 378232.000 -
473.astar 23351.000 -
482.sphinx3 115267.000 -
Geometric Mean 139713.574 -
Name Current %
401.bzip2 13.000 -
401.bzip2 (avg) 13.000 -
401.bzip2 (avg) (percentage) 0.490 -2.00%
401.bzip2 (max) 9.000 -10.00%
401.bzip2 (max) (percentage) 0.370 -2.63%
401.bzip2 (unexplained diff vs previous) 3.000 50.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 57.14%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.880 -
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.170 -4.79%
429.mcf 16.000 -
429.mcf (avg) 16.000 -
429.mcf (avg) (percentage) 1.450 -
429.mcf (max) 19.000 1800.00%
429.mcf (max) (percentage) 1.650 1169.23%
429.mcf (unexplained diff vs previous) 19.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.620 -
433.milc 6.000 -
433.milc (avg) 6.000 -
433.milc (avg) (percentage) 0.570 -
433.milc (max) 9.000 -18.18%
433.milc (max) (percentage) 0.870 -16.35%
433.milc (unexplained diff vs previous) 9.000 -25.00%
433.milc (unexplained diff vs previous) (percentage) 0.780 -25.71%
444.namd 6.000 -
444.namd (avg) 6.000 -
444.namd (avg) (percentage) 0.950 -
444.namd (max) 6.000 -14.29%
444.namd (max) (percentage) 0.900 -7.22%
445.gobmk 16.000 -
445.gobmk (avg) 16.000 -
445.gobmk (avg) (percentage) 0.320 -
445.gobmk (max) 20.000 -16.67%
445.gobmk (max) (percentage) 0.400 -16.67%
445.gobmk (unexplained diff vs previous) 6.000 -76.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.120 -75.00%
447.dealII 10.000 -
447.dealII (avg) 10.000 -
447.dealII (avg) (percentage) 0.580 -3.33%
447.dealII (max) 16.000 -5.88%
447.dealII (max) (percentage) 0.930 -3.12%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.170 -
450.soplex (max) 7.000 -12.50%
450.soplex (max) (percentage) 1.410 -10.19%
450.soplex (unexplained diff vs previous) 5.000 400.00%
450.soplex (unexplained diff vs previous) (percentage) 0.970 410.53%
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.050 -
453.povray (max) 2.000 -
453.povray (max) (percentage) 0.600 -3.23%
456.hmmer 18.000 -
456.hmmer (avg) 18.000 -
456.hmmer (avg) (percentage) 0.510 -
456.hmmer (max) 15.000 -11.76%
456.hmmer (max) (percentage) 0.450 -6.25%
458.sjeng 30.000 -
458.sjeng (avg) 30.000 -
458.sjeng (avg) (percentage) 0.370 -
458.sjeng (max) 33.000 -
458.sjeng (max) (percentage) 0.400 -
458.sjeng (unexplained diff vs previous) 24.000 1100.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.290 1350.00%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.530 1.32%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 3.060 47.12%
462.libquantum (unexplained diff vs previous) 3.000 50.00%
462.libquantum (unexplained diff vs previous) (percentage) 3.160 54.90%
464.h264ref 21.000 -
464.h264ref (avg) 21.000 -
464.h264ref (avg) (percentage) 0.380 -2.56%
464.h264ref (max) 7.000 -22.22%
464.h264ref (max) (percentage) 0.140 -17.65%
464.h264ref (unexplained diff vs previous) 3.000 -
464.h264ref (unexplained diff vs previous) (percentage) 0.050 -
470.lbm 23.000 -4.17%
470.lbm (avg) 23.000 -4.17%
470.lbm (avg) (percentage) 0.760 -
470.lbm (max) 15.000 -11.76%
470.lbm (max) (percentage) 0.500 -10.71%
470.lbm (unexplained diff vs previous) 14.000 27.27%
470.lbm (unexplained diff vs previous) (percentage) 0.440 25.71%
471.omnetpp 39.000 -
471.omnetpp (avg) 39.000 -
471.omnetpp (avg) (percentage) 1.410 -1.40%
471.omnetpp (max) 36.000 -10.00%
471.omnetpp (max) (percentage) 1.310 -10.27%
471.omnetpp (unexplained diff vs previous) 4.000 -80.95%
471.omnetpp (unexplained diff vs previous) (percentage) 0.140 -81.58%
473.astar 38.000 -
473.astar (avg) 38.000 -
473.astar (avg) (percentage) 0.790 -1.25%
473.astar (max) 24.000 -11.11%
473.astar (max) (percentage) 0.510 -10.53%
473.astar (unexplained diff vs previous) 0.000 -
473.astar (unexplained diff vs previous) (percentage) 0.000 -
482.sphinx3 7.000 -
482.sphinx3 (avg) 7.000 -
482.sphinx3 (avg) (percentage) 0.880 -
482.sphinx3 (max) 9.000 -10.00%
482.sphinx3 (max) (percentage) 1.100 -6.78%
482.sphinx3 (unexplained diff vs previous) 9.000 28.57%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.020 27.50%
483.xalancbmk (avg) (percentage) 1.330 -
483.xalancbmk (max) (percentage) 0.690 -
Geometric Mean 2.115 -27.88%