Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/6f64a600649a95141526043b170aa4244d54c94b (+ 762 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/259/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0259 (llvmorg-21-init-14077-g6f64a600649a) 2025-05-28T05:17:41 0:00:00
Previous 0258 (llvmorg-21-init-13315-ge015626f189d) 2025-05-22T09:07:00 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 16 14
Performance Improvements 48 128
Added Tests 0 2
Unchanged Tests 704 624
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
473.astar (unexplained diff vs previous) 266.67% 3.000 11.000 - -56.00% -
473.astar (unexplained diff vs previous) (percentage) 242.86% 0.070 0.240 - 20.00% -
471.omnetpp (unexplained diff vs previous) 53.85% 13.000 20.000 - -80.58% -
471.omnetpp (unexplained diff vs previous) (percentage) 51.06% 0.470 0.710 - -27.55% -
450.soplex (unexplained diff vs previous) 33.33% 3.000 4.000 - -94.20% -
456.hmmer (unexplained diff vs previous) 33.33% 6.000 8.000 - -82.61% -
450.soplex (unexplained diff vs previous) (percentage) 33.33% 0.540 0.720 - 56.52% -
456.hmmer (unexplained diff vs previous) (percentage) 31.25% 0.160 0.210 - -46.15% -
470.lbm (max) 18.18% 11.000 13.000 - -98.28% -
470.lbm (unexplained diff vs previous) 16.67% 12.000 14.000 - -98.26% -
470.lbm (max) (percentage) 16.67% 0.300 0.350 - -93.88% -
470.lbm (unexplained diff vs previous) (percentage) 16.67% 0.300 0.350 - -94.22% -
464.h264ref (unexplained diff vs previous) 14.29% 7.000 8.000 - 0.00% -
473.astar (max) 10.00% 10.000 11.000 - -98.66% -
473.astar (max) (percentage) 9.09% 0.220 0.240 - -96.42% -
464.h264ref (unexplained diff vs previous) (percentage) 8.33% 0.120 0.130 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -11.86% 59.000 52.000 - -99.45% -
462.libquantum -2.67% 187.000 182.000 - -98.74% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) -87.50% 8.000 1.000 - -95.45% -
429.mcf (unexplained diff vs previous) (percentage) -87.14% 0.700 0.090 - -43.75% -
444.namd (unexplained diff vs previous) (percentage) -83.78% 0.740 0.120 - 100.00% -
444.namd (unexplained diff vs previous) -83.33% 6.000 1.000 - -87.50% -
482.sphinx3 (unexplained diff vs previous) (percentage) -70.30% 1.010 0.300 - -91.25% -
482.sphinx3 (unexplained diff vs previous) -70.00% 10.000 3.000 - -99.67% -
433.milc (unexplained diff vs previous) -66.67% 3.000 1.000 - -92.31% -
433.milc (unexplained diff vs previous) (percentage) -65.38% 0.260 0.090 - -10.00% -
453.povray (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) -50.00% 0.400 0.200 - 0.00% -
462.libquantum (max) -28.57% 7.000 5.000 - -99.46% -
462.libquantum (unexplained diff vs previous) -28.57% 7.000 5.000 - 400.00% -
462.libquantum (unexplained diff vs previous) (percentage) -26.47% 3.740 2.750 - 27400.00% -
462.libquantum (max) (percentage) -24.94% 3.890 2.920 - -54.23% -
447.dealII (max) -21.43% 14.000 11.000 - -95.07% -
401.bzip2 (max) -16.67% 6.000 5.000 - -99.18% -
447.dealII (max) (percentage) -15.28% 0.720 0.610 - -74.37% -
447.dealII (unexplained diff vs previous) -14.29% 14.000 12.000 - -77.78% -
447.dealII (unexplained diff vs previous) (percentage) -12.68% 0.710 0.620 - 6.90% -
429.mcf (max) -12.50% 8.000 7.000 - -99.69% -
482.sphinx3 -12.50% 8.000 7.000 - -98.49% -
482.sphinx3 (avg) -12.50% 8.000 7.000 - -98.49% -
458.sjeng (max) (percentage) -11.76% 0.340 0.300 - -94.16% -
458.sjeng (max) -11.11% 27.000 24.000 - -97.26% -
482.sphinx3 (max) -11.11% 18.000 16.000 - -98.19% -
429.mcf (max) (percentage) -10.96% 0.730 0.650 - -96.01% -
444.namd (max) (percentage) -9.76% 0.820 0.740 - -90.85% -
456.hmmer (max) (percentage) -8.57% 0.350 0.320 - -96.95% -
482.sphinx3 (max) (percentage) -8.51% 1.880 1.720 - -48.04% -
445.gobmk (max) -7.69% 13.000 12.000 - -97.09% -
456.hmmer (max) -7.69% 13.000 12.000 - -99.03% -
429.mcf -7.14% 14.000 13.000 - -95.61% -
429.mcf (avg) -7.14% 14.000 13.000 - -95.61% -
471.omnetpp (max) -7.14% 56.000 52.000 - -94.65% -
471.omnetpp (max) (percentage) -6.93% 2.020 1.880 - -79.74% -
450.soplex (max) (percentage) -6.45% 1.240 1.160 - -29.70% -
433.milc (max) (percentage) -6.25% 0.320 0.300 - -62.50% -
464.h264ref (max) (percentage) -5.88% 0.340 0.320 - -23.81% -
464.h264ref (max) -5.00% 20.000 19.000 - -68.33% -
453.povray (max) (percentage) -4.57% 1.750 1.670 - 363.89% -
401.bzip2 (max) (percentage) -4.55% 0.220 0.210 - -94.44% -
445.gobmk (max) (percentage) -3.70% 0.270 0.260 - -93.03% -
403.gcc (max) (percentage) -3.27% 10.100 9.770 - 319.31% -
453.povray (avg) (percentage) -1.96% 1.020 1.000 - 25.00% -
429.mcf (avg) (percentage) -1.61% 1.240 1.220 - -42.45% -
433.milc (avg) (percentage) -1.39% 0.720 0.710 - -17.44% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 27400.00% 0.010 2.750 - -26.47% -
403.gcc (avg) (percentage) 607.27% 0.550 3.890 - 0.00% -
462.libquantum (unexplained diff vs previous) 400.00% 1.000 5.000 - -28.57% -
453.povray (max) (percentage) 363.89% 0.360 1.670 - -4.57% -
403.gcc (max) (percentage) 319.31% 2.330 9.770 - -3.27% -
450.soplex (avg) (percentage) 152.00% 0.500 1.260 - -0.79% -
462.libquantum (avg) (percentage) 105.19% 0.770 1.580 - 0.64% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.060 0.120 - -83.78% -
450.soplex (unexplained diff vs previous) (percentage) 56.52% 0.460 0.720 - 33.33% -
453.povray (avg) (percentage) 25.00% 0.800 1.000 - -1.96% -
473.astar (unexplained diff vs previous) (percentage) 20.00% 0.200 0.240 - 242.86% -
447.dealII (unexplained diff vs previous) (percentage) 6.90% 0.580 0.620 - -12.68% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.48% 7239.000 6915.000 - 0.00% -
462.libquantum -2.95% 12504.000 12135.000 - 0.00% -
433.milc -2.41% 47001.000 45869.000 - 0.00% -
453.povray -2.35% 524493.000 512190.000 - 0.00% -
447.dealII -2.23% 195792.000 191430.000 - 0.00% -
444.namd -1.86% 124963.000 122635.000 - 0.00% -
464.h264ref -1.79% 303767.000 298329.000 - 0.00% -
401.bzip2 -1.59% 33698.000 33161.000 - 0.00% -
456.hmmer -1.35% 80861.000 79769.000 - 0.00% -
470.lbm -1.35% 9338.000 9212.000 - 0.00% -
458.sjeng -1.25% 80297.000 79291.000 - -0.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.45% 9509.000 52.000 - -11.86% -
462.libquantum -98.74% 14409.000 182.000 - -2.67% -
450.soplex -96.33% 15112.000 555.000 - 0.73% -
482.sphinx3 -96.31% 26682.000 985.000 - -0.30% -
444.namd -93.46% 12400.000 811.000 - -0.12% -
453.povray -92.83% 6987.000 501.000 - 0.20% -
429.mcf -91.84% 13988.000 1142.000 - 0.09% -
433.milc -91.41% 13601.000 1168.000 - -0.09% -
401.bzip2 -82.36% 16137.000 2846.000 - 0.18% -
447.dealII -79.21% 9380.000 1950.000 - -0.61% -
471.omnetpp -73.22% 10477.000 2806.000 - 0.72% -
470.lbm -70.00% 13259.000 3978.000 - -0.35% -
456.hmmer -67.83% 11854.000 3813.000 - 0.21% -
473.astar -62.47% 12272.000 4606.000 - 0.24% -
464.h264ref -58.56% 14498.000 6008.000 - -0.13% -
445.gobmk -56.34% 11093.000 4843.000 - -0.08% -
458.sjeng -52.29% 17055.000 8137.000 - -0.09% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
429.mcf (max) -99.69% 2281.000 7.000 - -12.50% -
482.sphinx3 (unexplained diff vs previous) -99.67% 914.000 3.000 - -70.00% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
462.libquantum (max) -99.46% 919.000 5.000 - -28.57% -
444.namd (max) -99.40% 1003.000 6.000 - 0.00% -
401.bzip2 (max) -99.18% 609.000 5.000 - -16.67% -
456.hmmer (max) -99.03% 1242.000 12.000 - -7.69% -
473.astar (max) -98.66% 822.000 11.000 - 10.00% -
482.sphinx3 -98.49% 464.000 7.000 - -12.50% -
482.sphinx3 (avg) -98.49% 464.000 7.000 - -12.50% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
470.lbm (max) -98.28% 758.000 13.000 - 18.18% -
470.lbm (unexplained diff vs previous) -98.26% 804.000 14.000 - 16.67% -
482.sphinx3 (max) -98.19% 883.000 16.000 - -11.11% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
403.gcc (max) -97.74% 221.000 5.000 - 0.00% -
450.soplex (max) -97.59% 249.000 6.000 - 0.00% -
458.sjeng (max) -97.26% 876.000 24.000 - -11.11% -
433.milc (max) -97.22% 108.000 3.000 - 0.00% -
445.gobmk (max) -97.09% 413.000 12.000 - -7.69% -
456.hmmer (max) (percentage) -96.95% 10.480 0.320 - -8.57% -
473.astar (max) (percentage) -96.42% 6.700 0.240 - 9.09% -
403.gcc -96.15% 52.000 2.000 - 0.00% -
403.gcc (avg) -96.15% 52.000 2.000 - 0.00% -
429.mcf (max) (percentage) -96.01% 16.310 0.650 - -10.96% -
429.mcf -95.61% 296.000 13.000 - -7.14% -
429.mcf (avg) -95.61% 296.000 13.000 - -7.14% -
429.mcf (unexplained diff vs previous) -95.45% 22.000 1.000 - -87.50% -
470.lbm -95.24% 441.000 21.000 - 0.00% -
470.lbm (avg) -95.24% 441.000 21.000 - 0.00% -
447.dealII (max) -95.07% 223.000 11.000 - -21.43% -
471.omnetpp (max) -94.65% 972.000 52.000 - -7.14% -
401.bzip2 (max) (percentage) -94.44% 3.780 0.210 - -4.55% -
470.lbm (unexplained diff vs previous) (percentage) -94.22% 6.060 0.350 - 16.67% -
450.soplex (unexplained diff vs previous) -94.20% 69.000 4.000 - 33.33% -
458.sjeng (max) (percentage) -94.16% 5.140 0.300 - -11.76% -
470.lbm (max) (percentage) -93.88% 5.720 0.350 - 16.67% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
445.gobmk (max) (percentage) -93.03% 3.730 0.260 - -3.70% -
433.milc (unexplained diff vs previous) -92.31% 13.000 1.000 - -66.67% -
450.soplex -92.00% 75.000 6.000 - 0.00% -
450.soplex (avg) -92.00% 75.000 6.000 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) -91.25% 3.430 0.300 - -70.30% -
453.povray -90.91% 55.000 5.000 - 0.00% -
453.povray (avg) -90.91% 55.000 5.000 - 0.00% -
444.namd (max) (percentage) -90.85% 8.090 0.740 - -9.76% -
401.bzip2 -88.46% 104.000 12.000 - 0.00% -
401.bzip2 (avg) -88.46% 104.000 12.000 - 0.00% -
444.namd (unexplained diff vs previous) -87.50% 8.000 1.000 - -83.33% -
456.hmmer -87.20% 164.000 21.000 - 0.00% -
456.hmmer (avg) -87.20% 164.000 21.000 - 0.00% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 - 0.00% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -83.48% 3.330 0.550 - 0.00% -
458.sjeng -83.09% 136.000 23.000 - 0.00% -
458.sjeng (avg) -83.09% 136.000 23.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -82.61% 46.000 8.000 - 33.33% -
473.astar -82.14% 112.000 20.000 - 0.00% -
473.astar (avg) -82.14% 112.000 20.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) -80.58% 103.000 20.000 - 53.85% -
471.omnetpp (max) (percentage) -79.74% 9.280 1.880 - -6.93% -
471.omnetpp -79.64% 167.000 34.000 - 0.00% -
471.omnetpp (avg) -79.64% 167.000 34.000 - 0.00% -
447.dealII (unexplained diff vs previous) -77.78% 54.000 12.000 - -14.29% -
447.dealII (max) (percentage) -74.37% 2.380 0.610 - -15.28% -
444.namd (avg) (percentage) -73.54% 2.570 0.680 - -1.45% -
464.h264ref -71.43% 42.000 12.000 - 0.00% -
464.h264ref (avg) -71.43% 42.000 12.000 - 0.00% -
464.h264ref (max) -68.33% 60.000 19.000 - -5.00% -
453.povray (max) -68.00% 25.000 8.000 - 0.00% -
458.sjeng (avg) (percentage) -63.75% 0.800 0.290 - 0.00% -
433.milc (max) (percentage) -62.50% 0.800 0.300 - -6.25% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 0.00% -
456.hmmer (avg) (percentage) -59.71% 1.390 0.560 - 0.00% -
473.astar (unexplained diff vs previous) -56.00% 25.000 11.000 - 266.67% -
462.libquantum (max) (percentage) -54.23% 6.380 2.920 - -24.94% -
482.sphinx3 (avg) (percentage) -53.45% 1.740 0.810 - -1.22% -
473.astar (avg) (percentage) -52.17% 0.920 0.440 - 0.00% -
482.sphinx3 (max) (percentage) -48.04% 3.310 1.720 - -8.51% -
456.hmmer (unexplained diff vs previous) (percentage) -46.15% 0.390 0.210 - 31.25% -
429.mcf (unexplained diff vs previous) (percentage) -43.75% 0.160 0.090 - -87.14% -
429.mcf (avg) (percentage) -42.45% 2.120 1.220 - -1.61% -
401.bzip2 (avg) (percentage) -33.85% 0.650 0.430 - 0.00% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
447.dealII (avg) (percentage) -31.43% 1.050 0.720 - 0.00% -
450.soplex (max) (percentage) -29.70% 1.650 1.160 - -6.45% -
464.h264ref (avg) (percentage) -27.59% 0.290 0.210 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -27.55% 0.980 0.710 - 51.06% -
464.h264ref (max) (percentage) -23.81% 0.420 0.320 - -5.88% -
471.omnetpp (avg) (percentage) -22.50% 1.600 1.240 - -0.80% -
433.milc (avg) (percentage) -17.44% 0.860 0.710 - -1.39% -
401.bzip2 (unexplained diff vs previous) (percentage) -10.00% 0.200 0.180 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -10.00% 0.100 0.090 - -65.38% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
401.bzip2 2846.000 -
403.gcc 52.000 -11.86%
429.mcf 1142.000 -
433.milc 1168.000 -
444.namd 811.000 -
445.gobmk 4843.000 -
447.dealII 1950.000 -
450.soplex 555.000 -
453.povray 501.000 -
456.hmmer 3813.000 -
458.sjeng 8137.000 -
462.libquantum 182.000 -2.67%
464.h264ref 6008.000 -
470.lbm 3978.000 -
471.omnetpp 2806.000 -
473.astar 4606.000 -
482.sphinx3 985.000 -
Geometric Mean 1472.850 -
Code Size (bytes)
Name Current %
401.bzip2 33161.000 -
403.gcc 1653300.000 -
429.mcf 6915.000 -
433.milc 45869.000 -
444.namd 122635.000 -
445.gobmk 1255937.000 -
447.dealII 191430.000 -
450.soplex 146412.000 -
453.povray 512190.000 -
456.hmmer 79769.000 -
458.sjeng 79291.000 -
462.libquantum 12135.000 -
464.h264ref 298329.000 -
470.lbm 9212.000 -
471.omnetpp 317466.000 -
473.astar 15583.000 -
482.sphinx3 87400.000 -
Geometric Mean 94021.956 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.430 -
401.bzip2 (max) 5.000 -16.67%
401.bzip2 (max) (percentage) 0.210 -4.55%
401.bzip2 (unexplained diff vs previous) 5.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.180 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.890 -
403.gcc (max) 5.000 -
403.gcc (max) (percentage) 9.770 -3.27%
429.mcf 13.000 -7.14%
429.mcf (avg) 13.000 -7.14%
429.mcf (avg) (percentage) 1.220 -1.61%
429.mcf (max) 7.000 -12.50%
429.mcf (max) (percentage) 0.650 -10.96%
429.mcf (unexplained diff vs previous) 1.000 -87.50%
429.mcf (unexplained diff vs previous) (percentage) 0.090 -87.14%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.710 -1.39%
433.milc (max) 3.000 -
433.milc (max) (percentage) 0.300 -6.25%
433.milc (unexplained diff vs previous) 1.000 -66.67%
433.milc (unexplained diff vs previous) (percentage) 0.090 -65.38%
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.680 -
444.namd (max) 6.000 -
444.namd (max) (percentage) 0.740 -9.76%
444.namd (unexplained diff vs previous) 1.000 -83.33%
444.namd (unexplained diff vs previous) (percentage) 0.120 -83.78%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 -
445.gobmk (max) 12.000 -7.69%
445.gobmk (max) (percentage) 0.260 -3.70%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.720 -
447.dealII (max) 11.000 -21.43%
447.dealII (max) (percentage) 0.610 -15.28%
447.dealII (unexplained diff vs previous) 12.000 -14.29%
447.dealII (unexplained diff vs previous) (percentage) 0.620 -12.68%
450.soplex 6.000 -
450.soplex (avg) 6.000 -
450.soplex (avg) (percentage) 1.260 -
450.soplex (max) 6.000 -
450.soplex (max) (percentage) 1.160 -6.45%
450.soplex (unexplained diff vs previous) 4.000 33.33%
450.soplex (unexplained diff vs previous) (percentage) 0.720 33.33%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.000 -1.96%
453.povray (max) 8.000 -
453.povray (max) (percentage) 1.670 -4.57%
453.povray (unexplained diff vs previous) 1.000 -50.00%
453.povray (unexplained diff vs previous) (percentage) 0.200 -50.00%
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.560 -
456.hmmer (max) 12.000 -7.69%
456.hmmer (max) (percentage) 0.320 -8.57%
456.hmmer (unexplained diff vs previous) 8.000 33.33%
456.hmmer (unexplained diff vs previous) (percentage) 0.210 31.25%
458.sjeng 23.000 -
458.sjeng (avg) 23.000 -
458.sjeng (avg) (percentage) 0.290 -
458.sjeng (max) 24.000 -11.11%
458.sjeng (max) (percentage) 0.300 -11.76%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.580 -
462.libquantum (max) 5.000 -28.57%
462.libquantum (max) (percentage) 2.920 -24.94%
462.libquantum (unexplained diff vs previous) 5.000 -28.57%
462.libquantum (unexplained diff vs previous) (percentage) 2.750 -26.47%
464.h264ref 12.000 -
464.h264ref (avg) 12.000 -
464.h264ref (avg) (percentage) 0.210 -
464.h264ref (max) 19.000 -5.00%
464.h264ref (max) (percentage) 0.320 -5.88%
464.h264ref (unexplained diff vs previous) 8.000 14.29%
464.h264ref (unexplained diff vs previous) (percentage) 0.130 8.33%
470.lbm 21.000 -
470.lbm (avg) 21.000 -
470.lbm (avg) (percentage) 0.550 -
470.lbm (max) 13.000 18.18%
470.lbm (max) (percentage) 0.350 16.67%
470.lbm (unexplained diff vs previous) 14.000 16.67%
470.lbm (unexplained diff vs previous) (percentage) 0.350 16.67%
471.omnetpp 34.000 -
471.omnetpp (avg) 34.000 -
471.omnetpp (avg) (percentage) 1.240 -
471.omnetpp (max) 52.000 -7.14%
471.omnetpp (max) (percentage) 1.880 -6.93%
471.omnetpp (unexplained diff vs previous) 20.000 53.85%
471.omnetpp (unexplained diff vs previous) (percentage) 0.710 51.06%
473.astar 20.000 -
473.astar (avg) 20.000 -
473.astar (avg) (percentage) 0.440 -
473.astar (max) 11.000 10.00%
473.astar (max) (percentage) 0.240 9.09%
473.astar (unexplained diff vs previous) 11.000 266.67%
473.astar (unexplained diff vs previous) (percentage) 0.240 242.86%
482.sphinx3 7.000 -12.50%
482.sphinx3 (avg) 7.000 -12.50%
482.sphinx3 (avg) (percentage) 0.810 -
482.sphinx3 (max) 16.000 -11.11%
482.sphinx3 (max) (percentage) 1.720 -8.51%
482.sphinx3 (unexplained diff vs previous) 3.000 -70.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.300 -70.30%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 2.482 -10.24%