Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/af2a957ce30e3d91e17e2194e4be0a6b6481e4ba (+ 760 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Oz_LTO-build/257/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0257 (llvmorg-21-init-13110-gaf2a957ce30e) 2025-05-17T13:15:42 0:00:00
Previous 0255 (llvmorg-21-init-12350-gd08833f23fc8) 2025-05-10T17:54:16 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 30 15
Performance Improvements 40 123
Added Tests 0 4
Unchanged Tests 698 626
Total Tests 768

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 2.15% 977.000 998.000 - -96.26% -
471.omnetpp 1.86% 2748.000 2799.000 - -73.28% -
453.povray 1.43% 491.000 498.000 - -92.87% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (unexplained diff vs previous) (percentage) 2200.00% 0.020 0.460 - 0.00% -
458.sjeng (unexplained diff vs previous) 1750.00% 2.000 37.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 660.00% 0.050 0.380 - -93.73% -
470.lbm (unexplained diff vs previous) 650.00% 2.000 15.000 - -98.13% -
458.sjeng (max) 350.00% 8.000 36.000 - -95.89% -
458.sjeng (max) (percentage) 350.00% 0.100 0.450 - -91.25% -
473.astar (unexplained diff vs previous) 250.00% 4.000 14.000 - -44.00% -
473.astar (unexplained diff vs previous) (percentage) 233.33% 0.090 0.300 - 50.00% -
482.sphinx3 (max) 50.00% 14.000 21.000 - -97.62% -
473.astar (max) (percentage) 50.00% 0.200 0.300 - -95.52% -
473.astar (max) 44.44% 9.000 13.000 - -98.42% -
482.sphinx3 (max) (percentage) 42.38% 1.510 2.150 - -35.05% -
482.sphinx3 (unexplained diff vs previous) 40.00% 15.000 21.000 - -97.70% -
429.mcf (unexplained diff vs previous) 37.50% 8.000 11.000 - -50.00% -
429.mcf (unexplained diff vs previous) (percentage) 37.14% 0.700 0.960 - 500.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 36.36% 1.540 2.100 - -38.78% -
470.lbm (max) 15.38% 13.000 15.000 - -98.02% -
482.sphinx3 14.29% 7.000 8.000 - -98.28% -
482.sphinx3 (avg) 14.29% 7.000 8.000 - -98.28% -
470.lbm (max) (percentage) 8.57% 0.350 0.380 - -93.36% -
456.hmmer (unexplained diff vs previous) 7.14% 14.000 15.000 - -67.39% -
456.hmmer (max) (percentage) 5.41% 0.370 0.390 - -96.28% -
456.hmmer (unexplained diff vs previous) (percentage) 5.41% 0.370 0.390 - 0.00% -
471.omnetpp 2.94% 34.000 35.000 - -79.04% -
471.omnetpp (avg) 2.94% 34.000 35.000 - -79.04% -
482.sphinx3 (avg) (percentage) 2.53% 0.790 0.810 - -53.45% -
462.libquantum (unexplained diff vs previous) (percentage) 2.30% 2.170 2.220 - 22100.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
462.libquantum -2.17% 184.000 180.000 - -98.75% -
403.gcc -1.72% 58.000 57.000 - -99.40% -
450.soplex -1.26% 555.000 548.000 - -96.37% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -94.44% 18.000 1.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) -93.33% 0.300 0.020 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) -34.30% 2.770 1.820 - 85.71% -
471.omnetpp (unexplained diff vs previous) -32.89% 76.000 51.000 - -50.49% -
453.povray (unexplained diff vs previous) (percentage) -30.88% 2.040 1.410 - 0.00% -
453.povray (unexplained diff vs previous) -30.00% 10.000 7.000 - 0.00% -
433.milc (max) -25.00% 4.000 3.000 - -97.22% -
462.libquantum (max) -25.00% 4.000 3.000 - -99.67% -
444.namd (max) (percentage) -21.43% 1.260 0.990 - -87.76% -
444.namd (max) -20.00% 10.000 8.000 - -99.20% -
471.omnetpp (max) (percentage) -16.73% 2.690 2.240 - -75.86% -
401.bzip2 (unexplained diff vs previous) -16.67% 6.000 5.000 - -84.85% -
445.gobmk (unexplained diff vs previous) -16.67% 12.000 10.000 - -75.00% -
445.gobmk (unexplained diff vs previous) (percentage) -16.00% 0.250 0.210 - -41.67% -
471.omnetpp (max) -15.07% 73.000 62.000 - -93.62% -
401.bzip2 (max) (percentage) -14.81% 0.270 0.230 - -93.92% -
401.bzip2 (max) -14.29% 7.000 6.000 - -99.01% -
401.bzip2 (unexplained diff vs previous) (percentage) -14.29% 0.210 0.180 - -10.00% -
429.mcf (max) -14.29% 14.000 12.000 - -99.47% -
444.namd (unexplained diff vs previous) (percentage) -11.71% 1.110 0.980 - 1533.33% -
429.mcf (max) (percentage) -11.29% 1.240 1.100 - -93.26% -
444.namd (unexplained diff vs previous) -11.11% 9.000 8.000 - 0.00% -
450.soplex (max) -11.11% 9.000 8.000 - -96.79% -
447.dealII (max) -9.09% 11.000 10.000 - -95.52% -
464.h264ref (max) -8.70% 23.000 21.000 - -65.00% -
433.milc (max) (percentage) -8.11% 0.370 0.340 - -57.50% -
464.h264ref (max) (percentage) -7.69% 0.390 0.360 - -14.29% -
445.gobmk (max) -7.14% 14.000 13.000 - -96.85% -
453.povray (max) (percentage) -7.00% 2.000 1.860 - 416.67% -
447.dealII (max) (percentage) -6.90% 0.580 0.540 - -77.31% -
445.gobmk (max) (percentage) -6.67% 0.300 0.280 - -92.49% -
450.soplex (max) (percentage) -6.06% 1.650 1.550 - -6.06% -
470.lbm -4.55% 22.000 21.000 - -95.24% -
470.lbm (avg) -4.55% 22.000 21.000 - -95.24% -
403.gcc (max) (percentage) -3.05% 11.160 10.820 - 364.38% -
462.libquantum (max) (percentage) -2.25% 2.220 2.170 - -65.99% -
470.lbm (avg) (percentage) -1.79% 0.560 0.550 - -83.48% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 22100.00% 0.010 2.220 - 2.30% -
444.namd (unexplained diff vs previous) (percentage) 1533.33% 0.060 0.980 - -11.71% -
403.gcc (avg) (percentage) 609.09% 0.550 3.900 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 500.00% 0.160 0.960 - 37.14% -
453.povray (max) (percentage) 416.67% 0.360 1.860 - -7.00% -
403.gcc (max) (percentage) 364.38% 2.330 10.820 - -3.05% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 160.00% 0.100 0.260 - 0.00% -
450.soplex (avg) (percentage) 156.00% 0.500 1.280 - 0.00% -
462.libquantum (avg) (percentage) 100.00% 0.770 1.540 - 0.65% -
471.omnetpp (unexplained diff vs previous) (percentage) 85.71% 0.980 1.820 - -34.30% -
473.astar (unexplained diff vs previous) (percentage) 50.00% 0.200 0.300 - 233.33% -
453.povray (avg) (percentage) 30.00% 0.800 1.040 - 0.97% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.56% 18.000 17.000 - 0.00% -
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
429.mcf -4.48% 7239.000 6915.000 - 0.00% -
462.libquantum -2.95% 12504.000 12135.000 - 0.00% -
433.milc -2.41% 47001.000 45869.000 - 0.00% -
453.povray -2.35% 524493.000 512190.000 - 0.00% -
447.dealII -2.23% 195792.000 191430.000 - -0.01% -
444.namd -1.86% 124963.000 122635.000 - 0.00% -
464.h264ref -1.79% 303767.000 298329.000 - 0.00% -
401.bzip2 -1.59% 33698.000 33161.000 - 0.00% -
456.hmmer -1.35% 80861.000 79769.000 - 0.00% -
470.lbm -1.35% 9338.000 9212.000 - 0.00% -
458.sjeng -1.23% 80297.000 79307.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.40% 9509.000 57.000 - -1.72% -
462.libquantum -98.75% 14409.000 180.000 - -2.17% -
450.soplex -96.37% 15112.000 548.000 - -1.26% -
482.sphinx3 -96.26% 26682.000 998.000 - 2.15% -
444.namd -93.40% 12400.000 818.000 - 0.99% -
453.povray -92.87% 6987.000 498.000 - 1.43% -
429.mcf -91.79% 13988.000 1149.000 - 0.97% -
433.milc -91.43% 13601.000 1166.000 - -0.26% -
401.bzip2 -82.43% 16137.000 2836.000 - -0.18% -
447.dealII -79.23% 9380.000 1948.000 - -0.05% -
471.omnetpp -73.28% 10477.000 2799.000 - 1.86% -
470.lbm -69.98% 13259.000 3980.000 - -0.38% -
456.hmmer -67.85% 11854.000 3811.000 - -0.39% -
473.astar -62.58% 12272.000 4592.000 - -0.30% -
464.h264ref -58.55% 14498.000 6009.000 - -0.02% -
445.gobmk -56.26% 11093.000 4852.000 - -0.21% -
458.sjeng -52.34% 17055.000 8128.000 - -0.45% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (max) -99.67% 919.000 3.000 - -25.00% -
483.xalancbmk (max) (percentage) -99.61% 12.900 0.050 - 0.00% -
429.mcf (max) -99.47% 2281.000 12.000 - -14.29% -
444.namd (max) -99.20% 1003.000 8.000 - -20.00% -
401.bzip2 (max) -99.01% 609.000 6.000 - -14.29% -
456.hmmer (max) -98.87% 1242.000 14.000 - 0.00% -
444.namd -98.43% 318.000 5.000 - 0.00% -
444.namd (avg) -98.43% 318.000 5.000 - 0.00% -
473.astar (max) -98.42% 822.000 13.000 - 44.44% -
482.sphinx3 -98.28% 464.000 8.000 - 14.29% -
482.sphinx3 (avg) -98.28% 464.000 8.000 - 14.29% -
462.libquantum -98.18% 110.000 2.000 - 0.00% -
462.libquantum (avg) -98.18% 110.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) -98.13% 804.000 15.000 - 650.00% -
470.lbm (max) -98.02% 758.000 15.000 - 15.38% -
482.sphinx3 (unexplained diff vs previous) -97.70% 914.000 21.000 - 40.00% -
482.sphinx3 (max) -97.62% 883.000 21.000 - 50.00% -
403.gcc (max) -97.29% 221.000 6.000 - 0.00% -
433.milc (max) -97.22% 108.000 3.000 - -25.00% -
445.gobmk (max) -96.85% 413.000 13.000 - -7.14% -
450.soplex (max) -96.79% 249.000 8.000 - -11.11% -
456.hmmer (max) (percentage) -96.28% 10.480 0.390 - 5.41% -
403.gcc -96.15% 52.000 2.000 - 0.00% -
403.gcc (avg) -96.15% 52.000 2.000 - 0.00% -
458.sjeng (max) -95.89% 876.000 36.000 - 350.00% -
473.astar (max) (percentage) -95.52% 6.700 0.300 - 50.00% -
447.dealII (max) -95.52% 223.000 10.000 - -9.09% -
429.mcf -95.27% 296.000 14.000 - 0.00% -
429.mcf (avg) -95.27% 296.000 14.000 - 0.00% -
470.lbm -95.24% 441.000 21.000 - -4.55% -
470.lbm (avg) -95.24% 441.000 21.000 - -4.55% -
401.bzip2 (max) (percentage) -93.92% 3.780 0.230 - -14.81% -
470.lbm (unexplained diff vs previous) (percentage) -93.73% 6.060 0.380 - 660.00% -
471.omnetpp (max) -93.62% 972.000 62.000 - -15.07% -
470.lbm (max) (percentage) -93.36% 5.720 0.380 - 8.57% -
429.mcf (max) (percentage) -93.26% 16.310 1.100 - -11.29% -
433.milc -93.10% 116.000 8.000 - 0.00% -
433.milc (avg) -93.10% 116.000 8.000 - 0.00% -
445.gobmk (max) (percentage) -92.49% 3.730 0.280 - -6.67% -
458.sjeng (max) (percentage) -91.25% 5.140 0.450 - 350.00% -
453.povray -90.91% 55.000 5.000 - 0.00% -
453.povray (avg) -90.91% 55.000 5.000 - 0.00% -
450.soplex -90.67% 75.000 7.000 - 0.00% -
450.soplex (avg) -90.67% 75.000 7.000 - 0.00% -
401.bzip2 -88.46% 104.000 12.000 - 0.00% -
401.bzip2 (avg) -88.46% 104.000 12.000 - 0.00% -
444.namd (max) (percentage) -87.76% 8.090 0.990 - -21.43% -
456.hmmer -87.20% 164.000 21.000 - 0.00% -
456.hmmer (avg) -87.20% 164.000 21.000 - 0.00% -
447.dealII -85.71% 98.000 14.000 - 0.00% -
447.dealII (avg) -85.71% 98.000 14.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) -84.85% 33.000 5.000 - -16.67% -
445.gobmk -83.78% 74.000 12.000 - 0.00% -
445.gobmk (avg) -83.78% 74.000 12.000 - 0.00% -
470.lbm (avg) (percentage) -83.48% 3.330 0.550 - -1.79% -
458.sjeng -83.09% 136.000 23.000 - 0.00% -
458.sjeng (avg) -83.09% 136.000 23.000 - 0.00% -
473.astar -82.14% 112.000 20.000 - 0.00% -
473.astar (avg) -82.14% 112.000 20.000 - 0.00% -
471.omnetpp -79.04% 167.000 35.000 - 2.94% -
471.omnetpp (avg) -79.04% 167.000 35.000 - 2.94% -
447.dealII (max) (percentage) -77.31% 2.380 0.540 - -6.90% -
433.milc (unexplained diff vs previous) -76.92% 13.000 3.000 - 0.00% -
471.omnetpp (max) (percentage) -75.86% 9.280 2.240 - -16.73% -
445.gobmk (unexplained diff vs previous) -75.00% 40.000 10.000 - -16.67% -
444.namd (avg) (percentage) -73.15% 2.570 0.690 - 0.00% -
464.h264ref -69.05% 42.000 13.000 - 0.00% -
464.h264ref (avg) -69.05% 42.000 13.000 - 0.00% -
456.hmmer (unexplained diff vs previous) -67.39% 46.000 15.000 - 7.14% -
462.libquantum (max) (percentage) -65.99% 6.380 2.170 - -2.25% -
464.h264ref (max) -65.00% 60.000 21.000 - -8.70% -
453.povray (max) -64.00% 25.000 9.000 - 0.00% -
458.sjeng (avg) (percentage) -63.75% 0.800 0.290 - 0.00% -
445.gobmk (avg) (percentage) -61.19% 0.670 0.260 - 0.00% -
456.hmmer (avg) (percentage) -58.99% 1.390 0.570 - 0.00% -
433.milc (max) (percentage) -57.50% 0.800 0.340 - -8.11% -
482.sphinx3 (avg) (percentage) -53.45% 1.740 0.810 - 2.53% -
473.astar (avg) (percentage) -51.09% 0.920 0.450 - 0.00% -
471.omnetpp (unexplained diff vs previous) -50.49% 103.000 51.000 - -32.89% -
429.mcf (unexplained diff vs previous) -50.00% 22.000 11.000 - 37.50% -
473.astar (unexplained diff vs previous) -44.00% 25.000 14.000 - 250.00% -
445.gobmk (unexplained diff vs previous) (percentage) -41.67% 0.360 0.210 - -16.00% -
429.mcf (avg) (percentage) -41.51% 2.120 1.240 - -0.80% -
482.sphinx3 (unexplained diff vs previous) (percentage) -38.78% 3.430 2.100 - 36.36% -
482.sphinx3 (max) (percentage) -35.05% 3.310 2.150 - 42.38% -
401.bzip2 (avg) (percentage) -32.31% 0.650 0.440 - 0.00% -
483.xalancbmk (avg) (percentage) -32.08% 2.120 1.440 - 0.00% -
447.dealII (avg) (percentage) -31.43% 1.050 0.720 - 0.00% -
464.h264ref (avg) (percentage) -24.14% 0.290 0.220 - 0.00% -
471.omnetpp (avg) (percentage) -21.25% 1.600 1.260 - 0.80% -
433.milc (avg) (percentage) -15.12% 0.860 0.730 - 0.00% -
464.h264ref (max) (percentage) -14.29% 0.420 0.360 - -7.69% -
401.bzip2 (unexplained diff vs previous) (percentage) -10.00% 0.200 0.180 - -14.29% -
450.soplex (max) (percentage) -6.06% 1.650 1.550 - -6.06% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2836.000 -
403.gcc 57.000 -1.72%
429.mcf 1149.000 -
433.milc 1166.000 -
444.namd 818.000 -
445.gobmk 4852.000 -
447.dealII 1948.000 -
450.soplex 548.000 -1.26%
453.povray 498.000 1.43%
456.hmmer 3811.000 -
458.sjeng 8128.000 -
462.libquantum 180.000 -2.17%
464.h264ref 6009.000 -
470.lbm 3980.000 -
471.omnetpp 2799.000 1.86%
473.astar 4592.000 -
482.sphinx3 998.000 2.15%
Geometric Mean 1479.707 -
Code Size (bytes)
Name Current %
401.bzip2 33161.000 -
403.gcc 1653492.000 -
429.mcf 6915.000 -
433.milc 45869.000 -
444.namd 122635.000 -
445.gobmk 1255985.000 -
447.dealII 191430.000 -
450.soplex 146412.000 -
453.povray 512190.000 -
456.hmmer 79769.000 -
458.sjeng 79307.000 -
462.libquantum 12135.000 -
464.h264ref 298329.000 -
470.lbm 9212.000 -
471.omnetpp 317466.000 -
473.astar 15583.000 -
482.sphinx3 87400.000 -
Geometric Mean 94023.925 -
sample variability
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.440 -
401.bzip2 (max) 6.000 -14.29%
401.bzip2 (max) (percentage) 0.230 -14.81%
401.bzip2 (unexplained diff vs previous) 5.000 -16.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.180 -14.29%
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 3.900 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.820 -3.05%
429.mcf 14.000 -
429.mcf (avg) 14.000 -
429.mcf (avg) (percentage) 1.240 -
429.mcf (max) 12.000 -14.29%
429.mcf (max) (percentage) 1.100 -11.29%
429.mcf (unexplained diff vs previous) 11.000 37.50%
429.mcf (unexplained diff vs previous) (percentage) 0.960 37.14%
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.730 -
433.milc (max) 3.000 -25.00%
433.milc (max) (percentage) 0.340 -8.11%
433.milc (unexplained diff vs previous) 3.000 -
433.milc (unexplained diff vs previous) (percentage) 0.260 -
444.namd 5.000 -
444.namd (avg) 5.000 -
444.namd (avg) (percentage) 0.690 -
444.namd (max) 8.000 -20.00%
444.namd (max) (percentage) 0.990 -21.43%
444.namd (unexplained diff vs previous) 8.000 -11.11%
444.namd (unexplained diff vs previous) (percentage) 0.980 -11.71%
445.gobmk 12.000 -
445.gobmk (avg) 12.000 -
445.gobmk (avg) (percentage) 0.260 -
445.gobmk (max) 13.000 -7.14%
445.gobmk (max) (percentage) 0.280 -6.67%
445.gobmk (unexplained diff vs previous) 10.000 -16.67%
445.gobmk (unexplained diff vs previous) (percentage) 0.210 -16.00%
447.dealII 14.000 -
447.dealII (avg) 14.000 -
447.dealII (avg) (percentage) 0.720 -
447.dealII (max) 10.000 -9.09%
447.dealII (max) (percentage) 0.540 -6.90%
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.280 -
450.soplex (max) 8.000 -11.11%
450.soplex (max) (percentage) 1.550 -6.06%
453.povray 5.000 -
453.povray (avg) 5.000 -
453.povray (avg) (percentage) 1.040 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 1.860 -7.00%
453.povray (unexplained diff vs previous) 7.000 -30.00%
453.povray (unexplained diff vs previous) (percentage) 1.410 -30.88%
456.hmmer 21.000 -
456.hmmer (avg) 21.000 -
456.hmmer (avg) (percentage) 0.570 -
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.390 5.41%
456.hmmer (unexplained diff vs previous) 15.000 7.14%
456.hmmer (unexplained diff vs previous) (percentage) 0.390 5.41%
458.sjeng 23.000 -
458.sjeng (avg) 23.000 -
458.sjeng (avg) (percentage) 0.290 -
458.sjeng (max) 36.000 350.00%
458.sjeng (max) (percentage) 0.450 350.00%
458.sjeng (unexplained diff vs previous) 37.000 1750.00%
458.sjeng (unexplained diff vs previous) (percentage) 0.460 2200.00%
462.libquantum 2.000 -
462.libquantum (avg) 2.000 -
462.libquantum (avg) (percentage) 1.540 -
462.libquantum (max) 3.000 -25.00%
462.libquantum (max) (percentage) 2.170 -2.25%
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.220 2.30%
464.h264ref 13.000 -
464.h264ref (avg) 13.000 -
464.h264ref (avg) (percentage) 0.220 -
464.h264ref (max) 21.000 -8.70%
464.h264ref (max) (percentage) 0.360 -7.69%
464.h264ref (unexplained diff vs previous) 1.000 -94.44%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -93.33%
470.lbm 21.000 -4.55%
470.lbm (avg) 21.000 -4.55%
470.lbm (avg) (percentage) 0.550 -1.79%
470.lbm (max) 15.000 15.38%
470.lbm (max) (percentage) 0.380 8.57%
470.lbm (unexplained diff vs previous) 15.000 650.00%
470.lbm (unexplained diff vs previous) (percentage) 0.380 660.00%
471.omnetpp 35.000 2.94%
471.omnetpp (avg) 35.000 2.94%
471.omnetpp (avg) (percentage) 1.260 -
471.omnetpp (max) 62.000 -15.07%
471.omnetpp (max) (percentage) 2.240 -16.73%
471.omnetpp (unexplained diff vs previous) 51.000 -32.89%
471.omnetpp (unexplained diff vs previous) (percentage) 1.820 -34.30%
473.astar 20.000 -
473.astar (avg) 20.000 -
473.astar (avg) (percentage) 0.450 -
473.astar (max) 13.000 44.44%
473.astar (max) (percentage) 0.300 50.00%
473.astar (unexplained diff vs previous) 14.000 250.00%
473.astar (unexplained diff vs previous) (percentage) 0.300 233.33%
482.sphinx3 8.000 14.29%
482.sphinx3 (avg) 8.000 14.29%
482.sphinx3 (avg) (percentage) 0.810 2.53%
482.sphinx3 (max) 21.000 50.00%
482.sphinx3 (max) (percentage) 2.150 42.38%
482.sphinx3 (unexplained diff vs previous) 21.000 40.00%
482.sphinx3 (unexplained diff vs previous) (percentage) 2.100 36.36%
483.xalancbmk (avg) (percentage) 1.440 -
483.xalancbmk (max) (percentage) 0.050 -
Geometric Mean 3.085 7.32%