Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0508ac32cfcc1a9fc5a81d16de8d418dc5a0666b (+ 568 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O2-build/32/
View Options
Report
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0032 (llvmorg-17-init-12713-g0508ac32cfcc) 2023-05-13T07:33:38 0:00:00
Previous 0031 (llvmorg-17-init-12145-g75cce50fd2d3) 2023-04-29T15:04:42 0:00:00
Baseline 0001 (llvmorg-16-init-16024-ga455c91601a8) 2022-12-31T07:27:27 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 2 27
Performance Improvements 17 26
Unchanged Tests 713 679
Total Tests 732

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (unexplained diff vs previous) 600.00% 1.000 7.000 - 40.00% -
429.mcf (unexplained diff vs previous) (percentage) 600.00% 0.010 0.070 - 40.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (max) -7.89% 38.000 35.000 - 337.50% -
462.libquantum (max) (percentage) -7.69% 0.260 0.240 - 300.00% -
473.astar (max) (percentage) -7.69% 0.130 0.120 - -29.41% -
401.bzip2 (max) -6.82% 88.000 82.000 - 811.11% -
401.bzip2 (max) (percentage) -6.49% 0.770 0.720 - 800.00% -
403.gcc (max) (percentage) -5.88% 0.170 0.160 - -79.49% -
444.namd (max) (percentage) -5.26% 0.190 0.180 - -30.77% -
445.gobmk (max) (percentage) -5.26% 0.190 0.180 - -33.33% -
450.soplex (max) (percentage) -4.55% 0.220 0.210 - -12.50% -
458.sjeng (max) -4.46% 112.000 107.000 - 109.80% -
471.omnetpp (max) (percentage) -4.04% 0.990 0.950 - 106.52% -
458.sjeng (max) (percentage) -3.80% 0.790 0.760 - 117.14% -
456.hmmer (max) (percentage) -2.34% 1.280 1.250 - -67.28% -
482.sphinx3 (max) (percentage) -2.22% 0.450 0.440 - 62.96% -
483.xalancbmk (max) (percentage) -2.05% 1.460 1.430 - 32.41% -
464.h264ref (max) (percentage) -1.43% 0.700 0.690 - -23.33% -
447.dealII (max) (percentage) -1.41% 0.710 0.700 - 6.06% -

Run-Over-Baseline Changes Detail

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (max) 811.11% 9.000 82.000 - -6.82% -
401.bzip2 (max) (percentage) 800.00% 0.080 0.720 - -6.49% -
462.libquantum (max) 337.50% 8.000 35.000 - -7.89% -
462.libquantum (max) (percentage) 300.00% 0.060 0.240 - -7.69% -
458.sjeng (max) (percentage) 117.14% 0.350 0.760 - -3.80% -
458.sjeng (max) 109.80% 51.000 107.000 - -4.46% -
471.omnetpp (max) (percentage) 106.52% 0.460 0.950 - -4.04% -
429.mcf (max) 80.00% 10.000 18.000 - 0.00% -
401.bzip2 77.78% 9.000 16.000 - 0.00% -
401.bzip2 (avg) 77.78% 9.000 16.000 - 0.00% -
401.bzip2 (avg) (percentage) 75.00% 0.080 0.140 - 0.00% -
429.mcf (max) (percentage) 72.73% 0.110 0.190 - 0.00% -
482.sphinx3 (max) (percentage) 62.96% 0.270 0.440 - -2.22% -
471.omnetpp (avg) (percentage) 56.82% 0.440 0.690 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 40.00% 0.050 0.070 - 600.00% -
429.mcf (unexplained diff vs previous) 40.00% 5.000 7.000 - 600.00% -
483.xalancbmk (max) (percentage) 32.41% 1.080 1.430 - -2.05% -
470.lbm (max) (percentage) 22.22% 0.180 0.220 - 0.00% -
462.libquantum 15.79% 19.000 22.000 - 0.00% -
462.libquantum (avg) 15.79% 19.000 22.000 - 0.00% -
462.libquantum (avg) (percentage) 15.38% 0.130 0.150 - 0.00% -
429.mcf 14.29% 7.000 8.000 - 0.00% -
429.mcf (avg) 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) 11.81% 1.270 1.420 - 0.00% -
450.soplex (avg) (percentage) 10.53% 0.190 0.210 - 0.00% -
447.dealII (max) (percentage) 6.06% 0.660 0.700 - -1.41% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -77.78% 18.000 4.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -4.13% 35357.000 33896.000 - 0.09% -
401.bzip2 -1.31% 73592.000 72631.000 - 0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.89% 14662.000 14091.000 - -0.79% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) -79.49% 0.780 0.160 - -5.88% -
456.hmmer (max) (percentage) -67.28% 3.820 1.250 - -2.34% -
433.milc (max) (percentage) -66.67% 0.090 0.030 - 0.00% -
445.gobmk (max) (percentage) -33.33% 0.270 0.180 - -5.26% -
444.namd (max) (percentage) -30.77% 0.260 0.180 - -5.26% -
473.astar (max) (percentage) -29.41% 0.170 0.120 - -7.69% -
453.povray (max) (percentage) -26.98% 0.630 0.460 - 0.00% -
464.h264ref (max) (percentage) -23.33% 0.900 0.690 - -1.43% -
458.sjeng -20.65% 92.000 73.000 - 0.00% -
458.sjeng (avg) -20.65% 92.000 73.000 - 0.00% -
470.lbm (avg) (percentage) -20.00% 0.300 0.240 - 0.00% -
444.namd (avg) (percentage) -17.65% 0.170 0.140 - 0.00% -
458.sjeng (avg) (percentage) -17.46% 0.630 0.520 - 0.00% -
473.astar (avg) (percentage) -16.67% 0.120 0.100 - 0.00% -
453.povray (avg) (percentage) -16.33% 0.490 0.410 - 0.00% -
482.sphinx3 (avg) (percentage) -15.69% 0.510 0.430 - 0.00% -
433.milc (avg) (percentage) -14.29% 0.070 0.060 - 0.00% -
445.gobmk (avg) (percentage) -13.64% 0.220 0.190 - 0.00% -
450.soplex (max) (percentage) -12.50% 0.240 0.210 - -4.55% -
464.h264ref (avg) (percentage) -12.50% 0.640 0.560 - 0.00% -
483.xalancbmk (avg) (percentage) -8.70% 0.920 0.840 - 0.00% -
403.gcc (avg) (percentage) -8.33% 0.360 0.330 - 0.00% -
447.dealII (avg) (percentage) -5.45% 0.550 0.520 - 0.00% -

Report Time: 0.23s
Execution (seconds)
Name Current %
401.bzip2 11436.000 -
429.mcf 9640.000 -
458.sjeng 14091.000 -
462.libquantum 14684.000 -
Geometric Mean 12289.504 -
Code Size (bytes)
Name Current %
401.bzip2 72631.000 -
429.mcf 10910.000 -
458.sjeng 148836.000 -
462.libquantum 33896.000 -
Geometric Mean 44714.750 -
sample variability
Name Current %
401.bzip2 16.000 -
401.bzip2 (avg) 16.000 -
401.bzip2 (avg) (percentage) 0.140 -
401.bzip2 (max) 82.000 -6.82%
401.bzip2 (max) (percentage) 0.720 -6.49%
403.gcc (avg) (percentage) 0.330 -
403.gcc (max) (percentage) 0.160 -5.88%
429.mcf 8.000 -
429.mcf (avg) 8.000 -
429.mcf (avg) (percentage) 0.090 -
429.mcf (max) 18.000 -
429.mcf (max) (percentage) 0.190 -
429.mcf (unexplained diff vs previous) 7.000 600.00%
429.mcf (unexplained diff vs previous) (percentage) 0.070 600.00%
433.milc (avg) (percentage) 0.060 -
433.milc (max) (percentage) 0.030 -
444.namd (avg) (percentage) 0.140 -
444.namd (max) (percentage) 0.180 -5.26%
445.gobmk (avg) (percentage) 0.190 -
445.gobmk (max) (percentage) 0.180 -5.26%
447.dealII (avg) (percentage) 0.520 -
447.dealII (max) (percentage) 0.700 -1.41%
450.soplex (avg) (percentage) 0.210 -
450.soplex (max) (percentage) 0.210 -4.55%
453.povray (avg) (percentage) 0.410 -
453.povray (max) (percentage) 0.460 -
456.hmmer (avg) (percentage) 1.420 -
456.hmmer (max) (percentage) 1.250 -2.34%
458.sjeng 73.000 -
458.sjeng (avg) 73.000 -
458.sjeng (avg) (percentage) 0.520 -
458.sjeng (max) 107.000 -4.46%
458.sjeng (max) (percentage) 0.760 -3.80%
462.libquantum 22.000 -
462.libquantum (avg) 22.000 -
462.libquantum (avg) (percentage) 0.150 -
462.libquantum (max) 35.000 -7.89%
462.libquantum (max) (percentage) 0.240 -7.69%
464.h264ref (avg) (percentage) 0.560 -
464.h264ref (max) (percentage) 0.690 -1.43%
470.lbm (avg) (percentage) 0.240 -
470.lbm (max) (percentage) 0.220 -
471.omnetpp (avg) (percentage) 0.690 -
471.omnetpp (max) (percentage) 0.950 -4.04%
473.astar (avg) (percentage) 0.100 -
473.astar (max) (percentage) 0.120 -7.69%
482.sphinx3 (avg) (percentage) 0.430 -
482.sphinx3 (max) (percentage) 0.440 -2.22%
483.xalancbmk (avg) (percentage) 0.840 -
483.xalancbmk (max) (percentage) 1.430 -2.05%
Geometric Mean 0.940 6.33%