Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/8a80e331506e3e3db390ed0b482c7cbe216f7afc (+ 993 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O2-build/81/
View Options
Report
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0081 (llvmorg-18-init-09708-g8a80e331506e) 2023-10-19T01:54:21 0:00:00
Previous 0078 (llvmorg-18-init-08715-g7f2dd2da9937) 2023-10-11T16:01:42 0:00:00
Baseline 0001 (llvmorg-16-init-16024-ga455c91601a8) 2022-12-31T07:27:27 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 23
Performance Improvements 14 27
Unchanged Tests 718 682
Total Tests 732

Run-Over-Run Changes Detail

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -4.01% 11765.000 11293.000 - -0.51% -
458.sjeng -1.66% 14316.000 14079.000 - -3.98% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) -12.00% 225.000 198.000 - 2100.00% -
458.sjeng (max) -10.00% 110.000 99.000 - 94.12% -
429.mcf (max) -9.09% 11.000 10.000 - 0.00% -
401.bzip2 (max) (percentage) -8.33% 1.920 1.760 - 2100.00% -
458.sjeng (max) (percentage) -7.79% 0.770 0.710 - 102.86% -
462.libquantum (max) -5.77% 52.000 49.000 - 512.50% -
462.libquantum (max) (percentage) -5.56% 0.360 0.340 - 466.67% -
401.bzip2 -2.63% 38.000 37.000 - 311.11% -
401.bzip2 (avg) -2.63% 38.000 37.000 - 311.11% -
458.sjeng -1.47% 68.000 67.000 - -27.17% -
458.sjeng (avg) -1.47% 68.000 67.000 - -27.17% -
471.omnetpp (max) (percentage) -1.15% 0.870 0.860 - 86.96% -

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 1.94% 73592.000 75023.000 - -0.03% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (max) 2100.00% 9.000 198.000 - -12.00% -
401.bzip2 (max) (percentage) 2100.00% 0.080 1.760 - -8.33% -
462.libquantum (max) 512.50% 8.000 49.000 - -5.77% -
462.libquantum (max) (percentage) 466.67% 0.060 0.340 - -5.56% -
401.bzip2 (avg) (percentage) 312.50% 0.080 0.330 - 0.00% -
401.bzip2 311.11% 9.000 37.000 - -2.63% -
401.bzip2 (avg) 311.11% 9.000 37.000 - -2.63% -
458.sjeng (max) (percentage) 102.86% 0.350 0.710 - -7.79% -
458.sjeng (max) 94.12% 51.000 99.000 - -10.00% -
471.omnetpp (max) (percentage) 86.96% 0.460 0.860 - -1.15% -
471.omnetpp (avg) (percentage) 56.82% 0.440 0.690 - 0.00% -
482.sphinx3 (max) (percentage) 44.44% 0.270 0.390 - 0.00% -
462.libquantum (avg) (percentage) 38.46% 0.130 0.180 - 0.00% -
462.libquantum 36.84% 19.000 26.000 - 0.00% -
462.libquantum (avg) 36.84% 19.000 26.000 - 0.00% -
470.lbm (max) (percentage) 22.22% 0.180 0.220 - 0.00% -
429.mcf 14.29% 7.000 8.000 - 0.00% -
429.mcf (avg) 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) 11.81% 1.270 1.420 - 0.00% -
450.soplex (avg) (percentage) 10.53% 0.190 0.210 - 0.00% -
483.xalancbmk (max) (percentage) 4.63% 1.080 1.130 - -0.88% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -77.78% 18.000 4.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -6.69% 35357.000 32992.000 - -0.24% -
429.mcf -1.64% 11019.000 10838.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -3.98% 14662.000 14079.000 - -1.66% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) -80.77% 0.780 0.150 - 0.00% -
456.hmmer (max) (percentage) -71.20% 3.820 1.100 - -0.90% -
433.milc (max) (percentage) -66.67% 0.090 0.030 - 0.00% -
445.gobmk (max) (percentage) -44.44% 0.270 0.150 - 0.00% -
444.namd (max) (percentage) -42.31% 0.260 0.150 - 0.00% -
473.astar (max) (percentage) -41.18% 0.170 0.100 - 0.00% -
453.povray (max) (percentage) -34.92% 0.630 0.410 - 0.00% -
464.h264ref (max) (percentage) -31.11% 0.900 0.620 - 0.00% -
450.soplex (max) (percentage) -29.17% 0.240 0.170 - 0.00% -
458.sjeng -27.17% 92.000 67.000 - -1.47% -
458.sjeng (avg) -27.17% 92.000 67.000 - -1.47% -
458.sjeng (avg) (percentage) -23.81% 0.630 0.480 - 0.00% -
470.lbm (avg) (percentage) -20.00% 0.300 0.240 - 0.00% -
444.namd (avg) (percentage) -17.65% 0.170 0.140 - 0.00% -
473.astar (avg) (percentage) -16.67% 0.120 0.100 - 0.00% -
453.povray (avg) (percentage) -16.33% 0.490 0.410 - 0.00% -
482.sphinx3 (avg) (percentage) -15.69% 0.510 0.430 - 0.00% -
433.milc (avg) (percentage) -14.29% 0.070 0.060 - 0.00% -
445.gobmk (avg) (percentage) -13.64% 0.220 0.190 - 0.00% -
464.h264ref (avg) (percentage) -12.50% 0.640 0.560 - 0.00% -
483.xalancbmk (avg) (percentage) -8.70% 0.920 0.840 - 0.00% -
403.gcc (avg) (percentage) -8.33% 0.360 0.330 - 0.00% -
447.dealII (max) (percentage) -6.06% 0.660 0.620 - 0.00% -
447.dealII (avg) (percentage) -5.45% 0.550 0.520 - 0.00% -

Report Time: 0.22s
Execution (seconds)
Name Current %
401.bzip2 11293.000 -4.01%
429.mcf 9674.000 -
458.sjeng 14079.000 -1.66%
462.libquantum 14684.000 -
Geometric Mean 12259.081 -1.45%
Code Size (bytes)
Name Current %
401.bzip2 75023.000 -
429.mcf 10838.000 -
458.sjeng 148216.000 -
462.libquantum 32992.000 -
Geometric Mean 44654.150 -
sample variability
Name Current %
401.bzip2 37.000 -2.63%
401.bzip2 (avg) 37.000 -2.63%
401.bzip2 (avg) (percentage) 0.330 -
401.bzip2 (max) 198.000 -12.00%
401.bzip2 (max) (percentage) 1.760 -8.33%
403.gcc (avg) (percentage) 0.330 -
403.gcc (max) (percentage) 0.150 -
429.mcf 8.000 -
429.mcf (avg) 8.000 -
429.mcf (avg) (percentage) 0.090 -
429.mcf (max) 10.000 -9.09%
429.mcf (max) (percentage) 0.110 -
433.milc (avg) (percentage) 0.060 -
433.milc (max) (percentage) 0.030 -
444.namd (avg) (percentage) 0.140 -
444.namd (max) (percentage) 0.150 -
445.gobmk (avg) (percentage) 0.190 -
445.gobmk (max) (percentage) 0.150 -
447.dealII (avg) (percentage) 0.520 -
447.dealII (max) (percentage) 0.620 -
450.soplex (avg) (percentage) 0.210 -
450.soplex (max) (percentage) 0.170 -
453.povray (avg) (percentage) 0.410 -
453.povray (max) (percentage) 0.410 -
456.hmmer (avg) (percentage) 1.420 -
456.hmmer (max) (percentage) 1.100 -
458.sjeng 67.000 -1.47%
458.sjeng (avg) 67.000 -1.47%
458.sjeng (avg) (percentage) 0.480 -
458.sjeng (max) 99.000 -10.00%
458.sjeng (max) (percentage) 0.710 -7.79%
462.libquantum 26.000 -
462.libquantum (avg) 26.000 -
462.libquantum (avg) (percentage) 0.180 -
462.libquantum (max) 49.000 -5.77%
462.libquantum (max) (percentage) 0.340 -5.56%
464.h264ref (avg) (percentage) 0.560 -
464.h264ref (max) (percentage) 0.620 -
470.lbm (avg) (percentage) 0.240 -
470.lbm (max) (percentage) 0.220 -
471.omnetpp (avg) (percentage) 0.690 -
471.omnetpp (max) (percentage) 0.860 -1.15%
473.astar (avg) (percentage) 0.100 -
473.astar (max) (percentage) 0.100 -
482.sphinx3 (avg) (percentage) 0.430 -
482.sphinx3 (max) (percentage) 0.390 -
483.xalancbmk (avg) (percentage) 0.840 -
483.xalancbmk (max) (percentage) 1.130 -
Geometric Mean 0.997 -1.68%