Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ba7273b02577236fbbca53554bafc6c22d7dd4c9 (+ 2470 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-spec2k6--llvm-arm-master-O2-build/46/
Filter

llvm-arm-master-O2 test results

Run Order Start Time Duration
Current 0046 (llvmorg-17-init-18081-gba7273b02577) 2023-06-28T11:30:09 0:00:00
Previous 0040 (llvmorg-17-init-15611-g9435942447b7) 2023-06-11T18:05:08 0:00:00
Baseline 0001 (llvmorg-16-init-16024-ga455c91601a8) 2022-12-31T07:27:27 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 24
Performance Improvements 1 26
Unchanged Tests 729 682
Total Tests 732

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 1.26% 72631.000 73543.000 - -0.07% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf 1.06% 9643.000 9745.000 - 1.45% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
401.bzip2 (max) -1.52% 66.000 65.000 - 622.22% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf 1.45% 9606.000 9745.000 - 1.06% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 (max) (percentage) 625.00% 0.080 0.580 - 0.00% -
401.bzip2 (max) 622.22% 9.000 65.000 - -1.52% -
462.libquantum (max) 300.00% 8.000 32.000 - 0.00% -
462.libquantum (max) (percentage) 266.67% 0.060 0.220 - 0.00% -
458.sjeng (max) (percentage) 105.71% 0.350 0.720 - 0.00% -
458.sjeng (max) 101.96% 51.000 103.000 - 0.00% -
401.bzip2 100.00% 9.000 18.000 - 0.00% -
401.bzip2 (avg) 100.00% 9.000 18.000 - 0.00% -
401.bzip2 (avg) (percentage) 100.00% 0.080 0.160 - 0.00% -
471.omnetpp (max) (percentage) 100.00% 0.460 0.920 - 0.00% -
482.sphinx3 (max) (percentage) 59.26% 0.270 0.430 - 0.00% -
471.omnetpp (avg) (percentage) 56.82% 0.440 0.690 - 0.00% -
483.xalancbmk (max) (percentage) 25.93% 1.080 1.360 - 0.00% -
470.lbm (max) (percentage) 22.22% 0.180 0.220 - 0.00% -
462.libquantum 15.79% 19.000 22.000 - 0.00% -
462.libquantum (avg) 15.79% 19.000 22.000 - 0.00% -
462.libquantum (avg) (percentage) 15.38% 0.130 0.150 - 0.00% -
429.mcf 14.29% 7.000 8.000 - 0.00% -
429.mcf (avg) 14.29% 7.000 8.000 - 0.00% -
456.hmmer (avg) (percentage) 11.81% 1.270 1.420 - 0.00% -
450.soplex (avg) (percentage) 10.53% 0.190 0.210 - 0.00% -
447.dealII (max) (percentage) 3.03% 0.660 0.680 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -77.78% 18.000 4.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -4.00% 35357.000 33944.000 - 0.14% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
458.sjeng -2.38% 14662.000 14313.000 - -0.32% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) -79.49% 0.780 0.160 - 0.00% -
456.hmmer (max) (percentage) -68.32% 3.820 1.210 - 0.00% -
433.milc (max) (percentage) -66.67% 0.090 0.030 - 0.00% -
445.gobmk (max) (percentage) -37.04% 0.270 0.170 - 0.00% -
444.namd (max) (percentage) -34.62% 0.260 0.170 - 0.00% -
473.astar (max) (percentage) -29.41% 0.170 0.120 - 0.00% -
453.povray (max) (percentage) -28.57% 0.630 0.450 - 0.00% -
464.h264ref (max) (percentage) -25.56% 0.900 0.670 - 0.00% -
470.lbm (avg) (percentage) -20.00% 0.300 0.240 - 0.00% -
458.sjeng -19.57% 92.000 74.000 - 0.00% -
458.sjeng (avg) -19.57% 92.000 74.000 - 0.00% -
444.namd (avg) (percentage) -17.65% 0.170 0.140 - 0.00% -
458.sjeng (avg) (percentage) -17.46% 0.630 0.520 - 0.00% -
450.soplex (max) (percentage) -16.67% 0.240 0.200 - 0.00% -
473.astar (avg) (percentage) -16.67% 0.120 0.100 - 0.00% -
453.povray (avg) (percentage) -16.33% 0.490 0.410 - 0.00% -
482.sphinx3 (avg) (percentage) -15.69% 0.510 0.430 - 0.00% -
433.milc (avg) (percentage) -14.29% 0.070 0.060 - 0.00% -
445.gobmk (avg) (percentage) -13.64% 0.220 0.190 - 0.00% -
464.h264ref (avg) (percentage) -12.50% 0.640 0.560 - 0.00% -
429.mcf (max) -10.00% 10.000 9.000 - 0.00% -
483.xalancbmk (avg) (percentage) -8.70% 0.920 0.840 - 0.00% -
403.gcc (avg) (percentage) -8.33% 0.360 0.330 - 0.00% -
447.dealII (avg) (percentage) -5.45% 0.550 0.520 - 0.00% -


Report Time: 0.22s
Name Current %
401.bzip2 11303.000 -
429.mcf 9745.000 1.06%
458.sjeng 14313.000 -
462.libquantum 14701.000 -
Geometric Mean 12338.526 -
Name Current %
401.bzip2 73543.000 1.26%
429.mcf 10966.000 -
458.sjeng 148620.000 -
462.libquantum 33944.000 -
Geometric Mean 44911.490 -
Name Current %
401.bzip2 18.000 -
401.bzip2 (avg) 18.000 -
401.bzip2 (avg) (percentage) 0.160 -
401.bzip2 (max) 65.000 -1.52%
401.bzip2 (max) (percentage) 0.580 -
403.gcc (avg) (percentage) 0.330 -
403.gcc (max) (percentage) 0.160 -
429.mcf 8.000 -
429.mcf (avg) 8.000 -
429.mcf (avg) (percentage) 0.090 -
429.mcf (max) 9.000 -
429.mcf (max) (percentage) 0.100 -
433.milc (avg) (percentage) 0.060 -
433.milc (max) (percentage) 0.030 -
444.namd (avg) (percentage) 0.140 -
444.namd (max) (percentage) 0.170 -
445.gobmk (avg) (percentage) 0.190 -
445.gobmk (max) (percentage) 0.170 -
447.dealII (avg) (percentage) 0.520 -
447.dealII (max) (percentage) 0.680 -
450.soplex (avg) (percentage) 0.210 -
450.soplex (max) (percentage) 0.200 -
453.povray (avg) (percentage) 0.410 -
453.povray (max) (percentage) 0.450 -
456.hmmer (avg) (percentage) 1.420 -
456.hmmer (max) (percentage) 1.210 -
458.sjeng 74.000 -
458.sjeng (avg) 74.000 -
458.sjeng (avg) (percentage) 0.520 -
458.sjeng (max) 103.000 -
458.sjeng (max) (percentage) 0.720 -
462.libquantum 22.000 -
462.libquantum (avg) 22.000 -
462.libquantum (avg) (percentage) 0.150 -
462.libquantum (max) 32.000 -
462.libquantum (max) (percentage) 0.220 -
464.h264ref (avg) (percentage) 0.560 -
464.h264ref (max) (percentage) 0.670 -
470.lbm (avg) (percentage) 0.240 -
470.lbm (max) (percentage) 0.220 -
471.omnetpp (avg) (percentage) 0.690 -
471.omnetpp (max) (percentage) 0.920 -
473.astar (avg) (percentage) 0.100 -
473.astar (max) (percentage) 0.120 -
482.sphinx3 (avg) (percentage) 0.430 -
482.sphinx3 (max) (percentage) 0.430 -
483.xalancbmk (avg) (percentage) 0.840 -
483.xalancbmk (max) (percentage) 1.360 -
Geometric Mean 0.912 -