Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3496245ed3d0b4d24444260da77dcdb93512fb5a (+ 238 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-arm-master-O3_LTO-build/165/
Filter

llvm-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0165 (llvmorg-20-init-02821-g3496245ed3d0) 2024-07-31T06:56:55 0:00:00
Previous 0165 (llvmorg-20-init-02821-g3496245ed3d0) 2024-07-31T06:56:55 0:00:00
Baseline 0006 (llvmorg-17-init-05349-gd0398d3593ba) 2023-03-18T19:32:43 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 6
Performance Improvements 0 21
Added Tests 0 87
Unchanged Tests 768 654
Total Tests 768

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 2.28% 64543.000 66015.000 - 0.00% -
470.lbm 2.16% 10930.000 11166.000 - 0.00% -
473.astar 2.03% 30771.000 31395.000 - 0.00% -
433.milc 1.15% 107474.000 108710.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
444.namd 3.60% 694.000 719.000 - 0.00% -
447.dealII 1.31% 1067.000 1081.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
444.namd -3.05% 181004.000 175480.000 - 0.00% -
471.omnetpp -2.39% 690755.000 674248.000 - 0.00% -
447.dealII -2.05% 477780.000 467992.000 - 0.00% -
445.gobmk -1.32% 1842098.000 1817762.000 - 0.00% -
429.mcf -1.19% 12471.000 12323.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
433.milc -9.40% 1117.000 1012.000 - 0.00% -
450.soplex -9.06% 563.000 512.000 - 0.00% -
429.mcf -8.38% 1277.000 1170.000 - 0.00% -
470.lbm -5.89% 2990.000 2814.000 - 0.00% -
401.bzip2 -5.55% 2847.000 2689.000 - 0.00% -
482.sphinx3 -5.05% 911.000 865.000 - 0.00% -
403.gcc -4.92% 61.000 58.000 - 0.00% -
473.astar -3.28% 4881.000 4721.000 - 0.00% -
462.libquantum -3.16% 95.000 92.000 - 0.00% -
458.sjeng -2.50% 7518.000 7330.000 - 0.00% -
445.gobmk -2.18% 4912.000 4805.000 - 0.00% -
464.h264ref -1.73% 5142.000 5053.000 - 0.00% -
456.hmmer -1.41% 3487.000 3438.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 110.53% 19.000 40.000 - 0.00% -
nb_compile_successful 89.47% 19.000 36.000 - 0.00% -
nb_execution_successful 88.89% 18.000 34.000 - 0.00% -

Added Tests - sample variability
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.26s
Name Current %
401.bzip2 2689.000 -
403.gcc 58.000 -
429.mcf 1170.000 -
433.milc 1012.000 -
444.namd 719.000 -
445.gobmk 4805.000 -
447.dealII 1081.000 -
450.soplex 512.000 -
453.povray 420.000 -
456.hmmer 3438.000 -
458.sjeng 7330.000 -
462.libquantum 92.000 -
464.h264ref 5053.000 -
470.lbm 2814.000 -
471.omnetpp 2252.000 -
473.astar 4721.000 -
482.sphinx3 865.000 -
Geometric Mean 1250.910 -
Name Current %
401.bzip2 66015.000 -
403.gcc 3833717.000 -
429.mcf 12323.000 -
433.milc 108710.000 -
444.namd 175480.000 -
445.gobmk 1817762.000 -
447.dealII 467992.000 -
450.soplex 286437.000 -
453.povray 1142741.000 -
456.hmmer 166955.000 -
458.sjeng 137563.000 -
462.libquantum 36128.000 -
464.h264ref 818280.000 -
470.lbm 11166.000 -
471.omnetpp 674248.000 -
473.astar 31395.000 -
482.sphinx3 177016.000 -
Geometric Mean 188305.367 -
Name Current %
401.bzip2 12.000 -
401.bzip2 (avg) 12.000 -
401.bzip2 (avg) (percentage) 0.460 -
401.bzip2 (max) 15.000 -
401.bzip2 (max) (percentage) 0.560 -
401.bzip2 (unexplained diff vs previous) 8.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.300 -
403.gcc 2.000 -
403.gcc (avg) 2.000 -
403.gcc (avg) (percentage) 5.090 -
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 10.420 -
403.gcc (unexplained diff vs previous) 3.000 -
403.gcc (unexplained diff vs previous) (percentage) 5.170 -
429.mcf 11.000 -
429.mcf (avg) 11.000 -
429.mcf (avg) (percentage) 1.000 -
429.mcf (max) 15.000 -
429.mcf (max) (percentage) 1.290 -
429.mcf (unexplained diff vs previous) 11.000 -
429.mcf (unexplained diff vs previous) (percentage) 0.940 -
433.milc 7.000 -
433.milc (avg) 7.000 -
433.milc (avg) (percentage) 0.700 -
433.milc (max) 7.000 -
433.milc (max) (percentage) 0.780 -
433.milc (unexplained diff vs previous) 8.000 -
433.milc (unexplained diff vs previous) (percentage) 0.790 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.630 -
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.410 -
444.namd (unexplained diff vs previous) 10.000 -
444.namd (unexplained diff vs previous) (percentage) 1.390 -
445.gobmk 14.000 -
445.gobmk (avg) 14.000 -
445.gobmk (avg) (percentage) 0.300 -
445.gobmk (max) 49.000 -
445.gobmk (max) (percentage) 1.020 -
445.gobmk (unexplained diff vs previous) 13.000 -
445.gobmk (unexplained diff vs previous) (percentage) 0.270 -
447.dealII 17.000 -
447.dealII (avg) 17.000 -
447.dealII (avg) (percentage) 1.620 -
447.dealII (max) 29.000 -
447.dealII (max) (percentage) 2.700 -
447.dealII (unexplained diff vs previous) 27.000 -
447.dealII (unexplained diff vs previous) (percentage) 2.500 -
450.soplex 7.000 -
450.soplex (avg) 7.000 -
450.soplex (avg) (percentage) 1.420 -
450.soplex (max) 14.000 -
450.soplex (max) (percentage) 2.850 -
450.soplex (unexplained diff vs previous) 15.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.930 -
453.povray 3.000 -
453.povray (avg) 3.000 -
453.povray (avg) (percentage) 0.910 -
453.povray (max) 3.000 -
453.povray (max) (percentage) 0.780 -
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.240 -
456.hmmer 6.000 -
456.hmmer (avg) 6.000 -
456.hmmer (avg) (percentage) 0.180 -
456.hmmer (max) 7.000 -
456.hmmer (max) (percentage) 0.230 -
456.hmmer (unexplained diff vs previous) 8.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.230 -
458.sjeng 13.000 -
458.sjeng (avg) 13.000 -
458.sjeng (avg) (percentage) 0.180 -
458.sjeng (max) 22.000 -
458.sjeng (max) (percentage) 0.310 -
458.sjeng (unexplained diff vs previous) 23.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.310 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.190 -
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.740 -
462.libquantum (unexplained diff vs previous) 1.000 -
462.libquantum (unexplained diff vs previous) (percentage) 1.090 -
464.h264ref 14.000 -
464.h264ref (avg) 14.000 -
464.h264ref (avg) (percentage) 0.290 -
464.h264ref (max) 18.000 -
464.h264ref (max) (percentage) 0.370 -
470.lbm 14.000 -
470.lbm (avg) 14.000 -
470.lbm (avg) (percentage) 0.500 -
470.lbm (max) 22.000 -
470.lbm (max) (percentage) 0.790 -
470.lbm (unexplained diff vs previous) 22.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.780 -
471.omnetpp 32.000 -
471.omnetpp (avg) 32.000 -
471.omnetpp (avg) (percentage) 1.430 -
471.omnetpp (max) 63.000 -
471.omnetpp (max) (percentage) 2.830 -
471.omnetpp (unexplained diff vs previous) 62.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.750 -
473.astar 18.000 -
473.astar (avg) 18.000 -
473.astar (avg) (percentage) 0.400 -
473.astar (max) 36.000 -
473.astar (max) (percentage) 0.780 -
473.astar (unexplained diff vs previous) 10.000 -
473.astar (unexplained diff vs previous) (percentage) 0.210 -
482.sphinx3 4.000 -
482.sphinx3 (avg) 4.000 -
482.sphinx3 (avg) (percentage) 0.520 -
482.sphinx3 (max) 8.000 -
482.sphinx3 (max) (percentage) 1.030 -
483.xalancbmk (avg) (percentage) 0.610 -
483.xalancbmk (max) (percentage) 1.050 -
Geometric Mean 3.248 -