Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/628f11f78d33a182dbd9d8746a6e93dce08a8c44 (+ 311 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/9/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0009 (llvmorg-17-init-07076-g628f11f78d33) 2023-03-31T23:21:36 0:00:00
Previous 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 1
Performance Improvements 8
Added Tests 89
Unchanged Tests 754
Total Tests 852

Performance Regressions - Execution Δ Previous Current σ
447.dealII 1.97% 1220.000 1244.000 -

Performance Improvements - Execution Δ Previous Current σ
403.gcc -10.94% 64.000 57.000 -
464.h264ref -5.97% 4036.000 3795.000 -
450.soplex -3.92% 536.000 515.000 -
471.omnetpp -3.48% 2614.000 2523.000 -
462.libquantum -2.83% 106.000 103.000 -
400.perlbench -2.04% 1664.000 1630.000 -
483.xalancbmk -1.96% 3572.000 3502.000 -
401.bzip2 -1.40% 2501.000 2466.000 -

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)


Report Time: 0.20s
Name Current %
400.perlbench 1630.000 -2.04%
401.bzip2 2466.000 -1.40%
403.gcc 57.000 -10.94%
429.mcf 1891.000 -
433.milc 1191.000 -
444.namd 668.000 -
445.gobmk 4881.000 -
447.dealII 1244.000 1.97%
450.soplex 515.000 -3.92%
453.povray 465.000 -
456.hmmer 2643.000 -
458.sjeng 6723.000 -
462.libquantum 103.000 -2.83%
464.h264ref 3795.000 -5.97%
470.lbm 3227.000 -
471.omnetpp 2523.000 -3.48%
473.astar 4868.000 -
482.sphinx3 668.000 -
483.xalancbmk 3502.000 -1.96%
Geometric Mean 1355.336 -1.76%
Name Current %
400.perlbench 1190522.000 -
401.bzip2 76990.000 -
403.gcc 3430595.000 -
429.mcf 13355.000 -
433.milc 138560.000 -
444.namd 212450.000 -
445.gobmk 2129149.000 -
447.dealII 3238278.000 -
450.soplex 370340.000 -
453.povray 963294.000 -
456.hmmer 299347.000 -
458.sjeng 146118.000 -
462.libquantum 42477.000 -
464.h264ref 747415.000 -
470.lbm 12165.000 -
471.omnetpp 676594.000 -
473.astar 42380.000 -
482.sphinx3 197139.000 -
483.xalancbmk 4320086.000 -
Geometric Mean 301206.403 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 25.000 -
401.bzip2 (avg) 25.000 -
401.bzip2 (avg) (percentage) 1.030 -
401.bzip2 (max) 24.000 -
401.bzip2 (max) (percentage) 1.010 -
401.bzip2 (unexplained diff vs previous) 23.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.930 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 0.000 -
429.mcf 129.000 -
429.mcf (avg) 129.000 -
429.mcf (avg) (percentage) 6.870 -
429.mcf (max) 110.000 -
429.mcf (max) (percentage) 5.830 -
433.milc 47.000 -
433.milc (avg) 47.000 -
433.milc (avg) (percentage) 4.010 -
433.milc (max) 75.000 -
433.milc (max) (percentage) 6.310 -
433.milc (unexplained diff vs previous) 8.000 -
433.milc (unexplained diff vs previous) (percentage) 0.670 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.630 -
444.namd (max) 5.000 -
444.namd (max) (percentage) 0.780 -
444.namd (unexplained diff vs previous) 3.000 -
444.namd (unexplained diff vs previous) (percentage) 0.450 -
445.gobmk 24.000 -
445.gobmk (avg) 24.000 -
445.gobmk (avg) (percentage) 0.510 -
445.gobmk (max) 23.000 -
445.gobmk (max) (percentage) 0.490 -
447.dealII 38.000 -
447.dealII (avg) 38.000 -
447.dealII (avg) (percentage) 3.110 -
447.dealII (max) 22.000 -
447.dealII (max) (percentage) 1.810 -
450.soplex 24.000 -
450.soplex (avg) 24.000 -
450.soplex (avg) (percentage) 4.840 -
450.soplex (max) 28.000 -
450.soplex (max) (percentage) 5.620 -
450.soplex (unexplained diff vs previous) 13.000 -
450.soplex (unexplained diff vs previous) (percentage) 2.520 -
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.330 -
453.povray (max) 9.000 -
453.povray (max) (percentage) 2.110 -
453.povray (unexplained diff vs previous) 10.000 -
453.povray (unexplained diff vs previous) (percentage) 2.150 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.330 -
456.hmmer (max) 14.000 -
456.hmmer (max) (percentage) 0.530 -
456.hmmer (unexplained diff vs previous) 14.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.530 -
458.sjeng 20.000 -
458.sjeng (avg) 20.000 -
458.sjeng (avg) (percentage) 0.300 -
458.sjeng (max) 45.000 -
458.sjeng (max) (percentage) 0.670 -
458.sjeng (unexplained diff vs previous) 6.000 -
458.sjeng (unexplained diff vs previous) (percentage) 0.090 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.920 -
462.libquantum (max) 3.000 -
462.libquantum (max) (percentage) 3.740 -
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 3.880 -
464.h264ref 24.000 -
464.h264ref (avg) 24.000 -
464.h264ref (avg) (percentage) 0.640 -
464.h264ref (max) 17.000 -
464.h264ref (max) (percentage) 0.450 -
470.lbm 103.000 -
470.lbm (avg) 103.000 -
470.lbm (avg) (percentage) 3.210 -
470.lbm (max) 173.000 -
470.lbm (max) (percentage) 5.380 -
470.lbm (unexplained diff vs previous) 1.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.030 -
471.omnetpp 37.000 -
471.omnetpp (avg) 37.000 -
471.omnetpp (avg) (percentage) 1.470 -
471.omnetpp (max) 52.000 -
471.omnetpp (max) (percentage) 2.100 -
471.omnetpp (unexplained diff vs previous) 54.000 -
471.omnetpp (unexplained diff vs previous) (percentage) 2.140 -
473.astar 82.000 -
473.astar (avg) 82.000 -
473.astar (avg) (percentage) 1.700 -
473.astar (max) 104.000 -
473.astar (max) (percentage) 2.150 -
482.sphinx3 17.000 -
482.sphinx3 (avg) 17.000 -
482.sphinx3 (avg) (percentage) 2.680 -
482.sphinx3 (max) 24.000 -
482.sphinx3 (max) (percentage) 3.630 -
482.sphinx3 (unexplained diff vs previous) 8.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 1.200 -
483.xalancbmk 22.000 -
483.xalancbmk (avg) 22.000 -
483.xalancbmk (avg) (percentage) 0.650 -
483.xalancbmk (max) 34.000 -
483.xalancbmk (max) (percentage) 0.990 -
483.xalancbmk (unexplained diff vs previous) 8.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.230 -
Geometric Mean 4.072 -2731637222199852531712.00%