Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/9fae0c6f9c05915a5daac5b368258a40e1fab237 (+ 471 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-aarch64-master-Os-build/195/
Filter

llvm-aarch64-master-Os test results

Run Order Start Time Duration
Current 0195 (llvmorg-19-init-18074-g9fae0c6f9c05) 2024-07-14T04:42:53 0:00:00
Previous 0195 (llvmorg-19-init-18074-g9fae0c6f9c05) 2024-07-14T04:42:53 0:00:00
Baseline 0151 (llvmorg-19-init-07210-g0f5f931a9b32) 2024-04-03T14:28:02 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 6
Performance Improvements 0 8
Added Tests 5 148
Unchanged Tests 1147 990
Total Tests 1152

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
410.bwaves 3.94% 670624.000 697064.000 - 0.00% -
401.bzip2 1.69% 53812.000 54720.000 - 0.00% -
434.zeusmp 1.44% 1365588.000 1385236.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
464.h264ref 8.59% 3935.000 4273.000 - 0.00% -
445.gobmk 1.66% 5066.000 5150.000 - 0.00% -
400.perlbench 1.34% 1641.000 1663.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -26.09% 1920.000 1419.000 - 0.00% -
403.gcc -8.20% 61.000 56.000 - 0.00% -
450.soplex -2.10% 523.000 512.000 - 0.00% -
444.namd -1.18% 678.000 670.000 - 0.00% -
462.libquantum -1.12% 89.000 88.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 125.00% 24.000 54.000 - 0.00% -
nb_execution_successful 125.00% 24.000 54.000 - 0.00% -
nb_total_tests 82.35% 34.000 62.000 - 0.00% -

Added Tests - Code Size
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - Execution
416.gamess
435.gromacs
436.cactusADM
481.wrf

Added Tests - sample variability
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
416.gamess
416.gamess (avg)
416.gamess (avg) (percentage)
416.gamess (max)
416.gamess (max) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
435.gromacs
435.gromacs (avg)
435.gromacs (avg) (percentage)
435.gromacs (max)
435.gromacs (max) (percentage)
435.gromacs (unexplained diff vs previous)
435.gromacs (unexplained diff vs previous) (percentage)
436.cactusADM
436.cactusADM (avg)
436.cactusADM (avg) (percentage)
436.cactusADM (max)
436.cactusADM (max) (percentage)
436.cactusADM (unexplained diff vs previous)
436.cactusADM (unexplained diff vs previous) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
465.tonto
465.tonto (avg)
465.tonto (avg) (percentage)
465.tonto (max)
465.tonto (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
481.wrf
481.wrf (avg)
481.wrf (avg) (percentage)
481.wrf (max)
481.wrf (max) (percentage)
481.wrf (unexplained diff vs previous)
481.wrf (unexplained diff vs previous) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max) (percentage)


Report Time: 0.34s
Name Current %
400.perlbench 1663.000 -
401.bzip2 2568.000 -
403.gcc 56.000 -
410.bwaves 21516.000 -
416.gamess 39293.000 -
429.mcf 1419.000 -
433.milc 1237.000 -
434.zeusmp 8504.000 -
435.gromacs 17735.000 -
436.cactusADM 6769.000 -
437.leslie3d 56798.000 -
444.namd 670.000 -
445.gobmk 5150.000 -
447.dealII 1605.000 -
450.soplex 512.000 -
453.povray 440.000 -
456.hmmer 2833.000 -
458.sjeng 7136.000 -
459.GemsFDTD 23762.000 -
462.libquantum 88.000 -
464.h264ref 4273.000 -
465.tonto 68586.000 -
470.lbm 3167.000 -
471.omnetpp 2545.000 -
473.astar 5185.000 -
481.wrf 26268.000 -
482.sphinx3 797.000 -
Geometric Mean 3427.532 -
Name Current %
400.perlbench 1042982.000 -
401.bzip2 54720.000 -
403.gcc 3000748.000 -
410.bwaves 697064.000 -
416.gamess 12950510.000 -
429.mcf 11523.000 -
433.milc 103688.000 -
434.zeusmp 1385236.000 -
435.gromacs 990560.000 -
436.cactusADM 1343548.000 -
437.leslie3d 1145152.000 -
444.namd 194919.000 -
445.gobmk 1952334.000 -
447.dealII 2637605.000 -
450.soplex 305086.000 -
453.povray 772547.000 -
456.hmmer 251918.000 -
458.sjeng 124635.000 -
459.GemsFDTD 2133187.000 -
462.libquantum 35740.000 -
464.h264ref 462321.000 -
465.tonto 14167860.000 -
470.lbm 11368.000 -
471.omnetpp 634442.000 -
473.astar 34700.000 -
481.wrf 11198323.000 -
482.sphinx3 167857.000 -
Geometric Mean 498324.082 -
Name Current %
400.perlbench (max) 0.000 -
400.perlbench (max) (percentage) 0.000 -
401.bzip2 21.000 -
401.bzip2 (avg) 21.000 -
401.bzip2 (avg) (percentage) 0.830 -
401.bzip2 (max) 16.000 -
401.bzip2 (max) (percentage) 0.630 -
401.bzip2 (unexplained diff vs previous) 6.000 -
401.bzip2 (unexplained diff vs previous) (percentage) 0.230 -
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 0.470 -
403.gcc (max) 0.000 -
403.gcc (max) (percentage) 1.290 -
410.bwaves 25.000 -
410.bwaves (avg) 25.000 -
410.bwaves (avg) (percentage) 0.120 -
410.bwaves (max) 62.000 -
410.bwaves (max) (percentage) 0.290 -
410.bwaves (unexplained diff vs previous) 38.000 -
410.bwaves (unexplained diff vs previous) (percentage) 0.180 -
416.gamess 47.000 -
416.gamess (avg) 47.000 -
416.gamess (avg) (percentage) 0.120 -
416.gamess (max) 43.000 -
416.gamess (max) (percentage) 0.110 -
429.mcf 62.000 -
429.mcf (avg) 62.000 -
429.mcf (avg) (percentage) 4.430 -
429.mcf (max) 143.000 -
429.mcf (max) (percentage) 10.110 -
429.mcf (unexplained diff vs previous) 21.000 -
429.mcf (unexplained diff vs previous) (percentage) 1.480 -
433.milc 8.000 -
433.milc (avg) 8.000 -
433.milc (avg) (percentage) 0.660 -
433.milc (max) 11.000 -
433.milc (max) (percentage) 0.900 -
433.milc (unexplained diff vs previous) 11.000 -
433.milc (unexplained diff vs previous) (percentage) 0.890 -
434.zeusmp 11.000 -
434.zeusmp (avg) 11.000 -
434.zeusmp (avg) (percentage) 0.130 -
434.zeusmp (max) 15.000 -
434.zeusmp (max) (percentage) 0.180 -
434.zeusmp (unexplained diff vs previous) 14.000 -
434.zeusmp (unexplained diff vs previous) (percentage) 0.160 -
435.gromacs 90.000 -
435.gromacs (avg) 90.000 -
435.gromacs (avg) (percentage) 0.510 -
435.gromacs (max) 133.000 -
435.gromacs (max) (percentage) 0.750 -
435.gromacs (unexplained diff vs previous) 3.000 -
435.gromacs (unexplained diff vs previous) (percentage) 0.020 -
436.cactusADM 10.000 -
436.cactusADM (avg) 10.000 -
436.cactusADM (avg) (percentage) 0.150 -
436.cactusADM (max) 16.000 -
436.cactusADM (max) (percentage) 0.240 -
436.cactusADM (unexplained diff vs previous) 13.000 -
436.cactusADM (unexplained diff vs previous) (percentage) 0.190 -
437.leslie3d 159.000 -
437.leslie3d (avg) 159.000 -
437.leslie3d (avg) (percentage) 0.280 -
437.leslie3d (max) 437.000 -
437.leslie3d (max) (percentage) 0.770 -
437.leslie3d (unexplained diff vs previous) 67.000 -
437.leslie3d (unexplained diff vs previous) (percentage) 0.120 -
444.namd 4.000 -
444.namd (avg) 4.000 -
444.namd (avg) (percentage) 0.660 -
444.namd (max) 7.000 -
444.namd (max) (percentage) 1.190 -
444.namd (unexplained diff vs previous) 2.000 -
444.namd (unexplained diff vs previous) (percentage) 0.300 -
445.gobmk 25.000 -
445.gobmk (avg) 25.000 -
445.gobmk (avg) (percentage) 0.490 -
445.gobmk (max) 7.000 -
445.gobmk (max) (percentage) 0.140 -
447.dealII 12.000 -
447.dealII (avg) 12.000 -
447.dealII (avg) (percentage) 0.800 -
447.dealII (max) 10.000 -
447.dealII (max) (percentage) 0.660 -
450.soplex 16.000 -
450.soplex (avg) 16.000 -
450.soplex (avg) (percentage) 3.200 -
450.soplex (max) 22.000 -
450.soplex (max) (percentage) 4.380 -
450.soplex (unexplained diff vs previous) 6.000 -
450.soplex (unexplained diff vs previous) (percentage) 1.170 -
453.povray 4.000 -
453.povray (avg) 4.000 -
453.povray (avg) (percentage) 1.090 -
453.povray (max) 11.000 -
453.povray (max) (percentage) 2.550 -
456.hmmer 8.000 -
456.hmmer (avg) 8.000 -
456.hmmer (avg) (percentage) 0.290 -
456.hmmer (max) 13.000 -
456.hmmer (max) (percentage) 0.480 -
456.hmmer (unexplained diff vs previous) 5.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.180 -
458.sjeng 28.000 -
458.sjeng (avg) 28.000 -
458.sjeng (avg) (percentage) 0.400 -
458.sjeng (max) 41.000 -
458.sjeng (max) (percentage) 0.580 -
459.GemsFDTD 87.000 -
459.GemsFDTD (avg) 87.000 -
459.GemsFDTD (avg) (percentage) 0.370 -
459.GemsFDTD (max) 121.000 -
459.GemsFDTD (max) (percentage) 0.510 -
459.GemsFDTD (unexplained diff vs previous) 76.000 -
459.GemsFDTD (unexplained diff vs previous) (percentage) 0.320 -
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.990 -
462.libquantum (max) 4.000 -
462.libquantum (max) (percentage) 4.760 -
462.libquantum (unexplained diff vs previous) 4.000 -
462.libquantum (unexplained diff vs previous) (percentage) 4.550 -
464.h264ref 23.000 -
464.h264ref (avg) 23.000 -
464.h264ref (avg) (percentage) 0.560 -
464.h264ref (max) 49.000 -
464.h264ref (max) (percentage) 1.160 -
465.tonto 89.000 -
465.tonto (avg) 89.000 -
465.tonto (avg) (percentage) 0.130 -
465.tonto (max) 123.000 -
465.tonto (max) (percentage) 0.180 -
465.tonto (unexplained diff vs previous) 12.000 -
465.tonto (unexplained diff vs previous) (percentage) 0.020 -
470.lbm 14.000 -
470.lbm (avg) 14.000 -
470.lbm (avg) (percentage) 0.470 -
470.lbm (max) 19.000 -
470.lbm (max) (percentage) 0.600 -
470.lbm (unexplained diff vs previous) 2.000 -
470.lbm (unexplained diff vs previous) (percentage) 0.060 -
471.omnetpp 42.000 -
471.omnetpp (avg) 42.000 -
471.omnetpp (avg) (percentage) 1.670 -
471.omnetpp (max) 45.000 -
471.omnetpp (max) (percentage) 1.780 -
473.astar 72.000 -
473.astar (avg) 72.000 -
473.astar (avg) (percentage) 1.390 -
473.astar (max) 135.000 -
473.astar (max) (percentage) 2.620 -
473.astar (unexplained diff vs previous) 14.000 -
473.astar (unexplained diff vs previous) (percentage) 0.270 -
481.wrf 52.000 -
481.wrf (avg) 52.000 -
481.wrf (avg) (percentage) 0.200 -
481.wrf (max) 47.000 -
481.wrf (max) (percentage) 0.180 -
481.wrf (unexplained diff vs previous) 48.000 -
481.wrf (unexplained diff vs previous) (percentage) 0.180 -
482.sphinx3 12.000 -
482.sphinx3 (avg) 12.000 -
482.sphinx3 (avg) (percentage) 1.540 -
482.sphinx3 (max) 16.000 -
482.sphinx3 (max) (percentage) 2.130 -
482.sphinx3 (unexplained diff vs previous) 3.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.380 -
483.xalancbmk (avg) (percentage) 1.100 -
483.xalancbmk (max) (percentage) 1.170 -
Geometric Mean 2.987 -26.82%