Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/579e721ce91bd47a7e519a85f99498eb45d3d693 (+ 193 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/81/
Filter

llvm-aarch64-master-Oz_LTO test results

Run Order Start Time Duration
Current 0081 (llvmorg-18-init-12592-g579e721ce91b) 2023-11-14T03:04:15 0:00:00
Previous 0080 (llvmorg-18-init-12399-g907ed77ad1d7) 2023-11-03T22:55:52 0:00:00
Baseline 0001 (llvmorg-17-init-03810-g04a9c62554cf) 2023-03-03T19:15:36 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 5
Performance Improvements 15 4
Added Tests 2 76
Unchanged Tests 599 545
Total Tests 630

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
657.xz_s 5.87% 2777.000 2940.000 - -0.24% -
638.imagick_s 1.40% 3429.000 3477.000 - 1.85% -
605.mcf_s 1.35% 6840.000 6932.000 - 8.62% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
657.xz_s 6.02% 216.000 229.000 - 0.00% -
657.xz_s (avg) 6.02% 216.000 229.000 - 0.00% -
657.xz_s (max) 5.98% 535.000 567.000 - 0.00% -
641.leela_s 1.59% 63.000 64.000 - 0.00% -
641.leela_s (avg) 1.59% 63.000 64.000 - 0.00% -
638.imagick_s 1.50% 267.000 271.000 - 0.00% -
638.imagick_s (avg) 1.50% 267.000 271.000 - 0.00% -
638.imagick_s (max) 1.49% 404.000 410.000 - 0.00% -
605.mcf_s 1.40% 214.000 217.000 - 0.00% -
605.mcf_s (avg) 1.40% 214.000 217.000 - 0.00% -
605.mcf_s (max) 1.26% 633.000 641.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -6.67% 44981.000 41981.000 - -2.31% -
526.blender_r -1.93% 11162.000 10947.000 - 5.96% -
644.nab_s -1.90% 11717.000 11494.000 - -0.17% -
623.xalancbmk_s -1.55% 7355.000 7241.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -6.67% 5096.000 4756.000 - 0.00% -
619.lbm_s (avg) -6.67% 5096.000 4756.000 - 0.00% -
619.lbm_s (max) -6.67% 17079.000 15940.000 - 0.00% -
526.blender_r (max) -3.03% 33.000 32.000 - 0.00% -
644.nab_s (max) -1.92% 261.000 256.000 - 0.00% -
644.nab_s -1.88% 160.000 157.000 - 0.00% -
644.nab_s (avg) -1.88% 160.000 157.000 - 0.00% -
526.blender_r -1.59% 63.000 62.000 - 0.00% -
526.blender_r (avg) -1.59% 63.000 62.000 - 0.00% -
631.deepsjeng_s -1.02% 98.000 97.000 - 0.00% -
631.deepsjeng_s (avg) -1.02% 98.000 97.000 - 0.00% -

Added Tests - Score
nb_compile_successful
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s 8.62% 6382.000 6932.000 - 1.35% -
526.blender_r 5.96% 10331.000 10947.000 - -1.93% -
508.namd_r 3.26% 2703.000 2791.000 - 0.14% -
638.imagick_s 1.85% 3414.000 3477.000 - 1.40% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -33.33% 24.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s -4.72% 4516.000 4303.000 - -0.58% -
619.lbm_s -2.31% 42973.000 41981.000 - -6.67% -
600.perlbench_s -1.79% 3527.000 3464.000 - 0.90% -
511.povray_r -1.13% 532.000 526.000 - -0.19% -

Added Tests - Execution
510.parest_r
620.omnetpp_s
623.xalancbmk_s
641.leela_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_compile_successful
nb_execution_successful


Report Time: 0.22s
Name Current %
508.namd_r 2791.000 -
510.parest_r 6528.000 -
511.povray_r 526.000 -
526.blender_r 10947.000 -1.93%
600.perlbench_s 3464.000 -
602.gcc_s 6373.000 -
605.mcf_s 6932.000 1.35%
619.lbm_s 41981.000 -6.67%
620.omnetpp_s 4789.000 -
623.xalancbmk_s 7241.000 -1.55%
625.x264_s 4929.000 -
631.deepsjeng_s 4303.000 -
638.imagick_s 3477.000 1.40%
641.leela_s 4742.000 -
644.nab_s 11494.000 -1.90%
657.xz_s 2940.000 5.87%
Geometric Mean 5188.906 -
Name Current %
508.namd_r 64.000 -
508.namd_r (avg) 64.000 -
508.namd_r (avg) (percentage) 2.320 -
508.namd_r (max) 169.000 -
508.namd_r (max) (percentage) 6.070 -
510.parest_r 296.000 -
510.parest_r (avg) 296.000 -
510.parest_r (avg) (percentage) 4.540 -
510.parest_r (max) 622.000 -
510.parest_r (max) (percentage) 9.530 -
511.povray_r 18.000 -
511.povray_r (avg) 18.000 -
511.povray_r (avg) (percentage) 3.540 -
511.povray_r (max) 24.000 -
511.povray_r (max) (percentage) 4.580 -
526.blender_r 62.000 -1.59%
526.blender_r (avg) 62.000 -1.59%
526.blender_r (avg) (percentage) 0.570 -
526.blender_r (max) 32.000 -3.03%
526.blender_r (max) (percentage) 0.300 -
600.perlbench_s 246.000 -
600.perlbench_s (avg) 246.000 -
600.perlbench_s (avg) (percentage) 7.120 -
600.perlbench_s (max) 351.000 -
600.perlbench_s (max) (percentage) 10.150 -
605.mcf_s 217.000 1.40%
605.mcf_s (avg) 217.000 1.40%
605.mcf_s (avg) (percentage) 3.140 -
605.mcf_s (max) 641.000 1.26%
605.mcf_s (max) (percentage) 9.260 -
619.lbm_s 4756.000 -6.67%
619.lbm_s (avg) 4756.000 -6.67%
619.lbm_s (avg) (percentage) 11.330 -
619.lbm_s (max) 15940.000 -6.67%
619.lbm_s (max) (percentage) 37.970 -
620.omnetpp_s 261.000 -
620.omnetpp_s (avg) 261.000 -
620.omnetpp_s (avg) (percentage) 5.470 -
620.omnetpp_s (max) 612.000 -
620.omnetpp_s (max) (percentage) 12.790 -
625.x264_s 42.000 -
625.x264_s (avg) 42.000 -
625.x264_s (avg) (percentage) 0.870 -
625.x264_s (max) 67.000 -
625.x264_s (max) (percentage) 1.370 -
631.deepsjeng_s 97.000 -1.02%
631.deepsjeng_s (avg) 97.000 -1.02%
631.deepsjeng_s (avg) (percentage) 2.270 -
631.deepsjeng_s (max) 310.000 -
631.deepsjeng_s (max) (percentage) 7.210 -
638.imagick_s 271.000 1.50%
638.imagick_s (avg) 271.000 1.50%
638.imagick_s (avg) (percentage) 7.800 -
638.imagick_s (max) 410.000 1.49%
638.imagick_s (max) (percentage) 11.810 -
641.leela_s 64.000 1.59%
641.leela_s (avg) 64.000 1.59%
641.leela_s (avg) (percentage) 1.350 -
641.leela_s (max) 183.000 -
641.leela_s (max) (percentage) 3.860 -
644.nab_s 157.000 -1.88%
644.nab_s (avg) 157.000 -1.88%
644.nab_s (avg) (percentage) 1.370 -
644.nab_s (max) 256.000 -1.92%
644.nab_s (max) (percentage) 2.230 -
657.xz_s 229.000 6.02%
657.xz_s (avg) 229.000 6.02%
657.xz_s (avg) (percentage) 7.790 -
657.xz_s (max) 567.000 5.98%
657.xz_s (max) (percentage) 19.300 -
Geometric Mean 41.644 -