Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/02ce8227ac28e0b83cf780716ae8f912d076eebe (+ 160 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz-build/151/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0151 (llvmorg-19-init-10517-g02ce8227ac28) 2024-05-03T04:49:57 0:00:00
Previous 0150 (llvmorg-19-init-10357-g1022636b0ce3) 2024-04-29T05:53:37 0:00:00
Baseline 0140 (llvmorg-19-init-07219-g72e2e4f7dc68) 2024-04-03T16:00:23 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 0
Performance Improvements 15 3
Added Tests 4 20
Unchanged Tests 275 277
Total Tests 300

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (max) 426.09% 23.000 121.000 - 0.00% -
526.blender_r (max) (percentage) 420.00% 0.250 1.300 - 0.00% -
526.blender_r 186.49% 37.000 106.000 - 0.00% -
526.blender_r (avg) 186.49% 37.000 106.000 - 0.00% -
526.blender_r (avg) (percentage) 185.00% 0.400 1.140 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -7.69% 52.000 48.000 - 100.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
526.blender_r -1.30% 9476.000 9353.000 - -0.84% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) -83.33% 18.000 3.000 0.000 0.00% 0.000
508.namd_r (unexplained diff vs previous) (percentage) -82.86% 0.700 0.120 0.000 0.00% 0.000
511.povray_r -33.33% 3.000 2.000 - 0.00% -
511.povray_r (avg) -33.33% 3.000 2.000 - 0.00% -
510.parest_r (unexplained diff vs previous) -25.00% 24.000 18.000 0.000 0.00% 0.000
510.parest_r (unexplained diff vs previous) (percentage) -23.91% 0.460 0.350 0.000 0.00% 0.000
508.namd_r -20.00% 10.000 8.000 - 0.00% -
508.namd_r (avg) -20.00% 10.000 8.000 - 0.00% -
508.namd_r (avg) (percentage) -17.50% 0.400 0.330 - 0.00% -
511.povray_r (avg) (percentage) -17.46% 0.630 0.520 - 0.00% -
508.namd_r (max) -16.67% 18.000 15.000 - 0.00% -
508.namd_r (max) (percentage) -12.86% 0.700 0.610 - 0.00% -
510.parest_r (max) -12.50% 24.000 21.000 - 0.00% -
510.parest_r (max) (percentage) -12.50% 0.480 0.420 - 0.00% -

Added Tests - sample variability
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 100.00% 4.000 8.000 - 0.00% -
nb_total_tests 100.00% 24.000 48.000 - -7.69% -
nb_compile_successful 81.82% 22.000 40.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)


Report Time: 0.21s
Name Current %
508.namd_r 2582.000 -
510.parest_r 5150.000 -
511.povray_r 478.000 -
526.blender_r 9353.000 -1.30%
Geometric Mean 2776.742 -
Name Current %
508.namd_r 422433.000 -
510.parest_r 5537595.000 -
511.povray_r 739132.000 -
526.blender_r 12081521.000 -
Geometric Mean 2137866.891 -
Name Current %
nb_compile_successful 40.000 -
nb_execution_successful 8.000 -
nb_total_tests 48.000 -7.69%
Geometric Mean 24.858 -2.63%