Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/aebe6c5d7f88a05a29ef6c643482ca7eaf994b19 (+ 8800 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Oz_LTO-build/110/
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0110 (llvmorg-21-init-01270-gaebe6c5d7f88) 2024-12-26T05:13:55 0:00:00
Previous 0081 (llvmorg-20-init-11975-ge887f8290df4) 2024-11-10T04:52:18 0:00:00
Baseline 0025 (llvmorg-19-init-16254-g1846523bb772) 2024-07-02T11:39:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 4
Performance Improvements 25 5
Added Tests 0 77
Unchanged Tests 608 556
Total Tests 642

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 1491.67% 0.120 1.910 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 1437.50% 16.000 246.000 - 0.00% -
520.omnetpp_r (max) (percentage) 86.14% 1.010 1.880 - 0.00% -
520.omnetpp_r (max) 82.58% 132.000 241.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 9.84% 0.610 0.670 - 0.00% -
520.omnetpp_r 8.86% 79.000 86.000 - 0.00% -
520.omnetpp_r (avg) 8.86% 79.000 86.000 - 0.00% -
541.leela_r 3.23% 31.000 32.000 - 0.00% -
541.leela_r (avg) 3.23% 31.000 32.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -1.88% 13105.000 12859.000 - -3.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) -11.59% 69.000 61.000 - 0.00% -
505.mcf_r (max) (percentage) -11.32% 0.530 0.470 - 0.00% -
525.x264_r (max) -7.50% 40.000 37.000 - 0.00% -
525.x264_r (max) (percentage) -7.14% 0.280 0.260 - 0.00% -
523.xalancbmk_r (max) -6.67% 30.000 28.000 - 0.00% -
557.xz_r (max) -6.33% 79.000 74.000 - 0.00% -
508.namd_r (max) -6.00% 100.000 94.000 - 0.00% -
508.namd_r (max) (percentage) -5.94% 1.010 0.950 - 0.00% -
544.nab_r (max) -5.68% 88.000 83.000 - 0.00% -
526.blender_r (max) -5.45% 110.000 104.000 - 0.00% -
526.blender_r (max) (percentage) -5.43% 0.920 0.870 - 0.00% -
557.xz_r (max) (percentage) -5.33% 0.750 0.710 - 0.00% -
544.nab_r (max) (percentage) -5.19% 0.770 0.730 - 0.00% -
525.x264_r (unexplained diff vs previous) -4.76% 21.000 20.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
500.perlbench_r (max) -3.16% 158.000 153.000 - 0.00% -
541.leela_r (max) (percentage) -2.94% 0.340 0.330 - 0.00% -
500.perlbench_r (max) (percentage) -2.75% 1.090 1.060 - 0.00% -
541.leela_r (max) -2.50% 40.000 39.000 - 0.00% -
538.imagick_r (max) -2.22% 90.000 88.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.08% 0.480 0.470 - 0.00% -
531.deepsjeng_r (max) -2.00% 50.000 49.000 - 0.00% -
538.imagick_r (max) (percentage) -1.52% 0.660 0.650 - 0.00% -
511.povray_r (max) -1.30% 77.000 76.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 20.31% 12552.000 15101.000 - -0.40% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -
nb_execution_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -3.07% 13266.000 12859.000 - -1.88% -
500.perlbench_r -2.91% 14941.000 14506.000 - -0.04% -
538.imagick_r -2.62% 14043.000 13675.000 - -0.80% -
531.deepsjeng_r -1.16% 10739.000 10614.000 - 0.22% -
526.blender_r -1.03% 12129.000 12004.000 - 0.04% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 14506.000 -
502.gcc_r 9900.000 -
505.mcf_r 13176.000 -
508.namd_r 9940.000 -
510.parest_r 22717.000 -
511.povray_r 20122.000 -
519.lbm_r 15101.000 -
520.omnetpp_r 12859.000 -1.88%
523.xalancbmk_r 11122.000 -
525.x264_r 14497.000 -
526.blender_r 12004.000 -
531.deepsjeng_r 10614.000 -
538.imagick_r 13675.000 -
541.leela_r 11893.000 -
544.nab_r 11407.000 -
557.xz_r 10460.000 -
Geometric Mean 13000.154 -
Name Current %
500.perlbench_r 1111218.000 -
502.gcc_r 4427681.000 -
505.mcf_r 12365.000 -
508.namd_r 276305.000 -
510.parest_r 748221.000 -
511.povray_r 515184.000 -
519.lbm_r 9300.000 -
520.omnetpp_r 824344.000 -
523.xalancbmk_r 1705428.000 -
525.x264_r 269489.000 -
526.blender_r 5797475.000 -
531.deepsjeng_r 50054.000 -
538.imagick_r 711456.000 -
541.leela_r 43060.000 -
544.nab_r 49193.000 -
557.xz_r 80211.000 -
Geometric Mean 270067.359 -
Name Current %
500.perlbench_r 85.000 -
500.perlbench_r (avg) 85.000 -
500.perlbench_r (avg) (percentage) 0.590 -
500.perlbench_r (max) 153.000 -3.16%
500.perlbench_r (max) (percentage) 1.060 -2.75%
505.mcf_r 42.000 -
505.mcf_r (avg) 42.000 -
505.mcf_r (avg) (percentage) 0.320 -
505.mcf_r (max) 61.000 -11.59%
505.mcf_r (max) (percentage) 0.470 -11.32%
508.namd_r 28.000 -
508.namd_r (avg) 28.000 -
508.namd_r (avg) (percentage) 0.290 -
508.namd_r (max) 94.000 -6.00%
508.namd_r (max) (percentage) 0.950 -5.94%
510.parest_r 15.000 -
510.parest_r (avg) 15.000 -
510.parest_r (avg) (percentage) 0.070 -
510.parest_r (max) 22.000 -
510.parest_r (max) (percentage) 0.100 -
511.povray_r 64.000 -
511.povray_r (avg) 64.000 -
511.povray_r (avg) (percentage) 0.320 -
511.povray_r (max) 76.000 -1.30%
511.povray_r (max) (percentage) 0.380 -
519.lbm_r 24.000 -
519.lbm_r (avg) 24.000 -
519.lbm_r (avg) (percentage) 0.160 -
519.lbm_r (max) 6.000 -
519.lbm_r (max) (percentage) 0.040 -
520.omnetpp_r 86.000 8.86%
520.omnetpp_r (avg) 86.000 8.86%
520.omnetpp_r (avg) (percentage) 0.670 9.84%
520.omnetpp_r (max) 241.000 82.58%
520.omnetpp_r (max) (percentage) 1.880 86.14%
520.omnetpp_r (unexplained diff vs previous) 246.000 1437.50%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.910 1491.67%
523.xalancbmk_r 36.000 -
523.xalancbmk_r (avg) 36.000 -
523.xalancbmk_r (avg) (percentage) 0.330 -
523.xalancbmk_r (max) 28.000 -6.67%
523.xalancbmk_r (max) (percentage) 0.260 -3.70%
525.x264_r 31.000 -
525.x264_r (avg) 31.000 -
525.x264_r (avg) (percentage) 0.220 -
525.x264_r (max) 37.000 -7.50%
525.x264_r (max) (percentage) 0.260 -7.14%
525.x264_r (unexplained diff vs previous) 20.000 -4.76%
525.x264_r (unexplained diff vs previous) (percentage) 0.140 -
526.blender_r 40.000 -
526.blender_r (avg) 40.000 -
526.blender_r (avg) (percentage) 0.340 -
526.blender_r (max) 104.000 -5.45%
526.blender_r (max) (percentage) 0.870 -5.43%
531.deepsjeng_r 80.000 -
531.deepsjeng_r (avg) 80.000 -
531.deepsjeng_r (avg) (percentage) 0.760 -
531.deepsjeng_r (max) 49.000 -2.00%
531.deepsjeng_r (max) (percentage) 0.470 -2.08%
538.imagick_r 45.000 -
538.imagick_r (avg) 45.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 88.000 -2.22%
538.imagick_r (max) (percentage) 0.650 -1.52%
541.leela_r 32.000 3.23%
541.leela_r (avg) 32.000 3.23%
541.leela_r (avg) (percentage) 0.270 -
541.leela_r (max) 39.000 -2.50%
541.leela_r (max) (percentage) 0.330 -2.94%
544.nab_r 51.000 -
544.nab_r (avg) 51.000 -
544.nab_r (avg) (percentage) 0.450 -
544.nab_r (max) 83.000 -5.68%
544.nab_r (max) (percentage) 0.730 -5.19%
557.xz_r 25.000 -
557.xz_r (avg) 25.000 -
557.xz_r (avg) (percentage) 0.240 -
557.xz_r (max) 74.000 -6.33%
557.xz_r (max) (percentage) 0.710 -5.33%
Geometric Mean 6.595 7.65%