Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/ac42b083f104442e12393ff09929a1add881010d (+ 170 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-Os_LTO-build/135/
Filter

llvm-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0135 (llvmorg-21-init-07777-gac42b083f104) 2025-04-03T15:39:01 0:00:00
Previous 0134 (llvmorg-21-init-07607-gf8f9be32411d) 2025-03-30T04:15:06 0:00:00
Baseline 0003 (llvmorg-19-init-10108-gcd132dcbeb0f) 2024-05-02T07:22:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 33 10
Performance Improvements 48 6
Added Tests 0 81
Unchanged Tests 597 581
Total Tests 678

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 733.33% 0.030 0.250 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 625.00% 4.000 29.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 277.27% 0.220 0.830 - 0.00% -
526.blender_r (unexplained diff vs previous) 276.00% 25.000 94.000 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 150.00% 0.240 0.600 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) 141.67% 24.000 58.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) 75.00% 4.000 7.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 68.57% 0.350 0.590 - 0.00% -
523.xalancbmk_r (max) 67.65% 34.000 57.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 66.67% 0.030 0.050 - 0.00% -
510.parest_r (unexplained diff vs previous) 60.00% 25.000 40.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 58.33% 0.120 0.190 - 0.00% -
519.lbm_r (max) (percentage) 47.62% 0.210 0.310 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 47.62% 0.210 0.310 - 0.00% -
519.lbm_r (max) 46.88% 32.000 47.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 42.42% 33.000 47.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 24.47% 1.880 2.340 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 21.35% 178.000 216.000 - 0.00% -
525.x264_r (unexplained diff vs previous) 20.69% 29.000 35.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 19.27% 1.920 2.290 - 0.00% -
525.x264_r (max) (percentage) 19.23% 0.260 0.310 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 19.23% 0.260 0.310 - 0.00% -
525.x264_r (max) 17.24% 29.000 34.000 - 0.00% -
531.deepsjeng_r (max) 16.57% 181.000 211.000 - 0.00% -
510.parest_r 6.90% 29.000 31.000 - 0.00% -
510.parest_r (avg) 6.90% 29.000 31.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) 5.00% 0.400 0.420 - 0.00% -
526.blender_r 4.08% 49.000 51.000 - 0.00% -
526.blender_r (avg) 4.08% 49.000 51.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 3.70% 1.080 1.120 - 0.00% -
523.xalancbmk_r 2.56% 39.000 40.000 - 0.00% -
523.xalancbmk_r (avg) 2.56% 39.000 40.000 - 0.00% -
526.blender_r (avg) (percentage) 2.27% 0.440 0.450 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -2.29% 9448.000 9232.000 - -0.59% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r (unexplained diff vs previous) (percentage) -88.57% 0.350 0.040 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) -88.52% 0.610 0.070 - 0.00% -
511.povray_r (unexplained diff vs previous) -88.46% 104.000 12.000 - 0.00% -
541.leela_r (unexplained diff vs previous) -87.18% 39.000 5.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) -84.00% 0.250 0.040 - 0.00% -
544.nab_r (unexplained diff vs previous) -82.14% 28.000 5.000 - 0.00% -
557.xz_r (unexplained diff vs previous) -81.82% 22.000 4.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -81.82% 0.220 0.040 - 0.00% -
505.mcf_r (unexplained diff vs previous) -66.67% 24.000 8.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -66.67% 0.180 0.060 - 0.00% -
541.leela_r (max) (percentage) -27.78% 0.360 0.260 - 0.00% -
541.leela_r (max) -27.50% 40.000 29.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -22.73% 0.220 0.170 - 0.00% -
508.namd_r (unexplained diff vs previous) -20.00% 20.000 16.000 - 0.00% -
544.nab_r (max) -17.86% 28.000 23.000 - 0.00% -
544.nab_r (max) (percentage) -16.00% 0.250 0.210 - 0.00% -
505.mcf_r (max) -12.50% 24.000 21.000 - 0.00% -
557.xz_r (max) -12.00% 25.000 22.000 - 0.00% -
557.xz_r (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
505.mcf_r (max) (percentage) -11.11% 0.180 0.160 - 0.00% -
508.namd_r (max) -10.00% 20.000 18.000 - 0.00% -
508.namd_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
526.blender_r (max) (percentage) -7.02% 1.140 1.060 - 0.00% -
510.parest_r (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
510.parest_r (max) -6.67% 60.000 56.000 - 0.00% -
526.blender_r (max) -6.25% 128.000 120.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.18% 2.590 2.430 - 0.00% -
520.omnetpp_r (max) -6.06% 297.000 279.000 - 0.00% -
544.nab_r -5.71% 35.000 33.000 - 0.00% -
544.nab_r (avg) -5.71% 35.000 33.000 - 0.00% -
511.povray_r (avg) (percentage) -5.13% 0.390 0.370 - 0.00% -
505.mcf_r -5.13% 39.000 37.000 - 0.00% -
505.mcf_r (avg) -5.13% 39.000 37.000 - 0.00% -
511.povray_r -4.55% 66.000 63.000 - 0.00% -
511.povray_r (avg) -4.55% 66.000 63.000 - 0.00% -
541.leela_r (avg) (percentage) -4.35% 0.230 0.220 - 0.00% -
541.leela_r -4.00% 25.000 24.000 - 0.00% -
541.leela_r (avg) -4.00% 25.000 24.000 - 0.00% -
538.imagick_r (avg) (percentage) -3.70% 0.270 0.260 - 0.00% -
544.nab_r (avg) (percentage) -3.23% 0.310 0.300 - 0.00% -
538.imagick_r -2.78% 36.000 35.000 - 0.00% -
538.imagick_r (avg) -2.78% 36.000 35.000 - 0.00% -
511.povray_r (max) (percentage) -2.15% 0.930 0.910 - 0.00% -
511.povray_r (max) -1.89% 159.000 156.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.77% 1.130 1.110 - 0.00% -
520.omnetpp_r -1.55% 129.000 127.000 - 0.00% -
520.omnetpp_r (avg) -1.55% 129.000 127.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 3.32% 57556.000 59468.000 - 0.00% -
510.parest_r 1.60% 970810.000 986378.000 - 0.00% -
557.xz_r 1.01% 84259.000 85111.000 - 0.00% -
519.lbm_r 1.01% 9496.000 9592.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.07% 10835.000 11384.000 - 0.83% -
519.lbm_r 3.91% 14766.000 15344.000 - -0.31% -
520.omnetpp_r 2.00% 11275.000 11501.000 - 0.25% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.94% 34.000 16.000 - 0.00% -
nb_execution_successful -50.00% 30.000 15.000 - 0.00% -
nb_compile_successful -46.67% 30.000 16.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -2.22% 15106.000 14770.000 - 0.00% -
508.namd_r -1.05% 323621.000 320209.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -10.12% 12417.000 11160.000 - -0.31% -
508.namd_r -2.90% 9423.000 9150.000 - -0.17% -
538.imagick_r -1.42% 13781.000 13585.000 - 0.05% -
511.povray_r -1.15% 17346.000 17147.000 - 0.07% -

Added Tests - Code Size
523.xalancbmk_r

Added Tests - Execution
523.xalancbmk_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
502.gcc_r 9007.000 -
505.mcf_r 13445.000 -
508.namd_r 9150.000 -
510.parest_r 20842.000 -
511.povray_r 17147.000 -
519.lbm_r 15344.000 -
520.omnetpp_r 11501.000 -
523.xalancbmk_r 9745.000 -
525.x264_r 11160.000 -
526.blender_r 11384.000 -
531.deepsjeng_r 9232.000 -2.29%
538.imagick_r 13585.000 -
541.leela_r 11263.000 -
544.nab_r 11329.000 -
557.xz_r 10165.000 -
Geometric Mean 11927.815 -
Name Current %
502.gcc_r 5261516.000 -
505.mcf_r 14770.000 -
508.namd_r 320209.000 -
510.parest_r 986378.000 -
511.povray_r 567896.000 -
519.lbm_r 9592.000 -
520.omnetpp_r 925262.000 -
523.xalancbmk_r 1966614.000 -
525.x264_r 320162.000 -
526.blender_r 6461284.000 -
531.deepsjeng_r 59468.000 -
538.imagick_r 841969.000 -
541.leela_r 49994.000 -
544.nab_r 52865.000 -
557.xz_r 85111.000 -
Geometric Mean 281988.459 -
Name Current %
500.perlbench_r (avg) (percentage) 0.520 -
500.perlbench_r (max) (percentage) 0.520 -
502.gcc_r 33.000 -
502.gcc_r (avg) 33.000 -
502.gcc_r (avg) (percentage) 0.370 -
502.gcc_r (max) 29.000 -
502.gcc_r (max) (percentage) 0.330 -
505.mcf_r 37.000 -5.13%
505.mcf_r (avg) 37.000 -5.13%
505.mcf_r (avg) (percentage) 0.280 -
505.mcf_r (max) 21.000 -12.50%
505.mcf_r (max) (percentage) 0.160 -11.11%
505.mcf_r (unexplained diff vs previous) 8.000 -66.67%
505.mcf_r (unexplained diff vs previous) (percentage) 0.060 -66.67%
508.namd_r 26.000 -
508.namd_r (avg) 26.000 -
508.namd_r (avg) (percentage) 0.290 -
508.namd_r (max) 18.000 -10.00%
508.namd_r (max) (percentage) 0.200 -9.09%
508.namd_r (unexplained diff vs previous) 16.000 -20.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.170 -22.73%
510.parest_r 31.000 6.90%
510.parest_r (avg) 31.000 6.90%
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 56.000 -6.67%
510.parest_r (max) (percentage) 0.270 -6.90%
510.parest_r (unexplained diff vs previous) 40.000 60.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.190 58.33%
511.povray_r 63.000 -4.55%
511.povray_r (avg) 63.000 -4.55%
511.povray_r (avg) (percentage) 0.370 -5.13%
511.povray_r (max) 156.000 -1.89%
511.povray_r (max) (percentage) 0.910 -2.15%
511.povray_r (unexplained diff vs previous) 12.000 -88.46%
511.povray_r (unexplained diff vs previous) (percentage) 0.070 -88.52%
519.lbm_r 24.000 -
519.lbm_r (avg) 24.000 -
519.lbm_r (avg) (percentage) 0.160 -
519.lbm_r (max) 47.000 46.88%
519.lbm_r (max) (percentage) 0.310 47.62%
519.lbm_r (unexplained diff vs previous) 47.000 42.42%
519.lbm_r (unexplained diff vs previous) (percentage) 0.310 47.62%
520.omnetpp_r 127.000 -1.55%
520.omnetpp_r (avg) 127.000 -1.55%
520.omnetpp_r (avg) (percentage) 1.110 -1.77%
520.omnetpp_r (max) 279.000 -6.06%
520.omnetpp_r (max) (percentage) 2.430 -6.18%
520.omnetpp_r (unexplained diff vs previous) 29.000 625.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.250 733.33%
523.xalancbmk_r 40.000 2.56%
523.xalancbmk_r (avg) 40.000 2.56%
523.xalancbmk_r (avg) (percentage) 0.420 5.00%
523.xalancbmk_r (max) 57.000 67.65%
523.xalancbmk_r (max) (percentage) 0.590 68.57%
523.xalancbmk_r (unexplained diff vs previous) 58.000 141.67%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.600 150.00%
525.x264_r 24.000 -
525.x264_r (avg) 24.000 -
525.x264_r (avg) (percentage) 0.220 -
525.x264_r (max) 34.000 17.24%
525.x264_r (max) (percentage) 0.310 19.23%
525.x264_r (unexplained diff vs previous) 35.000 20.69%
525.x264_r (unexplained diff vs previous) (percentage) 0.310 19.23%
526.blender_r 51.000 4.08%
526.blender_r (avg) 51.000 4.08%
526.blender_r (avg) (percentage) 0.450 2.27%
526.blender_r (max) 120.000 -6.25%
526.blender_r (max) (percentage) 1.060 -7.02%
526.blender_r (unexplained diff vs previous) 94.000 276.00%
526.blender_r (unexplained diff vs previous) (percentage) 0.830 277.27%
531.deepsjeng_r 103.000 -
531.deepsjeng_r (avg) 103.000 -
531.deepsjeng_r (avg) (percentage) 1.120 3.70%
531.deepsjeng_r (max) 211.000 16.57%
531.deepsjeng_r (max) (percentage) 2.290 19.27%
531.deepsjeng_r (unexplained diff vs previous) 216.000 21.35%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 2.340 24.47%
538.imagick_r 35.000 -2.78%
538.imagick_r (avg) 35.000 -2.78%
538.imagick_r (avg) (percentage) 0.260 -3.70%
538.imagick_r (max) 29.000 -
538.imagick_r (max) (percentage) 0.220 -
538.imagick_r (unexplained diff vs previous) 7.000 75.00%
538.imagick_r (unexplained diff vs previous) (percentage) 0.050 66.67%
541.leela_r 24.000 -4.00%
541.leela_r (avg) 24.000 -4.00%
541.leela_r (avg) (percentage) 0.220 -4.35%
541.leela_r (max) 29.000 -27.50%
541.leela_r (max) (percentage) 0.260 -27.78%
541.leela_r (unexplained diff vs previous) 5.000 -87.18%
541.leela_r (unexplained diff vs previous) (percentage) 0.040 -88.57%
544.nab_r 33.000 -5.71%
544.nab_r (avg) 33.000 -5.71%
544.nab_r (avg) (percentage) 0.300 -3.23%
544.nab_r (max) 23.000 -17.86%
544.nab_r (max) (percentage) 0.210 -16.00%
544.nab_r (unexplained diff vs previous) 5.000 -82.14%
544.nab_r (unexplained diff vs previous) (percentage) 0.040 -84.00%
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 22.000 -12.00%
557.xz_r (max) (percentage) 0.220 -12.00%
557.xz_r (unexplained diff vs previous) 4.000 -81.82%
557.xz_r (unexplained diff vs previous) (percentage) 0.040 -81.82%
Geometric Mean 4.315 -5.60%