Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/7ef77eb9984d1fb537a409cf4be89560fbb681fe (+ 452 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-Oz-build/256/
Filter

llvm-arm-master-Oz test results

Run Order Start Time Duration
Current 0256 (llvmorg-21-init-15195-g7ef77eb9984d) 2025-06-08T19:21:13 0:00:00
Previous 0255 (llvmorg-21-init-14743-g03f616eb3acf) 2025-06-05T04:33:17 0:00:00
Baseline 0002 (llvmorg-17-init-04570-g24416d22bb28) 2023-03-12T06:27:23 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 4
Performance Improvements 45 10
Added Tests 0 74
Unchanged Tests 559 542
Total Tests 630

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) (percentage) 450.00% 0.140 0.770 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 437.50% 8.000 43.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 410.00% 0.100 0.510 - 0.00% -
519.lbm_r (unexplained diff vs previous) 400.00% 4.000 20.000 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) 353.85% 0.390 1.770 - 0.00% -
511.povray_r (unexplained diff vs previous) 350.00% 2.000 9.000 - 0.00% -
531.deepsjeng_r (max) 168.75% 16.000 43.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 156.67% 0.300 0.770 - 0.00% -
519.lbm_r (max) 150.00% 8.000 20.000 - 0.00% -
519.lbm_r (max) (percentage) 126.09% 0.230 0.520 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 102.74% 0.730 1.480 - 0.00% -
523.xalancbmk_r (max) (percentage) 100.00% 0.730 1.460 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) 100.00% 34.000 68.000 - 0.00% -
523.xalancbmk_r (max) 97.06% 34.000 67.000 - 0.00% -
511.povray_r (max) (percentage) 47.46% 1.180 1.740 - 0.00% -
511.povray_r (max) 33.33% 6.000 8.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 25.00% 0.120 0.150 - 0.00% -
525.x264_r (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
519.lbm_r 11.11% 9.000 10.000 - 0.00% -
519.lbm_r (avg) 11.11% 9.000 10.000 - 0.00% -
531.deepsjeng_r 5.56% 18.000 19.000 - 0.00% -
531.deepsjeng_r (avg) 5.56% 18.000 19.000 - 0.00% -
519.lbm_r (avg) (percentage) 4.00% 0.250 0.260 - 0.00% -
523.xalancbmk_r (avg) (percentage) 3.45% 0.580 0.600 - 0.00% -
531.deepsjeng_r (avg) (percentage) 3.03% 0.330 0.340 - 0.00% -
511.povray_r (avg) (percentage) 2.15% 0.930 0.950 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r -1.74% 518.000 509.000 - -1.36% -
523.xalancbmk_r -1.46% 4661.000 4593.000 - -1.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (unexplained diff vs previous) -97.44% 39.000 1.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -97.40% 1.540 0.040 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -90.91% 1.650 0.150 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -90.77% 65.000 6.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) -81.97% 61.000 11.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -81.55% 1.030 0.190 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -56.36% 0.550 0.240 - 0.00% -
508.namd_r (max) -55.56% 18.000 8.000 - 0.00% -
541.leela_r (unexplained diff vs previous) -55.17% 29.000 13.000 - 0.00% -
508.namd_r (max) (percentage) -52.94% 0.510 0.240 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -44.90% 0.490 0.270 - 0.00% -
526.blender_r (unexplained diff vs previous) -43.75% 64.000 36.000 - 0.00% -
526.blender_r (max) -39.77% 88.000 53.000 - 0.00% -
526.blender_r (max) (percentage) -39.71% 0.680 0.410 - 0.00% -
508.namd_r (unexplained diff vs previous) -20.00% 10.000 8.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -18.52% 0.270 0.220 - 0.00% -
557.xz_r (max) -13.16% 38.000 33.000 - 0.00% -
557.xz_r (max) (percentage) -12.50% 1.520 1.330 - 0.00% -
541.leela_r (max) -11.76% 34.000 30.000 - 0.00% -
520.omnetpp_r (max) (percentage) -10.92% 2.840 2.530 - 0.00% -
520.omnetpp_r (max) -10.81% 111.000 99.000 - 0.00% -
525.x264_r (max) (percentage) -10.26% 0.780 0.700 - 0.00% -
505.mcf_r (max) -9.84% 61.000 55.000 - 0.00% -
525.x264_r (max) -9.68% 31.000 28.000 - 0.00% -
505.mcf_r (max) (percentage) -9.62% 1.040 0.940 - 0.00% -
541.leela_r (max) (percentage) -9.38% 0.640 0.580 - 0.00% -
544.nab_r (unexplained diff vs previous) -7.55% 53.000 49.000 - 0.00% -
544.nab_r (max) (percentage) -6.35% 0.630 0.590 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) -6.35% 0.630 0.590 - 0.00% -
544.nab_r (max) -5.77% 52.000 49.000 - 0.00% -
510.parest_r (max) (percentage) -5.71% 0.350 0.330 - 0.00% -
557.xz_r -4.55% 22.000 21.000 - 0.00% -
557.xz_r (avg) -4.55% 22.000 21.000 - 0.00% -
510.parest_r (max) -4.35% 23.000 22.000 - 0.00% -
505.mcf_r -2.56% 39.000 38.000 - 0.00% -
505.mcf_r (avg) -2.56% 39.000 38.000 - 0.00% -
557.xz_r (avg) (percentage) -2.25% 0.890 0.870 - 0.00% -
520.omnetpp_r -2.08% 48.000 47.000 - 0.00% -
520.omnetpp_r (avg) -2.08% 48.000 47.000 - 0.00% -
526.blender_r -1.89% 53.000 52.000 - 0.00% -
526.blender_r (avg) -1.89% 53.000 52.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.63% 1.230 1.210 - 0.00% -
505.mcf_r (avg) (percentage) -1.52% 0.660 0.650 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 5.22% 5634.000 5928.000 - -0.19% -
520.omnetpp_r 3.23% 3813.000 3936.000 - 0.15% -
544.nab_r 2.71% 8092.000 8311.000 - -0.59% -
531.deepsjeng_r 1.10% 5552.000 5613.000 - 0.77% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.67% 1079012.000 1060963.000 - 0.01% -
511.povray_r -1.41% 551640.000 543867.000 - 0.00% -
505.mcf_r -1.39% 15863.000 15643.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -1.83% 2572.000 2525.000 - -0.04% -
523.xalancbmk_r -1.73% 4674.000 4593.000 - -1.46% -
511.povray_r -1.36% 516.000 509.000 - -1.74% -
538.imagick_r -1.33% 4424.000 4365.000 - 0.05% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 14.29% 14.000 16.000 - 0.00% -
nb_execution_successful 7.14% 14.000 15.000 - 0.00% -
nb_total_tests 6.67% 15.000 16.000 - 0.00% -

Added Tests - Code Size
510.parest_r

Added Tests - Execution
510.parest_r

Added Tests - sample variability
500.perlbench_r (avg) (percentage)
500.perlbench_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.21s
Name Current %
502.gcc_r 4101.000 -
505.mcf_r 5928.000 -
508.namd_r 3693.000 -
510.parest_r 6674.000 -
511.povray_r 509.000 -1.74%
519.lbm_r 3892.000 -
520.omnetpp_r 3936.000 -
523.xalancbmk_r 4593.000 -1.46%
525.x264_r 4090.000 -
526.blender_r 13105.000 -
531.deepsjeng_r 5613.000 -
538.imagick_r 4365.000 -
541.leela_r 5333.000 -
544.nab_r 8311.000 -
557.xz_r 2525.000 -
Geometric Mean 4297.891 -
Name Current %
502.gcc_r 4830535.000 -
505.mcf_r 15643.000 -
508.namd_r 352203.000 -
510.parest_r 3359563.000 -
511.povray_r 543867.000 -
519.lbm_r 11434.000 -
520.omnetpp_r 994337.000 -
523.xalancbmk_r 2259574.000 -
525.x264_r 274596.000 -
526.blender_r 6532633.000 -
531.deepsjeng_r 58967.000 -
538.imagick_r 1060963.000 -
541.leela_r 71987.000 -
544.nab_r 95257.000 -
557.xz_r 115528.000 -
Geometric Mean 343851.939 -
Name Current %
500.perlbench_r (avg) (percentage) 0.800 -
500.perlbench_r (max) (percentage) 0.680 -
505.mcf_r 38.000 -2.56%
505.mcf_r (avg) 38.000 -2.56%
505.mcf_r (avg) (percentage) 0.650 -1.52%
505.mcf_r (max) 55.000 -9.84%
505.mcf_r (max) (percentage) 0.940 -9.62%
505.mcf_r (unexplained diff vs previous) 11.000 -81.97%
505.mcf_r (unexplained diff vs previous) (percentage) 0.190 -81.55%
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 8.000 -55.56%
508.namd_r (max) (percentage) 0.240 -52.94%
508.namd_r (unexplained diff vs previous) 8.000 -20.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.220 -18.52%
510.parest_r 18.000 -
510.parest_r (avg) 18.000 -
510.parest_r (avg) (percentage) 0.280 -
510.parest_r (max) 22.000 -4.35%
510.parest_r (max) (percentage) 0.330 -5.71%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.950 2.15%
511.povray_r (max) 8.000 33.33%
511.povray_r (max) (percentage) 1.740 47.46%
511.povray_r (unexplained diff vs previous) 9.000 350.00%
511.povray_r (unexplained diff vs previous) (percentage) 1.770 353.85%
519.lbm_r 10.000 11.11%
519.lbm_r (avg) 10.000 11.11%
519.lbm_r (avg) (percentage) 0.260 4.00%
519.lbm_r (max) 20.000 150.00%
519.lbm_r (max) (percentage) 0.520 126.09%
519.lbm_r (unexplained diff vs previous) 20.000 400.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.510 410.00%
520.omnetpp_r 47.000 -2.08%
520.omnetpp_r (avg) 47.000 -2.08%
520.omnetpp_r (avg) (percentage) 1.210 -1.63%
520.omnetpp_r (max) 99.000 -10.81%
520.omnetpp_r (max) (percentage) 2.530 -10.92%
520.omnetpp_r (unexplained diff vs previous) 6.000 -90.77%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.150 -90.91%
523.xalancbmk_r 27.000 -
523.xalancbmk_r (avg) 27.000 -
523.xalancbmk_r (avg) (percentage) 0.600 3.45%
523.xalancbmk_r (max) 67.000 97.06%
523.xalancbmk_r (max) (percentage) 1.460 100.00%
523.xalancbmk_r (unexplained diff vs previous) 68.000 100.00%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 1.480 102.74%
525.x264_r 16.000 -
525.x264_r (avg) 16.000 -
525.x264_r (avg) (percentage) 0.400 -
525.x264_r (max) 28.000 -9.68%
525.x264_r (max) (percentage) 0.700 -10.26%
525.x264_r (unexplained diff vs previous) 6.000 20.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.150 25.00%
526.blender_r 52.000 -1.89%
526.blender_r (avg) 52.000 -1.89%
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 53.000 -39.77%
526.blender_r (max) (percentage) 0.410 -39.71%
526.blender_r (unexplained diff vs previous) 36.000 -43.75%
526.blender_r (unexplained diff vs previous) (percentage) 0.270 -44.90%
531.deepsjeng_r 19.000 5.56%
531.deepsjeng_r (avg) 19.000 5.56%
531.deepsjeng_r (avg) (percentage) 0.340 3.03%
531.deepsjeng_r (max) 43.000 168.75%
531.deepsjeng_r (max) (percentage) 0.770 156.67%
531.deepsjeng_r (unexplained diff vs previous) 43.000 437.50%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.770 450.00%
538.imagick_r 5.000 -
538.imagick_r (avg) 5.000 -
538.imagick_r (avg) (percentage) 0.120 -
538.imagick_r (max) 6.000 -
538.imagick_r (max) (percentage) 0.140 -
541.leela_r 23.000 -
541.leela_r (avg) 23.000 -
541.leela_r (avg) (percentage) 0.440 -
541.leela_r (max) 30.000 -11.76%
541.leela_r (max) (percentage) 0.580 -9.38%
541.leela_r (unexplained diff vs previous) 13.000 -55.17%
541.leela_r (unexplained diff vs previous) (percentage) 0.240 -56.36%
544.nab_r 30.000 -
544.nab_r (avg) 30.000 -
544.nab_r (avg) (percentage) 0.370 -
544.nab_r (max) 49.000 -5.77%
544.nab_r (max) (percentage) 0.590 -6.35%
544.nab_r (unexplained diff vs previous) 49.000 -7.55%
544.nab_r (unexplained diff vs previous) (percentage) 0.590 -6.35%
557.xz_r 21.000 -4.55%
557.xz_r (avg) 21.000 -4.55%
557.xz_r (avg) (percentage) 0.870 -2.25%
557.xz_r (max) 33.000 -13.16%
557.xz_r (max) (percentage) 1.330 -12.50%
557.xz_r (unexplained diff vs previous) 1.000 -97.44%
557.xz_r (unexplained diff vs previous) (percentage) 0.040 -97.40%
Geometric Mean 3.819 -5.61%