Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/4607d39c7eded3ff6d425cbc502e30349078365c (+ 190 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3-build/302/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0302 (llvmorg-21-init-07720-g4607d39c7ede) 2025-04-01T02:30:12 0:00:00
Previous 0301 (llvmorg-21-init-07530-gd8fd66596063) 2025-03-25T11:23:46 0:00:00
Baseline 0015 (llvmorg-17-init-07405-g0f9842c21c76) 2023-04-07T17:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 36 4
Performance Improvements 44 2
Added Tests 2 130
Unchanged Tests 608 554
Total Tests 690

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) (percentage) 4000.00% 0.020 0.820 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 3166.67% 3.000 98.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 1800.00% 0.010 0.190 - 0.00% -
525.x264_r (unexplained diff vs previous) 1700.00% 1.000 18.000 - 0.00% -
531.deepsjeng_r (max) 273.08% 26.000 97.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 268.18% 0.220 0.810 - 0.00% -
523.xalancbmk_r (max) 230.00% 20.000 66.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 227.27% 0.220 0.720 - 0.00% -
544.nab_r (unexplained diff vs previous) 167.86% 28.000 75.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 166.67% 0.240 0.640 - 0.00% -
510.parest_r (unexplained diff vs previous) 147.37% 19.000 47.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 144.44% 0.090 0.220 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) 128.57% 0.140 0.320 - 0.00% -
511.povray_r (unexplained diff vs previous) 123.08% 26.000 58.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 114.29% 0.140 0.300 - 0.00% -
538.imagick_r (unexplained diff vs previous) 104.17% 24.000 49.000 - 0.00% -
544.nab_r (max) 100.00% 37.000 74.000 - 0.00% -
544.nab_r (max) (percentage) 100.00% 0.320 0.640 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 84.62% 0.130 0.240 - 0.00% -
508.namd_r (unexplained diff vs previous) 75.00% 12.000 21.000 - 0.00% -
508.namd_r (max) (percentage) 35.29% 0.170 0.230 - 0.00% -
508.namd_r (max) 33.33% 15.000 20.000 - 0.00% -
500.perlbench_r (unexplained diff vs previous) (percentage) 32.53% 0.830 1.100 - 0.00% -
500.perlbench_r (unexplained diff vs previous) 30.66% 137.000 179.000 - 0.00% -
500.perlbench_r (max) (percentage) 29.76% 0.840 1.090 - 0.00% -
500.perlbench_r (max) 28.26% 138.000 177.000 - 0.00% -
523.xalancbmk_r 5.56% 36.000 38.000 - 0.00% -
523.xalancbmk_r (avg) 5.56% 36.000 38.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) 5.00% 0.400 0.420 - 0.00% -
505.mcf_r (avg) (percentage) 4.55% 0.220 0.230 - 0.00% -
505.mcf_r 3.33% 30.000 31.000 - 0.00% -
505.mcf_r (avg) 3.33% 30.000 31.000 - 0.00% -
544.nab_r (avg) (percentage) 2.63% 0.380 0.390 - 0.00% -
544.nab_r 2.27% 44.000 45.000 - 0.00% -
544.nab_r (avg) 2.27% 44.000 45.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 1.69% 0.590 0.600 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -1.09% 16477.000 16298.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (unexplained diff vs previous) (percentage) -87.50% 0.080 0.010 - 0.00% -
557.xz_r (unexplained diff vs previous) -87.50% 8.000 1.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -69.23% 0.130 0.040 - 0.00% -
519.lbm_r (unexplained diff vs previous) -68.42% 19.000 6.000 - 0.00% -
519.lbm_r (max) -65.96% 47.000 16.000 - 0.00% -
519.lbm_r (max) (percentage) -65.62% 0.320 0.110 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -61.70% 0.470 0.180 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -61.11% 54.000 21.000 - 0.00% -
557.xz_r (max) -50.00% 14.000 7.000 - 0.00% -
557.xz_r (max) (percentage) -50.00% 0.140 0.070 - 0.00% -
502.gcc_r (unexplained diff vs previous) -33.33% 15.000 10.000 - 0.00% -
502.gcc_r (unexplained diff vs previous) (percentage) -31.25% 0.160 0.110 - 0.00% -
525.x264_r (max) -12.50% 24.000 21.000 - 0.00% -
525.x264_r (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
520.omnetpp_r (max) -11.00% 200.000 178.000 - 0.00% -
520.omnetpp_r (max) (percentage) -10.92% 1.740 1.550 - 0.00% -
510.parest_r (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
541.leela_r (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -8.33% 0.240 0.220 - 0.00% -
510.parest_r (max) -8.00% 50.000 46.000 - 0.00% -
541.leela_r (max) -8.00% 25.000 23.000 - 0.00% -
541.leela_r (unexplained diff vs previous) -7.69% 26.000 24.000 - 0.00% -
505.mcf_r (max) (percentage) -6.98% 0.430 0.400 - 0.00% -
505.mcf_r (max) -6.78% 59.000 55.000 - 0.00% -
526.blender_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
526.blender_r (max) -5.88% 34.000 32.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) -5.08% 59.000 56.000 - 0.00% -
538.imagick_r (max) -5.05% 99.000 94.000 - 0.00% -
538.imagick_r (max) (percentage) -5.00% 0.600 0.570 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -4.76% 0.420 0.400 - 0.00% -
511.povray_r (max) -4.02% 199.000 191.000 - 0.00% -
538.imagick_r -3.77% 53.000 51.000 - 0.00% -
538.imagick_r (avg) -3.77% 53.000 51.000 - 0.00% -
511.povray_r (max) (percentage) -3.60% 1.110 1.070 - 0.00% -
502.gcc_r -3.57% 28.000 27.000 - 0.00% -
502.gcc_r (avg) -3.57% 28.000 27.000 - 0.00% -
502.gcc_r (avg) (percentage) -3.33% 0.300 0.290 - 0.00% -
538.imagick_r (avg) (percentage) -3.13% 0.320 0.310 - 0.00% -
520.omnetpp_r -2.02% 99.000 97.000 - 0.00% -
520.omnetpp_r (avg) -2.02% 99.000 97.000 - 0.00% -
502.gcc_r (max) -1.85% 54.000 53.000 - 0.00% -
502.gcc_r (max) (percentage) -1.72% 0.580 0.570 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.16% 0.860 0.850 - 0.00% -

Added Tests - sample variability
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 4.98% 30264.000 31772.000 - 0.00% -
531.deepsjeng_r 3.53% 100020.000 103552.000 - 0.00% -
557.xz_r 1.11% 184775.000 186823.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 11.29% 10775.000 11992.000 - -0.81% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -2.75% 10353.000 10068.000 - -0.01% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
502.gcc_r (unexplained diff vs previous)
502.gcc_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 16298.000 -1.09%
502.gcc_r 9418.000 -
505.mcf_r 13851.000 -
508.namd_r 8936.000 -
510.parest_r 21075.000 -
511.povray_r 17925.000 -
519.lbm_r 14877.000 -
520.omnetpp_r 11499.000 -
523.xalancbmk_r 9231.000 -
525.x264_r 9703.000 -
526.blender_r 10780.000 -
531.deepsjeng_r 11992.000 -
538.imagick_r 16599.000 -
541.leela_r 10705.000 -
544.nab_r 11645.000 -
557.xz_r 10068.000 -
Geometric Mean 12358.649 -
Name Current %
500.perlbench_r 2122151.000 -
502.gcc_r 8930743.000 -
505.mcf_r 31772.000 -
508.namd_r 657179.000 -
510.parest_r 8118551.000 -
511.povray_r 942615.000 -
519.lbm_r 13452.000 -
520.omnetpp_r 1740538.000 -
523.xalancbmk_r 4055734.000 -
525.x264_r 575449.000 -
526.blender_r 10713028.000 -
531.deepsjeng_r 103552.000 -
538.imagick_r 1834052.000 -
541.leela_r 151059.000 -
544.nab_r 191351.000 -
557.xz_r 186823.000 -
Geometric Mean 674105.091 -
Name Current %
500.perlbench_r 153.000 -
500.perlbench_r (avg) 153.000 -
500.perlbench_r (avg) (percentage) 0.940 -
500.perlbench_r (max) 177.000 28.26%
500.perlbench_r (max) (percentage) 1.090 29.76%
500.perlbench_r (unexplained diff vs previous) 179.000 30.66%
500.perlbench_r (unexplained diff vs previous) (percentage) 1.100 32.53%
502.gcc_r 27.000 -3.57%
502.gcc_r (avg) 27.000 -3.57%
502.gcc_r (avg) (percentage) 0.290 -3.33%
502.gcc_r (max) 53.000 -1.85%
502.gcc_r (max) (percentage) 0.570 -1.72%
502.gcc_r (unexplained diff vs previous) 10.000 -33.33%
502.gcc_r (unexplained diff vs previous) (percentage) 0.110 -31.25%
505.mcf_r 31.000 3.33%
505.mcf_r (avg) 31.000 3.33%
505.mcf_r (avg) (percentage) 0.230 4.55%
505.mcf_r (max) 55.000 -6.78%
505.mcf_r (max) (percentage) 0.400 -6.98%
505.mcf_r (unexplained diff vs previous) 56.000 -5.08%
505.mcf_r (unexplained diff vs previous) (percentage) 0.400 -4.76%
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.220 -
508.namd_r (max) 20.000 33.33%
508.namd_r (max) (percentage) 0.230 35.29%
508.namd_r (unexplained diff vs previous) 21.000 75.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.240 84.62%
510.parest_r 31.000 -
510.parest_r (avg) 31.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 46.000 -8.00%
510.parest_r (max) (percentage) 0.220 -8.33%
510.parest_r (unexplained diff vs previous) 47.000 147.37%
510.parest_r (unexplained diff vs previous) (percentage) 0.220 144.44%
511.povray_r 102.000 -
511.povray_r (avg) 102.000 -
511.povray_r (avg) (percentage) 0.570 -
511.povray_r (max) 191.000 -4.02%
511.povray_r (max) (percentage) 1.070 -3.60%
511.povray_r (unexplained diff vs previous) 58.000 123.08%
511.povray_r (unexplained diff vs previous) (percentage) 0.320 128.57%
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.130 -
519.lbm_r (max) 16.000 -65.96%
519.lbm_r (max) (percentage) 0.110 -65.62%
519.lbm_r (unexplained diff vs previous) 6.000 -68.42%
519.lbm_r (unexplained diff vs previous) (percentage) 0.040 -69.23%
520.omnetpp_r 97.000 -2.02%
520.omnetpp_r (avg) 97.000 -2.02%
520.omnetpp_r (avg) (percentage) 0.850 -1.16%
520.omnetpp_r (max) 178.000 -11.00%
520.omnetpp_r (max) (percentage) 1.550 -10.92%
520.omnetpp_r (unexplained diff vs previous) 21.000 -61.11%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.180 -61.70%
523.xalancbmk_r 38.000 5.56%
523.xalancbmk_r (avg) 38.000 5.56%
523.xalancbmk_r (avg) (percentage) 0.420 5.00%
523.xalancbmk_r (max) 66.000 230.00%
523.xalancbmk_r (max) (percentage) 0.720 227.27%
523.xalancbmk_r (unexplained diff vs previous) 66.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.710 -
525.x264_r 20.000 -
525.x264_r (avg) 20.000 -
525.x264_r (avg) (percentage) 0.210 -
525.x264_r (max) 21.000 -12.50%
525.x264_r (max) (percentage) 0.220 -12.00%
525.x264_r (unexplained diff vs previous) 18.000 1700.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.190 1800.00%
526.blender_r 31.000 -
526.blender_r (avg) 31.000 -
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 32.000 -5.88%
526.blender_r (max) (percentage) 0.300 -6.25%
531.deepsjeng_r 71.000 -
531.deepsjeng_r (avg) 71.000 -
531.deepsjeng_r (avg) (percentage) 0.600 1.69%
531.deepsjeng_r (max) 97.000 273.08%
531.deepsjeng_r (max) (percentage) 0.810 268.18%
531.deepsjeng_r (unexplained diff vs previous) 98.000 3166.67%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.820 4000.00%
538.imagick_r 51.000 -3.77%
538.imagick_r (avg) 51.000 -3.77%
538.imagick_r (avg) (percentage) 0.310 -3.13%
538.imagick_r (max) 94.000 -5.05%
538.imagick_r (max) (percentage) 0.570 -5.00%
538.imagick_r (unexplained diff vs previous) 49.000 104.17%
538.imagick_r (unexplained diff vs previous) (percentage) 0.300 114.29%
541.leela_r 31.000 -
541.leela_r (avg) 31.000 -
541.leela_r (avg) (percentage) 0.290 -
541.leela_r (max) 23.000 -8.00%
541.leela_r (max) (percentage) 0.220 -8.33%
541.leela_r (unexplained diff vs previous) 24.000 -7.69%
541.leela_r (unexplained diff vs previous) (percentage) 0.220 -8.33%
544.nab_r 45.000 2.27%
544.nab_r (avg) 45.000 2.27%
544.nab_r (avg) (percentage) 0.390 2.63%
544.nab_r (max) 74.000 100.00%
544.nab_r (max) (percentage) 0.640 100.00%
544.nab_r (unexplained diff vs previous) 75.000 167.86%
544.nab_r (unexplained diff vs previous) (percentage) 0.640 166.67%
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.150 -
557.xz_r (max) 7.000 -50.00%
557.xz_r (max) (percentage) 0.070 -50.00%
557.xz_r (unexplained diff vs previous) 1.000 -87.50%
557.xz_r (unexplained diff vs previous) (percentage) 0.010 -87.50%
Geometric Mean 4.902 15.49%