Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fccab5d757778204666d70e2f1592952fc8b336d (+ 201 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3-build/331/
Filter

llvm-arm-master-O3 test results

Run Order Start Time Duration
Current 0331 (llvmorg-21-init-15609-gfccab5d75777) 2025-06-12T06:39:30 0:00:00
Previous 0330 (llvmorg-21-init-15408-gf6bf3bd5e001) 2025-06-07T19:08:21 0:00:00
Baseline 0015 (llvmorg-17-init-07405-g0f9842c21c76) 2023-04-07T17:38:29 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 27 4
Performance Improvements 34 2
Added Tests 0 120
Unchanged Tests 605 540
Total Tests 666

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
557.xz_r (unexplained diff vs previous) 2300.00% 1.000 24.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 2300.00% 0.010 0.240 - 0.00% -
510.parest_r (unexplained diff vs previous) 1100.00% 2.000 24.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 1000.00% 0.010 0.110 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 525.00% 0.040 0.250 - 0.00% -
519.lbm_r (unexplained diff vs previous) 516.67% 6.000 37.000 - 0.00% -
525.x264_r (max) 500.00% 5.000 30.000 - 0.00% -
525.x264_r (max) (percentage) 416.67% 0.060 0.310 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 416.67% 0.060 0.310 - 0.00% -
525.x264_r (unexplained diff vs previous) 400.00% 6.000 30.000 - 0.00% -
508.namd_r (max) 266.67% 3.000 11.000 - 0.00% -
519.lbm_r (max) 236.36% 11.000 37.000 - 0.00% -
508.namd_r (max) (percentage) 225.00% 0.040 0.130 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 225.00% 0.040 0.130 - 0.00% -
519.lbm_r (max) (percentage) 212.50% 0.080 0.250 - 0.00% -
508.namd_r (unexplained diff vs previous) 200.00% 4.000 12.000 - 0.00% -
557.xz_r (max) 100.00% 12.000 24.000 - 0.00% -
557.xz_r (max) (percentage) 100.00% 0.120 0.240 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 72.46% 1.380 2.380 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 68.48% 165.000 278.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) 54.55% 11.000 17.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 50.00% 0.080 0.120 - 0.00% -
520.omnetpp_r (max) (percentage) 38.92% 1.670 2.320 - 0.00% -
520.omnetpp_r (max) 35.50% 200.000 271.000 - 0.00% -
526.blender_r 3.33% 30.000 31.000 - 0.00% -
526.blender_r (avg) 3.33% 30.000 31.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 2.27% 0.880 0.900 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.40% 16254.000 15864.000 - 0.00% -
520.omnetpp_r -2.32% 11981.000 11703.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r (unexplained diff vs previous) -73.91% 23.000 6.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -71.43% 0.210 0.060 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -33.96% 0.530 0.350 - 0.00% -
526.blender_r (unexplained diff vs previous) -33.33% 57.000 38.000 - 0.00% -
526.blender_r (max) -17.54% 57.000 47.000 - 0.00% -
526.blender_r (max) (percentage) -16.98% 0.530 0.440 - 0.00% -
505.mcf_r (max) -9.09% 66.000 60.000 - 0.00% -
505.mcf_r (max) (percentage) -8.33% 0.480 0.440 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -7.14% 14.000 13.000 - 0.00% -
544.nab_r (max) -6.25% 96.000 90.000 - 0.00% -
544.nab_r (max) (percentage) -6.10% 0.820 0.770 - 0.00% -
541.leela_r (max) (percentage) -6.00% 0.500 0.470 - 0.00% -
541.leela_r (max) -5.66% 53.000 50.000 - 0.00% -
502.gcc_r (max) -5.48% 73.000 69.000 - 0.00% -
502.gcc_r (max) (percentage) -5.13% 0.780 0.740 - 0.00% -
500.perlbench_r (max) -4.86% 185.000 176.000 - 0.00% -
510.parest_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
510.parest_r (max) -4.17% 48.000 46.000 - 0.00% -
523.xalancbmk_r (max) -4.17% 48.000 46.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.00% 0.500 0.480 - 0.00% -
502.gcc_r -3.57% 28.000 27.000 - 0.00% -
502.gcc_r (avg) -3.57% 28.000 27.000 - 0.00% -
511.povray_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
538.imagick_r (max) -2.63% 76.000 74.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.63% 1.140 1.110 - 0.00% -
538.imagick_r (max) (percentage) -2.17% 0.460 0.450 - 0.00% -
500.perlbench_r -2.08% 144.000 141.000 - 0.00% -
500.perlbench_r (avg) -2.08% 144.000 141.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
511.povray_r (max) -1.69% 59.000 58.000 - 0.00% -
531.deepsjeng_r -1.56% 64.000 63.000 - 0.00% -
531.deepsjeng_r (avg) -1.56% 64.000 63.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 5.04% 30264.000 31788.000 - 0.00% -
531.deepsjeng_r 3.58% 100020.000 103600.000 - 0.00% -
557.xz_r 1.20% 184775.000 186999.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 11.05% 10775.000 11966.000 - -0.11% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -2.70% 10353.000 10073.000 - -0.24% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 15864.000 -2.40%
502.gcc_r 9332.000 -
505.mcf_r 13848.000 -
508.namd_r 8960.000 -
510.parest_r 21265.000 -
511.povray_r 18161.000 -
519.lbm_r 14873.000 -
520.omnetpp_r 11703.000 -2.32%
523.xalancbmk_r 9751.000 -
525.x264_r 9685.000 -
526.blender_r 10727.000 -
531.deepsjeng_r 11966.000 -
538.imagick_r 16641.000 -
541.leela_r 10766.000 -
544.nab_r 11694.000 -
557.xz_r 10073.000 -
Geometric Mean 12408.512 -
Name Current %
500.perlbench_r 2122583.000 -
502.gcc_r 8929959.000 -
505.mcf_r 31788.000 -
508.namd_r 657115.000 -
510.parest_r 8125483.000 -
511.povray_r 942223.000 -
519.lbm_r 13440.000 -
520.omnetpp_r 1740122.000 -
523.xalancbmk_r 4068578.000 -
525.x264_r 574105.000 -
526.blender_r 10714396.000 -
531.deepsjeng_r 103600.000 -
538.imagick_r 1836348.000 -
541.leela_r 151347.000 -
544.nab_r 191271.000 -
557.xz_r 186999.000 -
Geometric Mean 674312.487 -
Name Current %
500.perlbench_r 141.000 -2.08%
500.perlbench_r (avg) 141.000 -2.08%
500.perlbench_r (avg) (percentage) 0.890 -
500.perlbench_r (max) 176.000 -4.86%
500.perlbench_r (max) (percentage) 1.110 -2.63%
502.gcc_r 27.000 -3.57%
502.gcc_r (avg) 27.000 -3.57%
502.gcc_r (avg) (percentage) 0.300 -
502.gcc_r (max) 69.000 -5.48%
502.gcc_r (max) (percentage) 0.740 -5.13%
505.mcf_r 31.000 -
505.mcf_r (avg) 31.000 -
505.mcf_r (avg) (percentage) 0.230 -
505.mcf_r (max) 60.000 -9.09%
505.mcf_r (max) (percentage) 0.440 -8.33%
505.mcf_r (unexplained diff vs previous) 17.000 54.55%
505.mcf_r (unexplained diff vs previous) (percentage) 0.120 50.00%
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 11.000 266.67%
508.namd_r (max) (percentage) 0.130 225.00%
508.namd_r (unexplained diff vs previous) 12.000 200.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.130 225.00%
510.parest_r 31.000 -
510.parest_r (avg) 31.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 46.000 -4.17%
510.parest_r (max) (percentage) 0.220 -4.35%
510.parest_r (unexplained diff vs previous) 24.000 1100.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.110 1000.00%
511.povray_r 88.000 -
511.povray_r (avg) 88.000 -
511.povray_r (avg) (percentage) 0.490 -
511.povray_r (max) 58.000 -1.69%
511.povray_r (max) (percentage) 0.320 -3.03%
519.lbm_r 17.000 -
519.lbm_r (avg) 17.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 37.000 236.36%
519.lbm_r (max) (percentage) 0.250 212.50%
519.lbm_r (unexplained diff vs previous) 37.000 516.67%
519.lbm_r (unexplained diff vs previous) (percentage) 0.250 525.00%
520.omnetpp_r 105.000 -
520.omnetpp_r (avg) 105.000 -
520.omnetpp_r (avg) (percentage) 0.900 2.27%
520.omnetpp_r (max) 271.000 35.50%
520.omnetpp_r (max) (percentage) 2.320 38.92%
520.omnetpp_r (unexplained diff vs previous) 278.000 68.48%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.380 72.46%
523.xalancbmk_r 39.000 -
523.xalancbmk_r (avg) 39.000 -
523.xalancbmk_r (avg) (percentage) 0.400 -
523.xalancbmk_r (max) 46.000 -4.17%
523.xalancbmk_r (max) (percentage) 0.480 -4.00%
525.x264_r 18.000 -
525.x264_r (avg) 18.000 -
525.x264_r (avg) (percentage) 0.190 -
525.x264_r (max) 30.000 500.00%
525.x264_r (max) (percentage) 0.310 416.67%
525.x264_r (unexplained diff vs previous) 30.000 400.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.310 416.67%
526.blender_r 31.000 3.33%
526.blender_r (avg) 31.000 3.33%
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 47.000 -17.54%
526.blender_r (max) (percentage) 0.440 -16.98%
526.blender_r (unexplained diff vs previous) 38.000 -33.33%
526.blender_r (unexplained diff vs previous) (percentage) 0.350 -33.96%
531.deepsjeng_r 63.000 -1.56%
531.deepsjeng_r (avg) 63.000 -1.56%
531.deepsjeng_r (avg) (percentage) 0.530 -1.85%
531.deepsjeng_r (max) 34.000 -
531.deepsjeng_r (max) (percentage) 0.290 -
531.deepsjeng_r (unexplained diff vs previous) 13.000 -7.14%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.110 -
538.imagick_r 48.000 -
538.imagick_r (avg) 48.000 -
538.imagick_r (avg) (percentage) 0.290 -
538.imagick_r (max) 74.000 -2.63%
538.imagick_r (max) (percentage) 0.450 -2.17%
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.270 -
541.leela_r (max) 50.000 -5.66%
541.leela_r (max) (percentage) 0.470 -6.00%
541.leela_r (unexplained diff vs previous) 6.000 -73.91%
541.leela_r (unexplained diff vs previous) (percentage) 0.060 -71.43%
544.nab_r 50.000 -
544.nab_r (avg) 50.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 90.000 -6.25%
544.nab_r (max) (percentage) 0.770 -6.10%
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.150 -
557.xz_r (max) 24.000 100.00%
557.xz_r (max) (percentage) 0.240 100.00%
557.xz_r (unexplained diff vs previous) 24.000 2300.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.240 2300.00%
Geometric Mean 5.136 31.92%