Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ec5409b1865b9a462ea336db7428c210eb1955d7 (+ 25 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (ef938108b8d141a251783cbf123248f30319d211) (+ 90 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0a027674a10337cb22ad4e056637616ea1611324 (+ 3 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/323/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0323 (3-changed-components) 2025-06-05T22:52:02 0:00:00
Previous 0322 (4-changed-components) 2025-06-02T11:08:21 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 42 18
Performance Improvements 37 10
Added Tests 2 117
Unchanged Tests 855 791
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r 2.69% 3647.000 3745.000 - 3.91% -
511.povray_r 2.18% 412.000 421.000 - -0.71% -
520.omnetpp_r 1.61% 3474.000 3530.000 - 0.00% -
531.deepsjeng_r 1.21% 5269.000 5333.000 - -1.04% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r (unexplained diff vs previous) (percentage) 2700.00% 0.010 0.280 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 2400.00% 1.000 25.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 2033.33% 3.000 64.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1900.00% 0.060 1.200 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 940.00% 0.050 0.520 - 0.00% -
544.nab_r (unexplained diff vs previous) 925.00% 4.000 41.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) 425.00% 8.000 42.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 422.22% 0.090 0.470 - 0.00% -
510.parest_r (max) 350.00% 4.000 18.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 350.00% 4.000 18.000 - 0.00% -
510.parest_r (max) (percentage) 342.86% 0.070 0.310 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 327.27% 0.110 0.470 - 0.00% -
544.nab_r (max) 100.00% 20.000 40.000 - 0.00% -
544.nab_r (max) (percentage) 100.00% 0.260 0.520 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 40.00% 40.000 56.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 38.26% 1.150 1.590 - 0.00% -
541.leela_r (max) 37.50% 24.000 33.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 37.04% 0.540 0.740 - 0.00% -
541.leela_r (unexplained diff vs previous) 36.00% 25.000 34.000 - 0.00% -
541.leela_r (max) (percentage) 35.19% 0.540 0.730 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 27.66% 0.470 0.600 - 0.00% -
526.blender_r (unexplained diff vs previous) 27.45% 51.000 65.000 - 0.00% -
520.omnetpp_r (max) 9.80% 51.000 56.000 - 0.00% -
520.omnetpp_r (max) (percentage) 9.52% 1.470 1.610 - 0.00% -
510.parest_r 8.33% 12.000 13.000 - 0.00% -
510.parest_r (avg) 8.33% 12.000 13.000 - 0.00% -
526.blender_r 7.89% 38.000 41.000 - 0.00% -
526.blender_r (avg) 7.89% 38.000 41.000 - 0.00% -
526.blender_r (max) 6.56% 61.000 65.000 - 0.00% -
526.blender_r (avg) (percentage) 5.56% 0.360 0.380 - 0.00% -
526.blender_r (max) (percentage) 5.26% 0.570 0.600 - 0.00% -
510.parest_r (avg) (percentage) 4.76% 0.210 0.220 - 0.00% -
531.deepsjeng_r 3.85% 26.000 27.000 - 0.00% -
531.deepsjeng_r (avg) 3.85% 26.000 27.000 - 0.00% -
549.fotonik3d_r 3.03% 33.000 34.000 - 0.00% -
549.fotonik3d_r (avg) 3.03% 33.000 34.000 - 0.00% -
549.fotonik3d_r (avg) (percentage) 2.63% 0.380 0.390 - 0.00% -
531.deepsjeng_r (avg) (percentage) 2.00% 0.500 0.510 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -3.42% 2251.000 2174.000 - 7.73% -
527.cam4_r -2.56% 2536.000 2471.000 - -1.32% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) -62.96% 27.000 10.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -62.34% 0.770 0.290 - 0.00% -
557.xz_r (max) -14.29% 14.000 12.000 - 0.00% -
557.xz_r (max) (percentage) -12.07% 0.580 0.510 - 0.00% -
508.namd_r (max) -10.67% 75.000 67.000 - 0.00% -
508.namd_r (max) (percentage) -9.77% 2.150 1.940 - 0.00% -
549.fotonik3d_r (max) (percentage) -7.69% 0.520 0.480 - 0.00% -
527.cam4_r (max) -7.32% 41.000 38.000 - 0.00% -
538.imagick_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
549.fotonik3d_r (max) -6.67% 45.000 42.000 - 0.00% -
554.roms_r (max) -6.07% 214.000 201.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -6.06% 1.320 1.240 - 0.00% -
554.roms_r (max) (percentage) -5.88% 0.680 0.640 - 0.00% -
523.xalancbmk_r (max) -5.56% 54.000 51.000 - 0.00% -
500.perlbench_r (max) -5.41% 37.000 35.000 - 0.00% -
525.x264_r (max) -5.26% 38.000 36.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.79% 1.670 1.590 - 0.00% -
531.deepsjeng_r (max) -4.35% 69.000 66.000 - 0.00% -
525.x264_r (max) (percentage) -3.85% 1.040 1.000 - 0.00% -
500.perlbench_r -3.85% 26.000 25.000 - 0.00% -
500.perlbench_r (avg) -3.85% 26.000 25.000 - 0.00% -
505.mcf_r (max) (percentage) -3.26% 0.920 0.890 - 0.00% -
521.wrf_r (max) (percentage) -3.20% 1.250 1.210 - 0.00% -
505.mcf_r (max) -3.12% 64.000 62.000 - 0.00% -
527.cam4_r -3.12% 32.000 31.000 - 0.00% -
527.cam4_r (avg) -3.12% 32.000 31.000 - 0.00% -
527.cam4_r (max) (percentage) -3.09% 1.620 1.570 - 0.00% -
544.nab_r -3.03% 33.000 32.000 - 0.00% -
544.nab_r (avg) -3.03% 33.000 32.000 - 0.00% -
521.wrf_r (max) -2.48% 121.000 118.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.40% 1.670 1.630 - 0.00% -
508.namd_r (avg) (percentage) -2.38% 0.420 0.410 - 0.00% -
511.povray_r (max) (percentage) -1.80% 1.110 1.090 - 0.00% -
507.cactuBSSN_r (max) -1.75% 57.000 56.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -1.28% 0.780 0.770 - 0.00% -

Added Tests - sample variability
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 6.64% 3425837.000 3653266.000 - -0.00% -
541.leela_r 5.79% 74603.000 78921.000 - 0.00% -
503.bwaves_r 3.85% 29255.000 30380.000 - 0.00% -
521.wrf_r 3.51% 14837046.000 15358405.000 - -0.02% -
508.namd_r 2.62% 638884.000 655593.000 - 0.00% -
531.deepsjeng_r 2.14% 91923.000 93887.000 - 0.00% -
500.perlbench_r 1.85% 1956619.000 1992770.000 - -0.00% -
502.gcc_r 1.68% 8210636.000 8348240.000 - 0.01% -
520.omnetpp_r 1.31% 1374872.000 1392835.000 - -0.00% -
557.xz_r 1.28% 129911.000 131571.000 - -0.18% -
511.povray_r 1.23% 785535.000 795215.000 - 0.00% -
519.lbm_r 1.07% 11191.000 11311.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 7.73% 2018.000 2174.000 - -3.42% -
505.mcf_r 3.99% 6735.000 7004.000 - -0.19% -
502.gcc_r 3.91% 3604.000 3745.000 - 2.69% -
554.roms_r 2.86% 30622.000 31499.000 - -0.03% -
549.fotonik3d_r 1.83% 8698.000 8857.000 - 0.48% -
557.xz_r 1.05% 2389.000 2414.000 - -0.17% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.60% 1163451.000 1144847.000 - 0.00% -
505.mcf_r -1.44% 20525.000 20229.000 - -0.04% -
549.fotonik3d_r -1.27% 327730.000 323569.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -1.83% 7985.000 7839.000 - -0.52% -
541.leela_r -1.37% 4658.000 4594.000 - -0.73% -
527.cam4_r -1.32% 2504.000 2471.000 - -2.56% -
531.deepsjeng_r -1.04% 5389.000 5333.000 - 1.21% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 10.00% 20.000 22.000 - 0.00% -
nb_execution_successful 10.00% 20.000 22.000 - 0.00% -
nb_total_tests 10.00% 20.000 22.000 - 0.00% -

Added Tests - Code Size
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 2174.000 -3.42%
502.gcc_r 3745.000 2.69%
503.bwaves_r 8793.000 -
505.mcf_r 7004.000 -
507.cactuBSSN_r 7352.000 -
508.namd_r 3505.000 -
510.parest_r 6057.000 -
511.povray_r 421.000 2.18%
519.lbm_r 3820.000 -
520.omnetpp_r 3530.000 1.61%
521.wrf_r 9757.000 -
523.xalancbmk_r 3266.000 -
525.x264_r 3689.000 -
526.blender_r 10856.000 -
527.cam4_r 2471.000 -2.56%
531.deepsjeng_r 5333.000 1.21%
538.imagick_r 4233.000 -
541.leela_r 4594.000 -
544.nab_r 7839.000 -
549.fotonik3d_r 8857.000 -
554.roms_r 31499.000 -
557.xz_r 2414.000 -
Geometric Mean 4748.798 -
Name Current %
500.perlbench_r 1992770.000 -
502.gcc_r 8348240.000 -
503.bwaves_r 30380.000 -
505.mcf_r 20229.000 -
507.cactuBSSN_r 3653266.000 -
508.namd_r 655593.000 -
510.parest_r 1398299.000 -
511.povray_r 795215.000 -
519.lbm_r 11311.000 -
520.omnetpp_r 1392835.000 -
521.wrf_r 15358405.000 -
523.xalancbmk_r 3001585.000 -
525.x264_r 442856.000 -
526.blender_r 8030511.000 -
527.cam4_r 2808588.000 -
531.deepsjeng_r 93887.000 -
538.imagick_r 1144847.000 -
541.leela_r 78921.000 -
544.nab_r 78223.000 -
549.fotonik3d_r 323569.000 -
554.roms_r 517841.000 -
557.xz_r 131571.000 -
Geometric Mean 560039.422 -
Name Current %
500.perlbench_r 25.000 -3.85%
500.perlbench_r (avg) 25.000 -3.85%
500.perlbench_r (avg) (percentage) 1.190 -
500.perlbench_r (max) 35.000 -5.41%
500.perlbench_r (max) (percentage) 1.630 -2.40%
503.bwaves_r 38.000 -
503.bwaves_r (avg) 38.000 -
503.bwaves_r (avg) (percentage) 0.440 -
503.bwaves_r (max) 24.000 -
503.bwaves_r (max) (percentage) 0.280 -
503.bwaves_r (unexplained diff vs previous) 25.000 2400.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.280 2700.00%
505.mcf_r 56.000 -
505.mcf_r (avg) 56.000 -
505.mcf_r (avg) (percentage) 0.800 -
505.mcf_r (max) 62.000 -3.12%
505.mcf_r (max) (percentage) 0.890 -3.26%
507.cactuBSSN_r 44.000 -
507.cactuBSSN_r (avg) 44.000 -
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) 56.000 -1.75%
507.cactuBSSN_r (max) (percentage) 0.770 -1.28%
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.410 -2.38%
508.namd_r (max) 67.000 -10.67%
508.namd_r (max) (percentage) 1.940 -9.77%
508.namd_r (unexplained diff vs previous) 10.000 -62.96%
508.namd_r (unexplained diff vs previous) (percentage) 0.290 -62.34%
510.parest_r 13.000 8.33%
510.parest_r (avg) 13.000 8.33%
510.parest_r (avg) (percentage) 0.220 4.76%
510.parest_r (max) 18.000 350.00%
510.parest_r (max) (percentage) 0.310 342.86%
510.parest_r (unexplained diff vs previous) 19.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.310 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.180 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.090 -1.80%
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.520 -
519.lbm_r (max) 17.000 -
519.lbm_r (max) (percentage) 0.470 -
519.lbm_r (unexplained diff vs previous) 18.000 350.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.470 327.27%
520.omnetpp_r 44.000 -
520.omnetpp_r (avg) 44.000 -
520.omnetpp_r (avg) (percentage) 1.270 -
520.omnetpp_r (max) 56.000 9.80%
520.omnetpp_r (max) (percentage) 1.610 9.52%
520.omnetpp_r (unexplained diff vs previous) 56.000 40.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.590 38.26%
521.wrf_r 106.000 -
521.wrf_r (avg) 106.000 -
521.wrf_r (avg) (percentage) 1.090 -
521.wrf_r (max) 118.000 -2.48%
521.wrf_r (max) (percentage) 1.210 -3.20%
523.xalancbmk_r 35.000 -
523.xalancbmk_r (avg) 35.000 -
523.xalancbmk_r (avg) (percentage) 1.090 -
523.xalancbmk_r (max) 51.000 -5.56%
523.xalancbmk_r (max) (percentage) 1.590 -4.79%
525.x264_r 22.000 -
525.x264_r (avg) 22.000 -
525.x264_r (avg) (percentage) 0.600 -
525.x264_r (max) 36.000 -5.26%
525.x264_r (max) (percentage) 1.000 -3.85%
526.blender_r 41.000 7.89%
526.blender_r (avg) 41.000 7.89%
526.blender_r (avg) (percentage) 0.380 5.56%
526.blender_r (max) 65.000 6.56%
526.blender_r (max) (percentage) 0.600 5.26%
526.blender_r (unexplained diff vs previous) 65.000 27.45%
526.blender_r (unexplained diff vs previous) (percentage) 0.600 27.66%
527.cam4_r 31.000 -3.12%
527.cam4_r (avg) 31.000 -3.12%
527.cam4_r (avg) (percentage) 1.270 -
527.cam4_r (max) 38.000 -7.32%
527.cam4_r (max) (percentage) 1.570 -3.09%
531.deepsjeng_r 27.000 3.85%
531.deepsjeng_r (avg) 27.000 3.85%
531.deepsjeng_r (avg) (percentage) 0.510 2.00%
531.deepsjeng_r (max) 66.000 -4.35%
531.deepsjeng_r (max) (percentage) 1.240 -6.06%
531.deepsjeng_r (unexplained diff vs previous) 64.000 2033.33%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1.200 1900.00%
538.imagick_r 9.000 -
538.imagick_r (avg) 9.000 -
538.imagick_r (avg) (percentage) 0.220 -
538.imagick_r (max) 5.000 -
538.imagick_r (max) (percentage) 0.130 -7.14%
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.660 -
541.leela_r (max) 33.000 37.50%
541.leela_r (max) (percentage) 0.730 35.19%
541.leela_r (unexplained diff vs previous) 34.000 36.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.740 37.04%
544.nab_r 32.000 -3.03%
544.nab_r (avg) 32.000 -3.03%
544.nab_r (avg) (percentage) 0.420 -
544.nab_r (max) 40.000 100.00%
544.nab_r (max) (percentage) 0.520 100.00%
544.nab_r (unexplained diff vs previous) 41.000 925.00%
544.nab_r (unexplained diff vs previous) (percentage) 0.520 940.00%
548.exchange2_r (avg) (percentage) 0.540 -
548.exchange2_r (max) (percentage) 0.290 -
549.fotonik3d_r 34.000 3.03%
549.fotonik3d_r (avg) 34.000 3.03%
549.fotonik3d_r (avg) (percentage) 0.390 2.63%
549.fotonik3d_r (max) 42.000 -6.67%
549.fotonik3d_r (max) (percentage) 0.480 -7.69%
549.fotonik3d_r (unexplained diff vs previous) 42.000 425.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.470 422.22%
554.roms_r 242.000 -
554.roms_r (avg) 242.000 -
554.roms_r (avg) (percentage) 0.770 -
554.roms_r (max) 201.000 -6.07%
554.roms_r (max) (percentage) 0.640 -5.88%
557.xz_r 17.000 -
557.xz_r (avg) 17.000 -
557.xz_r (avg) (percentage) 0.740 -
557.xz_r (max) 12.000 -14.29%
557.xz_r (max) (percentage) 0.510 -12.07%
Geometric Mean 5.974 22.85%