Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b304edbeb6d5bcc7c39929de961b6b3a9265799b (+ 16 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (21842fe301caa5dbc69a69033cdc17bb29b8c399) (+ 200 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ae312544325724509ca734fcade2a05497f92b26 (+ 4 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (+ 186 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/315/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0315 (4-changed-components) 2025-05-07T11:21:10 0:00:00
Previous 0313 (basepoints/gcc-16-00303-g1a13684dfc7) 2025-05-05T06:32:38 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 18
Performance Improvements 50 11
Added Tests 0 113
Unchanged Tests 857 770
Total Tests 912

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
557.xz_r 1.65% 2425.000 2465.000 - 3.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 59.42% 0.690 1.100 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 58.33% 24.000 38.000 - 0.00% -
500.perlbench_r 4.00% 25.000 26.000 - 0.00% -
500.perlbench_r (avg) 4.00% 25.000 26.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -3.31% 10081.000 9747.000 - -0.26% -
523.xalancbmk_r -2.04% 3229.000 3163.000 - 0.00% -
527.cam4_r -1.11% 2533.000 2505.000 - 0.04% -
520.omnetpp_r -1.08% 3503.000 3465.000 - -1.84% -
503.bwaves_r -1.07% 8885.000 8790.000 - -0.60% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) -57.14% 7.000 3.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -55.56% 0.180 0.080 - 0.00% -
508.namd_r (max) -13.33% 15.000 13.000 - 0.00% -
526.blender_r (max) -12.70% 63.000 55.000 - 0.00% -
526.blender_r (max) (percentage) -12.07% 0.580 0.510 - 0.00% -
519.lbm_r (max) -11.76% 17.000 15.000 - 0.00% -
519.lbm_r (max) (percentage) -11.11% 0.450 0.400 - 0.00% -
549.fotonik3d_r (max) -10.00% 30.000 27.000 - 0.00% -
508.namd_r (max) (percentage) -9.30% 0.430 0.390 - 0.00% -
549.fotonik3d_r (max) (percentage) -8.82% 0.340 0.310 - 0.00% -
503.bwaves_r (max) -8.43% 83.000 76.000 - 0.00% -
503.bwaves_r (max) (percentage) -7.45% 0.940 0.870 - 0.00% -
525.x264_r (max) -6.25% 16.000 15.000 - 0.00% -
531.deepsjeng_r (max) -5.56% 36.000 34.000 - 0.00% -
521.wrf_r (max) -5.48% 73.000 69.000 - 0.00% -
500.perlbench_r (max) -4.76% 21.000 20.000 - 0.00% -
525.x264_r (max) (percentage) -4.55% 0.440 0.420 - 0.00% -
527.cam4_r (max) -4.26% 47.000 45.000 - 0.00% -
554.roms_r (max) -4.18% 311.000 298.000 - 0.00% -
511.povray_r (max) (percentage) -4.17% 1.440 1.380 - 0.00% -
557.xz_r (max) -4.17% 24.000 23.000 - 0.00% -
554.roms_r (max) (percentage) -4.04% 0.990 0.950 - 0.00% -
544.nab_r (max) -3.33% 60.000 58.000 - 0.00% -
505.mcf_r (max) (percentage) -3.16% 0.950 0.920 - 0.00% -
538.imagick_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
523.xalancbmk_r (max) -3.12% 64.000 62.000 - 0.00% -
500.perlbench_r (max) (percentage) -3.06% 0.980 0.950 - 0.00% -
505.mcf_r (max) -3.03% 66.000 64.000 - 0.00% -
557.xz_r (max) (percentage) -3.00% 1.000 0.970 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.94% 0.680 0.660 - 0.00% -
541.leela_r (max) -2.86% 70.000 68.000 - 0.00% -
521.wrf_r -2.78% 108.000 105.000 - 0.00% -
521.wrf_r (avg) -2.78% 108.000 105.000 - 0.00% -
521.wrf_r (max) (percentage) -2.74% 0.730 0.710 - 0.00% -
544.nab_r (max) (percentage) -2.63% 0.760 0.740 - 0.00% -
523.xalancbmk_r -2.63% 38.000 37.000 - 0.00% -
523.xalancbmk_r (avg) -2.63% 38.000 37.000 - 0.00% -
541.leela_r (max) (percentage) -2.61% 1.530 1.490 - 0.00% -
520.omnetpp_r -2.27% 44.000 43.000 - 0.00% -
520.omnetpp_r (avg) -2.27% 44.000 43.000 - 0.00% -
507.cactuBSSN_r (max) -2.04% 49.000 48.000 - 0.00% -
520.omnetpp_r (max) -1.92% 52.000 51.000 - 0.00% -
519.lbm_r (avg) (percentage) -1.79% 0.560 0.550 - 0.00% -
527.cam4_r (max) (percentage) -1.61% 1.860 1.830 - 0.00% -
507.cactuBSSN_r (max) (percentage) -1.49% 0.670 0.660 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 6.64% 3425837.000 3653362.000 - 0.50% -
541.leela_r 5.79% 74603.000 78921.000 - 0.53% -
503.bwaves_r 3.87% 29255.000 30388.000 - -0.26% -
521.wrf_r 3.54% 14837046.000 15362525.000 - 0.11% -
508.namd_r 2.62% 638884.000 655593.000 - 0.07% -
531.deepsjeng_r 1.98% 91923.000 93743.000 - 0.21% -
500.perlbench_r 1.85% 1956619.000 1992730.000 - 0.57% -
557.xz_r 1.46% 129911.000 131811.000 - -0.01% -
502.gcc_r 1.44% 8210636.000 8328880.000 - 0.30% -
520.omnetpp_r 1.33% 1374872.000 1393123.000 - 0.24% -
511.povray_r 1.25% 785535.000 795351.000 - 0.08% -
519.lbm_r 1.07% 11191.000 11311.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 8.77% 2018.000 2195.000 - 0.73% -
505.mcf_r 4.51% 6735.000 7039.000 - 0.64% -
557.xz_r 3.18% 2389.000 2465.000 - 1.65% -
554.roms_r 2.65% 30622.000 31432.000 - -0.16% -
502.gcc_r 2.11% 3604.000 3680.000 - 0.11% -
549.fotonik3d_r 1.82% 8698.000 8856.000 - -0.30% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.79% 1163451.000 1142643.000 - 0.40% -
505.mcf_r -1.40% 20525.000 20237.000 - 0.44% -
549.fotonik3d_r -1.27% 327730.000 323569.000 - -0.50% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -3.07% 424.000 411.000 - 0.24% -
520.omnetpp_r -1.84% 3530.000 3465.000 - -1.08% -
531.deepsjeng_r -1.67% 5389.000 5299.000 - -0.13% -
541.leela_r -1.31% 4658.000 4597.000 - -0.22% -
544.nab_r -1.23% 7985.000 7887.000 - -0.18% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 10.00% 20.000 22.000 - 0.00% -
nb_execution_successful 10.00% 20.000 22.000 - 0.00% -
nb_total_tests 10.00% 20.000 22.000 - 0.00% -

Added Tests - Code Size
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 2195.000 -
502.gcc_r 3680.000 -
503.bwaves_r 8790.000 -1.07%
505.mcf_r 7039.000 -
507.cactuBSSN_r 7358.000 -
508.namd_r 3492.000 -
510.parest_r 6084.000 -
511.povray_r 411.000 -
519.lbm_r 3823.000 -
520.omnetpp_r 3465.000 -1.08%
521.wrf_r 9747.000 -3.31%
523.xalancbmk_r 3163.000 -2.04%
525.x264_r 3665.000 -
526.blender_r 10818.000 -
527.cam4_r 2505.000 -1.11%
531.deepsjeng_r 5299.000 -
538.imagick_r 4232.000 -
541.leela_r 4597.000 -
544.nab_r 7887.000 -
549.fotonik3d_r 8856.000 -
554.roms_r 31432.000 -
557.xz_r 2465.000 1.65%
Geometric Mean 4737.115 -
Name Current %
500.perlbench_r 1992730.000 -
502.gcc_r 8328880.000 -
503.bwaves_r 30388.000 -
505.mcf_r 20237.000 -
507.cactuBSSN_r 3653362.000 -
508.namd_r 655593.000 -
510.parest_r 1399471.000 -
511.povray_r 795351.000 -
519.lbm_r 11311.000 -
520.omnetpp_r 1393123.000 -
521.wrf_r 15362525.000 -
523.xalancbmk_r 3002573.000 -
525.x264_r 443096.000 -
526.blender_r 8031027.000 -
527.cam4_r 2808852.000 -
531.deepsjeng_r 93743.000 -
538.imagick_r 1142643.000 -
541.leela_r 78921.000 -
544.nab_r 78271.000 -
549.fotonik3d_r 323569.000 -
554.roms_r 517889.000 -
557.xz_r 131811.000 -
Geometric Mean 560037.455 -
Name Current %
500.perlbench_r 26.000 4.00%
500.perlbench_r (avg) 26.000 4.00%
500.perlbench_r (avg) (percentage) 1.190 -
500.perlbench_r (max) 20.000 -4.76%
500.perlbench_r (max) (percentage) 0.950 -3.06%
503.bwaves_r 40.000 -
503.bwaves_r (avg) 40.000 -
503.bwaves_r (avg) (percentage) 0.460 -
503.bwaves_r (max) 76.000 -8.43%
503.bwaves_r (max) (percentage) 0.870 -7.45%
505.mcf_r 57.000 -
505.mcf_r (avg) 57.000 -
505.mcf_r (avg) (percentage) 0.820 -
505.mcf_r (max) 64.000 -3.03%
505.mcf_r (max) (percentage) 0.920 -3.16%
507.cactuBSSN_r 44.000 -
507.cactuBSSN_r (avg) 44.000 -
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) 48.000 -2.04%
507.cactuBSSN_r (max) (percentage) 0.660 -1.49%
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 13.000 -13.33%
508.namd_r (max) (percentage) 0.390 -9.30%
510.parest_r 21.000 -
510.parest_r (avg) 21.000 -
510.parest_r (avg) (percentage) 0.350 -
510.parest_r (max) 34.000 -
510.parest_r (max) (percentage) 0.560 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.200 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.380 -4.17%
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.550 -1.79%
519.lbm_r (max) 15.000 -11.76%
519.lbm_r (max) (percentage) 0.400 -11.11%
519.lbm_r (unexplained diff vs previous) 3.000 -57.14%
519.lbm_r (unexplained diff vs previous) (percentage) 0.080 -55.56%
520.omnetpp_r 43.000 -2.27%
520.omnetpp_r (avg) 43.000 -2.27%
520.omnetpp_r (avg) (percentage) 1.260 -
520.omnetpp_r (max) 51.000 -1.92%
520.omnetpp_r (max) (percentage) 1.500 -
520.omnetpp_r (unexplained diff vs previous) 38.000 58.33%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.100 59.42%
521.wrf_r 105.000 -2.78%
521.wrf_r (avg) 105.000 -2.78%
521.wrf_r (avg) (percentage) 1.080 -
521.wrf_r (max) 69.000 -5.48%
521.wrf_r (max) (percentage) 0.710 -2.74%
523.xalancbmk_r 37.000 -2.63%
523.xalancbmk_r (avg) 37.000 -2.63%
523.xalancbmk_r (avg) (percentage) 1.200 -
523.xalancbmk_r (max) 62.000 -3.12%
523.xalancbmk_r (max) (percentage) 1.980 -
525.x264_r 22.000 -
525.x264_r (avg) 22.000 -
525.x264_r (avg) (percentage) 0.610 -
525.x264_r (max) 15.000 -6.25%
525.x264_r (max) (percentage) 0.420 -4.55%
526.blender_r 30.000 -
526.blender_r (avg) 30.000 -
526.blender_r (avg) (percentage) 0.280 -
526.blender_r (max) 55.000 -12.70%
526.blender_r (max) (percentage) 0.510 -12.07%
527.cam4_r 32.000 -
527.cam4_r (avg) 32.000 -
527.cam4_r (avg) (percentage) 1.290 -
527.cam4_r (max) 45.000 -4.26%
527.cam4_r (max) (percentage) 1.830 -1.61%
531.deepsjeng_r 25.000 -
531.deepsjeng_r (avg) 25.000 -
531.deepsjeng_r (avg) (percentage) 0.480 -
531.deepsjeng_r (max) 34.000 -5.56%
531.deepsjeng_r (max) (percentage) 0.660 -2.94%
538.imagick_r 9.000 -
538.imagick_r (avg) 9.000 -
538.imagick_r (avg) (percentage) 0.230 -
538.imagick_r (max) 13.000 -
538.imagick_r (max) (percentage) 0.310 -3.13%
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.650 -
541.leela_r (max) 68.000 -2.86%
541.leela_r (max) (percentage) 1.490 -2.61%
544.nab_r 33.000 -
544.nab_r (avg) 33.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 58.000 -3.33%
544.nab_r (max) (percentage) 0.740 -2.63%
548.exchange2_r (avg) (percentage) 0.540 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 34.000 -
549.fotonik3d_r (avg) 34.000 -
549.fotonik3d_r (avg) (percentage) 0.390 -
549.fotonik3d_r (max) 27.000 -10.00%
549.fotonik3d_r (max) (percentage) 0.310 -8.82%
554.roms_r 245.000 -
554.roms_r (avg) 245.000 -
554.roms_r (avg) (percentage) 0.780 -
554.roms_r (max) 298.000 -4.18%
554.roms_r (max) (percentage) 0.950 -4.04%
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.770 -
557.xz_r (max) 23.000 -4.17%
557.xz_r (max) (percentage) 0.970 -3.00%
Geometric Mean 6.179 -2.55%