Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f3d834df28734ebc82931808960fe63401127c06 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (d4da4474dd3b76d82bf1c9dc79548b708322cb46) (+ 243 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4f6dae219578d6df475864e273da40bde9d30806 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/150/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0150 (basepoints/gcc-16-00432-gd4da4474dd3) 2025-05-05T04:40:56 0:00:00
Previous 0149 (basepoints/gcc-16-00189-g99aa410f5e0) 2025-05-03T09:03:24 0:00:00
Baseline 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 9
Performance Improvements 52 18
Added Tests 3 115
Unchanged Tests 904 824
Total Tests 966

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 320.45% 0.440 1.850 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 310.34% 58.000 238.000 - 0.00% -
520.omnetpp_r (max) (percentage) 175.76% 0.660 1.820 - 0.00% -
520.omnetpp_r (max) 172.09% 86.000 234.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.90% 1.050 1.070 - 0.00% -
544.nab_r 1.89% 53.000 54.000 - 0.00% -
544.nab_r (avg) 1.89% 53.000 54.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -1.82% 13098.000 12860.000 - -2.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) -60.98% 82.000 32.000 - 0.00% -
505.mcf_r (max) (percentage) -60.66% 0.610 0.240 - 0.00% -
505.mcf_r (unexplained diff vs previous) -53.49% 43.000 20.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -53.12% 0.320 0.150 - 0.00% -
519.lbm_r (max) -52.78% 36.000 17.000 - 0.00% -
519.lbm_r (max) (percentage) -52.38% 0.210 0.100 - 0.00% -
510.parest_r (unexplained diff vs previous) -50.00% 10.000 5.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -50.00% 0.040 0.020 - 0.00% -
519.lbm_r (unexplained diff vs previous) -15.00% 20.000 17.000 - 0.00% -
531.deepsjeng_r (max) -10.56% 142.000 127.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -9.77% 1.330 1.200 - 0.00% -
503.bwaves_r (max) -9.38% 32.000 29.000 - 0.00% -
549.fotonik3d_r (max) -9.29% 140.000 127.000 - 0.00% -
527.cam4_r (max) (percentage) -8.96% 0.670 0.610 - 0.00% -
527.cam4_r (max) -8.86% 79.000 72.000 - 0.00% -
527.cam4_r (unexplained diff vs previous) -8.86% 79.000 72.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -8.70% 0.690 0.630 - 0.00% -
508.namd_r (max) -8.33% 12.000 11.000 - 0.00% -
503.bwaves_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
510.parest_r (avg) (percentage) -7.69% 0.130 0.120 - 0.00% -
510.parest_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
527.cam4_r (unexplained diff vs previous) (percentage) -7.58% 0.660 0.610 - 0.00% -
538.imagick_r (max) (percentage) -7.44% 1.210 1.120 - 0.00% -
557.xz_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
538.imagick_r (max) -7.03% 185.000 172.000 - 0.00% -
510.parest_r -6.90% 29.000 27.000 - 0.00% -
510.parest_r (avg) -6.90% 29.000 27.000 - 0.00% -
510.parest_r (max) -6.90% 29.000 27.000 - 0.00% -
526.blender_r (max) -6.90% 58.000 54.000 - 0.00% -
526.blender_r (max) (percentage) -6.38% 0.470 0.440 - 0.00% -
541.leela_r (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
557.xz_r (max) -5.88% 17.000 16.000 - 0.00% -
523.xalancbmk_r (max) -5.18% 193.000 183.000 - 0.00% -
541.leela_r (max) -5.00% 20.000 19.000 - 0.00% -
525.x264_r -4.76% 21.000 20.000 - 0.00% -
525.x264_r (avg) -4.76% 21.000 20.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.38% 1.600 1.530 - 0.00% -
521.wrf_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
502.gcc_r (max) (percentage) -4.35% 0.690 0.660 - 0.00% -
507.cactuBSSN_r (max) (percentage) -4.21% 0.950 0.910 - 0.00% -
502.gcc_r (max) -4.11% 73.000 70.000 - 0.00% -
544.nab_r (max) (percentage) -4.08% 0.490 0.470 - 0.00% -
521.wrf_r (max) -4.08% 49.000 47.000 - 0.00% -
554.roms_r (max) (percentage) -3.77% 0.530 0.510 - 0.00% -
554.roms_r (max) -3.64% 110.000 106.000 - 0.00% -
544.nab_r (max) -3.51% 57.000 55.000 - 0.00% -
507.cactuBSSN_r (max) -3.47% 202.000 195.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.21% 1.360 1.330 - 0.00% -
505.mcf_r -2.13% 47.000 46.000 - 0.00% -
505.mcf_r (avg) -2.13% 47.000 46.000 - 0.00% -
500.perlbench_r (max) -1.60% 187.000 184.000 - 0.00% -

Added Tests - sample variability
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
548.exchange2_r (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 4.84% 18014.000 18886.000 - 0.04% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 3.86% 21015.000 21826.000 - 0.56% -
505.mcf_r 3.26% 13186.000 13616.000 - 0.15% -
554.roms_r 2.84% 20361.000 20939.000 - 0.85% -
503.bwaves_r 2.51% 24051.000 24654.000 - -0.03% -
549.fotonik3d_r 2.21% 19864.000 20303.000 - -0.24% -
510.parest_r 1.51% 22639.000 22981.000 - -0.02% -
507.cactuBSSN_r 1.01% 21233.000 21448.000 - 0.81% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.33% 24.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -2.50% 45366.000 44233.000 - 0.18% -
549.fotonik3d_r -2.17% 183875.000 179880.000 - -0.04% -
544.nab_r -1.50% 49589.000 48845.000 - 0.02% -
510.parest_r -1.31% 725746.000 716271.000 - 0.01% -
538.imagick_r -1.22% 671242.000 663026.000 - -0.02% -
531.deepsjeng_r -1.22% 50769.000 50149.000 - -0.14% -
502.gcc_r -1.20% 4233263.000 4182319.000 - -0.14% -
511.povray_r -1.17% 498628.000 492773.000 - 0.03% -
520.omnetpp_r -1.16% 748951.000 740249.000 - 0.01% -
507.cactuBSSN_r -1.11% 1813477.000 1793416.000 - 0.01% -
500.perlbench_r -1.02% 1095104.000 1083890.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -4.49% 11114.000 10615.000 - -0.96% -
541.leela_r -3.33% 12801.000 12375.000 - 0.97% -
520.omnetpp_r -2.11% 13137.000 12860.000 - -1.82% -
502.gcc_r -1.46% 10804.000 10646.000 - -0.47% -
521.wrf_r -1.32% 21850.000 21561.000 - -0.78% -
525.x264_r -1.28% 14731.000 14543.000 - 0.02% -
526.blender_r -1.10% 12586.000 12447.000 - 0.45% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 13875.000 -
502.gcc_r 10646.000 -
503.bwaves_r 24654.000 -
505.mcf_r 13616.000 -
507.cactuBSSN_r 21448.000 -
508.namd_r 10633.000 -
510.parest_r 22981.000 -
511.povray_r 21826.000 -
519.lbm_r 17566.000 -
520.omnetpp_r 12860.000 -1.82%
521.wrf_r 21561.000 -
523.xalancbmk_r 12024.000 -
525.x264_r 14543.000 -
526.blender_r 12447.000 -
527.cam4_r 11818.000 -
531.deepsjeng_r 10615.000 -
538.imagick_r 15358.000 -
541.leela_r 12375.000 -
544.nab_r 11796.000 -
549.fotonik3d_r 20303.000 -
554.roms_r 20939.000 -
557.xz_r 12659.000 -
Geometric Mean 15134.166 -
Name Current %
500.perlbench_r 1083890.000 -
502.gcc_r 4182319.000 -
503.bwaves_r 18886.000 -
505.mcf_r 14153.000 -
507.cactuBSSN_r 1793416.000 -
508.namd_r 357368.000 -
510.parest_r 716271.000 -
511.povray_r 492773.000 -
519.lbm_r 10113.000 -
520.omnetpp_r 740249.000 -
521.wrf_r 7699653.000 -
523.xalancbmk_r 1574890.000 -
525.x264_r 261054.000 -
526.blender_r 4356833.000 -
527.cam4_r 1812298.000 -
531.deepsjeng_r 50149.000 -
538.imagick_r 663026.000 -
541.leela_r 44233.000 -
544.nab_r 48845.000 -
549.fotonik3d_r 179880.000 -
554.roms_r 340704.000 -
557.xz_r 75417.000 -
Geometric Mean 323973.565 -
Name Current %
500.perlbench_r 106.000 -
500.perlbench_r (avg) 106.000 -
500.perlbench_r (avg) (percentage) 0.770 -
500.perlbench_r (max) 184.000 -1.60%
500.perlbench_r (max) (percentage) 1.330 -2.21%
502.gcc_r 34.000 -
502.gcc_r (avg) 34.000 -
502.gcc_r (avg) (percentage) 0.320 -
502.gcc_r (max) 70.000 -4.11%
502.gcc_r (max) (percentage) 0.660 -4.35%
503.bwaves_r 51.000 -
503.bwaves_r (avg) 51.000 -
503.bwaves_r (avg) (percentage) 0.210 -
503.bwaves_r (max) 29.000 -9.38%
503.bwaves_r (max) (percentage) 0.120 -7.69%
505.mcf_r 46.000 -2.13%
505.mcf_r (avg) 46.000 -2.13%
505.mcf_r (avg) (percentage) 0.340 -
505.mcf_r (max) 32.000 -60.98%
505.mcf_r (max) (percentage) 0.240 -60.66%
505.mcf_r (unexplained diff vs previous) 20.000 -53.49%
505.mcf_r (unexplained diff vs previous) (percentage) 0.150 -53.12%
507.cactuBSSN_r 87.000 -
507.cactuBSSN_r (avg) 87.000 -
507.cactuBSSN_r (avg) (percentage) 0.410 -
507.cactuBSSN_r (max) 195.000 -3.47%
507.cactuBSSN_r (max) (percentage) 0.910 -4.21%
508.namd_r 29.000 -
508.namd_r (avg) 29.000 -
508.namd_r (avg) (percentage) 0.280 -
508.namd_r (max) 11.000 -8.33%
508.namd_r (max) (percentage) 0.110 -
510.parest_r 27.000 -6.90%
510.parest_r (avg) 27.000 -6.90%
510.parest_r (avg) (percentage) 0.120 -7.69%
510.parest_r (max) 27.000 -6.90%
510.parest_r (max) (percentage) 0.120 -7.69%
510.parest_r (unexplained diff vs previous) 5.000 -50.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.020 -50.00%
511.povray_r 117.000 -
511.povray_r (avg) 117.000 -
511.povray_r (avg) (percentage) 0.540 -
511.povray_r (max) 91.000 -
511.povray_r (max) (percentage) 0.420 -
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.110 -
519.lbm_r (max) 17.000 -52.78%
519.lbm_r (max) (percentage) 0.100 -52.38%
519.lbm_r (unexplained diff vs previous) 17.000 -15.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.100 -
520.omnetpp_r 137.000 -
520.omnetpp_r (avg) 137.000 -
520.omnetpp_r (avg) (percentage) 1.070 1.90%
520.omnetpp_r (max) 234.000 172.09%
520.omnetpp_r (max) (percentage) 1.820 175.76%
520.omnetpp_r (unexplained diff vs previous) 238.000 310.34%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.850 320.45%
521.wrf_r 112.000 -
521.wrf_r (avg) 112.000 -
521.wrf_r (avg) (percentage) 0.520 -
521.wrf_r (max) 47.000 -4.08%
521.wrf_r (max) (percentage) 0.220 -4.35%
523.xalancbmk_r 48.000 -
523.xalancbmk_r (avg) 48.000 -
523.xalancbmk_r (avg) (percentage) 0.400 -
523.xalancbmk_r (max) 183.000 -5.18%
523.xalancbmk_r (max) (percentage) 1.530 -4.38%
525.x264_r 20.000 -4.76%
525.x264_r (avg) 20.000 -4.76%
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 8.000 -
525.x264_r (max) (percentage) 0.060 -
525.x264_r (unexplained diff vs previous) 3.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.020 -
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.310 -
526.blender_r (max) 54.000 -6.90%
526.blender_r (max) (percentage) 0.440 -6.38%
527.cam4_r 53.000 -
527.cam4_r (avg) 53.000 -
527.cam4_r (avg) (percentage) 0.450 -
527.cam4_r (max) 72.000 -8.86%
527.cam4_r (max) (percentage) 0.610 -8.96%
527.cam4_r (unexplained diff vs previous) 72.000 -8.86%
527.cam4_r (unexplained diff vs previous) (percentage) 0.610 -7.58%
531.deepsjeng_r 87.000 -
531.deepsjeng_r (avg) 87.000 -
531.deepsjeng_r (avg) (percentage) 0.820 -
531.deepsjeng_r (max) 127.000 -10.56%
531.deepsjeng_r (max) (percentage) 1.200 -9.77%
538.imagick_r 64.000 -
538.imagick_r (avg) 64.000 -
538.imagick_r (avg) (percentage) 0.420 -
538.imagick_r (max) 172.000 -7.03%
538.imagick_r (max) (percentage) 1.120 -7.44%
541.leela_r 25.000 -
541.leela_r (avg) 25.000 -
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 19.000 -5.00%
541.leela_r (max) (percentage) 0.160 -5.88%
544.nab_r 54.000 1.89%
544.nab_r (avg) 54.000 1.89%
544.nab_r (avg) (percentage) 0.460 -
544.nab_r (max) 55.000 -3.51%
544.nab_r (max) (percentage) 0.470 -4.08%
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 52.000 -
549.fotonik3d_r (avg) 52.000 -
549.fotonik3d_r (avg) (percentage) 0.260 -
549.fotonik3d_r (max) 127.000 -9.29%
549.fotonik3d_r (max) (percentage) 0.630 -8.70%
554.roms_r 41.000 -
554.roms_r (avg) 41.000 -
554.roms_r (avg) (percentage) 0.200 -
554.roms_r (max) 106.000 -3.64%
554.roms_r (max) (percentage) 0.510 -3.77%
557.xz_r 22.000 -
557.xz_r (avg) 22.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 16.000 -5.88%
557.xz_r (max) (percentage) 0.130 -7.14%
Geometric Mean 5.552 -16.47%