Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=998165ba99a3bcc80ba0b196223f4d49623e87b4 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (1a13684dfc7286139064f7d7341462c9995cbd1c) (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=3270c50e4853d9356eb5892364c52cd1558860ec (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
regression GNU-1572
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/313/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0313 (basepoints/gcc-16-00303-g1a13684dfc7) 2025-05-05T06:32:38 0:00:00
Previous 0312 (basepoints/gcc-16-00302-g85e4f21f9e9) 2025-05-03T21:09:33 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 20
Performance Improvements 40 10
Added Tests 0 115
Unchanged Tests 865 779
Total Tests 924

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r 3.37% 29476.000 30468.000 - 4.15% -
531.deepsjeng_r 1.51% 92163.000 93551.000 - 1.77% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r 3.18% 9770.000 10081.000 - 3.16% -
500.perlbench_r 2.25% 2131.000 2179.000 - 7.98% -
527.cam4_r 1.08% 2506.000 2533.000 - 1.16% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (unexplained diff vs previous) (percentage) 152.17% 0.230 0.580 - 0.00% -
526.blender_r (unexplained diff vs previous) 152.00% 25.000 63.000 - 0.00% -
508.namd_r (max) 87.50% 8.000 15.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 87.50% 8.000 15.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 86.96% 0.230 0.430 - 0.00% -
508.namd_r (max) (percentage) 72.00% 0.250 0.430 - 0.00% -
526.blender_r (max) 28.57% 49.000 63.000 - 0.00% -
526.blender_r (max) (percentage) 26.09% 0.460 0.580 - 0.00% -
526.blender_r 20.00% 25.000 30.000 - 0.00% -
526.blender_r (avg) 20.00% 25.000 30.000 - 0.00% -
526.blender_r (avg) (percentage) 16.67% 0.240 0.280 - 0.00% -
521.wrf_r 2.86% 105.000 108.000 - 0.00% -
521.wrf_r (avg) 2.86% 105.000 108.000 - 0.00% -
507.cactuBSSN_r (max) 2.08% 48.000 49.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
557.xz_r -1.02% 2450.000 2425.000 - 1.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -70.00% 0.600 0.180 - 0.00% -
519.lbm_r (unexplained diff vs previous) -69.57% 23.000 7.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -60.78% 1.020 0.400 - 0.00% -
505.mcf_r (unexplained diff vs previous) -60.56% 71.000 28.000 - 0.00% -
520.omnetpp_r (max) (percentage) -55.22% 3.350 1.500 - 0.00% -
520.omnetpp_r (max) -55.17% 116.000 52.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -44.35% 1.240 0.690 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -44.19% 43.000 24.000 - 0.00% -
519.lbm_r (max) (percentage) -25.00% 0.600 0.450 - 0.00% -
519.lbm_r (max) -22.73% 22.000 17.000 - 0.00% -
511.povray_r (max) -16.67% 6.000 5.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -12.82% 0.390 0.340 - 0.00% -
549.fotonik3d_r (max) -11.76% 34.000 30.000 - 0.00% -
503.bwaves_r (max) (percentage) -7.84% 1.020 0.940 - 0.00% -
503.bwaves_r (max) -7.78% 90.000 83.000 - 0.00% -
505.mcf_r (max) (percentage) -5.94% 1.010 0.950 - 0.00% -
505.mcf_r (max) -5.71% 70.000 66.000 - 0.00% -
554.roms_r (max) -4.89% 327.000 311.000 - 0.00% -
554.roms_r (max) (percentage) -4.81% 1.040 0.990 - 0.00% -
525.x264_r (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
541.leela_r (max) -4.11% 73.000 70.000 - 0.00% -
511.povray_r (max) (percentage) -4.00% 1.500 1.440 - 0.00% -
557.xz_r (max) -4.00% 25.000 24.000 - 0.00% -
521.wrf_r (max) (percentage) -3.95% 0.760 0.730 - 0.00% -
500.perlbench_r (max) (percentage) -3.92% 1.020 0.980 - 0.00% -
557.xz_r (max) (percentage) -3.85% 1.040 1.000 - 0.00% -
541.leela_r -3.33% 30.000 29.000 - 0.00% -
541.leela_r (avg) -3.33% 30.000 29.000 - 0.00% -
541.leela_r (max) (percentage) -3.16% 1.580 1.530 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.86% 0.700 0.680 - 0.00% -
531.deepsjeng_r (max) -2.70% 37.000 36.000 - 0.00% -
544.nab_r (max) (percentage) -2.56% 0.780 0.760 - 0.00% -
523.xalancbmk_r -2.56% 39.000 38.000 - 0.00% -
523.xalancbmk_r (avg) -2.56% 39.000 38.000 - 0.00% -
527.cam4_r (max) (percentage) -2.11% 1.900 1.860 - 0.00% -
544.nab_r (max) -1.64% 61.000 60.000 - 0.00% -
523.xalancbmk_r (max) -1.54% 65.000 64.000 - 0.00% -
521.wrf_r (max) -1.35% 74.000 73.000 - 0.00% -
505.mcf_r (avg) (percentage) -1.20% 0.830 0.820 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 6.11% 3425837.000 3635178.000 - 0.19% -
541.leela_r 5.23% 74603.000 78503.000 - 0.07% -
503.bwaves_r 4.15% 29255.000 30468.000 - 3.37% -
521.wrf_r 3.43% 14837046.000 15345665.000 - 0.96% -
508.namd_r 2.55% 638884.000 655147.000 - 0.00% -
531.deepsjeng_r 1.77% 91923.000 93551.000 - 1.51% -
557.xz_r 1.47% 129911.000 131819.000 - 0.04% -
500.perlbench_r 1.27% 1956619.000 1981438.000 - 0.03% -
511.povray_r 1.17% 785535.000 794707.000 - 0.05% -
502.gcc_r 1.14% 8210636.000 8303964.000 - 0.05% -
520.omnetpp_r 1.08% 1374872.000 1389763.000 - -0.01% -
519.lbm_r 1.07% 11191.000 11311.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 7.98% 2018.000 2179.000 - 2.25% -
505.mcf_r 3.85% 6735.000 6994.000 - 0.40% -
521.wrf_r 3.16% 9772.000 10081.000 - 3.18% -
554.roms_r 2.81% 30622.000 31482.000 - 0.09% -
549.fotonik3d_r 2.13% 8698.000 8883.000 - -0.22% -
502.gcc_r 2.00% 3604.000 3676.000 - 0.71% -
557.xz_r 1.51% 2389.000 2425.000 - -1.02% -
527.cam4_r 1.16% 2504.000 2533.000 - 1.08% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -2.18% 1163451.000 1138059.000 - 0.41% -
505.mcf_r -1.83% 20525.000 20149.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -3.30% 424.000 410.000 - 0.00% -
531.deepsjeng_r -1.54% 5389.000 5306.000 - -0.15% -
507.cactuBSSN_r -1.10% 7423.000 7341.000 - 0.58% -
541.leela_r -1.09% 4658.000 4607.000 - -0.50% -
544.nab_r -1.05% 7985.000 7901.000 - 0.27% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 10.00% 20.000 22.000 - 0.00% -
nb_execution_successful 10.00% 20.000 22.000 - 0.00% -
nb_total_tests 10.00% 20.000 22.000 - 0.00% -

Added Tests - Code Size
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 2179.000 2.25%
502.gcc_r 3676.000 -
503.bwaves_r 8885.000 -
505.mcf_r 6994.000 -
507.cactuBSSN_r 7341.000 -
508.namd_r 3523.000 -
510.parest_r 6093.000 -
511.povray_r 410.000 -
519.lbm_r 3826.000 -
520.omnetpp_r 3503.000 -
521.wrf_r 10081.000 3.18%
523.xalancbmk_r 3229.000 -
525.x264_r 3668.000 -
526.blender_r 10896.000 -
527.cam4_r 2533.000 1.08%
531.deepsjeng_r 5306.000 -
538.imagick_r 4230.000 -
541.leela_r 4607.000 -
544.nab_r 7901.000 -
549.fotonik3d_r 8883.000 -
554.roms_r 31482.000 -
557.xz_r 2425.000 -1.02%
Geometric Mean 4754.312 -
Name Current %
500.perlbench_r 1981438.000 -
502.gcc_r 8303964.000 -
503.bwaves_r 30468.000 3.37%
505.mcf_r 20149.000 -
507.cactuBSSN_r 3635178.000 -
508.namd_r 655147.000 -
510.parest_r 1402823.000 -
511.povray_r 794707.000 -
519.lbm_r 11311.000 -
520.omnetpp_r 1389763.000 -
521.wrf_r 15345665.000 -
523.xalancbmk_r 3001645.000 -
525.x264_r 441905.000 -
526.blender_r 8008955.000 -
527.cam4_r 2808508.000 -
531.deepsjeng_r 93551.000 1.51%
538.imagick_r 1138059.000 -
541.leela_r 78503.000 -
544.nab_r 78183.000 -
549.fotonik3d_r 325193.000 -
554.roms_r 517633.000 -
557.xz_r 131819.000 -
Geometric Mean 559228.114 -
Name Current %
500.perlbench_r 25.000 -
500.perlbench_r (avg) 25.000 -
500.perlbench_r (avg) (percentage) 1.190 -
500.perlbench_r (max) 21.000 -
500.perlbench_r (max) (percentage) 0.980 -3.92%
503.bwaves_r 40.000 -
503.bwaves_r (avg) 40.000 -
503.bwaves_r (avg) (percentage) 0.460 -
503.bwaves_r (max) 83.000 -7.78%
503.bwaves_r (max) (percentage) 0.940 -7.84%
505.mcf_r 57.000 -
505.mcf_r (avg) 57.000 -
505.mcf_r (avg) (percentage) 0.820 -1.20%
505.mcf_r (max) 66.000 -5.71%
505.mcf_r (max) (percentage) 0.950 -5.94%
505.mcf_r (unexplained diff vs previous) 28.000 -60.56%
505.mcf_r (unexplained diff vs previous) (percentage) 0.400 -60.78%
507.cactuBSSN_r 44.000 -
507.cactuBSSN_r (avg) 44.000 -
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) 49.000 2.08%
507.cactuBSSN_r (max) (percentage) 0.670 -
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 15.000 87.50%
508.namd_r (max) (percentage) 0.430 72.00%
508.namd_r (unexplained diff vs previous) 15.000 87.50%
508.namd_r (unexplained diff vs previous) (percentage) 0.430 86.96%
510.parest_r 21.000 -
510.parest_r (avg) 21.000 -
510.parest_r (avg) (percentage) 0.350 -
510.parest_r (max) 34.000 -
510.parest_r (max) (percentage) 0.560 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.200 -
511.povray_r (max) 5.000 -16.67%
511.povray_r (max) (percentage) 1.440 -4.00%
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.560 -
519.lbm_r (max) 17.000 -22.73%
519.lbm_r (max) (percentage) 0.450 -25.00%
519.lbm_r (unexplained diff vs previous) 7.000 -69.57%
519.lbm_r (unexplained diff vs previous) (percentage) 0.180 -70.00%
520.omnetpp_r 44.000 -
520.omnetpp_r (avg) 44.000 -
520.omnetpp_r (avg) (percentage) 1.260 -
520.omnetpp_r (max) 52.000 -55.17%
520.omnetpp_r (max) (percentage) 1.500 -55.22%
520.omnetpp_r (unexplained diff vs previous) 24.000 -44.19%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.690 -44.35%
521.wrf_r 108.000 2.86%
521.wrf_r (avg) 108.000 2.86%
521.wrf_r (avg) (percentage) 1.080 -
521.wrf_r (max) 73.000 -1.35%
521.wrf_r (max) (percentage) 0.730 -3.95%
523.xalancbmk_r 38.000 -2.56%
523.xalancbmk_r (avg) 38.000 -2.56%
523.xalancbmk_r (avg) (percentage) 1.200 -
523.xalancbmk_r (max) 64.000 -1.54%
523.xalancbmk_r (max) (percentage) 1.990 -
525.x264_r 22.000 -
525.x264_r (avg) 22.000 -
525.x264_r (avg) (percentage) 0.610 -
525.x264_r (max) 16.000 -
525.x264_r (max) (percentage) 0.440 -4.35%
526.blender_r 30.000 20.00%
526.blender_r (avg) 30.000 20.00%
526.blender_r (avg) (percentage) 0.280 16.67%
526.blender_r (max) 63.000 28.57%
526.blender_r (max) (percentage) 0.580 26.09%
526.blender_r (unexplained diff vs previous) 63.000 152.00%
526.blender_r (unexplained diff vs previous) (percentage) 0.580 152.17%
527.cam4_r 32.000 -
527.cam4_r (avg) 32.000 -
527.cam4_r (avg) (percentage) 1.290 -
527.cam4_r (max) 47.000 -
527.cam4_r (max) (percentage) 1.860 -2.11%
531.deepsjeng_r 25.000 -
531.deepsjeng_r (avg) 25.000 -
531.deepsjeng_r (avg) (percentage) 0.480 -
531.deepsjeng_r (max) 36.000 -2.70%
531.deepsjeng_r (max) (percentage) 0.680 -2.86%
538.imagick_r 9.000 -
538.imagick_r (avg) 9.000 -
538.imagick_r (avg) (percentage) 0.230 -
538.imagick_r (max) 13.000 -
538.imagick_r (max) (percentage) 0.320 -
541.leela_r 29.000 -3.33%
541.leela_r (avg) 29.000 -3.33%
541.leela_r (avg) (percentage) 0.650 -
541.leela_r (max) 70.000 -4.11%
541.leela_r (max) (percentage) 1.530 -3.16%
544.nab_r 33.000 -
544.nab_r (avg) 33.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 60.000 -1.64%
544.nab_r (max) (percentage) 0.760 -2.56%
548.exchange2_r (avg) (percentage) 0.540 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 34.000 -
549.fotonik3d_r (avg) 34.000 -
549.fotonik3d_r (avg) (percentage) 0.390 -
549.fotonik3d_r (max) 30.000 -11.76%
549.fotonik3d_r (max) (percentage) 0.340 -12.82%
554.roms_r 245.000 -
554.roms_r (avg) 245.000 -
554.roms_r (avg) (percentage) 0.780 -
554.roms_r (max) 311.000 -4.89%
554.roms_r (max) (percentage) 0.990 -4.81%
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.770 -
557.xz_r (max) 24.000 -4.00%
557.xz_r (max) (percentage) 1.000 -3.85%
Geometric Mean 6.169 -3.09%