Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f9a37571ba647927c4f37706fe69fba8f69339dd (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (d036322ada1481d90034d389e345e5db26b4a808) (+ 593 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=daab2a6d19f8360248289840408e7d2e5c203c2e (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/162/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0162 (basepoints/gcc-16-01475-gd036322ada1) 2025-06-06T10:18:47 0:00:00
Previous 0161 (3-changed-components) 2025-05-31T10:33:58 0:00:00
Baseline 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 8
Performance Improvements 74 19
Added Tests 1 115
Unchanged Tests 884 824
Total Tests 966

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 1.36% 13757.000 13944.000 - 0.70% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) (percentage) 120.00% 0.050 0.110 - 0.00% -
525.x264_r (unexplained diff vs previous) 100.00% 8.000 16.000 - 0.00% -
519.lbm_r 10.53% 19.000 21.000 - 0.00% -
519.lbm_r (avg) 10.53% 19.000 21.000 - 0.00% -
500.perlbench_r 1.98% 101.000 103.000 - 0.00% -
500.perlbench_r (avg) 1.98% 101.000 103.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -99.32% 147.000 1.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -99.12% 1.140 0.010 - 0.00% -
510.parest_r (unexplained diff vs previous) -85.16% 182.000 27.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -84.81% 0.790 0.120 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -64.00% 0.250 0.090 - 0.00% -
521.wrf_r (unexplained diff vs previous) -62.39% 117.000 44.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) (percentage) -61.82% 0.550 0.210 - 0.00% -
508.namd_r (unexplained diff vs previous) -61.54% 26.000 10.000 - 0.00% -
520.omnetpp_r (max) -52.84% 229.000 108.000 - 0.00% -
520.omnetpp_r (max) (percentage) -52.54% 1.770 0.840 - 0.00% -
527.cam4_r (unexplained diff vs previous) -39.47% 38.000 23.000 - 0.00% -
527.cam4_r (unexplained diff vs previous) (percentage) -39.39% 0.330 0.200 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -28.12% 96.000 69.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -27.66% 0.470 0.340 - 0.00% -
510.parest_r (max) -25.41% 181.000 135.000 - 0.00% -
510.parest_r (max) (percentage) -25.32% 0.790 0.590 - 0.00% -
549.fotonik3d_r (max) (percentage) -22.22% 0.540 0.420 - 0.00% -
549.fotonik3d_r (max) -22.02% 109.000 85.000 - 0.00% -
508.namd_r (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
508.namd_r (max) -11.54% 26.000 23.000 - 0.00% -
521.wrf_r (max) -9.40% 117.000 106.000 - 0.00% -
521.wrf_r (max) (percentage) -9.09% 0.550 0.500 - 0.00% -
544.nab_r (max) -9.09% 44.000 40.000 - 0.00% -
544.nab_r (max) (percentage) -7.89% 0.380 0.350 - 0.00% -
557.xz_r (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
505.mcf_r (max) -6.85% 73.000 68.000 - 0.00% -
511.povray_r (max) -6.75% 163.000 152.000 - 0.00% -
511.povray_r (max) (percentage) -6.67% 0.750 0.700 - 0.00% -
527.cam4_r (max) (percentage) -6.47% 1.700 1.590 - 0.00% -
554.roms_r (max) (percentage) -6.25% 1.760 1.650 - 0.00% -
527.cam4_r (max) -6.15% 195.000 183.000 - 0.00% -
554.roms_r (max) -6.04% 364.000 342.000 - 0.00% -
525.x264_r (max) -5.88% 17.000 16.000 - 0.00% -
505.mcf_r (max) (percentage) -5.56% 0.540 0.510 - 0.00% -
557.xz_r (max) -5.56% 36.000 34.000 - 0.00% -
503.bwaves_r (max) (percentage) -5.26% 0.190 0.180 - 0.00% -
502.gcc_r (max) -5.17% 58.000 55.000 - 0.00% -
541.leela_r (max) -5.17% 58.000 55.000 - 0.00% -
500.perlbench_r (max) (percentage) -5.08% 0.590 0.560 - 0.00% -
526.blender_r (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
503.bwaves_r (max) -4.35% 46.000 44.000 - 0.00% -
541.leela_r (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
519.lbm_r (max) -4.08% 49.000 47.000 - 0.00% -
538.imagick_r (max) -4.03% 124.000 119.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.92% 3.060 2.940 - 0.00% -
526.blender_r (max) -3.77% 53.000 51.000 - 0.00% -
502.gcc_r (max) (percentage) -3.70% 0.540 0.520 - 0.00% -
538.imagick_r (max) (percentage) -3.70% 0.810 0.780 - 0.00% -
500.perlbench_r (max) -3.70% 81.000 78.000 - 0.00% -
508.namd_r (avg) (percentage) -3.57% 0.280 0.270 - 0.00% -
519.lbm_r (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -3.57% 0.280 0.270 - 0.00% -
508.namd_r -3.45% 29.000 28.000 - 0.00% -
508.namd_r (avg) -3.45% 29.000 28.000 - 0.00% -
523.xalancbmk_r (max) -3.31% 363.000 351.000 - 0.00% -
520.omnetpp_r -2.84% 141.000 137.000 - 0.00% -
520.omnetpp_r (avg) -2.84% 141.000 137.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -2.75% 1.090 1.060 - 0.00% -
531.deepsjeng_r (avg) (percentage) -2.50% 0.800 0.780 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.50% 0.800 0.780 - 0.00% -
507.cactuBSSN_r (max) (percentage) -2.41% 0.830 0.810 - 0.00% -
531.deepsjeng_r -2.38% 84.000 82.000 - 0.00% -
531.deepsjeng_r (avg) -2.38% 84.000 82.000 - 0.00% -
531.deepsjeng_r (max) -2.38% 84.000 82.000 - 0.00% -
505.mcf_r -2.17% 46.000 45.000 - 0.00% -
505.mcf_r (avg) -2.17% 46.000 45.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) -2.04% 49.000 48.000 - 0.00% -
521.wrf_r (avg) (percentage) -1.96% 0.510 0.500 - 0.00% -
527.cam4_r (avg) (percentage) -1.89% 0.530 0.520 - 0.00% -
521.wrf_r -1.85% 108.000 106.000 - 0.00% -
521.wrf_r (avg) -1.85% 108.000 106.000 - 0.00% -
507.cactuBSSN_r (max) -1.70% 176.000 173.000 - 0.00% -
527.cam4_r -1.67% 60.000 59.000 - 0.00% -
527.cam4_r (avg) -1.67% 60.000 59.000 - 0.00% -

Added Tests - sample variability
548.exchange2_r (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 5.20% 18014.000 18950.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 3.74% 21015.000 21800.000 - 0.27% -
505.mcf_r 2.44% 13186.000 13508.000 - -0.25% -
503.bwaves_r 2.18% 24051.000 24575.000 - 0.05% -
554.roms_r 2.06% 20361.000 20781.000 - 0.30% -
549.fotonik3d_r 1.97% 19864.000 20255.000 - -0.34% -
510.parest_r 1.39% 22639.000 22953.000 - -0.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.33% 24.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -2.50% 45366.000 44233.000 - 0.00% -
549.fotonik3d_r -2.24% 183875.000 179760.000 - 0.00% -
544.nab_r -1.50% 49589.000 48845.000 - 0.02% -
510.parest_r -1.32% 725746.000 716187.000 - -0.00% -
502.gcc_r -1.22% 4233263.000 4181689.000 - -0.00% -
538.imagick_r -1.21% 671242.000 663118.000 - -0.01% -
511.povray_r -1.17% 498628.000 492801.000 - 0.01% -
520.omnetpp_r -1.17% 748951.000 740209.000 - -0.00% -
507.cactuBSSN_r -1.12% 1813477.000 1793160.000 - -0.00% -
531.deepsjeng_r -1.08% 50769.000 50221.000 - 0.00% -
500.perlbench_r -1.03% 1095104.000 1083784.000 - 0.03% -
557.xz_r -1.02% 76161.000 75385.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -5.26% 11114.000 10529.000 - -0.05% -
541.leela_r -2.91% 12801.000 12429.000 - -0.34% -
521.wrf_r -2.49% 21850.000 21305.000 - -0.21% -
520.omnetpp_r -1.50% 13137.000 12940.000 - 0.01% -
502.gcc_r -1.27% 10804.000 10667.000 - -0.74% -
525.x264_r -1.19% 14731.000 14556.000 - -0.11% -
538.imagick_r -1.13% 15489.000 15314.000 - -0.10% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 13944.000 1.36%
502.gcc_r 10667.000 -
503.bwaves_r 24575.000 -
505.mcf_r 13508.000 -
507.cactuBSSN_r 21368.000 -
508.namd_r 10612.000 -
510.parest_r 22953.000 -
511.povray_r 21800.000 -
519.lbm_r 17571.000 -
520.omnetpp_r 12940.000 -
521.wrf_r 21305.000 -
523.xalancbmk_r 11954.000 -
525.x264_r 14556.000 -
526.blender_r 12485.000 -
527.cam4_r 11531.000 -
531.deepsjeng_r 10529.000 -
538.imagick_r 15314.000 -
541.leela_r 12429.000 -
544.nab_r 11703.000 -
549.fotonik3d_r 20255.000 -
554.roms_r 20781.000 -
557.xz_r 12674.000 -
Geometric Mean 15087.714 -
Name Current %
500.perlbench_r 1083784.000 -
502.gcc_r 4181689.000 -
503.bwaves_r 18950.000 -
505.mcf_r 14153.000 -
507.cactuBSSN_r 1793160.000 -
508.namd_r 356216.000 -
510.parest_r 716187.000 -
511.povray_r 492801.000 -
519.lbm_r 10113.000 -
520.omnetpp_r 740209.000 -
521.wrf_r 7710005.000 -
523.xalancbmk_r 1574822.000 -
525.x264_r 260974.000 -
526.blender_r 4356909.000 -
527.cam4_r 1811858.000 -
531.deepsjeng_r 50221.000 -
538.imagick_r 663118.000 -
541.leela_r 44233.000 -
544.nab_r 48845.000 -
549.fotonik3d_r 179760.000 -
554.roms_r 340528.000 -
557.xz_r 75385.000 -
Geometric Mean 323979.191 -
Name Current %
500.perlbench_r 103.000 1.98%
500.perlbench_r (avg) 103.000 1.98%
500.perlbench_r (avg) (percentage) 0.740 -
500.perlbench_r (max) 78.000 -3.70%
500.perlbench_r (max) (percentage) 0.560 -5.08%
502.gcc_r 33.000 -
502.gcc_r (avg) 33.000 -
502.gcc_r (avg) (percentage) 0.310 -
502.gcc_r (max) 55.000 -5.17%
502.gcc_r (max) (percentage) 0.520 -3.70%
503.bwaves_r 49.000 -
503.bwaves_r (avg) 49.000 -
503.bwaves_r (avg) (percentage) 0.200 -
503.bwaves_r (max) 44.000 -4.35%
503.bwaves_r (max) (percentage) 0.180 -5.26%
505.mcf_r 45.000 -2.17%
505.mcf_r (avg) 45.000 -2.17%
505.mcf_r (avg) (percentage) 0.340 -
505.mcf_r (max) 68.000 -6.85%
505.mcf_r (max) (percentage) 0.510 -5.56%
507.cactuBSSN_r 83.000 -
507.cactuBSSN_r (avg) 83.000 -
507.cactuBSSN_r (avg) (percentage) 0.390 -
507.cactuBSSN_r (max) 173.000 -1.70%
507.cactuBSSN_r (max) (percentage) 0.810 -2.41%
508.namd_r 28.000 -3.45%
508.namd_r (avg) 28.000 -3.45%
508.namd_r (avg) (percentage) 0.270 -3.57%
508.namd_r (max) 23.000 -11.54%
508.namd_r (max) (percentage) 0.220 -12.00%
508.namd_r (unexplained diff vs previous) 10.000 -61.54%
508.namd_r (unexplained diff vs previous) (percentage) 0.090 -64.00%
510.parest_r 36.000 -
510.parest_r (avg) 36.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 135.000 -25.41%
510.parest_r (max) (percentage) 0.590 -25.32%
510.parest_r (unexplained diff vs previous) 27.000 -85.16%
510.parest_r (unexplained diff vs previous) (percentage) 0.120 -84.81%
511.povray_r 117.000 -
511.povray_r (avg) 117.000 -
511.povray_r (avg) (percentage) 0.540 -
511.povray_r (max) 152.000 -6.75%
511.povray_r (max) (percentage) 0.700 -6.67%
519.lbm_r 21.000 10.53%
519.lbm_r (avg) 21.000 10.53%
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 47.000 -4.08%
519.lbm_r (max) (percentage) 0.270 -3.57%
519.lbm_r (unexplained diff vs previous) 48.000 -2.04%
519.lbm_r (unexplained diff vs previous) (percentage) 0.270 -3.57%
520.omnetpp_r 137.000 -2.84%
520.omnetpp_r (avg) 137.000 -2.84%
520.omnetpp_r (avg) (percentage) 1.060 -2.75%
520.omnetpp_r (max) 108.000 -52.84%
520.omnetpp_r (max) (percentage) 0.840 -52.54%
520.omnetpp_r (unexplained diff vs previous) 1.000 -99.32%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.010 -99.12%
521.wrf_r 106.000 -1.85%
521.wrf_r (avg) 106.000 -1.85%
521.wrf_r (avg) (percentage) 0.500 -1.96%
521.wrf_r (max) 106.000 -9.40%
521.wrf_r (max) (percentage) 0.500 -9.09%
521.wrf_r (unexplained diff vs previous) 44.000 -62.39%
521.wrf_r (unexplained diff vs previous) (percentage) 0.210 -61.82%
523.xalancbmk_r 60.000 -
523.xalancbmk_r (avg) 60.000 -
523.xalancbmk_r (avg) (percentage) 0.510 -
523.xalancbmk_r (max) 351.000 -3.31%
523.xalancbmk_r (max) (percentage) 2.940 -3.92%
525.x264_r 20.000 -
525.x264_r (avg) 20.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 16.000 -5.88%
525.x264_r (max) (percentage) 0.110 -
525.x264_r (unexplained diff vs previous) 16.000 100.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.110 120.00%
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.310 -
526.blender_r (max) 51.000 -3.77%
526.blender_r (max) (percentage) 0.410 -4.65%
527.cam4_r 59.000 -1.67%
527.cam4_r (avg) 59.000 -1.67%
527.cam4_r (avg) (percentage) 0.520 -1.89%
527.cam4_r (max) 183.000 -6.15%
527.cam4_r (max) (percentage) 1.590 -6.47%
527.cam4_r (unexplained diff vs previous) 23.000 -39.47%
527.cam4_r (unexplained diff vs previous) (percentage) 0.200 -39.39%
531.deepsjeng_r 82.000 -2.38%
531.deepsjeng_r (avg) 82.000 -2.38%
531.deepsjeng_r (avg) (percentage) 0.780 -2.50%
531.deepsjeng_r (max) 82.000 -2.38%
531.deepsjeng_r (max) (percentage) 0.780 -2.50%
531.deepsjeng_r (unexplained diff vs previous) 5.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.050 -
538.imagick_r 65.000 -
538.imagick_r (avg) 65.000 -
538.imagick_r (avg) (percentage) 0.430 -
538.imagick_r (max) 119.000 -4.03%
538.imagick_r (max) (percentage) 0.780 -3.70%
541.leela_r 27.000 -
541.leela_r (avg) 27.000 -
541.leela_r (avg) (percentage) 0.220 -
541.leela_r (max) 55.000 -5.17%
541.leela_r (max) (percentage) 0.450 -4.26%
544.nab_r 52.000 -
544.nab_r (avg) 52.000 -
544.nab_r (avg) (percentage) 0.450 -
544.nab_r (max) 40.000 -9.09%
544.nab_r (max) (percentage) 0.350 -7.89%
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 54.000 -
549.fotonik3d_r (avg) 54.000 -
549.fotonik3d_r (avg) (percentage) 0.270 -
549.fotonik3d_r (max) 85.000 -22.02%
549.fotonik3d_r (max) (percentage) 0.420 -22.22%
549.fotonik3d_r (unexplained diff vs previous) 69.000 -28.12%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.340 -27.66%
554.roms_r 51.000 -
554.roms_r (avg) 51.000 -
554.roms_r (avg) (percentage) 0.250 -
554.roms_r (max) 342.000 -6.04%
554.roms_r (max) (percentage) 1.650 -6.25%
557.xz_r 22.000 -
557.xz_r (avg) 22.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 34.000 -5.56%
557.xz_r (max) (percentage) 0.270 -6.90%
Geometric Mean 5.797 -23.03%