Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ef8bee09ef09230e4247ea962698bf5a0b4892cc (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (edf745dc519ddbfef127e2789bf11bfbacd300b7) (+ 130 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ad966bc4efd9e69cbbda2073121cc68f1deb9588 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3_LTO-build/394/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0394 (basepoints/gcc-16-00450-gedf745dc519) 2025-05-08T18:57:42 0:00:00
Previous 0392 (3-changed-components) 2025-05-03T23:19:59 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T16:28:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 20
Performance Improvements 40 20
Added Tests 0 107
Unchanged Tests 886 789
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r 3.37% 9522.000 9843.000 - 7.63% -
549.fotonik3d_r 3.32% 18484.000 19098.000 - 2.64% -
525.x264_r 1.40% 10987.000 11141.000 - 2.44% -
511.povray_r 1.14% 17762.000 17965.000 - 0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) 33.33% 0.180 0.240 - 0.00% -
519.lbm_r (unexplained diff vs previous) 31.25% 32.000 42.000 - 0.00% -
523.xalancbmk_r 2.90% 69.000 71.000 - 0.00% -
523.xalancbmk_r (avg) 2.90% 69.000 71.000 - 0.00% -
544.nab_r 2.78% 36.000 37.000 - 0.00% -
544.nab_r (avg) 2.78% 36.000 37.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -1.11% 12292.000 12155.000 - -3.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (max) -35.42% 144.000 93.000 - 0.00% -
520.omnetpp_r (max) (percentage) -34.75% 1.410 0.920 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -27.68% 112.000 81.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -26.61% 1.090 0.800 - 0.00% -
526.blender_r (max) -10.17% 59.000 53.000 - 0.00% -
526.blender_r (max) (percentage) -9.09% 0.550 0.500 - 0.00% -
549.fotonik3d_r (max) (percentage) -8.70% 0.230 0.210 - 0.00% -
519.lbm_r (max) (percentage) -8.11% 0.370 0.340 - 0.00% -
519.lbm_r (max) -7.69% 65.000 60.000 - 0.00% -
544.nab_r (max) (percentage) -5.88% 0.340 0.320 - 0.00% -
505.mcf_r (max) -5.48% 146.000 138.000 - 0.00% -
544.nab_r (max) -5.26% 38.000 36.000 - 0.00% -
549.fotonik3d_r (max) -4.76% 42.000 40.000 - 0.00% -
508.namd_r (max) (percentage) -4.62% 0.650 0.620 - 0.00% -
508.namd_r (max) -4.55% 66.000 63.000 - 0.00% -
505.mcf_r (max) (percentage) -4.20% 1.190 1.140 - 0.00% -
500.perlbench_r (max) -3.45% 145.000 140.000 - 0.00% -
541.leela_r (max) -3.45% 29.000 28.000 - 0.00% -
500.perlbench_r (max) (percentage) -3.39% 1.180 1.140 - 0.00% -
541.leela_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.28% 1.220 1.180 - 0.00% -
510.parest_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
507.cactuBSSN_r (max) -3.20% 250.000 242.000 - 0.00% -
510.parest_r (max) -3.12% 64.000 62.000 - 0.00% -
538.imagick_r (max) -2.78% 108.000 105.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.74% 2.190 2.130 - 0.00% -
554.roms_r (max) (percentage) -2.67% 3.750 3.650 - 0.00% -
538.imagick_r (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
554.roms_r (max) -2.31% 650.000 635.000 - 0.00% -
525.x264_r (max) -2.22% 45.000 44.000 - 0.00% -
538.imagick_r -2.08% 48.000 47.000 - 0.00% -
538.imagick_r (avg) -2.08% 48.000 47.000 - 0.00% -
521.wrf_r (max) (percentage) -2.03% 1.480 1.450 - 0.00% -
505.mcf_r -2.00% 50.000 49.000 - 0.00% -
505.mcf_r (avg) -2.00% 50.000 49.000 - 0.00% -
511.povray_r (max) (percentage) -1.82% 1.100 1.080 - 0.00% -
521.wrf_r (max) -1.67% 240.000 236.000 - 0.00% -
520.omnetpp_r -1.05% 95.000 94.000 - 0.00% -
520.omnetpp_r (avg) -1.05% 95.000 94.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.75% 9961079.000 10533725.000 - -0.01% -
557.xz_r 5.35% 145387.000 153167.000 - -0.01% -
503.bwaves_r 4.28% 28114.000 29317.000 - -0.03% -
502.gcc_r 3.64% 9512398.000 9858664.000 - 0.03% -
500.perlbench_r 3.56% 2484215.000 2572562.000 - 0.26% -
519.lbm_r 3.25% 11415.000 11786.000 - 0.00% -
520.omnetpp_r 2.44% 1620416.000 1659895.000 - 0.06% -
541.leela_r 2.13% 100201.000 102334.000 - -0.36% -
511.povray_r 1.67% 1086933.000 1105136.000 - 0.01% -
531.deepsjeng_r 1.16% 112861.000 114167.000 - -0.03% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 29.21% 13661.000 17652.000 - 0.24% -
523.xalancbmk_r 7.63% 9145.000 9843.000 - 3.37% -
508.namd_r 4.24% 9834.000 10251.000 - -0.04% -
549.fotonik3d_r 2.64% 18607.000 19098.000 - 3.32% -
525.x264_r 2.44% 10876.000 11141.000 - 1.40% -
554.roms_r 2.25% 17036.000 17420.000 - 0.46% -
503.bwaves_r 1.58% 21603.000 21944.000 - 0.03% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -24.83% 21211054.000 15944701.000 - 0.16% -
554.roms_r -16.50% 873970.000 729784.000 - 0.03% -
549.fotonik3d_r -14.08% 403090.000 346340.000 - -0.33% -
527.cam4_r -8.02% 3573957.000 3287472.000 - 0.32% -
508.namd_r -5.66% 853851.000 805485.000 - -0.12% -
507.cactuBSSN_r -4.75% 4586703.000 4368778.000 - 0.65% -
544.nab_r -4.32% 97555.000 93339.000 - 0.11% -
505.mcf_r -2.80% 28397.000 27601.000 - 0.00% -
525.x264_r -1.83% 607922.000 596780.000 - 0.21% -
538.imagick_r -1.68% 1560853.000 1534643.000 - 0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -13.23% 12966.000 11251.000 - 0.48% -
520.omnetpp_r -8.13% 11076.000 10175.000 - -0.79% -
507.cactuBSSN_r -6.97% 22118.000 20577.000 - 0.22% -
541.leela_r -6.25% 10449.000 9796.000 - 0.70% -
557.xz_r -4.38% 10492.000 10032.000 - -0.12% -
505.mcf_r -3.08% 12541.000 12155.000 - -1.11% -
500.perlbench_r -2.49% 12607.000 12293.000 - -0.19% -
526.blender_r -2.37% 10990.000 10729.000 - -0.13% -
510.parest_r -2.18% 21273.000 20809.000 - 0.24% -
502.gcc_r -1.72% 8756.000 8605.000 - -0.13% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 12293.000 -
502.gcc_r 8605.000 -
503.bwaves_r 21944.000 -
505.mcf_r 12155.000 -1.11%
507.cactuBSSN_r 20577.000 -
508.namd_r 10251.000 -
510.parest_r 20809.000 -
511.povray_r 17965.000 1.14%
519.lbm_r 17652.000 -
520.omnetpp_r 10175.000 -
521.wrf_r 16283.000 -
523.xalancbmk_r 9843.000 3.37%
525.x264_r 11141.000 1.40%
526.blender_r 10729.000 -
527.cam4_r 9767.000 -
531.deepsjeng_r 12079.000 -
538.imagick_r 14085.000 -
541.leela_r 9796.000 -
544.nab_r 11251.000 -
549.fotonik3d_r 19098.000 3.32%
554.roms_r 17420.000 -
557.xz_r 10032.000 -
Geometric Mean 13224.291 -
Name Current %
500.perlbench_r 2572562.000 -
502.gcc_r 9858664.000 -
503.bwaves_r 29317.000 -
505.mcf_r 27601.000 -
507.cactuBSSN_r 4368778.000 -
508.namd_r 805485.000 -
510.parest_r 1685442.000 -
511.povray_r 1105136.000 -
519.lbm_r 11786.000 -
520.omnetpp_r 1659895.000 -
521.wrf_r 15944701.000 -
523.xalancbmk_r 3418288.000 -
525.x264_r 596780.000 -
526.blender_r 10533725.000 -
527.cam4_r 3287472.000 -
531.deepsjeng_r 114167.000 -
538.imagick_r 1534643.000 -
541.leela_r 102334.000 -
544.nab_r 93339.000 -
549.fotonik3d_r 346340.000 -
554.roms_r 729784.000 -
557.xz_r 153167.000 -
Geometric Mean 677740.728 -
Name Current %
500.perlbench_r 67.000 -
500.perlbench_r (avg) 67.000 -
500.perlbench_r (avg) (percentage) 0.550 -
500.perlbench_r (max) 140.000 -3.45%
500.perlbench_r (max) (percentage) 1.140 -3.39%
502.gcc_r 26.000 -
502.gcc_r (avg) 26.000 -
502.gcc_r (avg) (percentage) 0.310 -
502.gcc_r (max) 40.000 -
502.gcc_r (max) (percentage) 0.470 -
503.bwaves_r 43.000 -
503.bwaves_r (avg) 43.000 -
503.bwaves_r (avg) (percentage) 0.200 -
503.bwaves_r (max) 35.000 -
503.bwaves_r (max) (percentage) 0.160 -
505.mcf_r 49.000 -2.00%
505.mcf_r (avg) 49.000 -2.00%
505.mcf_r (avg) (percentage) 0.410 -
505.mcf_r (max) 138.000 -5.48%
505.mcf_r (max) (percentage) 1.140 -4.20%
507.cactuBSSN_r 119.000 -
507.cactuBSSN_r (avg) 119.000 -
507.cactuBSSN_r (avg) (percentage) 0.580 -
507.cactuBSSN_r (max) 242.000 -3.20%
507.cactuBSSN_r (max) (percentage) 1.180 -3.28%
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.180 -
508.namd_r (max) 63.000 -4.55%
508.namd_r (max) (percentage) 0.620 -4.62%
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 62.000 -3.12%
510.parest_r (max) (percentage) 0.300 -3.23%
511.povray_r 71.000 -
511.povray_r (avg) 71.000 -
511.povray_r (avg) (percentage) 0.400 -
511.povray_r (max) 194.000 -
511.povray_r (max) (percentage) 1.080 -1.82%
519.lbm_r 31.000 -
519.lbm_r (avg) 31.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 60.000 -7.69%
519.lbm_r (max) (percentage) 0.340 -8.11%
519.lbm_r (unexplained diff vs previous) 42.000 31.25%
519.lbm_r (unexplained diff vs previous) (percentage) 0.240 33.33%
520.omnetpp_r 94.000 -1.05%
520.omnetpp_r (avg) 94.000 -1.05%
520.omnetpp_r (avg) (percentage) 0.930 -
520.omnetpp_r (max) 93.000 -35.42%
520.omnetpp_r (max) (percentage) 0.920 -34.75%
520.omnetpp_r (unexplained diff vs previous) 81.000 -27.68%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.800 -26.61%
521.wrf_r 112.000 -
521.wrf_r (avg) 112.000 -
521.wrf_r (avg) (percentage) 0.690 -
521.wrf_r (max) 236.000 -1.67%
521.wrf_r (max) (percentage) 1.450 -2.03%
523.xalancbmk_r 71.000 2.90%
523.xalancbmk_r (avg) 71.000 2.90%
523.xalancbmk_r (avg) (percentage) 0.730 -
523.xalancbmk_r (max) 209.000 -
523.xalancbmk_r (max) (percentage) 2.130 -2.74%
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 44.000 -2.22%
525.x264_r (max) (percentage) 0.400 -
526.blender_r 49.000 -
526.blender_r (avg) 49.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 53.000 -10.17%
526.blender_r (max) (percentage) 0.500 -9.09%
531.deepsjeng_r 103.000 -
531.deepsjeng_r (avg) 103.000 -
531.deepsjeng_r (avg) (percentage) 0.860 -
531.deepsjeng_r (max) 24.000 -
531.deepsjeng_r (max) (percentage) 0.200 -
538.imagick_r 47.000 -2.08%
538.imagick_r (avg) 47.000 -2.08%
538.imagick_r (avg) (percentage) 0.340 -
538.imagick_r (max) 105.000 -2.78%
538.imagick_r (max) (percentage) 0.750 -2.60%
541.leela_r 34.000 -
541.leela_r (avg) 34.000 -
541.leela_r (avg) (percentage) 0.350 -
541.leela_r (max) 28.000 -3.45%
541.leela_r (max) (percentage) 0.290 -3.33%
544.nab_r 37.000 2.78%
544.nab_r (avg) 37.000 2.78%
544.nab_r (avg) (percentage) 0.330 -
544.nab_r (max) 36.000 -5.26%
544.nab_r (max) (percentage) 0.320 -5.88%
548.exchange2_r (avg) (percentage) 0.340 -
548.exchange2_r (max) (percentage) 0.550 -
549.fotonik3d_r 24.000 -
549.fotonik3d_r (avg) 24.000 -
549.fotonik3d_r (avg) (percentage) 0.130 -
549.fotonik3d_r (max) 40.000 -4.76%
549.fotonik3d_r (max) (percentage) 0.210 -8.70%
554.roms_r 50.000 -
554.roms_r (avg) 50.000 -
554.roms_r (avg) (percentage) 0.290 -
554.roms_r (max) 635.000 -2.31%
554.roms_r (max) (percentage) 3.650 -2.67%
557.xz_r 17.000 -
557.xz_r (avg) 17.000 -
557.xz_r (avg) (percentage) 0.170 -
557.xz_r (max) 16.000 -
557.xz_r (max) (percentage) 0.160 -
Geometric Mean 7.308 -2.01%