Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ef8bee09ef09230e4247ea962698bf5a0b4892cc (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (9a2083f025fae3559474b961943484d764c2e6dd) (+ 203 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=ad966bc4efd9e69cbbda2073121cc68f1deb9588 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3_LTO-build/395/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0395 (basepoints/gcc-16-00653-g9a2083f025f) 2025-05-12T04:44:56 0:00:00
Previous 0394 (basepoints/gcc-16-00450-gedf745dc519) 2025-05-08T18:57:42 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T16:28:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 21
Performance Improvements 46 21
Added Tests 8 107
Unchanged Tests 871 787
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.26% 20577.000 20836.000 - -5.80% -
521.wrf_r 1.04% 16283.000 16452.000 - 1.26% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) (percentage) 30.00% 0.200 0.260 - 0.00% -
531.deepsjeng_r (max) 29.17% 24.000 31.000 - 0.00% -
507.cactuBSSN_r (max) 8.26% 242.000 262.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) 6.78% 1.180 1.260 - 0.00% -
507.cactuBSSN_r 2.52% 119.000 122.000 - 0.00% -
507.cactuBSSN_r (avg) 2.52% 119.000 122.000 - 0.00% -
538.imagick_r 2.13% 47.000 48.000 - 0.00% -
538.imagick_r (avg) 2.13% 47.000 48.000 - 0.00% -
507.cactuBSSN_r (avg) (percentage) 1.72% 0.580 0.590 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -2.43% 9843.000 9604.000 - 5.02% -
511.povray_r -1.93% 17965.000 17619.000 - -1.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) -54.76% 42.000 19.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -54.17% 0.240 0.110 - 0.00% -
519.lbm_r (max) -41.67% 60.000 35.000 - 0.00% -
519.lbm_r (max) (percentage) -41.18% 0.340 0.200 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -25.00% 0.800 0.600 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -24.69% 81.000 61.000 - 0.00% -
520.omnetpp_r (max) -11.83% 93.000 82.000 - 0.00% -
520.omnetpp_r (max) (percentage) -10.87% 0.920 0.820 - 0.00% -
503.bwaves_r (max) -8.57% 35.000 32.000 - 0.00% -
526.blender_r (max) (percentage) -8.00% 0.500 0.460 - 0.00% -
526.blender_r (max) -7.55% 53.000 49.000 - 0.00% -
505.mcf_r (max) -6.52% 138.000 129.000 - 0.00% -
503.bwaves_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
505.mcf_r (max) (percentage) -6.14% 1.140 1.070 - 0.00% -
544.nab_r (max) -5.56% 36.000 34.000 - 0.00% -
523.xalancbmk_r (max) -5.26% 209.000 198.000 - 0.00% -
549.fotonik3d_r (max) -5.00% 40.000 38.000 - 0.00% -
511.povray_r (max) -4.12% 194.000 186.000 - 0.00% -
541.leela_r (max) -3.57% 28.000 27.000 - 0.00% -
510.parest_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
508.namd_r (max) (percentage) -3.23% 0.620 0.600 - 0.00% -
510.parest_r (max) -3.23% 62.000 60.000 - 0.00% -
508.namd_r (max) -3.17% 63.000 61.000 - 0.00% -
544.nab_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
541.leela_r -2.94% 34.000 33.000 - 0.00% -
541.leela_r (avg) -2.94% 34.000 33.000 - 0.00% -
500.perlbench_r (max) -2.86% 140.000 136.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.82% 2.130 2.070 - 0.00% -
554.roms_r (max) (percentage) -2.74% 3.650 3.550 - 0.00% -
538.imagick_r (max) (percentage) -2.67% 0.750 0.730 - 0.00% -
500.perlbench_r (max) (percentage) -2.63% 1.140 1.110 - 0.00% -
554.roms_r (max) -2.52% 635.000 619.000 - 0.00% -
525.x264_r (max) (percentage) -2.50% 0.400 0.390 - 0.00% -
531.deepsjeng_r (avg) (percentage) -2.33% 0.860 0.840 - 0.00% -
525.x264_r (max) -2.27% 44.000 43.000 - 0.00% -
531.deepsjeng_r -1.94% 103.000 101.000 - 0.00% -
531.deepsjeng_r (avg) -1.94% 103.000 101.000 - 0.00% -
538.imagick_r (max) -1.90% 105.000 103.000 - 0.00% -
511.povray_r (max) (percentage) -1.85% 1.080 1.060 - 0.00% -
511.povray_r -1.41% 71.000 70.000 - 0.00% -
511.povray_r (avg) -1.41% 71.000 70.000 - 0.00% -
523.xalancbmk_r -1.41% 71.000 70.000 - 0.00% -
523.xalancbmk_r (avg) -1.41% 71.000 70.000 - 0.00% -
521.wrf_r (max) (percentage) -1.38% 1.450 1.430 - 0.00% -

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
507.cactuBSSN_r (unexplained diff vs previous)
507.cactuBSSN_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.82% 9961079.000 10540809.000 - 0.07% -
557.xz_r 5.35% 145387.000 153167.000 - 0.00% -
503.bwaves_r 4.28% 28114.000 29317.000 - 0.00% -
502.gcc_r 3.64% 9512398.000 9858928.000 - 0.00% -
500.perlbench_r 3.56% 2484215.000 2572746.000 - 0.01% -
519.lbm_r 3.25% 11415.000 11786.000 - 0.00% -
520.omnetpp_r 2.44% 1620416.000 1660007.000 - 0.01% -
541.leela_r 2.13% 100201.000 102334.000 - 0.00% -
511.povray_r 1.78% 1086933.000 1106252.000 - 0.10% -
531.deepsjeng_r 1.16% 112861.000 114167.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 29.35% 13661.000 17671.000 - 0.11% -
523.xalancbmk_r 5.02% 9145.000 9604.000 - -2.43% -
508.namd_r 4.97% 9834.000 10323.000 - 0.70% -
525.x264_r 2.62% 10876.000 11161.000 - 0.18% -
554.roms_r 2.44% 17036.000 17452.000 - 0.18% -
549.fotonik3d_r 2.39% 18607.000 19052.000 - -0.24% -
521.wrf_r 1.26% 16247.000 16452.000 - 1.04% -
503.bwaves_r 1.22% 21603.000 21867.000 - -0.35% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -24.81% 21211054.000 15949341.000 - 0.03% -
554.roms_r -16.47% 873970.000 730000.000 - 0.03% -
549.fotonik3d_r -14.08% 403090.000 346324.000 - -0.00% -
527.cam4_r -7.99% 3573957.000 3288240.000 - 0.02% -
508.namd_r -5.56% 853851.000 806350.000 - 0.11% -
507.cactuBSSN_r -4.74% 4586703.000 4369358.000 - 0.01% -
544.nab_r -4.31% 97555.000 93355.000 - 0.02% -
505.mcf_r -2.80% 28397.000 27601.000 - 0.00% -
525.x264_r -1.82% 607922.000 596868.000 - 0.01% -
538.imagick_r -1.38% 1560853.000 1539323.000 - 0.30% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -13.32% 12966.000 11239.000 - -0.11% -
520.omnetpp_r -8.69% 11076.000 10114.000 - -0.60% -
541.leela_r -6.19% 10449.000 9802.000 - 0.06% -
507.cactuBSSN_r -5.80% 22118.000 20836.000 - 1.26% -
557.xz_r -4.30% 10492.000 10041.000 - 0.09% -
505.mcf_r -3.17% 12541.000 12143.000 - -0.10% -
526.blender_r -2.57% 10990.000 10708.000 - -0.20% -
510.parest_r -2.42% 21273.000 20758.000 - -0.25% -
500.perlbench_r -2.17% 12607.000 12333.000 - 0.33% -
502.gcc_r -1.94% 8756.000 8586.000 - -0.22% -
511.povray_r -1.75% 17933.000 17619.000 - -1.93% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 12333.000 -
502.gcc_r 8586.000 -
503.bwaves_r 21867.000 -
505.mcf_r 12143.000 -
507.cactuBSSN_r 20836.000 1.26%
508.namd_r 10323.000 -
510.parest_r 20758.000 -
511.povray_r 17619.000 -1.93%
519.lbm_r 17671.000 -
520.omnetpp_r 10114.000 -
521.wrf_r 16452.000 1.04%
523.xalancbmk_r 9604.000 -2.43%
525.x264_r 11161.000 -
526.blender_r 10708.000 -
527.cam4_r 9753.000 -
531.deepsjeng_r 12047.000 -
538.imagick_r 14224.000 -
541.leela_r 9802.000 -
544.nab_r 11239.000 -
549.fotonik3d_r 19052.000 -
554.roms_r 17452.000 -
557.xz_r 10041.000 -
Geometric Mean 13212.503 -
Name Current %
500.perlbench_r 2572746.000 -
502.gcc_r 9858928.000 -
503.bwaves_r 29317.000 -
505.mcf_r 27601.000 -
507.cactuBSSN_r 4369358.000 -
508.namd_r 806350.000 -
510.parest_r 1685482.000 -
511.povray_r 1106252.000 -
519.lbm_r 11786.000 -
520.omnetpp_r 1660007.000 -
521.wrf_r 15949341.000 -
523.xalancbmk_r 3417472.000 -
525.x264_r 596868.000 -
526.blender_r 10540809.000 -
527.cam4_r 3288240.000 -
531.deepsjeng_r 114167.000 -
538.imagick_r 1539323.000 -
541.leela_r 102334.000 -
544.nab_r 93355.000 -
549.fotonik3d_r 346324.000 -
554.roms_r 730000.000 -
557.xz_r 153167.000 -
Geometric Mean 677955.682 -
Name Current %
500.perlbench_r 67.000 -
500.perlbench_r (avg) 67.000 -
500.perlbench_r (avg) (percentage) 0.550 -
500.perlbench_r (max) 136.000 -2.86%
500.perlbench_r (max) (percentage) 1.110 -2.63%
502.gcc_r 26.000 -
502.gcc_r (avg) 26.000 -
502.gcc_r (avg) (percentage) 0.310 -
502.gcc_r (max) 40.000 -
502.gcc_r (max) (percentage) 0.470 -
503.bwaves_r 43.000 -
503.bwaves_r (avg) 43.000 -
503.bwaves_r (avg) (percentage) 0.200 -
503.bwaves_r (max) 32.000 -8.57%
503.bwaves_r (max) (percentage) 0.150 -6.25%
505.mcf_r 49.000 -
505.mcf_r (avg) 49.000 -
505.mcf_r (avg) (percentage) 0.410 -
505.mcf_r (max) 129.000 -6.52%
505.mcf_r (max) (percentage) 1.070 -6.14%
505.mcf_r (unexplained diff vs previous) 12.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.100 -
507.cactuBSSN_r 122.000 2.52%
507.cactuBSSN_r (avg) 122.000 2.52%
507.cactuBSSN_r (avg) (percentage) 0.590 1.72%
507.cactuBSSN_r (max) 262.000 8.26%
507.cactuBSSN_r (max) (percentage) 1.260 6.78%
507.cactuBSSN_r (unexplained diff vs previous) 259.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 1.240 -
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.180 -
508.namd_r (max) 61.000 -3.17%
508.namd_r (max) (percentage) 0.600 -3.23%
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 60.000 -3.23%
510.parest_r (max) (percentage) 0.290 -3.33%
511.povray_r 70.000 -1.41%
511.povray_r (avg) 70.000 -1.41%
511.povray_r (avg) (percentage) 0.400 -
511.povray_r (max) 186.000 -4.12%
511.povray_r (max) (percentage) 1.060 -1.85%
519.lbm_r 31.000 -
519.lbm_r (avg) 31.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 35.000 -41.67%
519.lbm_r (max) (percentage) 0.200 -41.18%
519.lbm_r (unexplained diff vs previous) 19.000 -54.76%
519.lbm_r (unexplained diff vs previous) (percentage) 0.110 -54.17%
520.omnetpp_r 94.000 -
520.omnetpp_r (avg) 94.000 -
520.omnetpp_r (avg) (percentage) 0.930 -
520.omnetpp_r (max) 82.000 -11.83%
520.omnetpp_r (max) (percentage) 0.820 -10.87%
520.omnetpp_r (unexplained diff vs previous) 61.000 -24.69%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.600 -25.00%
521.wrf_r 113.000 -
521.wrf_r (avg) 113.000 -
521.wrf_r (avg) (percentage) 0.690 -
521.wrf_r (max) 235.000 -
521.wrf_r (max) (percentage) 1.430 -1.38%
523.xalancbmk_r 70.000 -1.41%
523.xalancbmk_r (avg) 70.000 -1.41%
523.xalancbmk_r (avg) (percentage) 0.730 -
523.xalancbmk_r (max) 198.000 -5.26%
523.xalancbmk_r (max) (percentage) 2.070 -2.82%
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 43.000 -2.27%
525.x264_r (max) (percentage) 0.390 -2.50%
526.blender_r 49.000 -
526.blender_r (avg) 49.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 49.000 -7.55%
526.blender_r (max) (percentage) 0.460 -8.00%
531.deepsjeng_r 101.000 -1.94%
531.deepsjeng_r (avg) 101.000 -1.94%
531.deepsjeng_r (avg) (percentage) 0.840 -2.33%
531.deepsjeng_r (max) 31.000 29.17%
531.deepsjeng_r (max) (percentage) 0.260 30.00%
531.deepsjeng_r (unexplained diff vs previous) 32.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.270 -
538.imagick_r 48.000 2.13%
538.imagick_r (avg) 48.000 2.13%
538.imagick_r (avg) (percentage) 0.340 -
538.imagick_r (max) 103.000 -1.90%
538.imagick_r (max) (percentage) 0.730 -2.67%
541.leela_r 33.000 -2.94%
541.leela_r (avg) 33.000 -2.94%
541.leela_r (avg) (percentage) 0.340 -
541.leela_r (max) 27.000 -3.57%
541.leela_r (max) (percentage) 0.280 -
541.leela_r (unexplained diff vs previous) 6.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.060 -
544.nab_r 37.000 -
544.nab_r (avg) 37.000 -
544.nab_r (avg) (percentage) 0.330 -
544.nab_r (max) 34.000 -5.56%
544.nab_r (max) (percentage) 0.310 -3.13%
548.exchange2_r (avg) (percentage) 0.340 -
548.exchange2_r (max) (percentage) 0.550 -
549.fotonik3d_r 24.000 -
549.fotonik3d_r (avg) 24.000 -
549.fotonik3d_r (avg) (percentage) 0.130 -
549.fotonik3d_r (max) 38.000 -5.00%
549.fotonik3d_r (max) (percentage) 0.200 -
554.roms_r 50.000 -
554.roms_r (avg) 50.000 -
554.roms_r (avg) (percentage) 0.290 -
554.roms_r (max) 619.000 -2.52%
554.roms_r (max) (percentage) 3.550 -2.74%
557.xz_r 17.000 -
557.xz_r (avg) 17.000 -
557.xz_r (avg) (percentage) 0.170 -
557.xz_r (max) 16.000 -
557.xz_r (max) (percentage) 0.160 -
Geometric Mean 6.557 -10.27%