Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e488d8ccd0fb25d9c2d33feceb9eac3e336c1b0 (+ 172 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (70a5de6920055adde1cba97d91534376a195adf4) (+ 333 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d8f7a79335b0d861c12c42aec94c04cd5bb181e2 (+ 44 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/f1f8a95d093efd12e3e7a66cb387389471fa25a6 (+ 385 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/154/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0154 (4-changed-components) 2025-05-13T00:05:31 0:00:00
Previous 0150 (basepoints/gcc-16-00432-gd4da4474dd3) 2025-05-05T04:40:56 0:00:00
Baseline 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 42 8
Performance Improvements 36 18
Added Tests 3 115
Unchanged Tests 885 825
Total Tests 966

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 2.36% 12860.000 13164.000 - 0.21% -
523.xalancbmk_r 2.05% 12024.000 12270.000 - 2.83% -
502.gcc_r 1.11% 10646.000 10764.000 - -0.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
510.parest_r (unexplained diff vs previous) (percentage) 4100.00% 0.020 0.840 - 0.00% -
510.parest_r (unexplained diff vs previous) 3800.00% 5.000 195.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 650.00% 0.020 0.150 - 0.00% -
525.x264_r (unexplained diff vs previous) 633.33% 3.000 22.000 - 0.00% -
510.parest_r (max) 625.93% 27.000 196.000 - 0.00% -
510.parest_r (max) (percentage) 608.33% 0.120 0.850 - 0.00% -
505.mcf_r (unexplained diff vs previous) 450.00% 20.000 110.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 440.00% 0.150 0.810 - 0.00% -
527.cam4_r (unexplained diff vs previous) (percentage) 327.87% 0.610 2.610 - 0.00% -
527.cam4_r (unexplained diff vs previous) 318.06% 72.000 301.000 - 0.00% -
527.cam4_r (max) (percentage) 318.03% 0.610 2.550 - 0.00% -
527.cam4_r (max) 306.94% 72.000 293.000 - 0.00% -
505.mcf_r (max) 240.62% 32.000 109.000 - 0.00% -
505.mcf_r (max) (percentage) 237.50% 0.240 0.810 - 0.00% -
525.x264_r (max) 162.50% 8.000 21.000 - 0.00% -
525.x264_r (max) (percentage) 150.00% 0.060 0.150 - 0.00% -
520.omnetpp_r (max) 32.48% 234.000 310.000 - 0.00% -
520.omnetpp_r (max) (percentage) 29.67% 1.820 2.360 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 27.73% 238.000 304.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 24.86% 1.850 2.310 - 0.00% -
519.lbm_r (max) 23.53% 17.000 21.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 23.53% 17.000 21.000 - 0.00% -
527.cam4_r (avg) (percentage) 20.00% 0.450 0.540 - 0.00% -
519.lbm_r (max) (percentage) 20.00% 0.100 0.120 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 20.00% 0.100 0.120 - 0.00% -
510.parest_r 18.52% 27.000 32.000 - 0.00% -
510.parest_r (avg) 18.52% 27.000 32.000 - 0.00% -
527.cam4_r 16.98% 53.000 62.000 - 0.00% -
527.cam4_r (avg) 16.98% 53.000 62.000 - 0.00% -
510.parest_r (avg) (percentage) 16.67% 0.120 0.140 - 0.00% -
520.omnetpp_r 5.11% 137.000 144.000 - 0.00% -
520.omnetpp_r (avg) 5.11% 137.000 144.000 - 0.00% -
541.leela_r 4.00% 25.000 26.000 - 0.00% -
541.leela_r (avg) 4.00% 25.000 26.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 2.80% 1.070 1.100 - 0.00% -
505.mcf_r 2.17% 46.000 47.000 - 0.00% -
505.mcf_r (avg) 2.17% 46.000 47.000 - 0.00% -
523.xalancbmk_r 2.08% 48.000 49.000 - 0.00% -
523.xalancbmk_r (avg) 2.08% 48.000 49.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
554.roms_r -2.56% 20939.000 20402.000 - 0.20% -
527.cam4_r -2.55% 11818.000 11517.000 - 0.00% -
521.wrf_r -1.28% 21561.000 21285.000 - -2.59% -
538.imagick_r -1.24% 15358.000 15168.000 - -2.07% -
500.perlbench_r -1.15% 13875.000 13715.000 - -0.95% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (max) -23.64% 55.000 42.000 - 0.00% -
544.nab_r (max) (percentage) -23.40% 0.470 0.360 - 0.00% -
531.deepsjeng_r (max) -7.87% 127.000 117.000 - 0.00% -
557.xz_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
531.deepsjeng_r (max) (percentage) -7.50% 1.200 1.110 - 0.00% -
538.imagick_r (max) -6.98% 172.000 160.000 - 0.00% -
554.roms_r (max) -6.60% 106.000 99.000 - 0.00% -
521.wrf_r (max) -6.38% 47.000 44.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -6.35% 0.630 0.590 - 0.00% -
549.fotonik3d_r (max) -6.30% 127.000 119.000 - 0.00% -
557.xz_r (max) -6.25% 16.000 15.000 - 0.00% -
538.imagick_r (max) (percentage) -5.36% 1.120 1.060 - 0.00% -
521.wrf_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
526.blender_r (max) (percentage) -4.55% 0.440 0.420 - 0.00% -
507.cactuBSSN_r (max) -4.10% 195.000 187.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.92% 1.530 1.470 - 0.00% -
554.roms_r (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
526.blender_r (max) -3.70% 54.000 52.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.30% 0.910 0.880 - 0.00% -
502.gcc_r (max) (percentage) -3.03% 0.660 0.640 - 0.00% -
502.gcc_r (max) -2.86% 70.000 68.000 - 0.00% -
500.perlbench_r (max) -2.72% 184.000 179.000 - 0.00% -
554.roms_r -2.44% 41.000 40.000 - 0.00% -
554.roms_r (avg) -2.44% 41.000 40.000 - 0.00% -
521.wrf_r -1.79% 112.000 110.000 - 0.00% -
521.wrf_r (avg) -1.79% 112.000 110.000 - 0.00% -
523.xalancbmk_r (max) -1.64% 183.000 180.000 - 0.00% -
538.imagick_r -1.56% 64.000 63.000 - 0.00% -
538.imagick_r (avg) -1.56% 64.000 63.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.50% 1.330 1.310 - 0.00% -
511.povray_r (max) -1.10% 91.000 90.000 - 0.00% -

Added Tests - sample variability
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
548.exchange2_r (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 5.20% 18014.000 18950.000 - 0.34% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 2.87% 21015.000 21619.000 - -0.95% -
523.xalancbmk_r 2.83% 11932.000 12270.000 - 2.05% -
505.mcf_r 2.43% 13186.000 13506.000 - -0.81% -
503.bwaves_r 2.40% 24051.000 24628.000 - -0.11% -
510.parest_r 2.37% 22639.000 23176.000 - 0.85% -
549.fotonik3d_r 1.91% 19864.000 20244.000 - -0.29% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -8.33% 24.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -2.50% 45366.000 44233.000 - 0.00% -
549.fotonik3d_r -2.24% 183875.000 179760.000 - -0.07% -
544.nab_r -1.52% 49589.000 48837.000 - -0.02% -
510.parest_r -1.32% 725746.000 716199.000 - -0.01% -
502.gcc_r -1.22% 4233263.000 4181743.000 - -0.01% -
538.imagick_r -1.20% 671242.000 663186.000 - 0.02% -
511.povray_r -1.18% 498628.000 492749.000 - -0.00% -
520.omnetpp_r -1.16% 748951.000 740237.000 - -0.00% -
507.cactuBSSN_r -1.12% 1813477.000 1793184.000 - -0.01% -
531.deepsjeng_r -1.08% 50769.000 50221.000 - 0.14% -
500.perlbench_r -1.06% 1095104.000 1083512.000 - -0.03% -
557.xz_r -1.02% 76161.000 75385.000 - -0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -4.41% 11114.000 10624.000 - 0.08% -
541.leela_r -2.80% 12801.000 12442.000 - 0.54% -
521.wrf_r -2.59% 21850.000 21285.000 - -1.28% -
538.imagick_r -2.07% 15489.000 15168.000 - -1.24% -
526.blender_r -1.24% 12586.000 12430.000 - -0.14% -
525.x264_r -1.13% 14731.000 14565.000 - 0.15% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 13715.000 -1.15%
502.gcc_r 10764.000 1.11%
503.bwaves_r 24628.000 -
505.mcf_r 13506.000 -
507.cactuBSSN_r 21350.000 -
508.namd_r 10551.000 -
510.parest_r 23176.000 -
511.povray_r 21619.000 -
519.lbm_r 17587.000 -
520.omnetpp_r 13164.000 2.36%
521.wrf_r 21285.000 -1.28%
523.xalancbmk_r 12270.000 2.05%
525.x264_r 14565.000 -
526.blender_r 12430.000 -
527.cam4_r 11517.000 -2.55%
531.deepsjeng_r 10624.000 -
538.imagick_r 15168.000 -1.24%
541.leela_r 12442.000 -
544.nab_r 11763.000 -
549.fotonik3d_r 20244.000 -
554.roms_r 20402.000 -2.56%
557.xz_r 12673.000 -
Geometric Mean 15097.298 -
Name Current %
500.perlbench_r 1083512.000 -
502.gcc_r 4181743.000 -
503.bwaves_r 18950.000 -
505.mcf_r 14153.000 -
507.cactuBSSN_r 1793184.000 -
508.namd_r 356248.000 -
510.parest_r 716199.000 -
511.povray_r 492749.000 -
519.lbm_r 10113.000 -
520.omnetpp_r 740237.000 -
521.wrf_r 7710479.000 -
523.xalancbmk_r 1574826.000 -
525.x264_r 260982.000 -
526.blender_r 4356717.000 -
527.cam4_r 1811962.000 -
531.deepsjeng_r 50221.000 -
538.imagick_r 663186.000 -
541.leela_r 44233.000 -
544.nab_r 48837.000 -
549.fotonik3d_r 179760.000 -
554.roms_r 340584.000 -
557.xz_r 75385.000 -
Geometric Mean 323979.565 -
Name Current %
500.perlbench_r 105.000 -
500.perlbench_r (avg) 105.000 -
500.perlbench_r (avg) (percentage) 0.770 -
500.perlbench_r (max) 179.000 -2.72%
500.perlbench_r (max) (percentage) 1.310 -1.50%
502.gcc_r 34.000 -
502.gcc_r (avg) 34.000 -
502.gcc_r (avg) (percentage) 0.320 -
502.gcc_r (max) 68.000 -2.86%
502.gcc_r (max) (percentage) 0.640 -3.03%
503.bwaves_r 51.000 -
503.bwaves_r (avg) 51.000 -
503.bwaves_r (avg) (percentage) 0.210 -
503.bwaves_r (max) 29.000 -
503.bwaves_r (max) (percentage) 0.120 -
505.mcf_r 47.000 2.17%
505.mcf_r (avg) 47.000 2.17%
505.mcf_r (avg) (percentage) 0.350 -
505.mcf_r (max) 109.000 240.62%
505.mcf_r (max) (percentage) 0.810 237.50%
505.mcf_r (unexplained diff vs previous) 110.000 450.00%
505.mcf_r (unexplained diff vs previous) (percentage) 0.810 440.00%
507.cactuBSSN_r 87.000 -
507.cactuBSSN_r (avg) 87.000 -
507.cactuBSSN_r (avg) (percentage) 0.410 -
507.cactuBSSN_r (max) 187.000 -4.10%
507.cactuBSSN_r (max) (percentage) 0.880 -3.30%
508.namd_r 29.000 -
508.namd_r (avg) 29.000 -
508.namd_r (avg) (percentage) 0.280 -
508.namd_r (max) 11.000 -
508.namd_r (max) (percentage) 0.110 -
510.parest_r 32.000 18.52%
510.parest_r (avg) 32.000 18.52%
510.parest_r (avg) (percentage) 0.140 16.67%
510.parest_r (max) 196.000 625.93%
510.parest_r (max) (percentage) 0.850 608.33%
510.parest_r (unexplained diff vs previous) 195.000 3800.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.840 4100.00%
511.povray_r 116.000 -
511.povray_r (avg) 116.000 -
511.povray_r (avg) (percentage) 0.540 -
511.povray_r (max) 90.000 -1.10%
511.povray_r (max) (percentage) 0.420 -
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.110 -
519.lbm_r (max) 21.000 23.53%
519.lbm_r (max) (percentage) 0.120 20.00%
519.lbm_r (unexplained diff vs previous) 21.000 23.53%
519.lbm_r (unexplained diff vs previous) (percentage) 0.120 20.00%
520.omnetpp_r 144.000 5.11%
520.omnetpp_r (avg) 144.000 5.11%
520.omnetpp_r (avg) (percentage) 1.100 2.80%
520.omnetpp_r (max) 310.000 32.48%
520.omnetpp_r (max) (percentage) 2.360 29.67%
520.omnetpp_r (unexplained diff vs previous) 304.000 27.73%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.310 24.86%
521.wrf_r 110.000 -1.79%
521.wrf_r (avg) 110.000 -1.79%
521.wrf_r (avg) (percentage) 0.520 -
521.wrf_r (max) 44.000 -6.38%
521.wrf_r (max) (percentage) 0.210 -4.55%
523.xalancbmk_r 49.000 2.08%
523.xalancbmk_r (avg) 49.000 2.08%
523.xalancbmk_r (avg) (percentage) 0.400 -
523.xalancbmk_r (max) 180.000 -1.64%
523.xalancbmk_r (max) (percentage) 1.470 -3.92%
525.x264_r 20.000 -
525.x264_r (avg) 20.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 21.000 162.50%
525.x264_r (max) (percentage) 0.150 150.00%
525.x264_r (unexplained diff vs previous) 22.000 633.33%
525.x264_r (unexplained diff vs previous) (percentage) 0.150 650.00%
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.310 -
526.blender_r (max) 52.000 -3.70%
526.blender_r (max) (percentage) 0.420 -4.55%
527.cam4_r 62.000 16.98%
527.cam4_r (avg) 62.000 16.98%
527.cam4_r (avg) (percentage) 0.540 20.00%
527.cam4_r (max) 293.000 306.94%
527.cam4_r (max) (percentage) 2.550 318.03%
527.cam4_r (unexplained diff vs previous) 301.000 318.06%
527.cam4_r (unexplained diff vs previous) (percentage) 2.610 327.87%
531.deepsjeng_r 87.000 -
531.deepsjeng_r (avg) 87.000 -
531.deepsjeng_r (avg) (percentage) 0.820 -
531.deepsjeng_r (max) 117.000 -7.87%
531.deepsjeng_r (max) (percentage) 1.110 -7.50%
538.imagick_r 63.000 -1.56%
538.imagick_r (avg) 63.000 -1.56%
538.imagick_r (avg) (percentage) 0.420 -
538.imagick_r (max) 160.000 -6.98%
538.imagick_r (max) (percentage) 1.060 -5.36%
541.leela_r 26.000 4.00%
541.leela_r (avg) 26.000 4.00%
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 19.000 -
541.leela_r (max) (percentage) 0.160 -
544.nab_r 54.000 -
544.nab_r (avg) 54.000 -
544.nab_r (avg) (percentage) 0.460 -
544.nab_r (max) 42.000 -23.64%
544.nab_r (max) (percentage) 0.360 -23.40%
544.nab_r (unexplained diff vs previous) 33.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 52.000 -
549.fotonik3d_r (avg) 52.000 -
549.fotonik3d_r (avg) (percentage) 0.260 -
549.fotonik3d_r (max) 119.000 -6.30%
549.fotonik3d_r (max) (percentage) 0.590 -6.35%
554.roms_r 40.000 -2.44%
554.roms_r (avg) 40.000 -2.44%
554.roms_r (avg) (percentage) 0.200 -
554.roms_r (max) 99.000 -6.60%
554.roms_r (max) (percentage) 0.490 -3.92%
557.xz_r 22.000 -
557.xz_r (avg) 22.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 15.000 -6.25%
557.xz_r (max) (percentage) 0.120 -7.69%
Geometric Mean 6.995 15.19%