Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=006fb761170a153205f8381fa773fa007120ab5b (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (1bc5b47f5b06dc4e8d2e7b622a7100b40b8e6b27) (+ 118 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=08d7243a6179d5a1f3f65a53aba1ec0803895aeb (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f871ce2482ed3a48ea0e1080bfeb7e4d6e99f78 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/329/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0329 (basepoints/gcc-16-00924-g1bc5b47f5b0) 2025-05-25T01:37:34 0:00:00
Previous 0328 (3-changed-components) 2025-05-22T02:23:51 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 32
Performance Improvements 53 9
Added Tests 0 107
Unchanged Tests 871 788
Total Tests 936

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) 500.00% 2.000 12.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 500.00% 0.020 0.120 - 0.00% -
557.xz_r (unexplained diff vs previous) 166.67% 6.000 16.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 166.67% 0.060 0.160 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 161.90% 0.210 0.550 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 156.52% 23.000 59.000 - 0.00% -
544.nab_r (unexplained diff vs previous) 17.86% 28.000 33.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 16.00% 0.250 0.290 - 0.00% -
538.imagick_r 2.44% 41.000 42.000 - 0.00% -
538.imagick_r (avg) 2.44% 41.000 42.000 - 0.00% -
503.bwaves_r 2.13% 47.000 48.000 - 0.00% -
503.bwaves_r (avg) 2.13% 47.000 48.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.39% 13688.000 13361.000 - 2.70% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r (unexplained diff vs previous) (percentage) -82.73% 2.490 0.430 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) -82.47% 251.000 44.000 - 0.00% -
510.parest_r (unexplained diff vs previous) -81.82% 121.000 22.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -81.36% 0.590 0.110 - 0.00% -
505.mcf_r (unexplained diff vs previous) -80.95% 21.000 4.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -80.00% 0.150 0.030 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -79.74% 1.530 0.310 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -79.65% 172.000 35.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) -41.86% 43.000 25.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -40.00% 0.250 0.150 - 0.00% -
519.lbm_r (max) (percentage) -12.00% 0.250 0.220 - 0.00% -
519.lbm_r (max) -11.90% 42.000 37.000 - 0.00% -
557.xz_r (max) -11.11% 18.000 16.000 - 0.00% -
557.xz_r (max) (percentage) -11.11% 0.180 0.160 - 0.00% -
531.deepsjeng_r (max) -10.06% 169.000 152.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -9.93% 1.510 1.360 - 0.00% -
508.namd_r (max) -8.33% 12.000 11.000 - 0.00% -
503.bwaves_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
508.namd_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
507.cactuBSSN_r (max) -7.29% 192.000 178.000 - 0.00% -
503.bwaves_r (max) -7.14% 28.000 26.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -7.14% 0.700 0.650 - 0.00% -
511.povray_r (max) -5.63% 71.000 67.000 - 0.00% -
511.povray_r (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
554.roms_r (max) (percentage) -5.49% 1.820 1.720 - 0.00% -
554.roms_r (max) -5.18% 386.000 366.000 - 0.00% -
510.parest_r (max) (percentage) -5.17% 0.580 0.550 - 0.00% -
510.parest_r (max) -5.04% 119.000 113.000 - 0.00% -
549.fotonik3d_r (max) -4.44% 45.000 43.000 - 0.00% -
525.x264_r (max) -4.35% 46.000 44.000 - 0.00% -
541.leela_r (max) (percentage) -3.51% 0.570 0.550 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.28% 3.050 2.950 - 0.00% -
526.blender_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
502.gcc_r (max) -3.23% 31.000 30.000 - 0.00% -
525.x264_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
526.blender_r (max) -3.03% 33.000 32.000 - 0.00% -
521.wrf_r (max) (percentage) -2.99% 0.670 0.650 - 0.00% -
541.leela_r (max) -2.94% 68.000 66.000 - 0.00% -
523.xalancbmk_r (max) -2.93% 307.000 298.000 - 0.00% -
500.perlbench_r -2.78% 72.000 70.000 - 0.00% -
500.perlbench_r (avg) -2.78% 72.000 70.000 - 0.00% -
521.wrf_r (max) -2.68% 112.000 109.000 - 0.00% -
500.perlbench_r (max) -2.53% 79.000 77.000 - 0.00% -
538.imagick_r (max) (percentage) -2.33% 0.430 0.420 - 0.00% -
544.nab_r (max) (percentage) -2.08% 0.480 0.470 - 0.00% -
544.nab_r (max) -1.85% 54.000 53.000 - 0.00% -
505.mcf_r (max) -1.56% 64.000 63.000 - 0.00% -
538.imagick_r (max) -1.56% 64.000 63.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) -1.37% 0.730 0.720 - 0.00% -
531.deepsjeng_r -1.23% 81.000 80.000 - 0.00% -
531.deepsjeng_r (avg) -1.23% 81.000 80.000 - 0.00% -
520.omnetpp_r (max) -1.12% 89.000 88.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 12.75% 28615.000 32262.000 - -0.02% -
510.parest_r 8.70% 6402190.000 6959236.000 - 0.00% -
541.leela_r 8.70% 126444.000 137440.000 - 0.01% -
507.cactuBSSN_r 6.48% 3793035.000 4038674.000 - 0.00% -
526.blender_r 6.44% 7841603.000 8346437.000 - 0.00% -
520.omnetpp_r 6.34% 1579795.000 1679954.000 - 0.00% -
557.xz_r 6.32% 171382.000 182214.000 - 0.00% -
521.wrf_r 5.24% 18630170.000 19606453.000 - -0.07% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
523.xalancbmk_r 4.33% 3639697.000 3797322.000 - 0.00% -
502.gcc_r 4.29% 8093137.000 8440327.000 - 0.00% -
500.perlbench_r 4.06% 1879803.000 1956106.000 - -0.02% -
544.nab_r 3.75% 149498.000 155110.000 - 0.00% -
508.namd_r 3.71% 643020.000 666879.000 - 0.00% -
505.mcf_r 2.78% 24877.000 25569.000 - 0.00% -
525.x264_r 2.78% 438558.000 450737.000 - -0.03% -
511.povray_r 2.69% 771450.000 792208.000 - -0.02% -
531.deepsjeng_r 2.44% 90159.000 92361.000 - 0.00% -
538.imagick_r 1.98% 1669137.000 1702183.000 - 0.00% -
527.cam4_r 1.87% 15743687.000 16037395.000 - -0.00% -
554.roms_r 1.83% 691655.000 704337.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 10.03% 18060.000 19871.000 - -0.11% -
507.cactuBSSN_r 4.53% 26205.000 27392.000 - -0.29% -
554.roms_r 3.99% 20494.000 21312.000 - 0.29% -
500.perlbench_r 2.70% 13010.000 13361.000 - -2.39% -
505.mcf_r 2.06% 13471.000 13748.000 - -0.03% -
549.fotonik3d_r 1.79% 18451.000 18782.000 - -0.08% -
519.lbm_r 1.34% 16818.000 17043.000 - 0.15% -
523.xalancbmk_r 1.23% 10004.000 10127.000 - 0.44% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.17% 12900.000 11330.000 - 0.29% -
541.leela_r -6.31% 12835.000 12025.000 - 0.14% -
557.xz_r -5.79% 10659.000 10042.000 - -0.16% -
520.omnetpp_r -5.68% 11471.000 10820.000 - -0.54% -
503.bwaves_r -4.69% 22913.000 21838.000 - 0.09% -
538.imagick_r -2.80% 15456.000 15023.000 - 0.31% -
525.x264_r -2.02% 14337.000 14047.000 - -0.32% -
526.blender_r -1.83% 11021.000 10819.000 - -0.40% -
502.gcc_r -1.74% 9245.000 9084.000 - -0.57% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13361.000 -2.39%
502.gcc_r 9084.000 -
503.bwaves_r 21838.000 -
505.mcf_r 13748.000 -
507.cactuBSSN_r 27392.000 -
508.namd_r 9868.000 -
510.parest_r 20660.000 -
511.povray_r 19871.000 -
519.lbm_r 17043.000 -
520.omnetpp_r 10820.000 -
521.wrf_r 16816.000 -
523.xalancbmk_r 10127.000 -
525.x264_r 14047.000 -
526.blender_r 10819.000 -
527.cam4_r 10758.000 -
531.deepsjeng_r 11197.000 -
538.imagick_r 15023.000 -
541.leela_r 12025.000 -
544.nab_r 11330.000 -
549.fotonik3d_r 18782.000 -
554.roms_r 21312.000 -
557.xz_r 10042.000 -
Geometric Mean 14098.214 -
Name Current %
500.perlbench_r 1956106.000 -
502.gcc_r 8440327.000 -
503.bwaves_r 32262.000 -
505.mcf_r 25569.000 -
507.cactuBSSN_r 4038674.000 -
508.namd_r 666879.000 -
510.parest_r 6959236.000 -
511.povray_r 792208.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1679954.000 -
521.wrf_r 19606453.000 -
523.xalancbmk_r 3797322.000 -
525.x264_r 450737.000 -
526.blender_r 8346437.000 -
527.cam4_r 16037395.000 -
531.deepsjeng_r 92361.000 -
538.imagick_r 1702183.000 -
541.leela_r 137440.000 -
544.nab_r 155110.000 -
549.fotonik3d_r 331818.000 -
554.roms_r 704337.000 -
557.xz_r 182214.000 -
Geometric Mean 768205.743 -
Name Current %
500.perlbench_r 70.000 -2.78%
500.perlbench_r (avg) 70.000 -2.78%
500.perlbench_r (avg) (percentage) 0.530 -
500.perlbench_r (max) 77.000 -2.53%
500.perlbench_r (max) (percentage) 0.580 -
502.gcc_r 32.000 -
502.gcc_r (avg) 32.000 -
502.gcc_r (avg) (percentage) 0.360 -
502.gcc_r (max) 30.000 -3.23%
502.gcc_r (max) (percentage) 0.340 -
503.bwaves_r 48.000 2.13%
503.bwaves_r (avg) 48.000 2.13%
503.bwaves_r (avg) (percentage) 0.220 -
503.bwaves_r (max) 26.000 -7.14%
503.bwaves_r (max) (percentage) 0.120 -7.69%
505.mcf_r 39.000 -
505.mcf_r (avg) 39.000 -
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 63.000 -1.56%
505.mcf_r (max) (percentage) 0.460 -
505.mcf_r (unexplained diff vs previous) 4.000 -80.95%
505.mcf_r (unexplained diff vs previous) (percentage) 0.030 -80.00%
507.cactuBSSN_r 109.000 -
507.cactuBSSN_r (avg) 109.000 -
507.cactuBSSN_r (avg) (percentage) 0.400 -
507.cactuBSSN_r (max) 178.000 -7.29%
507.cactuBSSN_r (max) (percentage) 0.650 -7.14%
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 11.000 -8.33%
508.namd_r (max) (percentage) 0.120 -7.69%
508.namd_r (unexplained diff vs previous) 12.000 500.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.120 500.00%
510.parest_r 24.000 -
510.parest_r (avg) 24.000 -
510.parest_r (avg) (percentage) 0.120 -
510.parest_r (max) 113.000 -5.04%
510.parest_r (max) (percentage) 0.550 -5.17%
510.parest_r (unexplained diff vs previous) 22.000 -81.82%
510.parest_r (unexplained diff vs previous) (percentage) 0.110 -81.36%
511.povray_r 57.000 -
511.povray_r (avg) 57.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 67.000 -5.63%
511.povray_r (max) (percentage) 0.340 -5.56%
519.lbm_r 54.000 -
519.lbm_r (avg) 54.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 37.000 -11.90%
519.lbm_r (max) (percentage) 0.220 -12.00%
519.lbm_r (unexplained diff vs previous) 25.000 -41.86%
519.lbm_r (unexplained diff vs previous) (percentage) 0.150 -40.00%
520.omnetpp_r 121.000 -
520.omnetpp_r (avg) 121.000 -
520.omnetpp_r (avg) (percentage) 1.120 -
520.omnetpp_r (max) 88.000 -1.12%
520.omnetpp_r (max) (percentage) 0.820 -
520.omnetpp_r (unexplained diff vs previous) 59.000 156.52%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.550 161.90%
521.wrf_r 75.000 -
521.wrf_r (avg) 75.000 -
521.wrf_r (avg) (percentage) 0.450 -
521.wrf_r (max) 109.000 -2.68%
521.wrf_r (max) (percentage) 0.650 -2.99%
523.xalancbmk_r 74.000 -
523.xalancbmk_r (avg) 74.000 -
523.xalancbmk_r (avg) (percentage) 0.740 -
523.xalancbmk_r (max) 298.000 -2.93%
523.xalancbmk_r (max) (percentage) 2.950 -3.28%
523.xalancbmk_r (unexplained diff vs previous) 44.000 -82.47%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.430 -82.73%
525.x264_r 16.000 -
525.x264_r (avg) 16.000 -
525.x264_r (avg) (percentage) 0.120 -
525.x264_r (max) 44.000 -4.35%
525.x264_r (max) (percentage) 0.320 -3.03%
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 32.000 -3.03%
526.blender_r (max) (percentage) 0.300 -3.23%
531.deepsjeng_r 80.000 -1.23%
531.deepsjeng_r (avg) 80.000 -1.23%
531.deepsjeng_r (avg) (percentage) 0.720 -1.37%
531.deepsjeng_r (max) 152.000 -10.06%
531.deepsjeng_r (max) (percentage) 1.360 -9.93%
531.deepsjeng_r (unexplained diff vs previous) 35.000 -79.65%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.310 -79.74%
538.imagick_r 42.000 2.44%
538.imagick_r (avg) 42.000 2.44%
538.imagick_r (avg) (percentage) 0.280 -
538.imagick_r (max) 63.000 -1.56%
538.imagick_r (max) (percentage) 0.420 -2.33%
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.250 -
541.leela_r (max) 66.000 -2.94%
541.leela_r (max) (percentage) 0.550 -3.51%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 53.000 -1.85%
544.nab_r (max) (percentage) 0.470 -2.08%
544.nab_r (unexplained diff vs previous) 33.000 17.86%
544.nab_r (unexplained diff vs previous) (percentage) 0.290 16.00%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 43.000 -4.44%
549.fotonik3d_r (max) (percentage) 0.230 -
554.roms_r 55.000 -
554.roms_r (avg) 55.000 -
554.roms_r (avg) (percentage) 0.260 -
554.roms_r (max) 366.000 -5.18%
554.roms_r (max) (percentage) 1.720 -5.49%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 16.000 -11.11%
557.xz_r (max) (percentage) 0.160 -11.11%
557.xz_r (unexplained diff vs previous) 16.000 166.67%
557.xz_r (unexplained diff vs previous) (percentage) 0.160 166.67%
Geometric Mean 5.439 -6.79%