Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1305119a7ef3d19b7d868093b7b6b6a6c4f21c19 (+ 78 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (4f02bfb62da3a0e32a86cc2ac1171b11da026e7c) (+ 352 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4052d99ead880797cf271309fd87ddd2b95bd353 (+ 44 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/f1f8a95d093efd12e3e7a66cb387389471fa25a6 (+ 199 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/325/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0325 (4-changed-components) 2025-05-16T12:50:47 0:00:00
Previous 0322 (basepoints/gcc-16-00454-g0a339746e76) 2025-05-11T08:53:10 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 33
Performance Improvements 38 9
Added Tests 6 107
Unchanged Tests 873 787
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 3.47% 13153.000 13609.000 - 4.60% -
531.deepsjeng_r 3.20% 11050.000 11404.000 - 2.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 833.33% 6.000 56.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 725.00% 0.040 0.330 - 0.00% -
507.cactuBSSN_r (max) 191.78% 73.000 213.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) 188.89% 0.270 0.780 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 114.29% 0.070 0.150 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 113.64% 0.220 0.470 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 112.50% 24.000 51.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 100.00% 16.000 32.000 - 0.00% -
508.namd_r (max) 44.44% 9.000 13.000 - 0.00% -
508.namd_r (max) (percentage) 40.00% 0.100 0.140 - 0.00% -
500.perlbench_r 2.94% 68.000 70.000 - 0.00% -
500.perlbench_r (avg) 2.94% 68.000 70.000 - 0.00% -
507.cactuBSSN_r 2.83% 106.000 109.000 - 0.00% -
507.cactuBSSN_r (avg) 2.83% 106.000 109.000 - 0.00% -
507.cactuBSSN_r (avg) (percentage) 2.56% 0.390 0.400 - 0.00% -
531.deepsjeng_r 2.56% 78.000 80.000 - 0.00% -
531.deepsjeng_r (avg) 2.56% 78.000 80.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -1.72% 10515.000 10334.000 - 3.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) -16.28% 43.000 36.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -16.13% 0.310 0.260 - 0.00% -
519.lbm_r (max) (percentage) -11.54% 0.520 0.460 - 0.00% -
519.lbm_r (max) -11.36% 88.000 78.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -9.09% 0.330 0.300 - 0.00% -
511.povray_r (max) -8.70% 23.000 21.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.58% 1.520 1.420 - 0.00% -
520.omnetpp_r (max) -6.10% 164.000 154.000 - 0.00% -
505.mcf_r (max) (percentage) -5.77% 0.520 0.490 - 0.00% -
505.mcf_r (max) -5.63% 71.000 67.000 - 0.00% -
531.deepsjeng_r (max) -5.56% 36.000 34.000 - 0.00% -
549.fotonik3d_r (max) -5.41% 37.000 35.000 - 0.00% -
503.bwaves_r (max) -5.13% 39.000 37.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
557.xz_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
557.xz_r (max) -4.55% 22.000 21.000 - 0.00% -
523.xalancbmk_r (max) -4.21% 404.000 387.000 - 0.00% -
511.povray_r -3.39% 59.000 57.000 - 0.00% -
511.povray_r (avg) -3.39% 59.000 57.000 - 0.00% -
511.povray_r (avg) (percentage) -3.33% 0.300 0.290 - 0.00% -
500.perlbench_r (max) (percentage) -3.03% 0.990 0.960 - 0.00% -
502.gcc_r -3.03% 33.000 32.000 - 0.00% -
502.gcc_r (avg) -3.03% 33.000 32.000 - 0.00% -
538.imagick_r (max) -2.99% 67.000 65.000 - 0.00% -
521.wrf_r (max) -2.63% 114.000 111.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.60% 3.850 3.750 - 0.00% -
554.roms_r (max) -2.58% 426.000 415.000 - 0.00% -
554.roms_r (max) (percentage) -2.45% 2.040 1.990 - 0.00% -
538.imagick_r (max) (percentage) -2.22% 0.450 0.440 - 0.00% -
541.leela_r (max) (percentage) -1.96% 0.510 0.500 - 0.00% -
526.blender_r (max) -1.64% 61.000 60.000 - 0.00% -
541.leela_r (max) -1.64% 61.000 60.000 - 0.00% -
521.wrf_r (max) (percentage) -1.49% 0.670 0.660 - 0.00% -
544.nab_r (max) (percentage) -1.49% 0.670 0.660 - 0.00% -
523.xalancbmk_r -1.37% 73.000 72.000 - 0.00% -
523.xalancbmk_r (avg) -1.37% 73.000 72.000 - 0.00% -
544.nab_r (max) -1.33% 75.000 74.000 - 0.00% -

Added Tests - sample variability
507.cactuBSSN_r (unexplained diff vs previous)
507.cactuBSSN_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 12.77% 28615.000 32270.000 - 0.00% -
510.parest_r 8.70% 6402190.000 6959228.000 - -0.00% -
541.leela_r 8.69% 126444.000 137432.000 - -0.01% -
507.cactuBSSN_r 6.48% 3793035.000 4038658.000 - -0.00% -
526.blender_r 6.44% 7841603.000 8346405.000 - -0.00% -
520.omnetpp_r 6.34% 1579795.000 1679946.000 - -0.00% -
557.xz_r 6.32% 171382.000 182214.000 - 0.00% -
521.wrf_r 5.32% 18630170.000 19620925.000 - 0.00% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
523.xalancbmk_r 4.33% 3639697.000 3797322.000 - -0.02% -
502.gcc_r 4.29% 8093137.000 8440135.000 - 0.00% -
500.perlbench_r 4.08% 1879803.000 1956410.000 - 0.02% -
544.nab_r 3.75% 149498.000 155110.000 - -0.04% -
508.namd_r 3.71% 643020.000 666879.000 - 0.00% -
525.x264_r 2.81% 438558.000 450889.000 - 0.01% -
505.mcf_r 2.78% 24877.000 25569.000 - 0.00% -
511.povray_r 2.71% 771450.000 792352.000 - 0.00% -
531.deepsjeng_r 2.44% 90159.000 92361.000 - -0.02% -
538.imagick_r 1.98% 1669137.000 1702175.000 - 0.01% -
527.cam4_r 1.87% 15743687.000 16037459.000 - -0.00% -
554.roms_r 1.83% 691655.000 704301.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 10.54% 18060.000 19964.000 - -0.11% -
507.cactuBSSN_r 4.68% 26205.000 27432.000 - 0.78% -
500.perlbench_r 4.60% 13010.000 13609.000 - 3.47% -
523.xalancbmk_r 3.30% 10004.000 10334.000 - -1.72% -
531.deepsjeng_r 2.36% 11141.000 11404.000 - 3.20% -
549.fotonik3d_r 2.12% 18451.000 18842.000 - -0.03% -
505.mcf_r 1.93% 13471.000 13731.000 - 0.26% -
554.roms_r 1.84% 20494.000 20872.000 - -0.15% -
519.lbm_r 1.44% 16818.000 17061.000 - 0.33% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.21% 12900.000 11325.000 - 0.61% -
541.leela_r -5.91% 12835.000 12077.000 - 0.35% -
557.xz_r -5.58% 10659.000 10064.000 - -0.15% -
520.omnetpp_r -4.96% 11471.000 10902.000 - 0.47% -
503.bwaves_r -4.76% 22913.000 21822.000 - -0.15% -
538.imagick_r -3.33% 15456.000 14941.000 - 0.07% -
525.x264_r -2.04% 14337.000 14045.000 - -0.18% -
526.blender_r -1.70% 11021.000 10834.000 - 0.00% -
502.gcc_r -1.53% 9245.000 9104.000 - -0.77% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13609.000 3.47%
502.gcc_r 9104.000 -
503.bwaves_r 21822.000 -
505.mcf_r 13731.000 -
507.cactuBSSN_r 27432.000 -
508.namd_r 9854.000 -
510.parest_r 20803.000 -
511.povray_r 19964.000 -
519.lbm_r 17061.000 -
520.omnetpp_r 10902.000 -
521.wrf_r 16921.000 -
523.xalancbmk_r 10334.000 -1.72%
525.x264_r 14045.000 -
526.blender_r 10834.000 -
527.cam4_r 10603.000 -
531.deepsjeng_r 11404.000 3.20%
538.imagick_r 14941.000 -
541.leela_r 12077.000 -
544.nab_r 11325.000 -
549.fotonik3d_r 18842.000 -
554.roms_r 20872.000 -
557.xz_r 10064.000 -
Geometric Mean 14132.383 -
Name Current %
500.perlbench_r 1956410.000 -
502.gcc_r 8440135.000 -
503.bwaves_r 32270.000 -
505.mcf_r 25569.000 -
507.cactuBSSN_r 4038658.000 -
508.namd_r 666879.000 -
510.parest_r 6959228.000 -
511.povray_r 792352.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1679946.000 -
521.wrf_r 19620925.000 -
523.xalancbmk_r 3797322.000 -
525.x264_r 450889.000 -
526.blender_r 8346405.000 -
527.cam4_r 16037459.000 -
531.deepsjeng_r 92361.000 -
538.imagick_r 1702175.000 -
541.leela_r 137432.000 -
544.nab_r 155110.000 -
549.fotonik3d_r 331866.000 -
554.roms_r 704301.000 -
557.xz_r 182214.000 -
Geometric Mean 768263.649 -
Name Current %
500.perlbench_r 70.000 2.94%
500.perlbench_r (avg) 70.000 2.94%
500.perlbench_r (avg) (percentage) 0.520 -
500.perlbench_r (max) 130.000 -
500.perlbench_r (max) (percentage) 0.960 -3.03%
502.gcc_r 32.000 -3.03%
502.gcc_r (avg) 32.000 -3.03%
502.gcc_r (avg) (percentage) 0.360 -
502.gcc_r (max) 25.000 -
502.gcc_r (max) (percentage) 0.280 -
503.bwaves_r 48.000 -
503.bwaves_r (avg) 48.000 -
503.bwaves_r (avg) (percentage) 0.220 -
503.bwaves_r (max) 37.000 -5.13%
503.bwaves_r (max) (percentage) 0.170 -
503.bwaves_r (unexplained diff vs previous) 32.000 100.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.150 114.29%
505.mcf_r 39.000 -
505.mcf_r (avg) 39.000 -
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 67.000 -5.63%
505.mcf_r (max) (percentage) 0.490 -5.77%
505.mcf_r (unexplained diff vs previous) 36.000 -16.28%
505.mcf_r (unexplained diff vs previous) (percentage) 0.260 -16.13%
507.cactuBSSN_r 109.000 2.83%
507.cactuBSSN_r (avg) 109.000 2.83%
507.cactuBSSN_r (avg) (percentage) 0.400 2.56%
507.cactuBSSN_r (max) 213.000 191.78%
507.cactuBSSN_r (max) (percentage) 0.780 188.89%
507.cactuBSSN_r (unexplained diff vs previous) 213.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.780 -
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 13.000 44.44%
508.namd_r (max) (percentage) 0.140 40.00%
508.namd_r (unexplained diff vs previous) 14.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.140 -
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.110 -
510.parest_r (max) 33.000 -
510.parest_r (max) (percentage) 0.160 -
511.povray_r 57.000 -3.39%
511.povray_r (avg) 57.000 -3.39%
511.povray_r (avg) (percentage) 0.290 -3.33%
511.povray_r (max) 21.000 -8.70%
511.povray_r (max) (percentage) 0.110 -
511.povray_r (unexplained diff vs previous) 22.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.110 -
519.lbm_r 54.000 -
519.lbm_r (avg) 54.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 78.000 -11.36%
519.lbm_r (max) (percentage) 0.460 -11.54%
519.lbm_r (unexplained diff vs previous) 56.000 833.33%
519.lbm_r (unexplained diff vs previous) (percentage) 0.330 725.00%
520.omnetpp_r 124.000 -
520.omnetpp_r (avg) 124.000 -
520.omnetpp_r (avg) (percentage) 1.140 -
520.omnetpp_r (max) 154.000 -6.10%
520.omnetpp_r (max) (percentage) 1.420 -6.58%
520.omnetpp_r (unexplained diff vs previous) 51.000 112.50%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.470 113.64%
521.wrf_r 76.000 -
521.wrf_r (avg) 76.000 -
521.wrf_r (avg) (percentage) 0.450 -
521.wrf_r (max) 111.000 -2.63%
521.wrf_r (max) (percentage) 0.660 -1.49%
523.xalancbmk_r 72.000 -1.37%
523.xalancbmk_r (avg) 72.000 -1.37%
523.xalancbmk_r (avg) (percentage) 0.700 -
523.xalancbmk_r (max) 387.000 -4.21%
523.xalancbmk_r (max) (percentage) 3.750 -2.60%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 15.000 -
525.x264_r (max) (percentage) 0.110 -
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 60.000 -1.64%
526.blender_r (max) (percentage) 0.560 -
531.deepsjeng_r 80.000 2.56%
531.deepsjeng_r (avg) 80.000 2.56%
531.deepsjeng_r (avg) (percentage) 0.710 -
531.deepsjeng_r (max) 34.000 -5.56%
531.deepsjeng_r (max) (percentage) 0.300 -9.09%
538.imagick_r 41.000 -
538.imagick_r (avg) 41.000 -
538.imagick_r (avg) (percentage) 0.280 -
538.imagick_r (max) 65.000 -2.99%
538.imagick_r (max) (percentage) 0.440 -2.22%
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.240 -
541.leela_r (max) 60.000 -1.64%
541.leela_r (max) (percentage) 0.500 -1.96%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 74.000 -1.33%
544.nab_r (max) (percentage) 0.660 -1.49%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 35.000 -5.41%
549.fotonik3d_r (max) (percentage) 0.190 -5.00%
554.roms_r 48.000 -
554.roms_r (avg) 48.000 -
554.roms_r (avg) (percentage) 0.230 -
554.roms_r (max) 415.000 -2.58%
554.roms_r (max) (percentage) 1.990 -2.45%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 21.000 -4.55%
557.xz_r (max) (percentage) 0.210 -4.55%
Geometric Mean 5.780 3.94%