Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=09828ac2f1327cd1bcd6f8223820c88c9338de75 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (e82a9f6536ba8fcf50a7172650a86519c50aeabd) (+ 326 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b4495bd40578b455668887b9170059bb0d3c0dc5 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3-build/385/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0385 (basepoints/gcc-16-00803-ge82a9f6536b) 2025-05-13T05:37:11 0:00:00
Previous 0380 (3-changed-components) 2025-05-05T01:53:14 0:00:00
Baseline 0090 (4-changed-components) 2023-10-17T12:24:51 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 21
Performance Improvements 47 18
Added Tests 4 107
Unchanged Tests 880 790
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 1.27% 13330.000 13499.000 - 2.09% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 1.59% 63.000 64.000 - 0.00% -
500.perlbench_r (avg) 1.59% 63.000 64.000 - 0.00% -
521.wrf_r 1.28% 78.000 79.000 - 0.00% -
521.wrf_r (avg) 1.28% 78.000 79.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -82.87% 251.000 43.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -82.63% 2.360 0.410 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -54.93% 0.710 0.320 - 0.00% -
519.lbm_r (unexplained diff vs previous) -54.55% 121.000 55.000 - 0.00% -
508.namd_r (max) (percentage) -28.57% 0.140 0.100 - 0.00% -
508.namd_r (max) -28.57% 14.000 10.000 - 0.00% -
505.mcf_r (max) -13.75% 80.000 69.000 - 0.00% -
505.mcf_r (max) (percentage) -13.33% 0.600 0.520 - 0.00% -
519.lbm_r (max) -10.74% 121.000 108.000 - 0.00% -
519.lbm_r (max) (percentage) -9.86% 0.710 0.640 - 0.00% -
544.nab_r (max) (percentage) -8.70% 0.230 0.210 - 0.00% -
557.xz_r (max) (percentage) -8.70% 0.230 0.210 - 0.00% -
557.xz_r (max) -8.70% 23.000 21.000 - 0.00% -
544.nab_r (max) -8.00% 25.000 23.000 - 0.00% -
520.omnetpp_r (max) -5.45% 257.000 243.000 - 0.00% -
520.omnetpp_r (max) (percentage) -4.96% 2.420 2.300 - 0.00% -
526.blender_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
505.mcf_r -4.55% 44.000 42.000 - 0.00% -
505.mcf_r (avg) -4.55% 44.000 42.000 - 0.00% -
521.wrf_r (max) (percentage) -4.48% 1.340 1.280 - 0.00% -
507.cactuBSSN_r (max) -4.35% 115.000 110.000 - 0.00% -
526.blender_r (max) -4.35% 23.000 22.000 - 0.00% -
521.wrf_r (max) -4.09% 220.000 211.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.70% 0.540 0.520 - 0.00% -
510.parest_r (max) -3.45% 58.000 56.000 - 0.00% -
554.roms_r (max) -3.23% 62.000 60.000 - 0.00% -
505.mcf_r (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -
541.leela_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
554.roms_r (max) (percentage) -2.94% 0.340 0.330 - 0.00% -
541.leela_r (max) -2.78% 36.000 35.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.75% 1.090 1.060 - 0.00% -
523.xalancbmk_r (max) -2.44% 164.000 160.000 - 0.00% -
511.povray_r (max) (percentage) -1.85% 0.540 0.530 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.83% 1.640 1.610 - 0.00% -
538.imagick_r (max) -1.72% 58.000 57.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -1.64% 1.220 1.200 - 0.00% -
523.xalancbmk_r -1.47% 68.000 67.000 - 0.00% -
523.xalancbmk_r (avg) -1.47% 68.000 67.000 - 0.00% -
500.perlbench_r (max) -1.38% 145.000 143.000 - 0.00% -
519.lbm_r -1.25% 80.000 79.000 - 0.00% -
519.lbm_r (avg) -1.25% 80.000 79.000 - 0.00% -
507.cactuBSSN_r -1.23% 81.000 80.000 - 0.00% -
507.cactuBSSN_r (avg) -1.23% 81.000 80.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.10% 0.910 0.900 - 0.00% -
511.povray_r (max) -1.06% 94.000 93.000 - 0.00% -
520.omnetpp_r -1.04% 96.000 95.000 - 0.00% -
520.omnetpp_r (avg) -1.04% 96.000 95.000 - 0.00% -

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 5.89% 1790858.000 1896291.000 - -0.00% -
526.blender_r 4.09% 9337120.000 9719401.000 - -0.00% -
557.xz_r 4.00% 187986.000 195510.000 - 0.04% -
519.lbm_r 3.85% 14506.000 15065.000 - 0.00% -
500.perlbench_r 2.69% 2202396.000 2261558.000 - 0.03% -
502.gcc_r 2.15% 9267975.000 9467483.000 - 0.00% -
541.leela_r 1.75% 183950.000 187162.000 - -0.01% -
523.xalancbmk_r 1.15% 4933438.000 4990086.000 - -0.02% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 8.32% 15712.000 17019.000 - -0.32% -
554.roms_r 7.43% 17061.000 18329.000 - -0.25% -
508.namd_r 5.28% 9729.000 10243.000 - 0.08% -
549.fotonik3d_r 2.51% 18587.000 19053.000 - 0.30% -
500.perlbench_r 2.09% 13223.000 13499.000 - 1.27% -
531.deepsjeng_r 2.04% 12334.000 12585.000 - 0.99% -
538.imagick_r 1.61% 14189.000 14417.000 - 0.35% -
520.omnetpp_r 1.31% 10457.000 10594.000 - -0.40% -
523.xalancbmk_r 1.22% 9869.000 9989.000 - -0.34% -
521.wrf_r 1.14% 16336.000 16522.000 - 0.49% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -24.04% 27033273.000 20534573.000 - 0.00% -
554.roms_r -14.21% 1086498.000 932125.000 - 0.00% -
505.mcf_r -13.70% 35989.000 31057.000 - 0.00% -
549.fotonik3d_r -12.13% 404732.000 355626.000 - -0.00% -
508.namd_r -10.01% 905308.000 814660.000 - 0.00% -
510.parest_r -6.16% 8367039.000 7851464.000 - -0.00% -
507.cactuBSSN_r -4.72% 4949254.000 4715887.000 - -0.00% -
527.cam4_r -4.13% 17243586.000 16531991.000 - -0.00% -
531.deepsjeng_r -1.11% 108133.000 106933.000 - 0.45% -
544.nab_r -1.04% 202246.000 200150.000 - -0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -5.72% 11805.000 11130.000 - 0.13% -
510.parest_r -5.62% 21507.000 20298.000 - -0.12% -
503.bwaves_r -4.53% 22981.000 21940.000 - -0.22% -
557.xz_r -4.06% 10495.000 10069.000 - -0.22% -
507.cactuBSSN_r -2.93% 21928.000 21285.000 - -0.38% -
541.leela_r -1.72% 11161.000 10969.000 - 0.29% -
502.gcc_r -1.45% 8883.000 8754.000 - -0.18% -
505.mcf_r -1.05% 13574.000 13432.000 - -0.04% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 13499.000 1.27%
502.gcc_r 8754.000 -
503.bwaves_r 21940.000 -
505.mcf_r 13432.000 -
507.cactuBSSN_r 21285.000 -
508.namd_r 10243.000 -
510.parest_r 20298.000 -
511.povray_r 17573.000 -
519.lbm_r 17019.000 -
520.omnetpp_r 10594.000 -
521.wrf_r 16522.000 -
523.xalancbmk_r 9989.000 -
525.x264_r 10999.000 -
526.blender_r 10800.000 -
527.cam4_r 9982.000 -
531.deepsjeng_r 12585.000 -
538.imagick_r 14417.000 -
541.leela_r 10969.000 -
544.nab_r 11130.000 -
549.fotonik3d_r 19053.000 -
554.roms_r 18329.000 -
557.xz_r 10069.000 -
Geometric Mean 13506.211 -
Name Current %
500.perlbench_r 2261558.000 -
502.gcc_r 9467483.000 -
503.bwaves_r 31070.000 -
505.mcf_r 31057.000 -
507.cactuBSSN_r 4715887.000 -
508.namd_r 814660.000 -
510.parest_r 7851464.000 -
511.povray_r 975424.000 -
519.lbm_r 15065.000 -
520.omnetpp_r 1896291.000 -
521.wrf_r 20534573.000 -
523.xalancbmk_r 4990086.000 -
525.x264_r 590680.000 -
526.blender_r 9719401.000 -
527.cam4_r 16531991.000 -
531.deepsjeng_r 106933.000 -
538.imagick_r 1981051.000 -
541.leela_r 187162.000 -
544.nab_r 200150.000 -
549.fotonik3d_r 355626.000 -
554.roms_r 932125.000 -
557.xz_r 195510.000 -
Geometric Mean 894880.311 -
Name Current %
500.perlbench_r 64.000 1.59%
500.perlbench_r (avg) 64.000 1.59%
500.perlbench_r (avg) (percentage) 0.480 -
500.perlbench_r (max) 143.000 -1.38%
500.perlbench_r (max) (percentage) 1.060 -2.75%
502.gcc_r 30.000 -
502.gcc_r (avg) 30.000 -
502.gcc_r (avg) (percentage) 0.350 -
502.gcc_r (max) 49.000 -
502.gcc_r (max) (percentage) 0.560 -
503.bwaves_r 57.000 -
503.bwaves_r (avg) 57.000 -
503.bwaves_r (avg) (percentage) 0.260 -
503.bwaves_r (max) 19.000 -
503.bwaves_r (max) (percentage) 0.090 -
505.mcf_r 42.000 -4.55%
505.mcf_r (avg) 42.000 -4.55%
505.mcf_r (avg) (percentage) 0.320 -3.03%
505.mcf_r (max) 69.000 -13.75%
505.mcf_r (max) (percentage) 0.520 -13.33%
505.mcf_r (unexplained diff vs previous) 6.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.040 -
507.cactuBSSN_r 80.000 -1.23%
507.cactuBSSN_r (avg) 80.000 -1.23%
507.cactuBSSN_r (avg) (percentage) 0.380 -
507.cactuBSSN_r (max) 110.000 -4.35%
507.cactuBSSN_r (max) (percentage) 0.520 -3.70%
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.220 -
508.namd_r (max) 10.000 -28.57%
508.namd_r (max) (percentage) 0.100 -28.57%
508.namd_r (unexplained diff vs previous) 8.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.080 -
510.parest_r 26.000 -
510.parest_r (avg) 26.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 56.000 -3.45%
510.parest_r (max) (percentage) 0.280 -
511.povray_r 57.000 -
511.povray_r (avg) 57.000 -
511.povray_r (avg) (percentage) 0.330 -
511.povray_r (max) 93.000 -1.06%
511.povray_r (max) (percentage) 0.530 -1.85%
519.lbm_r 79.000 -1.25%
519.lbm_r (avg) 79.000 -1.25%
519.lbm_r (avg) (percentage) 0.470 -
519.lbm_r (max) 108.000 -10.74%
519.lbm_r (max) (percentage) 0.640 -9.86%
519.lbm_r (unexplained diff vs previous) 55.000 -54.55%
519.lbm_r (unexplained diff vs previous) (percentage) 0.320 -54.93%
520.omnetpp_r 95.000 -1.04%
520.omnetpp_r (avg) 95.000 -1.04%
520.omnetpp_r (avg) (percentage) 0.900 -1.10%
520.omnetpp_r (max) 243.000 -5.45%
520.omnetpp_r (max) (percentage) 2.300 -4.96%
520.omnetpp_r (unexplained diff vs previous) 43.000 -82.87%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.410 -82.63%
521.wrf_r 79.000 1.28%
521.wrf_r (avg) 79.000 1.28%
521.wrf_r (avg) (percentage) 0.480 -
521.wrf_r (max) 211.000 -4.09%
521.wrf_r (max) (percentage) 1.280 -4.48%
523.xalancbmk_r 67.000 -1.47%
523.xalancbmk_r (avg) 67.000 -1.47%
523.xalancbmk_r (avg) (percentage) 0.680 -
523.xalancbmk_r (max) 160.000 -2.44%
523.xalancbmk_r (max) (percentage) 1.610 -1.83%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 36.000 -
525.x264_r (max) (percentage) 0.330 -
526.blender_r 35.000 -
526.blender_r (avg) 35.000 -
526.blender_r (avg) (percentage) 0.330 -
526.blender_r (max) 22.000 -4.35%
526.blender_r (max) (percentage) 0.210 -4.55%
531.deepsjeng_r 57.000 -
531.deepsjeng_r (avg) 57.000 -
531.deepsjeng_r (avg) (percentage) 0.460 -
531.deepsjeng_r (max) 151.000 -
531.deepsjeng_r (max) (percentage) 1.200 -1.64%
538.imagick_r 44.000 -
538.imagick_r (avg) 44.000 -
538.imagick_r (avg) (percentage) 0.310 -
538.imagick_r (max) 57.000 -1.72%
538.imagick_r (max) (percentage) 0.400 -
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.270 -
541.leela_r (max) 35.000 -2.78%
541.leela_r (max) (percentage) 0.320 -3.03%
544.nab_r 43.000 -
544.nab_r (avg) 43.000 -
544.nab_r (avg) (percentage) 0.390 -
544.nab_r (max) 23.000 -8.00%
544.nab_r (max) (percentage) 0.210 -8.70%
548.exchange2_r (avg) (percentage) 0.300 -
548.exchange2_r (max) (percentage) 0.230 -
549.fotonik3d_r 36.000 -
549.fotonik3d_r (avg) 36.000 -
549.fotonik3d_r (avg) (percentage) 0.190 -
549.fotonik3d_r (max) 22.000 -
549.fotonik3d_r (max) (percentage) 0.120 -
554.roms_r 49.000 -
554.roms_r (avg) 49.000 -
554.roms_r (avg) (percentage) 0.270 -
554.roms_r (max) 60.000 -3.23%
554.roms_r (max) (percentage) 0.330 -2.94%
557.xz_r 14.000 -
557.xz_r (avg) 14.000 -
557.xz_r (avg) (percentage) 0.140 -
557.xz_r (max) 21.000 -8.70%
557.xz_r (max) (percentage) 0.210 -8.70%
Geometric Mean 5.774 -13.78%