Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e0f07df069aa122449303595747fe336ca870797 (+ 44 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (9cc6cfdca980a508f72865830a09b353140e738e) (+ 76 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=abc2e954af77f8d10f4f54754520814590e79830 (+ 45 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/339/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0339 (3-changed-components) 2025-06-14T20:00:00 0:00:00
Previous 0337 (4-changed-components) 2025-06-10T20:56:40 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 30 31
Performance Improvements 51 9
Added Tests 0 107
Unchanged Tests 855 789
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.47% 11066.000 11229.000 - 0.79% -
507.cactuBSSN_r 1.28% 27313.000 27663.000 - 5.56% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r (unexplained diff vs previous) 3800.00% 1.000 39.000 - 0.00% -
557.xz_r (unexplained diff vs previous) 1300.00% 1.000 14.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 1300.00% 0.010 0.140 - 0.00% -
554.roms_r (unexplained diff vs previous) (percentage) 400.00% 0.020 0.100 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 355.00% 0.200 0.910 - 0.00% -
505.mcf_r (unexplained diff vs previous) 342.86% 28.000 124.000 - 0.00% -
554.roms_r (unexplained diff vs previous) 340.00% 5.000 22.000 - 0.00% -
505.mcf_r (max) 335.71% 28.000 122.000 - 0.00% -
505.mcf_r (max) (percentage) 328.57% 0.210 0.900 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 91.67% 0.120 0.230 - 0.00% -
510.parest_r (unexplained diff vs previous) 88.00% 25.000 47.000 - 0.00% -
510.parest_r (max) 67.86% 28.000 47.000 - 0.00% -
510.parest_r (max) (percentage) 64.29% 0.140 0.230 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 52.34% 107.000 163.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 49.48% 0.970 1.450 - 0.00% -
519.lbm_r (max) 44.68% 47.000 68.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 44.68% 47.000 68.000 - 0.00% -
519.lbm_r (max) (percentage) 42.86% 0.280 0.400 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 42.86% 0.280 0.400 - 0.00% -
531.deepsjeng_r (max) 41.03% 117.000 165.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 38.68% 1.060 1.470 - 0.00% -
531.deepsjeng_r 3.95% 76.000 79.000 - 0.00% -
531.deepsjeng_r (avg) 3.95% 76.000 79.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 2.90% 0.690 0.710 - 0.00% -
505.mcf_r 2.63% 38.000 39.000 - 0.00% -
505.mcf_r (avg) 2.63% 38.000 39.000 - 0.00% -
538.imagick_r 2.44% 41.000 42.000 - 0.00% -
538.imagick_r (avg) 2.44% 41.000 42.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.76% 13457.000 13085.000 - 0.58% -
544.nab_r -1.56% 11409.000 11231.000 - -12.94% -
526.blender_r -1.18% 10902.000 10773.000 - -2.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -68.94% 132.000 41.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -68.60% 1.210 0.380 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -62.50% 0.160 0.060 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -60.00% 30.000 12.000 - 0.00% -
521.wrf_r (max) -43.35% 263.000 149.000 - 0.00% -
521.wrf_r (max) (percentage) -43.31% 1.570 0.890 - 0.00% -
549.fotonik3d_r (max) -26.67% 30.000 22.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) -25.58% 86.000 64.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) (percentage) -25.49% 0.510 0.380 - 0.00% -
549.fotonik3d_r (max) (percentage) -25.00% 0.160 0.120 - 0.00% -
520.omnetpp_r (max) (percentage) -12.50% 1.200 1.050 - 0.00% -
520.omnetpp_r (max) -12.31% 130.000 114.000 - 0.00% -
549.fotonik3d_r -9.09% 22.000 20.000 - 0.00% -
549.fotonik3d_r (avg) -9.09% 22.000 20.000 - 0.00% -
508.namd_r (max) -6.45% 31.000 29.000 - 0.00% -
508.namd_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
508.namd_r -5.26% 19.000 18.000 - 0.00% -
508.namd_r (avg) -5.26% 19.000 18.000 - 0.00% -
544.nab_r (max) -5.17% 58.000 55.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -5.17% 0.580 0.550 - 0.00% -
508.namd_r (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
503.bwaves_r (max) (percentage) -4.94% 1.620 1.540 - 0.00% -
503.bwaves_r (max) -4.82% 353.000 336.000 - 0.00% -
557.xz_r (max) -4.17% 24.000 23.000 - 0.00% -
544.nab_r (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
500.perlbench_r (max) -3.85% 78.000 75.000 - 0.00% -
507.cactuBSSN_r (max) -3.80% 158.000 152.000 - 0.00% -
541.leela_r (max) -3.77% 53.000 51.000 - 0.00% -
538.imagick_r (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
554.roms_r (avg) (percentage) -3.57% 0.280 0.270 - 0.00% -
511.povray_r (max) -3.39% 59.000 57.000 - 0.00% -
554.roms_r -3.39% 59.000 57.000 - 0.00% -
554.roms_r (avg) -3.39% 59.000 57.000 - 0.00% -
500.perlbench_r -2.94% 68.000 66.000 - 0.00% -
500.perlbench_r (avg) -2.94% 68.000 66.000 - 0.00% -
554.roms_r (max) -2.59% 270.000 263.000 - 0.00% -
526.blender_r (max) -2.56% 39.000 38.000 - 0.00% -
538.imagick_r (max) -2.44% 41.000 40.000 - 0.00% -
544.nab_r -2.44% 41.000 40.000 - 0.00% -
544.nab_r (avg) -2.44% 41.000 40.000 - 0.00% -
554.roms_r (max) (percentage) -2.36% 1.270 1.240 - 0.00% -
541.leela_r (max) (percentage) -2.27% 0.440 0.430 - 0.00% -
502.gcc_r (max) -1.82% 55.000 54.000 - 0.00% -
502.gcc_r (max) (percentage) -1.64% 0.610 0.600 - 0.00% -
520.omnetpp_r -1.64% 122.000 120.000 - 0.00% -
520.omnetpp_r (avg) -1.64% 122.000 120.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.12% 2.670 2.640 - 0.00% -
523.xalancbmk_r (max) -1.10% 272.000 269.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 12.77% 28615.000 32270.000 - 0.00% -
541.leela_r 8.68% 126444.000 137424.000 - 0.02% -
510.parest_r 8.67% 6402190.000 6957060.000 - -0.02% -
507.cactuBSSN_r 6.63% 3793035.000 4044402.000 - 0.15% -
526.blender_r 6.45% 7841603.000 8347669.000 - 0.02% -
520.omnetpp_r 6.28% 1579795.000 1678974.000 - -0.03% -
557.xz_r 6.26% 171382.000 182118.000 - 0.00% -
521.wrf_r 5.24% 18630170.000 19605509.000 - -0.00% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
502.gcc_r 4.54% 8093137.000 8460403.000 - -0.00% -
523.xalancbmk_r 4.33% 3639697.000 3797378.000 - 0.00% -
500.perlbench_r 4.03% 1879803.000 1955482.000 - -0.03% -
508.namd_r 3.72% 643020.000 666931.000 - 0.00% -
544.nab_r 3.70% 149498.000 155030.000 - -0.05% -
505.mcf_r 2.72% 24877.000 25553.000 - 0.00% -
511.povray_r 2.70% 771450.000 792248.000 - 0.00% -
525.x264_r 2.69% 438558.000 450353.000 - -0.05% -
531.deepsjeng_r 2.45% 90159.000 92369.000 - 0.00% -
538.imagick_r 2.13% 1669137.000 1704647.000 - 0.01% -
527.cam4_r 1.86% 15743687.000 16036963.000 - 0.00% -
554.roms_r 1.82% 691655.000 704249.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 12.77% 18060.000 20367.000 - -0.23% -
507.cactuBSSN_r 5.56% 26205.000 27663.000 - 1.28% -
554.roms_r 3.86% 20494.000 21286.000 - 0.10% -
523.xalancbmk_r 1.99% 10004.000 10203.000 - 0.04% -
549.fotonik3d_r 1.88% 18451.000 18798.000 - -0.06% -
505.mcf_r 1.32% 13471.000 13649.000 - -0.90% -
519.lbm_r 1.09% 16818.000 17002.000 - -0.40% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.94% 12900.000 11231.000 - -1.56% -
541.leela_r -6.59% 12835.000 11989.000 - -0.56% -
557.xz_r -5.65% 10659.000 10057.000 - 0.14% -
520.omnetpp_r -5.21% 11471.000 10873.000 - -0.38% -
503.bwaves_r -4.59% 22913.000 21862.000 - 0.18% -
538.imagick_r -2.69% 15456.000 15041.000 - 0.44% -
526.blender_r -2.25% 11021.000 10773.000 - -1.18% -
525.x264_r -1.63% 14337.000 14103.000 - 0.13% -
502.gcc_r -1.21% 9245.000 9133.000 - 0.75% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 13085.000 -2.76%
502.gcc_r 9133.000 -
503.bwaves_r 21862.000 -
505.mcf_r 13649.000 -
507.cactuBSSN_r 27663.000 1.28%
508.namd_r 9874.000 -
510.parest_r 20738.000 -
511.povray_r 20367.000 -
519.lbm_r 17002.000 -
520.omnetpp_r 10873.000 -
521.wrf_r 16832.000 -
523.xalancbmk_r 10203.000 -
525.x264_r 14103.000 -
526.blender_r 10773.000 -1.18%
527.cam4_r 10723.000 -
531.deepsjeng_r 11229.000 1.47%
538.imagick_r 15041.000 -
541.leela_r 11989.000 -
544.nab_r 11231.000 -1.56%
549.fotonik3d_r 18798.000 -
554.roms_r 21286.000 -
557.xz_r 10057.000 -
Geometric Mean 14109.765 -
Name Current %
500.perlbench_r 1955482.000 -
502.gcc_r 8460403.000 -
503.bwaves_r 32270.000 -
505.mcf_r 25553.000 -
507.cactuBSSN_r 4044402.000 -
508.namd_r 666931.000 -
510.parest_r 6957060.000 -
511.povray_r 792248.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1678974.000 -
521.wrf_r 19605509.000 -
523.xalancbmk_r 3797378.000 -
525.x264_r 450353.000 -
526.blender_r 8347669.000 -
527.cam4_r 16036963.000 -
531.deepsjeng_r 92369.000 -
538.imagick_r 1704647.000 -
541.leela_r 137424.000 -
544.nab_r 155030.000 -
549.fotonik3d_r 331818.000 -
554.roms_r 704249.000 -
557.xz_r 182118.000 -
Geometric Mean 768269.018 -
Name Current %
500.perlbench_r 66.000 -2.94%
500.perlbench_r (avg) 66.000 -2.94%
500.perlbench_r (avg) (percentage) 0.510 -
500.perlbench_r (max) 75.000 -3.85%
500.perlbench_r (max) (percentage) 0.580 -
502.gcc_r 33.000 -
502.gcc_r (avg) 33.000 -
502.gcc_r (avg) (percentage) 0.370 -
502.gcc_r (max) 54.000 -1.82%
502.gcc_r (max) (percentage) 0.600 -1.64%
503.bwaves_r 61.000 -
503.bwaves_r (avg) 61.000 -
503.bwaves_r (avg) (percentage) 0.280 -
503.bwaves_r (max) 336.000 -4.82%
503.bwaves_r (max) (percentage) 1.540 -4.94%
503.bwaves_r (unexplained diff vs previous) 39.000 3800.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.180 -
505.mcf_r 39.000 2.63%
505.mcf_r (avg) 39.000 2.63%
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 122.000 335.71%
505.mcf_r (max) (percentage) 0.900 328.57%
505.mcf_r (unexplained diff vs previous) 124.000 342.86%
505.mcf_r (unexplained diff vs previous) (percentage) 0.910 355.00%
507.cactuBSSN_r 110.000 -
507.cactuBSSN_r (avg) 110.000 -
507.cactuBSSN_r (avg) (percentage) 0.400 -
507.cactuBSSN_r (max) 152.000 -3.80%
507.cactuBSSN_r (max) (percentage) 0.550 -5.17%
508.namd_r 18.000 -5.26%
508.namd_r (avg) 18.000 -5.26%
508.namd_r (avg) (percentage) 0.190 -5.00%
508.namd_r (max) 29.000 -6.45%
508.namd_r (max) (percentage) 0.300 -6.25%
508.namd_r (unexplained diff vs previous) 6.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.060 -
510.parest_r 24.000 -
510.parest_r (avg) 24.000 -
510.parest_r (avg) (percentage) 0.120 -
510.parest_r (max) 47.000 67.86%
510.parest_r (max) (percentage) 0.230 64.29%
510.parest_r (unexplained diff vs previous) 47.000 88.00%
510.parest_r (unexplained diff vs previous) (percentage) 0.230 91.67%
511.povray_r 59.000 -
511.povray_r (avg) 59.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 57.000 -3.39%
511.povray_r (max) (percentage) 0.280 -
519.lbm_r 52.000 -
519.lbm_r (avg) 52.000 -
519.lbm_r (avg) (percentage) 0.310 -
519.lbm_r (max) 68.000 44.68%
519.lbm_r (max) (percentage) 0.400 42.86%
519.lbm_r (unexplained diff vs previous) 68.000 44.68%
519.lbm_r (unexplained diff vs previous) (percentage) 0.400 42.86%
520.omnetpp_r 120.000 -1.64%
520.omnetpp_r (avg) 120.000 -1.64%
520.omnetpp_r (avg) (percentage) 1.110 -
520.omnetpp_r (max) 114.000 -12.31%
520.omnetpp_r (max) (percentage) 1.050 -12.50%
520.omnetpp_r (unexplained diff vs previous) 41.000 -68.94%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.380 -68.60%
521.wrf_r 85.000 -
521.wrf_r (avg) 85.000 -
521.wrf_r (avg) (percentage) 0.510 -
521.wrf_r (max) 149.000 -43.35%
521.wrf_r (max) (percentage) 0.890 -43.31%
521.wrf_r (unexplained diff vs previous) 64.000 -25.58%
521.wrf_r (unexplained diff vs previous) (percentage) 0.380 -25.49%
523.xalancbmk_r 72.000 -
523.xalancbmk_r (avg) 72.000 -
523.xalancbmk_r (avg) (percentage) 0.710 -
523.xalancbmk_r (max) 269.000 -1.10%
523.xalancbmk_r (max) (percentage) 2.640 -1.12%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 35.000 -
525.x264_r (max) (percentage) 0.250 -
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 38.000 -2.56%
526.blender_r (max) (percentage) 0.360 -
531.deepsjeng_r 79.000 3.95%
531.deepsjeng_r (avg) 79.000 3.95%
531.deepsjeng_r (avg) (percentage) 0.710 2.90%
531.deepsjeng_r (max) 165.000 41.03%
531.deepsjeng_r (max) (percentage) 1.470 38.68%
531.deepsjeng_r (unexplained diff vs previous) 163.000 52.34%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1.450 49.48%
538.imagick_r 42.000 2.44%
538.imagick_r (avg) 42.000 2.44%
538.imagick_r (avg) (percentage) 0.280 -
538.imagick_r (max) 40.000 -2.44%
538.imagick_r (max) (percentage) 0.270 -3.57%
541.leela_r 31.000 -
541.leela_r (avg) 31.000 -
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 51.000 -3.77%
541.leela_r (max) (percentage) 0.430 -2.27%
544.nab_r 40.000 -2.44%
544.nab_r (avg) 40.000 -2.44%
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 55.000 -5.17%
544.nab_r (max) (percentage) 0.490 -3.92%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 20.000 -9.09%
549.fotonik3d_r (avg) 20.000 -9.09%
549.fotonik3d_r (avg) (percentage) 0.110 -
549.fotonik3d_r (max) 22.000 -26.67%
549.fotonik3d_r (max) (percentage) 0.120 -25.00%
549.fotonik3d_r (unexplained diff vs previous) 12.000 -60.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.060 -62.50%
554.roms_r 57.000 -3.39%
554.roms_r (avg) 57.000 -3.39%
554.roms_r (avg) (percentage) 0.270 -3.57%
554.roms_r (max) 263.000 -2.59%
554.roms_r (max) (percentage) 1.240 -2.36%
554.roms_r (unexplained diff vs previous) 22.000 340.00%
554.roms_r (unexplained diff vs previous) (percentage) 0.100 400.00%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 23.000 -4.17%
557.xz_r (max) (percentage) 0.230 -
557.xz_r (unexplained diff vs previous) 14.000 1300.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.140 1300.00%
Geometric Mean 5.968 36.33%