Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e0f07df069aa122449303595747fe336ca870797 (+ 44 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (9cc6cfdca980a508f72865830a09b353140e738e) (+ 76 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=abc2e954af77f8d10f4f54754520814590e79830 (+ 45 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/339/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0339 (3-changed-components) 2025-06-14T20:00:00 0:00:00
Previous 0336 (basepoints/gcc-16-01402-g0005b1e5771) 2025-06-08T23:30:41 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 26 31
Performance Improvements 47 9
Added Tests 14 107
Unchanged Tests 849 789
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.40% 27280.000 27663.000 - 5.56% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) (percentage) 309.09% 0.220 0.900 - 0.00% -
505.mcf_r (max) 306.67% 30.000 122.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 195.65% 23.000 68.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 185.71% 0.140 0.400 - 0.00% -
519.lbm_r (max) 74.36% 39.000 68.000 - 0.00% -
519.lbm_r (max) (percentage) 73.91% 0.230 0.400 - 0.00% -
510.parest_r (max) (percentage) 43.75% 0.160 0.230 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) 43.75% 0.160 0.230 - 0.00% -
510.parest_r (max) 42.42% 33.000 47.000 - 0.00% -
510.parest_r (unexplained diff vs previous) 42.42% 33.000 47.000 - 0.00% -
549.fotonik3d_r (max) 37.50% 16.000 22.000 - 0.00% -
531.deepsjeng_r (max) 36.36% 121.000 165.000 - 0.00% -
531.deepsjeng_r (max) (percentage) 34.86% 1.090 1.470 - 0.00% -
549.fotonik3d_r (max) (percentage) 33.33% 0.090 0.120 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) 20.00% 10.000 12.000 - 0.00% -
511.povray_r (max) 9.62% 52.000 57.000 - 0.00% -
511.povray_r (max) (percentage) 7.69% 0.260 0.280 - 0.00% -
541.leela_r (avg) (percentage) 4.00% 0.250 0.260 - 0.00% -
541.leela_r 3.33% 30.000 31.000 - 0.00% -
541.leela_r (avg) 3.33% 30.000 31.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 2.90% 0.690 0.710 - 0.00% -
505.mcf_r 2.63% 38.000 39.000 - 0.00% -
505.mcf_r (avg) 2.63% 38.000 39.000 - 0.00% -
531.deepsjeng_r 2.60% 77.000 79.000 - 0.00% -
531.deepsjeng_r (avg) 2.60% 77.000 79.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.43% 13411.000 13085.000 - 0.58% -
520.omnetpp_r -1.57% 11046.000 10873.000 - -5.21% -
544.nab_r -1.16% 11363.000 11231.000 - -12.94% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -73.03% 152.000 41.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -72.46% 1.380 0.380 - 0.00% -
521.wrf_r (max) -45.62% 274.000 149.000 - 0.00% -
521.wrf_r (max) (percentage) -45.40% 1.630 0.890 - 0.00% -
508.namd_r (max) -30.95% 42.000 29.000 - 0.00% -
508.namd_r (max) (percentage) -30.23% 0.430 0.300 - 0.00% -
520.omnetpp_r (max) -25.97% 154.000 114.000 - 0.00% -
520.omnetpp_r (max) (percentage) -25.00% 1.400 1.050 - 0.00% -
507.cactuBSSN_r (max) (percentage) -20.29% 0.690 0.550 - 0.00% -
507.cactuBSSN_r (max) -19.15% 188.000 152.000 - 0.00% -
544.nab_r (max) -11.29% 62.000 55.000 - 0.00% -
538.imagick_r (max) -11.11% 45.000 40.000 - 0.00% -
503.bwaves_r (max) (percentage) -10.98% 1.730 1.540 - 0.00% -
544.nab_r (max) (percentage) -10.91% 0.550 0.490 - 0.00% -
503.bwaves_r (max) -10.88% 377.000 336.000 - 0.00% -
538.imagick_r (max) (percentage) -10.00% 0.300 0.270 - 0.00% -
557.xz_r (max) -8.00% 25.000 23.000 - 0.00% -
557.xz_r (max) (percentage) -8.00% 0.250 0.230 - 0.00% -
541.leela_r (max) -5.56% 54.000 51.000 - 0.00% -
554.roms_r (max) -5.40% 278.000 263.000 - 0.00% -
554.roms_r (max) (percentage) -5.34% 1.310 1.240 - 0.00% -
508.namd_r -5.26% 19.000 18.000 - 0.00% -
508.namd_r (avg) -5.26% 19.000 18.000 - 0.00% -
508.namd_r (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
526.blender_r (max) -5.00% 40.000 38.000 - 0.00% -
541.leela_r (max) (percentage) -4.44% 0.450 0.430 - 0.00% -
525.x264_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
554.roms_r (avg) (percentage) -3.57% 0.280 0.270 - 0.00% -
502.gcc_r (max) -3.57% 56.000 54.000 - 0.00% -
554.roms_r -3.39% 59.000 57.000 - 0.00% -
554.roms_r (avg) -3.39% 59.000 57.000 - 0.00% -
502.gcc_r (max) (percentage) -3.23% 0.620 0.600 - 0.00% -
500.perlbench_r -2.94% 68.000 66.000 - 0.00% -
500.perlbench_r (avg) -2.94% 68.000 66.000 - 0.00% -
523.xalancbmk_r (max) -2.89% 277.000 269.000 - 0.00% -
525.x264_r (max) -2.78% 36.000 35.000 - 0.00% -
526.blender_r (max) (percentage) -2.70% 0.370 0.360 - 0.00% -
500.perlbench_r (max) -2.60% 77.000 75.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.58% 2.710 2.640 - 0.00% -
520.omnetpp_r -2.44% 123.000 120.000 - 0.00% -
520.omnetpp_r (avg) -2.44% 123.000 120.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) -1.39% 0.720 0.710 - 0.00% -
523.xalancbmk_r -1.37% 73.000 72.000 - 0.00% -
523.xalancbmk_r (avg) -1.37% 73.000 72.000 - 0.00% -

Added Tests - sample variability
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
521.wrf_r (unexplained diff vs previous)
521.wrf_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
554.roms_r (unexplained diff vs previous)
554.roms_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 12.77% 28615.000 32270.000 - 0.00% -
541.leela_r 8.68% 126444.000 137424.000 - 0.02% -
510.parest_r 8.67% 6402190.000 6957060.000 - -0.02% -
507.cactuBSSN_r 6.63% 3793035.000 4044402.000 - 0.15% -
526.blender_r 6.45% 7841603.000 8347669.000 - 0.02% -
520.omnetpp_r 6.28% 1579795.000 1678974.000 - -0.03% -
557.xz_r 6.26% 171382.000 182118.000 - 0.00% -
521.wrf_r 5.24% 18630170.000 19605509.000 - -0.00% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
502.gcc_r 4.54% 8093137.000 8460403.000 - -0.00% -
523.xalancbmk_r 4.33% 3639697.000 3797378.000 - 0.00% -
500.perlbench_r 4.03% 1879803.000 1955482.000 - -0.03% -
508.namd_r 3.72% 643020.000 666931.000 - 0.00% -
544.nab_r 3.70% 149498.000 155030.000 - -0.05% -
505.mcf_r 2.72% 24877.000 25553.000 - 0.00% -
511.povray_r 2.70% 771450.000 792248.000 - 0.00% -
525.x264_r 2.69% 438558.000 450353.000 - -0.05% -
531.deepsjeng_r 2.45% 90159.000 92369.000 - 0.00% -
538.imagick_r 2.13% 1669137.000 1704647.000 - 0.01% -
527.cam4_r 1.86% 15743687.000 16036963.000 - 0.00% -
554.roms_r 1.82% 691655.000 704249.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 12.77% 18060.000 20367.000 - 0.06% -
507.cactuBSSN_r 5.56% 26205.000 27663.000 - 1.40% -
554.roms_r 3.86% 20494.000 21286.000 - 0.08% -
523.xalancbmk_r 1.99% 10004.000 10203.000 - -0.22% -
549.fotonik3d_r 1.88% 18451.000 18798.000 - 0.10% -
505.mcf_r 1.32% 13471.000 13649.000 - -0.70% -
519.lbm_r 1.09% 16818.000 17002.000 - -0.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.94% 12900.000 11231.000 - -1.16% -
541.leela_r -6.59% 12835.000 11989.000 - -0.93% -
557.xz_r -5.65% 10659.000 10057.000 - 0.13% -
520.omnetpp_r -5.21% 11471.000 10873.000 - -1.57% -
503.bwaves_r -4.59% 22913.000 21862.000 - 0.18% -
538.imagick_r -2.69% 15456.000 15041.000 - 0.15% -
526.blender_r -2.25% 11021.000 10773.000 - -0.76% -
525.x264_r -1.63% 14337.000 14103.000 - 0.06% -
502.gcc_r -1.21% 9245.000 9133.000 - 0.74% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13085.000 -2.43%
502.gcc_r 9133.000 -
503.bwaves_r 21862.000 -
505.mcf_r 13649.000 -
507.cactuBSSN_r 27663.000 1.40%
508.namd_r 9874.000 -
510.parest_r 20738.000 -
511.povray_r 20367.000 -
519.lbm_r 17002.000 -
520.omnetpp_r 10873.000 -1.57%
521.wrf_r 16832.000 -
523.xalancbmk_r 10203.000 -
525.x264_r 14103.000 -
526.blender_r 10773.000 -
527.cam4_r 10723.000 -
531.deepsjeng_r 11229.000 -
538.imagick_r 15041.000 -
541.leela_r 11989.000 -
544.nab_r 11231.000 -1.16%
549.fotonik3d_r 18798.000 -
554.roms_r 21286.000 -
557.xz_r 10057.000 -
Geometric Mean 14109.765 -
Name Current %
500.perlbench_r 1955482.000 -
502.gcc_r 8460403.000 -
503.bwaves_r 32270.000 -
505.mcf_r 25553.000 -
507.cactuBSSN_r 4044402.000 -
508.namd_r 666931.000 -
510.parest_r 6957060.000 -
511.povray_r 792248.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1678974.000 -
521.wrf_r 19605509.000 -
523.xalancbmk_r 3797378.000 -
525.x264_r 450353.000 -
526.blender_r 8347669.000 -
527.cam4_r 16036963.000 -
531.deepsjeng_r 92369.000 -
538.imagick_r 1704647.000 -
541.leela_r 137424.000 -
544.nab_r 155030.000 -
549.fotonik3d_r 331818.000 -
554.roms_r 704249.000 -
557.xz_r 182118.000 -
Geometric Mean 768269.018 -
Name Current %
500.perlbench_r 66.000 -2.94%
500.perlbench_r (avg) 66.000 -2.94%
500.perlbench_r (avg) (percentage) 0.510 -
500.perlbench_r (max) 75.000 -2.60%
500.perlbench_r (max) (percentage) 0.580 -
502.gcc_r 33.000 -
502.gcc_r (avg) 33.000 -
502.gcc_r (avg) (percentage) 0.370 -
502.gcc_r (max) 54.000 -3.57%
502.gcc_r (max) (percentage) 0.600 -3.23%
503.bwaves_r 61.000 -
503.bwaves_r (avg) 61.000 -
503.bwaves_r (avg) (percentage) 0.280 -
503.bwaves_r (max) 336.000 -10.88%
503.bwaves_r (max) (percentage) 1.540 -10.98%
503.bwaves_r (unexplained diff vs previous) 39.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.180 -
505.mcf_r 39.000 2.63%
505.mcf_r (avg) 39.000 2.63%
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 122.000 306.67%
505.mcf_r (max) (percentage) 0.900 309.09%
505.mcf_r (unexplained diff vs previous) 124.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.910 -
507.cactuBSSN_r 110.000 -
507.cactuBSSN_r (avg) 110.000 -
507.cactuBSSN_r (avg) (percentage) 0.400 -
507.cactuBSSN_r (max) 152.000 -19.15%
507.cactuBSSN_r (max) (percentage) 0.550 -20.29%
508.namd_r 18.000 -5.26%
508.namd_r (avg) 18.000 -5.26%
508.namd_r (avg) (percentage) 0.190 -5.00%
508.namd_r (max) 29.000 -30.95%
508.namd_r (max) (percentage) 0.300 -30.23%
508.namd_r (unexplained diff vs previous) 6.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.060 -
510.parest_r 24.000 -
510.parest_r (avg) 24.000 -
510.parest_r (avg) (percentage) 0.120 -
510.parest_r (max) 47.000 42.42%
510.parest_r (max) (percentage) 0.230 43.75%
510.parest_r (unexplained diff vs previous) 47.000 42.42%
510.parest_r (unexplained diff vs previous) (percentage) 0.230 43.75%
511.povray_r 59.000 -
511.povray_r (avg) 59.000 -
511.povray_r (avg) (percentage) 0.290 -
511.povray_r (max) 57.000 9.62%
511.povray_r (max) (percentage) 0.280 7.69%
519.lbm_r 52.000 -
519.lbm_r (avg) 52.000 -
519.lbm_r (avg) (percentage) 0.310 -
519.lbm_r (max) 68.000 74.36%
519.lbm_r (max) (percentage) 0.400 73.91%
519.lbm_r (unexplained diff vs previous) 68.000 195.65%
519.lbm_r (unexplained diff vs previous) (percentage) 0.400 185.71%
520.omnetpp_r 120.000 -2.44%
520.omnetpp_r (avg) 120.000 -2.44%
520.omnetpp_r (avg) (percentage) 1.110 -
520.omnetpp_r (max) 114.000 -25.97%
520.omnetpp_r (max) (percentage) 1.050 -25.00%
520.omnetpp_r (unexplained diff vs previous) 41.000 -73.03%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.380 -72.46%
521.wrf_r 85.000 -
521.wrf_r (avg) 85.000 -
521.wrf_r (avg) (percentage) 0.510 -
521.wrf_r (max) 149.000 -45.62%
521.wrf_r (max) (percentage) 0.890 -45.40%
521.wrf_r (unexplained diff vs previous) 64.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.380 -
523.xalancbmk_r 72.000 -1.37%
523.xalancbmk_r (avg) 72.000 -1.37%
523.xalancbmk_r (avg) (percentage) 0.710 -1.39%
523.xalancbmk_r (max) 269.000 -2.89%
523.xalancbmk_r (max) (percentage) 2.640 -2.58%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 35.000 -2.78%
525.x264_r (max) (percentage) 0.250 -3.85%
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 38.000 -5.00%
526.blender_r (max) (percentage) 0.360 -2.70%
531.deepsjeng_r 79.000 2.60%
531.deepsjeng_r (avg) 79.000 2.60%
531.deepsjeng_r (avg) (percentage) 0.710 2.90%
531.deepsjeng_r (max) 165.000 36.36%
531.deepsjeng_r (max) (percentage) 1.470 34.86%
531.deepsjeng_r (unexplained diff vs previous) 163.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1.450 -
538.imagick_r 42.000 -
538.imagick_r (avg) 42.000 -
538.imagick_r (avg) (percentage) 0.280 -
538.imagick_r (max) 40.000 -11.11%
538.imagick_r (max) (percentage) 0.270 -10.00%
541.leela_r 31.000 3.33%
541.leela_r (avg) 31.000 3.33%
541.leela_r (avg) (percentage) 0.260 4.00%
541.leela_r (max) 51.000 -5.56%
541.leela_r (max) (percentage) 0.430 -4.44%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 55.000 -11.29%
544.nab_r (max) (percentage) 0.490 -10.91%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 20.000 -
549.fotonik3d_r (avg) 20.000 -
549.fotonik3d_r (avg) (percentage) 0.110 -
549.fotonik3d_r (max) 22.000 37.50%
549.fotonik3d_r (max) (percentage) 0.120 33.33%
549.fotonik3d_r (unexplained diff vs previous) 12.000 20.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.060 -
554.roms_r 57.000 -3.39%
554.roms_r (avg) 57.000 -3.39%
554.roms_r (avg) (percentage) 0.270 -3.57%
554.roms_r (max) 263.000 -5.40%
554.roms_r (max) (percentage) 1.240 -5.34%
554.roms_r (unexplained diff vs previous) 22.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.100 -
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 23.000 -8.00%
557.xz_r (max) (percentage) 0.230 -8.00%
557.xz_r (unexplained diff vs previous) 14.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.140 -
Geometric Mean 5.968 -6.02%