Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=614806c7c2a3978211f65c13f30b5a90ee9e814d (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (85e4f21f9e90fc70b8c7c75ec8e4d0766008ac6e) (+ 185 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f176bf2a06b458dea8186fb2ff3bb8ea24da6d67 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/318/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0318 (basepoints/gcc-16-00302-g85e4f21f9e9) 2025-05-06T11:32:14 0:00:00
Previous 0316 (3-changed-components) 2025-04-29T23:04:19 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 30
Performance Improvements 46 10
Added Tests 0 107
Unchanged Tests 880 789
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 1.83% 17486.000 17806.000 - -1.41% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 491.43% 0.350 2.070 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 484.21% 38.000 222.000 - 0.00% -
520.omnetpp_r (max) (percentage) 5.18% 1.930 2.030 - 0.00% -
520.omnetpp_r (max) 3.33% 210.000 217.000 - 0.00% -
511.povray_r 1.92% 52.000 53.000 - 0.00% -
511.povray_r (avg) 1.92% 52.000 53.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.75% 1.140 1.160 - 0.00% -
500.perlbench_r 1.47% 68.000 69.000 - 0.00% -
500.perlbench_r (avg) 1.47% 68.000 69.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -2.03% 10922.000 10700.000 - -6.72% -
531.deepsjeng_r -1.75% 11347.000 11148.000 - 0.06% -
523.xalancbmk_r -1.29% 10515.000 10379.000 - 3.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -74.17% 1.200 0.310 - 0.00% -
519.lbm_r (unexplained diff vs previous) -74.15% 205.000 53.000 - 0.00% -
508.namd_r (max) -16.67% 12.000 10.000 - 0.00% -
508.namd_r (max) (percentage) -15.38% 0.130 0.110 - 0.00% -
519.lbm_r (max) (percentage) -12.30% 1.220 1.070 - 0.00% -
531.deepsjeng_r (max) -12.20% 41.000 36.000 - 0.00% -
519.lbm_r (max) -12.02% 208.000 183.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -10.81% 0.370 0.330 - 0.00% -
507.cactuBSSN_r (max) (percentage) -9.09% 0.330 0.300 - 0.00% -
507.cactuBSSN_r (max) -8.79% 91.000 83.000 - 0.00% -
505.mcf_r (max) -7.45% 94.000 87.000 - 0.00% -
505.mcf_r (max) (percentage) -7.25% 0.690 0.640 - 0.00% -
511.povray_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
503.bwaves_r (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
525.x264_r (max) -6.25% 16.000 15.000 - 0.00% -
503.bwaves_r (max) -5.97% 67.000 63.000 - 0.00% -
538.imagick_r (max) -5.33% 75.000 71.000 - 0.00% -
523.xalancbmk_r (max) -4.51% 443.000 423.000 - 0.00% -
511.povray_r (max) -4.17% 24.000 23.000 - 0.00% -
521.wrf_r (max) (percentage) -4.05% 0.740 0.710 - 0.00% -
538.imagick_r (max) (percentage) -4.00% 0.500 0.480 - 0.00% -
521.wrf_r (max) -4.00% 125.000 120.000 - 0.00% -
500.perlbench_r (max) (percentage) -3.70% 1.080 1.040 - 0.00% -
502.gcc_r (max) -3.70% 27.000 26.000 - 0.00% -
554.roms_r (max) -3.67% 463.000 446.000 - 0.00% -
541.leela_r (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
500.perlbench_r (max) -3.50% 143.000 138.000 - 0.00% -
502.gcc_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.32% 4.220 4.080 - 0.00% -
554.roms_r (max) (percentage) -3.15% 2.220 2.150 - 0.00% -
541.leela_r (max) -2.99% 67.000 65.000 - 0.00% -
544.nab_r (max) (percentage) -2.78% 0.720 0.700 - 0.00% -
544.nab_r (max) -2.47% 81.000 79.000 - 0.00% -
538.imagick_r -2.38% 42.000 41.000 - 0.00% -
538.imagick_r (avg) -2.38% 42.000 41.000 - 0.00% -
554.roms_r -2.08% 48.000 47.000 - 0.00% -
554.roms_r (avg) -2.08% 48.000 47.000 - 0.00% -
526.blender_r (max) (percentage) -1.69% 0.590 0.580 - 0.00% -
526.blender_r (max) -1.59% 63.000 62.000 - 0.00% -
523.xalancbmk_r -1.37% 73.000 72.000 - 0.00% -
523.xalancbmk_r (avg) -1.37% 73.000 72.000 - 0.00% -
531.deepsjeng_r -1.23% 81.000 80.000 - 0.00% -
531.deepsjeng_r (avg) -1.23% 81.000 80.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 9.14% 28615.000 31230.000 - 0.13% -
510.parest_r 8.40% 6402190.000 6939779.000 - 0.07% -
541.leela_r 7.15% 126444.000 135484.000 - 0.02% -
557.xz_r 6.33% 171382.000 182222.000 - 0.01% -
507.cactuBSSN_r 6.25% 3793035.000 4030270.000 - 0.45% -
526.blender_r 6.23% 7841603.000 8330229.000 - 0.02% -
520.omnetpp_r 6.11% 1579795.000 1676378.000 - -0.00% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
521.wrf_r 4.41% 18630170.000 19450857.000 - -0.05% -
523.xalancbmk_r 4.36% 3639697.000 3798498.000 - 0.01% -
502.gcc_r 4.14% 8093137.000 8428219.000 - 0.02% -
500.perlbench_r 3.99% 1879803.000 1954818.000 - 0.05% -
544.nab_r 3.82% 149498.000 155206.000 - -0.02% -
508.namd_r 3.61% 643020.000 666232.000 - 0.47% -
505.mcf_r 2.85% 24877.000 25585.000 - 0.06% -
525.x264_r 2.77% 438558.000 450721.000 - -0.04% -
511.povray_r 2.55% 771450.000 791140.000 - 0.04% -
531.deepsjeng_r 1.81% 90159.000 91793.000 - -0.06% -
554.roms_r 1.65% 691655.000 703069.000 - -0.02% -
538.imagick_r 1.50% 1669137.000 1694175.000 - 0.04% -
527.cam4_r 1.39% 15743687.000 15962067.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 5.97% 26205.000 27770.000 - 0.60% -
523.xalancbmk_r 3.75% 10004.000 10379.000 - -1.29% -
500.perlbench_r 2.71% 13010.000 13363.000 - 0.72% -
519.lbm_r 1.78% 16818.000 17117.000 - 0.31% -
505.mcf_r 1.67% 13471.000 13696.000 - 0.01% -
554.roms_r 1.35% 20494.000 20771.000 - -0.51% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.27% 12900.000 11317.000 - -0.15% -
520.omnetpp_r -6.72% 11471.000 10700.000 - -2.03% -
541.leela_r -5.81% 12835.000 12089.000 - 0.16% -
557.xz_r -5.15% 10659.000 10110.000 - 0.57% -
503.bwaves_r -4.24% 22913.000 21942.000 - 0.22% -
538.imagick_r -3.09% 15456.000 14978.000 - -0.22% -
525.x264_r -2.42% 14337.000 13990.000 - -0.11% -
526.blender_r -2.01% 11021.000 10799.000 - -0.05% -
502.gcc_r -1.77% 9245.000 9081.000 - -0.38% -
511.povray_r -1.41% 18060.000 17806.000 - 1.83% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.38s
Name Current %
500.perlbench_r 13363.000 -
502.gcc_r 9081.000 -
503.bwaves_r 21942.000 -
505.mcf_r 13696.000 -
507.cactuBSSN_r 27770.000 -
508.namd_r 9850.000 -
510.parest_r 20808.000 -
511.povray_r 17806.000 1.83%
519.lbm_r 17117.000 -
520.omnetpp_r 10700.000 -2.03%
521.wrf_r 16931.000 -
523.xalancbmk_r 10379.000 -1.29%
525.x264_r 13990.000 -
526.blender_r 10799.000 -
527.cam4_r 10744.000 -
531.deepsjeng_r 11148.000 -1.75%
538.imagick_r 14978.000 -
541.leela_r 12089.000 -
544.nab_r 11317.000 -
549.fotonik3d_r 18442.000 -
554.roms_r 20771.000 -
557.xz_r 10110.000 -
Geometric Mean 14025.968 -
Name Current %
500.perlbench_r 1954818.000 -
502.gcc_r 8428219.000 -
503.bwaves_r 31230.000 -
505.mcf_r 25585.000 -
507.cactuBSSN_r 4030270.000 -
508.namd_r 666232.000 -
510.parest_r 6939779.000 -
511.povray_r 791140.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1676378.000 -
521.wrf_r 19450857.000 -
523.xalancbmk_r 3798498.000 -
525.x264_r 450721.000 -
526.blender_r 8330229.000 -
527.cam4_r 15962067.000 -
531.deepsjeng_r 91793.000 -
538.imagick_r 1694175.000 -
541.leela_r 135484.000 -
544.nab_r 155206.000 -
549.fotonik3d_r 333354.000 -
554.roms_r 703069.000 -
557.xz_r 182222.000 -
Geometric Mean 765438.300 -
Name Current %
500.perlbench_r 69.000 1.47%
500.perlbench_r (avg) 69.000 1.47%
500.perlbench_r (avg) (percentage) 0.520 -
500.perlbench_r (max) 138.000 -3.50%
500.perlbench_r (max) (percentage) 1.040 -3.70%
502.gcc_r 32.000 -
502.gcc_r (avg) 32.000 -
502.gcc_r (avg) (percentage) 0.360 -
502.gcc_r (max) 26.000 -3.70%
502.gcc_r (max) (percentage) 0.290 -3.33%
503.bwaves_r 48.000 -
503.bwaves_r (avg) 48.000 -
503.bwaves_r (avg) (percentage) 0.220 -
503.bwaves_r (max) 63.000 -5.97%
503.bwaves_r (max) (percentage) 0.290 -6.45%
505.mcf_r 39.000 -
505.mcf_r (avg) 39.000 -
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 87.000 -7.45%
505.mcf_r (max) (percentage) 0.640 -7.25%
507.cactuBSSN_r 108.000 -
507.cactuBSSN_r (avg) 108.000 -
507.cactuBSSN_r (avg) (percentage) 0.390 -
507.cactuBSSN_r (max) 83.000 -8.79%
507.cactuBSSN_r (max) (percentage) 0.300 -9.09%
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 10.000 -16.67%
508.namd_r (max) (percentage) 0.110 -15.38%
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.110 -
510.parest_r (max) 31.000 -
510.parest_r (max) (percentage) 0.150 -
511.povray_r 53.000 1.92%
511.povray_r (avg) 53.000 1.92%
511.povray_r (avg) (percentage) 0.300 -
511.povray_r (max) 23.000 -4.17%
511.povray_r (max) (percentage) 0.130 -7.14%
519.lbm_r 54.000 -
519.lbm_r (avg) 54.000 -
519.lbm_r (avg) (percentage) 0.320 -
519.lbm_r (max) 183.000 -12.02%
519.lbm_r (max) (percentage) 1.070 -12.30%
519.lbm_r (unexplained diff vs previous) 53.000 -74.15%
519.lbm_r (unexplained diff vs previous) (percentage) 0.310 -74.17%
520.omnetpp_r 124.000 -
520.omnetpp_r (avg) 124.000 -
520.omnetpp_r (avg) (percentage) 1.160 1.75%
520.omnetpp_r (max) 217.000 3.33%
520.omnetpp_r (max) (percentage) 2.030 5.18%
520.omnetpp_r (unexplained diff vs previous) 222.000 484.21%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.070 491.43%
521.wrf_r 76.000 -
521.wrf_r (avg) 76.000 -
521.wrf_r (avg) (percentage) 0.450 -
521.wrf_r (max) 120.000 -4.00%
521.wrf_r (max) (percentage) 0.710 -4.05%
523.xalancbmk_r 72.000 -1.37%
523.xalancbmk_r (avg) 72.000 -1.37%
523.xalancbmk_r (avg) (percentage) 0.700 -
523.xalancbmk_r (max) 423.000 -4.51%
523.xalancbmk_r (max) (percentage) 4.080 -3.32%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 15.000 -6.25%
525.x264_r (max) (percentage) 0.110 -
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 62.000 -1.59%
526.blender_r (max) (percentage) 0.580 -1.69%
531.deepsjeng_r 80.000 -1.23%
531.deepsjeng_r (avg) 80.000 -1.23%
531.deepsjeng_r (avg) (percentage) 0.720 -
531.deepsjeng_r (max) 36.000 -12.20%
531.deepsjeng_r (max) (percentage) 0.330 -10.81%
538.imagick_r 41.000 -2.38%
538.imagick_r (avg) 41.000 -2.38%
538.imagick_r (avg) (percentage) 0.280 -
538.imagick_r (max) 71.000 -5.33%
538.imagick_r (max) (percentage) 0.480 -4.00%
541.leela_r 30.000 -
541.leela_r (avg) 30.000 -
541.leela_r (avg) (percentage) 0.250 -
541.leela_r (max) 65.000 -2.99%
541.leela_r (max) (percentage) 0.540 -3.57%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.360 -
544.nab_r (max) 79.000 -2.47%
544.nab_r (max) (percentage) 0.700 -2.78%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 11.000 -
549.fotonik3d_r (max) (percentage) 0.060 -
554.roms_r 47.000 -2.08%
554.roms_r (avg) 47.000 -2.08%
554.roms_r (avg) (percentage) 0.230 -
554.roms_r (max) 446.000 -3.67%
554.roms_r (max) (percentage) 2.150 -3.15%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 11.000 -
557.xz_r (max) (percentage) 0.110 -
Geometric Mean 6.289 -1.19%