Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=b381c2381c5b069c3f2e969334368c4d4fdf25be (+ 108 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (c77d04506e6abdc45969d0ff146204be7485244a) (+ 245 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=59f64a1f4f3bbe2bcaf8fc1951b94e1d0e7d307e (+ 15 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (+ 551 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3-build/378/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0378 (4-changed-components) 2025-04-27T09:51:24 0:00:00
Previous 0377 (basepoints/gcc-16-00117-g2056d52d740) 2025-04-22T02:30:28 0:00:00
Baseline 0090 (4-changed-components) 2023-10-17T12:24:51 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 17
Performance Improvements 51 16
Added Tests 0 107
Unchanged Tests 875 796
Total Tests 936

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r 1.74% 30518.000 31050.000 - 0.11% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r 1.26% 11024.000 11163.000 - 2.42% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 616.67% 6.000 43.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 525.00% 0.040 0.250 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 3.09% 0.970 1.000 - 0.00% -
505.mcf_r 2.38% 42.000 43.000 - 0.00% -
505.mcf_r (avg) 2.38% 42.000 43.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 1.94% 103.000 105.000 - 0.00% -
507.cactuBSSN_r 1.23% 81.000 82.000 - 0.00% -
507.cactuBSSN_r (avg) 1.23% 81.000 82.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -4.54% 14147.000 13505.000 - 2.13% -
549.fotonik3d_r -2.50% 18929.000 18455.000 - -0.71% -
531.deepsjeng_r -1.08% 12502.000 12367.000 - 0.27% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (max) -11.54% 26.000 23.000 - 0.00% -
526.blender_r (max) -11.11% 27.000 24.000 - 0.00% -
526.blender_r (max) (percentage) -8.00% 0.250 0.230 - 0.00% -
554.roms_r (max) -7.79% 77.000 71.000 - 0.00% -
500.perlbench_r (max) -7.74% 168.000 155.000 - 0.00% -
557.xz_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
557.xz_r (max) -7.69% 13.000 12.000 - 0.00% -
519.lbm_r (max) (percentage) -7.32% 0.410 0.380 - 0.00% -
519.lbm_r (max) -7.25% 69.000 64.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
554.roms_r (max) (percentage) -7.14% 0.420 0.390 - 0.00% -
505.mcf_r (max) (percentage) -6.67% 0.450 0.420 - 0.00% -
505.mcf_r (max) -6.67% 60.000 56.000 - 0.00% -
521.wrf_r (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
521.wrf_r (max) -6.00% 50.000 47.000 - 0.00% -
508.namd_r (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
508.namd_r (max) -5.88% 17.000 16.000 - 0.00% -
541.leela_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
541.leela_r (max) -4.88% 41.000 39.000 - 0.00% -
538.imagick_r (max) -4.69% 64.000 61.000 - 0.00% -
500.perlbench_r -4.48% 67.000 64.000 - 0.00% -
500.perlbench_r (avg) -4.48% 67.000 64.000 - 0.00% -
538.imagick_r (max) (percentage) -4.44% 0.450 0.430 - 0.00% -
503.bwaves_r (max) -3.80% 79.000 76.000 - 0.00% -
511.povray_r (max) -3.77% 106.000 102.000 - 0.00% -
544.nab_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
502.gcc_r (max) -3.64% 55.000 53.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.39% 0.590 0.570 - 0.00% -
500.perlbench_r (max) (percentage) -3.36% 1.190 1.150 - 0.00% -
511.povray_r (max) (percentage) -3.33% 0.600 0.580 - 0.00% -
544.nab_r (max) -3.33% 30.000 29.000 - 0.00% -
502.gcc_r (max) (percentage) -3.17% 0.630 0.610 - 0.00% -
510.parest_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
531.deepsjeng_r (max) -3.09% 162.000 157.000 - 0.00% -
510.parest_r (max) -3.08% 65.000 63.000 - 0.00% -
503.bwaves_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
507.cactuBSSN_r (max) -2.38% 126.000 123.000 - 0.00% -
523.xalancbmk_r (max) -2.31% 173.000 169.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.31% 1.300 1.270 - 0.00% -
520.omnetpp_r (max) -1.92% 156.000 153.000 - 0.00% -
531.deepsjeng_r -1.75% 57.000 56.000 - 0.00% -
531.deepsjeng_r (avg) -1.75% 57.000 56.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.73% 1.730 1.700 - 0.00% -
523.xalancbmk_r -1.47% 68.000 67.000 - 0.00% -
523.xalancbmk_r (avg) -1.47% 68.000 67.000 - 0.00% -
520.omnetpp_r (max) (percentage) -1.35% 1.480 1.460 - 0.00% -
520.omnetpp_r -1.08% 93.000 92.000 - 0.00% -
520.omnetpp_r (avg) -1.08% 93.000 92.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 5.79% 1790858.000 1894503.000 - -0.01% -
557.xz_r 3.97% 187986.000 195454.000 - -0.07% -
526.blender_r 3.97% 9337120.000 9707681.000 - 0.10% -
519.lbm_r 3.14% 14506.000 14961.000 - 0.00% -
500.perlbench_r 2.63% 2202396.000 2260358.000 - 0.01% -
502.gcc_r 2.05% 9267975.000 9458347.000 - 0.10% -
523.xalancbmk_r 1.23% 4933438.000 4993906.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 8.62% 15712.000 17066.000 - 0.25% -
554.roms_r 7.71% 17061.000 18376.000 - 0.14% -
508.namd_r 5.17% 9729.000 10232.000 - 0.06% -
525.x264_r 2.42% 10899.000 11163.000 - 1.26% -
500.perlbench_r 2.13% 13223.000 13505.000 - -4.54% -
538.imagick_r 1.21% 14189.000 14361.000 - -0.12% -
523.xalancbmk_r 1.06% 9869.000 9974.000 - -0.29% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -24.24% 27033273.000 20481497.000 - -0.15% -
554.roms_r -14.26% 1086498.000 931517.000 - 0.04% -
505.mcf_r -13.79% 35989.000 31025.000 - -0.10% -
549.fotonik3d_r -11.86% 404732.000 356730.000 - 0.04% -
508.namd_r -10.42% 905308.000 810964.000 - 0.05% -
510.parest_r -6.22% 8367039.000 7846827.000 - 0.13% -
507.cactuBSSN_r -4.72% 4949254.000 4715807.000 - 0.13% -
527.cam4_r -4.13% 17243586.000 16531579.000 - 0.03% -
531.deepsjeng_r -1.65% 108133.000 106349.000 - 0.25% -
544.nab_r -1.06% 202246.000 200110.000 - -0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -5.36% 11805.000 11172.000 - -0.43% -
510.parest_r -5.36% 21507.000 20354.000 - 0.05% -
503.bwaves_r -4.43% 22981.000 21962.000 - -0.04% -
557.xz_r -3.98% 10495.000 10077.000 - 0.13% -
541.leela_r -2.07% 11161.000 10930.000 - 0.49% -
507.cactuBSSN_r -1.51% 21928.000 21597.000 - 0.47% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13505.000 -4.54%
502.gcc_r 8811.000 -
503.bwaves_r 21962.000 -
505.mcf_r 13473.000 -
507.cactuBSSN_r 21597.000 -
508.namd_r 10232.000 -
510.parest_r 20354.000 -
511.povray_r 17618.000 -
519.lbm_r 17066.000 -
520.omnetpp_r 10492.000 -
521.wrf_r 16454.000 -
523.xalancbmk_r 9974.000 -
525.x264_r 11163.000 1.26%
526.blender_r 10796.000 -
527.cam4_r 9919.000 -
531.deepsjeng_r 12367.000 -1.08%
538.imagick_r 14361.000 -
541.leela_r 10930.000 -
544.nab_r 11172.000 -
549.fotonik3d_r 18455.000 -2.50%
554.roms_r 18376.000 -
557.xz_r 10077.000 -
Geometric Mean 13491.260 -
Name Current %
500.perlbench_r 2260358.000 -
502.gcc_r 9458347.000 -
503.bwaves_r 31050.000 1.74%
505.mcf_r 31025.000 -
507.cactuBSSN_r 4715807.000 -
508.namd_r 810964.000 -
510.parest_r 7846827.000 -
511.povray_r 973908.000 -
519.lbm_r 14961.000 -
520.omnetpp_r 1894503.000 -
521.wrf_r 20481497.000 -
523.xalancbmk_r 4993906.000 -
525.x264_r 590824.000 -
526.blender_r 9707681.000 -
527.cam4_r 16531579.000 -
531.deepsjeng_r 106349.000 -
538.imagick_r 1976467.000 -
541.leela_r 185026.000 -
544.nab_r 200110.000 -
549.fotonik3d_r 356730.000 -
554.roms_r 931517.000 -
557.xz_r 195454.000 -
Geometric Mean 893341.100 -
Name Current %
500.perlbench_r 64.000 -4.48%
500.perlbench_r (avg) 64.000 -4.48%
500.perlbench_r (avg) (percentage) 0.480 -
500.perlbench_r (max) 155.000 -7.74%
500.perlbench_r (max) (percentage) 1.150 -3.36%
502.gcc_r 30.000 -
502.gcc_r (avg) 30.000 -
502.gcc_r (avg) (percentage) 0.350 -
502.gcc_r (max) 53.000 -3.64%
502.gcc_r (max) (percentage) 0.610 -3.17%
503.bwaves_r 57.000 -
503.bwaves_r (avg) 57.000 -
503.bwaves_r (avg) (percentage) 0.260 -
503.bwaves_r (max) 76.000 -3.80%
503.bwaves_r (max) (percentage) 0.350 -2.78%
505.mcf_r 43.000 2.38%
505.mcf_r (avg) 43.000 2.38%
505.mcf_r (avg) (percentage) 0.320 -
505.mcf_r (max) 56.000 -6.67%
505.mcf_r (max) (percentage) 0.420 -6.67%
507.cactuBSSN_r 82.000 1.23%
507.cactuBSSN_r (avg) 82.000 1.23%
507.cactuBSSN_r (avg) (percentage) 0.380 -
507.cactuBSSN_r (max) 123.000 -2.38%
507.cactuBSSN_r (max) (percentage) 0.570 -3.39%
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.220 -
508.namd_r (max) 16.000 -5.88%
508.namd_r (max) (percentage) 0.160 -5.88%
510.parest_r 26.000 -
510.parest_r (avg) 26.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 63.000 -3.08%
510.parest_r (max) (percentage) 0.310 -3.13%
511.povray_r 58.000 -
511.povray_r (avg) 58.000 -
511.povray_r (avg) (percentage) 0.330 -
511.povray_r (max) 102.000 -3.77%
511.povray_r (max) (percentage) 0.580 -3.33%
519.lbm_r 80.000 -
519.lbm_r (avg) 80.000 -
519.lbm_r (avg) (percentage) 0.470 -
519.lbm_r (max) 64.000 -7.25%
519.lbm_r (max) (percentage) 0.380 -7.32%
519.lbm_r (unexplained diff vs previous) 43.000 616.67%
519.lbm_r (unexplained diff vs previous) (percentage) 0.250 525.00%
520.omnetpp_r 92.000 -1.08%
520.omnetpp_r (avg) 92.000 -1.08%
520.omnetpp_r (avg) (percentage) 0.880 -
520.omnetpp_r (max) 153.000 -1.92%
520.omnetpp_r (max) (percentage) 1.460 -1.35%
520.omnetpp_r (unexplained diff vs previous) 105.000 1.94%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.000 3.09%
521.wrf_r 75.000 -
521.wrf_r (avg) 75.000 -
521.wrf_r (avg) (percentage) 0.460 -
521.wrf_r (max) 47.000 -6.00%
521.wrf_r (max) (percentage) 0.290 -6.45%
523.xalancbmk_r 67.000 -1.47%
523.xalancbmk_r (avg) 67.000 -1.47%
523.xalancbmk_r (avg) (percentage) 0.680 -
523.xalancbmk_r (max) 169.000 -2.31%
523.xalancbmk_r (max) (percentage) 1.700 -1.73%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 37.000 -
525.x264_r (max) (percentage) 0.340 -
526.blender_r 35.000 -
526.blender_r (avg) 35.000 -
526.blender_r (avg) (percentage) 0.330 -
526.blender_r (max) 24.000 -11.11%
526.blender_r (max) (percentage) 0.230 -8.00%
531.deepsjeng_r 56.000 -1.75%
531.deepsjeng_r (avg) 56.000 -1.75%
531.deepsjeng_r (avg) (percentage) 0.460 -
531.deepsjeng_r (max) 157.000 -3.09%
531.deepsjeng_r (max) (percentage) 1.270 -2.31%
538.imagick_r 44.000 -
538.imagick_r (avg) 44.000 -
538.imagick_r (avg) (percentage) 0.310 -
538.imagick_r (max) 61.000 -4.69%
538.imagick_r (max) (percentage) 0.430 -4.44%
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.270 -
541.leela_r (max) 39.000 -4.88%
541.leela_r (max) (percentage) 0.360 -5.26%
544.nab_r 44.000 -
544.nab_r (avg) 44.000 -
544.nab_r (avg) (percentage) 0.400 -
544.nab_r (max) 29.000 -3.33%
544.nab_r (max) (percentage) 0.260 -3.70%
548.exchange2_r (avg) (percentage) 0.300 -
548.exchange2_r (max) (percentage) 0.230 -
549.fotonik3d_r 35.000 -
549.fotonik3d_r (avg) 35.000 -
549.fotonik3d_r (avg) (percentage) 0.190 -
549.fotonik3d_r (max) 23.000 -11.54%
549.fotonik3d_r (max) (percentage) 0.130 -7.14%
554.roms_r 49.000 -
554.roms_r (avg) 49.000 -
554.roms_r (avg) (percentage) 0.270 -
554.roms_r (max) 71.000 -7.79%
554.roms_r (max) (percentage) 0.390 -7.14%
557.xz_r 14.000 -
557.xz_r (avg) 14.000 -
557.xz_r (avg) (percentage) 0.140 -
557.xz_r (max) 12.000 -7.69%
557.xz_r (max) (percentage) 0.120 -7.69%
Geometric Mean 6.313 1.50%