Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=26dd9cb647140db87a5a530fd9f044d356e081de (+ 62 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (aa361611490947eb228e5b625a3f0f23ff647dbd) (+ 86 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=91bb902f58264a2fd50fbce8f39a9a290dd23706 (+ 16 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/eca38256279414c7c17b091434c79e3a9a8608cc (+ 187 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/279/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0279 (4-changed-components) 2025-01-16T05:04:56 0:00:00
Previous 0278 (3-changed-components) 2025-01-13T22:54:53 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 15
Performance Improvements 43 7
Added Tests 0 89
Unchanged Tests 748 687
Total Tests 798

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
527.cam4_r 1.12% 2495.000 2523.000 - 0.76% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 92.86% 14.000 27.000 - 0.00% -
519.lbm_r (max) (percentage) 91.89% 0.370 0.710 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 91.89% 0.370 0.710 - 0.00% -
519.lbm_r (max) 85.71% 14.000 26.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 11.68% 1.370 1.530 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 10.42% 48.000 53.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -2.04% 6827.000 6688.000 - -0.70% -
500.perlbench_r -1.81% 2212.000 2172.000 - 7.63% -
557.xz_r -1.61% 2424.000 2385.000 - -0.17% -
520.omnetpp_r -1.51% 3506.000 3453.000 - -2.18% -
538.imagick_r -1.42% 4294.000 4233.000 - -0.89% -
544.nab_r -1.36% 7942.000 7834.000 - -1.89% -
525.x264_r -1.17% 3665.000 3622.000 - -0.93% -
503.bwaves_r -1.11% 8935.000 8836.000 - -0.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) (percentage) -70.63% 1.260 0.370 - 0.00% -
508.namd_r (unexplained diff vs previous) -70.45% 44.000 13.000 - 0.00% -
520.omnetpp_r (max) -8.70% 69.000 63.000 - 0.00% -
508.namd_r (max) (percentage) -8.00% 1.250 1.150 - 0.00% -
538.imagick_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
508.namd_r (max) -6.98% 43.000 40.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.57% 1.980 1.850 - 0.00% -
505.mcf_r (max) -5.88% 17.000 16.000 - 0.00% -
557.xz_r (max) -5.88% 17.000 16.000 - 0.00% -
544.nab_r (max) -5.50% 109.000 103.000 - 0.00% -
500.perlbench_r (max) -5.41% 37.000 35.000 - 0.00% -
521.wrf_r (max) -5.30% 132.000 125.000 - 0.00% -
521.wrf_r (max) (percentage) -5.15% 1.360 1.290 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.82% 0.830 0.790 - 0.00% -
519.lbm_r -4.76% 21.000 20.000 - 0.00% -
519.lbm_r (avg) -4.76% 21.000 20.000 - 0.00% -
531.deepsjeng_r (max) -4.65% 43.000 41.000 - 0.00% -
544.nab_r (max) (percentage) -4.35% 1.380 1.320 - 0.00% -
503.bwaves_r (max) -4.32% 162.000 155.000 - 0.00% -
505.mcf_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
500.perlbench_r -3.70% 27.000 26.000 - 0.00% -
500.perlbench_r (avg) -3.70% 27.000 26.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.45% 0.870 0.840 - 0.00% -
527.cam4_r (max) (percentage) -3.41% 0.880 0.850 - 0.00% -
503.bwaves_r (max) (percentage) -3.30% 1.820 1.760 - 0.00% -
554.roms_r (max) -2.97% 404.000 392.000 - 0.00% -
557.xz_r (max) (percentage) -2.78% 0.720 0.700 - 0.00% -
549.fotonik3d_r (max) -2.78% 36.000 35.000 - 0.00% -
544.nab_r -2.70% 37.000 36.000 - 0.00% -
544.nab_r (avg) -2.70% 37.000 36.000 - 0.00% -
511.povray_r (max) (percentage) -2.56% 1.170 1.140 - 0.00% -
500.perlbench_r (max) (percentage) -2.37% 1.690 1.650 - 0.00% -
554.roms_r (max) (percentage) -2.33% 1.290 1.260 - 0.00% -
505.mcf_r -1.82% 55.000 54.000 - 0.00% -
505.mcf_r (avg) -1.82% 55.000 54.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r 4.51% 74603.000 77971.000 - -0.03% -
508.namd_r 2.40% 638884.000 654203.000 - 0.00% -
521.wrf_r 2.32% 14837046.000 15181441.000 - -0.00% -
557.xz_r 1.51% 129911.000 131867.000 - 0.02% -
500.perlbench_r 1.28% 1956619.000 1981566.000 - -0.01% -
520.omnetpp_r 1.26% 1374872.000 1392199.000 - 0.00% -
503.bwaves_r 1.14% 29255.000 29588.000 - 0.05% -
511.povray_r 1.08% 785535.000 794007.000 - -0.00% -
519.lbm_r 1.07% 11191.000 11311.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 7.63% 2018.000 2172.000 - -1.81% -
549.fotonik3d_r 2.02% 8698.000 8874.000 - -0.34% -
554.roms_r 1.73% 30622.000 31152.000 - -0.70% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -15.00% 20.000 17.000 - 0.00% -
nb_execution_successful -15.00% 20.000 17.000 - 0.00% -
nb_total_tests -15.00% 20.000 17.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -2.50% 1163451.000 1134395.000 - 0.00% -
505.mcf_r -1.36% 20525.000 20245.000 - -0.04% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -3.07% 424.000 411.000 - 0.24% -
531.deepsjeng_r -2.54% 5389.000 5252.000 - 0.08% -
520.omnetpp_r -2.18% 3530.000 3453.000 - -1.51% -
544.nab_r -1.89% 7985.000 7834.000 - -1.36% -
541.leela_r -1.01% 4658.000 4611.000 - -0.47% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.40s
Name Current %
500.perlbench_r 2172.000 -1.81%
503.bwaves_r 8836.000 -1.11%
505.mcf_r 6688.000 -2.04%
508.namd_r 3496.000 -
511.povray_r 411.000 -
519.lbm_r 3798.000 -
520.omnetpp_r 3453.000 -1.51%
521.wrf_r 9706.000 -
525.x264_r 3622.000 -1.17%
527.cam4_r 2523.000 1.12%
531.deepsjeng_r 5252.000 -
538.imagick_r 4233.000 -1.42%
541.leela_r 4611.000 -
544.nab_r 7834.000 -1.36%
549.fotonik3d_r 8874.000 -
554.roms_r 31152.000 -
557.xz_r 2385.000 -1.61%
Geometric Mean 4470.061 -
Name Current %
500.perlbench_r 1981566.000 -
503.bwaves_r 29588.000 -
505.mcf_r 20245.000 -
508.namd_r 654203.000 -
511.povray_r 794007.000 -
519.lbm_r 11311.000 -
520.omnetpp_r 1392199.000 -
521.wrf_r 15181441.000 -
525.x264_r 442233.000 -
527.cam4_r 2816864.000 -
531.deepsjeng_r 91791.000 -
538.imagick_r 1134395.000 -
541.leela_r 77971.000 -
544.nab_r 78239.000 -
549.fotonik3d_r 326250.000 -
554.roms_r 517761.000 -
557.xz_r 131867.000 -
Geometric Mean 312593.030 -
Name Current %
500.perlbench_r 26.000 -3.70%
500.perlbench_r (avg) 26.000 -3.70%
500.perlbench_r (avg) (percentage) 1.230 -
500.perlbench_r (max) 35.000 -5.41%
500.perlbench_r (max) (percentage) 1.650 -2.37%
503.bwaves_r 36.000 -
503.bwaves_r (avg) 36.000 -
503.bwaves_r (avg) (percentage) 0.410 -
503.bwaves_r (max) 155.000 -4.32%
503.bwaves_r (max) (percentage) 1.760 -3.30%
505.mcf_r 54.000 -1.82%
505.mcf_r (avg) 54.000 -1.82%
505.mcf_r (avg) (percentage) 0.820 -
505.mcf_r (max) 16.000 -5.88%
505.mcf_r (max) (percentage) 0.250 -3.85%
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) (percentage) 0.840 -3.45%
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.390 -
508.namd_r (max) 40.000 -6.98%
508.namd_r (max) (percentage) 1.150 -8.00%
508.namd_r (unexplained diff vs previous) 13.000 -70.45%
508.namd_r (unexplained diff vs previous) (percentage) 0.370 -70.63%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.130 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.140 -2.56%
519.lbm_r 20.000 -4.76%
519.lbm_r (avg) 20.000 -4.76%
519.lbm_r (avg) (percentage) 0.550 -
519.lbm_r (max) 26.000 85.71%
519.lbm_r (max) (percentage) 0.710 91.89%
519.lbm_r (unexplained diff vs previous) 27.000 92.86%
519.lbm_r (unexplained diff vs previous) (percentage) 0.710 91.89%
520.omnetpp_r 40.000 -
520.omnetpp_r (avg) 40.000 -
520.omnetpp_r (avg) (percentage) 1.160 -
520.omnetpp_r (max) 63.000 -8.70%
520.omnetpp_r (max) (percentage) 1.850 -6.57%
520.omnetpp_r (unexplained diff vs previous) 53.000 10.42%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.530 11.68%
521.wrf_r 111.000 -
521.wrf_r (avg) 111.000 -
521.wrf_r (avg) (percentage) 1.150 -
521.wrf_r (max) 125.000 -5.30%
521.wrf_r (max) (percentage) 1.290 -5.15%
525.x264_r 22.000 -
525.x264_r (avg) 22.000 -
525.x264_r (avg) (percentage) 0.620 -
525.x264_r (max) 20.000 -
525.x264_r (max) (percentage) 0.560 -
527.cam4_r 32.000 -
527.cam4_r (avg) 32.000 -
527.cam4_r (avg) (percentage) 1.290 -
527.cam4_r (max) 21.000 -
527.cam4_r (max) (percentage) 0.850 -3.41%
531.deepsjeng_r 24.000 -
531.deepsjeng_r (avg) 24.000 -
531.deepsjeng_r (avg) (percentage) 0.470 -
531.deepsjeng_r (max) 41.000 -4.65%
531.deepsjeng_r (max) (percentage) 0.790 -4.82%
538.imagick_r 10.000 -
538.imagick_r (avg) 10.000 -
538.imagick_r (avg) (percentage) 0.250 -
538.imagick_r (max) 5.000 -
538.imagick_r (max) (percentage) 0.120 -7.69%
541.leela_r 27.000 -
541.leela_r (avg) 27.000 -
541.leela_r (avg) (percentage) 0.590 -
541.leela_r (max) 40.000 -
541.leela_r (max) (percentage) 0.870 -
544.nab_r 36.000 -2.70%
544.nab_r (avg) 36.000 -2.70%
544.nab_r (avg) (percentage) 0.470 -
544.nab_r (max) 103.000 -5.50%
544.nab_r (max) (percentage) 1.320 -4.35%
548.exchange2_r (avg) (percentage) 0.540 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 37.000 -
549.fotonik3d_r (avg) 37.000 -
549.fotonik3d_r (avg) (percentage) 0.420 -
549.fotonik3d_r (max) 35.000 -2.78%
549.fotonik3d_r (max) (percentage) 0.400 -
554.roms_r 258.000 -
554.roms_r (avg) 258.000 -
554.roms_r (avg) (percentage) 0.830 -
554.roms_r (max) 392.000 -2.97%
554.roms_r (max) (percentage) 1.260 -2.33%
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.780 -
557.xz_r (max) 16.000 -5.88%
557.xz_r (max) (percentage) 0.700 -2.78%
Geometric Mean 6.044 -1.23%