Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f3d834df28734ebc82931808960fe63401127c06 (+ 209 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (c182f4d14d65b3e012ad65b5014d86352fabc86f) (+ 556 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4f6dae219578d6df475864e273da40bde9d30806 (+ 45 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (+ 14280 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3_LTO-build/266/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0266 (4-changed-components) 2025-04-17T22:05:20 0:00:00
Previous 0261 (4-changed-components) 2025-03-31T01:34:11 0:00:00
Baseline 0073 (4-changed-components) 2023-10-17T22:44:19 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 11
Performance Improvements 44 18
Added Tests 0 105
Unchanged Tests 808 730
Total Tests 864

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r 1.51% 29187.000 29627.000 - 3.64% -
531.deepsjeng_r 1.19% 112347.000 113679.000 - 1.66% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
527.cam4_r 2.30% 2351.000 2405.000 - 4.66% -
554.roms_r 1.32% 25132.000 25464.000 - 10.16% -
500.perlbench_r 1.16% 2147.000 2172.000 - 8.01% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r 6.25% 16.000 17.000 - 0.00% -
508.namd_r (avg) 6.25% 16.000 17.000 - 0.00% -
527.cam4_r 2.50% 40.000 41.000 - 0.00% -
527.cam4_r (avg) 2.50% 40.000 41.000 - 0.00% -
527.cam4_r (max) 1.75% 57.000 58.000 - 0.00% -
554.roms_r 1.23% 163.000 165.000 - 0.00% -
554.roms_r (avg) 1.23% 163.000 165.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -2.25% 3287.000 3213.000 - 0.00% -
503.bwaves_r -1.82% 8043.000 7897.000 - -0.11% -
511.povray_r -1.37% 437.000 431.000 - 0.70% -
541.leela_r -1.22% 4096.000 4046.000 - 0.57% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) -85.95% 1.210 0.170 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -85.71% 42.000 6.000 - 0.00% -
519.lbm_r (max) -18.42% 38.000 31.000 - 0.00% -
519.lbm_r (max) (percentage) -16.38% 1.160 0.970 - 0.00% -
519.lbm_r (unexplained diff vs previous) -15.79% 38.000 32.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -14.78% 1.150 0.980 - 0.00% -
508.namd_r (max) -10.00% 10.000 9.000 - 0.00% -
505.mcf_r (max) -9.68% 31.000 28.000 - 0.00% -
520.omnetpp_r (max) -8.89% 90.000 82.000 - 0.00% -
520.omnetpp_r (max) (percentage) -8.81% 2.610 2.380 - 0.00% -
549.fotonik3d_r (max) -8.33% 12.000 11.000 - 0.00% -
503.bwaves_r (max) -8.16% 98.000 90.000 - 0.00% -
525.x264_r (max) -8.00% 25.000 23.000 - 0.00% -
503.bwaves_r (max) (percentage) -6.56% 1.220 1.140 - 0.00% -
505.mcf_r (max) (percentage) -6.52% 0.460 0.430 - 0.00% -
544.nab_r (max) -4.81% 104.000 99.000 - 0.00% -
525.x264_r (max) (percentage) -4.55% 0.880 0.840 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.41% 0.680 0.650 - 0.00% -
557.xz_r (max) (percentage) -4.04% 1.980 1.900 - 0.00% -
508.namd_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
544.nab_r (max) (percentage) -3.70% 1.350 1.300 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.51% 0.570 0.550 - 0.00% -
511.povray_r (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
500.perlbench_r (max) (percentage) -3.08% 3.570 3.460 - 0.00% -
531.deepsjeng_r (max) -2.78% 36.000 35.000 - 0.00% -
507.cactuBSSN_r (max) -2.70% 37.000 36.000 - 0.00% -
503.bwaves_r -2.38% 42.000 41.000 - 0.00% -
503.bwaves_r (avg) -2.38% 42.000 41.000 - 0.00% -
520.omnetpp_r -2.27% 44.000 43.000 - 0.00% -
520.omnetpp_r (avg) -2.27% 44.000 43.000 - 0.00% -
557.xz_r (max) -2.17% 46.000 45.000 - 0.00% -
521.wrf_r (max) (percentage) -1.95% 2.050 2.010 - 0.00% -
521.wrf_r (max) -1.59% 189.000 186.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.56% 1.280 1.260 - 0.00% -
541.leela_r (max) -1.43% 70.000 69.000 - 0.00% -
554.roms_r (max) (percentage) -1.41% 0.710 0.700 - 0.00% -
505.mcf_r -1.41% 71.000 70.000 - 0.00% -
505.mcf_r (avg) -1.41% 71.000 70.000 - 0.00% -
500.perlbench_r (max) -1.32% 76.000 75.000 - 0.00% -
527.cam4_r (max) (percentage) -1.22% 2.460 2.430 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 3.64% 28586.000 29627.000 - 1.51% -
531.deepsjeng_r 1.66% 111823.000 113679.000 - 1.19% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
554.roms_r 10.16% 23116.000 25464.000 - 1.32% -
521.wrf_r 8.86% 8508.000 9262.000 - 0.08% -
500.perlbench_r 8.01% 2011.000 2172.000 - 1.16% -
527.cam4_r 4.66% 2298.000 2405.000 - 2.30% -
505.mcf_r 3.15% 6508.000 6713.000 - -0.83% -
531.deepsjeng_r 2.75% 5271.000 5416.000 - 0.18% -
525.x264_r 2.05% 2787.000 2844.000 - -0.91% -
520.omnetpp_r 1.37% 3426.000 3473.000 - -0.17% -
557.xz_r 1.06% 2360.000 2385.000 - 0.59% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -27.34% 21470017.000 15600389.000 - -0.03% -
554.roms_r -16.71% 864093.000 719685.000 - 0.38% -
549.fotonik3d_r -12.27% 398186.000 349309.000 - -0.19% -
508.namd_r -10.56% 901164.000 806008.000 - 0.15% -
527.cam4_r -10.29% 3616716.000 3244664.000 - 0.45% -
505.mcf_r -6.33% 28293.000 26501.000 - -0.09% -
544.nab_r -5.82% 98295.000 92575.000 - 0.10% -
507.cactuBSSN_r -5.53% 4609579.000 4354658.000 - 0.85% -
538.imagick_r -2.81% 1561691.000 1517847.000 - -0.32% -
525.x264_r -1.97% 599185.000 587400.000 - 0.38% -
511.povray_r -1.48% 1104695.000 1088313.000 - -0.31% -
541.leela_r -1.04% 100263.000 99218.000 - -0.24% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.28% 8562.000 8367.000 - 0.06% -
544.nab_r -2.19% 7848.000 7676.000 - -0.52% -
507.cactuBSSN_r -1.90% 6785.000 6656.000 - 0.99% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 15.79% 19.000 22.000 - 0.00% -
nb_execution_successful 15.79% 19.000 22.000 - 0.00% -
nb_total_tests 15.79% 19.000 22.000 - 0.00% -

Added Tests - Code Size
502.gcc_r
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
502.gcc_r
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 2172.000 1.16%
502.gcc_r 3576.000 -
503.bwaves_r 7897.000 -1.82%
505.mcf_r 6713.000 -
507.cactuBSSN_r 6656.000 -
508.namd_r 3784.000 -
510.parest_r 6067.000 -
511.povray_r 431.000 -1.37%
519.lbm_r 3282.000 -
520.omnetpp_r 3473.000 -
521.wrf_r 9262.000 -
523.xalancbmk_r 3213.000 -2.25%
525.x264_r 2844.000 -
526.blender_r 10581.000 -
527.cam4_r 2405.000 2.30%
531.deepsjeng_r 5416.000 -
538.imagick_r 3987.000 -
541.leela_r 4046.000 -1.22%
544.nab_r 7676.000 -
549.fotonik3d_r 8367.000 -
554.roms_r 25464.000 1.32%
557.xz_r 2385.000 -
Geometric Mean 4492.977 -
Name Current %
500.perlbench_r 2527522.000 -
502.gcc_r 9625628.000 -
503.bwaves_r 29627.000 1.51%
505.mcf_r 26501.000 -
507.cactuBSSN_r 4354658.000 -
508.namd_r 806008.000 -
510.parest_r 1636761.000 -
511.povray_r 1088313.000 -
519.lbm_r 11399.000 -
520.omnetpp_r 1583492.000 -
521.wrf_r 15600389.000 -
523.xalancbmk_r 3319201.000 -
525.x264_r 587400.000 -
526.blender_r 10155365.000 -
527.cam4_r 3244664.000 -
531.deepsjeng_r 113679.000 1.19%
538.imagick_r 1517847.000 -
541.leela_r 99218.000 -
544.nab_r 92575.000 -
549.fotonik3d_r 349309.000 -
554.roms_r 719685.000 -
557.xz_r 149247.000 -
Geometric Mean 665468.672 -
Name Current %
500.perlbench_r 29.000 -
500.perlbench_r (avg) 29.000 -
500.perlbench_r (avg) (percentage) 1.370 -
500.perlbench_r (max) 75.000 -1.32%
500.perlbench_r (max) (percentage) 3.460 -3.08%
503.bwaves_r 41.000 -2.38%
503.bwaves_r (avg) 41.000 -2.38%
503.bwaves_r (avg) (percentage) 0.530 -
503.bwaves_r (max) 90.000 -8.16%
503.bwaves_r (max) (percentage) 1.140 -6.56%
505.mcf_r 70.000 -1.41%
505.mcf_r (avg) 70.000 -1.41%
505.mcf_r (avg) (percentage) 1.050 -
505.mcf_r (max) 28.000 -9.68%
505.mcf_r (max) (percentage) 0.430 -6.52%
507.cactuBSSN_r 31.000 -
507.cactuBSSN_r (avg) 31.000 -
507.cactuBSSN_r (avg) (percentage) 0.480 -
507.cactuBSSN_r (max) 36.000 -2.70%
507.cactuBSSN_r (max) (percentage) 0.550 -3.51%
508.namd_r 17.000 6.25%
508.namd_r (avg) 17.000 6.25%
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 9.000 -10.00%
508.namd_r (max) (percentage) 0.260 -3.70%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.960 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.930 -3.12%
519.lbm_r 26.000 -
519.lbm_r (avg) 26.000 -
519.lbm_r (avg) (percentage) 0.800 -
519.lbm_r (max) 31.000 -18.42%
519.lbm_r (max) (percentage) 0.970 -16.38%
519.lbm_r (unexplained diff vs previous) 32.000 -15.79%
519.lbm_r (unexplained diff vs previous) (percentage) 0.980 -14.78%
520.omnetpp_r 43.000 -2.27%
520.omnetpp_r (avg) 43.000 -2.27%
520.omnetpp_r (avg) (percentage) 1.260 -1.56%
520.omnetpp_r (max) 82.000 -8.89%
520.omnetpp_r (max) (percentage) 2.380 -8.81%
520.omnetpp_r (unexplained diff vs previous) 6.000 -85.71%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.170 -85.95%
521.wrf_r 89.000 -
521.wrf_r (avg) 89.000 -
521.wrf_r (avg) (percentage) 0.970 -
521.wrf_r (max) 186.000 -1.59%
521.wrf_r (max) (percentage) 2.010 -1.95%
525.x264_r 30.000 -
525.x264_r (avg) 30.000 -
525.x264_r (avg) (percentage) 1.060 -
525.x264_r (max) 23.000 -8.00%
525.x264_r (max) (percentage) 0.840 -4.55%
526.blender_r 113.000 -
526.blender_r (avg) 113.000 -
526.blender_r (avg) (percentage) 1.070 -
526.blender_r (max) 113.000 -
526.blender_r (max) (percentage) 1.070 -
527.cam4_r 41.000 2.50%
527.cam4_r (avg) 41.000 2.50%
527.cam4_r (avg) (percentage) 1.710 -
527.cam4_r (max) 58.000 1.75%
527.cam4_r (max) (percentage) 2.430 -1.22%
531.deepsjeng_r 23.000 -
531.deepsjeng_r (avg) 23.000 -
531.deepsjeng_r (avg) (percentage) 0.440 -
531.deepsjeng_r (max) 35.000 -2.78%
531.deepsjeng_r (max) (percentage) 0.650 -4.41%
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.190 -
538.imagick_r (max) 12.000 -
538.imagick_r (max) (percentage) 0.310 -
541.leela_r 35.000 -
541.leela_r (avg) 35.000 -
541.leela_r (avg) (percentage) 0.870 -
541.leela_r (max) 69.000 -1.43%
541.leela_r (max) (percentage) 1.710 -
544.nab_r 37.000 -
544.nab_r (avg) 37.000 -
544.nab_r (avg) (percentage) 0.490 -
544.nab_r (max) 99.000 -4.81%
544.nab_r (max) (percentage) 1.300 -3.70%
548.exchange2_r (avg) (percentage) 0.990 -
548.exchange2_r (max) (percentage) 1.250 -
549.fotonik3d_r 42.000 -
549.fotonik3d_r (avg) 42.000 -
549.fotonik3d_r (avg) (percentage) 0.510 -
549.fotonik3d_r (max) 11.000 -8.33%
549.fotonik3d_r (max) (percentage) 0.140 -
554.roms_r 165.000 1.23%
554.roms_r (avg) 165.000 1.23%
554.roms_r (avg) (percentage) 0.650 -
554.roms_r (max) 178.000 -
554.roms_r (max) (percentage) 0.700 -1.41%
557.xz_r 20.000 -
557.xz_r (avg) 20.000 -
557.xz_r (avg) (percentage) 0.870 -
557.xz_r (max) 45.000 -2.17%
557.xz_r (max) (percentage) 1.900 -4.04%
Geometric Mean 7.219 -5.73%