Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=37afef6fe1378d671643624439e76453ade7c4af (+ 13 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (6589eb4efe39545ec7f7e641e1d302c89b260350) (+ 20 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e5893e6349541d871e8a25120bca014551d13ff5 (+ 1 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/68b02c3ac18b9686154702eb4aa2e5327d35e3ac (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-Os_LTO-build/274/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0274 (3-changed-components) 2025-02-27T07:14:20 0:00:00
Previous 0273 (4-changed-components) 2025-02-25T06:12:43 0:00:00
Baseline 0001 (4-changed-components) 2023-03-10T08:26:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 42 5
Performance Improvements 35 20
Added Tests 4 94
Unchanged Tests 729 691
Total Tests 810

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r 1.80% 4221.000 4297.000 - -4.68% -
520.omnetpp_r 1.33% 3773.000 3823.000 - -3.80% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
554.roms_r (unexplained diff vs previous) 1337.50% 16.000 230.000 - 0.00% -
554.roms_r (unexplained diff vs previous) (percentage) 1220.00% 0.050 0.660 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) 570.27% 0.370 2.480 - 0.00% -
511.povray_r (unexplained diff vs previous) 550.00% 2.000 13.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 333.33% 0.090 0.390 - 0.00% -
508.namd_r (unexplained diff vs previous) 325.00% 4.000 17.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
519.lbm_r (max) (percentage) 260.00% 0.050 0.180 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 260.00% 0.050 0.180 - 0.00% -
519.lbm_r (max) 250.00% 2.000 7.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 212.50% 16.000 50.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 211.90% 0.420 1.310 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 128.57% 0.070 0.160 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 125.00% 4.000 9.000 - 0.00% -
511.povray_r (max) 100.00% 6.000 12.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) 98.21% 56.000 111.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) (percentage) 97.73% 0.440 0.870 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 94.29% 0.350 0.680 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) 90.00% 20.000 38.000 - 0.00% -
511.povray_r (max) (percentage) 87.60% 1.290 2.420 - 0.00% -
508.namd_r (max) 70.00% 10.000 17.000 - 0.00% -
508.namd_r (max) (percentage) 60.00% 0.250 0.400 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) 50.00% 6.000 9.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 50.00% 0.060 0.090 - 0.00% -
520.omnetpp_r (max) 47.06% 34.000 50.000 - 0.00% -
520.omnetpp_r (max) (percentage) 46.15% 0.910 1.330 - 0.00% -
507.cactuBSSN_r (max) (percentage) 28.85% 0.520 0.670 - 0.00% -
507.cactuBSSN_r (max) 27.59% 29.000 37.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 20.00% 0.500 0.600 - 0.00% -
544.nab_r (max) 18.18% 44.000 52.000 - 0.00% -
544.nab_r (unexplained diff vs previous) 18.18% 44.000 52.000 - 0.00% -
544.nab_r (max) (percentage) 17.65% 0.510 0.600 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 13.89% 0.720 0.820 - 0.00% -
525.x264_r (unexplained diff vs previous) 13.33% 30.000 34.000 - 0.00% -
525.x264_r (max) (percentage) 12.50% 0.720 0.810 - 0.00% -
525.x264_r (max) 10.00% 30.000 33.000 - 0.00% -
520.omnetpp_r 2.50% 40.000 41.000 - 0.00% -
520.omnetpp_r (avg) 2.50% 40.000 41.000 - 0.00% -
511.povray_r (avg) (percentage) 2.06% 0.970 0.990 - 0.00% -
507.cactuBSSN_r (avg) (percentage) 1.61% 0.620 0.630 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r -2.42% 538.000 525.000 - -2.96% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r (unexplained diff vs previous) (percentage) -82.35% 0.340 0.060 - 0.00% -
503.bwaves_r (unexplained diff vs previous) -82.35% 34.000 6.000 - 0.00% -
527.cam4_r (unexplained diff vs previous) -75.81% 62.000 15.000 - 0.00% -
527.cam4_r (unexplained diff vs previous) (percentage) -75.58% 2.170 0.530 - 0.00% -
557.xz_r (unexplained diff vs previous) -64.71% 17.000 6.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -64.52% 0.620 0.220 - 0.00% -
505.mcf_r (unexplained diff vs previous) -63.49% 63.000 23.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -62.77% 0.940 0.350 - 0.00% -
557.xz_r (max) -40.00% 25.000 15.000 - 0.00% -
557.xz_r (max) (percentage) -38.71% 0.930 0.570 - 0.00% -
503.bwaves_r (max) -24.39% 41.000 31.000 - 0.00% -
503.bwaves_r (max) (percentage) -24.39% 0.410 0.310 - 0.00% -
505.mcf_r (max) -17.46% 63.000 52.000 - 0.00% -
505.mcf_r (max) (percentage) -16.84% 0.950 0.790 - 0.00% -
527.cam4_r (max) -12.70% 63.000 55.000 - 0.00% -
527.cam4_r (max) (percentage) -12.61% 2.220 1.940 - 0.00% -
531.deepsjeng_r (max) (percentage) -10.81% 0.370 0.330 - 0.00% -
531.deepsjeng_r (max) -10.00% 20.000 18.000 - 0.00% -
549.fotonik3d_r (max) -6.67% 15.000 14.000 - 0.00% -
541.leela_r (max) (percentage) -3.70% 1.350 1.300 - 0.00% -
538.imagick_r (max) -3.70% 27.000 26.000 - 0.00% -
500.perlbench_r (max) (percentage) -3.27% 1.530 1.480 - 0.00% -
500.perlbench_r (max) -3.03% 33.000 32.000 - 0.00% -
541.leela_r (max) -2.86% 70.000 68.000 - 0.00% -
554.roms_r (max) -2.59% 348.000 339.000 - 0.00% -
527.cam4_r -2.56% 39.000 38.000 - 0.00% -
527.cam4_r (avg) -2.56% 39.000 38.000 - 0.00% -
527.cam4_r (avg) (percentage) -2.19% 1.370 1.340 - 0.00% -
531.deepsjeng_r (avg) (percentage) -2.08% 0.480 0.470 - 0.00% -
554.roms_r (max) (percentage) -2.02% 0.990 0.970 - 0.00% -
538.imagick_r (max) (percentage) -1.67% 0.600 0.590 - 0.00% -
505.mcf_r -1.61% 62.000 61.000 - 0.00% -
505.mcf_r (avg) -1.61% 62.000 61.000 - 0.00% -
505.mcf_r (avg) (percentage) -1.08% 0.930 0.920 - 0.00% -

Added Tests - sample variability
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 4.60% 18107.000 18940.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r 4.32% 4352.000 4540.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.00% 20.000 19.000 - 0.00% -
nb_execution_successful -5.00% 20.000 19.000 - 0.00% -
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r -5.54% 11489.000 10853.000 - 0.00% -
549.fotonik3d_r -2.40% 185388.000 180936.000 - 0.00% -
538.imagick_r -1.84% 675590.000 663142.000 - 0.00% -
544.nab_r -1.64% 50637.000 49805.000 - 0.00% -
541.leela_r -1.17% 45298.000 44766.000 - 0.00% -
507.cactuBSSN_r -1.04% 1812438.000 1793556.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -6.20% 10972.000 10292.000 - 0.09% -
505.mcf_r -5.82% 7062.000 6651.000 - -0.34% -
502.gcc_r -4.68% 4508.000 4297.000 - 1.80% -
557.xz_r -4.53% 2872.000 2742.000 - -0.22% -
519.lbm_r -4.31% 4644.000 4444.000 - 0.18% -
520.omnetpp_r -3.80% 3974.000 3823.000 - 1.33% -
507.cactuBSSN_r -3.63% 5840.000 5628.000 - -0.67% -
511.povray_r -2.96% 541.000 525.000 - -2.42% -
531.deepsjeng_r -2.17% 5663.000 5540.000 - 0.16% -
554.roms_r -1.97% 35663.000 34959.000 - -0.65% -
541.leela_r -1.69% 5323.000 5233.000 - 0.77% -
525.x264_r -1.64% 4207.000 4138.000 - -0.81% -
544.nab_r -1.41% 8808.000 8684.000 - -0.60% -
503.bwaves_r -1.38% 10194.000 10053.000 - -0.06% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 2171.000 -
502.gcc_r 4297.000 1.80%
503.bwaves_r 10053.000 -
505.mcf_r 6651.000 -
507.cactuBSSN_r 5628.000 -
508.namd_r 4314.000 -
511.povray_r 525.000 -2.42%
519.lbm_r 4444.000 -
520.omnetpp_r 3823.000 1.33%
521.wrf_r 12831.000 -
525.x264_r 4138.000 -
527.cam4_r 2839.000 -
531.deepsjeng_r 5540.000 -
538.imagick_r 4540.000 -
541.leela_r 5233.000 -
544.nab_r 8684.000 -
549.fotonik3d_r 10292.000 -
554.roms_r 34959.000 -
557.xz_r 2742.000 -
Geometric Mean 5049.035 -
Name Current %
500.perlbench_r 1084884.000 -
502.gcc_r 4191433.000 -
503.bwaves_r 18940.000 -
505.mcf_r 13357.000 -
507.cactuBSSN_r 1793556.000 -
508.namd_r 355850.000 -
511.povray_r 493565.000 -
519.lbm_r 10853.000 -
520.omnetpp_r 741746.000 -
521.wrf_r 7732799.000 -
525.x264_r 262070.000 -
527.cam4_r 1816694.000 -
531.deepsjeng_r 50285.000 -
538.imagick_r 663142.000 -
541.leela_r 44766.000 -
544.nab_r 49805.000 -
549.fotonik3d_r 180936.000 -
554.roms_r 342945.000 -
557.xz_r 76201.000 -
Geometric Mean 250488.808 -
Name Current %
500.perlbench_r 23.000 -
500.perlbench_r (avg) 23.000 -
500.perlbench_r (avg) (percentage) 1.060 -
500.perlbench_r (max) 32.000 -3.03%
500.perlbench_r (max) (percentage) 1.480 -3.27%
500.perlbench_r (unexplained diff vs previous) 7.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.320 -
503.bwaves_r 30.000 -
503.bwaves_r (avg) 30.000 -
503.bwaves_r (avg) (percentage) 0.300 -
503.bwaves_r (max) 31.000 -24.39%
503.bwaves_r (max) (percentage) 0.310 -24.39%
503.bwaves_r (unexplained diff vs previous) 6.000 -82.35%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.060 -82.35%
505.mcf_r 61.000 -1.61%
505.mcf_r (avg) 61.000 -1.61%
505.mcf_r (avg) (percentage) 0.920 -1.08%
505.mcf_r (max) 52.000 -17.46%
505.mcf_r (max) (percentage) 0.790 -16.84%
505.mcf_r (unexplained diff vs previous) 23.000 -63.49%
505.mcf_r (unexplained diff vs previous) (percentage) 0.350 -62.77%
507.cactuBSSN_r 35.000 -
507.cactuBSSN_r (avg) 35.000 -
507.cactuBSSN_r (avg) (percentage) 0.630 1.61%
507.cactuBSSN_r (max) 37.000 27.59%
507.cactuBSSN_r (max) (percentage) 0.670 28.85%
507.cactuBSSN_r (unexplained diff vs previous) 38.000 90.00%
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.680 94.29%
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.360 -
508.namd_r (max) 17.000 70.00%
508.namd_r (max) (percentage) 0.400 60.00%
508.namd_r (unexplained diff vs previous) 17.000 325.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.390 333.33%
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 0.990 2.06%
511.povray_r (max) 12.000 100.00%
511.povray_r (max) (percentage) 2.420 87.60%
511.povray_r (unexplained diff vs previous) 13.000 550.00%
511.povray_r (unexplained diff vs previous) (percentage) 2.480 570.27%
519.lbm_r 13.000 -
519.lbm_r (avg) 13.000 -
519.lbm_r (avg) (percentage) 0.300 -
519.lbm_r (max) 7.000 250.00%
519.lbm_r (max) (percentage) 0.180 260.00%
519.lbm_r (unexplained diff vs previous) 8.000 300.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.180 260.00%
520.omnetpp_r 41.000 2.50%
520.omnetpp_r (avg) 41.000 2.50%
520.omnetpp_r (avg) (percentage) 1.090 -
520.omnetpp_r (max) 50.000 47.06%
520.omnetpp_r (max) (percentage) 1.330 46.15%
520.omnetpp_r (unexplained diff vs previous) 50.000 212.50%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.310 211.90%
521.wrf_r 107.000 -
521.wrf_r (avg) 107.000 -
521.wrf_r (avg) (percentage) 0.840 -
521.wrf_r (max) 143.000 -
521.wrf_r (max) (percentage) 1.120 -
521.wrf_r (unexplained diff vs previous) 111.000 98.21%
521.wrf_r (unexplained diff vs previous) (percentage) 0.870 97.73%
525.x264_r 21.000 -
525.x264_r (avg) 21.000 -
525.x264_r (avg) (percentage) 0.520 -
525.x264_r (max) 33.000 10.00%
525.x264_r (max) (percentage) 0.810 12.50%
525.x264_r (unexplained diff vs previous) 34.000 13.33%
525.x264_r (unexplained diff vs previous) (percentage) 0.820 13.89%
527.cam4_r 38.000 -2.56%
527.cam4_r (avg) 38.000 -2.56%
527.cam4_r (avg) (percentage) 1.340 -2.19%
527.cam4_r (max) 55.000 -12.70%
527.cam4_r (max) (percentage) 1.940 -12.61%
527.cam4_r (unexplained diff vs previous) 15.000 -75.81%
527.cam4_r (unexplained diff vs previous) (percentage) 0.530 -75.58%
531.deepsjeng_r 26.000 -
531.deepsjeng_r (avg) 26.000 -
531.deepsjeng_r (avg) (percentage) 0.470 -2.08%
531.deepsjeng_r (max) 18.000 -10.00%
531.deepsjeng_r (max) (percentage) 0.330 -10.81%
531.deepsjeng_r (unexplained diff vs previous) 9.000 125.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.160 128.57%
538.imagick_r 12.000 -
538.imagick_r (avg) 12.000 -
538.imagick_r (avg) (percentage) 0.270 -
538.imagick_r (max) 26.000 -3.70%
538.imagick_r (max) (percentage) 0.590 -1.67%
538.imagick_r (unexplained diff vs previous) 0.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.000 -
541.leela_r 31.000 -
541.leela_r (avg) 31.000 -
541.leela_r (avg) (percentage) 0.600 -
541.leela_r (max) 68.000 -2.86%
541.leela_r (max) (percentage) 1.300 -3.70%
541.leela_r (unexplained diff vs previous) 40.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.760 -
544.nab_r 39.000 -
544.nab_r (avg) 39.000 -
544.nab_r (avg) (percentage) 0.450 -
544.nab_r (max) 52.000 18.18%
544.nab_r (max) (percentage) 0.600 17.65%
544.nab_r (unexplained diff vs previous) 52.000 18.18%
544.nab_r (unexplained diff vs previous) (percentage) 0.600 20.00%
548.exchange2_r (avg) (percentage) 0.530 -
548.exchange2_r (max) (percentage) 0.480 -
549.fotonik3d_r 42.000 -
549.fotonik3d_r (avg) 42.000 -
549.fotonik3d_r (avg) (percentage) 0.410 -
549.fotonik3d_r (max) 14.000 -6.67%
549.fotonik3d_r (max) (percentage) 0.140 -
549.fotonik3d_r (unexplained diff vs previous) 9.000 50.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.090 50.00%
554.roms_r 213.000 -
554.roms_r (avg) 213.000 -
554.roms_r (avg) (percentage) 0.610 -
554.roms_r (max) 339.000 -2.59%
554.roms_r (max) (percentage) 0.970 -2.02%
554.roms_r (unexplained diff vs previous) 230.000 1337.50%
554.roms_r (unexplained diff vs previous) (percentage) 0.660 1220.00%
557.xz_r 14.000 -
557.xz_r (avg) 14.000 -
557.xz_r (avg) (percentage) 0.540 -
557.xz_r (max) 15.000 -40.00%
557.xz_r (max) (percentage) 0.570 -38.71%
557.xz_r (unexplained diff vs previous) 6.000 -64.71%
557.xz_r (unexplained diff vs previous) (percentage) 0.220 -64.52%
Geometric Mean 4.279 12.37%