Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3f8fc746d6bd837c082a41cbc37a2f8ec2325bf2 (+ 123 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (fce42e15063e76d2535586a25d560e2340ca8ac9) (+ 436 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f8f73249d94fd3ef5fc5843932dbd1fde6bef12c (+ 53 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/854a85bbaa94372aab63fed6a37a8e1768cf1a84 (+ 856 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3_LTO-build/406/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0406 (4-changed-components) 2025-06-02T05:24:28 0:00:00
Previous 0402 (3-changed-components) 2025-05-25T07:07:23 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T16:28:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 21 21
Performance Improvements 35 21
Added Tests 0 107
Unchanged Tests 880 787
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.66% 20431.000 20771.000 - -6.09% -
520.omnetpp_r 1.40% 10084.000 10225.000 - -7.68% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (unexplained diff vs previous) (percentage) 300.00% 0.010 0.040 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) 250.00% 2.000 7.000 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) 167.72% 127.000 340.000 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 164.52% 0.620 1.640 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 100.00% 0.220 0.440 - 0.00% -
508.namd_r (unexplained diff vs previous) 95.65% 23.000 45.000 - 0.00% -
507.cactuBSSN_r (max) 85.95% 185.000 344.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) 82.42% 0.910 1.660 - 0.00% -
520.omnetpp_r (max) 24.35% 115.000 143.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 22.61% 115.000 141.000 - 0.00% -
520.omnetpp_r (max) (percentage) 21.74% 1.150 1.400 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 21.05% 1.140 1.380 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 7.69% 13.000 14.000 - 0.00% -
507.cactuBSSN_r 4.84% 124.000 130.000 - 0.00% -
507.cactuBSSN_r (avg) 4.84% 124.000 130.000 - 0.00% -
520.omnetpp_r 3.30% 91.000 94.000 - 0.00% -
520.omnetpp_r (avg) 3.30% 91.000 94.000 - 0.00% -
507.cactuBSSN_r (avg) (percentage) 3.28% 0.610 0.630 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.10% 0.910 0.920 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) -45.71% 0.700 0.380 - 0.00% -
544.nab_r (unexplained diff vs previous) -44.87% 78.000 43.000 - 0.00% -
541.leela_r (max) -13.51% 37.000 32.000 - 0.00% -
541.leela_r (max) (percentage) -13.16% 0.380 0.330 - 0.00% -
505.mcf_r (max) -12.50% 104.000 91.000 - 0.00% -
505.mcf_r (max) (percentage) -11.76% 0.850 0.750 - 0.00% -
544.nab_r (max) -9.09% 77.000 70.000 - 0.00% -
544.nab_r (max) (percentage) -8.70% 0.690 0.630 - 0.00% -
521.wrf_r (max) -8.31% 301.000 276.000 - 0.00% -
521.wrf_r (max) (percentage) -7.69% 1.820 1.680 - 0.00% -
557.xz_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
557.xz_r (max) -7.69% 13.000 12.000 - 0.00% -
531.deepsjeng_r (max) -6.90% 29.000 27.000 - 0.00% -
503.bwaves_r (max) (percentage) -5.41% 0.370 0.350 - 0.00% -
503.bwaves_r (avg) (percentage) -5.00% 0.200 0.190 - 0.00% -
503.bwaves_r (max) -5.00% 80.000 76.000 - 0.00% -
503.bwaves_r -4.65% 43.000 41.000 - 0.00% -
503.bwaves_r (avg) -4.65% 43.000 41.000 - 0.00% -
508.namd_r (max) (percentage) -3.85% 0.780 0.750 - 0.00% -
510.parest_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
510.parest_r (max) -3.77% 53.000 51.000 - 0.00% -
508.namd_r (max) -3.75% 80.000 77.000 - 0.00% -
523.xalancbmk_r (max) -2.90% 379.000 368.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.74% 4.020 3.910 - 0.00% -
511.povray_r (max) -2.34% 171.000 167.000 - 0.00% -
554.roms_r (max) -2.25% 579.000 566.000 - 0.00% -
554.roms_r (max) (percentage) -2.17% 3.220 3.150 - 0.00% -
502.gcc_r (max) (percentage) -2.15% 0.930 0.910 - 0.00% -
511.povray_r (max) (percentage) -2.06% 0.970 0.950 - 0.00% -
500.perlbench_r (max) (percentage) -1.94% 1.030 1.010 - 0.00% -
500.perlbench_r (max) -1.60% 125.000 123.000 - 0.00% -
554.roms_r -1.59% 63.000 62.000 - 0.00% -
554.roms_r (avg) -1.59% 63.000 62.000 - 0.00% -
538.imagick_r (max) (percentage) -1.39% 0.720 0.710 - 0.00% -
502.gcc_r (max) -1.27% 79.000 78.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.82% 9961079.000 10540401.000 - -0.00% -
557.xz_r 5.44% 145387.000 153295.000 - -0.06% -
503.bwaves_r 4.25% 28114.000 29309.000 - 0.00% -
502.gcc_r 3.85% 9512398.000 9879048.000 - 0.20% -
500.perlbench_r 3.54% 2484215.000 2572274.000 - -0.00% -
519.lbm_r 3.25% 11415.000 11786.000 - 0.00% -
520.omnetpp_r 2.41% 1620416.000 1659447.000 - -0.04% -
541.leela_r 2.12% 100201.000 102330.000 - -0.00% -
511.povray_r 1.80% 1086933.000 1106524.000 - 0.02% -
531.deepsjeng_r 1.31% 112861.000 114343.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 29.21% 13661.000 17652.000 - 0.22% -
554.roms_r 5.59% 17036.000 17989.000 - -0.10% -
508.namd_r 4.84% 9834.000 10310.000 - 0.44% -
523.xalancbmk_r 3.12% 9145.000 9430.000 - -0.17% -
525.x264_r 2.91% 10876.000 11193.000 - 0.13% -
549.fotonik3d_r 2.45% 18607.000 19062.000 - 0.04% -
503.bwaves_r 1.37% 21603.000 21899.000 - 0.06% -
521.wrf_r 1.16% 16247.000 16436.000 - -0.86% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -24.80% 21211054.000 15951365.000 - -0.00% -
554.roms_r -16.47% 873970.000 730032.000 - 0.00% -
549.fotonik3d_r -14.07% 403090.000 346380.000 - 0.00% -
527.cam4_r -8.00% 3573957.000 3288040.000 - 0.00% -
508.namd_r -5.56% 853851.000 806390.000 - 0.00% -
507.cactuBSSN_r -4.74% 4586703.000 4369166.000 - -0.00% -
544.nab_r -4.31% 97555.000 93355.000 - 0.00% -
505.mcf_r -2.80% 28397.000 27601.000 - 0.00% -
525.x264_r -1.81% 607922.000 596924.000 - -0.01% -
538.imagick_r -1.36% 1560853.000 1539703.000 - 0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -13.31% 12966.000 11240.000 - 0.38% -
520.omnetpp_r -7.68% 11076.000 10225.000 - 1.40% -
541.leela_r -6.41% 10449.000 9779.000 - -0.48% -
507.cactuBSSN_r -6.09% 22118.000 20771.000 - 1.66% -
557.xz_r -4.21% 10492.000 10050.000 - -0.06% -
505.mcf_r -3.10% 12541.000 12152.000 - -0.69% -
500.perlbench_r -3.08% 12607.000 12219.000 - 0.30% -
510.parest_r -2.84% 21273.000 20668.000 - -0.41% -
526.blender_r -2.13% 10990.000 10756.000 - -0.47% -
511.povray_r -1.41% 17933.000 17681.000 - 0.13% -
502.gcc_r -1.16% 8756.000 8654.000 - 0.89% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 12219.000 -
502.gcc_r 8654.000 -
503.bwaves_r 21899.000 -
505.mcf_r 12152.000 -
507.cactuBSSN_r 20771.000 1.66%
508.namd_r 10310.000 -
510.parest_r 20668.000 -
511.povray_r 17681.000 -
519.lbm_r 17652.000 -
520.omnetpp_r 10225.000 1.40%
521.wrf_r 16436.000 -
523.xalancbmk_r 9430.000 -
525.x264_r 11193.000 -
526.blender_r 10756.000 -
527.cam4_r 9764.000 -
531.deepsjeng_r 12073.000 -
538.imagick_r 14130.000 -
541.leela_r 9779.000 -
544.nab_r 11240.000 -
549.fotonik3d_r 19062.000 -
554.roms_r 17989.000 -
557.xz_r 10050.000 -
Geometric Mean 13224.295 -
Name Current %
500.perlbench_r 2572274.000 -
502.gcc_r 9879048.000 -
503.bwaves_r 29309.000 -
505.mcf_r 27601.000 -
507.cactuBSSN_r 4369166.000 -
508.namd_r 806390.000 -
510.parest_r 1687186.000 -
511.povray_r 1106524.000 -
519.lbm_r 11786.000 -
520.omnetpp_r 1659447.000 -
521.wrf_r 15951365.000 -
523.xalancbmk_r 3417220.000 -
525.x264_r 596924.000 -
526.blender_r 10540401.000 -
527.cam4_r 3288040.000 -
531.deepsjeng_r 114343.000 -
538.imagick_r 1539703.000 -
541.leela_r 102330.000 -
544.nab_r 93355.000 -
549.fotonik3d_r 346380.000 -
554.roms_r 730032.000 -
557.xz_r 153295.000 -
Geometric Mean 678120.364 -
Name Current %
500.perlbench_r 68.000 -
500.perlbench_r (avg) 68.000 -
500.perlbench_r (avg) (percentage) 0.560 -
500.perlbench_r (max) 123.000 -1.60%
500.perlbench_r (max) (percentage) 1.010 -1.94%
502.gcc_r 27.000 -
502.gcc_r (avg) 27.000 -
502.gcc_r (avg) (percentage) 0.320 -
502.gcc_r (max) 78.000 -1.27%
502.gcc_r (max) (percentage) 0.910 -2.15%
503.bwaves_r 41.000 -4.65%
503.bwaves_r (avg) 41.000 -4.65%
503.bwaves_r (avg) (percentage) 0.190 -5.00%
503.bwaves_r (max) 76.000 -5.00%
503.bwaves_r (max) (percentage) 0.350 -5.41%
503.bwaves_r (unexplained diff vs previous) 14.000 7.69%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.060 -
505.mcf_r 52.000 -
505.mcf_r (avg) 52.000 -
505.mcf_r (avg) (percentage) 0.430 -
505.mcf_r (max) 91.000 -12.50%
505.mcf_r (max) (percentage) 0.750 -11.76%
507.cactuBSSN_r 130.000 4.84%
507.cactuBSSN_r (avg) 130.000 4.84%
507.cactuBSSN_r (avg) (percentage) 0.630 3.28%
507.cactuBSSN_r (max) 344.000 85.95%
507.cactuBSSN_r (max) (percentage) 1.660 82.42%
507.cactuBSSN_r (unexplained diff vs previous) 340.000 167.72%
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 1.640 164.52%
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.200 -
508.namd_r (max) 77.000 -3.75%
508.namd_r (max) (percentage) 0.750 -3.85%
508.namd_r (unexplained diff vs previous) 45.000 95.65%
508.namd_r (unexplained diff vs previous) (percentage) 0.440 100.00%
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 51.000 -3.77%
510.parest_r (max) (percentage) 0.250 -3.85%
511.povray_r 67.000 -
511.povray_r (avg) 67.000 -
511.povray_r (avg) (percentage) 0.380 -
511.povray_r (max) 167.000 -2.34%
511.povray_r (max) (percentage) 0.950 -2.06%
519.lbm_r 31.000 -
519.lbm_r (avg) 31.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 38.000 -
519.lbm_r (max) (percentage) 0.220 -
519.lbm_r (unexplained diff vs previous) 39.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.220 -
520.omnetpp_r 94.000 3.30%
520.omnetpp_r (avg) 94.000 3.30%
520.omnetpp_r (avg) (percentage) 0.920 1.10%
520.omnetpp_r (max) 143.000 24.35%
520.omnetpp_r (max) (percentage) 1.400 21.74%
520.omnetpp_r (unexplained diff vs previous) 141.000 22.61%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.380 21.05%
521.wrf_r 118.000 -
521.wrf_r (avg) 118.000 -
521.wrf_r (avg) (percentage) 0.720 -
521.wrf_r (max) 276.000 -8.31%
521.wrf_r (max) (percentage) 1.680 -7.69%
523.xalancbmk_r 82.000 -
523.xalancbmk_r (avg) 82.000 -
523.xalancbmk_r (avg) (percentage) 0.870 -
523.xalancbmk_r (max) 368.000 -2.90%
523.xalancbmk_r (max) (percentage) 3.910 -2.74%
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 40.000 -
525.x264_r (max) (percentage) 0.360 -
526.blender_r 47.000 -
526.blender_r (avg) 47.000 -
526.blender_r (avg) (percentage) 0.440 -
526.blender_r (max) 43.000 -
526.blender_r (max) (percentage) 0.400 -
531.deepsjeng_r 96.000 -
531.deepsjeng_r (avg) 96.000 -
531.deepsjeng_r (avg) (percentage) 0.800 -
531.deepsjeng_r (max) 27.000 -6.90%
531.deepsjeng_r (max) (percentage) 0.230 -
538.imagick_r 48.000 -
538.imagick_r (avg) 48.000 -
538.imagick_r (avg) (percentage) 0.340 -
538.imagick_r (max) 100.000 -
538.imagick_r (max) (percentage) 0.710 -1.39%
541.leela_r 33.000 -
541.leela_r (avg) 33.000 -
541.leela_r (avg) (percentage) 0.340 -
541.leela_r (max) 32.000 -13.51%
541.leela_r (max) (percentage) 0.330 -13.16%
544.nab_r 38.000 -
544.nab_r (avg) 38.000 -
544.nab_r (avg) (percentage) 0.340 -
544.nab_r (max) 70.000 -9.09%
544.nab_r (max) (percentage) 0.630 -8.70%
544.nab_r (unexplained diff vs previous) 43.000 -44.87%
544.nab_r (unexplained diff vs previous) (percentage) 0.380 -45.71%
548.exchange2_r (avg) (percentage) 0.340 -
548.exchange2_r (max) (percentage) 0.550 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 26.000 -
549.fotonik3d_r (max) (percentage) 0.140 -
549.fotonik3d_r (unexplained diff vs previous) 7.000 250.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.040 300.00%
554.roms_r 62.000 -1.59%
554.roms_r (avg) 62.000 -1.59%
554.roms_r (avg) (percentage) 0.350 -
554.roms_r (max) 566.000 -2.25%
554.roms_r (max) (percentage) 3.150 -2.17%
557.xz_r 16.000 -
557.xz_r (avg) 16.000 -
557.xz_r (avg) (percentage) 0.160 -
557.xz_r (max) 12.000 -7.69%
557.xz_r (max) (percentage) 0.120 -7.69%
Geometric Mean 7.064 4.38%