Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=392678738b1be629d75932013fc372c468f39a34 (+ 392 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (24f79780148613ea8539209c30ec6e102b007ee6) (+ 1362 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=70b648855185e967e54668b101d24704c3fb869d (+ 93 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/dfc5f6de47b62aa45150d0b9ef1ffda99bb5112a (+ 719 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/395/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0395 (4-changed-components) 2025-03-19T06:50:24 0:00:00
Previous 0386 (3-changed-components) 2025-03-01T04:10:59 0:00:00
Baseline 0001 (4-changed-components) 2023-03-24T00:16:56 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 21
Performance Improvements 46 11
Added Tests 0 106
Unchanged Tests 859 780
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 12.23% 139.000 156.000 - 0.00% -
511.povray_r 2.75% 400.000 411.000 - 1.73% -
603.bwaves_s 1.18% 8962.000 9068.000 - 0.06% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s (unexplained diff vs previous) 211.76% 34.000 106.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) 208.16% 49.000 151.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) 207.89% 0.380 1.170 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 206.25% 0.160 0.490 - 0.00% -
511.povray_r 33.33% 3.000 4.000 - 0.00% -
511.povray_r (avg) 33.33% 3.000 4.000 - 0.00% -
644.nab_s 1.56% 64.000 65.000 - 0.00% -
644.nab_s (avg) 1.56% 64.000 65.000 - 0.00% -
510.parest_r 1.49% 67.000 68.000 - 0.00% -
510.parest_r (avg) 1.49% 67.000 68.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s -1.37% 295349.000 291301.000 - -1.57% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
600.perlbench_s -3.82% 2066.000 1987.000 - -4.47% -
621.wrf_s -1.56% 7180.000 7068.000 - -23.77% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -71.43% 42.000 12.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -71.15% 1.040 0.300 - 0.00% -
620.omnetpp_s (max) -47.69% 65.000 34.000 - 0.00% -
620.omnetpp_s (max) (percentage) -47.24% 1.630 0.860 - 0.00% -
508.namd_r (max) (percentage) -10.71% 1.120 1.000 - 0.00% -
605.mcf_s (max) (percentage) -10.64% 0.470 0.420 - 0.00% -
605.mcf_s (max) -9.68% 31.000 28.000 - 0.00% -
508.namd_r (max) -9.38% 32.000 29.000 - 0.00% -
603.bwaves_s (max) (percentage) -7.43% 5.250 4.860 - 0.00% -
654.roms_s (max) -7.35% 2597.000 2406.000 - 0.00% -
526.blender_r (max) (percentage) -7.05% 1.560 1.450 - 0.00% -
526.blender_r (max) -6.75% 163.000 152.000 - 0.00% -
644.nab_s (max) (percentage) -6.58% 0.760 0.710 - 0.00% -
654.roms_s (max) (percentage) -6.50% 8.920 8.340 - 0.00% -
603.bwaves_s (max) -6.38% 470.000 440.000 - 0.00% -
648.exchange2_s (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
511.povray_r (max) (percentage) -5.23% 1.720 1.630 - 0.00% -
644.nab_s (max) -4.88% 82.000 78.000 - 0.00% -
600.perlbench_s (max) -4.76% 42.000 40.000 - 0.00% -
631.deepsjeng_s (max) -4.00% 50.000 48.000 - 0.00% -
625.x264_s (max) (percentage) -3.98% 2.010 1.930 - 0.00% -
625.x264_s (max) -3.92% 51.000 49.000 - 0.00% -
638.imagick_s (max) -3.85% 78.000 75.000 - 0.00% -
510.parest_r (max) (percentage) -3.78% 1.850 1.780 - 0.00% -
510.parest_r (max) -3.77% 106.000 102.000 - 0.00% -
641.leela_s (max) (percentage) -3.65% 1.370 1.320 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.55% 1.410 1.360 - 0.00% -
638.imagick_s (max) (percentage) -3.50% 1.430 1.380 - 0.00% -
641.leela_s (max) -3.45% 58.000 56.000 - 0.00% -
628.pop2_s (max) (percentage) -3.33% 0.900 0.870 - 0.00% -
628.pop2_s (max) -3.30% 91.000 88.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -3.25% 2.770 2.680 - 0.00% -
657.xz_s (max) (percentage) -3.24% 2.470 2.390 - 0.00% -
600.perlbench_s -3.23% 31.000 30.000 - 0.00% -
600.perlbench_s (avg) -3.23% 31.000 30.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -2.99% 0.670 0.650 - 0.00% -
649.fotonik3d_s (max) -2.95% 271.000 263.000 - 0.00% -
619.lbm_s (max) (percentage) -2.78% 10.800 10.500 - 0.00% -
619.lbm_s (max) -2.33% 3346.000 3268.000 - 0.00% -
600.perlbench_s (max) (percentage) -1.92% 2.080 2.040 - 0.00% -
657.xz_s (max) -1.75% 57.000 56.000 - 0.00% -
607.cactuBSSN_s (max) -1.71% 117.000 115.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.15% 6.950 6.870 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 4.97% 613265.000 643741.000 - 0.73% -
621.wrf_s 3.78% 13460511.000 13968678.000 - 0.08% -
510.parest_r 2.73% 1458341.000 1498100.000 - -0.01% -
657.xz_s 2.32% 135153.000 138289.000 - -0.19% -
600.perlbench_s 1.95% 2151136.000 2193107.000 - 0.12% -
628.pop2_s 1.20% 2872616.000 2907041.000 - -0.55% -
605.mcf_s 1.03% 16285.000 16453.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 64.67% 3334.000 5490.000 - 0.18% -
508.namd_r 19.69% 2428.000 2906.000 - -0.14% -
648.exchange2_s 9.91% 2221.000 2441.000 - 0.04% -
625.x264_s 9.24% 2359.000 2577.000 - 0.51% -
619.lbm_s 8.86% 28600.000 31133.000 - 0.49% -
657.xz_s 6.20% 2211.000 2348.000 - 0.73% -
654.roms_s 5.94% 27239.000 28857.000 - -0.89% -
644.nab_s 5.07% 10486.000 11018.000 - 1.00% -
526.blender_r 5.03% 10028.000 10532.000 - 0.48% -
607.cactuBSSN_s 3.31% 4835.000 4995.000 - -0.77% -
641.leela_s 3.16% 4176.000 4308.000 - 0.09% -
631.deepsjeng_s 2.39% 3479.000 3562.000 - 0.03% -
605.mcf_s 1.74% 6721.000 6838.000 - 0.91% -
511.povray_r 1.73% 404.000 411.000 - 2.75% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -10.55% 60958.000 54524.000 - 0.08% -
619.lbm_s -2.68% 12965.000 12617.000 - 0.00% -
603.bwaves_s -2.27% 47699.000 46615.000 - 0.00% -
649.fotonik3d_s -1.57% 295938.000 291301.000 - -1.37% -
644.nab_s -1.34% 91858.000 90630.000 - -0.31% -
620.omnetpp_s -1.21% 1699582.000 1679061.000 - -0.05% -
638.imagick_s -1.21% 1298946.000 1283282.000 - -0.11% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -23.77% 9272.000 7068.000 - -1.56% -
600.perlbench_s -4.47% 2080.000 1987.000 - -3.82% -
628.pop2_s -3.76% 10608.000 10209.000 - 0.28% -
602.gcc_s -2.06% 4182.000 4096.000 - 0.61% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2906.000 -
510.parest_r 5767.000 -
511.povray_r 411.000 2.75%
526.blender_r 10532.000 -
600.perlbench_s 1987.000 -3.82%
602.gcc_s 4096.000 -
603.bwaves_s 9068.000 1.18%
605.mcf_s 6838.000 -
607.cactuBSSN_s 4995.000 -
619.lbm_s 31133.000 -
620.omnetpp_s 4051.000 -
621.wrf_s 7068.000 -1.56%
623.xalancbmk_s 3247.000 -
625.x264_s 2577.000 -
627.cam4_s 156.000 12.23%
628.pop2_s 10209.000 -
631.deepsjeng_s 3562.000 -
638.imagick_s 5490.000 -
641.leela_s 4308.000 -
644.nab_s 11018.000 -
648.exchange2_s 2441.000 -
649.fotonik3d_s 9824.000 -
654.roms_s 28857.000 -
657.xz_s 2348.000 -
Geometric Mean 4430.713 -
Name Current %
508.namd_r 643741.000 -
510.parest_r 1498100.000 -
511.povray_r 836605.000 -
526.blender_r 9369009.000 -
600.perlbench_s 2193107.000 -
602.gcc_s 8917786.000 -
603.bwaves_s 46615.000 -
605.mcf_s 16453.000 -
607.cactuBSSN_s 2778724.000 -
619.lbm_s 12617.000 -
620.omnetpp_s 1679061.000 -
621.wrf_s 13968678.000 -
623.xalancbmk_s 3431122.000 -
625.x264_s 436406.000 -
628.pop2_s 2907041.000 -
631.deepsjeng_s 70484.000 -
638.imagick_s 1283282.000 -
641.leela_s 80559.000 -
644.nab_s 90630.000 -
648.exchange2_s 54524.000 -
649.fotonik3d_s 291301.000 -1.37%
654.roms_s 504669.000 -
657.xz_s 138289.000 -
Geometric Mean 520249.983 -
Name Current %
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.770 -
508.namd_r (max) 29.000 -9.38%
508.namd_r (max) (percentage) 1.000 -10.71%
510.parest_r 68.000 1.49%
510.parest_r (avg) 68.000 1.49%
510.parest_r (avg) (percentage) 1.180 -
510.parest_r (max) 102.000 -3.77%
510.parest_r (max) (percentage) 1.780 -3.78%
511.povray_r 4.000 33.33%
511.povray_r (avg) 4.000 33.33%
511.povray_r (avg) (percentage) 0.980 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.630 -5.23%
526.blender_r 74.000 -
526.blender_r (avg) 74.000 -
526.blender_r (avg) (percentage) 0.710 -
526.blender_r (max) 152.000 -6.75%
526.blender_r (max) (percentage) 1.450 -7.05%
600.perlbench_s 30.000 -3.23%
600.perlbench_s (avg) 30.000 -3.23%
600.perlbench_s (avg) (percentage) 1.510 -
600.perlbench_s (max) 40.000 -4.76%
600.perlbench_s (max) (percentage) 2.040 -1.92%
603.bwaves_s 196.000 -
603.bwaves_s (avg) 196.000 -
603.bwaves_s (avg) (percentage) 2.170 -
603.bwaves_s (max) 440.000 -6.38%
603.bwaves_s (max) (percentage) 4.860 -7.43%
603.bwaves_s (unexplained diff vs previous) 106.000 211.76%
603.bwaves_s (unexplained diff vs previous) (percentage) 1.170 207.89%
605.mcf_s 75.000 -
605.mcf_s (avg) 75.000 -
605.mcf_s (avg) (percentage) 1.110 -
605.mcf_s (max) 28.000 -9.68%
605.mcf_s (max) (percentage) 0.420 -10.64%
607.cactuBSSN_s 138.000 -
607.cactuBSSN_s (avg) 138.000 -
607.cactuBSSN_s (avg) (percentage) 2.780 -
607.cactuBSSN_s (max) 115.000 -1.71%
607.cactuBSSN_s (max) (percentage) 2.320 -
619.lbm_s 2138.000 -
619.lbm_s (avg) 2138.000 -
619.lbm_s (avg) (percentage) 6.870 -1.15%
619.lbm_s (max) 3268.000 -2.33%
619.lbm_s (max) (percentage) 10.500 -2.78%
619.lbm_s (unexplained diff vs previous) 151.000 208.16%
619.lbm_s (unexplained diff vs previous) (percentage) 0.490 206.25%
620.omnetpp_s 63.000 -
620.omnetpp_s (avg) 63.000 -
620.omnetpp_s (avg) (percentage) 1.570 -
620.omnetpp_s (max) 34.000 -47.69%
620.omnetpp_s (max) (percentage) 0.860 -47.24%
620.omnetpp_s (unexplained diff vs previous) 12.000 -71.43%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.300 -71.15%
623.xalancbmk_s 26.000 -
623.xalancbmk_s (avg) 26.000 -
623.xalancbmk_s (avg) (percentage) 0.820 -
623.xalancbmk_s (max) 21.000 -
623.xalancbmk_s (max) (percentage) 0.650 -2.99%
625.x264_s 26.000 -
625.x264_s (avg) 26.000 -
625.x264_s (avg) (percentage) 1.030 -
625.x264_s (max) 49.000 -3.92%
625.x264_s (max) (percentage) 1.930 -3.98%
628.pop2_s 103.000 -
628.pop2_s (avg) 103.000 -
628.pop2_s (avg) (percentage) 1.010 -
628.pop2_s (max) 88.000 -3.30%
628.pop2_s (max) (percentage) 0.870 -3.33%
631.deepsjeng_s 32.000 -
631.deepsjeng_s (avg) 32.000 -
631.deepsjeng_s (avg) (percentage) 0.900 -
631.deepsjeng_s (max) 48.000 -4.00%
631.deepsjeng_s (max) (percentage) 1.360 -3.55%
638.imagick_s 58.000 -
638.imagick_s (avg) 58.000 -
638.imagick_s (avg) (percentage) 1.060 -
638.imagick_s (max) 75.000 -3.85%
638.imagick_s (max) (percentage) 1.380 -3.50%
641.leela_s 25.000 -
641.leela_s (avg) 25.000 -
641.leela_s (avg) (percentage) 0.590 -
641.leela_s (max) 56.000 -3.45%
641.leela_s (max) (percentage) 1.320 -3.65%
644.nab_s 65.000 1.56%
644.nab_s (avg) 65.000 1.56%
644.nab_s (avg) (percentage) 0.590 -
644.nab_s (max) 78.000 -4.88%
644.nab_s (max) (percentage) 0.710 -6.58%
648.exchange2_s 11.000 -
648.exchange2_s (avg) 11.000 -
648.exchange2_s (avg) (percentage) 0.460 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.150 -6.25%
649.fotonik3d_s 167.000 -
649.fotonik3d_s (avg) 167.000 -
649.fotonik3d_s (avg) (percentage) 1.710 -
649.fotonik3d_s (max) 263.000 -2.95%
649.fotonik3d_s (max) (percentage) 2.680 -3.25%
654.roms_s 984.000 -
654.roms_s (avg) 984.000 -
654.roms_s (avg) (percentage) 3.410 -
654.roms_s (max) 2406.000 -7.35%
654.roms_s (max) (percentage) 8.340 -6.50%
657.xz_s 31.000 -
657.xz_s (avg) 31.000 -
657.xz_s (avg) (percentage) 1.340 -
657.xz_s (max) 56.000 -1.75%
657.xz_s (max) (percentage) 2.390 -3.24%
Geometric Mean 13.312 -