Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e64cd55419b79018caf66043fb9db77aef0abb1d (+ 58 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (736ae0a005d21230b141e9eb94cfd61032f8db19) (+ 146 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=319f94dea2b7eeff12adb22ee50b46b64dd6a52d (+ 26 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f871ce2482ed3a48ea0e1080bfeb7e4d6e99f78 (+ 345 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/411/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0411 (4-changed-components) 2025-05-19T00:37:03 0:00:00
Previous 0409 (3-changed-components) 2025-05-13T16:46:54 0:00:00
Baseline 0001 (4-changed-components) 2023-03-24T00:16:56 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 10 25
Performance Improvements 53 10
Added Tests 10 108
Unchanged Tests 833 763
Total Tests 906

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.47% 285824.000 290028.000 - -2.00% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
644.nab_s 1.03% 10946.000 11059.000 - 5.46% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) 500.00% 0.020 0.120 - 0.00% -
619.lbm_s (unexplained diff vs previous) 442.86% 7.000 38.000 - 0.00% -
644.nab_s 1.52% 66.000 67.000 - 0.00% -
644.nab_s (avg) 1.52% 66.000 67.000 - 0.00% -
526.blender_r 1.39% 72.000 73.000 - 0.00% -
526.blender_r (avg) 1.39% 72.000 73.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -4.17% 24.000 23.000 - -4.17% -
nb_total_tests -4.17% 24.000 23.000 - -4.17% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s -13.46% 156.000 135.000 - 0.00% -
621.wrf_s -2.08% 7342.000 7189.000 - -22.47% -
623.xalancbmk_s -1.17% 3152.000 3115.000 - -4.42% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) -66.67% 0.120 0.040 - 0.00% -
620.omnetpp_s (max) -42.55% 47.000 27.000 - 0.00% -
620.omnetpp_s (max) (percentage) -41.38% 1.160 0.680 - 0.00% -
657.xz_s (max) -4.88% 41.000 39.000 - 0.00% -
623.xalancbmk_s (max) -4.55% 22.000 21.000 - 0.00% -
603.bwaves_s (max) -4.05% 222.000 213.000 - 0.00% -
508.namd_r (max) -3.70% 27.000 26.000 - 0.00% -
603.bwaves_s (max) (percentage) -3.67% 2.450 2.360 - 0.00% -
511.povray_r (max) (percentage) -3.59% 1.950 1.880 - 0.00% -
631.deepsjeng_s (max) -3.57% 28.000 27.000 - 0.00% -
657.xz_s -3.23% 31.000 30.000 - 0.00% -
657.xz_s (avg) -3.23% 31.000 30.000 - 0.00% -
638.imagick_s (max) -3.17% 63.000 61.000 - 0.00% -
605.mcf_s (max) -3.16% 95.000 92.000 - 0.00% -
644.nab_s (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
649.fotonik3d_s (max) -3.03% 99.000 96.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -2.94% 1.020 0.990 - 0.00% -
657.xz_s (max) (percentage) -2.86% 1.750 1.700 - 0.00% -
644.nab_s (max) -2.86% 105.000 102.000 - 0.00% -
605.mcf_s (max) (percentage) -2.86% 1.400 1.360 - 0.00% -
510.parest_r (max) (percentage) -2.58% 1.550 1.510 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.50% 0.800 0.780 - 0.00% -
648.exchange2_s (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
510.parest_r (max) -2.22% 90.000 88.000 - 0.00% -
508.namd_r (max) (percentage) -2.11% 0.950 0.930 - 0.00% -
625.x264_s (avg) (percentage) -2.00% 1.000 0.980 - 0.00% -
628.pop2_s (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
628.pop2_s (max) -1.85% 54.000 53.000 - 0.00% -
607.cactuBSSN_s (avg) (percentage) -1.83% 2.730 2.680 - 0.00% -
625.x264_s (max) (percentage) -1.79% 0.560 0.550 - 0.00% -
600.perlbench_s (max) (percentage) -1.78% 1.690 1.660 - 0.00% -
638.imagick_s (max) (percentage) -1.74% 1.150 1.130 - 0.00% -
607.cactuBSSN_s (max) (percentage) -1.73% 1.730 1.700 - 0.00% -
654.roms_s (max) (percentage) -1.69% 6.490 6.380 - 0.00% -
620.omnetpp_s -1.59% 63.000 62.000 - 0.00% -
620.omnetpp_s (avg) -1.59% 63.000 62.000 - 0.00% -
607.cactuBSSN_s -1.47% 136.000 134.000 - 0.00% -
607.cactuBSSN_s (avg) -1.47% 136.000 134.000 - 0.00% -
619.lbm_s -1.41% 2196.000 2165.000 - 0.00% -
619.lbm_s (avg) -1.41% 2196.000 2165.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.41% 0.710 0.700 - 0.00% -
654.roms_s (max) -1.38% 1888.000 1862.000 - 0.00% -
605.mcf_s -1.33% 75.000 74.000 - 0.00% -
605.mcf_s (avg) -1.33% 75.000 74.000 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.29% 1.550 1.530 - 0.00% -
619.lbm_s (avg) (percentage) -1.28% 7.050 6.960 - 0.00% -
607.cactuBSSN_s (max) -1.16% 86.000 85.000 - 0.00% -
631.deepsjeng_s (avg) (percentage) -1.12% 0.890 0.880 - 0.00% -
526.blender_r (max) (percentage) -1.09% 0.920 0.910 - 0.00% -

Added Tests - sample variability
607.cactuBSSN_s (unexplained diff vs previous)
607.cactuBSSN_s (unexplained diff vs previous) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)
657.xz_s (unexplained diff vs previous)
657.xz_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s 4.87% 13460511.000 14115458.000 - 0.00% -
508.namd_r 3.71% 613265.000 635992.000 - -0.02% -
510.parest_r 3.10% 1458341.000 1503540.000 - 0.28% -
657.xz_s 2.40% 135153.000 138393.000 - 0.01% -
600.perlbench_s 2.18% 2151136.000 2198075.000 - -0.19% -
607.cactuBSSN_s 1.99% 2773236.000 2828526.000 - 0.00% -
628.pop2_s 1.71% 2872616.000 2921617.000 - 0.99% -
605.mcf_s 1.47% 16285.000 16525.000 - 0.05% -
625.x264_s 1.36% 435471.000 441381.000 - 0.00% -
641.leela_s 1.10% 80027.000 80907.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 64.34% 3334.000 5479.000 - -0.22% -
508.namd_r 19.19% 2428.000 2894.000 - 0.80% -
648.exchange2_s 9.59% 2221.000 2434.000 - 0.04% -
625.x264_s 9.33% 2359.000 2579.000 - 0.08% -
619.lbm_s 8.79% 28600.000 31114.000 - -0.12% -
654.roms_s 7.16% 27239.000 29190.000 - 0.31% -
657.xz_s 5.83% 2211.000 2340.000 - -0.55% -
526.blender_r 5.68% 10028.000 10598.000 - 0.83% -
644.nab_s 5.46% 10486.000 11059.000 - 1.03% -
607.cactuBSSN_s 3.43% 4835.000 5001.000 - -0.28% -
641.leela_s 2.35% 4176.000 4274.000 - -0.23% -
631.deepsjeng_s 2.13% 3479.000 3553.000 - -0.08% -
510.parest_r 1.25% 5765.000 5837.000 - -0.12% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.17% 24.000 23.000 - -4.17% -
nb_total_tests -4.17% 24.000 23.000 - -4.17% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -10.80% 60958.000 54376.000 - 0.01% -
619.lbm_s -2.62% 12965.000 12625.000 - 0.06% -
649.fotonik3d_s -2.00% 295938.000 290028.000 - 1.47% -
638.imagick_s -1.71% 1298946.000 1276726.000 - 0.00% -
644.nab_s -1.36% 91858.000 90606.000 - 0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -22.47% 9272.000 7189.000 - -2.08% -
623.xalancbmk_s -4.42% 3259.000 3115.000 - -1.17% -
600.perlbench_s -4.09% 2080.000 1995.000 - 0.40% -
628.pop2_s -3.08% 10608.000 10281.000 - -0.46% -
602.gcc_s -2.58% 4182.000 4074.000 - -0.63% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2894.000 -
510.parest_r 5837.000 -
511.povray_r 400.000 -
526.blender_r 10598.000 -
600.perlbench_s 1995.000 -
602.gcc_s 4074.000 -
603.bwaves_s 9063.000 -
605.mcf_s 6778.000 -
607.cactuBSSN_s 5001.000 -
619.lbm_s 31114.000 -
620.omnetpp_s 4069.000 -
621.wrf_s 7189.000 -2.08%
623.xalancbmk_s 3115.000 -1.17%
625.x264_s 2579.000 -
627.cam4_s 135.000 -13.46%
628.pop2_s 10281.000 -
631.deepsjeng_s 3553.000 -
638.imagick_s 5479.000 -
641.leela_s 4274.000 -
644.nab_s 11059.000 1.03%
648.exchange2_s 2434.000 -
649.fotonik3d_s 9786.000 -
654.roms_s 29190.000 -
657.xz_s 2340.000 -
Geometric Mean 4396.251 -
Name Current %
508.namd_r 635992.000 -
510.parest_r 1503540.000 -
511.povray_r 841081.000 -
526.blender_r 9381448.000 -
600.perlbench_s 2198075.000 -
602.gcc_s 8934618.000 -
603.bwaves_s 47623.000 -
605.mcf_s 16525.000 -
607.cactuBSSN_s 2828526.000 -
619.lbm_s 12625.000 -
620.omnetpp_s 1686244.000 -
621.wrf_s 14115458.000 -
623.xalancbmk_s 3433598.000 -
625.x264_s 441381.000 -
628.pop2_s 2921617.000 -
631.deepsjeng_s 70884.000 -
638.imagick_s 1276726.000 -
641.leela_s 80907.000 -
644.nab_s 90606.000 -
648.exchange2_s 54376.000 -
649.fotonik3d_s 290028.000 1.47%
654.roms_s 508777.000 -
657.xz_s 138393.000 -
Geometric Mean 522167.284 -
Name Current %
nb_compile_successful 23.000 -4.17%
nb_execution_successful 23.000 -
nb_total_tests 23.000 -4.17%
Geometric Mean 23.000 -2.80%
Name Current %
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.770 -
508.namd_r (max) 26.000 -3.70%
508.namd_r (max) (percentage) 0.930 -2.11%
510.parest_r 69.000 -
510.parest_r (avg) 69.000 -
510.parest_r (avg) (percentage) 1.190 -
510.parest_r (max) 88.000 -2.22%
510.parest_r (max) (percentage) 1.510 -2.58%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.990 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.880 -3.59%
526.blender_r 73.000 1.39%
526.blender_r (avg) 73.000 1.39%
526.blender_r (avg) (percentage) 0.690 -
526.blender_r (max) 96.000 -
526.blender_r (max) (percentage) 0.910 -1.09%
600.perlbench_s 29.000 -
600.perlbench_s (avg) 29.000 -
600.perlbench_s (avg) (percentage) 1.490 -
600.perlbench_s (max) 33.000 -
600.perlbench_s (max) (percentage) 1.660 -1.78%
603.bwaves_s 193.000 -
603.bwaves_s (avg) 193.000 -
603.bwaves_s (avg) (percentage) 2.140 -
603.bwaves_s (max) 213.000 -4.05%
603.bwaves_s (max) (percentage) 2.360 -3.67%
605.mcf_s 74.000 -1.33%
605.mcf_s (avg) 74.000 -1.33%
605.mcf_s (avg) (percentage) 1.100 -
605.mcf_s (max) 92.000 -3.16%
605.mcf_s (max) (percentage) 1.360 -2.86%
607.cactuBSSN_s 134.000 -1.47%
607.cactuBSSN_s (avg) 134.000 -1.47%
607.cactuBSSN_s (avg) (percentage) 2.680 -1.83%
607.cactuBSSN_s (max) 85.000 -1.16%
607.cactuBSSN_s (max) (percentage) 1.700 -1.73%
607.cactuBSSN_s (unexplained diff vs previous) 14.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.280 -
619.lbm_s 2165.000 -1.41%
619.lbm_s (avg) 2165.000 -1.41%
619.lbm_s (avg) (percentage) 6.960 -1.28%
619.lbm_s (max) 2526.000 -
619.lbm_s (max) (percentage) 8.120 -
619.lbm_s (unexplained diff vs previous) 38.000 442.86%
619.lbm_s (unexplained diff vs previous) (percentage) 0.120 500.00%
620.omnetpp_s 62.000 -1.59%
620.omnetpp_s (avg) 62.000 -1.59%
620.omnetpp_s (avg) (percentage) 1.530 -1.29%
620.omnetpp_s (max) 27.000 -42.55%
620.omnetpp_s (max) (percentage) 0.680 -41.38%
620.omnetpp_s (unexplained diff vs previous) 0.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.000 -
623.xalancbmk_s 25.000 -
623.xalancbmk_s (avg) 25.000 -
623.xalancbmk_s (avg) (percentage) 0.820 -
623.xalancbmk_s (max) 21.000 -4.55%
623.xalancbmk_s (max) (percentage) 0.700 -1.41%
625.x264_s 25.000 -
625.x264_s (avg) 25.000 -
625.x264_s (avg) (percentage) 0.980 -2.00%
625.x264_s (max) 14.000 -
625.x264_s (max) (percentage) 0.550 -1.79%
625.x264_s (unexplained diff vs previous) 2.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.080 -
628.pop2_s 101.000 -
628.pop2_s (avg) 101.000 -
628.pop2_s (avg) (percentage) 0.990 -
628.pop2_s (max) 53.000 -1.85%
628.pop2_s (max) (percentage) 0.520 -1.89%
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.880 -1.12%
631.deepsjeng_s (max) 27.000 -3.57%
631.deepsjeng_s (max) (percentage) 0.780 -2.50%
631.deepsjeng_s (unexplained diff vs previous) 3.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.080 -
638.imagick_s 57.000 -
638.imagick_s (avg) 57.000 -
638.imagick_s (avg) (percentage) 1.050 -
638.imagick_s (max) 61.000 -3.17%
638.imagick_s (max) (percentage) 1.130 -1.74%
641.leela_s 24.000 -
641.leela_s (avg) 24.000 -
641.leela_s (avg) (percentage) 0.570 -
641.leela_s (max) 17.000 -
641.leela_s (max) (percentage) 0.400 -
644.nab_s 67.000 1.52%
644.nab_s (avg) 67.000 1.52%
644.nab_s (avg) (percentage) 0.610 -
644.nab_s (max) 102.000 -2.86%
644.nab_s (max) (percentage) 0.930 -3.12%
648.exchange2_s 10.000 -
648.exchange2_s (avg) 10.000 -
648.exchange2_s (avg) (percentage) 0.430 -2.27%
648.exchange2_s (max) 2.000 -
648.exchange2_s (max) (percentage) 0.120 -
648.exchange2_s (unexplained diff vs previous) 1.000 -66.67%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.040 -66.67%
649.fotonik3d_s 162.000 -
649.fotonik3d_s (avg) 162.000 -
649.fotonik3d_s (avg) (percentage) 1.660 -
649.fotonik3d_s (max) 96.000 -3.03%
649.fotonik3d_s (max) (percentage) 0.990 -2.94%
654.roms_s 974.000 -
654.roms_s (avg) 974.000 -
654.roms_s (avg) (percentage) 3.340 -
654.roms_s (max) 1862.000 -1.38%
654.roms_s (max) (percentage) 6.380 -1.69%
657.xz_s 30.000 -3.23%
657.xz_s (avg) 30.000 -3.23%
657.xz_s (avg) (percentage) 1.320 -
657.xz_s (max) 39.000 -4.88%
657.xz_s (max) (percentage) 1.700 -2.86%
657.xz_s (unexplained diff vs previous) 13.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.560 -
Geometric Mean 7.659 -30.43%