Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0b0e00271c2c2c90446827207288b3f67e9d3602 (+ 29 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (dd87540491de7242416751666089fcdbce434e7b) (+ 190 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b4495bd40578b455668887b9170059bb0d3c0dc5 (+ 2 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/392c8e00cced35ed6f84559b2c12cc07fae012e3 (+ 186 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/407/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0407 (4-changed-components) 2025-05-06T06:35:08 0:00:00
Previous 0405 (basepoints/gcc-16-00303-g1a13684dfc7) 2025-05-03T04:50:33 0:00:00
Baseline 0001 (4-changed-components) 2023-03-24T00:16:56 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 23
Performance Improvements 56 11
Added Tests 2 106
Unchanged Tests 834 766
Total Tests 906

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 6.29% 143.000 152.000 - 0.00% -
511.povray_r 1.73% 405.000 412.000 - 1.98% -
603.bwaves_s 1.72% 8913.000 9066.000 - 0.03% -
648.exchange2_s 1.50% 2397.000 2433.000 - 9.55% -
621.wrf_s 1.47% 7119.000 7224.000 - -22.09% -
605.mcf_s 1.05% 6771.000 6842.000 - 1.80% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
511.povray_r 33.33% 3.000 4.000 - 0.00% -
511.povray_r (avg) 33.33% 3.000 4.000 - 0.00% -
603.bwaves_s 1.55% 193.000 196.000 - 0.00% -
603.bwaves_s (avg) 1.55% 193.000 196.000 - 0.00% -
644.nab_s 1.54% 65.000 66.000 - 0.00% -
644.nab_s (avg) 1.54% 65.000 66.000 - 0.00% -
605.mcf_s 1.33% 75.000 76.000 - 0.00% -
605.mcf_s (avg) 1.33% 75.000 76.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r -1.87% 647517.000 635436.000 - 3.62% -
649.fotonik3d_s -1.50% 290808.000 286456.000 - -3.20% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
607.cactuBSSN_s -1.68% 5000.000 4916.000 - 1.68% -
526.blender_r -1.17% 10640.000 10515.000 - 4.86% -
600.perlbench_s -1.10% 2003.000 1981.000 - -4.76% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -84.21% 76.000 12.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -84.21% 1.900 0.300 - 0.00% -
619.lbm_s (unexplained diff vs previous) -50.00% 54.000 27.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -47.06% 0.170 0.090 - 0.00% -
620.omnetpp_s (max) (percentage) -36.07% 2.190 1.400 - 0.00% -
620.omnetpp_s (max) -35.63% 87.000 56.000 - 0.00% -
603.bwaves_s (max) (percentage) -14.11% 3.190 2.740 - 0.00% -
603.bwaves_s (max) -12.68% 284.000 248.000 - 0.00% -
619.lbm_s (max) -9.69% 4210.000 3802.000 - 0.00% -
619.lbm_s (max) (percentage) -9.62% 13.520 12.220 - 0.00% -
508.namd_r (max) -6.45% 31.000 29.000 - 0.00% -
625.x264_s (max) -6.25% 16.000 15.000 - 0.00% -
605.mcf_s (max) (percentage) -6.17% 1.620 1.520 - 0.00% -
644.nab_s (max) (percentage) -6.04% 1.490 1.400 - 0.00% -
644.nab_s (max) -5.52% 163.000 154.000 - 0.00% -
605.mcf_s (max) -5.50% 109.000 103.000 - 0.00% -
526.blender_r (max) -4.81% 104.000 99.000 - 0.00% -
625.x264_s (max) (percentage) -4.76% 0.630 0.600 - 0.00% -
508.namd_r (max) (percentage) -4.67% 1.070 1.020 - 0.00% -
623.xalancbmk_s (max) -4.17% 24.000 23.000 - 0.00% -
657.xz_s (max) -4.00% 50.000 48.000 - 0.00% -
600.perlbench_s -3.33% 30.000 29.000 - 0.00% -
600.perlbench_s (avg) -3.33% 30.000 29.000 - 0.00% -
526.blender_r (max) (percentage) -3.06% 0.980 0.950 - 0.00% -
600.perlbench_s (max) -2.86% 35.000 34.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -2.60% 0.770 0.750 - 0.00% -
641.leela_s (max) (percentage) -2.59% 1.160 1.130 - 0.00% -
511.povray_r (max) (percentage) -2.50% 1.200 1.170 - 0.00% -
654.roms_s (max) -2.42% 2021.000 1972.000 - 0.00% -
657.xz_s (max) (percentage) -2.34% 2.140 2.090 - 0.00% -
654.roms_s (max) (percentage) -2.18% 6.890 6.740 - 0.00% -
607.cactuBSSN_s -2.16% 139.000 136.000 - 0.00% -
607.cactuBSSN_s (avg) -2.16% 139.000 136.000 - 0.00% -
649.fotonik3d_s (max) -2.15% 233.000 228.000 - 0.00% -
641.leela_s (max) -2.04% 49.000 48.000 - 0.00% -
628.pop2_s (max) (percentage) -1.79% 0.560 0.550 - 0.00% -
607.cactuBSSN_s (max) -1.75% 114.000 112.000 - 0.00% -
628.pop2_s (max) -1.75% 57.000 56.000 - 0.00% -
600.perlbench_s (max) (percentage) -1.69% 1.780 1.750 - 0.00% -
649.fotonik3d_s (max) (percentage) -1.67% 2.390 2.350 - 0.00% -
638.imagick_s (max) (percentage) -1.67% 1.200 1.180 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.65% 1.210 1.190 - 0.00% -
638.imagick_s (max) -1.54% 65.000 64.000 - 0.00% -
526.blender_r -1.33% 75.000 74.000 - 0.00% -
526.blender_r (avg) -1.33% 75.000 74.000 - 0.00% -
619.lbm_s -1.32% 2273.000 2243.000 - 0.00% -
619.lbm_s (avg) -1.32% 2273.000 2243.000 - 0.00% -
510.parest_r (max) (percentage) -1.29% 1.550 1.530 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.26% 1.590 1.570 - 0.00% -
619.lbm_s (avg) (percentage) -1.23% 7.300 7.210 - 0.00% -
510.parest_r (max) -1.12% 89.000 88.000 - 0.00% -

Added Tests - sample variability
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s 4.89% 13460511.000 14118982.000 - 0.02% -
508.namd_r 3.62% 613265.000 635436.000 - -1.87% -
510.parest_r 2.80% 1458341.000 1499132.000 - -0.40% -
657.xz_s 2.39% 135153.000 138385.000 - -0.02% -
607.cactuBSSN_s 2.14% 2773236.000 2832559.000 - 0.58% -
600.perlbench_s 1.99% 2151136.000 2194027.000 - 0.34% -
605.mcf_s 1.42% 16285.000 16517.000 - 0.00% -
625.x264_s 1.36% 435471.000 441405.000 - 0.22% -
641.leela_s 1.09% 80027.000 80899.000 - -0.11% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 64.61% 3334.000 5488.000 - 0.04% -
508.namd_r 19.48% 2428.000 2901.000 - 0.03% -
625.x264_s 9.71% 2359.000 2588.000 - 0.82% -
648.exchange2_s 9.55% 2221.000 2433.000 - 1.50% -
619.lbm_s 8.79% 28600.000 31113.000 - -0.09% -
654.roms_s 7.42% 27239.000 29260.000 - -0.27% -
657.xz_s 5.70% 2211.000 2337.000 - -0.09% -
644.nab_s 5.17% 10486.000 11028.000 - 0.61% -
526.blender_r 4.86% 10028.000 10515.000 - -1.17% -
641.leela_s 2.42% 4176.000 4277.000 - 0.71% -
631.deepsjeng_s 2.16% 3479.000 3554.000 - 0.17% -
511.povray_r 1.98% 404.000 412.000 - 1.73% -
605.mcf_s 1.80% 6721.000 6842.000 - 1.05% -
607.cactuBSSN_s 1.68% 4835.000 4916.000 - -1.68% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -10.81% 60958.000 54368.000 - -0.37% -
649.fotonik3d_s -3.20% 295938.000 286456.000 - -1.50% -
619.lbm_s -2.68% 12965.000 12617.000 - 0.00% -
638.imagick_s -1.71% 1298946.000 1276710.000 - 0.16% -
644.nab_s -1.27% 91858.000 90694.000 - -0.06% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -22.09% 9272.000 7224.000 - 1.47% -
600.perlbench_s -4.76% 2080.000 1981.000 - -1.10% -
628.pop2_s -3.20% 10608.000 10269.000 - -0.65% -
602.gcc_s -2.25% 4182.000 4088.000 - 0.15% -
623.xalancbmk_s -1.99% 3259.000 3194.000 - -0.28% -
620.omnetpp_s -1.61% 4088.000 4022.000 - 0.30% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2901.000 -
510.parest_r 5752.000 -
511.povray_r 412.000 1.73%
526.blender_r 10515.000 -1.17%
600.perlbench_s 1981.000 -1.10%
602.gcc_s 4088.000 -
603.bwaves_s 9066.000 1.72%
605.mcf_s 6842.000 1.05%
607.cactuBSSN_s 4916.000 -1.68%
619.lbm_s 31113.000 -
620.omnetpp_s 4022.000 -
621.wrf_s 7224.000 1.47%
623.xalancbmk_s 3194.000 -
625.x264_s 2588.000 -
627.cam4_s 152.000 6.29%
628.pop2_s 10269.000 -
631.deepsjeng_s 3554.000 -
638.imagick_s 5488.000 -
641.leela_s 4277.000 -
644.nab_s 11028.000 -
648.exchange2_s 2433.000 1.50%
649.fotonik3d_s 9733.000 -
654.roms_s 29260.000 -
657.xz_s 2337.000 -
Geometric Mean 4420.622 -
Name Current %
508.namd_r 635436.000 -1.87%
510.parest_r 1499132.000 -
511.povray_r 841521.000 -
526.blender_r 9382060.000 -
600.perlbench_s 2194027.000 -
602.gcc_s 8922186.000 -
603.bwaves_s 47647.000 -
605.mcf_s 16517.000 -
607.cactuBSSN_s 2832559.000 -
619.lbm_s 12617.000 -
620.omnetpp_s 1686236.000 -
621.wrf_s 14118982.000 -
623.xalancbmk_s 3439646.000 -
625.x264_s 441405.000 -
628.pop2_s 2893185.000 -
631.deepsjeng_s 70812.000 -
638.imagick_s 1276710.000 -
641.leela_s 80899.000 -
644.nab_s 90694.000 -
648.exchange2_s 54368.000 -
649.fotonik3d_s 286456.000 -1.50%
654.roms_s 504705.000 -
657.xz_s 138385.000 -
Geometric Mean 521392.377 -
Name Current %
508.namd_r 22.000 -
508.namd_r (avg) 22.000 -
508.namd_r (avg) (percentage) 0.770 -
508.namd_r (max) 29.000 -6.45%
508.namd_r (max) (percentage) 1.020 -4.67%
510.parest_r 68.000 -
510.parest_r (avg) 68.000 -
510.parest_r (avg) (percentage) 1.190 -
510.parest_r (max) 88.000 -1.12%
510.parest_r (max) (percentage) 1.530 -1.29%
511.povray_r 4.000 33.33%
511.povray_r (avg) 4.000 33.33%
511.povray_r (avg) (percentage) 0.980 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.170 -2.50%
526.blender_r 74.000 -1.33%
526.blender_r (avg) 74.000 -1.33%
526.blender_r (avg) (percentage) 0.710 -
526.blender_r (max) 99.000 -4.81%
526.blender_r (max) (percentage) 0.950 -3.06%
600.perlbench_s 29.000 -3.33%
600.perlbench_s (avg) 29.000 -3.33%
600.perlbench_s (avg) (percentage) 1.510 -
600.perlbench_s (max) 34.000 -2.86%
600.perlbench_s (max) (percentage) 1.750 -1.69%
603.bwaves_s 196.000 1.55%
603.bwaves_s (avg) 196.000 1.55%
603.bwaves_s (avg) (percentage) 2.170 -
603.bwaves_s (max) 248.000 -12.68%
603.bwaves_s (max) (percentage) 2.740 -14.11%
603.bwaves_s (unexplained diff vs previous) 153.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.690 -
605.mcf_s 76.000 1.33%
605.mcf_s (avg) 76.000 1.33%
605.mcf_s (avg) (percentage) 1.120 -
605.mcf_s (max) 103.000 -5.50%
605.mcf_s (max) (percentage) 1.520 -6.17%
607.cactuBSSN_s 136.000 -2.16%
607.cactuBSSN_s (avg) 136.000 -2.16%
607.cactuBSSN_s (avg) (percentage) 2.780 -
607.cactuBSSN_s (max) 112.000 -1.75%
607.cactuBSSN_s (max) (percentage) 2.280 -
619.lbm_s 2243.000 -1.32%
619.lbm_s (avg) 2243.000 -1.32%
619.lbm_s (avg) (percentage) 7.210 -1.23%
619.lbm_s (max) 3802.000 -9.69%
619.lbm_s (max) (percentage) 12.220 -9.62%
619.lbm_s (unexplained diff vs previous) 27.000 -50.00%
619.lbm_s (unexplained diff vs previous) (percentage) 0.090 -47.06%
620.omnetpp_s 63.000 -
620.omnetpp_s (avg) 63.000 -
620.omnetpp_s (avg) (percentage) 1.570 -1.26%
620.omnetpp_s (max) 56.000 -35.63%
620.omnetpp_s (max) (percentage) 1.400 -36.07%
620.omnetpp_s (unexplained diff vs previous) 12.000 -84.21%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.300 -84.21%
623.xalancbmk_s 26.000 -
623.xalancbmk_s (avg) 26.000 -
623.xalancbmk_s (avg) (percentage) 0.820 -
623.xalancbmk_s (max) 23.000 -4.17%
623.xalancbmk_s (max) (percentage) 0.750 -2.60%
625.x264_s 26.000 -
625.x264_s (avg) 26.000 -
625.x264_s (avg) (percentage) 1.020 -
625.x264_s (max) 15.000 -6.25%
625.x264_s (max) (percentage) 0.600 -4.76%
628.pop2_s 101.000 -
628.pop2_s (avg) 101.000 -
628.pop2_s (avg) (percentage) 0.990 -
628.pop2_s (max) 56.000 -1.75%
628.pop2_s (max) (percentage) 0.550 -1.79%
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.900 -
631.deepsjeng_s (max) 42.000 -
631.deepsjeng_s (max) (percentage) 1.190 -1.65%
638.imagick_s 57.000 -
638.imagick_s (avg) 57.000 -
638.imagick_s (avg) (percentage) 1.050 -
638.imagick_s (max) 64.000 -1.54%
638.imagick_s (max) (percentage) 1.180 -1.67%
641.leela_s 24.000 -
641.leela_s (avg) 24.000 -
641.leela_s (avg) (percentage) 0.580 -
641.leela_s (max) 48.000 -2.04%
641.leela_s (max) (percentage) 1.130 -2.59%
644.nab_s 66.000 1.54%
644.nab_s (avg) 66.000 1.54%
644.nab_s (avg) (percentage) 0.600 -
644.nab_s (max) 154.000 -5.52%
644.nab_s (max) (percentage) 1.400 -6.04%
648.exchange2_s 10.000 -
648.exchange2_s (avg) 10.000 -
648.exchange2_s (avg) (percentage) 0.450 -
648.exchange2_s (max) 2.000 -
648.exchange2_s (max) (percentage) 0.120 -
649.fotonik3d_s 163.000 -
649.fotonik3d_s (avg) 163.000 -
649.fotonik3d_s (avg) (percentage) 1.680 -
649.fotonik3d_s (max) 228.000 -2.15%
649.fotonik3d_s (max) (percentage) 2.350 -1.67%
654.roms_s 977.000 -
654.roms_s (avg) 977.000 -
654.roms_s (avg) (percentage) 3.340 -
654.roms_s (max) 1972.000 -2.42%
654.roms_s (max) (percentage) 6.740 -2.18%
657.xz_s 31.000 -
657.xz_s (avg) 31.000 -
657.xz_s (avg) (percentage) 1.340 -
657.xz_s (max) 48.000 -4.00%
657.xz_s (max) (percentage) 2.090 -2.34%
Geometric Mean 12.522 -5.76%