Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3e488d8ccd0fb25d9c2d33feceb9eac3e336c1b0 (+ 173 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (6901d56fea2132389e9a7ae60b4d9731e6e3c65a) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d8f7a79335b0d861c12c42aec94c04cd5bb181e2 (+ 44 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/f1f8a95d093efd12e3e7a66cb387389471fa25a6 (+ 385 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/377/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0377 (3-changed-components) 2025-05-12T07:21:30 0:00:00
Previous 0370 (basepoints/gcc-16-00190-g6901d56fea2) 2025-05-03T21:06:58 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 18
Performance Improvements 53 14
Added Tests 20 110
Unchanged Tests 814 764
Total Tests 906

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
621.wrf_s 2.81% 7005.000 7202.000 - -21.02% -
620.omnetpp_s 2.51% 4031.000 4132.000 - -0.74% -
510.parest_r 1.62% 5749.000 5842.000 - 3.64% -
644.nab_s 1.11% 11038.000 11161.000 - 6.62% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
526.blender_r (max) (percentage) 152.63% 0.570 1.440 - 0.00% -
526.blender_r (max) 151.67% 60.000 151.000 - 0.00% -
508.namd_r (max) (percentage) 95.24% 0.210 0.410 - 0.00% -
508.namd_r (max) 83.33% 6.000 11.000 - 0.00% -
648.exchange2_s (max) 20.00% 5.000 6.000 - 0.00% -
648.exchange2_s (max) (percentage) 19.05% 0.210 0.250 - 0.00% -
620.omnetpp_s 2.63% 76.000 78.000 - 0.00% -
620.omnetpp_s (avg) 2.63% 76.000 78.000 - 0.00% -
510.parest_r 2.44% 82.000 84.000 - 0.00% -
510.parest_r (avg) 2.44% 82.000 84.000 - 0.00% -
526.blender_r (avg) (percentage) 2.25% 0.890 0.910 - 0.00% -
644.nab_s 1.45% 69.000 70.000 - 0.00% -
644.nab_s (avg) 1.45% 69.000 70.000 - 0.00% -
526.blender_r 1.06% 94.000 95.000 - 0.00% -
526.blender_r (avg) 1.06% 94.000 95.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
526.blender_r -1.44% 10647.000 10494.000 - 4.39% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) -86.21% 2.320 0.320 - 0.00% -
619.lbm_s (unexplained diff vs previous) -86.19% 724.000 100.000 - 0.00% -
619.lbm_s (max) -73.05% 1959.000 528.000 - 0.00% -
619.lbm_s (max) (percentage) -72.93% 6.280 1.700 - 0.00% -
625.x264_s (max) -61.90% 21.000 8.000 - 0.00% -
625.x264_s (max) (percentage) -59.76% 0.820 0.330 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -26.06% 3.300 2.440 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -24.06% 133.000 101.000 - 0.00% -
638.imagick_s (max) -14.29% 7.000 6.000 - 0.00% -
641.leela_s (max) -14.29% 35.000 30.000 - 0.00% -
641.leela_s (max) (percentage) -13.89% 0.720 0.620 - 0.00% -
620.omnetpp_s (max) (percentage) -12.54% 3.190 2.790 - 0.00% -
511.povray_r (max) -11.11% 9.000 8.000 - 0.00% -
620.omnetpp_s (max) -10.16% 128.000 115.000 - 0.00% -
638.imagick_s (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
508.namd_r -5.00% 20.000 19.000 - 0.00% -
508.namd_r (avg) -5.00% 20.000 19.000 - 0.00% -
603.bwaves_s (max) -4.63% 367.000 350.000 - 0.00% -
605.mcf_s (max) -4.55% 88.000 84.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -4.32% 1.390 1.330 - 0.00% -
654.roms_s (max) -4.26% 352.000 337.000 - 0.00% -
625.x264_s -4.17% 24.000 23.000 - 0.00% -
625.x264_s (avg) -4.17% 24.000 23.000 - 0.00% -
654.roms_s (max) (percentage) -4.13% 1.210 1.160 - 0.00% -
600.perlbench_s -4.00% 25.000 24.000 - 0.00% -
600.perlbench_s (avg) -4.00% 25.000 24.000 - 0.00% -
605.mcf_s (max) (percentage) -3.91% 1.280 1.230 - 0.00% -
644.nab_s (max) (percentage) -3.77% 1.060 1.020 - 0.00% -
631.deepsjeng_s (max) -3.70% 27.000 26.000 - 0.00% -
603.bwaves_s (max) (percentage) -3.70% 4.050 3.900 - 0.00% -
649.fotonik3d_s (max) -3.68% 136.000 131.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.57% 2.240 2.160 - 0.00% -
510.parest_r (max) (percentage) -3.55% 1.410 1.360 - 0.00% -
628.pop2_s (max) (percentage) -3.54% 1.130 1.090 - 0.00% -
628.pop2_s (max) -3.48% 115.000 111.000 - 0.00% -
644.nab_s (max) -3.42% 117.000 113.000 - 0.00% -
657.xz_s (max) -3.33% 30.000 29.000 - 0.00% -
511.povray_r (max) (percentage) -3.24% 2.160 2.090 - 0.00% -
657.xz_s (max) (percentage) -3.05% 1.310 1.270 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.86% 0.700 0.680 - 0.00% -
607.cactuBSSN_s (max) -2.78% 108.000 105.000 - 0.00% -
510.parest_r (max) -2.47% 81.000 79.000 - 0.00% -
600.perlbench_s (max) (percentage) -2.25% 0.890 0.870 - 0.00% -
511.povray_r (avg) (percentage) -1.87% 1.070 1.050 - 0.00% -
600.perlbench_s (avg) (percentage) -1.61% 1.240 1.220 - 0.00% -
641.leela_s (avg) (percentage) -1.52% 0.660 0.650 - 0.00% -
619.lbm_s -1.51% 1850.000 1822.000 - 0.00% -
619.lbm_s (avg) -1.51% 1850.000 1822.000 - 0.00% -
607.cactuBSSN_s (avg) (percentage) -1.27% 3.140 3.100 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.27% 0.790 0.780 - 0.00% -
619.lbm_s (avg) (percentage) -1.18% 5.930 5.860 - 0.00% -
631.deepsjeng_s (avg) (percentage) -1.11% 0.900 0.890 - 0.00% -

Added Tests - sample variability
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
600.perlbench_s (unexplained diff vs previous)
600.perlbench_s (unexplained diff vs previous) (percentage)
607.cactuBSSN_s (unexplained diff vs previous)
607.cactuBSSN_s (unexplained diff vs previous) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 7.32% 60374.000 64796.000 - 0.01% -
510.parest_r 3.29% 7623044.000 7873767.000 - 0.00% -
621.wrf_s 3.01% 17057867.000 17571646.000 - -0.05% -
508.namd_r 2.58% 627398.000 643614.000 - 0.00% -
631.deepsjeng_s 2.43% 80966.000 82930.000 - 0.01% -
607.cactuBSSN_s 1.62% 3224093.000 3276459.000 - 0.00% -
600.perlbench_s 1.07% 2120214.000 2142919.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 63.99% 3346.000 5487.000 - 0.09% -
508.namd_r 20.19% 2427.000 2917.000 - 0.41% -
648.exchange2_s 10.37% 2199.000 2427.000 - 0.25% -
619.lbm_s 9.49% 28412.000 31109.000 - -0.32% -
644.nab_s 6.62% 10468.000 11161.000 - 1.11% -
654.roms_s 6.37% 27387.000 29131.000 - -0.09% -
657.xz_s 5.61% 2228.000 2353.000 - -0.38% -
526.blender_r 4.39% 10053.000 10494.000 - -1.44% -
510.parest_r 3.64% 5637.000 5842.000 - 1.62% -
631.deepsjeng_s 2.91% 3847.000 3959.000 - -0.23% -
607.cactuBSSN_s 2.86% 4748.000 4884.000 - 0.83% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -4.65% 49143.000 46859.000 - 0.02% -
641.leela_s -3.13% 147936.000 143304.000 - 0.01% -
511.povray_r -1.55% 851500.000 838332.000 - 0.00% -
620.omnetpp_s -1.52% 2027591.000 1996671.000 - 0.00% -
623.xalancbmk_s -1.27% 4496134.000 4438852.000 - 0.00% -
619.lbm_s -1.25% 16006.000 15806.000 - 0.05% -
649.fotonik3d_s -1.23% 308847.000 305046.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -21.02% 9119.000 7202.000 - 2.81% -
628.pop2_s -3.76% 10641.000 10241.000 - 0.41% -
602.gcc_s -2.37% 4307.000 4205.000 - 0.05% -
623.xalancbmk_s -2.10% 3804.000 3724.000 - 0.40% -
600.perlbench_s -1.80% 2058.000 2021.000 - 0.20% -
511.povray_r -1.41% 425.000 419.000 - -0.24% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
625.x264_s (unexplained diff vs previous)
625.x264_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2917.000 -
510.parest_r 5842.000 1.62%
511.povray_r 419.000 -
526.blender_r 10494.000 -1.44%
600.perlbench_s 2021.000 -
602.gcc_s 4205.000 -
603.bwaves_s 8994.000 -
605.mcf_s 6862.000 -
607.cactuBSSN_s 4884.000 -
619.lbm_s 31109.000 -
620.omnetpp_s 4132.000 2.51%
621.wrf_s 7202.000 2.81%
623.xalancbmk_s 3724.000 -
625.x264_s 2572.000 -
627.cam4_s 144.000 -
628.pop2_s 10241.000 -
631.deepsjeng_s 3959.000 -
638.imagick_s 5487.000 -
641.leela_s 4925.000 -
644.nab_s 11161.000 1.11%
648.exchange2_s 2427.000 -
649.fotonik3d_s 9858.000 -
654.roms_s 29131.000 -
657.xz_s 2353.000 -
Geometric Mean 4506.228 -
Name Current %
508.namd_r 643614.000 -
510.parest_r 7873767.000 -
511.povray_r 838332.000 -
526.blender_r 9745571.000 -
600.perlbench_s 2142919.000 -
602.gcc_s 9043807.000 -
603.bwaves_s 46859.000 -
605.mcf_s 21057.000 -
607.cactuBSSN_s 3276459.000 -
619.lbm_s 15806.000 -
620.omnetpp_s 1996671.000 -
621.wrf_s 17571646.000 -
623.xalancbmk_s 4438852.000 -
625.x264_s 445290.000 -
628.pop2_s 25464983.000 -
631.deepsjeng_s 82930.000 -
638.imagick_s 1851314.000 -
641.leela_s 143304.000 -
644.nab_s 174171.000 -
648.exchange2_s 64796.000 -
649.fotonik3d_s 305046.000 -
654.roms_s 677300.000 -
657.xz_s 192299.000 -
Geometric Mean 729813.837 -
Name Current %
508.namd_r 19.000 -5.00%
508.namd_r (avg) 19.000 -5.00%
508.namd_r (avg) (percentage) 0.680 -
508.namd_r (max) 11.000 83.33%
508.namd_r (max) (percentage) 0.410 95.24%
508.namd_r (unexplained diff vs previous) 12.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.410 -
510.parest_r 84.000 2.44%
510.parest_r (avg) 84.000 2.44%
510.parest_r (avg) (percentage) 1.440 -
510.parest_r (max) 79.000 -2.47%
510.parest_r (max) (percentage) 1.360 -3.55%
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.050 -1.87%
511.povray_r (max) 8.000 -11.11%
511.povray_r (max) (percentage) 2.090 -3.24%
511.povray_r (unexplained diff vs previous) 1.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.240 -
526.blender_r 95.000 1.06%
526.blender_r (avg) 95.000 1.06%
526.blender_r (avg) (percentage) 0.910 2.25%
526.blender_r (max) 151.000 151.67%
526.blender_r (max) (percentage) 1.440 152.63%
526.blender_r (unexplained diff vs previous) 153.000 -
526.blender_r (unexplained diff vs previous) (percentage) 1.460 -
600.perlbench_s 24.000 -4.00%
600.perlbench_s (avg) 24.000 -4.00%
600.perlbench_s (avg) (percentage) 1.220 -1.61%
600.perlbench_s (max) 17.000 -
600.perlbench_s (max) (percentage) 0.870 -2.25%
600.perlbench_s (unexplained diff vs previous) 4.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.200 -
603.bwaves_s 196.000 -
603.bwaves_s (avg) 196.000 -
603.bwaves_s (avg) (percentage) 2.180 -
603.bwaves_s (max) 350.000 -4.63%
603.bwaves_s (max) (percentage) 3.900 -3.70%
605.mcf_s 117.000 -
605.mcf_s (avg) 117.000 -
605.mcf_s (avg) (percentage) 1.710 -
605.mcf_s (max) 84.000 -4.55%
605.mcf_s (max) (percentage) 1.230 -3.91%
607.cactuBSSN_s 151.000 -
607.cactuBSSN_s (avg) 151.000 -
607.cactuBSSN_s (avg) (percentage) 3.100 -1.27%
607.cactuBSSN_s (max) 105.000 -2.78%
607.cactuBSSN_s (max) (percentage) 2.160 -3.57%
607.cactuBSSN_s (unexplained diff vs previous) 40.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.820 -
619.lbm_s 1822.000 -1.51%
619.lbm_s (avg) 1822.000 -1.51%
619.lbm_s (avg) (percentage) 5.860 -1.18%
619.lbm_s (max) 528.000 -73.05%
619.lbm_s (max) (percentage) 1.700 -72.93%
619.lbm_s (unexplained diff vs previous) 100.000 -86.19%
619.lbm_s (unexplained diff vs previous) (percentage) 0.320 -86.21%
620.omnetpp_s 78.000 2.63%
620.omnetpp_s (avg) 78.000 2.63%
620.omnetpp_s (avg) (percentage) 1.900 -
620.omnetpp_s (max) 115.000 -10.16%
620.omnetpp_s (max) (percentage) 2.790 -12.54%
620.omnetpp_s (unexplained diff vs previous) 101.000 -24.06%
620.omnetpp_s (unexplained diff vs previous) (percentage) 2.440 -26.06%
623.xalancbmk_s 34.000 -
623.xalancbmk_s (avg) 34.000 -
623.xalancbmk_s (avg) (percentage) 0.930 -
623.xalancbmk_s (max) 29.000 -
623.xalancbmk_s (max) (percentage) 0.780 -1.27%
625.x264_s 23.000 -4.17%
625.x264_s (avg) 23.000 -4.17%
625.x264_s (avg) (percentage) 0.930 -
625.x264_s (max) 8.000 -61.90%
625.x264_s (max) (percentage) 0.330 -59.76%
625.x264_s (unexplained diff vs previous) 2.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.080 -
628.pop2_s 145.000 -
628.pop2_s (avg) 145.000 -
628.pop2_s (avg) (percentage) 1.420 -
628.pop2_s (max) 111.000 -3.48%
628.pop2_s (max) (percentage) 1.090 -3.54%
631.deepsjeng_s 35.000 -
631.deepsjeng_s (avg) 35.000 -
631.deepsjeng_s (avg) (percentage) 0.890 -1.11%
631.deepsjeng_s (max) 26.000 -3.70%
631.deepsjeng_s (max) (percentage) 0.680 -2.86%
631.deepsjeng_s (unexplained diff vs previous) 9.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.230 -
638.imagick_s 49.000 -
638.imagick_s (avg) 49.000 -
638.imagick_s (avg) (percentage) 0.910 -
638.imagick_s (max) 6.000 -14.29%
638.imagick_s (max) (percentage) 0.120 -7.69%
641.leela_s 32.000 -
641.leela_s (avg) 32.000 -
641.leela_s (avg) (percentage) 0.650 -1.52%
641.leela_s (max) 30.000 -14.29%
641.leela_s (max) (percentage) 0.620 -13.89%
641.leela_s (unexplained diff vs previous) 8.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.160 -
644.nab_s 70.000 1.45%
644.nab_s (avg) 70.000 1.45%
644.nab_s (avg) (percentage) 0.630 -
644.nab_s (max) 113.000 -3.42%
644.nab_s (max) (percentage) 1.020 -3.77%
648.exchange2_s 8.000 -
648.exchange2_s (avg) 8.000 -
648.exchange2_s (avg) (percentage) 0.340 -
648.exchange2_s (max) 6.000 20.00%
648.exchange2_s (max) (percentage) 0.250 19.05%
648.exchange2_s (unexplained diff vs previous) 6.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.250 -
649.fotonik3d_s 141.000 -
649.fotonik3d_s (avg) 141.000 -
649.fotonik3d_s (avg) (percentage) 1.440 -
649.fotonik3d_s (max) 131.000 -3.68%
649.fotonik3d_s (max) (percentage) 1.330 -4.32%
649.fotonik3d_s (unexplained diff vs previous) 59.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.600 -
654.roms_s 620.000 -
654.roms_s (avg) 620.000 -
654.roms_s (avg) (percentage) 2.130 -
654.roms_s (max) 337.000 -4.26%
654.roms_s (max) (percentage) 1.160 -4.13%
657.xz_s 36.000 -
657.xz_s (avg) 36.000 -
657.xz_s (avg) (percentage) 1.550 -
657.xz_s (max) 29.000 -3.33%
657.xz_s (max) (percentage) 1.270 -3.05%
Geometric Mean 8.844 -30.18%