Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c8ed94e1433fc27342b53130ce8d4b0f0839b2ab (+ 205 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (736ae0a005d21230b141e9eb94cfd61032f8db19) (+ 494 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=319f94dea2b7eeff12adb22ee50b46b64dd6a52d (+ 60 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f871ce2482ed3a48ea0e1080bfeb7e4d6e99f78 (+ 531 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/348/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0348 (4-changed-components) 2025-05-10T02:05:41 0:00:00
Previous 0343 (4-changed-components) 2025-04-25T23:15:23 0:00:00
Baseline 0001 (4-changed-components) 2023-03-02T21:02:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 13
Performance Improvements 43 19
Added Tests 0 113
Unchanged Tests 893 797
Total Tests 942

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s 2.75% 1347.000 1384.000 - -0.57% -
510.parest_r 1.89% 5456.000 5559.000 - 2.94% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
510.parest_r 3.57% 28.000 29.000 - 0.00% -
510.parest_r (avg) 3.57% 28.000 29.000 - 0.00% -
605.mcf_s 1.82% 55.000 56.000 - 0.00% -
605.mcf_s (avg) 1.82% 55.000 56.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -18.41% 21210.000 17306.000 - -18.56% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -1.62% 4002.000 3937.000 - 5.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -53.19% 47.000 22.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -53.04% 1.150 0.540 - 0.00% -
511.povray_r (max) -11.11% 9.000 8.000 - 0.00% -
638.imagick_s (max) -9.09% 11.000 10.000 - 0.00% -
649.fotonik3d_s (max) -8.00% 25.000 23.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -7.69% 0.260 0.240 - 0.00% -
620.omnetpp_s (max) -7.69% 78.000 72.000 - 0.00% -
620.omnetpp_s (max) (percentage) -7.22% 1.940 1.800 - 0.00% -
623.xalancbmk_s (max) -7.14% 14.000 13.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -6.82% 1.320 1.230 - 0.00% -
600.perlbench_s (max) -6.67% 30.000 28.000 - 0.00% -
508.namd_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
607.cactuBSSN_s (max) -6.25% 64.000 60.000 - 0.00% -
648.exchange2_s (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
600.perlbench_s (max) (percentage) -5.26% 1.520 1.440 - 0.00% -
654.roms_s (max) (percentage) -5.19% 3.080 2.920 - 0.00% -
510.parest_r (max) (percentage) -5.13% 0.390 0.370 - 0.00% -
654.roms_s (max) -5.01% 719.000 683.000 - 0.00% -
657.xz_s (max) -5.00% 20.000 19.000 - 0.00% -
510.parest_r (max) -4.76% 21.000 20.000 - 0.00% -
511.povray_r (max) (percentage) -4.70% 2.340 2.230 - 0.00% -
631.deepsjeng_s (max) (percentage) -4.69% 0.640 0.610 - 0.00% -
623.xalancbmk_s -4.55% 22.000 21.000 - 0.00% -
623.xalancbmk_s (avg) -4.55% 22.000 21.000 - 0.00% -
644.nab_s (max) (percentage) -4.23% 0.710 0.680 - 0.00% -
631.deepsjeng_s (max) -4.17% 24.000 23.000 - 0.00% -
641.leela_s (max) -4.17% 24.000 23.000 - 0.00% -
644.nab_s (max) -4.17% 72.000 69.000 - 0.00% -
625.x264_s (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
619.lbm_s (max) (percentage) -3.78% 3.970 3.820 - 0.00% -
605.mcf_s (max) (percentage) -3.66% 0.820 0.790 - 0.00% -
619.lbm_s (max) -3.56% 1179.000 1137.000 - 0.00% -
641.leela_s (max) (percentage) -3.23% 0.620 0.600 - 0.00% -
657.xz_s (max) (percentage) -3.23% 0.930 0.900 - 0.00% -
526.blender_r (max) -2.86% 70.000 68.000 - 0.00% -
526.blender_r (max) (percentage) -2.82% 0.710 0.690 - 0.00% -
603.bwaves_s (max) -2.40% 125.000 122.000 - 0.00% -
628.pop2_s (max) -2.29% 175.000 171.000 - 0.00% -
628.pop2_s (max) (percentage) -2.27% 1.760 1.720 - 0.00% -
603.bwaves_s (max) (percentage) -2.16% 1.390 1.360 - 0.00% -
605.mcf_s (max) -1.92% 52.000 51.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 11.14% 177422.000 197180.000 - 0.19% -
508.namd_r 10.85% 738062.000 818161.000 - 0.54% -
657.xz_s 7.34% 205531.000 220607.000 - -0.04% -
511.povray_r 5.56% 1004857.000 1060693.000 - -0.07% -
607.cactuBSSN_s 5.03% 4214065.000 4426128.000 - 0.13% -
510.parest_r 4.74% 8624037.000 9033038.000 - 0.17% -
623.xalancbmk_s 2.76% 5501002.000 5653087.000 - -0.09% -
526.blender_r 2.74% 11124884.000 11429665.000 - 0.10% -
602.gcc_s 2.42% 10008387.000 10250735.000 - -0.12% -
605.mcf_s 2.40% 28789.000 29481.000 - 0.05% -
638.imagick_s 1.87% 2221404.000 2262982.000 - 0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s 5.10% 3746.000 3937.000 - -1.62% -
510.parest_r 2.94% 5400.000 5559.000 - 1.89% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -18.56% 21250.000 17306.000 - -18.41% -
641.leela_s -3.86% 204135.000 196246.000 - 0.77% -
603.bwaves_s -3.81% 53831.000 51779.000 - 0.03% -
649.fotonik3d_s -2.72% 353975.000 344338.000 - 0.18% -
654.roms_s -1.67% 1075717.000 1057713.000 - 0.43% -
625.x264_s -1.63% 626778.000 616589.000 - 0.05% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -18.17% 1629.000 1333.000 - 0.38% -
511.povray_r -7.49% 414.000 383.000 - -0.52% -
638.imagick_s -6.59% 3367.000 3145.000 - 0.03% -
641.leela_s -4.62% 4110.000 3920.000 - -0.28% -
657.xz_s -4.10% 2290.000 2196.000 - 0.46% -
619.lbm_s -4.03% 31031.000 29780.000 - 0.22% -
654.roms_s -3.28% 24211.000 23417.000 - 0.24% -
649.fotonik3d_s -3.20% 10076.000 9754.000 - -0.47% -
631.deepsjeng_s -2.59% 3970.000 3867.000 - 0.34% -
620.omnetpp_s -2.32% 4146.000 4050.000 - -0.54% -
605.mcf_s -2.20% 6626.000 6480.000 - 0.93% -
602.gcc_s -1.12% 4202.000 4155.000 - 0.27% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s

Added Tests - Execution
600.perlbench_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.59s
Name Current %
508.namd_r 2416.000 -
510.parest_r 5559.000 1.89%
511.povray_r 383.000 -
526.blender_r 9883.000 -
600.perlbench_s 2011.000 -
602.gcc_s 4155.000 -
603.bwaves_s 9036.000 -
605.mcf_s 6480.000 -
607.cactuBSSN_s 4918.000 -
619.lbm_s 29780.000 -
620.omnetpp_s 4050.000 -
621.wrf_s 6519.000 -
623.xalancbmk_s 3937.000 -1.62%
625.x264_s 1333.000 -
627.cam4_s 134.000 -
628.pop2_s 9997.000 -
631.deepsjeng_s 3867.000 -
638.imagick_s 3145.000 -
641.leela_s 3920.000 -
644.nab_s 10212.000 -
648.exchange2_s 1384.000 2.75%
649.fotonik3d_s 9754.000 -
654.roms_s 23417.000 -
657.xz_s 2196.000 -
Geometric Mean 3965.408 -
Name Current %
508.namd_r 818161.000 -
510.parest_r 9033038.000 -
511.povray_r 1060693.000 -
526.blender_r 11429665.000 -
600.perlbench_s 2581439.000 -
602.gcc_s 10250735.000 -
603.bwaves_s 51779.000 -
605.mcf_s 29481.000 -
607.cactuBSSN_s 4426128.000 -
619.lbm_s 17306.000 -18.41%
620.omnetpp_s 2234409.000 -
621.wrf_s 20395680.000 -
623.xalancbmk_s 5653087.000 -
625.x264_s 616589.000 -
628.pop2_s 26269003.000 -
631.deepsjeng_s 96658.000 -
638.imagick_s 2262982.000 -
641.leela_s 196246.000 -
644.nab_s 218891.000 -
648.exchange2_s 197180.000 -
649.fotonik3d_s 344338.000 -
654.roms_s 1057713.000 -
657.xz_s 220607.000 -
Geometric Mean 926369.500 -
Name Current %
508.namd_r 11.000 -
508.namd_r (avg) 11.000 -
508.namd_r (avg) (percentage) 0.490 -
508.namd_r (max) 3.000 -
508.namd_r (max) (percentage) 0.150 -6.25%
510.parest_r 29.000 3.57%
510.parest_r (avg) 29.000 3.57%
510.parest_r (avg) (percentage) 0.530 -
510.parest_r (max) 20.000 -4.76%
510.parest_r (max) (percentage) 0.370 -5.13%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.010 -
511.povray_r (max) 8.000 -11.11%
511.povray_r (max) (percentage) 2.230 -4.70%
526.blender_r 45.000 -
526.blender_r (avg) 45.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 68.000 -2.86%
526.blender_r (max) (percentage) 0.690 -2.82%
600.perlbench_s 17.000 -
600.perlbench_s (avg) 17.000 -
600.perlbench_s (avg) (percentage) 0.870 -
600.perlbench_s (max) 28.000 -6.67%
600.perlbench_s (max) (percentage) 1.440 -5.26%
603.bwaves_s 97.000 -
603.bwaves_s (avg) 97.000 -
603.bwaves_s (avg) (percentage) 1.080 -
603.bwaves_s (max) 122.000 -2.40%
603.bwaves_s (max) (percentage) 1.360 -2.16%
605.mcf_s 56.000 1.82%
605.mcf_s (avg) 56.000 1.82%
605.mcf_s (avg) (percentage) 0.870 -
605.mcf_s (max) 51.000 -1.92%
605.mcf_s (max) (percentage) 0.790 -3.66%
607.cactuBSSN_s 72.000 -
607.cactuBSSN_s (avg) 72.000 -
607.cactuBSSN_s (avg) (percentage) 1.470 -
607.cactuBSSN_s (max) 60.000 -6.25%
607.cactuBSSN_s (max) (percentage) 1.230 -6.82%
619.lbm_s 544.000 -
619.lbm_s (avg) 544.000 -
619.lbm_s (avg) (percentage) 1.830 -
619.lbm_s (max) 1137.000 -3.56%
619.lbm_s (max) (percentage) 3.820 -3.78%
620.omnetpp_s 45.000 -
620.omnetpp_s (avg) 45.000 -
620.omnetpp_s (avg) (percentage) 1.120 -
620.omnetpp_s (max) 72.000 -7.69%
620.omnetpp_s (max) (percentage) 1.800 -7.22%
620.omnetpp_s (unexplained diff vs previous) 22.000 -53.19%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.540 -53.04%
621.wrf_s 474.000 -
621.wrf_s (avg) 474.000 -
621.wrf_s (avg) (percentage) 7.280 -
621.wrf_s (max) 314.000 -
621.wrf_s (max) (percentage) 4.830 -
623.xalancbmk_s 21.000 -4.55%
623.xalancbmk_s (avg) 21.000 -4.55%
623.xalancbmk_s (avg) (percentage) 0.550 -
623.xalancbmk_s (max) 13.000 -7.14%
623.xalancbmk_s (max) (percentage) 0.340 -
625.x264_s 5.000 -
625.x264_s (avg) 5.000 -
625.x264_s (avg) (percentage) 0.450 -
625.x264_s (max) 6.000 -
625.x264_s (max) (percentage) 0.490 -3.92%
628.pop2_s 72.000 -
628.pop2_s (avg) 72.000 -
628.pop2_s (avg) (percentage) 0.730 -
628.pop2_s (max) 171.000 -2.29%
628.pop2_s (max) (percentage) 1.720 -2.27%
631.deepsjeng_s 13.000 -
631.deepsjeng_s (avg) 13.000 -
631.deepsjeng_s (avg) (percentage) 0.360 -
631.deepsjeng_s (max) 23.000 -4.17%
631.deepsjeng_s (max) (percentage) 0.610 -4.69%
638.imagick_s 10.000 -
638.imagick_s (avg) 10.000 -
638.imagick_s (avg) (percentage) 0.340 -
638.imagick_s (max) 10.000 -9.09%
638.imagick_s (max) (percentage) 0.340 -
641.leela_s 12.000 -
641.leela_s (avg) 12.000 -
641.leela_s (avg) (percentage) 0.330 -
641.leela_s (max) 23.000 -4.17%
641.leela_s (max) (percentage) 0.600 -3.23%
644.nab_s 63.000 -
644.nab_s (avg) 63.000 -
644.nab_s (avg) (percentage) 0.620 -
644.nab_s (max) 69.000 -4.17%
644.nab_s (max) (percentage) 0.680 -4.23%
648.exchange2_s 11.000 -
648.exchange2_s (avg) 11.000 -
648.exchange2_s (avg) (percentage) 0.830 -
648.exchange2_s (max) 2.000 -
648.exchange2_s (max) (percentage) 0.160 -5.88%
649.fotonik3d_s 61.000 -
649.fotonik3d_s (avg) 61.000 -
649.fotonik3d_s (avg) (percentage) 0.630 -
649.fotonik3d_s (max) 23.000 -8.00%
649.fotonik3d_s (max) (percentage) 0.240 -7.69%
654.roms_s 386.000 -
654.roms_s (avg) 386.000 -
654.roms_s (avg) (percentage) 1.650 -
654.roms_s (max) 683.000 -5.01%
654.roms_s (max) (percentage) 2.920 -5.19%
657.xz_s 11.000 -
657.xz_s (avg) 11.000 -
657.xz_s (avg) (percentage) 0.530 -
657.xz_s (max) 19.000 -5.00%
657.xz_s (max) (percentage) 0.900 -3.23%
Geometric Mean 7.647 -3.05%