Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=d8c3e4901650e35ddf5083f693b8a21b9d24fcc6 (+ 23 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (f53c5cde64770d6c175737a444450fea81feba80) (+ 87 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4fa959d13d21b8f56a43aa0a416100303736c55c (+ 2 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9d1e04f023f73707bfa28a37f4f433fe3a59a49b (+ 25 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/317/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0317 (4-changed-components) 2025-04-02T02:53:52 0:00:00
Previous 0316 (3-changed-components) 2025-03-26T19:08:29 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 16
Performance Improvements 45 21
Added Tests 0 116
Unchanged Tests 922 825
Total Tests 978

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.32% 330969.000 335325.000 - -2.30% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
621.wrf_s 1.44% 6534.000 6628.000 - -0.88% -
603.bwaves_s 1.00% 8987.000 9077.000 - 0.62% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) (percentage) 127.78% 0.540 1.230 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 122.73% 22.000 49.000 - 0.00% -
620.omnetpp_s (max) 118.18% 22.000 48.000 - 0.00% -
620.omnetpp_s (max) (percentage) 116.07% 0.560 1.210 - 0.00% -
621.wrf_s 1.64% 122.000 124.000 - 0.00% -
621.wrf_s (avg) 1.64% 122.000 124.000 - 0.00% -
603.bwaves_s 1.11% 180.000 182.000 - 0.00% -
603.bwaves_s (avg) 1.11% 180.000 182.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r -1.94% 360.000 353.000 - -5.36% -
600.perlbench_s -1.29% 2010.000 1984.000 - -7.81% -
620.omnetpp_s -1.21% 4039.000 3990.000 - 1.35% -
602.gcc_s -1.03% 4077.000 4035.000 - -2.21% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) -86.83% 668.000 88.000 - 0.00% -
619.lbm_s (max) (percentage) -86.67% 2.250 0.300 - 0.00% -
648.exchange2_s (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) -46.67% 0.150 0.080 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -36.67% 0.300 0.190 - 0.00% -
619.lbm_s (unexplained diff vs previous) -35.96% 89.000 57.000 - 0.00% -
625.x264_s (max) -16.67% 6.000 5.000 - 0.00% -
603.bwaves_s (max) (percentage) -11.84% 0.760 0.670 - 0.00% -
603.bwaves_s (max) -11.76% 68.000 60.000 - 0.00% -
638.imagick_s (max) -9.09% 11.000 10.000 - 0.00% -
644.nab_s (max) -8.57% 105.000 96.000 - 0.00% -
605.mcf_s (max) (percentage) -8.51% 1.410 1.290 - 0.00% -
641.leela_s (max) -8.33% 12.000 11.000 - 0.00% -
605.mcf_s (max) -8.05% 87.000 80.000 - 0.00% -
644.nab_s (max) (percentage) -7.84% 1.020 0.940 - 0.00% -
641.leela_s (max) (percentage) -5.71% 0.350 0.330 - 0.00% -
657.xz_s (max) (percentage) -5.71% 0.350 0.330 - 0.00% -
623.xalancbmk_s (max) -5.26% 19.000 18.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -5.26% 0.570 0.540 - 0.00% -
654.roms_s (max) -5.15% 136.000 129.000 - 0.00% -
526.blender_r (max) (percentage) -5.13% 1.170 1.110 - 0.00% -
654.roms_s (max) (percentage) -5.08% 0.590 0.560 - 0.00% -
511.povray_r (max) (percentage) -4.85% 1.030 0.980 - 0.00% -
600.perlbench_s (max) -4.76% 21.000 20.000 - 0.00% -
526.blender_r (max) -4.39% 114.000 109.000 - 0.00% -
625.x264_s (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
649.fotonik3d_s (max) -3.75% 80.000 77.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -3.61% 0.830 0.800 - 0.00% -
628.pop2_s (max) -3.28% 61.000 59.000 - 0.00% -
510.parest_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
628.pop2_s (max) (percentage) -3.17% 0.630 0.610 - 0.00% -
600.perlbench_s (max) (percentage) -2.83% 1.060 1.030 - 0.00% -
620.omnetpp_s -2.44% 82.000 80.000 - 0.00% -
620.omnetpp_s (avg) -2.44% 82.000 80.000 - 0.00% -
607.cactuBSSN_s (max) -2.38% 84.000 82.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.34% 1.710 1.670 - 0.00% -
648.exchange2_s (avg) (percentage) -2.00% 0.500 0.490 - 0.00% -
619.lbm_s -1.99% 1306.000 1280.000 - 0.00% -
619.lbm_s (avg) -1.99% 1306.000 1280.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.82% 4.400 4.320 - 0.00% -
508.namd_r (max) (percentage) -1.08% 0.930 0.920 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 13.24% 11474556.000 12994158.000 - 0.22% -
508.namd_r 13.11% 707624.000 800373.000 - -0.87% -
657.xz_s 10.87% 150385.000 166737.000 - 0.02% -
600.perlbench_s 7.16% 2649560.000 2839227.000 - -0.18% -
607.cactuBSSN_s 6.48% 3684442.000 3923115.000 - 0.10% -
648.exchange2_s 5.93% 164878.000 174660.000 - -0.10% -
623.xalancbmk_s 4.50% 3748643.000 3917186.000 - 0.01% -
605.mcf_s 3.36% 23365.000 24149.000 - 0.97% -
511.povray_r 3.08% 1093239.000 1126887.000 - 0.75% -
602.gcc_s 2.72% 10139438.000 10415566.000 - -0.23% -
510.parest_r 2.42% 1733486.000 1775515.000 - 0.27% -
638.imagick_s 1.53% 1700122.000 1726082.000 - 0.20% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 3.25% 4798.000 4954.000 - 0.32% -
631.deepsjeng_s 2.45% 3425.000 3509.000 - -0.11% -
620.omnetpp_s 1.35% 3937.000 3990.000 - -1.21% -
644.nab_s 1.18% 10194.000 10314.000 - -0.12% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.77% 646275.000 615446.000 - 0.04% -
654.roms_s -2.38% 863494.000 842953.000 - 0.45% -
649.fotonik3d_s -2.30% 343226.000 335325.000 - 1.32% -
603.bwaves_s -2.00% 52595.000 51543.000 - 0.25% -
619.lbm_s -1.73% 13445.000 13213.000 - 0.00% -
641.leela_s -1.04% 108742.000 107612.000 - 0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -17.71% 1626.000 1338.000 - 0.00% -
648.exchange2_s -7.95% 1422.000 1309.000 - -0.08% -
600.perlbench_s -7.81% 2152.000 1984.000 - -1.29% -
638.imagick_s -6.80% 3368.000 3139.000 - -0.22% -
511.povray_r -5.36% 373.000 353.000 - -1.94% -
641.leela_s -5.19% 3605.000 3418.000 - -0.47% -
657.xz_s -5.17% 2319.000 2199.000 - 0.00% -
649.fotonik3d_s -3.66% 10088.000 9719.000 - -0.04% -
654.roms_s -3.56% 24034.000 23179.000 - 0.39% -
628.pop2_s -2.88% 10109.000 9818.000 - 0.12% -
605.mcf_s -2.75% 6394.000 6218.000 - 0.23% -
602.gcc_s -2.21% 4126.000 4035.000 - -1.03% -
623.xalancbmk_s -1.26% 3407.000 3364.000 - 0.33% -
526.blender_r -1.19% 9950.000 9832.000 - 0.17% -
619.lbm_s -1.12% 29971.000 29634.000 - -0.19% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2424.000 -
510.parest_r 5454.000 -
511.povray_r 353.000 -1.94%
526.blender_r 9832.000 -
600.perlbench_s 1984.000 -1.29%
602.gcc_s 4035.000 -1.03%
603.bwaves_s 9077.000 1.00%
605.mcf_s 6218.000 -
607.cactuBSSN_s 4954.000 -
619.lbm_s 29634.000 -
620.omnetpp_s 3990.000 -1.21%
621.wrf_s 6628.000 1.44%
623.xalancbmk_s 3364.000 -
625.x264_s 1338.000 -
627.cam4_s 125.000 -
628.pop2_s 9818.000 -
631.deepsjeng_s 3509.000 -
638.imagick_s 3139.000 -
641.leela_s 3418.000 -
644.nab_s 10314.000 -
648.exchange2_s 1309.000 -
649.fotonik3d_s 9719.000 -
654.roms_s 23179.000 -
657.xz_s 2199.000 -
Geometric Mean 3849.257 -
Name Current %
508.namd_r 800373.000 -
510.parest_r 1775515.000 -
511.povray_r 1126887.000 -
526.blender_r 12994158.000 -
600.perlbench_s 2839227.000 -
602.gcc_s 10415566.000 -
603.bwaves_s 51543.000 -
605.mcf_s 24149.000 -
607.cactuBSSN_s 3923115.000 -
619.lbm_s 13213.000 -
620.omnetpp_s 1903465.000 -
621.wrf_s 15766661.000 -
623.xalancbmk_s 3917186.000 -
625.x264_s 615446.000 -
628.pop2_s 3446969.000 -
631.deepsjeng_s 85824.000 -
638.imagick_s 1726082.000 -
641.leela_s 107612.000 -
644.nab_s 105486.000 -
648.exchange2_s 174660.000 -
649.fotonik3d_s 335325.000 1.32%
654.roms_s 842953.000 -
657.xz_s 166737.000 -
Geometric Mean 679267.293 -
Name Current %
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.800 -
508.namd_r (max) 22.000 -
508.namd_r (max) (percentage) 0.920 -1.08%
510.parest_r 127.000 -
510.parest_r (avg) 127.000 -
510.parest_r (avg) (percentage) 2.330 -
510.parest_r (max) 16.000 -
510.parest_r (max) (percentage) 0.300 -3.23%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.050 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.980 -4.85%
526.blender_r 120.000 -
526.blender_r (avg) 120.000 -
526.blender_r (avg) (percentage) 1.230 -
526.blender_r (max) 109.000 -4.39%
526.blender_r (max) (percentage) 1.110 -5.13%
600.perlbench_s 40.000 -
600.perlbench_s (avg) 40.000 -
600.perlbench_s (avg) (percentage) 2.030 -
600.perlbench_s (max) 20.000 -4.76%
600.perlbench_s (max) (percentage) 1.030 -2.83%
603.bwaves_s 182.000 1.11%
603.bwaves_s (avg) 182.000 1.11%
603.bwaves_s (avg) (percentage) 2.010 -
603.bwaves_s (max) 60.000 -11.76%
603.bwaves_s (max) (percentage) 0.670 -11.84%
605.mcf_s 110.000 -
605.mcf_s (avg) 110.000 -
605.mcf_s (avg) (percentage) 1.780 -
605.mcf_s (max) 80.000 -8.05%
605.mcf_s (max) (percentage) 1.290 -8.51%
607.cactuBSSN_s 153.000 -
607.cactuBSSN_s (avg) 153.000 -
607.cactuBSSN_s (avg) (percentage) 3.090 -
607.cactuBSSN_s (max) 82.000 -2.38%
607.cactuBSSN_s (max) (percentage) 1.670 -2.34%
619.lbm_s 1280.000 -1.99%
619.lbm_s (avg) 1280.000 -1.99%
619.lbm_s (avg) (percentage) 4.320 -1.82%
619.lbm_s (max) 88.000 -86.83%
619.lbm_s (max) (percentage) 0.300 -86.67%
619.lbm_s (unexplained diff vs previous) 57.000 -35.96%
619.lbm_s (unexplained diff vs previous) (percentage) 0.190 -36.67%
620.omnetpp_s 80.000 -2.44%
620.omnetpp_s (avg) 80.000 -2.44%
620.omnetpp_s (avg) (percentage) 2.030 -
620.omnetpp_s (max) 48.000 118.18%
620.omnetpp_s (max) (percentage) 1.210 116.07%
620.omnetpp_s (unexplained diff vs previous) 49.000 122.73%
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.230 127.78%
621.wrf_s 124.000 1.64%
621.wrf_s (avg) 124.000 1.64%
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 62.000 -
621.wrf_s (max) (percentage) 0.950 -
623.xalancbmk_s 32.000 -
623.xalancbmk_s (avg) 32.000 -
623.xalancbmk_s (avg) (percentage) 0.970 -
623.xalancbmk_s (max) 18.000 -5.26%
623.xalancbmk_s (max) (percentage) 0.540 -5.26%
625.x264_s 14.000 -
625.x264_s (avg) 14.000 -
625.x264_s (avg) (percentage) 1.110 -
625.x264_s (max) 5.000 -16.67%
625.x264_s (max) (percentage) 0.440 -4.35%
627.cam4_s 14.000 -
627.cam4_s (avg) 14.000 -
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) 8.000 -
627.cam4_s (max) (percentage) 6.990 -
628.pop2_s 64.000 -
628.pop2_s (avg) 64.000 -
628.pop2_s (avg) (percentage) 0.660 -
628.pop2_s (max) 59.000 -3.28%
628.pop2_s (max) (percentage) 0.610 -3.17%
631.deepsjeng_s 43.000 -
631.deepsjeng_s (avg) 43.000 -
631.deepsjeng_s (avg) (percentage) 1.250 -
631.deepsjeng_s (max) 17.000 -
631.deepsjeng_s (max) (percentage) 0.500 -
638.imagick_s 43.000 -
638.imagick_s (avg) 43.000 -
638.imagick_s (avg) (percentage) 1.370 -
638.imagick_s (max) 10.000 -9.09%
638.imagick_s (max) (percentage) 0.340 -
641.leela_s 28.000 -
641.leela_s (avg) 28.000 -
641.leela_s (avg) (percentage) 0.820 -
641.leela_s (max) 11.000 -8.33%
641.leela_s (max) (percentage) 0.330 -5.71%
644.nab_s 79.000 -
644.nab_s (avg) 79.000 -
644.nab_s (avg) (percentage) 0.770 -
644.nab_s (max) 96.000 -8.57%
644.nab_s (max) (percentage) 0.940 -7.84%
648.exchange2_s 6.000 -
648.exchange2_s (avg) 6.000 -
648.exchange2_s (avg) (percentage) 0.490 -2.00%
648.exchange2_s (max) 1.000 -
648.exchange2_s (max) (percentage) 0.140 -
648.exchange2_s (unexplained diff vs previous) 1.000 -50.00%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.080 -46.67%
649.fotonik3d_s 207.000 -
649.fotonik3d_s (avg) 207.000 -
649.fotonik3d_s (avg) (percentage) 2.130 -
649.fotonik3d_s (max) 77.000 -3.75%
649.fotonik3d_s (max) (percentage) 0.800 -3.61%
654.roms_s 992.000 -
654.roms_s (avg) 992.000 -
654.roms_s (avg) (percentage) 4.280 -
654.roms_s (max) 129.000 -5.15%
654.roms_s (max) (percentage) 0.560 -5.08%
657.xz_s 38.000 -
657.xz_s (avg) 38.000 -
657.xz_s (avg) (percentage) 1.730 -
657.xz_s (max) 7.000 -
657.xz_s (max) (percentage) 0.330 -5.71%
Geometric Mean 9.242 -4.07%