Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=4011eaac9a1fce5c44fcabb12368159b3e899d84 (+ 14 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (e67758cd816978a519d751b618043a8957d67e0e) (+ 28 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4f6dae219578d6df475864e273da40bde9d30806 (+ 1 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/324/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0324 (3-changed-components) 2025-04-29T20:19:12 0:00:00
Previous 0323 (4-changed-components) 2025-04-24T05:37:55 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 17
Performance Improvements 49 19
Added Tests 10 116
Unchanged Tests 911 826
Total Tests 978

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
621.wrf_s 1.07% 6550.000 6620.000 - -1.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) 157.14% 14.000 36.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 140.00% 0.050 0.120 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 105.88% 17.000 35.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 102.33% 0.430 0.870 - 0.00% -
648.exchange2_s (max) (percentage) 50.00% 0.100 0.150 - 0.00% -
620.omnetpp_s (max) 25.00% 28.000 35.000 - 0.00% -
620.omnetpp_s (max) (percentage) 20.55% 0.730 0.880 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
631.deepsjeng_s -1.70% 3525.000 3465.000 - 1.17% -
607.cactuBSSN_s -1.67% 5038.000 4954.000 - 3.25% -
511.povray_r -1.65% 363.000 357.000 - -4.29% -
627.cam4_s -1.53% 131.000 129.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s (max) -52.78% 72.000 34.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -52.70% 0.740 0.350 - 0.00% -
654.roms_s (max) (percentage) -24.49% 0.490 0.370 - 0.00% -
654.roms_s (max) -23.89% 113.000 86.000 - 0.00% -
605.mcf_s (max) -15.12% 86.000 73.000 - 0.00% -
605.mcf_s (max) (percentage) -15.00% 1.400 1.190 - 0.00% -
603.bwaves_s (max) (percentage) -12.42% 1.530 1.340 - 0.00% -
603.bwaves_s (max) -12.41% 137.000 120.000 - 0.00% -
627.cam4_s (max) -11.11% 9.000 8.000 - 0.00% -
638.imagick_s (max) -11.11% 9.000 8.000 - 0.00% -
641.leela_s (max) -8.00% 25.000 23.000 - 0.00% -
625.x264_s (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
619.lbm_s (max) -6.32% 95.000 89.000 - 0.00% -
619.lbm_s (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
641.leela_s (max) (percentage) -4.11% 0.730 0.700 - 0.00% -
526.blender_r (max) -3.09% 97.000 94.000 - 0.00% -
526.blender_r (max) (percentage) -3.03% 0.990 0.960 - 0.00% -
644.nab_s (max) (percentage) -2.94% 0.680 0.660 - 0.00% -
654.roms_s (avg) (percentage) -2.70% 4.070 3.960 - 0.00% -
654.roms_s -2.54% 945.000 921.000 - 0.00% -
654.roms_s (avg) -2.54% 945.000 921.000 - 0.00% -
607.cactuBSSN_s (max) -2.50% 80.000 78.000 - 0.00% -
649.fotonik3d_s -2.46% 203.000 198.000 - 0.00% -
649.fotonik3d_s (avg) -2.46% 203.000 198.000 - 0.00% -
631.deepsjeng_s -2.33% 43.000 42.000 - 0.00% -
631.deepsjeng_s (avg) -2.33% 43.000 42.000 - 0.00% -
511.povray_r (max) (percentage) -2.27% 0.880 0.860 - 0.00% -
603.bwaves_s -2.25% 178.000 174.000 - 0.00% -
603.bwaves_s (avg) -2.25% 178.000 174.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -2.04% 0.490 0.480 - 0.00% -
603.bwaves_s (avg) (percentage) -2.01% 1.990 1.950 - 0.00% -
649.fotonik3d_s (avg) (percentage) -1.92% 2.080 2.040 - 0.00% -
605.mcf_s -1.83% 109.000 107.000 - 0.00% -
605.mcf_s (avg) -1.83% 109.000 107.000 - 0.00% -
628.pop2_s (max) (percentage) -1.79% 0.560 0.550 - 0.00% -
619.lbm_s (avg) (percentage) -1.72% 4.080 4.010 - 0.00% -
605.mcf_s (avg) (percentage) -1.69% 1.770 1.740 - 0.00% -
619.lbm_s -1.57% 1214.000 1195.000 - 0.00% -
619.lbm_s (avg) -1.57% 1214.000 1195.000 - 0.00% -
644.nab_s (max) -1.45% 69.000 68.000 - 0.00% -
607.cactuBSSN_s -1.29% 155.000 153.000 - 0.00% -
607.cactuBSSN_s (avg) -1.29% 155.000 153.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -1.25% 1.600 1.580 - 0.00% -
508.namd_r (max) (percentage) -1.11% 0.900 0.890 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.02% 1.960 1.940 - 0.00% -

Added Tests - sample variability
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)
654.roms_s (unexplained diff vs previous)
654.roms_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 13.44% 11474556.000 13017170.000 - 0.25% -
508.namd_r 13.32% 707624.000 801882.000 - -0.40% -
657.xz_s 10.68% 150385.000 166449.000 - -0.03% -
600.perlbench_s 7.92% 2649560.000 2859307.000 - 0.16% -
607.cactuBSSN_s 7.59% 3684442.000 3964083.000 - 0.75% -
648.exchange2_s 5.92% 164878.000 174636.000 - -0.03% -
623.xalancbmk_s 4.30% 3748643.000 3909762.000 - -0.05% -
605.mcf_s 3.36% 23365.000 24149.000 - 0.00% -
602.gcc_s 2.73% 10139438.000 10416090.000 - 0.07% -
510.parest_r 2.53% 1733486.000 1777343.000 - 0.13% -
628.pop2_s 2.02% 3413948.000 3482789.000 - 0.39% -
631.deepsjeng_s 1.84% 84996.000 86560.000 - 0.06% -
511.povray_r 1.31% 1093239.000 1107559.000 - -0.75% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 3.25% 4798.000 4954.000 - -1.67% -
644.nab_s 1.86% 10194.000 10384.000 - 0.96% -
620.omnetpp_s 1.65% 3937.000 4002.000 - 0.88% -
631.deepsjeng_s 1.17% 3425.000 3465.000 - -1.70% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.55% 646275.000 616849.000 - 0.22% -
649.fotonik3d_s -3.91% 343226.000 329796.000 - 0.00% -
654.roms_s -2.11% 863494.000 845293.000 - 0.00% -
603.bwaves_s -1.80% 52595.000 51647.000 - 0.00% -
619.lbm_s -1.73% 13445.000 13213.000 - 0.00% -
620.omnetpp_s -1.67% 1922167.000 1890069.000 - -0.00% -
641.leela_s -1.27% 108742.000 107365.000 - -0.34% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -17.84% 1626.000 1336.000 - 0.45% -
648.exchange2_s -7.59% 1422.000 1314.000 - 0.15% -
600.perlbench_s -7.02% 2152.000 2001.000 - 0.76% -
638.imagick_s -6.68% 3368.000 3143.000 - 0.03% -
641.leela_s -4.99% 3605.000 3425.000 - -0.81% -
657.xz_s -4.96% 2319.000 2204.000 - -0.14% -
511.povray_r -4.29% 373.000 357.000 - -1.65% -
649.fotonik3d_s -3.50% 10088.000 9735.000 - -0.35% -
654.roms_s -3.20% 24034.000 23266.000 - 0.18% -
605.mcf_s -3.13% 6394.000 6194.000 - -0.19% -
628.pop2_s -2.62% 10109.000 9844.000 - 0.41% -
621.wrf_s -1.00% 6687.000 6620.000 - 1.07% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2416.000 -
510.parest_r 5468.000 -
511.povray_r 357.000 -1.65%
526.blender_r 9879.000 -
600.perlbench_s 2001.000 -
602.gcc_s 4091.000 -
603.bwaves_s 8962.000 -
605.mcf_s 6194.000 -
607.cactuBSSN_s 4954.000 -1.67%
619.lbm_s 29805.000 -
620.omnetpp_s 4002.000 -
621.wrf_s 6620.000 1.07%
623.xalancbmk_s 3408.000 -
625.x264_s 1336.000 -
627.cam4_s 129.000 -1.53%
628.pop2_s 9844.000 -
631.deepsjeng_s 3465.000 -1.70%
638.imagick_s 3143.000 -
641.leela_s 3425.000 -
644.nab_s 10384.000 -
648.exchange2_s 1314.000 -
649.fotonik3d_s 9735.000 -
654.roms_s 23266.000 -
657.xz_s 2204.000 -
Geometric Mean 3862.612 -
Name Current %
508.namd_r 801882.000 -
510.parest_r 1777343.000 -
511.povray_r 1107559.000 -
526.blender_r 13017170.000 -
600.perlbench_s 2859307.000 -
602.gcc_s 10416090.000 -
603.bwaves_s 51647.000 -
605.mcf_s 24149.000 -
607.cactuBSSN_s 3964083.000 -
619.lbm_s 13213.000 -
620.omnetpp_s 1890069.000 -
621.wrf_s 15778145.000 -
623.xalancbmk_s 3909762.000 -
625.x264_s 616849.000 -
628.pop2_s 3482789.000 -
631.deepsjeng_s 86560.000 -
638.imagick_s 1714238.000 -
641.leela_s 107365.000 -
644.nab_s 105262.000 -
648.exchange2_s 174636.000 -
649.fotonik3d_s 329796.000 -
654.roms_s 845293.000 -
657.xz_s 166449.000 -
Geometric Mean 679054.015 -
Name Current %
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.800 -
508.namd_r (max) 21.000 -
508.namd_r (max) (percentage) 0.890 -1.11%
510.parest_r 127.000 -
510.parest_r (avg) 127.000 -
510.parest_r (avg) (percentage) 2.330 -
510.parest_r (max) 15.000 -
510.parest_r (max) (percentage) 0.290 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.050 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.860 -2.27%
526.blender_r 121.000 -
526.blender_r (avg) 121.000 -
526.blender_r (avg) (percentage) 1.230 -
526.blender_r (max) 94.000 -3.09%
526.blender_r (max) (percentage) 0.960 -3.03%
600.perlbench_s 40.000 -
600.perlbench_s (avg) 40.000 -
600.perlbench_s (avg) (percentage) 2.030 -
600.perlbench_s (max) 20.000 -
600.perlbench_s (max) (percentage) 1.010 -
603.bwaves_s 174.000 -2.25%
603.bwaves_s (avg) 174.000 -2.25%
603.bwaves_s (avg) (percentage) 1.950 -2.01%
603.bwaves_s (max) 120.000 -12.41%
603.bwaves_s (max) (percentage) 1.340 -12.42%
603.bwaves_s (unexplained diff vs previous) 24.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.270 -
605.mcf_s 107.000 -1.83%
605.mcf_s (avg) 107.000 -1.83%
605.mcf_s (avg) (percentage) 1.740 -1.69%
605.mcf_s (max) 73.000 -15.12%
605.mcf_s (max) (percentage) 1.190 -15.00%
605.mcf_s (unexplained diff vs previous) 12.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.190 -
607.cactuBSSN_s 153.000 -1.29%
607.cactuBSSN_s (avg) 153.000 -1.29%
607.cactuBSSN_s (avg) (percentage) 3.090 -
607.cactuBSSN_s (max) 78.000 -2.50%
607.cactuBSSN_s (max) (percentage) 1.580 -1.25%
619.lbm_s 1195.000 -1.57%
619.lbm_s (avg) 1195.000 -1.57%
619.lbm_s (avg) (percentage) 4.010 -1.72%
619.lbm_s (max) 89.000 -6.32%
619.lbm_s (max) (percentage) 0.300 -6.25%
619.lbm_s (unexplained diff vs previous) 36.000 157.14%
619.lbm_s (unexplained diff vs previous) (percentage) 0.120 140.00%
620.omnetpp_s 77.000 -
620.omnetpp_s (avg) 77.000 -
620.omnetpp_s (avg) (percentage) 1.940 -1.02%
620.omnetpp_s (max) 35.000 25.00%
620.omnetpp_s (max) (percentage) 0.880 20.55%
620.omnetpp_s (unexplained diff vs previous) 35.000 105.88%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.870 102.33%
621.wrf_s 124.000 -
621.wrf_s (avg) 124.000 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 62.000 -
621.wrf_s (max) (percentage) 0.950 -
623.xalancbmk_s 32.000 -
623.xalancbmk_s (avg) 32.000 -
623.xalancbmk_s (avg) (percentage) 0.950 -
623.xalancbmk_s (max) 16.000 -
623.xalancbmk_s (max) (percentage) 0.480 -2.04%
625.x264_s 14.000 -
625.x264_s (avg) 14.000 -
625.x264_s (avg) (percentage) 1.080 -
625.x264_s (max) 3.000 -
625.x264_s (max) (percentage) 0.250 -7.41%
627.cam4_s 14.000 -
627.cam4_s (avg) 14.000 -
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) 8.000 -11.11%
627.cam4_s (max) (percentage) 6.940 -
628.pop2_s 64.000 -
628.pop2_s (avg) 64.000 -
628.pop2_s (avg) (percentage) 0.660 -
628.pop2_s (max) 54.000 -
628.pop2_s (max) (percentage) 0.550 -1.79%
631.deepsjeng_s 42.000 -2.33%
631.deepsjeng_s (avg) 42.000 -2.33%
631.deepsjeng_s (avg) (percentage) 1.230 -
631.deepsjeng_s (max) 16.000 -
631.deepsjeng_s (max) (percentage) 0.480 -
638.imagick_s 41.000 -
638.imagick_s (avg) 41.000 -
638.imagick_s (avg) (percentage) 1.330 -
638.imagick_s (max) 8.000 -11.11%
638.imagick_s (max) (percentage) 0.280 -
641.leela_s 28.000 -
641.leela_s (avg) 28.000 -
641.leela_s (avg) (percentage) 0.820 -
641.leela_s (max) 23.000 -8.00%
641.leela_s (max) (percentage) 0.700 -4.11%
644.nab_s 76.000 -
644.nab_s (avg) 76.000 -
644.nab_s (avg) (percentage) 0.740 -
644.nab_s (max) 68.000 -1.45%
644.nab_s (max) (percentage) 0.660 -2.94%
648.exchange2_s 6.000 -
648.exchange2_s (avg) 6.000 -
648.exchange2_s (avg) (percentage) 0.460 -
648.exchange2_s (max) 1.000 -
648.exchange2_s (max) (percentage) 0.150 50.00%
648.exchange2_s (unexplained diff vs previous) 2.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.150 -
649.fotonik3d_s 198.000 -2.46%
649.fotonik3d_s (avg) 198.000 -2.46%
649.fotonik3d_s (avg) (percentage) 2.040 -1.92%
649.fotonik3d_s (max) 34.000 -52.78%
649.fotonik3d_s (max) (percentage) 0.350 -52.70%
649.fotonik3d_s (unexplained diff vs previous) 34.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.350 -
654.roms_s 921.000 -2.54%
654.roms_s (avg) 921.000 -2.54%
654.roms_s (avg) (percentage) 3.960 -2.70%
654.roms_s (max) 86.000 -23.89%
654.roms_s (max) (percentage) 0.370 -24.49%
654.roms_s (unexplained diff vs previous) 41.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.180 -
657.xz_s 37.000 -
657.xz_s (avg) 37.000 -
657.xz_s (avg) (percentage) 1.680 -
657.xz_s (max) 6.000 -
657.xz_s (max) (percentage) 0.280 -
Geometric Mean 8.141 -11.71%