Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0de07b986383f8be874df352482ea404760202c5 (+ 114 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (a4a726ca9485b07fb56a1442b5f9e5679944ed06) (+ 263 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=59f64a1f4f3bbe2bcaf8fc1951b94e1d0e7d307e (+ 15 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/d2cb798d2d8ceb0d194721a2cb0e577b4b927573 (+ 551 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/323/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0323 (4-changed-components) 2025-04-24T05:37:55 0:00:00
Previous 0322 (4-changed-components) 2025-04-15T21:03:28 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 15
Performance Improvements 41 20
Added Tests 0 116
Unchanged Tests 917 827
Total Tests 978

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 5.65% 124.000 131.000 - 0.00% -
621.wrf_s 2.73% 6376.000 6550.000 - -2.05% -
641.leela_s 1.50% 3402.000 3453.000 - -4.22% -
511.povray_r 1.40% 358.000 363.000 - -2.68% -
602.gcc_s 1.34% 4022.000 4076.000 - -1.21% -
623.xalancbmk_s 1.05% 3341.000 3376.000 - -0.91% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) 150.00% 0.020 0.050 - 0.00% -
619.lbm_s (unexplained diff vs previous) 133.33% 6.000 14.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) 40.91% 0.220 0.310 - 0.00% -
644.nab_s (unexplained diff vs previous) 39.13% 23.000 32.000 - 0.00% -
627.cam4_s (max) 12.50% 8.000 9.000 - 0.00% -
627.cam4_s 7.69% 13.000 14.000 - 0.00% -
627.cam4_s (avg) 7.69% 13.000 14.000 - 0.00% -
641.leela_s 3.70% 27.000 28.000 - 0.00% -
641.leela_s (avg) 3.70% 27.000 28.000 - 0.00% -
621.wrf_s 3.36% 119.000 123.000 - 0.00% -
621.wrf_s (avg) 3.36% 119.000 123.000 - 0.00% -
621.wrf_s (max) 3.33% 60.000 62.000 - 0.00% -
623.xalancbmk_s 3.23% 31.000 32.000 - 0.00% -
623.xalancbmk_s (avg) 3.23% 31.000 32.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -56.41% 39.000 17.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -56.12% 0.980 0.430 - 0.00% -
620.omnetpp_s (max) -26.32% 38.000 28.000 - 0.00% -
620.omnetpp_s (max) (percentage) -24.74% 0.970 0.730 - 0.00% -
619.lbm_s (max) -11.21% 107.000 95.000 - 0.00% -
619.lbm_s (max) (percentage) -11.11% 0.360 0.320 - 0.00% -
625.x264_s (max) (percentage) -10.00% 0.300 0.270 - 0.00% -
603.bwaves_s (max) -8.67% 150.000 137.000 - 0.00% -
603.bwaves_s (max) (percentage) -8.38% 1.670 1.530 - 0.00% -
605.mcf_s (max) -6.52% 92.000 86.000 - 0.00% -
510.parest_r (max) -6.25% 16.000 15.000 - 0.00% -
605.mcf_s (max) (percentage) -6.04% 1.490 1.400 - 0.00% -
623.xalancbmk_s (max) -5.88% 17.000 16.000 - 0.00% -
631.deepsjeng_s (max) -5.88% 17.000 16.000 - 0.00% -
644.nab_s (max) -5.48% 73.000 69.000 - 0.00% -
644.nab_s (max) (percentage) -4.23% 0.710 0.680 - 0.00% -
641.leela_s (max) (percentage) -3.95% 0.760 0.730 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
654.roms_s (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
654.roms_s (max) -3.42% 117.000 113.000 - 0.00% -
510.parest_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
638.imagick_s (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
657.xz_s (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
511.povray_r (max) (percentage) -3.30% 0.910 0.880 - 0.00% -
526.blender_r (max) -3.00% 100.000 97.000 - 0.00% -
526.blender_r (max) (percentage) -2.94% 1.020 0.990 - 0.00% -
649.fotonik3d_s (max) -2.70% 74.000 72.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -2.63% 0.760 0.740 - 0.00% -
620.omnetpp_s -2.53% 79.000 77.000 - 0.00% -
620.omnetpp_s (avg) -2.53% 79.000 77.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.04% 0.490 0.480 - 0.00% -
619.lbm_s -1.94% 1238.000 1214.000 - 0.00% -
619.lbm_s (avg) -1.94% 1238.000 1214.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.92% 4.160 4.080 - 0.00% -
628.pop2_s (max) -1.82% 55.000 54.000 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.51% 1.990 1.960 - 0.00% -
644.nab_s (avg) (percentage) -1.33% 0.750 0.740 - 0.00% -
644.nab_s -1.30% 77.000 76.000 - 0.00% -
644.nab_s (avg) -1.30% 77.000 76.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -1.23% 1.620 1.600 - 0.00% -
607.cactuBSSN_s (max) -1.23% 81.000 80.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 13.77% 707624.000 805069.000 - 0.15% -
526.blender_r 13.16% 11474556.000 12984346.000 - 0.02% -
657.xz_s 10.72% 150385.000 166501.000 - -0.03% -
600.perlbench_s 7.75% 2649560.000 2854835.000 - -0.14% -
607.cactuBSSN_s 6.79% 3684442.000 3934592.000 - 0.41% -
648.exchange2_s 5.95% 164878.000 174696.000 - 0.02% -
623.xalancbmk_s 4.35% 3748643.000 3911794.000 - -0.11% -
605.mcf_s 3.36% 23365.000 24149.000 - 0.00% -
602.gcc_s 2.66% 10139438.000 10408898.000 - -0.12% -
510.parest_r 2.40% 1733486.000 1775079.000 - 0.22% -
511.povray_r 2.07% 1093239.000 1115915.000 - -0.28% -
631.deepsjeng_s 1.78% 84996.000 86512.000 - 0.79% -
628.pop2_s 1.62% 3413948.000 3469129.000 - 0.15% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 5.00% 4798.000 5038.000 - 0.00% -
631.deepsjeng_s 2.92% 3425.000 3525.000 - 0.69% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.76% 646275.000 615510.000 - -0.02% -
649.fotonik3d_s -3.91% 343226.000 329796.000 - -0.70% -
654.roms_s -2.11% 863494.000 845293.000 - 0.28% -
603.bwaves_s -1.80% 52595.000 51647.000 - 0.20% -
619.lbm_s -1.73% 13445.000 13213.000 - 0.00% -
620.omnetpp_s -1.67% 1922167.000 1890124.000 - -0.48% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -18.20% 1626.000 1330.000 - -0.23% -
648.exchange2_s -7.74% 1422.000 1312.000 - 0.38% -
600.perlbench_s -7.71% 2152.000 1986.000 - 0.15% -
638.imagick_s -6.71% 3368.000 3142.000 - -0.22% -
657.xz_s -4.83% 2319.000 2207.000 - -0.05% -
641.leela_s -4.22% 3605.000 3453.000 - 1.50% -
654.roms_s -3.37% 24034.000 23225.000 - 0.45% -
649.fotonik3d_s -3.16% 10088.000 9769.000 - 0.15% -
628.pop2_s -3.02% 10109.000 9804.000 - 0.20% -
605.mcf_s -2.94% 6394.000 6206.000 - -0.14% -
511.povray_r -2.68% 373.000 363.000 - 1.40% -
621.wrf_s -2.05% 6687.000 6550.000 - 2.73% -
526.blender_r -1.28% 9950.000 9823.000 - -0.11% -
602.gcc_s -1.21% 4126.000 4076.000 - 1.34% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2426.000 -
510.parest_r 5449.000 -
511.povray_r 363.000 1.40%
526.blender_r 9823.000 -
600.perlbench_s 1986.000 -
602.gcc_s 4076.000 1.34%
603.bwaves_s 8986.000 -
605.mcf_s 6206.000 -
607.cactuBSSN_s 5038.000 -
619.lbm_s 29769.000 -
620.omnetpp_s 3967.000 -
621.wrf_s 6550.000 2.73%
623.xalancbmk_s 3376.000 1.05%
625.x264_s 1330.000 -
627.cam4_s 131.000 5.65%
628.pop2_s 9804.000 -
631.deepsjeng_s 3525.000 -
638.imagick_s 3142.000 -
641.leela_s 3453.000 1.50%
644.nab_s 10285.000 -
648.exchange2_s 1312.000 -
649.fotonik3d_s 9769.000 -
654.roms_s 23225.000 -
657.xz_s 2207.000 -
Geometric Mean 3865.121 -
Name Current %
508.namd_r 805069.000 -
510.parest_r 1775079.000 -
511.povray_r 1115915.000 -
526.blender_r 12984346.000 -
600.perlbench_s 2854835.000 -
602.gcc_s 10408898.000 -
603.bwaves_s 51647.000 -
605.mcf_s 24149.000 -
607.cactuBSSN_s 3934592.000 -
619.lbm_s 13213.000 -
620.omnetpp_s 1890124.000 -
621.wrf_s 15773149.000 -
623.xalancbmk_s 3911794.000 -
625.x264_s 615510.000 -
628.pop2_s 3469129.000 -
631.deepsjeng_s 86512.000 -
638.imagick_s 1714758.000 -
641.leela_s 107732.000 -
644.nab_s 105398.000 -
648.exchange2_s 174696.000 -
649.fotonik3d_s 329796.000 -
654.roms_s 845293.000 -
657.xz_s 166501.000 -
Geometric Mean 678971.269 -
Name Current %
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.800 -
508.namd_r (max) 21.000 -
508.namd_r (max) (percentage) 0.900 -
510.parest_r 126.000 -
510.parest_r (avg) 126.000 -
510.parest_r (avg) (percentage) 2.330 -
510.parest_r (max) 15.000 -6.25%
510.parest_r (max) (percentage) 0.290 -3.33%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.050 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.880 -3.30%
526.blender_r 120.000 -
526.blender_r (avg) 120.000 -
526.blender_r (avg) (percentage) 1.230 -
526.blender_r (max) 97.000 -3.00%
526.blender_r (max) (percentage) 0.990 -2.94%
600.perlbench_s 40.000 -
600.perlbench_s (avg) 40.000 -
600.perlbench_s (avg) (percentage) 2.030 -
600.perlbench_s (max) 20.000 -
600.perlbench_s (max) (percentage) 1.010 -
603.bwaves_s 178.000 -
603.bwaves_s (avg) 178.000 -
603.bwaves_s (avg) (percentage) 1.990 -
603.bwaves_s (max) 137.000 -8.67%
603.bwaves_s (max) (percentage) 1.530 -8.38%
605.mcf_s 109.000 -
605.mcf_s (avg) 109.000 -
605.mcf_s (avg) (percentage) 1.770 -
605.mcf_s (max) 86.000 -6.52%
605.mcf_s (max) (percentage) 1.400 -6.04%
607.cactuBSSN_s 155.000 -
607.cactuBSSN_s (avg) 155.000 -
607.cactuBSSN_s (avg) (percentage) 3.090 -
607.cactuBSSN_s (max) 80.000 -1.23%
607.cactuBSSN_s (max) (percentage) 1.600 -1.23%
619.lbm_s 1214.000 -1.94%
619.lbm_s (avg) 1214.000 -1.94%
619.lbm_s (avg) (percentage) 4.080 -1.92%
619.lbm_s (max) 95.000 -11.21%
619.lbm_s (max) (percentage) 0.320 -11.11%
619.lbm_s (unexplained diff vs previous) 14.000 133.33%
619.lbm_s (unexplained diff vs previous) (percentage) 0.050 150.00%
620.omnetpp_s 77.000 -2.53%
620.omnetpp_s (avg) 77.000 -2.53%
620.omnetpp_s (avg) (percentage) 1.960 -1.51%
620.omnetpp_s (max) 28.000 -26.32%
620.omnetpp_s (max) (percentage) 0.730 -24.74%
620.omnetpp_s (unexplained diff vs previous) 17.000 -56.41%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.430 -56.12%
621.wrf_s 123.000 3.36%
621.wrf_s (avg) 123.000 3.36%
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 62.000 3.33%
621.wrf_s (max) (percentage) 0.950 -
623.xalancbmk_s 32.000 3.23%
623.xalancbmk_s (avg) 32.000 3.23%
623.xalancbmk_s (avg) (percentage) 0.950 -
623.xalancbmk_s (max) 16.000 -5.88%
623.xalancbmk_s (max) (percentage) 0.490 -3.92%
625.x264_s 14.000 -
625.x264_s (avg) 14.000 -
625.x264_s (avg) (percentage) 1.080 -
625.x264_s (max) 3.000 -
625.x264_s (max) (percentage) 0.270 -10.00%
627.cam4_s 14.000 7.69%
627.cam4_s (avg) 14.000 7.69%
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) 9.000 12.50%
627.cam4_s (max) (percentage) 6.950 -
628.pop2_s 64.000 -
628.pop2_s (avg) 64.000 -
628.pop2_s (avg) (percentage) 0.660 -
628.pop2_s (max) 54.000 -1.82%
628.pop2_s (max) (percentage) 0.560 -
631.deepsjeng_s 43.000 -
631.deepsjeng_s (avg) 43.000 -
631.deepsjeng_s (avg) (percentage) 1.230 -
631.deepsjeng_s (max) 16.000 -5.88%
631.deepsjeng_s (max) (percentage) 0.480 -2.04%
638.imagick_s 41.000 -
638.imagick_s (avg) 41.000 -
638.imagick_s (avg) (percentage) 1.330 -
638.imagick_s (max) 9.000 -
638.imagick_s (max) (percentage) 0.290 -3.33%
641.leela_s 28.000 3.70%
641.leela_s (avg) 28.000 3.70%
641.leela_s (avg) (percentage) 0.820 -
641.leela_s (max) 25.000 -
641.leela_s (max) (percentage) 0.730 -3.95%
644.nab_s 76.000 -1.30%
644.nab_s (avg) 76.000 -1.30%
644.nab_s (avg) (percentage) 0.740 -1.33%
644.nab_s (max) 69.000 -5.48%
644.nab_s (max) (percentage) 0.680 -4.23%
644.nab_s (unexplained diff vs previous) 32.000 39.13%
644.nab_s (unexplained diff vs previous) (percentage) 0.310 40.91%
648.exchange2_s 6.000 -
648.exchange2_s (avg) 6.000 -
648.exchange2_s (avg) (percentage) 0.470 -
648.exchange2_s (max) 1.000 -
648.exchange2_s (max) (percentage) 0.100 -
649.fotonik3d_s 203.000 -
649.fotonik3d_s (avg) 203.000 -
649.fotonik3d_s (avg) (percentage) 2.080 -
649.fotonik3d_s (max) 72.000 -2.70%
649.fotonik3d_s (max) (percentage) 0.740 -2.63%
654.roms_s 945.000 -
654.roms_s (avg) 945.000 -
654.roms_s (avg) (percentage) 4.070 -
654.roms_s (max) 113.000 -3.42%
654.roms_s (max) (percentage) 0.490 -3.92%
657.xz_s 37.000 -
657.xz_s (avg) 37.000 -
657.xz_s (avg) (percentage) 1.680 -
657.xz_s (max) 6.000 -
657.xz_s (max) (percentage) 0.290 -3.33%
Geometric Mean 9.059 -