Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e82bc90812c54d32991326cdf3be973a5784a507 (+ 41 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (9ae1af9fca4b354fe0b4d10eca3424a7471cf7b6) (+ 137 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=daab2a6d19f8360248289840408e7d2e5c203c2e (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (+ 16054 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/337/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0337 (4-changed-components) 2025-06-06T18:57:46 0:00:00
Previous 0336 (4-changed-components) 2025-06-02T00:40:12 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 17
Performance Improvements 59 22
Added Tests 6 116
Unchanged Tests 899 823
Total Tests 978

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 7.38% 122.000 131.000 - 0.00% -
511.povray_r 1.69% 355.000 361.000 - -3.22% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s (max) 200.00% 1.000 3.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 140.00% 10.000 24.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 140.00% 0.250 0.600 - 0.00% -
620.omnetpp_s (max) (percentage) 84.85% 0.330 0.610 - 0.00% -
620.omnetpp_s (max) 84.62% 13.000 24.000 - 0.00% -
648.exchange2_s (max) (percentage) 53.33% 0.150 0.230 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) 53.33% 0.150 0.230 - 0.00% -
648.exchange2_s (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -
627.cam4_s 7.69% 13.000 14.000 - 0.00% -
627.cam4_s (avg) 7.69% 13.000 14.000 - 0.00% -
628.pop2_s 1.75% 57.000 58.000 - 0.00% -
628.pop2_s (avg) 1.75% 57.000 58.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -1.20% 3244.000 3205.000 - -5.93% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s (unexplained diff vs previous) (percentage) -97.46% 1.180 0.030 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) -97.37% 114.000 3.000 - 0.00% -
644.nab_s (unexplained diff vs previous) -85.71% 7.000 1.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) -85.71% 0.070 0.010 - 0.00% -
619.lbm_s (unexplained diff vs previous) -80.00% 30.000 6.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -80.00% 0.100 0.020 - 0.00% -
619.lbm_s (max) -10.34% 29.000 26.000 - 0.00% -
619.lbm_s (max) (percentage) -10.00% 0.100 0.090 - 0.00% -
654.roms_s (max) -7.34% 109.000 101.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -6.84% 1.170 1.090 - 0.00% -
623.xalancbmk_s (max) -6.45% 31.000 29.000 - 0.00% -
654.roms_s (max) (percentage) -6.38% 0.470 0.440 - 0.00% -
649.fotonik3d_s (max) -6.25% 112.000 105.000 - 0.00% -
631.deepsjeng_s (max) -5.56% 18.000 17.000 - 0.00% -
641.leela_s (max) -5.56% 18.000 17.000 - 0.00% -
603.bwaves_s (max) -5.48% 219.000 207.000 - 0.00% -
644.nab_s (max) (percentage) -4.96% 1.210 1.150 - 0.00% -
657.xz_s (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
644.nab_s (max) -4.84% 124.000 118.000 - 0.00% -
603.bwaves_s (max) (percentage) -4.56% 2.410 2.300 - 0.00% -
638.imagick_s (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
510.parest_r (max) -3.92% 51.000 49.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.77% 0.530 0.510 - 0.00% -
641.leela_s (max) (percentage) -3.70% 0.540 0.520 - 0.00% -
641.leela_s -3.70% 27.000 26.000 - 0.00% -
641.leela_s (avg) -3.70% 27.000 26.000 - 0.00% -
605.mcf_s (max) -3.33% 60.000 58.000 - 0.00% -
623.xalancbmk_s -3.33% 30.000 29.000 - 0.00% -
623.xalancbmk_s (avg) -3.33% 30.000 29.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.12% 0.960 0.930 - 0.00% -
625.x264_s (max) (percentage) -2.70% 0.370 0.360 - 0.00% -
644.nab_s (avg) (percentage) -2.70% 0.740 0.720 - 0.00% -
644.nab_s -2.63% 76.000 74.000 - 0.00% -
644.nab_s (avg) -2.63% 76.000 74.000 - 0.00% -
649.fotonik3d_s -2.62% 191.000 186.000 - 0.00% -
649.fotonik3d_s (avg) -2.62% 191.000 186.000 - 0.00% -
508.namd_r (avg) (percentage) -2.53% 0.790 0.770 - 0.00% -
641.leela_s (avg) (percentage) -2.53% 0.790 0.770 - 0.00% -
649.fotonik3d_s (avg) (percentage) -2.53% 1.980 1.930 - 0.00% -
631.deepsjeng_s (avg) (percentage) -2.48% 1.210 1.180 - 0.00% -
631.deepsjeng_s -2.38% 42.000 41.000 - 0.00% -
631.deepsjeng_s (avg) -2.38% 42.000 41.000 - 0.00% -
648.exchange2_s (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
510.parest_r (max) (percentage) -2.13% 0.940 0.920 - 0.00% -
628.pop2_s (max) -2.08% 48.000 47.000 - 0.00% -
605.mcf_s (max) (percentage) -2.06% 0.970 0.950 - 0.00% -
628.pop2_s (max) (percentage) -2.04% 0.490 0.480 - 0.00% -
607.cactuBSSN_s (max) -1.82% 55.000 54.000 - 0.00% -
619.lbm_s -1.65% 1088.000 1070.000 - 0.00% -
619.lbm_s (avg) -1.65% 1088.000 1070.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.64% 3.660 3.600 - 0.00% -
508.namd_r (max) (percentage) -1.52% 0.660 0.650 - 0.00% -
526.blender_r (max) -1.43% 70.000 69.000 - 0.00% -
526.blender_r (max) (percentage) -1.39% 0.720 0.710 - 0.00% -
620.omnetpp_s -1.39% 72.000 71.000 - 0.00% -
620.omnetpp_s (avg) -1.39% 72.000 71.000 - 0.00% -
511.povray_r (max) (percentage) -1.30% 0.770 0.760 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.10% 1.820 1.800 - 0.00% -

Added Tests - sample variability
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
631.deepsjeng_s (unexplained diff vs previous)
631.deepsjeng_s (unexplained diff vs previous) (percentage)
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 14.27% 707624.000 808594.000 - 0.00% -
526.blender_r 14.03% 11474556.000 13084986.000 - -0.06% -
657.xz_s 10.73% 150385.000 166521.000 - -0.10% -
607.cactuBSSN_s 7.69% 3684442.000 3967731.000 - 0.00% -
600.perlbench_s 7.35% 2649560.000 2844227.000 - -0.29% -
648.exchange2_s 5.73% 164878.000 174320.000 - -0.06% -
605.mcf_s 5.31% 23365.000 24605.000 - 0.00% -
623.xalancbmk_s 4.44% 3748643.000 3915062.000 - 0.20% -
510.parest_r 2.80% 1733486.000 1781959.000 - 0.50% -
602.gcc_s 2.78% 10139438.000 10421094.000 - 0.16% -
628.pop2_s 1.99% 3413948.000 3481725.000 - 0.45% -
511.povray_r 1.69% 1093239.000 1111767.000 - 0.00% -
631.deepsjeng_s 1.61% 84996.000 86368.000 - 0.00% -
638.imagick_s 1.40% 1700122.000 1723854.000 - -0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 2.88% 4798.000 4936.000 - -0.94% -
631.deepsjeng_s 1.58% 3425.000 3479.000 - -0.26% -
620.omnetpp_s 1.32% 3937.000 3989.000 - 0.61% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.39% 646275.000 617913.000 - 0.02% -
649.fotonik3d_s -3.62% 343226.000 330816.000 - 0.00% -
654.roms_s -2.56% 863494.000 841413.000 - -0.00% -
620.omnetpp_s -1.78% 1922167.000 1888013.000 - -0.01% -
603.bwaves_s -1.71% 52595.000 51695.000 - 0.00% -
619.lbm_s -1.67% 13445.000 13221.000 - 0.00% -
641.leela_s -1.33% 108742.000 107297.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -17.28% 1626.000 1345.000 - 0.82% -
648.exchange2_s -7.95% 1422.000 1309.000 - -0.23% -
600.perlbench_s -7.02% 2152.000 2001.000 - 0.55% -
638.imagick_s -6.65% 3368.000 3144.000 - -0.13% -
623.xalancbmk_s -5.93% 3407.000 3205.000 - -1.20% -
657.xz_s -5.74% 2319.000 2186.000 - -0.32% -
641.leela_s -5.02% 3605.000 3424.000 - 0.09% -
649.fotonik3d_s -4.26% 10088.000 9658.000 - 0.03% -
654.roms_s -3.76% 24034.000 23131.000 - -0.64% -
511.povray_r -3.22% 373.000 361.000 - 1.69% -
605.mcf_s -3.19% 6394.000 6190.000 - -0.24% -
628.pop2_s -2.50% 10109.000 9856.000 - 0.44% -
621.wrf_s -2.41% 6687.000 6526.000 - 0.73% -
602.gcc_s -2.18% 4126.000 4036.000 - -0.62% -
526.blender_r -1.71% 9950.000 9780.000 - -0.80% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.51s
Name Current %
508.namd_r 2400.000 -
510.parest_r 5430.000 -
511.povray_r 361.000 1.69%
526.blender_r 9780.000 -
600.perlbench_s 2001.000 -
602.gcc_s 4036.000 -
603.bwaves_s 9023.000 -
605.mcf_s 6190.000 -
607.cactuBSSN_s 4936.000 -
619.lbm_s 29737.000 -
620.omnetpp_s 3989.000 -
621.wrf_s 6526.000 -
623.xalancbmk_s 3205.000 -1.20%
625.x264_s 1345.000 -
627.cam4_s 131.000 7.38%
628.pop2_s 9856.000 -
631.deepsjeng_s 3479.000 -
638.imagick_s 3144.000 -
641.leela_s 3424.000 -
644.nab_s 10289.000 -
648.exchange2_s 1309.000 -
649.fotonik3d_s 9658.000 -
654.roms_s 23131.000 -
657.xz_s 2186.000 -
Geometric Mean 3844.560 -
Name Current %
508.namd_r 808594.000 -
510.parest_r 1781959.000 -
511.povray_r 1111767.000 -
526.blender_r 13084986.000 -
600.perlbench_s 2844227.000 -
602.gcc_s 10421094.000 -
603.bwaves_s 51695.000 -
605.mcf_s 24605.000 -
607.cactuBSSN_s 3967731.000 -
619.lbm_s 13221.000 -
620.omnetpp_s 1888013.000 -
621.wrf_s 15772193.000 -
623.xalancbmk_s 3915062.000 -
625.x264_s 617913.000 -
628.pop2_s 3481725.000 -
631.deepsjeng_s 86368.000 -
638.imagick_s 1723854.000 -
641.leela_s 107297.000 -
644.nab_s 105174.000 -
648.exchange2_s 174320.000 -
649.fotonik3d_s 330816.000 -
654.roms_s 841413.000 -
657.xz_s 166521.000 -
Geometric Mean 680135.149 -
Name Current %
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.770 -2.53%
508.namd_r (max) 15.000 -
508.namd_r (max) (percentage) 0.650 -1.52%
508.namd_r (unexplained diff vs previous) 1.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.040 -
510.parest_r 123.000 -
510.parest_r (avg) 123.000 -
510.parest_r (avg) (percentage) 2.270 -
510.parest_r (max) 49.000 -3.92%
510.parest_r (max) (percentage) 0.920 -2.13%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.050 -
511.povray_r (max) 2.000 -
511.povray_r (max) (percentage) 0.760 -1.30%
526.blender_r 116.000 -
526.blender_r (avg) 116.000 -
526.blender_r (avg) (percentage) 1.190 -
526.blender_r (max) 69.000 -1.43%
526.blender_r (max) (percentage) 0.710 -1.39%
600.perlbench_s 40.000 -
600.perlbench_s (avg) 40.000 -
600.perlbench_s (avg) (percentage) 2.030 -
600.perlbench_s (max) 20.000 -
600.perlbench_s (max) (percentage) 1.010 -
603.bwaves_s 171.000 -
603.bwaves_s (avg) 171.000 -
603.bwaves_s (avg) (percentage) 1.900 -
603.bwaves_s (max) 207.000 -5.48%
603.bwaves_s (max) (percentage) 2.300 -4.56%
605.mcf_s 101.000 -
605.mcf_s (avg) 101.000 -
605.mcf_s (avg) (percentage) 1.640 -
605.mcf_s (max) 58.000 -3.33%
605.mcf_s (max) (percentage) 0.950 -2.06%
607.cactuBSSN_s 148.000 -
607.cactuBSSN_s (avg) 148.000 -
607.cactuBSSN_s (avg) (percentage) 3.000 -
607.cactuBSSN_s (max) 54.000 -1.82%
607.cactuBSSN_s (max) (percentage) 1.110 -
619.lbm_s 1070.000 -1.65%
619.lbm_s (avg) 1070.000 -1.65%
619.lbm_s (avg) (percentage) 3.600 -1.64%
619.lbm_s (max) 26.000 -10.34%
619.lbm_s (max) (percentage) 0.090 -10.00%
619.lbm_s (unexplained diff vs previous) 6.000 -80.00%
619.lbm_s (unexplained diff vs previous) (percentage) 0.020 -80.00%
620.omnetpp_s 71.000 -1.39%
620.omnetpp_s (avg) 71.000 -1.39%
620.omnetpp_s (avg) (percentage) 1.800 -1.10%
620.omnetpp_s (max) 24.000 84.62%
620.omnetpp_s (max) (percentage) 0.610 84.85%
620.omnetpp_s (unexplained diff vs previous) 24.000 140.00%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.600 140.00%
621.wrf_s 122.000 -
621.wrf_s (avg) 122.000 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 61.000 -
621.wrf_s (max) (percentage) 0.950 -
623.xalancbmk_s 29.000 -3.33%
623.xalancbmk_s (avg) 29.000 -3.33%
623.xalancbmk_s (avg) (percentage) 0.930 -
623.xalancbmk_s (max) 29.000 -6.45%
623.xalancbmk_s (max) (percentage) 0.930 -3.12%
625.x264_s 14.000 -
625.x264_s (avg) 14.000 -
625.x264_s (avg) (percentage) 1.050 -
625.x264_s (max) 4.000 -
625.x264_s (max) (percentage) 0.360 -2.70%
627.cam4_s 14.000 7.69%
627.cam4_s (avg) 14.000 7.69%
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) 8.000 -
627.cam4_s (max) (percentage) 6.870 -
628.pop2_s 58.000 1.75%
628.pop2_s (avg) 58.000 1.75%
628.pop2_s (avg) (percentage) 0.590 -
628.pop2_s (max) 47.000 -2.08%
628.pop2_s (max) (percentage) 0.480 -2.04%
631.deepsjeng_s 41.000 -2.38%
631.deepsjeng_s (avg) 41.000 -2.38%
631.deepsjeng_s (avg) (percentage) 1.180 -2.48%
631.deepsjeng_s (max) 17.000 -5.56%
631.deepsjeng_s (max) (percentage) 0.510 -3.77%
631.deepsjeng_s (unexplained diff vs previous) 9.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.260 -
638.imagick_s 40.000 -
638.imagick_s (avg) 40.000 -
638.imagick_s (avg) (percentage) 1.280 -
638.imagick_s (max) 7.000 -
638.imagick_s (max) (percentage) 0.240 -4.00%
641.leela_s 26.000 -3.70%
641.leela_s (avg) 26.000 -3.70%
641.leela_s (avg) (percentage) 0.770 -2.53%
641.leela_s (max) 17.000 -5.56%
641.leela_s (max) (percentage) 0.520 -3.70%
641.leela_s (unexplained diff vs previous) 3.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.090 -
644.nab_s 74.000 -2.63%
644.nab_s (avg) 74.000 -2.63%
644.nab_s (avg) (percentage) 0.720 -2.70%
644.nab_s (max) 118.000 -4.84%
644.nab_s (max) (percentage) 1.150 -4.96%
644.nab_s (unexplained diff vs previous) 1.000 -85.71%
644.nab_s (unexplained diff vs previous) (percentage) 0.010 -85.71%
648.exchange2_s 5.000 -
648.exchange2_s (avg) 5.000 -
648.exchange2_s (avg) (percentage) 0.430 -2.27%
648.exchange2_s (max) 3.000 200.00%
648.exchange2_s (max) (percentage) 0.230 53.33%
648.exchange2_s (unexplained diff vs previous) 3.000 50.00%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.230 53.33%
649.fotonik3d_s 186.000 -2.62%
649.fotonik3d_s (avg) 186.000 -2.62%
649.fotonik3d_s (avg) (percentage) 1.930 -2.53%
649.fotonik3d_s (max) 105.000 -6.25%
649.fotonik3d_s (max) (percentage) 1.090 -6.84%
649.fotonik3d_s (unexplained diff vs previous) 3.000 -97.37%
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.030 -97.46%
654.roms_s 872.000 -
654.roms_s (avg) 872.000 -
654.roms_s (avg) (percentage) 3.770 -
654.roms_s (max) 101.000 -7.34%
654.roms_s (max) (percentage) 0.440 -6.38%
657.xz_s 33.000 -
657.xz_s (avg) 33.000 -
657.xz_s (avg) (percentage) 1.550 -
657.xz_s (max) 8.000 -
657.xz_s (max) (percentage) 0.390 -4.88%
Geometric Mean 6.729 -18.73%