Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=83c30fcc4d10fa3783199379e358a884a64f8688 (+ 155 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (c74e7f651a014d59631361bcc9be05d797928c5c) (+ 153 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=392261a2b6f94a32ff0dc511a52275d62301f535 (+ 23 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/a1856aaa2ca74c88751f7d255dfa0c8c50fcc1ca (+ 585 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/300/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0300 (4-changed-components) 2025-02-03T20:23:02 0:00:00
Previous 0297 (4-changed-components) 2025-01-27T01:47:02 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 16 22
Performance Improvements 42 14
Added Tests 0 116
Unchanged Tests 920 826
Total Tests 978

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.17% 329113.000 332953.000 - -2.99% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s 3.76% 133.000 138.000 - 0.00% -
607.cactuBSSN_s 3.23% 4712.000 4864.000 - 1.38% -
623.xalancbmk_s 1.28% 3369.000 3412.000 - 0.15% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) 457.45% 47.000 262.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 453.33% 0.150 0.830 - 0.00% -
526.blender_r (unexplained diff vs previous) 196.77% 31.000 92.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 196.67% 0.300 0.890 - 0.00% -
526.blender_r (max) (percentage) 87.23% 0.470 0.880 - 0.00% -
526.blender_r (max) 85.71% 49.000 91.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 44.23% 0.520 0.750 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 42.86% 21.000 30.000 - 0.00% -
627.cam4_s 7.14% 14.000 15.000 - 0.00% -
627.cam4_s (avg) 7.14% 14.000 15.000 - 0.00% -
607.cactuBSSN_s 3.23% 155.000 160.000 - 0.00% -
607.cactuBSSN_s (avg) 3.23% 155.000 160.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s -1.55% 9018.000 8878.000 - -1.59% -
511.povray_r -1.08% 372.000 368.000 - -1.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s (max) -10.98% 82.000 73.000 - 0.00% -
619.lbm_s (max) (percentage) -9.87% 3.750 3.380 - 0.00% -
644.nab_s (max) -9.82% 112.000 101.000 - 0.00% -
619.lbm_s (max) -9.08% 1167.000 1061.000 - 0.00% -
603.bwaves_s (max) (percentage) -8.79% 0.910 0.830 - 0.00% -
644.nab_s (max) (percentage) -8.74% 1.030 0.940 - 0.00% -
641.leela_s (max) -7.69% 13.000 12.000 - 0.00% -
648.exchange2_s (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
605.mcf_s (max) (percentage) -7.26% 1.240 1.150 - 0.00% -
605.mcf_s (max) -6.33% 79.000 74.000 - 0.00% -
510.parest_r (max) -5.26% 19.000 18.000 - 0.00% -
631.deepsjeng_s (max) -5.00% 20.000 19.000 - 0.00% -
511.povray_r (max) (percentage) -4.90% 1.020 0.970 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.76% 2.130 2.050 - 0.00% -
654.roms_s (max) -3.65% 137.000 132.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
654.roms_s (max) (percentage) -3.51% 0.570 0.550 - 0.00% -
657.xz_s (max) (percentage) -3.45% 0.580 0.560 - 0.00% -
508.namd_r (max) -3.33% 30.000 29.000 - 0.00% -
508.namd_r (max) (percentage) -2.86% 1.050 1.020 - 0.00% -
620.omnetpp_s (max) -2.86% 35.000 34.000 - 0.00% -
526.blender_r -2.84% 141.000 137.000 - 0.00% -
526.blender_r (avg) -2.84% 141.000 137.000 - 0.00% -
600.perlbench_s (max) -2.70% 37.000 36.000 - 0.00% -
625.x264_s (max) (percentage) -2.47% 0.810 0.790 - 0.00% -
638.imagick_s (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
620.omnetpp_s (max) (percentage) -2.27% 0.880 0.860 - 0.00% -
620.omnetpp_s -2.25% 89.000 87.000 - 0.00% -
620.omnetpp_s (avg) -2.25% 89.000 87.000 - 0.00% -
649.fotonik3d_s (max) -2.17% 92.000 90.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -2.13% 0.940 0.920 - 0.00% -
619.lbm_s (avg) (percentage) -1.65% 4.840 4.760 - 0.00% -
600.perlbench_s (max) (percentage) -1.62% 1.850 1.820 - 0.00% -
603.bwaves_s -1.57% 191.000 188.000 - 0.00% -
603.bwaves_s (avg) -1.57% 191.000 188.000 - 0.00% -
526.blender_r (avg) (percentage) -1.48% 1.350 1.330 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.36% 2.200 2.170 - 0.00% -
638.imagick_s -1.22% 82.000 81.000 - 0.00% -
638.imagick_s (avg) -1.22% 82.000 81.000 - 0.00% -
607.cactuBSSN_s (max) -1.00% 100.000 99.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 13.68% 707624.000 804460.000 - -0.07% -
526.blender_r 11.63% 11474556.000 12809349.000 - -0.10% -
657.xz_s 11.03% 150385.000 166965.000 - 0.08% -
600.perlbench_s 7.30% 2649560.000 2842851.000 - 0.27% -
648.exchange2_s 6.03% 164878.000 174820.000 - 0.06% -
607.cactuBSSN_s 5.08% 3684442.000 3871641.000 - -0.11% -
623.xalancbmk_s 4.52% 3748643.000 3918242.000 - 0.19% -
602.gcc_s 3.11% 10139438.000 10454622.000 - 0.23% -
510.parest_r 1.99% 1733486.000 1767903.000 - 0.20% -
511.povray_r 1.12% 1093239.000 1105468.000 - -0.03% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
638.imagick_s 60.15% 3368.000 5394.000 - -0.15% -
508.namd_r 20.18% 2408.000 2894.000 - -0.21% -
631.deepsjeng_s 5.96% 3425.000 3629.000 - -0.03% -
644.nab_s 5.88% 10194.000 10793.000 - -0.94% -
641.leela_s 5.83% 3605.000 3815.000 - 0.05% -
619.lbm_s 4.76% 29971.000 31397.000 - 0.84% -
526.blender_r 4.13% 9950.000 10361.000 - -0.88% -
621.wrf_s 2.39% 6687.000 6847.000 - -0.49% -
620.omnetpp_s 2.06% 3937.000 4018.000 - -0.74% -
657.xz_s 1.90% 2319.000 2363.000 - 0.64% -
605.mcf_s 1.42% 6394.000 6485.000 - 0.64% -
607.cactuBSSN_s 1.38% 4798.000 4864.000 - 3.23% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.59% 646275.000 616614.000 - -0.03% -
619.lbm_s -4.02% 13445.000 12905.000 - 0.00% -
654.roms_s -3.84% 863494.000 830357.000 - 0.99% -
603.bwaves_s -3.22% 52595.000 50903.000 - -0.25% -
649.fotonik3d_s -2.99% 343226.000 332953.000 - 1.17% -
641.leela_s -1.96% 108742.000 106612.000 - -0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -16.79% 1626.000 1353.000 - -0.22% -
648.exchange2_s -7.45% 1422.000 1316.000 - 0.53% -
600.perlbench_s -5.90% 2152.000 2025.000 - -0.59% -
649.fotonik3d_s -2.34% 10088.000 9852.000 - 0.37% -
603.bwaves_s -1.59% 9021.000 8878.000 - -1.55% -
628.pop2_s -1.45% 10109.000 9962.000 - 0.58% -
511.povray_r -1.34% 373.000 368.000 - -1.08% -
602.gcc_s -1.07% 4126.000 4082.000 - -0.24% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2894.000 -
510.parest_r 5472.000 -
511.povray_r 368.000 -1.08%
526.blender_r 10361.000 -
600.perlbench_s 2025.000 -
602.gcc_s 4082.000 -
603.bwaves_s 8878.000 -1.55%
605.mcf_s 6485.000 -
607.cactuBSSN_s 4864.000 3.23%
619.lbm_s 31397.000 -
620.omnetpp_s 4018.000 -
621.wrf_s 6847.000 -
623.xalancbmk_s 3412.000 1.28%
625.x264_s 1353.000 -
627.cam4_s 138.000 3.76%
628.pop2_s 9962.000 -
631.deepsjeng_s 3629.000 -
638.imagick_s 5394.000 -
641.leela_s 3815.000 -
644.nab_s 10793.000 -
648.exchange2_s 1316.000 -
649.fotonik3d_s 9852.000 -
654.roms_s 24125.000 -
657.xz_s 2363.000 -
Geometric Mean 4081.388 -
Name Current %
508.namd_r 804460.000 -
510.parest_r 1767903.000 -
511.povray_r 1105468.000 -
526.blender_r 12809349.000 -
600.perlbench_s 2842851.000 -
602.gcc_s 10454622.000 -
603.bwaves_s 50903.000 -
605.mcf_s 23265.000 -
607.cactuBSSN_s 3871641.000 -
619.lbm_s 12905.000 -
620.omnetpp_s 1904575.000 -
621.wrf_s 15711869.000 -
623.xalancbmk_s 3918242.000 -
625.x264_s 616614.000 -
628.pop2_s 3438753.000 -
631.deepsjeng_s 85676.000 -
638.imagick_s 1713682.000 -
641.leela_s 106612.000 -
644.nab_s 105518.000 -
648.exchange2_s 174820.000 -
649.fotonik3d_s 332953.000 1.17%
654.roms_s 830357.000 -
657.xz_s 166965.000 -
Geometric Mean 674697.953 -
Name Current %
508.namd_r 23.000 -
508.namd_r (avg) 23.000 -
508.namd_r (avg) (percentage) 0.810 -
508.namd_r (max) 29.000 -3.33%
508.namd_r (max) (percentage) 1.020 -2.86%
510.parest_r 145.000 -
510.parest_r (avg) 145.000 -
510.parest_r (avg) (percentage) 2.650 -
510.parest_r (max) 18.000 -5.26%
510.parest_r (max) (percentage) 0.340 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.090 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.970 -4.90%
526.blender_r 137.000 -2.84%
526.blender_r (avg) 137.000 -2.84%
526.blender_r (avg) (percentage) 1.330 -1.48%
526.blender_r (max) 91.000 85.71%
526.blender_r (max) (percentage) 0.880 87.23%
526.blender_r (unexplained diff vs previous) 92.000 196.77%
526.blender_r (unexplained diff vs previous) (percentage) 0.890 196.67%
600.perlbench_s 44.000 -
600.perlbench_s (avg) 44.000 -
600.perlbench_s (avg) (percentage) 2.190 -
600.perlbench_s (max) 36.000 -2.70%
600.perlbench_s (max) (percentage) 1.820 -1.62%
603.bwaves_s 188.000 -1.57%
603.bwaves_s (avg) 188.000 -1.57%
603.bwaves_s (avg) (percentage) 2.120 -
603.bwaves_s (max) 73.000 -10.98%
603.bwaves_s (max) (percentage) 0.830 -8.79%
605.mcf_s 122.000 -
605.mcf_s (avg) 122.000 -
605.mcf_s (avg) (percentage) 1.890 -
605.mcf_s (max) 74.000 -6.33%
605.mcf_s (max) (percentage) 1.150 -7.26%
607.cactuBSSN_s 160.000 3.23%
607.cactuBSSN_s (avg) 160.000 3.23%
607.cactuBSSN_s (avg) (percentage) 3.290 -
607.cactuBSSN_s (max) 99.000 -1.00%
607.cactuBSSN_s (max) (percentage) 2.050 -3.76%
619.lbm_s 1494.000 -
619.lbm_s (avg) 1494.000 -
619.lbm_s (avg) (percentage) 4.760 -1.65%
619.lbm_s (max) 1061.000 -9.08%
619.lbm_s (max) (percentage) 3.380 -9.87%
619.lbm_s (unexplained diff vs previous) 262.000 457.45%
619.lbm_s (unexplained diff vs previous) (percentage) 0.830 453.33%
620.omnetpp_s 87.000 -2.25%
620.omnetpp_s (avg) 87.000 -2.25%
620.omnetpp_s (avg) (percentage) 2.170 -1.36%
620.omnetpp_s (max) 34.000 -2.86%
620.omnetpp_s (max) (percentage) 0.860 -2.27%
620.omnetpp_s (unexplained diff vs previous) 30.000 42.86%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.750 44.23%
621.wrf_s 128.000 -
621.wrf_s (avg) 128.000 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 65.000 -
621.wrf_s (max) (percentage) 0.950 -
623.xalancbmk_s 35.000 -
623.xalancbmk_s (avg) 35.000 -
623.xalancbmk_s (avg) (percentage) 1.050 -
623.xalancbmk_s (max) 12.000 -
623.xalancbmk_s (max) (percentage) 0.370 -
625.x264_s 16.000 -
625.x264_s (avg) 16.000 -
625.x264_s (avg) (percentage) 1.220 -
625.x264_s (max) 10.000 -
625.x264_s (max) (percentage) 0.790 -2.47%
627.cam4_s 15.000 7.14%
627.cam4_s (avg) 15.000 7.14%
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) 9.000 -
627.cam4_s (max) (percentage) 7.050 -
628.pop2_s 66.000 -
628.pop2_s (avg) 66.000 -
628.pop2_s (avg) (percentage) 0.670 -
628.pop2_s (max) 33.000 -
628.pop2_s (max) (percentage) 0.340 -
631.deepsjeng_s 48.000 -
631.deepsjeng_s (avg) 48.000 -
631.deepsjeng_s (avg) (percentage) 1.340 -
631.deepsjeng_s (max) 19.000 -5.00%
631.deepsjeng_s (max) (percentage) 0.540 -3.57%
638.imagick_s 81.000 -1.22%
638.imagick_s (avg) 81.000 -1.22%
638.imagick_s (avg) (percentage) 1.520 -
638.imagick_s (max) 22.000 -
638.imagick_s (max) (percentage) 0.410 -2.38%
641.leela_s 33.000 -
641.leela_s (avg) 33.000 -
641.leela_s (avg) (percentage) 0.880 -
641.leela_s (max) 12.000 -7.69%
641.leela_s (max) (percentage) 0.340 -
644.nab_s 83.000 -
644.nab_s (avg) 83.000 -
644.nab_s (avg) (percentage) 0.770 -
644.nab_s (max) 101.000 -9.82%
644.nab_s (max) (percentage) 0.940 -8.74%
648.exchange2_s 6.000 -
648.exchange2_s (avg) 6.000 -
648.exchange2_s (avg) (percentage) 0.520 -
648.exchange2_s (max) 3.000 -
648.exchange2_s (max) (percentage) 0.250 -7.41%
649.fotonik3d_s 223.000 -
649.fotonik3d_s (avg) 223.000 -
649.fotonik3d_s (avg) (percentage) 2.270 -
649.fotonik3d_s (max) 90.000 -2.17%
649.fotonik3d_s (max) (percentage) 0.920 -2.13%
654.roms_s 1119.000 -
654.roms_s (avg) 1119.000 -
654.roms_s (avg) (percentage) 4.640 -
654.roms_s (max) 132.000 -3.65%
654.roms_s (max) (percentage) 0.550 -3.51%
657.xz_s 43.000 -
657.xz_s (avg) 43.000 -
657.xz_s (avg) (percentage) 1.850 -
657.xz_s (max) 13.000 -
657.xz_s (max) (percentage) 0.560 -3.45%
Geometric Mean 11.481 5.09%