Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e65a355022d0dc6b5707310876a72b5693ec0aa5 (+ 88 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (4731ead79fac259258dbb027090f3d085f518040) (+ 174 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=cb4692ce1edd5a81c2521de49dfef6125141d1c7 (+ 153 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/efe163851b025508a08a08a96032adc4f8b6c82d (+ 175 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/301/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0301 (4-changed-components) 2024-12-20T00:57:36 0:00:00
Previous 0297 (4-changed-components) 2024-12-12T17:36:52 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 3
Performance Improvements 58 17
Added Tests 0 106
Unchanged Tests 856 792
Total Tests 918

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) (percentage) 757.45% 0.940 8.060 - 0.00% -
619.lbm_s (unexplained diff vs previous) 690.52% 306.000 2419.000 - 0.00% -
619.lbm_s (max) (percentage) 203.25% 2.460 7.460 - 0.00% -
619.lbm_s (max) 180.80% 797.000 2238.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
627.cam4_s -8.51% 188.000 172.000 - 0.00% -
619.lbm_s -7.46% 32420.000 30001.000 - -1.49% -
603.bwaves_s -4.69% 9793.000 9334.000 - -10.56% -
607.cactuBSSN_s -2.35% 5153.000 5032.000 - -0.91% -
631.deepsjeng_s -1.98% 4288.000 4203.000 - -0.26% -
600.perlbench_s -1.72% 2268.000 2229.000 - -0.04% -
620.omnetpp_s -1.57% 4342.000 4274.000 - -2.91% -
602.gcc_s -1.43% 5089.000 5016.000 - -1.36% -
649.fotonik3d_s -1.26% 10521.000 10388.000 - 1.46% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
605.mcf_s (max) -11.27% 71.000 63.000 - 0.00% -
605.mcf_s (max) (percentage) -11.00% 1.000 0.890 - 0.00% -
603.bwaves_s (max) -10.63% 489.000 437.000 - 0.00% -
649.fotonik3d_s (max) -9.84% 122.000 110.000 - 0.00% -
648.exchange2_s (max) -9.09% 11.000 10.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -8.62% 1.160 1.060 - 0.00% -
648.exchange2_s (max) (percentage) -8.57% 0.350 0.320 - 0.00% -
620.omnetpp_s (max) -8.47% 59.000 54.000 - 0.00% -
619.lbm_s -7.85% 3096.000 2853.000 - 0.00% -
619.lbm_s (avg) -7.85% 3096.000 2853.000 - 0.00% -
600.perlbench_s (max) -6.90% 29.000 27.000 - 0.00% -
620.omnetpp_s (max) (percentage) -6.57% 1.370 1.280 - 0.00% -
603.bwaves_s (max) (percentage) -6.20% 5.000 4.690 - 0.00% -
657.xz_s (max) -6.06% 33.000 31.000 - 0.00% -
631.deepsjeng_s (max) -5.56% 18.000 17.000 - 0.00% -
508.namd_r (max) (percentage) -5.41% 0.370 0.350 - 0.00% -
603.bwaves_s -4.84% 310.000 295.000 - 0.00% -
603.bwaves_s (avg) -4.84% 310.000 295.000 - 0.00% -
654.roms_s (max) -4.71% 1465.000 1396.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
607.cactuBSSN_s (max) -4.65% 86.000 82.000 - 0.00% -
657.xz_s (max) (percentage) -4.48% 1.340 1.280 - 0.00% -
644.nab_s (max) -4.17% 96.000 92.000 - 0.00% -
654.roms_s (max) (percentage) -4.15% 4.340 4.160 - 0.00% -
638.imagick_s (max) -4.08% 49.000 47.000 - 0.00% -
600.perlbench_s (max) (percentage) -3.91% 1.280 1.230 - 0.00% -
644.nab_s (max) (percentage) -3.90% 0.770 0.740 - 0.00% -
641.leela_s (max) -3.85% 26.000 25.000 - 0.00% -
638.imagick_s (max) (percentage) -3.61% 0.830 0.800 - 0.00% -
641.leela_s (max) (percentage) -3.33% 0.600 0.580 - 0.00% -
511.povray_r (max) (percentage) -3.28% 0.610 0.590 - 0.00% -
623.xalancbmk_s (max) -3.28% 61.000 59.000 - 0.00% -
510.parest_r (max) -3.23% 31.000 30.000 - 0.00% -
625.x264_s (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.10% 1.290 1.250 - 0.00% -
607.cactuBSSN_s -2.52% 159.000 155.000 - 0.00% -
607.cactuBSSN_s (avg) -2.52% 159.000 155.000 - 0.00% -
526.blender_r (max) -1.98% 101.000 99.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -1.80% 1.670 1.640 - 0.00% -
638.imagick_s -1.52% 66.000 65.000 - 0.00% -
638.imagick_s (avg) -1.52% 66.000 65.000 - 0.00% -
628.pop2_s (max) (percentage) -1.32% 0.760 0.750 - 0.00% -
526.blender_r (max) (percentage) -1.27% 0.790 0.780 - 0.00% -
510.parest_r -1.11% 90.000 89.000 - 0.00% -
510.parest_r (avg) -1.11% 90.000 89.000 - 0.00% -
649.fotonik3d_s -1.10% 273.000 270.000 - 0.00% -
649.fotonik3d_s (avg) -1.10% 273.000 270.000 - 0.00% -
620.omnetpp_s -1.02% 98.000 97.000 - 0.00% -
620.omnetpp_s (avg) -1.02% 98.000 97.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 3.88% 76740.000 79716.000 - -0.43% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s 1.46% 10239.000 10388.000 - -1.26% -
628.pop2_s 1.24% 14154.000 14330.000 - -0.08% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s -3.87% 248379.000 238759.000 - 0.41% -
641.leela_s -2.86% 60068.000 58353.000 - 0.01% -
508.namd_r -2.51% 435429.000 424501.000 - 0.00% -
603.bwaves_s -1.78% 44462.000 43670.000 - -0.29% -
648.exchange2_s -1.42% 52581.000 51833.000 - -0.01% -
654.roms_s -1.27% 441553.000 435945.000 - 0.29% -
621.wrf_s -1.11% 9413720.000 9309132.000 - -0.01% -
631.deepsjeng_s -1.08% 57255.000 56635.000 - -0.01% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -10.56% 10436.000 9334.000 - -4.69% -
620.omnetpp_s -2.91% 4402.000 4274.000 - -1.57% -
526.blender_r -1.95% 12996.000 12743.000 - -0.82% -
648.exchange2_s -1.89% 3442.000 3377.000 - -0.88% -
621.wrf_s -1.75% 12528.000 12309.000 - -0.66% -
619.lbm_s -1.49% 30454.000 30001.000 - -7.46% -
510.parest_r -1.45% 6674.000 6577.000 - -0.90% -
602.gcc_s -1.36% 5085.000 5016.000 - -1.43% -
644.nab_s -1.08% 12577.000 12441.000 - -0.65% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 3441.000 -
510.parest_r 6577.000 -
511.povray_r 526.000 -
526.blender_r 12743.000 -
600.perlbench_s 2229.000 -1.72%
602.gcc_s 5016.000 -1.43%
603.bwaves_s 9334.000 -4.69%
605.mcf_s 7123.000 -
607.cactuBSSN_s 5032.000 -2.35%
619.lbm_s 30001.000 -7.46%
620.omnetpp_s 4274.000 -1.57%
621.wrf_s 12309.000 -
623.xalancbmk_s 4761.000 -
625.x264_s 3914.000 -
627.cam4_s 172.000 -8.51%
628.pop2_s 14330.000 -
631.deepsjeng_s 4203.000 -1.98%
638.imagick_s 5937.000 -
641.leela_s 4475.000 -
644.nab_s 12441.000 -
648.exchange2_s 3377.000 -
649.fotonik3d_s 10388.000 -1.26%
654.roms_s 33567.000 -
657.xz_s 2464.000 -
Geometric Mean 5217.744 -1.62%
Name Current %
508.namd_r 424501.000 -
510.parest_r 1110464.000 -
511.povray_r 650025.000 -
526.blender_r 7119602.000 -
600.perlbench_s 1706057.000 -
602.gcc_s 6540099.000 -
603.bwaves_s 43670.000 -
605.mcf_s 13718.000 -
607.cactuBSSN_s 2166236.000 -
619.lbm_s 11924.000 -
620.omnetpp_s 1287530.000 -
621.wrf_s 9309132.000 -
623.xalancbmk_s 2549021.000 -
625.x264_s 345867.000 -
628.pop2_s 2525094.000 -
631.deepsjeng_s 56635.000 -
638.imagick_s 964069.000 -
641.leela_s 58353.000 -
644.nab_s 79716.000 -
648.exchange2_s 51833.000 -
649.fotonik3d_s 238759.000 -
654.roms_s 435945.000 -
657.xz_s 103202.000 -
Geometric Mean 412413.779 -
Name Current %
508.namd_r 26.000 -
508.namd_r (avg) 26.000 -
508.namd_r (avg) (percentage) 0.780 -
508.namd_r (max) 12.000 -
508.namd_r (max) (percentage) 0.350 -5.41%
510.parest_r 89.000 -1.11%
510.parest_r (avg) 89.000 -1.11%
510.parest_r (avg) (percentage) 1.360 -
510.parest_r (max) 30.000 -3.23%
510.parest_r (max) (percentage) 0.460 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 0.850 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.590 -3.28%
526.blender_r 84.000 -
526.blender_r (avg) 84.000 -
526.blender_r (avg) (percentage) 0.660 -
526.blender_r (max) 99.000 -1.98%
526.blender_r (max) (percentage) 0.780 -1.27%
600.perlbench_s 34.000 -
600.perlbench_s (avg) 34.000 -
600.perlbench_s (avg) (percentage) 1.530 -
600.perlbench_s (max) 27.000 -6.90%
600.perlbench_s (max) (percentage) 1.230 -3.91%
603.bwaves_s 295.000 -4.84%
603.bwaves_s (avg) 295.000 -4.84%
603.bwaves_s (avg) (percentage) 3.170 -
603.bwaves_s (max) 437.000 -10.63%
603.bwaves_s (max) (percentage) 4.690 -6.20%
605.mcf_s 100.000 -
605.mcf_s (avg) 100.000 -
605.mcf_s (avg) (percentage) 1.410 -
605.mcf_s (max) 63.000 -11.27%
605.mcf_s (max) (percentage) 0.890 -11.00%
607.cactuBSSN_s 155.000 -2.52%
607.cactuBSSN_s (avg) 155.000 -2.52%
607.cactuBSSN_s (avg) (percentage) 3.090 -
607.cactuBSSN_s (max) 82.000 -4.65%
607.cactuBSSN_s (max) (percentage) 1.640 -1.80%
619.lbm_s 2853.000 -7.85%
619.lbm_s (avg) 2853.000 -7.85%
619.lbm_s (avg) (percentage) 9.510 -
619.lbm_s (max) 2238.000 180.80%
619.lbm_s (max) (percentage) 7.460 203.25%
619.lbm_s (unexplained diff vs previous) 2419.000 690.52%
619.lbm_s (unexplained diff vs previous) (percentage) 8.060 757.45%
620.omnetpp_s 97.000 -1.02%
620.omnetpp_s (avg) 97.000 -1.02%
620.omnetpp_s (avg) (percentage) 2.270 -
620.omnetpp_s (max) 54.000 -8.47%
620.omnetpp_s (max) (percentage) 1.280 -6.57%
623.xalancbmk_s 42.000 -
623.xalancbmk_s (avg) 42.000 -
623.xalancbmk_s (avg) (percentage) 0.900 -
623.xalancbmk_s (max) 59.000 -3.28%
623.xalancbmk_s (max) (percentage) 1.250 -3.10%
625.x264_s 32.000 -
625.x264_s (avg) 32.000 -
625.x264_s (avg) (percentage) 0.820 -
625.x264_s (max) 12.000 -
625.x264_s (max) (percentage) 0.310 -3.13%
628.pop2_s 146.000 -
628.pop2_s (avg) 146.000 -
628.pop2_s (avg) (percentage) 1.020 -
628.pop2_s (max) 107.000 -
628.pop2_s (max) (percentage) 0.750 -1.32%
631.deepsjeng_s 42.000 -
631.deepsjeng_s (avg) 42.000 -
631.deepsjeng_s (avg) (percentage) 1.000 -
631.deepsjeng_s (max) 17.000 -5.56%
631.deepsjeng_s (max) (percentage) 0.410 -4.65%
638.imagick_s 65.000 -1.52%
638.imagick_s (avg) 65.000 -1.52%
638.imagick_s (avg) (percentage) 1.110 -
638.imagick_s (max) 47.000 -4.08%
638.imagick_s (max) (percentage) 0.800 -3.61%
641.leela_s 27.000 -
641.leela_s (avg) 27.000 -
641.leela_s (avg) (percentage) 0.610 -
641.leela_s (max) 25.000 -3.85%
641.leela_s (max) (percentage) 0.580 -3.33%
644.nab_s 73.000 -
644.nab_s (avg) 73.000 -
644.nab_s (avg) (percentage) 0.590 -
644.nab_s (max) 92.000 -4.17%
644.nab_s (max) (percentage) 0.740 -3.90%
648.exchange2_s 14.000 -
648.exchange2_s (avg) 14.000 -
648.exchange2_s (avg) (percentage) 0.430 -
648.exchange2_s (max) 10.000 -9.09%
648.exchange2_s (max) (percentage) 0.320 -8.57%
649.fotonik3d_s 270.000 -1.10%
649.fotonik3d_s (avg) 270.000 -1.10%
649.fotonik3d_s (avg) (percentage) 2.600 -
649.fotonik3d_s (max) 110.000 -9.84%
649.fotonik3d_s (max) (percentage) 1.060 -8.62%
654.roms_s 1241.000 -
654.roms_s (avg) 1241.000 -
654.roms_s (avg) (percentage) 3.700 -
654.roms_s (max) 1396.000 -4.71%
654.roms_s (max) (percentage) 4.160 -4.15%
657.xz_s 45.000 -
657.xz_s (avg) 45.000 -
657.xz_s (avg) (percentage) 1.840 -
657.xz_s (max) 31.000 -6.06%
657.xz_s (max) (percentage) 1.280 -4.48%
Geometric Mean 14.168 3.78%