Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=26c7a0ea380bedb86ff3b5a9ed252d8d2557a0c5 (+ 49 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/841008d3966c0fe7a80ec10703a50fbdab7620ac (+ 89 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=dae3cf4134d476a4b4ef86fd7012231d6436c15e (+ 9 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/119/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0119 (3-changed-components) 2023-11-14T16:37:59 0:00:00
Previous 0118 (3-changed-components) 2023-11-11T08:20:33 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 31 16
Performance Improvements 7 1
Added Tests 1 107
Unchanged Tests 879 794
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 8.80% 33528.000 36479.000 - 19.78% -
627.cam4_s 8.24% 182.000 197.000 - 0.00% -
607.cactuBSSN_s 2.55% 5132.000 5263.000 - 3.64% -
620.omnetpp_s 2.35% 4334.000 4436.000 - 0.77% -
605.mcf_s 1.78% 7211.000 7339.000 - 2.29% -
621.wrf_s 1.65% 12448.000 12654.000 - 1.01% -
649.fotonik3d_s 1.54% 10251.000 10409.000 - 1.66% -
657.xz_s 1.45% 2488.000 2524.000 - 2.19% -
602.gcc_s 1.19% 5127.000 5188.000 - 2.03% -
600.perlbench_s 1.07% 2235.000 2259.000 - 1.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) 8.81% 6564.000 7142.000 - 0.00% -
619.lbm_s 8.80% 3761.000 4092.000 - 0.00% -
619.lbm_s (avg) 8.80% 3761.000 4092.000 - 0.00% -
625.x264_s 4.55% 22.000 23.000 - 0.00% -
625.x264_s (avg) 4.55% 22.000 23.000 - 0.00% -
620.omnetpp_s 3.39% 59.000 61.000 - 0.00% -
620.omnetpp_s (avg) 3.39% 59.000 61.000 - 0.00% -
607.cactuBSSN_s 3.23% 93.000 96.000 - 0.00% -
607.cactuBSSN_s (avg) 3.23% 93.000 96.000 - 0.00% -
620.omnetpp_s (max) 2.99% 67.000 69.000 - 0.00% -
657.xz_s 2.86% 35.000 36.000 - 0.00% -
657.xz_s (avg) 2.86% 35.000 36.000 - 0.00% -
657.xz_s (max) 2.50% 40.000 41.000 - 0.00% -
605.mcf_s 2.33% 86.000 88.000 - 0.00% -
605.mcf_s (avg) 2.33% 86.000 88.000 - 0.00% -
607.cactuBSSN_s (max) 2.24% 134.000 137.000 - 0.00% -
605.mcf_s (max) 2.15% 93.000 95.000 - 0.00% -
649.fotonik3d_s 1.92% 156.000 159.000 - 0.00% -
649.fotonik3d_s (avg) 1.92% 156.000 159.000 - 0.00% -
649.fotonik3d_s (max) 1.66% 181.000 184.000 - 0.00% -
510.parest_r (max) 1.20% 83.000 84.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s -3.12% 11009.000 10665.000 - 2.19% -
511.povray_r -1.31% 534.000 527.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s (max) -3.07% 554.000 537.000 - 0.00% -
603.bwaves_s -2.87% 314.000 305.000 - 0.00% -
603.bwaves_s (avg) -2.87% 314.000 305.000 - 0.00% -
526.blender_r -1.92% 52.000 51.000 - 0.00% -
526.blender_r (avg) -1.92% 52.000 51.000 - 0.00% -

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 19.78% 30454.000 36479.000 - 8.80% -
607.cactuBSSN_s 3.64% 5078.000 5263.000 - 2.55% -
605.mcf_s 2.29% 7175.000 7339.000 - 1.78% -
603.bwaves_s 2.19% 10436.000 10665.000 - -3.12% -
657.xz_s 2.19% 2470.000 2524.000 - 1.45% -
602.gcc_s 2.03% 5085.000 5188.000 - 1.19% -
649.fotonik3d_s 1.66% 10239.000 10409.000 - 1.54% -
648.exchange2_s 1.63% 3442.000 3498.000 - 0.14% -
600.perlbench_s 1.30% 2230.000 2259.000 - 1.07% -
628.pop2_s 1.27% 14154.000 14334.000 - -0.44% -
654.roms_s 1.23% 33893.000 34311.000 - -0.08% -
638.imagick_s 1.04% 5944.000 6006.000 - 0.74% -
625.x264_s 1.01% 3949.000 3989.000 - 0.76% -
621.wrf_s 1.01% 12528.000 12654.000 - 1.65% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - 0.00% -
nb_total_tests -95.83% 24.000 1.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s -1.10% 4727.000 4675.000 - 0.21% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.35s
Name Current %
508.namd_r 3481.000 -
510.parest_r 6732.000 -
511.povray_r 527.000 -1.31%
526.blender_r 12991.000 -
600.perlbench_s 2259.000 1.07%
602.gcc_s 5188.000 1.19%
603.bwaves_s 10665.000 -3.12%
605.mcf_s 7339.000 1.78%
607.cactuBSSN_s 5263.000 2.55%
619.lbm_s 36479.000 8.80%
620.omnetpp_s 4436.000 2.35%
621.wrf_s 12654.000 1.65%
623.xalancbmk_s 4675.000 -
625.x264_s 3989.000 -
627.cam4_s 197.000 8.24%
628.pop2_s 14334.000 -
631.deepsjeng_s 4250.000 -
638.imagick_s 6006.000 -
641.leela_s 4477.000 -
644.nab_s 12452.000 -
648.exchange2_s 3498.000 -
649.fotonik3d_s 10409.000 1.54%
654.roms_s 34311.000 -
657.xz_s 2524.000 1.45%
Geometric Mean 5398.079 1.16%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 22.000 -
508.namd_r (max) (percentage) 0.660 -
510.parest_r 88.000 -
510.parest_r (avg) 88.000 -
510.parest_r (avg) (percentage) 1.320 -
510.parest_r (max) 84.000 1.20%
510.parest_r (max) (percentage) 1.250 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
526.blender_r 51.000 -1.92%
526.blender_r (avg) 51.000 -1.92%
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 49.000 -
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 25.000 -
600.perlbench_s (avg) 25.000 -
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 29.000 -
600.perlbench_s (max) (percentage) 1.310 -
603.bwaves_s 305.000 -2.87%
603.bwaves_s (avg) 305.000 -2.87%
603.bwaves_s (avg) (percentage) 2.860 -
603.bwaves_s (max) 537.000 -3.07%
603.bwaves_s (max) (percentage) 5.040 -
605.mcf_s 88.000 2.33%
605.mcf_s (avg) 88.000 2.33%
605.mcf_s (avg) (percentage) 1.200 -
605.mcf_s (max) 95.000 2.15%
605.mcf_s (max) (percentage) 1.300 -
607.cactuBSSN_s 96.000 3.23%
607.cactuBSSN_s (avg) 96.000 3.23%
607.cactuBSSN_s (avg) (percentage) 1.830 -
607.cactuBSSN_s (max) 137.000 2.24%
607.cactuBSSN_s (max) (percentage) 2.620 -
619.lbm_s 4092.000 8.80%
619.lbm_s (avg) 4092.000 8.80%
619.lbm_s (avg) (percentage) 11.220 -
619.lbm_s (max) 7142.000 8.81%
619.lbm_s (max) (percentage) 19.580 -
620.omnetpp_s 61.000 3.39%
620.omnetpp_s (avg) 61.000 3.39%
620.omnetpp_s (avg) (percentage) 1.380 -
620.omnetpp_s (max) 69.000 2.99%
620.omnetpp_s (max) (percentage) 1.560 -
623.xalancbmk_s 20.000 -
623.xalancbmk_s (avg) 20.000 -
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 28.000 -
623.xalancbmk_s (max) (percentage) 0.610 -
625.x264_s 23.000 4.55%
625.x264_s (avg) 23.000 4.55%
625.x264_s (avg) (percentage) 0.580 -
625.x264_s (max) 33.000 -
625.x264_s (max) (percentage) 0.850 -
628.pop2_s 93.000 -
628.pop2_s (avg) 93.000 -
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 167.000 -
628.pop2_s (max) (percentage) 1.170 -
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.740 -
631.deepsjeng_s (max) 55.000 -
631.deepsjeng_s (max) (percentage) 1.310 -
638.imagick_s 16.000 -
638.imagick_s (avg) 16.000 -
638.imagick_s (avg) (percentage) 0.280 -
638.imagick_s (max) 49.000 -
638.imagick_s (max) (percentage) 0.830 -
641.leela_s 11.000 -
641.leela_s (avg) 11.000 -
641.leela_s (avg) (percentage) 0.250 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.350 -
644.nab_s 31.000 -
644.nab_s (avg) 31.000 -
644.nab_s (avg) (percentage) 0.250 -
644.nab_s (max) 41.000 -
644.nab_s (max) (percentage) 0.330 -
648.exchange2_s 21.000 -
648.exchange2_s (avg) 21.000 -
648.exchange2_s (avg) (percentage) 0.620 -
648.exchange2_s (max) 38.000 -
648.exchange2_s (max) (percentage) 1.100 -
649.fotonik3d_s 159.000 1.92%
649.fotonik3d_s (avg) 159.000 1.92%
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) 184.000 1.66%
649.fotonik3d_s (max) (percentage) 1.770 -
654.roms_s 3022.000 -
654.roms_s (avg) 3022.000 -
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) 3805.000 -
654.roms_s (max) (percentage) 11.090 -
657.xz_s 36.000 2.86%
657.xz_s (avg) 36.000 2.86%
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 41.000 2.50%
657.xz_s (max) (percentage) 1.640 -
Geometric Mean 12.786 -