Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=80f90d95e3978bb13b267ddd0f3d73f8ed82ec0b (+ 65 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/081fddbbcf9790229f4fe885781548ba1f6a365a (+ 109 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=323f367cc46b80224d39b082adf7be74b49ed843 (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/118/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0118 (3-changed-components) 2023-11-11T08:20:33 0:00:00
Previous 0117 (2-changed-components) 2023-11-07T11:55:09 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 9
Performance Improvements 38 2
Added Tests 2 107
Unchanged Tests 872 800
Total Tests 918

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s 1.68% 10827.000 11009.000 - 5.49% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s (max) 1.65% 545.000 554.000 - 0.00% -
603.bwaves_s 1.62% 309.000 314.000 - 0.00% -
603.bwaves_s (avg) 1.62% 309.000 314.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -95.83% 24.000 1.000 - -95.83% -
nb_total_tests -95.83% 24.000 1.000 - -95.83% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
619.lbm_s -8.69% 36720.000 33528.000 - 10.09% -
649.fotonik3d_s -3.48% 10621.000 10251.000 - 0.12% -
607.cactuBSSN_s -3.13% 5298.000 5132.000 - 1.06% -
620.omnetpp_s -3.02% 4469.000 4334.000 - -1.54% -
621.wrf_s -2.61% 12781.000 12448.000 - -0.64% -
657.xz_s -2.39% 2549.000 2488.000 - 0.73% -
602.gcc_s -2.23% 5244.000 5127.000 - 0.83% -
605.mcf_s -2.05% 7362.000 7211.000 - 0.50% -
510.parest_r -1.66% 6801.000 6688.000 - 0.21% -
638.imagick_s -1.45% 6050.000 5962.000 - 0.30% -
508.namd_r -1.37% 3510.000 3462.000 - 0.32% -
625.x264_s -1.27% 4010.000 3959.000 - 0.25% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (max) -8.69% 7189.000 6564.000 - 0.00% -
619.lbm_s -8.69% 4119.000 3761.000 - 0.00% -
619.lbm_s (avg) -8.69% 4119.000 3761.000 - 0.00% -
508.namd_r (max) -4.35% 23.000 22.000 - 0.00% -
625.x264_s -4.35% 23.000 22.000 - 0.00% -
625.x264_s (avg) -4.35% 23.000 22.000 - 0.00% -
649.fotonik3d_s -3.70% 162.000 156.000 - 0.00% -
649.fotonik3d_s (avg) -3.70% 162.000 156.000 - 0.00% -
620.omnetpp_s -3.28% 61.000 59.000 - 0.00% -
620.omnetpp_s (avg) -3.28% 61.000 59.000 - 0.00% -
649.fotonik3d_s (max) -3.21% 187.000 181.000 - 0.00% -
607.cactuBSSN_s -3.12% 96.000 93.000 - 0.00% -
607.cactuBSSN_s (avg) -3.12% 96.000 93.000 - 0.00% -
625.x264_s (max) -2.94% 34.000 33.000 - 0.00% -
607.cactuBSSN_s (max) -2.90% 138.000 134.000 - 0.00% -
620.omnetpp_s (max) -2.90% 69.000 67.000 - 0.00% -
657.xz_s -2.78% 36.000 35.000 - 0.00% -
657.xz_s (avg) -2.78% 36.000 35.000 - 0.00% -
657.xz_s (max) -2.44% 41.000 40.000 - 0.00% -
510.parest_r (max) -2.35% 85.000 83.000 - 0.00% -
605.mcf_s -2.27% 88.000 86.000 - 0.00% -
605.mcf_s (avg) -2.27% 88.000 86.000 - 0.00% -
605.mcf_s (max) -2.11% 95.000 93.000 - 0.00% -
638.imagick_s (max) -2.00% 50.000 49.000 - 0.00% -
510.parest_r -1.12% 89.000 88.000 - 0.00% -
510.parest_r (avg) -1.12% 89.000 88.000 - 0.00% -

Added Tests - Execution
627.cam4_s

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 10.09% 30454.000 33528.000 - -8.69% -
603.bwaves_s 5.49% 10436.000 11009.000 - 1.68% -
628.pop2_s 1.72% 14154.000 14397.000 - -0.16% -
648.exchange2_s 1.48% 3442.000 3493.000 - -0.37% -
511.povray_r 1.33% 527.000 534.000 - 0.38% -
654.roms_s 1.31% 33893.000 34338.000 - -0.22% -
607.cactuBSSN_s 1.06% 5078.000 5132.000 - -3.13% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - -95.83% -
nb_total_tests -95.83% 24.000 1.000 - -95.83% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
620.omnetpp_s -1.54% 4402.000 4334.000 - -3.02% -
623.xalancbmk_s -1.31% 4727.000 4665.000 - -0.55% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.37s
Name Current %
508.namd_r 3462.000 -1.37%
510.parest_r 6688.000 -1.66%
511.povray_r 534.000 -
526.blender_r 13029.000 -
600.perlbench_s 2235.000 -
602.gcc_s 5127.000 -2.23%
603.bwaves_s 11009.000 1.68%
605.mcf_s 7211.000 -2.05%
607.cactuBSSN_s 5132.000 -3.13%
619.lbm_s 33528.000 -8.69%
620.omnetpp_s 4334.000 -3.02%
621.wrf_s 12448.000 -2.61%
623.xalancbmk_s 4665.000 -
625.x264_s 3959.000 -1.27%
627.cam4_s 182.000 -
628.pop2_s 14397.000 -
631.deepsjeng_s 4237.000 -
638.imagick_s 5962.000 -1.45%
641.leela_s 4438.000 -
644.nab_s 12577.000 -
648.exchange2_s 3493.000 -
649.fotonik3d_s 10251.000 -3.48%
654.roms_s 34338.000 -
657.xz_s 2488.000 -2.39%
Geometric Mean 5336.025 -15.02%
Name Current %
nb_compile_successful 1.000 -95.83%
nb_execution_successful 0.000 -
nb_total_tests 1.000 -95.83%
Geometric Mean 0.046 -99.81%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 22.000 -4.35%
508.namd_r (max) (percentage) 0.660 -
510.parest_r 88.000 -1.12%
510.parest_r (avg) 88.000 -1.12%
510.parest_r (avg) (percentage) 1.320 -
510.parest_r (max) 83.000 -2.35%
510.parest_r (max) (percentage) 1.250 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
526.blender_r 52.000 -
526.blender_r (avg) 52.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 49.000 -
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 25.000 -
600.perlbench_s (avg) 25.000 -
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 29.000 -
600.perlbench_s (max) (percentage) 1.310 -
603.bwaves_s 314.000 1.62%
603.bwaves_s (avg) 314.000 1.62%
603.bwaves_s (avg) (percentage) 2.860 -
603.bwaves_s (max) 554.000 1.65%
603.bwaves_s (max) (percentage) 5.040 -
605.mcf_s 86.000 -2.27%
605.mcf_s (avg) 86.000 -2.27%
605.mcf_s (avg) (percentage) 1.200 -
605.mcf_s (max) 93.000 -2.11%
605.mcf_s (max) (percentage) 1.300 -
607.cactuBSSN_s 93.000 -3.12%
607.cactuBSSN_s (avg) 93.000 -3.12%
607.cactuBSSN_s (avg) (percentage) 1.830 -
607.cactuBSSN_s (max) 134.000 -2.90%
607.cactuBSSN_s (max) (percentage) 2.620 -
619.lbm_s 3761.000 -8.69%
619.lbm_s (avg) 3761.000 -8.69%
619.lbm_s (avg) (percentage) 11.220 -
619.lbm_s (max) 6564.000 -8.69%
619.lbm_s (max) (percentage) 19.580 -
620.omnetpp_s 59.000 -3.28%
620.omnetpp_s (avg) 59.000 -3.28%
620.omnetpp_s (avg) (percentage) 1.380 -
620.omnetpp_s (max) 67.000 -2.90%
620.omnetpp_s (max) (percentage) 1.560 -
623.xalancbmk_s 20.000 -
623.xalancbmk_s (avg) 20.000 -
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 28.000 -
623.xalancbmk_s (max) (percentage) 0.610 -
625.x264_s 22.000 -4.35%
625.x264_s (avg) 22.000 -4.35%
625.x264_s (avg) (percentage) 0.580 -
625.x264_s (max) 33.000 -2.94%
625.x264_s (max) (percentage) 0.850 -
628.pop2_s 93.000 -
628.pop2_s (avg) 93.000 -
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 168.000 -
628.pop2_s (max) (percentage) 1.170 -
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.740 -
631.deepsjeng_s (max) 55.000 -
631.deepsjeng_s (max) (percentage) 1.310 -
638.imagick_s 16.000 -
638.imagick_s (avg) 16.000 -
638.imagick_s (avg) (percentage) 0.280 -
638.imagick_s (max) 49.000 -2.00%
638.imagick_s (max) (percentage) 0.830 -
641.leela_s 11.000 -
641.leela_s (avg) 11.000 -
641.leela_s (avg) (percentage) 0.250 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.350 -
644.nab_s 31.000 -
644.nab_s (avg) 31.000 -
644.nab_s (avg) (percentage) 0.250 -
644.nab_s (max) 41.000 -
644.nab_s (max) (percentage) 0.330 -
648.exchange2_s 21.000 -
648.exchange2_s (avg) 21.000 -
648.exchange2_s (avg) (percentage) 0.620 -
648.exchange2_s (max) 38.000 -
648.exchange2_s (max) (percentage) 1.100 -
649.fotonik3d_s 156.000 -3.70%
649.fotonik3d_s (avg) 156.000 -3.70%
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) 181.000 -3.21%
649.fotonik3d_s (max) (percentage) 1.770 -
654.roms_s 3025.000 -
654.roms_s (avg) 3025.000 -
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) 3808.000 -
654.roms_s (max) (percentage) 11.090 -
657.xz_s 35.000 -2.78%
657.xz_s (avg) 35.000 -2.78%
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 40.000 -2.44%
657.xz_s (max) (percentage) 1.640 -
Geometric Mean 12.713 -