Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2b05f934486de42f8200bf11cece21ae3bc284e6 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/2277f987979445f4390a5c6e092d79e04814d641 (+ 64 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=54c1efdac55b756a4e2ea95590bcc3ba396a6568 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/199/
View Options
Report
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0199 (2-changed-components) 2024-06-06T14:54:23 0:00:00
Previous 0199 (2-changed-components) 2024-06-06T14:54:23 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 11
Performance Improvements 0 7
Added Tests 0 105
Unchanged Tests 918 795
Total Tests 918

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 4.90% 76740.000 80500.000 - 0.00% -
600.perlbench_s 1.43% 1704057.000 1728369.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 17.54% 30454.000 35796.000 - 0.00% -
607.cactuBSSN_s 5.08% 5078.000 5336.000 - 0.00% -
649.fotonik3d_s 3.71% 10239.000 10619.000 - 0.00% -
657.xz_s 2.75% 2470.000 2538.000 - 0.00% -
600.perlbench_s 2.06% 2230.000 2276.000 - 0.00% -
641.leela_s 1.71% 4439.000 4515.000 - 0.00% -
631.deepsjeng_s 1.64% 4214.000 4283.000 - 0.00% -
605.mcf_s 1.42% 7175.000 7277.000 - 0.00% -
644.nab_s 1.16% 12577.000 12723.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r -2.64% 435429.000 423937.000 - 0.00% -
654.roms_s -1.13% 441553.000 436553.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -9.82% 10436.000 9411.000 - 0.00% -
526.blender_r -2.26% 12996.000 12702.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 100.00% 24.000 48.000 - 0.00% -
nb_execution_successful 91.30% 23.000 44.000 - 0.00% -
nb_compile_successful 83.33% 24.000 44.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
508.namd_r 3467.000 -
510.parest_r 6702.000 -
511.povray_r 530.000 -
526.blender_r 12702.000 -
600.perlbench_s 2276.000 -
602.gcc_s 5126.000 -
603.bwaves_s 9411.000 -
605.mcf_s 7277.000 -
607.cactuBSSN_s 5336.000 -
619.lbm_s 35796.000 -
620.omnetpp_s 4373.000 -
623.xalancbmk_s 4732.000 -
625.x264_s 3936.000 -
628.pop2_s 14248.000 -
631.deepsjeng_s 4283.000 -
638.imagick_s 6000.000 -
641.leela_s 4515.000 -
644.nab_s 12723.000 -
648.exchange2_s 3432.000 -
649.fotonik3d_s 10619.000 -
654.roms_s 33685.000 -
657.xz_s 2538.000 -
Geometric Mean 5991.156 -
Code Size (bytes)
Name Current %
508.namd_r 423937.000 -
510.parest_r 1117869.000 -
511.povray_r 653158.000 -
526.blender_r 7159210.000 -
600.perlbench_s 1728369.000 -
602.gcc_s 6571919.000 -
603.bwaves_s 44430.000 -
605.mcf_s 13654.000 -
607.cactuBSSN_s 2177963.000 -
619.lbm_s 11932.000 -
620.omnetpp_s 1289624.000 -
623.xalancbmk_s 2560439.000 -
625.x264_s 348799.000 -
628.pop2_s 2550637.000 -
631.deepsjeng_s 56915.000 -
638.imagick_s 963249.000 -
641.leela_s 59946.000 -
644.nab_s 80500.000 -
648.exchange2_s 52773.000 -
649.fotonik3d_s 248415.000 -
654.roms_s 436553.000 -
657.xz_s 103870.000 -
Geometric Mean 360927.664 -
sample variability
Name Current %
508.namd_r 44.000 -
508.namd_r (avg) 44.000 -
508.namd_r (avg) (percentage) 1.270 -
508.namd_r (max) 43.000 -
508.namd_r (max) (percentage) 1.250 -
508.namd_r (unexplained diff vs previous) 14.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.400 -
510.parest_r 155.000 -
510.parest_r (avg) 155.000 -
510.parest_r (avg) (percentage) 2.320 -
510.parest_r (max) 65.000 -
510.parest_r (max) (percentage) 0.980 -
510.parest_r (unexplained diff vs previous) 66.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.980 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 0.980 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
511.povray_r (unexplained diff vs previous) 4.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.750 -
526.blender_r 113.000 -
526.blender_r (avg) 113.000 -
526.blender_r (avg) (percentage) 0.890 -
526.blender_r (max) 90.000 -
526.blender_r (max) (percentage) 0.710 -
526.blender_r (unexplained diff vs previous) 83.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.650 -
600.perlbench_s 41.000 -
600.perlbench_s (avg) 41.000 -
600.perlbench_s (avg) (percentage) 1.840 -
600.perlbench_s (max) 24.000 -
600.perlbench_s (max) (percentage) 1.090 -
600.perlbench_s (unexplained diff vs previous) 23.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 1.010 -
603.bwaves_s 391.000 -
603.bwaves_s (avg) 391.000 -
603.bwaves_s (avg) (percentage) 4.160 -
603.bwaves_s (max) 144.000 -
603.bwaves_s (max) (percentage) 1.540 -
603.bwaves_s (unexplained diff vs previous) 99.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.050 -
605.mcf_s 160.000 -
605.mcf_s (avg) 160.000 -
605.mcf_s (avg) (percentage) 2.210 -
605.mcf_s (max) 128.000 -
605.mcf_s (max) (percentage) 1.760 -
605.mcf_s (unexplained diff vs previous) 96.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 1.320 -
607.cactuBSSN_s 170.000 -
607.cactuBSSN_s (avg) 170.000 -
607.cactuBSSN_s (avg) (percentage) 3.200 -
607.cactuBSSN_s (max) 33.000 -
607.cactuBSSN_s (max) (percentage) 0.630 -
607.cactuBSSN_s (unexplained diff vs previous) 33.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.620 -
619.lbm_s 4750.000 -
619.lbm_s (avg) 4750.000 -
619.lbm_s (avg) (percentage) 13.270 -
619.lbm_s (max) 6940.000 -
619.lbm_s (max) (percentage) 19.390 -
619.lbm_s (unexplained diff vs previous) 1997.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 5.580 -
620.omnetpp_s 144.000 -
620.omnetpp_s (avg) 144.000 -
620.omnetpp_s (avg) (percentage) 3.310 -
620.omnetpp_s (max) 101.000 -
620.omnetpp_s (max) (percentage) 2.310 -
620.omnetpp_s (unexplained diff vs previous) 79.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.810 -
623.xalancbmk_s 45.000 -
623.xalancbmk_s (avg) 45.000 -
623.xalancbmk_s (avg) (percentage) 0.970 -
623.xalancbmk_s (max) 38.000 -
623.xalancbmk_s (max) (percentage) 0.820 -
623.xalancbmk_s (unexplained diff vs previous) 23.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.490 -
625.x264_s 54.000 -
625.x264_s (avg) 54.000 -
625.x264_s (avg) (percentage) 1.390 -
625.x264_s (max) 25.000 -
625.x264_s (max) (percentage) 0.650 -
625.x264_s (unexplained diff vs previous) 11.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.280 -
628.pop2_s 220.000 -
628.pop2_s (avg) 220.000 -
628.pop2_s (avg) (percentage) 1.550 -
628.pop2_s (max) 58.000 -
628.pop2_s (max) (percentage) 0.410 -
628.pop2_s (unexplained diff vs previous) 35.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 0.250 -
631.deepsjeng_s 75.000 -
631.deepsjeng_s (avg) 75.000 -
631.deepsjeng_s (avg) (percentage) 1.760 -
631.deepsjeng_s (max) 47.000 -
631.deepsjeng_s (max) (percentage) 1.100 -
631.deepsjeng_s (unexplained diff vs previous) 37.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.860 -
638.imagick_s 74.000 -
638.imagick_s (avg) 74.000 -
638.imagick_s (avg) (percentage) 1.240 -
638.imagick_s (max) 63.000 -
638.imagick_s (max) (percentage) 1.050 -
638.imagick_s (unexplained diff vs previous) 23.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.380 -
641.leela_s 35.000 -
641.leela_s (avg) 35.000 -
641.leela_s (avg) (percentage) 0.780 -
641.leela_s (max) 20.000 -
641.leela_s (max) (percentage) 0.450 -
641.leela_s (unexplained diff vs previous) 1.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.020 -
644.nab_s 103.000 -
644.nab_s (avg) 103.000 -
644.nab_s (avg) (percentage) 0.810 -
644.nab_s (max) 68.000 -
644.nab_s (max) (percentage) 0.540 -
644.nab_s (unexplained diff vs previous) 69.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.540 -
648.exchange2_s 19.000 -
648.exchange2_s (avg) 19.000 -
648.exchange2_s (avg) (percentage) 0.560 -
648.exchange2_s (max) 31.000 -
648.exchange2_s (max) (percentage) 0.910 -
648.exchange2_s (unexplained diff vs previous) 31.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.900 -
649.fotonik3d_s 525.000 -
649.fotonik3d_s (avg) 525.000 -
649.fotonik3d_s (avg) (percentage) 4.950 -
649.fotonik3d_s (max) 161.000 -
649.fotonik3d_s (max) (percentage) 1.520 -
649.fotonik3d_s (unexplained diff vs previous) 81.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.760 -
654.roms_s 1802.000 -
654.roms_s (avg) 1802.000 -
654.roms_s (avg) (percentage) 5.350 -
654.roms_s (max) 387.000 -
654.roms_s (max) (percentage) 1.150 -
654.roms_s (unexplained diff vs previous) 56.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.170 -
657.xz_s 58.000 -
657.xz_s (avg) 58.000 -
657.xz_s (avg) (percentage) 2.300 -
657.xz_s (max) 44.000 -
657.xz_s (max) (percentage) 1.770 -
657.xz_s (unexplained diff vs previous) 23.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.910 -
Geometric Mean 12.147 -