Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a2ee3a8fffceb52f0736a7ad84980907a0907d5a (+ 70 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6eb1507107dee3e67e3a136e2917b93cdffba7c4 (+ 201 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2e0c0ff95ca0e3122eb5b906ee26a31f284ce5ab (+ 22 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os_LTO-build/121/
Filter

gnu-aarch64-master-Os_LTO test results

Run Order Start Time Duration
Current 0121 (3-changed-components) 2023-11-21T08:22:14 0:00:00
Previous 0120 (3-changed-components) 2023-11-17T21:51:35 0:00:00
Baseline 0105 (4-changed-components) 2023-10-18T06:40:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 20
Performance Improvements 47 0
Added Tests 1 107
Unchanged Tests 868 791
Total Tests 918

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s 5.00% 20.000 21.000 - 0.00% -
623.xalancbmk_s (avg) 5.00% 20.000 21.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
607.cactuBSSN_s -5.52% 5563.000 5256.000 - 3.51% -
619.lbm_s -5.00% 39832.000 37839.000 - 24.25% -
620.omnetpp_s -3.38% 4644.000 4487.000 - 1.93% -
649.fotonik3d_s -2.95% 10886.000 10565.000 - 3.18% -
621.wrf_s -2.39% 12821.000 12515.000 - -0.10% -
657.xz_s -2.28% 2593.000 2534.000 - 2.59% -
654.roms_s -1.85% 34913.000 34267.000 - 1.10% -
648.exchange2_s -1.71% 3500.000 3440.000 - -0.06% -
628.pop2_s -1.67% 14627.000 14383.000 - 1.62% -
510.parest_r -1.57% 6873.000 6765.000 - 1.36% -
605.mcf_s -1.26% 7440.000 7346.000 - 2.38% -
603.bwaves_s -1.16% 10783.000 10658.000 - 2.13% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
638.imagick_s -5.88% 17.000 16.000 - 0.00% -
638.imagick_s (avg) -5.88% 17.000 16.000 - 0.00% -
607.cactuBSSN_s (max) -5.52% 145.000 137.000 - 0.00% -
619.lbm_s (max) -5.01% 7799.000 7408.000 - 0.00% -
619.lbm_s -5.01% 4469.000 4245.000 - 0.00% -
619.lbm_s (avg) -5.01% 4469.000 4245.000 - 0.00% -
607.cactuBSSN_s -4.95% 101.000 96.000 - 0.00% -
607.cactuBSSN_s (avg) -4.95% 101.000 96.000 - 0.00% -
620.omnetpp_s -4.69% 64.000 61.000 - 0.00% -
620.omnetpp_s (avg) -4.69% 64.000 61.000 - 0.00% -
620.omnetpp_s (max) -4.17% 72.000 69.000 - 0.00% -
600.perlbench_s -3.85% 26.000 25.000 - 0.00% -
600.perlbench_s (avg) -3.85% 26.000 25.000 - 0.00% -
649.fotonik3d_s -3.01% 166.000 161.000 - 0.00% -
649.fotonik3d_s (avg) -3.01% 166.000 161.000 - 0.00% -
657.xz_s -2.70% 37.000 36.000 - 0.00% -
657.xz_s (avg) -2.70% 37.000 36.000 - 0.00% -
648.exchange2_s (max) -2.63% 38.000 37.000 - 0.00% -
649.fotonik3d_s (max) -2.60% 192.000 187.000 - 0.00% -
657.xz_s (max) -2.38% 42.000 41.000 - 0.00% -
628.pop2_s -2.11% 95.000 93.000 - 0.00% -
628.pop2_s (avg) -2.11% 95.000 93.000 - 0.00% -
654.roms_s -1.85% 3075.000 3018.000 - 0.00% -
654.roms_s (avg) -1.85% 3075.000 3018.000 - 0.00% -
654.roms_s (max) -1.83% 3871.000 3800.000 - 0.00% -
628.pop2_s (max) -1.75% 171.000 168.000 - 0.00% -
603.bwaves_s -1.30% 308.000 304.000 - 0.00% -
603.bwaves_s (avg) -1.30% 308.000 304.000 - 0.00% -
510.parest_r (max) -1.18% 85.000 84.000 - 0.00% -
605.mcf_s -1.12% 89.000 88.000 - 0.00% -
605.mcf_s (avg) -1.12% 89.000 88.000 - 0.00% -
510.parest_r -1.11% 90.000 89.000 - 0.00% -
510.parest_r (avg) -1.11% 90.000 89.000 - 0.00% -
603.bwaves_s (max) -1.10% 543.000 537.000 - 0.00% -
605.mcf_s (max) -1.04% 96.000 95.000 - 0.00% -

Added Tests - Score
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s 24.25% 30454.000 37839.000 - -5.00% -
607.cactuBSSN_s 3.51% 5078.000 5256.000 - -5.52% -
602.gcc_s 3.19% 5085.000 5247.000 - -0.57% -
649.fotonik3d_s 3.18% 10239.000 10565.000 - -2.95% -
657.xz_s 2.59% 2470.000 2534.000 - -2.28% -
605.mcf_s 2.38% 7175.000 7346.000 - -1.26% -
603.bwaves_s 2.13% 10436.000 10658.000 - -1.16% -
600.perlbench_s 2.11% 2230.000 2277.000 - -0.52% -
631.deepsjeng_s 2.09% 4214.000 4302.000 - -0.35% -
511.povray_r 2.09% 527.000 538.000 - 0.37% -
508.namd_r 1.97% 3451.000 3519.000 - -0.23% -
620.omnetpp_s 1.93% 4402.000 4487.000 - -3.38% -
625.x264_s 1.77% 3949.000 4019.000 - -0.47% -
638.imagick_s 1.77% 5944.000 6049.000 - -0.98% -
628.pop2_s 1.62% 14154.000 14383.000 - -1.67% -
510.parest_r 1.36% 6674.000 6765.000 - -1.57% -
654.roms_s 1.10% 33893.000 34267.000 - -1.85% -
526.blender_r 1.08% 12996.000 13136.000 - 0.81% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -95.83% 24.000 1.000 - 0.00% -
nb_total_tests -95.83% 24.000 1.000 - 0.00% -

Added Tests - Execution
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_execution_successful


Report Time: 0.35s
Name Current %
508.namd_r 3519.000 -
510.parest_r 6765.000 -1.57%
511.povray_r 538.000 -
526.blender_r 13136.000 -
600.perlbench_s 2277.000 -
602.gcc_s 5247.000 -
603.bwaves_s 10658.000 -1.16%
605.mcf_s 7346.000 -1.26%
607.cactuBSSN_s 5256.000 -5.52%
619.lbm_s 37839.000 -5.00%
620.omnetpp_s 4487.000 -3.38%
621.wrf_s 12515.000 -2.39%
623.xalancbmk_s 4773.000 -
625.x264_s 4019.000 -
627.cam4_s 200.000 -
628.pop2_s 14383.000 -1.67%
631.deepsjeng_s 4302.000 -
638.imagick_s 6049.000 -
641.leela_s 4463.000 -
644.nab_s 12657.000 -
648.exchange2_s 3440.000 -1.71%
649.fotonik3d_s 10565.000 -2.95%
654.roms_s 34267.000 -1.85%
657.xz_s 2534.000 -2.28%
Geometric Mean 5439.349 -1.39%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.660 -
510.parest_r 89.000 -1.11%
510.parest_r (avg) 89.000 -1.11%
510.parest_r (avg) (percentage) 1.320 -
510.parest_r (max) 84.000 -1.18%
510.parest_r (max) (percentage) 1.250 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 0.850 -
526.blender_r 52.000 -
526.blender_r (avg) 52.000 -
526.blender_r (avg) (percentage) 0.400 -
526.blender_r (max) 49.000 -
526.blender_r (max) (percentage) 0.380 -
600.perlbench_s 25.000 -3.85%
600.perlbench_s (avg) 25.000 -3.85%
600.perlbench_s (avg) (percentage) 1.140 -
600.perlbench_s (max) 29.000 -
600.perlbench_s (max) (percentage) 1.310 -
603.bwaves_s 304.000 -1.30%
603.bwaves_s (avg) 304.000 -1.30%
603.bwaves_s (avg) (percentage) 2.860 -
603.bwaves_s (max) 537.000 -1.10%
603.bwaves_s (max) (percentage) 5.040 -
605.mcf_s 88.000 -1.12%
605.mcf_s (avg) 88.000 -1.12%
605.mcf_s (avg) (percentage) 1.200 -
605.mcf_s (max) 95.000 -1.04%
605.mcf_s (max) (percentage) 1.300 -
607.cactuBSSN_s 96.000 -4.95%
607.cactuBSSN_s (avg) 96.000 -4.95%
607.cactuBSSN_s (avg) (percentage) 1.830 -
607.cactuBSSN_s (max) 137.000 -5.52%
607.cactuBSSN_s (max) (percentage) 2.620 -
619.lbm_s 4245.000 -5.01%
619.lbm_s (avg) 4245.000 -5.01%
619.lbm_s (avg) (percentage) 11.220 -
619.lbm_s (max) 7408.000 -5.01%
619.lbm_s (max) (percentage) 19.580 -
620.omnetpp_s 61.000 -4.69%
620.omnetpp_s (avg) 61.000 -4.69%
620.omnetpp_s (avg) (percentage) 1.380 -
620.omnetpp_s (max) 69.000 -4.17%
620.omnetpp_s (max) (percentage) 1.560 -
623.xalancbmk_s 21.000 5.00%
623.xalancbmk_s (avg) 21.000 5.00%
623.xalancbmk_s (avg) (percentage) 0.440 -
623.xalancbmk_s (max) 29.000 -
623.xalancbmk_s (max) (percentage) 0.610 -
625.x264_s 23.000 -
625.x264_s (avg) 23.000 -
625.x264_s (avg) (percentage) 0.580 -
625.x264_s (max) 34.000 -
625.x264_s (max) (percentage) 0.850 -
628.pop2_s 93.000 -2.11%
628.pop2_s (avg) 93.000 -2.11%
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 168.000 -1.75%
628.pop2_s (max) (percentage) 1.170 -
631.deepsjeng_s 31.000 -
631.deepsjeng_s (avg) 31.000 -
631.deepsjeng_s (avg) (percentage) 0.740 -
631.deepsjeng_s (max) 56.000 -
631.deepsjeng_s (max) (percentage) 1.310 -
638.imagick_s 16.000 -5.88%
638.imagick_s (avg) 16.000 -5.88%
638.imagick_s (avg) (percentage) 0.280 -
638.imagick_s (max) 50.000 -
638.imagick_s (max) (percentage) 0.830 -
641.leela_s 11.000 -
641.leela_s (avg) 11.000 -
641.leela_s (avg) (percentage) 0.250 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.350 -
644.nab_s 31.000 -
644.nab_s (avg) 31.000 -
644.nab_s (avg) (percentage) 0.250 -
644.nab_s (max) 41.000 -
644.nab_s (max) (percentage) 0.330 -
648.exchange2_s 21.000 -
648.exchange2_s (avg) 21.000 -
648.exchange2_s (avg) (percentage) 0.620 -
648.exchange2_s (max) 37.000 -2.63%
648.exchange2_s (max) (percentage) 1.100 -
649.fotonik3d_s 161.000 -3.01%
649.fotonik3d_s (avg) 161.000 -3.01%
649.fotonik3d_s (avg) (percentage) 1.530 -
649.fotonik3d_s (max) 187.000 -2.60%
649.fotonik3d_s (max) (percentage) 1.770 -
654.roms_s 3018.000 -1.85%
654.roms_s (avg) 3018.000 -1.85%
654.roms_s (avg) (percentage) 8.810 -
654.roms_s (max) 3800.000 -1.83%
654.roms_s (max) (percentage) 11.090 -
657.xz_s 36.000 -2.70%
657.xz_s (avg) 36.000 -2.70%
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 41.000 -2.38%
657.xz_s (max) (percentage) 1.640 -
Geometric Mean 12.838 -