Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cb2775070260eae210df62ab57df95927a89536e (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/d45ddc2c04e471d0dcee016b6edacc00b8341b16 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb5bbc20702981c287aa3e44640e7d2f2b9a28cf (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (unchanged)
regression GNU-947
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/76/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0076 (basepoints/gcc-14-04089-gd45ddc2c04e) 2023-09-16T17:25:00 0:00:00
Previous 0075 (basepoints/gcc-14-04088-g1f9bf6f372d) 2023-09-15T01:53:43 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 10
Performance Improvements 51 8
Added Tests 0 107
Unchanged Tests 854 793
Total Tests 918

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 3.21% 629136.000 649336.000 - 3.50% -
648.exchange2_s 2.52% 60206.000 61722.000 - 2.23% -
603.bwaves_s 1.95% 49287.000 50247.000 - 2.25% -
621.wrf_s 1.92% 17026146.000 17353178.000 - 1.73% -
600.perlbench_s 1.19% 2105809.000 2130929.000 - 0.51% -
631.deepsjeng_s 1.13% 81434.000 82354.000 - 1.71% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
526.blender_r 1.12% 9978.000 10090.000 - 0.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) 416.67% 6.000 31.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 406.67% 0.150 0.760 - 0.00% -
619.lbm_s (unexplained diff vs previous) 216.67% 30.000 95.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 200.00% 0.110 0.330 - 0.00% -
526.blender_r 1.69% 118.000 120.000 - 0.00% -
526.blender_r (avg) 1.69% 118.000 120.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -6.19% 3957.000 3712.000 - -2.42% -
607.cactuBSSN_s -5.06% 4844.000 4599.000 - -3.14% -
631.deepsjeng_s -1.74% 3855.000 3788.000 - -1.53% -
621.wrf_s -1.48% 9349.000 9211.000 - 1.01% -
605.mcf_s -1.15% 6842.000 6763.000 - -1.87% -
600.perlbench_s -1.00% 2093.000 2072.000 - 0.68% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (max) -9.49% 158.000 143.000 - 0.00% -
623.xalancbmk_s (max) -9.09% 22.000 20.000 - 0.00% -
607.cactuBSSN_s (max) -8.96% 67.000 61.000 - 0.00% -
620.omnetpp_s (max) (percentage) -8.59% 3.840 3.510 - 0.00% -
619.lbm_s (avg) (percentage) -8.36% 6.340 5.810 - 0.00% -
619.lbm_s -8.08% 1795.000 1650.000 - 0.00% -
619.lbm_s (avg) -8.08% 1795.000 1650.000 - 0.00% -
605.mcf_s (max) -8.05% 149.000 137.000 - 0.00% -
623.xalancbmk_s -6.67% 15.000 14.000 - 0.00% -
623.xalancbmk_s (avg) -6.67% 15.000 14.000 - 0.00% -
641.leela_s (max) -6.67% 30.000 28.000 - 0.00% -
649.fotonik3d_s (max) -6.67% 30.000 28.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
605.mcf_s (max) (percentage) -6.42% 2.180 2.040 - 0.00% -
641.leela_s (max) (percentage) -6.35% 0.630 0.590 - 0.00% -
603.bwaves_s (max) -5.98% 418.000 393.000 - 0.00% -
619.lbm_s (max) (percentage) -5.73% 25.320 23.870 - 0.00% -
648.exchange2_s (max) (percentage) -5.43% 0.920 0.870 - 0.00% -
619.lbm_s (max) -5.41% 7170.000 6782.000 - 0.00% -
603.bwaves_s (max) (percentage) -5.38% 4.650 4.400 - 0.00% -
508.namd_r (max) -5.00% 20.000 19.000 - 0.00% -
607.cactuBSSN_s -5.00% 60.000 57.000 - 0.00% -
607.cactuBSSN_s (avg) -5.00% 60.000 57.000 - 0.00% -
648.exchange2_s (max) -5.00% 20.000 19.000 - 0.00% -
631.deepsjeng_s (max) -4.76% 21.000 20.000 - 0.00% -
644.nab_s (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
607.cactuBSSN_s (max) (percentage) -4.29% 1.400 1.340 - 0.00% -
644.nab_s (max) -4.17% 48.000 46.000 - 0.00% -
620.omnetpp_s -4.00% 50.000 48.000 - 0.00% -
620.omnetpp_s (avg) -4.00% 50.000 48.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
600.perlbench_s (max) -3.57% 28.000 27.000 - 0.00% -
508.namd_r (max) (percentage) -3.57% 0.840 0.810 - 0.00% -
620.omnetpp_s (avg) (percentage) -3.28% 1.220 1.180 - 0.00% -
638.imagick_s (max) -3.23% 31.000 30.000 - 0.00% -
654.roms_s (max) (percentage) -2.94% 0.340 0.330 - 0.00% -
600.perlbench_s (max) (percentage) -2.92% 1.370 1.330 - 0.00% -
654.roms_s (max) -2.15% 93.000 91.000 - 0.00% -
605.mcf_s -2.13% 47.000 46.000 - 0.00% -
605.mcf_s (avg) -2.13% 47.000 46.000 - 0.00% -
628.pop2_s (max) (percentage) -2.04% 0.490 0.480 - 0.00% -
628.pop2_s (max) -1.92% 52.000 51.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.82% 0.550 0.540 - 0.00% -
526.blender_r (max) (percentage) -1.63% 1.230 1.210 - 0.00% -
638.imagick_s (max) (percentage) -1.08% 0.930 0.920 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 3.50% 627398.000 649336.000 - 3.21% -
649.fotonik3d_s 3.00% 308847.000 318111.000 - 0.99% -
641.leela_s 2.39% 147936.000 151466.000 - 0.20% -
510.parest_r 2.34% 7623044.000 7801136.000 - 0.82% -
603.bwaves_s 2.25% 49143.000 50247.000 - 1.95% -
648.exchange2_s 2.23% 60374.000 61722.000 - 2.52% -
621.wrf_s 1.73% 17057867.000 17353178.000 - 1.92% -
631.deepsjeng_s 1.71% 80966.000 82354.000 - 1.13% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 1.14% 10468.000 10587.000 - 0.17% -
621.wrf_s 1.01% 9119.000 9211.000 - -1.48% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s -3.14% 4748.000 4599.000 - -5.06% -
623.xalancbmk_s -2.42% 3804.000 3712.000 - -6.19% -
641.leela_s -2.10% 4906.000 4803.000 - -0.25% -
605.mcf_s -1.87% 6892.000 6763.000 - -1.15% -
631.deepsjeng_s -1.53% 3847.000 3788.000 - -1.74% -
620.omnetpp_s -1.49% 4163.000 4101.000 - -0.75% -
508.namd_r -1.48% 2427.000 2391.000 - -0.71% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2391.000 -
510.parest_r 5689.000 -
511.povray_r 423.000 -
526.blender_r 10090.000 1.12%
600.perlbench_s 2072.000 -1.00%
602.gcc_s 4311.000 -
603.bwaves_s 8934.000 -
605.mcf_s 6763.000 -1.15%
607.cactuBSSN_s 4599.000 -5.06%
619.lbm_s 28416.000 -
620.omnetpp_s 4101.000 -
621.wrf_s 9211.000 -1.48%
623.xalancbmk_s 3712.000 -6.19%
625.x264_s 2582.000 -
628.pop2_s 10667.000 -
631.deepsjeng_s 3788.000 -1.74%
638.imagick_s 3339.000 -
641.leela_s 4803.000 -
644.nab_s 10587.000 -
648.exchange2_s 2185.000 -
649.fotonik3d_s 9771.000 -
654.roms_s 27619.000 -
657.xz_s 2225.000 -
Geometric Mean 5024.568 -
Name Current %
508.namd_r 649336.000 3.21%
510.parest_r 7801136.000 -
511.povray_r 844912.000 -
526.blender_r 9847518.000 -
600.perlbench_s 2130929.000 1.19%
602.gcc_s 9126331.000 -
603.bwaves_s 50247.000 1.95%
605.mcf_s 21181.000 -
607.cactuBSSN_s 3203303.000 -
619.lbm_s 16134.000 -
620.omnetpp_s 2013276.000 -
621.wrf_s 17353178.000 1.92%
623.xalancbmk_s 4457295.000 -
625.x264_s 445238.000 -
628.pop2_s 25484053.000 -
631.deepsjeng_s 82354.000 1.13%
638.imagick_s 1869788.000 -
641.leela_s 151466.000 -
644.nab_s 176335.000 -
648.exchange2_s 61722.000 2.52%
649.fotonik3d_s 318111.000 -
654.roms_s 686296.000 -
657.xz_s 191551.000 -
Geometric Mean 735189.751 -
Name Current %
508.namd_r 9.000 -
508.namd_r (avg) 9.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 19.000 -5.00%
508.namd_r (max) (percentage) 0.810 -3.57%
510.parest_r 32.000 -
510.parest_r (avg) 32.000 -
510.parest_r (avg) (percentage) 0.570 -
510.parest_r (max) 27.000 -
510.parest_r (max) (percentage) 0.490 -
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.930 -
526.blender_r 120.000 1.69%
526.blender_r (avg) 120.000 1.69%
526.blender_r (avg) (percentage) 1.190 -
526.blender_r (max) 122.000 -
526.blender_r (max) (percentage) 1.210 -1.63%
600.perlbench_s 12.000 -
600.perlbench_s (avg) 12.000 -
600.perlbench_s (avg) (percentage) 0.620 -
600.perlbench_s (max) 27.000 -3.57%
600.perlbench_s (max) (percentage) 1.330 -2.92%
603.bwaves_s 132.000 -
603.bwaves_s (avg) 132.000 -
603.bwaves_s (avg) (percentage) 1.480 -
603.bwaves_s (max) 393.000 -5.98%
603.bwaves_s (max) (percentage) 4.400 -5.38%
605.mcf_s 46.000 -2.13%
605.mcf_s (avg) 46.000 -2.13%
605.mcf_s (avg) (percentage) 0.690 -
605.mcf_s (max) 137.000 -8.05%
605.mcf_s (max) (percentage) 2.040 -6.42%
607.cactuBSSN_s 57.000 -5.00%
607.cactuBSSN_s (avg) 57.000 -5.00%
607.cactuBSSN_s (avg) (percentage) 1.250 -
607.cactuBSSN_s (max) 61.000 -8.96%
607.cactuBSSN_s (max) (percentage) 1.340 -4.29%
619.lbm_s 1650.000 -8.08%
619.lbm_s (avg) 1650.000 -8.08%
619.lbm_s (avg) (percentage) 5.810 -8.36%
619.lbm_s (max) 6782.000 -5.41%
619.lbm_s (max) (percentage) 23.870 -5.73%
619.lbm_s (unexplained diff vs previous) 95.000 216.67%
619.lbm_s (unexplained diff vs previous) (percentage) 0.330 200.00%
620.omnetpp_s 48.000 -4.00%
620.omnetpp_s (avg) 48.000 -4.00%
620.omnetpp_s (avg) (percentage) 1.180 -3.28%
620.omnetpp_s (max) 143.000 -9.49%
620.omnetpp_s (max) (percentage) 3.510 -8.59%
620.omnetpp_s (unexplained diff vs previous) 31.000 416.67%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.760 406.67%
623.xalancbmk_s 14.000 -6.67%
623.xalancbmk_s (avg) 14.000 -6.67%
623.xalancbmk_s (avg) (percentage) 0.390 -
623.xalancbmk_s (max) 20.000 -9.09%
623.xalancbmk_s (max) (percentage) 0.540 -3.57%
625.x264_s 13.000 -
625.x264_s (avg) 13.000 -
625.x264_s (avg) (percentage) 0.530 -
625.x264_s (max) 14.000 -
625.x264_s (max) (percentage) 0.560 -
628.pop2_s 41.000 -
628.pop2_s (avg) 41.000 -
628.pop2_s (avg) (percentage) 0.390 -
628.pop2_s (max) 51.000 -1.92%
628.pop2_s (max) (percentage) 0.480 -2.04%
631.deepsjeng_s 12.000 -
631.deepsjeng_s (avg) 12.000 -
631.deepsjeng_s (avg) (percentage) 0.320 -
631.deepsjeng_s (max) 20.000 -4.76%
631.deepsjeng_s (max) (percentage) 0.540 -1.82%
638.imagick_s 9.000 -
638.imagick_s (avg) 9.000 -
638.imagick_s (avg) (percentage) 0.270 -
638.imagick_s (max) 30.000 -3.23%
638.imagick_s (max) (percentage) 0.920 -1.08%
641.leela_s 19.000 -
641.leela_s (avg) 19.000 -
641.leela_s (avg) (percentage) 0.410 -
641.leela_s (max) 28.000 -6.67%
641.leela_s (max) (percentage) 0.590 -6.35%
644.nab_s 56.000 -
644.nab_s (avg) 56.000 -
644.nab_s (avg) (percentage) 0.530 -
644.nab_s (max) 46.000 -4.17%
644.nab_s (max) (percentage) 0.440 -4.35%
648.exchange2_s 14.000 -
648.exchange2_s (avg) 14.000 -
648.exchange2_s (avg) (percentage) 0.650 -
648.exchange2_s (max) 19.000 -5.00%
648.exchange2_s (max) (percentage) 0.870 -5.43%
649.fotonik3d_s 66.000 -
649.fotonik3d_s (avg) 66.000 -
649.fotonik3d_s (avg) (percentage) 0.680 -
649.fotonik3d_s (max) 28.000 -6.67%
649.fotonik3d_s (max) (percentage) 0.290 -6.45%
654.roms_s 138.000 -
654.roms_s (avg) 138.000 -
654.roms_s (avg) (percentage) 0.500 -
654.roms_s (max) 91.000 -2.15%
654.roms_s (max) (percentage) 0.330 -2.94%
657.xz_s 10.000 -
657.xz_s (avg) 10.000 -
657.xz_s (avg) (percentage) 0.460 -
657.xz_s (max) 13.000 -
657.xz_s (max) (percentage) 0.600 -
Geometric Mean 7.687 2.98%