Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cb2775070260eae210df62ab57df95927a89536e (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/8552dcd8e4448c02fe230662093756b75dd94399 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb5bbc20702981c287aa3e44640e7d2f2b9a28cf (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (unchanged)
regression GNU-952
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/79/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0079 (basepoints/gcc-14-04312-g8552dcd8e44) 2023-09-25T16:06:33 0:00:00
Previous 0078 (basepoints/gcc-14-04311-gd8b56c95782) 2023-09-22T16:15:22 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 14 14
Performance Improvements 36 7
Added Tests 0 107
Unchanged Tests 844 766
Total Tests 894

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
631.deepsjeng_s 4.47% 82354.000 86038.000 - 6.26% -
657.xz_s 2.12% 191551.000 195603.000 - 2.42% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s 3.42% 3680.000 3806.000 - 0.05% -
628.pop2_s 1.37% 10638.000 10784.000 - 1.34% -
644.nab_s 1.21% 10494.000 10621.000 - 1.46% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) (percentage) 62.07% 0.290 0.470 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 58.33% 12.000 19.000 - 0.00% -
638.imagick_s 12.50% 8.000 9.000 - 0.00% -
638.imagick_s (avg) 12.50% 8.000 9.000 - 0.00% -
628.pop2_s 2.44% 41.000 42.000 - 0.00% -
628.pop2_s (avg) 2.44% 41.000 42.000 - 0.00% -
628.pop2_s (max) 2.04% 49.000 50.000 - 0.00% -
644.nab_s 1.82% 55.000 56.000 - 0.00% -
644.nab_s (avg) 1.82% 55.000 56.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s -1.63% 318111.000 312911.000 - 1.32% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
605.mcf_s -1.98% 6859.000 6723.000 - -2.45% -
621.wrf_s -1.68% 9295.000 9139.000 - 0.22% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (max) (percentage) -10.71% 0.560 0.500 - 0.00% -
620.omnetpp_s (max) -9.09% 22.000 20.000 - 0.00% -
619.lbm_s (max) -7.59% 79.000 73.000 - 0.00% -
619.lbm_s (max) (percentage) -7.14% 0.280 0.260 - 0.00% -
605.mcf_s (max) -6.02% 133.000 125.000 - 0.00% -
648.exchange2_s (max) -5.56% 18.000 17.000 - 0.00% -
649.fotonik3d_s (max) -5.41% 37.000 35.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
644.nab_s (max) (percentage) -4.65% 0.430 0.410 - 0.00% -
620.omnetpp_s -4.44% 45.000 43.000 - 0.00% -
620.omnetpp_s (avg) -4.44% 45.000 43.000 - 0.00% -
644.nab_s (max) -4.44% 45.000 43.000 - 0.00% -
641.leela_s (max) -3.85% 26.000 25.000 - 0.00% -
605.mcf_s (max) (percentage) -3.61% 1.940 1.870 - 0.00% -
620.omnetpp_s (avg) (percentage) -3.57% 1.120 1.080 - 0.00% -
641.leela_s (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
510.parest_r (max) -3.57% 28.000 27.000 - 0.00% -
648.exchange2_s (max) (percentage) -3.57% 0.840 0.810 - 0.00% -
603.bwaves_s (max) (percentage) -3.55% 4.220 4.070 - 0.00% -
654.roms_s (max) (percentage) -3.37% 0.890 0.860 - 0.00% -
607.cactuBSSN_s (max) -3.23% 62.000 60.000 - 0.00% -
603.bwaves_s (max) -3.17% 379.000 367.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.08% 1.300 1.260 - 0.00% -
654.roms_s (max) -2.88% 243.000 236.000 - 0.00% -
511.povray_r (max) (percentage) -2.54% 1.180 1.150 - 0.00% -
508.namd_r (max) (percentage) -2.53% 0.790 0.770 - 0.00% -
600.perlbench_s (max) (percentage) -2.31% 1.300 1.270 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.92% 0.520 0.510 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.92% 0.520 0.510 - 0.00% -
605.mcf_s -1.92% 52.000 51.000 - 0.00% -
605.mcf_s (avg) -1.92% 52.000 51.000 - 0.00% -
526.blender_r (max) (percentage) -1.68% 1.190 1.170 - 0.00% -
638.imagick_s (max) (percentage) -1.10% 0.910 0.900 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
631.deepsjeng_s 6.26% 80966.000 86038.000 - 4.47% -
508.namd_r 3.48% 627398.000 649208.000 - -0.02% -
657.xz_s 2.42% 190987.000 195603.000 - 2.12% -
648.exchange2_s 2.26% 60374.000 61738.000 - 0.03% -
603.bwaves_s 1.80% 49143.000 50027.000 - -0.43% -
510.parest_r 1.67% 7623044.000 7750203.000 - -0.70% -
621.wrf_s 1.64% 17057867.000 17338018.000 - -0.13% -
641.leela_s 1.59% 147936.000 150285.000 - -0.80% -
649.fotonik3d_s 1.32% 308847.000 312911.000 - -1.63% -
600.perlbench_s 1.04% 2120214.000 2142321.000 - -0.04% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 1.46% 10468.000 10621.000 - 1.21% -
628.pop2_s 1.34% 10641.000 10784.000 - 1.37% -
603.bwaves_s 1.23% 8916.000 9026.000 - 0.38% -
510.parest_r 1.17% 5637.000 5703.000 - -0.47% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s -1.23% 4496134.000 4440843.000 - -0.45% -
620.omnetpp_s -1.09% 2027591.000 2005420.000 - -0.62% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s -2.45% 6892.000 6723.000 - -1.98% -
641.leela_s -2.43% 4906.000 4787.000 - -0.19% -
620.omnetpp_s -2.23% 4163.000 4070.000 - -0.46% -
631.deepsjeng_s -1.20% 3847.000 3801.000 - 0.42% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
508.namd_r 2410.000 -
510.parest_r 5703.000 -
511.povray_r 421.000 -
526.blender_r 10000.000 -
600.perlbench_s 2074.000 -
602.gcc_s 4289.000 -
603.bwaves_s 9026.000 -
605.mcf_s 6723.000 -1.98%
607.cactuBSSN_s 4763.000 -
619.lbm_s 28326.000 -
620.omnetpp_s 4070.000 -
621.wrf_s 9139.000 -1.68%
623.xalancbmk_s 3806.000 3.42%
625.x264_s 2585.000 -
628.pop2_s 10784.000 1.37%
631.deepsjeng_s 3801.000 -
638.imagick_s 3335.000 -
641.leela_s 4787.000 -
644.nab_s 10621.000 1.21%
648.exchange2_s 2216.000 -
649.fotonik3d_s 9736.000 -
654.roms_s 27459.000 -
657.xz_s 2224.000 -
Geometric Mean 5036.965 -
Name Current %
508.namd_r 649208.000 -
510.parest_r 7750203.000 -
511.povray_r 850960.000 -
526.blender_r 9775258.000 -
600.perlbench_s 2142321.000 -
602.gcc_s 9107371.000 -
603.bwaves_s 50027.000 -
605.mcf_s 21141.000 -
607.cactuBSSN_s 3206127.000 -
619.lbm_s 16078.000 -
620.omnetpp_s 2005420.000 -
621.wrf_s 17338018.000 -
623.xalancbmk_s 4440843.000 -
625.x264_s 444670.000 -
628.pop2_s 25475497.000 -
631.deepsjeng_s 86038.000 4.47%
638.imagick_s 1859280.000 -
641.leela_s 150285.000 -
644.nab_s 175363.000 -
648.exchange2_s 61738.000 -
649.fotonik3d_s 312911.000 -1.63%
654.roms_s 681336.000 -
657.xz_s 195603.000 2.12%
Geometric Mean 735174.815 -
Name Current %
508.namd_r 9.000 -
508.namd_r (avg) 9.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 18.000 -
508.namd_r (max) (percentage) 0.770 -2.53%
510.parest_r 32.000 -
510.parest_r (avg) 32.000 -
510.parest_r (avg) (percentage) 0.570 -
510.parest_r (max) 27.000 -3.57%
510.parest_r (max) (percentage) 0.490 -
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.630 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.150 -2.54%
526.blender_r 119.000 -
526.blender_r (avg) 119.000 -
526.blender_r (avg) (percentage) 1.190 -
526.blender_r (max) 117.000 -
526.blender_r (max) (percentage) 1.170 -1.68%
600.perlbench_s 12.000 -
600.perlbench_s (avg) 12.000 -
600.perlbench_s (avg) (percentage) 0.620 -
600.perlbench_s (max) 26.000 -
600.perlbench_s (max) (percentage) 1.270 -2.31%
603.bwaves_s 126.000 -
603.bwaves_s (avg) 126.000 -
603.bwaves_s (avg) (percentage) 1.400 -
603.bwaves_s (max) 367.000 -3.17%
603.bwaves_s (max) (percentage) 4.070 -3.55%
605.mcf_s 51.000 -1.92%
605.mcf_s (avg) 51.000 -1.92%
605.mcf_s (avg) (percentage) 0.760 -
605.mcf_s (max) 125.000 -6.02%
605.mcf_s (max) (percentage) 1.870 -3.61%
607.cactuBSSN_s 59.000 -
607.cactuBSSN_s (avg) 59.000 -
607.cactuBSSN_s (avg) (percentage) 1.250 -
607.cactuBSSN_s (max) 60.000 -3.23%
607.cactuBSSN_s (max) (percentage) 1.260 -3.08%
619.lbm_s 1512.000 -
619.lbm_s (avg) 1512.000 -
619.lbm_s (avg) (percentage) 5.340 -
619.lbm_s (max) 73.000 -7.59%
619.lbm_s (max) (percentage) 0.260 -7.14%
620.omnetpp_s 43.000 -4.44%
620.omnetpp_s (avg) 43.000 -4.44%
620.omnetpp_s (avg) (percentage) 1.080 -3.57%
620.omnetpp_s (max) 20.000 -9.09%
620.omnetpp_s (max) (percentage) 0.500 -10.71%
620.omnetpp_s (unexplained diff vs previous) 19.000 58.33%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.470 62.07%
623.xalancbmk_s 14.000 -
623.xalancbmk_s (avg) 14.000 -
623.xalancbmk_s (avg) (percentage) 0.390 -
623.xalancbmk_s (max) 19.000 -
623.xalancbmk_s (max) (percentage) 0.510 -1.92%
625.x264_s 13.000 -
625.x264_s (avg) 13.000 -
625.x264_s (avg) (percentage) 0.530 -
625.x264_s (max) 14.000 -
625.x264_s (max) (percentage) 0.560 -
628.pop2_s 42.000 2.44%
628.pop2_s (avg) 42.000 2.44%
628.pop2_s (avg) (percentage) 0.390 -
628.pop2_s (max) 50.000 2.04%
628.pop2_s (max) (percentage) 0.470 -
631.deepsjeng_s 10.000 -
631.deepsjeng_s (avg) 10.000 -
631.deepsjeng_s (avg) (percentage) 0.280 -
631.deepsjeng_s (max) 19.000 -
631.deepsjeng_s (max) (percentage) 0.510 -1.92%
638.imagick_s 9.000 12.50%
638.imagick_s (avg) 9.000 12.50%
638.imagick_s (avg) (percentage) 0.270 -
638.imagick_s (max) 30.000 -
638.imagick_s (max) (percentage) 0.900 -1.10%
641.leela_s 19.000 -
641.leela_s (avg) 19.000 -
641.leela_s (avg) (percentage) 0.410 -
641.leela_s (max) 25.000 -3.85%
641.leela_s (max) (percentage) 0.540 -3.57%
644.nab_s 56.000 1.82%
644.nab_s (avg) 56.000 1.82%
644.nab_s (avg) (percentage) 0.530 -
644.nab_s (max) 43.000 -4.44%
644.nab_s (max) (percentage) 0.410 -4.65%
648.exchange2_s 14.000 -
648.exchange2_s (avg) 14.000 -
648.exchange2_s (avg) (percentage) 0.640 -
648.exchange2_s (max) 17.000 -5.56%
648.exchange2_s (max) (percentage) 0.810 -3.57%
649.fotonik3d_s 62.000 -
649.fotonik3d_s (avg) 62.000 -
649.fotonik3d_s (avg) (percentage) 0.640 -
649.fotonik3d_s (max) 35.000 -5.41%
649.fotonik3d_s (max) (percentage) 0.360 -5.26%
654.roms_s 151.000 -
654.roms_s (avg) 151.000 -
654.roms_s (avg) (percentage) 0.550 -
654.roms_s (max) 236.000 -2.88%
654.roms_s (max) (percentage) 0.860 -3.37%
657.xz_s 10.000 -
657.xz_s (avg) 10.000 -
657.xz_s (avg) (percentage) 0.470 -
657.xz_s (max) 13.000 -
657.xz_s (max) (percentage) 0.600 -
Geometric Mean 6.842 -