Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=38b95a529385e32adc39428231c6fc8b0e8d6f21 (+ 41 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fb7044999b1e00e0538b2fc0771cc1f5d3b297d9 (+ 207 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (+ 18 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/19/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0019 (3-changed-components) 2023-05-05T05:49:48 0:00:00
Previous 0017 (4-changed-components) 2023-04-29T03:14:26 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 8 5
Performance Improvements 46 7
Added Tests 2 107
Unchanged Tests 838 775
Total Tests 894

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s 1.61% 2176.000 2211.000 - 0.55% -
607.cactuBSSN_s 1.56% 4796.000 4871.000 - 2.59% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) 1450.00% 2.000 31.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 1400.00% 0.050 0.750 - 0.00% -
631.deepsjeng_s 7.14% 14.000 15.000 - 0.00% -
631.deepsjeng_s (avg) 7.14% 14.000 15.000 - 0.00% -
607.cactuBSSN_s 1.54% 65.000 66.000 - 0.00% -
607.cactuBSSN_s (avg) 1.54% 65.000 66.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s -1.30% 312519.000 308447.000 - -0.13% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -2.45% 3959.000 3862.000 - 1.52% -
511.povray_r -1.88% 425.000 417.000 - -1.88% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
641.leela_s (max) (percentage) -18.92% 0.740 0.600 - 0.00% -
641.leela_s -18.18% 22.000 18.000 - 0.00% -
641.leela_s (avg) -18.18% 22.000 18.000 - 0.00% -
641.leela_s (max) -17.14% 35.000 29.000 - 0.00% -
641.leela_s (avg) (percentage) -17.02% 0.470 0.390 - 0.00% -
657.xz_s (max) -14.29% 7.000 6.000 - 0.00% -
638.imagick_s (max) -12.50% 8.000 7.000 - 0.00% -
649.fotonik3d_s (max) -10.77% 65.000 58.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -10.45% 0.670 0.600 - 0.00% -
657.xz_s (max) (percentage) -9.09% 0.330 0.300 - 0.00% -
619.lbm_s (max) -6.23% 3707.000 3476.000 - 0.00% -
619.lbm_s (max) (percentage) -6.20% 13.070 12.260 - 0.00% -
620.omnetpp_s (avg) (percentage) -6.15% 1.300 1.220 - 0.00% -
644.nab_s (max) (percentage) -5.77% 1.040 0.980 - 0.00% -
620.omnetpp_s -5.66% 53.000 50.000 - 0.00% -
620.omnetpp_s (avg) -5.66% 53.000 50.000 - 0.00% -
644.nab_s (max) -5.61% 107.000 101.000 - 0.00% -
510.parest_r (max) -5.56% 54.000 51.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -5.45% 0.550 0.520 - 0.00% -
620.omnetpp_s (max) -5.32% 94.000 89.000 - 0.00% -
603.bwaves_s (max) -5.11% 313.000 297.000 - 0.00% -
508.namd_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
511.povray_r (max) (percentage) -4.82% 0.830 0.790 - 0.00% -
623.xalancbmk_s -4.76% 21.000 20.000 - 0.00% -
623.xalancbmk_s (avg) -4.76% 21.000 20.000 - 0.00% -
631.deepsjeng_s (max) -4.76% 21.000 20.000 - 0.00% -
603.bwaves_s (max) (percentage) -4.66% 3.430 3.270 - 0.00% -
648.exchange2_s (max) (percentage) -4.62% 1.300 1.240 - 0.00% -
623.xalancbmk_s (max) -4.55% 44.000 42.000 - 0.00% -
526.blender_r (max) -4.23% 142.000 136.000 - 0.00% -
510.parest_r (max) (percentage) -4.21% 0.950 0.910 - 0.00% -
600.perlbench_s (max) (percentage) -4.17% 0.480 0.460 - 0.00% -
620.omnetpp_s (max) (percentage) -3.96% 2.270 2.180 - 0.00% -
605.mcf_s (max) -3.75% 80.000 77.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.72% 1.880 1.810 - 0.00% -
648.exchange2_s (max) -3.57% 28.000 27.000 - 0.00% -
526.blender_r (max) (percentage) -3.52% 1.420 1.370 - 0.00% -
605.mcf_s (max) (percentage) -3.36% 1.190 1.150 - 0.00% -
654.roms_s (max) (percentage) -3.33% 0.600 0.580 - 0.00% -
654.roms_s (max) -3.05% 164.000 159.000 - 0.00% -
607.cactuBSSN_s (max) -2.22% 90.000 88.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -1.77% 1.130 1.110 - 0.00% -
625.x264_s (max) (percentage) -1.35% 1.480 1.460 - 0.00% -

Added Tests - sample variability
641.leela_s (unexplained diff vs previous)
641.leela_s (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s 2.64% 9119.000 9360.000 - 0.66% -
607.cactuBSSN_s 2.59% 4748.000 4871.000 - 1.56% -
603.bwaves_s 1.92% 8916.000 9087.000 - -0.48% -
623.xalancbmk_s 1.52% 3804.000 3862.000 - -2.45% -
510.parest_r 1.31% 5637.000 5711.000 - 0.46% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -1.88% 425.000 417.000 - -1.88% -
605.mcf_s -1.74% 6892.000 6772.000 - -0.32% -
644.nab_s -1.51% 10468.000 10310.000 - 0.20% -
508.namd_r -1.44% 2427.000 2392.000 - -0.95% -
620.omnetpp_s -1.27% 4163.000 4110.000 - -0.75% -
526.blender_r -1.03% 10053.000 9949.000 - -0.94% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2392.000 -
510.parest_r 5711.000 -
511.povray_r 417.000 -1.88%
526.blender_r 9949.000 -
600.perlbench_s 2076.000 -
602.gcc_s 4291.000 -
603.bwaves_s 9087.000 -
605.mcf_s 6772.000 -
607.cactuBSSN_s 4871.000 1.56%
619.lbm_s 28354.000 -
620.omnetpp_s 4110.000 -
621.wrf_s 9360.000 -
623.xalancbmk_s 3862.000 -2.45%
625.x264_s 2358.000 -
628.pop2_s 10666.000 -
631.deepsjeng_s 3851.000 -
638.imagick_s 3335.000 -
641.leela_s 4870.000 -
644.nab_s 10310.000 -
648.exchange2_s 2211.000 1.61%
649.fotonik3d_s 9740.000 -
654.roms_s 27514.000 -
657.xz_s 2230.000 -
Geometric Mean 5029.708 -
Name Current %
508.namd_r 625976.000 -
510.parest_r 7602734.000 -
511.povray_r 850260.000 -
526.blender_r 9771914.000 -
600.perlbench_s 2120481.000 -
602.gcc_s 9061927.000 -
603.bwaves_s 49071.000 -
605.mcf_s 21049.000 -
607.cactuBSSN_s 3222803.000 -
619.lbm_s 16038.000 -
620.omnetpp_s 2014407.000 -
621.wrf_s 17030478.000 -
623.xalancbmk_s 4504088.000 -
625.x264_s 440906.000 -
628.pop2_s 25400753.000 -
631.deepsjeng_s 81014.000 -
638.imagick_s 1855020.000 -
641.leela_s 149003.000 -
644.nab_s 174759.000 -
648.exchange2_s 60430.000 -
649.fotonik3d_s 308447.000 -1.30%
654.roms_s 675288.000 -
657.xz_s 190987.000 -
Geometric Mean 727327.989 -
Name Current %
508.namd_r 8.000 -
508.namd_r (avg) 8.000 -
508.namd_r (avg) (percentage) 0.340 -
508.namd_r (max) 9.000 -
508.namd_r (max) (percentage) 0.390 -4.88%
510.parest_r 47.000 -
510.parest_r (avg) 47.000 -
510.parest_r (avg) (percentage) 0.830 -
510.parest_r (max) 51.000 -5.56%
510.parest_r (max) (percentage) 0.910 -4.21%
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.660 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.790 -4.82%
526.blender_r 110.000 -
526.blender_r (avg) 110.000 -
526.blender_r (avg) (percentage) 1.110 -
526.blender_r (max) 136.000 -4.23%
526.blender_r (max) (percentage) 1.370 -3.52%
600.perlbench_s 11.000 -
600.perlbench_s (avg) 11.000 -
600.perlbench_s (avg) (percentage) 0.540 -
600.perlbench_s (max) 9.000 -
600.perlbench_s (max) (percentage) 0.460 -4.17%
603.bwaves_s 159.000 -
603.bwaves_s (avg) 159.000 -
603.bwaves_s (avg) (percentage) 1.760 -
603.bwaves_s (max) 297.000 -5.11%
603.bwaves_s (max) (percentage) 3.270 -4.66%
605.mcf_s 58.000 -
605.mcf_s (avg) 58.000 -
605.mcf_s (avg) (percentage) 0.860 -
605.mcf_s (max) 77.000 -3.75%
605.mcf_s (max) (percentage) 1.150 -3.36%
607.cactuBSSN_s 66.000 1.54%
607.cactuBSSN_s (avg) 66.000 1.54%
607.cactuBSSN_s (avg) (percentage) 1.370 -
607.cactuBSSN_s (max) 88.000 -2.22%
607.cactuBSSN_s (max) (percentage) 1.810 -3.72%
619.lbm_s 1735.000 -
619.lbm_s (avg) 1735.000 -
619.lbm_s (avg) (percentage) 6.120 -
619.lbm_s (max) 3476.000 -6.23%
619.lbm_s (max) (percentage) 12.260 -6.20%
620.omnetpp_s 50.000 -5.66%
620.omnetpp_s (avg) 50.000 -5.66%
620.omnetpp_s (avg) (percentage) 1.220 -6.15%
620.omnetpp_s (max) 89.000 -5.32%
620.omnetpp_s (max) (percentage) 2.180 -3.96%
620.omnetpp_s (unexplained diff vs previous) 31.000 1450.00%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.750 1400.00%
623.xalancbmk_s 20.000 -4.76%
623.xalancbmk_s (avg) 20.000 -4.76%
623.xalancbmk_s (avg) (percentage) 0.540 -
623.xalancbmk_s (max) 42.000 -4.55%
623.xalancbmk_s (max) (percentage) 1.110 -1.77%
625.x264_s 12.000 -
625.x264_s (avg) 12.000 -
625.x264_s (avg) (percentage) 0.520 -
625.x264_s (max) 34.000 -
625.x264_s (max) (percentage) 1.460 -1.35%
628.pop2_s 69.000 -
628.pop2_s (avg) 69.000 -
628.pop2_s (avg) (percentage) 0.650 -
628.pop2_s (max) 49.000 -
628.pop2_s (max) (percentage) 0.460 -
631.deepsjeng_s 15.000 7.14%
631.deepsjeng_s (avg) 15.000 7.14%
631.deepsjeng_s (avg) (percentage) 0.390 -
631.deepsjeng_s (max) 20.000 -4.76%
631.deepsjeng_s (max) (percentage) 0.520 -5.45%
638.imagick_s 12.000 -
638.imagick_s (avg) 12.000 -
638.imagick_s (avg) (percentage) 0.360 -
638.imagick_s (max) 7.000 -12.50%
638.imagick_s (max) (percentage) 0.230 -
641.leela_s 18.000 -18.18%
641.leela_s (avg) 18.000 -18.18%
641.leela_s (avg) (percentage) 0.390 -17.02%
641.leela_s (max) 29.000 -17.14%
641.leela_s (max) (percentage) 0.600 -18.92%
641.leela_s (unexplained diff vs previous) 6.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.120 -
644.nab_s 88.000 -
644.nab_s (avg) 88.000 -
644.nab_s (avg) (percentage) 0.860 -
644.nab_s (max) 101.000 -5.61%
644.nab_s (max) (percentage) 0.980 -5.77%
648.exchange2_s 16.000 -
648.exchange2_s (avg) 16.000 -
648.exchange2_s (avg) (percentage) 0.740 -
648.exchange2_s (max) 27.000 -3.57%
648.exchange2_s (max) (percentage) 1.240 -4.62%
649.fotonik3d_s 70.000 -
649.fotonik3d_s (avg) 70.000 -
649.fotonik3d_s (avg) (percentage) 0.720 -
649.fotonik3d_s (max) 58.000 -10.77%
649.fotonik3d_s (max) (percentage) 0.600 -10.45%
654.roms_s 134.000 -
654.roms_s (avg) 134.000 -
654.roms_s (avg) (percentage) 0.490 -
654.roms_s (max) 159.000 -3.05%
654.roms_s (max) (percentage) 0.580 -3.33%
657.xz_s 11.000 -
657.xz_s (avg) 11.000 -
657.xz_s (avg) (percentage) 0.520 -
657.xz_s (max) 6.000 -14.29%
657.xz_s (max) (percentage) 0.300 -9.09%
Geometric Mean 7.871 -1.88%