Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=cb2775070260eae210df62ab57df95927a89536e (+ 1005 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f197392a16ffb1327f1d12ff8ff05f9295e015cb (+ 2001 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=bb5bbc20702981c287aa3e44640e7d2f2b9a28cf (+ 260 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=457f8bbe192a733ca17e640bd22dc9383525300d (+ 35076 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2-build/68/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0068 (4-changed-components) 2023-07-30T04:11:11 0:00:00
Previous 0029 (4-changed-components) 2023-06-10T07:33:00 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T18:17:00 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 3
Performance Improvements 49 10
Added Tests 0 107
Unchanged Tests 830 774
Total Tests 894

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.48% 623864.000 633088.000 - 0.91% -
510.parest_r 1.07% 7606349.000 7687412.000 - 0.84% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
625.x264_s 12.48% 2300.000 2587.000 - 0.00% -
603.bwaves_s 1.44% 8997.000 9127.000 - 2.37% -
623.xalancbmk_s 1.42% 3736.000 3789.000 - -0.39% -
644.nab_s 1.28% 10373.000 10506.000 - 0.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
625.x264_s 14.29% 14.000 16.000 - 0.00% -
625.x264_s (avg) 14.29% 14.000 16.000 - 0.00% -
625.x264_s (max) 10.53% 19.000 21.000 - 0.00% -
623.xalancbmk_s 7.69% 13.000 14.000 - 0.00% -
623.xalancbmk_s (avg) 7.69% 13.000 14.000 - 0.00% -
508.namd_r (avg) (percentage) 2.63% 0.380 0.390 - 0.00% -
603.bwaves_s 2.02% 99.000 101.000 - 0.00% -
603.bwaves_s (avg) 2.02% 99.000 101.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -4.17% 24.000 23.000 - 4.55% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -1.29% 4491911.000 4434055.000 - -1.38% -
607.cactuBSSN_s -1.26% 3229907.000 3189351.000 - -1.08% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
607.cactuBSSN_s -1.98% 4801.000 4706.000 - -0.88% -
621.wrf_s -1.97% 9324.000 9140.000 - 0.23% -
641.leela_s -1.55% 4843.000 4768.000 - -2.81% -
600.perlbench_s -1.19% 2100.000 2075.000 - 0.83% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -46.34% 41.000 22.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -45.45% 0.990 0.540 - 0.00% -
620.omnetpp_s (max) -25.00% 40.000 30.000 - 0.00% -
620.omnetpp_s (max) (percentage) -24.49% 0.980 0.740 - 0.00% -
605.mcf_s (max) -8.93% 56.000 51.000 - 0.00% -
605.mcf_s (max) (percentage) -8.43% 0.830 0.760 - 0.00% -
600.perlbench_s (max) -8.33% 12.000 11.000 - 0.00% -
619.lbm_s (max) -7.72% 2098.000 1936.000 - 0.00% -
619.lbm_s (max) (percentage) -7.43% 7.400 6.850 - 0.00% -
644.nab_s (max) (percentage) -6.85% 0.730 0.680 - 0.00% -
648.exchange2_s (max) (percentage) -6.78% 1.180 1.100 - 0.00% -
508.namd_r (max) -6.67% 15.000 14.000 - 0.00% -
603.bwaves_s (max) (percentage) -5.63% 0.710 0.670 - 0.00% -
644.nab_s (max) -5.33% 75.000 71.000 - 0.00% -
641.leela_s (max) -4.55% 22.000 21.000 - 0.00% -
641.leela_s (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
607.cactuBSSN_s (max) -4.00% 75.000 72.000 - 0.00% -
648.exchange2_s (max) -4.00% 25.000 24.000 - 0.00% -
657.xz_s (max) -4.00% 25.000 24.000 - 0.00% -
625.x264_s (max) (percentage) -3.49% 0.860 0.830 - 0.00% -
600.perlbench_s (max) (percentage) -3.45% 0.580 0.560 - 0.00% -
620.omnetpp_s -3.33% 30.000 29.000 - 0.00% -
620.omnetpp_s (avg) -3.33% 30.000 29.000 - 0.00% -
603.bwaves_s (max) -3.17% 63.000 61.000 - 0.00% -
508.namd_r (max) (percentage) -3.13% 0.640 0.620 - 0.00% -
638.imagick_s (max) -2.94% 34.000 33.000 - 0.00% -
654.roms_s (max) -2.93% 239.000 232.000 - 0.00% -
526.blender_r (max) -2.92% 137.000 133.000 - 0.00% -
511.povray_r (max) (percentage) -2.88% 1.040 1.010 - 0.00% -
620.omnetpp_s (avg) (percentage) -2.70% 0.740 0.720 - 0.00% -
657.xz_s (max) (percentage) -2.63% 1.140 1.110 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.55% 1.570 1.530 - 0.00% -
654.roms_s (max) (percentage) -2.30% 0.870 0.850 - 0.00% -
631.deepsjeng_s (max) (percentage) -2.27% 0.440 0.430 - 0.00% -
526.blender_r (max) (percentage) -2.21% 1.360 1.330 - 0.00% -
510.parest_r (max) (percentage) -2.00% 1.000 0.980 - 0.00% -
638.imagick_s (max) (percentage) -1.94% 1.030 1.010 - 0.00% -
628.pop2_s (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
607.cactuBSSN_s -1.89% 53.000 52.000 - 0.00% -
607.cactuBSSN_s (avg) -1.89% 53.000 52.000 - 0.00% -
510.parest_r (max) -1.79% 56.000 55.000 - 0.00% -
628.pop2_s (max) -1.79% 56.000 55.000 - 0.00% -
649.fotonik3d_s (max) -1.10% 91.000 90.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
641.leela_s 1.34% 147936.000 149911.000 - 0.67% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s 2.37% 8916.000 9127.000 - 1.44% -
510.parest_r 1.24% 5637.000 5707.000 - 0.28% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -2.05% 851500.000 834060.000 - -0.90% -
623.xalancbmk_s -1.38% 4496134.000 4434055.000 - -1.29% -
607.cactuBSSN_s -1.08% 3224093.000 3189351.000 - -1.26% -
620.omnetpp_s -1.04% 2027591.000 2006568.000 - -0.03% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
641.leela_s -2.81% 4906.000 4768.000 - -1.55% -
511.povray_r -1.88% 425.000 417.000 - -0.95% -
620.omnetpp_s -1.37% 4163.000 4106.000 - -0.53% -
508.namd_r -1.24% 2427.000 2397.000 - -0.04% -
605.mcf_s -1.20% 6892.000 6809.000 - 0.34% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - -4.17% -

Added Tests - Code Size
625.x264_s

Added Tests - Execution
625.x264_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2397.000 -
510.parest_r 5707.000 -
511.povray_r 417.000 -
526.blender_r 10048.000 -
600.perlbench_s 2075.000 -1.19%
602.gcc_s 4268.000 -
603.bwaves_s 9127.000 1.44%
605.mcf_s 6809.000 -
607.cactuBSSN_s 4706.000 -1.98%
619.lbm_s 28273.000 -
620.omnetpp_s 4106.000 -
621.wrf_s 9140.000 -1.97%
623.xalancbmk_s 3789.000 1.42%
625.x264_s 2587.000 12.48%
628.pop2_s 10660.000 -
631.deepsjeng_s 3841.000 -
638.imagick_s 3333.000 -
641.leela_s 4768.000 -1.55%
644.nab_s 10506.000 1.28%
648.exchange2_s 2206.000 -
649.fotonik3d_s 9767.000 -
654.roms_s 27367.000 -
657.xz_s 2227.000 -
Geometric Mean 5032.879 -
Name Current %
508.namd_r 633088.000 1.48%
510.parest_r 7687412.000 1.07%
511.povray_r 834060.000 -
526.blender_r 9735618.000 -
600.perlbench_s 2108377.000 -
602.gcc_s 9059031.000 -
603.bwaves_s 49071.000 -
605.mcf_s 20953.000 -
607.cactuBSSN_s 3189351.000 -1.26%
619.lbm_s 16086.000 -
620.omnetpp_s 2006568.000 -
621.wrf_s 17018174.000 -
623.xalancbmk_s 4434055.000 -1.29%
625.x264_s 439614.000 -
628.pop2_s 25417041.000 -
631.deepsjeng_s 80974.000 -
638.imagick_s 1851424.000 -
641.leela_s 149911.000 -
644.nab_s 174487.000 -
648.exchange2_s 60150.000 -
649.fotonik3d_s 310127.000 -
654.roms_s 679560.000 -
657.xz_s 191155.000 -
Geometric Mean 726342.809 -
Name Current %
nb_compile_successful 24.000 -
nb_execution_successful 23.000 -4.17%
nb_total_tests 24.000 -
Geometric Mean 23.662 -1.41%
Name Current %
508.namd_r 9.000 -
508.namd_r (avg) 9.000 -
508.namd_r (avg) (percentage) 0.390 2.63%
508.namd_r (max) 14.000 -6.67%
508.namd_r (max) (percentage) 0.620 -3.13%
510.parest_r 38.000 -
510.parest_r (avg) 38.000 -
510.parest_r (avg) (percentage) 0.670 -
510.parest_r (max) 55.000 -1.79%
510.parest_r (max) (percentage) 0.980 -2.00%
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.560 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.010 -2.88%
526.blender_r 119.000 -
526.blender_r (avg) 119.000 -
526.blender_r (avg) (percentage) 1.190 -
526.blender_r (max) 133.000 -2.92%
526.blender_r (max) (percentage) 1.330 -2.21%
600.perlbench_s 9.000 -
600.perlbench_s (avg) 9.000 -
600.perlbench_s (avg) (percentage) 0.440 -
600.perlbench_s (max) 11.000 -8.33%
600.perlbench_s (max) (percentage) 0.560 -3.45%
603.bwaves_s 101.000 2.02%
603.bwaves_s (avg) 101.000 2.02%
603.bwaves_s (avg) (percentage) 1.110 -
603.bwaves_s (max) 61.000 -3.17%
603.bwaves_s (max) (percentage) 0.670 -5.63%
605.mcf_s 37.000 -
605.mcf_s (avg) 37.000 -
605.mcf_s (avg) (percentage) 0.550 -
605.mcf_s (max) 51.000 -8.93%
605.mcf_s (max) (percentage) 0.760 -8.43%
607.cactuBSSN_s 52.000 -1.89%
607.cactuBSSN_s (avg) 52.000 -1.89%
607.cactuBSSN_s (avg) (percentage) 1.110 -
607.cactuBSSN_s (max) 72.000 -4.00%
607.cactuBSSN_s (max) (percentage) 1.530 -2.55%
619.lbm_s 1416.000 -
619.lbm_s (avg) 1416.000 -
619.lbm_s (avg) (percentage) 5.010 -
619.lbm_s (max) 1936.000 -7.72%
619.lbm_s (max) (percentage) 6.850 -7.43%
620.omnetpp_s 29.000 -3.33%
620.omnetpp_s (avg) 29.000 -3.33%
620.omnetpp_s (avg) (percentage) 0.720 -2.70%
620.omnetpp_s (max) 30.000 -25.00%
620.omnetpp_s (max) (percentage) 0.740 -24.49%
620.omnetpp_s (unexplained diff vs previous) 22.000 -46.34%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.540 -45.45%
623.xalancbmk_s 14.000 7.69%
623.xalancbmk_s (avg) 14.000 7.69%
623.xalancbmk_s (avg) (percentage) 0.370 -
623.xalancbmk_s (max) 15.000 -
623.xalancbmk_s (max) (percentage) 0.400 -
625.x264_s 16.000 14.29%
625.x264_s (avg) 16.000 14.29%
625.x264_s (avg) (percentage) 0.650 -
625.x264_s (max) 21.000 10.53%
625.x264_s (max) (percentage) 0.830 -3.49%
628.pop2_s 43.000 -
628.pop2_s (avg) 43.000 -
628.pop2_s (avg) (percentage) 0.410 -
628.pop2_s (max) 55.000 -1.79%
628.pop2_s (max) (percentage) 0.520 -1.89%
631.deepsjeng_s 10.000 -
631.deepsjeng_s (avg) 10.000 -
631.deepsjeng_s (avg) (percentage) 0.270 -
631.deepsjeng_s (max) 16.000 -
631.deepsjeng_s (max) (percentage) 0.430 -2.27%
638.imagick_s 11.000 -
638.imagick_s (avg) 11.000 -
638.imagick_s (avg) (percentage) 0.340 -
638.imagick_s (max) 33.000 -2.94%
638.imagick_s (max) (percentage) 1.010 -1.94%
641.leela_s 17.000 -
641.leela_s (avg) 17.000 -
641.leela_s (avg) (percentage) 0.370 -
641.leela_s (max) 21.000 -4.55%
641.leela_s (max) (percentage) 0.450 -4.26%
644.nab_s 60.000 -
644.nab_s (avg) 60.000 -
644.nab_s (avg) (percentage) 0.580 -
644.nab_s (max) 71.000 -5.33%
644.nab_s (max) (percentage) 0.680 -6.85%
648.exchange2_s 13.000 -
648.exchange2_s (avg) 13.000 -
648.exchange2_s (avg) (percentage) 0.630 -
648.exchange2_s (max) 24.000 -4.00%
648.exchange2_s (max) (percentage) 1.100 -6.78%
649.fotonik3d_s 80.000 -
649.fotonik3d_s (avg) 80.000 -
649.fotonik3d_s (avg) (percentage) 0.820 -
649.fotonik3d_s (max) 90.000 -1.10%
649.fotonik3d_s (max) (percentage) 0.930 -
654.roms_s 169.000 -
654.roms_s (avg) 169.000 -
654.roms_s (avg) (percentage) 0.620 -
654.roms_s (max) 232.000 -2.93%
654.roms_s (max) (percentage) 0.850 -2.30%
657.xz_s 12.000 -
657.xz_s (avg) 12.000 -
657.xz_s (avg) (percentage) 0.580 -
657.xz_s (max) 24.000 -4.00%
657.xz_s (max) (percentage) 1.110 -2.63%
Geometric Mean 7.201 -2.63%