Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=26cc2053e2e8a5392a08b21fc62a2cffd900f13f (+ 123 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f5c82bff5ef2930583eccc008cf73653720987b5 (+ 367 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=547de57e5a54d3a02733523b75f261e95fc71579 (+ 49 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=07d8dc519618fc2d3ec8c0677aeb7a366ff40fa8 (+ 494 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/40/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0040 (4-changed-components) 2023-05-28T21:02:01 0:00:00
Previous 0038 (basepoints/gcc-14-01146-g658938f3a17) 2023-05-23T15:30:56 0:00:00
Baseline 0001 (4-changed-components) 2023-03-02T21:02:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 17 4
Performance Improvements 48 10
Added Tests 0 112
Unchanged Tests 877 816
Total Tests 942

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.73% 9822.000 9992.000 - -0.83% -
648.exchange2_s 1.73% 1390.000 1414.000 - 1.58% -
631.deepsjeng_s 1.36% 3911.000 3964.000 - -0.15% -
511.povray_r 1.26% 398.000 403.000 - -2.66% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s (unexplained diff vs previous) 118.18% 11.000 24.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) 115.19% 0.790 1.700 - 0.00% -
648.exchange2_s (max) 20.00% 20.000 24.000 - 0.00% -
648.exchange2_s (max) (percentage) 18.49% 1.460 1.730 - 0.00% -
648.exchange2_s 7.69% 13.000 14.000 - 0.00% -
648.exchange2_s (avg) 7.69% 13.000 14.000 - 0.00% -
648.exchange2_s (avg) (percentage) 7.29% 0.960 1.030 - 0.00% -
641.leela_s 5.56% 18.000 19.000 - 0.00% -
641.leela_s (avg) 5.56% 18.000 19.000 - 0.00% -
631.deepsjeng_s 5.00% 20.000 21.000 - 0.00% -
631.deepsjeng_s (avg) 5.00% 20.000 21.000 - 0.00% -
649.fotonik3d_s 1.45% 69.000 70.000 - 0.00% -
649.fotonik3d_s (avg) 1.45% 69.000 70.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
654.roms_s -10.89% 26186.000 23335.000 - -3.62% -
623.xalancbmk_s -1.28% 3894.000 3844.000 - 2.62% -
526.blender_r -1.07% 9997.000 9890.000 - 0.23% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) -99.88% 4121.000 5.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -99.86% 14.410 0.020 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) -73.81% 126.000 33.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -73.62% 3.070 0.810 - 0.00% -
619.lbm_s (max) (percentage) -16.68% 12.590 10.490 - 0.00% -
619.lbm_s (max) -16.67% 3600.000 3000.000 - 0.00% -
654.roms_s (max) -14.28% 1723.000 1477.000 - 0.00% -
654.roms_s -10.90% 1293.000 1152.000 - 0.00% -
654.roms_s (avg) -10.90% 1293.000 1152.000 - 0.00% -
619.lbm_s -7.67% 1759.000 1624.000 - 0.00% -
619.lbm_s (avg) -7.67% 1759.000 1624.000 - 0.00% -
619.lbm_s (avg) (percentage) -7.64% 6.150 5.680 - 0.00% -
620.omnetpp_s (max) -7.38% 122.000 113.000 - 0.00% -
641.leela_s (max) -6.98% 43.000 40.000 - 0.00% -
641.leela_s (max) (percentage) -6.60% 1.060 0.990 - 0.00% -
620.omnetpp_s (max) (percentage) -6.38% 2.980 2.790 - 0.00% -
603.bwaves_s (max) -6.36% 330.000 309.000 - 0.00% -
620.omnetpp_s -6.32% 95.000 89.000 - 0.00% -
620.omnetpp_s (avg) -6.32% 95.000 89.000 - 0.00% -
510.parest_r (max) (percentage) -6.30% 1.270 1.190 - 0.00% -
649.fotonik3d_s (max) (percentage) -6.25% 1.120 1.050 - 0.00% -
510.parest_r (max) -5.88% 68.000 64.000 - 0.00% -
603.bwaves_s (max) (percentage) -5.75% 3.650 3.440 - 0.00% -
620.omnetpp_s (avg) (percentage) -5.58% 2.330 2.200 - 0.00% -
625.x264_s (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
649.fotonik3d_s (max) -5.45% 110.000 104.000 - 0.00% -
605.mcf_s (max) (percentage) -5.36% 1.120 1.060 - 0.00% -
605.mcf_s (max) -5.33% 75.000 71.000 - 0.00% -
607.cactuBSSN_s (max) -4.95% 101.000 96.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -4.83% 2.070 1.970 - 0.00% -
631.deepsjeng_s (max) (percentage) -4.58% 1.310 1.250 - 0.00% -
657.xz_s (max) -4.55% 44.000 42.000 - 0.00% -
657.xz_s (max) (percentage) -4.48% 2.010 1.920 - 0.00% -
628.pop2_s (max) -4.35% 69.000 66.000 - 0.00% -
628.pop2_s (max) (percentage) -4.29% 0.700 0.670 - 0.00% -
631.deepsjeng_s (max) -3.92% 51.000 49.000 - 0.00% -
654.roms_s (max) (percentage) -3.80% 6.580 6.330 - 0.00% -
644.nab_s (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
644.nab_s (max) -3.51% 57.000 55.000 - 0.00% -
508.namd_r (max) -3.45% 29.000 28.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
508.namd_r (max) (percentage) -3.23% 1.240 1.200 - 0.00% -
600.perlbench_s (max) (percentage) -2.89% 1.730 1.680 - 0.00% -
600.perlbench_s (max) -2.78% 36.000 35.000 - 0.00% -
526.blender_r (max) -1.47% 68.000 67.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
623.xalancbmk_s 2.62% 3746.000 3844.000 - -1.28% -
644.nab_s 1.82% 10118.000 10302.000 - 0.16% -
648.exchange2_s 1.58% 1392.000 1414.000 - 1.73% -
605.mcf_s 1.31% 6626.000 6713.000 - -0.19% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -19.16% 21250.000 17178.000 - 0.00% -
620.omnetpp_s -1.68% 2248766.000 2210921.000 - -0.04% -
508.namd_r -1.30% 738062.000 728456.000 - -0.51% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -7.81% 31031.000 28607.000 - 0.02% -
625.x264_s -5.83% 1629.000 1534.000 - 0.59% -
657.xz_s -3.62% 2290.000 2207.000 - 0.59% -
654.roms_s -3.62% 24211.000 23335.000 - -10.89% -
511.povray_r -2.66% 414.000 403.000 - 1.26% -
620.omnetpp_s -1.71% 4146.000 4075.000 - -0.80% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s

Added Tests - Execution
600.perlbench_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.36s
Name Current %
508.namd_r 2406.000 -
510.parest_r 5448.000 -
511.povray_r 403.000 1.26%
526.blender_r 9890.000 -1.07%
600.perlbench_s 2096.000 -
602.gcc_s 4240.000 -
603.bwaves_s 8996.000 -
605.mcf_s 6713.000 -
607.cactuBSSN_s 4915.000 -
619.lbm_s 28607.000 -
620.omnetpp_s 4075.000 -
621.wrf_s 6534.000 -
623.xalancbmk_s 3844.000 -1.28%
625.x264_s 1534.000 -
628.pop2_s 9996.000 -
631.deepsjeng_s 3964.000 1.36%
638.imagick_s 3339.000 -
641.leela_s 4131.000 -
644.nab_s 10302.000 -
648.exchange2_s 1414.000 1.73%
649.fotonik3d_s 9992.000 1.73%
654.roms_s 23335.000 -10.89%
657.xz_s 2207.000 -
Geometric Mean 4674.605 -
Name Current %
508.namd_r 728456.000 -
510.parest_r 8571000.000 -
511.povray_r 997665.000 -
526.blender_r 11105825.000 -
600.perlbench_s 2405873.000 -
602.gcc_s 10010811.000 -
603.bwaves_s 53815.000 -
605.mcf_s 28773.000 -
607.cactuBSSN_s 4210448.000 -
619.lbm_s 17178.000 -
620.omnetpp_s 2210921.000 -
621.wrf_s 20237070.000 -
623.xalancbmk_s 5494992.000 -
625.x264_s 624737.000 -
628.pop2_s 26196273.000 -
631.deepsjeng_s 95750.000 -
638.imagick_s 2207392.000 -
641.leela_s 203364.000 -
644.nab_s 217439.000 -
648.exchange2_s 177614.000 -
649.fotonik3d_s 357119.000 -
654.roms_s 1081944.000 -
657.xz_s 206375.000 -
Geometric Mean 904491.946 -
Name Current %
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.740 -
508.namd_r (max) 28.000 -3.45%
508.namd_r (max) (percentage) 1.200 -3.23%
510.parest_r 47.000 -
510.parest_r (avg) 47.000 -
510.parest_r (avg) (percentage) 0.870 -
510.parest_r (max) 64.000 -5.88%
510.parest_r (max) (percentage) 1.190 -6.30%
511.povray_r 2.000 -
511.povray_r (avg) 2.000 -
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 2.000 -
511.povray_r (max) (percentage) 0.620 -
526.blender_r 55.000 -
526.blender_r (avg) 55.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 67.000 -1.47%
526.blender_r (max) (percentage) 0.680 -
600.perlbench_s 21.000 -
600.perlbench_s (avg) 21.000 -
600.perlbench_s (avg) (percentage) 1.030 -
600.perlbench_s (max) 35.000 -2.78%
600.perlbench_s (max) (percentage) 1.680 -2.89%
603.bwaves_s 193.000 -
603.bwaves_s (avg) 193.000 -
603.bwaves_s (avg) (percentage) 2.150 -
603.bwaves_s (max) 309.000 -6.36%
603.bwaves_s (max) (percentage) 3.440 -5.75%
605.mcf_s 91.000 -
605.mcf_s (avg) 91.000 -
605.mcf_s (avg) (percentage) 1.360 -
605.mcf_s (max) 71.000 -5.33%
605.mcf_s (max) (percentage) 1.060 -5.36%
607.cactuBSSN_s 86.000 -
607.cactuBSSN_s (avg) 86.000 -
607.cactuBSSN_s (avg) (percentage) 1.760 -
607.cactuBSSN_s (max) 96.000 -4.95%
607.cactuBSSN_s (max) (percentage) 1.970 -4.83%
619.lbm_s 1624.000 -7.67%
619.lbm_s (avg) 1624.000 -7.67%
619.lbm_s (avg) (percentage) 5.680 -7.64%
619.lbm_s (max) 3000.000 -16.67%
619.lbm_s (max) (percentage) 10.490 -16.68%
619.lbm_s (unexplained diff vs previous) 5.000 -99.88%
619.lbm_s (unexplained diff vs previous) (percentage) 0.020 -99.86%
620.omnetpp_s 89.000 -6.32%
620.omnetpp_s (avg) 89.000 -6.32%
620.omnetpp_s (avg) (percentage) 2.200 -5.58%
620.omnetpp_s (max) 113.000 -7.38%
620.omnetpp_s (max) (percentage) 2.790 -6.38%
620.omnetpp_s (unexplained diff vs previous) 33.000 -73.81%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.810 -73.62%
621.wrf_s 476.000 -
621.wrf_s (avg) 476.000 -
621.wrf_s (avg) (percentage) 7.290 -
621.wrf_s (max) 325.000 -
621.wrf_s (max) (percentage) 4.980 -
623.xalancbmk_s 28.000 -
623.xalancbmk_s (avg) 28.000 -
623.xalancbmk_s (avg) (percentage) 0.730 -
623.xalancbmk_s (max) 11.000 -
623.xalancbmk_s (max) (percentage) 0.290 -3.33%
625.x264_s 13.000 -
625.x264_s (avg) 13.000 -
625.x264_s (avg) (percentage) 0.870 -
625.x264_s (max) 5.000 -
625.x264_s (max) (percentage) 0.340 -5.56%
628.pop2_s 95.000 -
628.pop2_s (avg) 95.000 -
628.pop2_s (avg) (percentage) 0.960 -
628.pop2_s (max) 66.000 -4.35%
628.pop2_s (max) (percentage) 0.670 -4.29%
631.deepsjeng_s 21.000 5.00%
631.deepsjeng_s (avg) 21.000 5.00%
631.deepsjeng_s (avg) (percentage) 0.530 -
631.deepsjeng_s (max) 49.000 -3.92%
631.deepsjeng_s (max) (percentage) 1.250 -4.58%
638.imagick_s 28.000 -
638.imagick_s (avg) 28.000 -
638.imagick_s (avg) (percentage) 0.860 -
638.imagick_s (max) 4.000 -
638.imagick_s (max) (percentage) 0.140 -
641.leela_s 19.000 5.56%
641.leela_s (avg) 19.000 5.56%
641.leela_s (avg) (percentage) 0.460 -
641.leela_s (max) 40.000 -6.98%
641.leela_s (max) (percentage) 0.990 -6.60%
644.nab_s 58.000 -
644.nab_s (avg) 58.000 -
644.nab_s (avg) (percentage) 0.570 -
644.nab_s (max) 55.000 -3.51%
644.nab_s (max) (percentage) 0.540 -3.57%
648.exchange2_s 14.000 7.69%
648.exchange2_s (avg) 14.000 7.69%
648.exchange2_s (avg) (percentage) 1.030 7.29%
648.exchange2_s (max) 24.000 20.00%
648.exchange2_s (max) (percentage) 1.730 18.49%
648.exchange2_s (unexplained diff vs previous) 24.000 118.18%
648.exchange2_s (unexplained diff vs previous) (percentage) 1.700 115.19%
649.fotonik3d_s 70.000 1.45%
649.fotonik3d_s (avg) 70.000 1.45%
649.fotonik3d_s (avg) (percentage) 0.710 -
649.fotonik3d_s (max) 104.000 -5.45%
649.fotonik3d_s (max) (percentage) 1.050 -6.25%
654.roms_s 1152.000 -10.90%
654.roms_s (avg) 1152.000 -10.90%
654.roms_s (avg) (percentage) 4.940 -
654.roms_s (max) 1477.000 -14.28%
654.roms_s (max) (percentage) 6.330 -3.80%
657.xz_s 34.000 -
657.xz_s (avg) 34.000 -
657.xz_s (avg) (percentage) 1.570 -
657.xz_s (max) 42.000 -4.55%
657.xz_s (max) (percentage) 1.920 -4.48%
Geometric Mean 11.020 -13.09%