Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5cabc8098e65ac22d4245232ad20b19fa4729802 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (e22d80d4f0f8d33f538c1a4bad07b2c819a6d55c) (+ 215 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=7b544224f82d20019f9b28522ebf8114a372d1a2 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9f92676c8009d4e6f664b9b33c243f10a72d33c0 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3-build/287/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0287 (basepoints/gcc-15-05083-ge22d80d4f0f) 2024-11-07T16:17:01 0:00:00
Previous 0286 (3-changed-components) 2024-11-03T20:11:39 0:00:00
Baseline 0001 (4-changed-components) 2023-03-02T21:02:50 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 30 14
Performance Improvements 45 20
Added Tests 0 113
Unchanged Tests 879 807
Total Tests 954

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 2.97% 741628.000 763636.000 - 3.47% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s 2.08% 4047.000 4131.000 - -0.36% -
627.cam4_s 1.61% 124.000 126.000 - 0.00% -
607.cactuBSSN_s 1.32% 4855.000 4919.000 - 0.55% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s (unexplained diff vs previous) (percentage) 1450.00% 0.020 0.310 - 0.00% -
649.fotonik3d_s (unexplained diff vs previous) 1400.00% 2.000 30.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 546.15% 13.000 84.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 534.37% 0.320 2.030 - 0.00% -
641.leela_s (unexplained diff vs previous) (percentage) 330.00% 0.100 0.430 - 0.00% -
641.leela_s (unexplained diff vs previous) 325.00% 4.000 17.000 - 0.00% -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 320.00% 0.050 0.210 - 0.00% -
605.mcf_s (max) (percentage) 314.29% 0.140 0.580 - 0.00% -
605.mcf_s (max) 311.11% 9.000 37.000 - 0.00% -
631.deepsjeng_s (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
620.omnetpp_s (max) 193.10% 29.000 85.000 - 0.00% -
620.omnetpp_s (max) (percentage) 181.08% 0.740 2.080 - 0.00% -
603.bwaves_s (unexplained diff vs previous) 90.62% 32.000 61.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) 88.89% 0.360 0.680 - 0.00% -
641.leela_s (max) 88.89% 9.000 17.000 - 0.00% -
641.leela_s (max) (percentage) 83.33% 0.240 0.440 - 0.00% -
644.nab_s (unexplained diff vs previous) 58.00% 50.000 79.000 - 0.00% -
644.nab_s (unexplained diff vs previous) (percentage) 57.14% 0.490 0.770 - 0.00% -
649.fotonik3d_s (max) (percentage) 47.62% 0.210 0.310 - 0.00% -
649.fotonik3d_s (max) 45.00% 20.000 29.000 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) 20.00% 0.350 0.420 - 0.00% -
648.exchange2_s (unexplained diff vs previous) 20.00% 5.000 6.000 - 0.00% -
620.omnetpp_s 1.96% 51.000 52.000 - 0.00% -
620.omnetpp_s (avg) 1.96% 51.000 52.000 - 0.00% -
607.cactuBSSN_s 1.33% 75.000 76.000 - 0.00% -
607.cactuBSSN_s (avg) 1.33% 75.000 76.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
621.wrf_s -4.29% 6646.000 6361.000 - -3.34% -
623.xalancbmk_s -3.53% 3877.000 3740.000 - -0.16% -
508.namd_r -1.48% 2427.000 2391.000 - -0.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s (unexplained diff vs previous) -90.89% 757.000 69.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -90.73% 2.590 0.240 - 0.00% -
654.roms_s (unexplained diff vs previous) (percentage) -70.77% 0.650 0.190 - 0.00% -
654.roms_s (unexplained diff vs previous) -70.59% 153.000 45.000 - 0.00% -
511.povray_r (max) -25.00% 4.000 3.000 - 0.00% -
619.lbm_s (max) (percentage) -16.67% 2.520 2.100 - 0.00% -
619.lbm_s (max) -16.44% 736.000 615.000 - 0.00% -
638.imagick_s (max) -11.11% 9.000 8.000 - 0.00% -
631.deepsjeng_s (max) -8.33% 12.000 11.000 - 0.00% -
644.nab_s (max) -7.32% 123.000 114.000 - 0.00% -
644.nab_s (max) (percentage) -6.67% 1.200 1.120 - 0.00% -
657.xz_s (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
603.bwaves_s (max) (percentage) -5.77% 1.040 0.980 - 0.00% -
511.povray_r (max) (percentage) -4.59% 1.090 1.040 - 0.00% -
621.wrf_s (max) -4.36% 321.000 307.000 - 0.00% -
603.bwaves_s (max) -4.35% 92.000 88.000 - 0.00% -
621.wrf_s -4.34% 484.000 463.000 - 0.00% -
621.wrf_s (avg) -4.34% 484.000 463.000 - 0.00% -
623.xalancbmk_s -4.00% 25.000 24.000 - 0.00% -
623.xalancbmk_s (avg) -4.00% 25.000 24.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
654.roms_s (max) -3.09% 162.000 157.000 - 0.00% -
510.parest_r (max) (percentage) -3.03% 0.660 0.640 - 0.00% -
654.roms_s (max) (percentage) -2.90% 0.690 0.670 - 0.00% -
510.parest_r (max) -2.78% 36.000 35.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.27% 2.200 2.150 - 0.00% -
631.deepsjeng_s (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
625.x264_s (max) (percentage) -2.20% 0.910 0.890 - 0.00% -
654.roms_s (avg) (percentage) -2.12% 1.890 1.850 - 0.00% -
526.blender_r (max) -2.06% 97.000 95.000 - 0.00% -
654.roms_s -1.80% 444.000 436.000 - 0.00% -
654.roms_s (avg) -1.80% 444.000 436.000 - 0.00% -
619.lbm_s (avg) (percentage) -1.67% 1.800 1.770 - 0.00% -
619.lbm_s -1.52% 526.000 518.000 - 0.00% -
619.lbm_s (avg) -1.52% 526.000 518.000 - 0.00% -
649.fotonik3d_s -1.45% 69.000 68.000 - 0.00% -
649.fotonik3d_s (avg) -1.45% 69.000 68.000 - 0.00% -
644.nab_s -1.43% 70.000 69.000 - 0.00% -
644.nab_s (avg) -1.43% 70.000 69.000 - 0.00% -
649.fotonik3d_s (avg) (percentage) -1.39% 0.720 0.710 - 0.00% -
526.blender_r (max) (percentage) -1.02% 0.980 0.970 - 0.00% -
605.mcf_s (avg) (percentage) -1.02% 0.980 0.970 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 7.22% 177422.000 190224.000 - 0.00% -
621.wrf_s 6.39% 20302811.000 21599372.000 - 0.15% -
607.cactuBSSN_s 4.75% 4214065.000 4414323.000 - -0.00% -
510.parest_r 4.21% 8624037.000 8987510.000 - -0.02% -
508.namd_r 3.47% 738062.000 763636.000 - 2.97% -
511.povray_r 3.32% 1004857.000 1038186.000 - -0.01% -
638.imagick_s 2.96% 2221404.000 2287158.000 - 0.08% -
623.xalancbmk_s 2.76% 5501002.000 5652739.000 - 0.07% -
657.xz_s 2.33% 205531.000 210311.000 - 0.01% -
602.gcc_s 1.27% 10008387.000 10135967.000 - -0.16% -
526.blender_r 1.11% 11124884.000 11248133.000 - 0.06% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 2.95% 1392.000 1433.000 - 0.42% -
510.parest_r 1.37% 5400.000 5474.000 - -0.18% -
644.nab_s 1.09% 10118.000 10228.000 - -0.77% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
603.bwaves_s -4.08% 53831.000 51635.000 - 0.00% -
649.fotonik3d_s -3.63% 353975.000 341134.000 - 0.00% -
625.x264_s -3.18% 626778.000 606845.000 - 0.00% -
641.leela_s -3.03% 204135.000 197940.000 - 0.00% -
620.omnetpp_s -1.51% 2248766.000 2214761.000 - 0.02% -
631.deepsjeng_s -1.11% 95946.000 94882.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -13.57% 1629.000 1408.000 - -0.28% -
511.povray_r -7.49% 414.000 383.000 - 0.00% -
638.imagick_s -6.50% 3367.000 3148.000 - 0.06% -
619.lbm_s -5.60% 31031.000 29294.000 - 0.24% -
657.xz_s -5.02% 2290.000 2175.000 - -0.18% -
641.leela_s -4.79% 4110.000 3913.000 - 0.44% -
649.fotonik3d_s -4.24% 10076.000 9649.000 - -0.31% -
621.wrf_s -3.34% 6581.000 6361.000 - -4.29% -
631.deepsjeng_s -2.90% 3970.000 3855.000 - 0.21% -
654.roms_s -2.64% 24211.000 23571.000 - 0.19% -
628.pop2_s -1.56% 10047.000 9890.000 - -0.34% -
605.mcf_s -1.37% 6626.000 6535.000 - 0.58% -
602.gcc_s -1.07% 4202.000 4157.000 - 0.82% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s

Added Tests - Execution
600.perlbench_s
627.cam4_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2391.000 -1.48%
510.parest_r 5474.000 -
511.povray_r 383.000 -
526.blender_r 9871.000 -
600.perlbench_s 2024.000 -
602.gcc_s 4157.000 -
603.bwaves_s 8998.000 -
605.mcf_s 6535.000 -
607.cactuBSSN_s 4919.000 1.32%
619.lbm_s 29294.000 -
620.omnetpp_s 4131.000 2.08%
621.wrf_s 6361.000 -4.29%
623.xalancbmk_s 3740.000 -3.53%
625.x264_s 1408.000 -
627.cam4_s 126.000 1.61%
628.pop2_s 9890.000 -
631.deepsjeng_s 3855.000 -
638.imagick_s 3148.000 -
641.leela_s 3913.000 -
644.nab_s 10228.000 -
648.exchange2_s 1433.000 -
649.fotonik3d_s 9649.000 -
654.roms_s 23571.000 -
657.xz_s 2175.000 -
Geometric Mean 3951.023 -
Name Current %
508.namd_r 763636.000 2.97%
510.parest_r 8987510.000 -
511.povray_r 1038186.000 -
526.blender_r 11248133.000 -
600.perlbench_s 2479335.000 -
602.gcc_s 10135967.000 -
603.bwaves_s 51635.000 -
605.mcf_s 28673.000 -
607.cactuBSSN_s 4414323.000 -
619.lbm_s 21146.000 -
620.omnetpp_s 2214761.000 -
621.wrf_s 21599372.000 -
623.xalancbmk_s 5652739.000 -
625.x264_s 606845.000 -
628.pop2_s 26381714.000 -
631.deepsjeng_s 94882.000 -
638.imagick_s 2287158.000 -
641.leela_s 197940.000 -
644.nab_s 219387.000 -
648.exchange2_s 190224.000 -
649.fotonik3d_s 341134.000 -
654.roms_s 1084909.000 -
657.xz_s 210311.000 -
Geometric Mean 925408.416 -
Name Current %
508.namd_r 11.000 -
508.namd_r (avg) 11.000 -
508.namd_r (avg) (percentage) 0.470 -
508.namd_r (max) 9.000 -
508.namd_r (max) (percentage) 0.400 -
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.610 -
510.parest_r (max) 35.000 -2.78%
510.parest_r (max) (percentage) 0.640 -3.03%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.900 -
511.povray_r (max) 3.000 -25.00%
511.povray_r (max) (percentage) 1.040 -4.59%
526.blender_r 47.000 -
526.blender_r (avg) 47.000 -
526.blender_r (avg) (percentage) 0.480 -
526.blender_r (max) 95.000 -2.06%
526.blender_r (max) (percentage) 0.970 -1.02%
600.perlbench_s 17.000 -
600.perlbench_s (avg) 17.000 -
600.perlbench_s (avg) (percentage) 0.870 -
600.perlbench_s (max) 4.000 -
600.perlbench_s (max) (percentage) 0.240 -
603.bwaves_s 103.000 -
603.bwaves_s (avg) 103.000 -
603.bwaves_s (avg) (percentage) 1.150 -
603.bwaves_s (max) 88.000 -4.35%
603.bwaves_s (max) (percentage) 0.980 -5.77%
603.bwaves_s (unexplained diff vs previous) 61.000 90.62%
603.bwaves_s (unexplained diff vs previous) (percentage) 0.680 88.89%
605.mcf_s 63.000 -
605.mcf_s (avg) 63.000 -
605.mcf_s (avg) (percentage) 0.970 -1.02%
605.mcf_s (max) 37.000 311.11%
605.mcf_s (max) (percentage) 0.580 314.29%
605.mcf_s (unexplained diff vs previous) 38.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.580 -
607.cactuBSSN_s 76.000 1.33%
607.cactuBSSN_s (avg) 76.000 1.33%
607.cactuBSSN_s (avg) (percentage) 1.550 -
607.cactuBSSN_s (max) 105.000 -
607.cactuBSSN_s (max) (percentage) 2.150 -2.27%
619.lbm_s 518.000 -1.52%
619.lbm_s (avg) 518.000 -1.52%
619.lbm_s (avg) (percentage) 1.770 -1.67%
619.lbm_s (max) 615.000 -16.44%
619.lbm_s (max) (percentage) 2.100 -16.67%
619.lbm_s (unexplained diff vs previous) 69.000 -90.89%
619.lbm_s (unexplained diff vs previous) (percentage) 0.240 -90.73%
620.omnetpp_s 52.000 1.96%
620.omnetpp_s (avg) 52.000 1.96%
620.omnetpp_s (avg) (percentage) 1.280 -
620.omnetpp_s (max) 85.000 193.10%
620.omnetpp_s (max) (percentage) 2.080 181.08%
620.omnetpp_s (unexplained diff vs previous) 84.000 546.15%
620.omnetpp_s (unexplained diff vs previous) (percentage) 2.030 534.37%
621.wrf_s 463.000 -4.34%
621.wrf_s (avg) 463.000 -4.34%
621.wrf_s (avg) (percentage) 7.290 -
621.wrf_s (max) 307.000 -4.36%
621.wrf_s (max) (percentage) 4.840 -
623.xalancbmk_s 24.000 -4.00%
623.xalancbmk_s (avg) 24.000 -4.00%
623.xalancbmk_s (avg) (percentage) 0.660 -
623.xalancbmk_s (max) 13.000 -
623.xalancbmk_s (max) (percentage) 0.350 -
625.x264_s 6.000 -
625.x264_s (avg) 6.000 -
625.x264_s (avg) (percentage) 0.480 -
625.x264_s (max) 12.000 -
625.x264_s (max) (percentage) 0.890 -2.20%
628.pop2_s 72.000 -
628.pop2_s (avg) 72.000 -
628.pop2_s (avg) (percentage) 0.730 -
628.pop2_s (max) 44.000 -
628.pop2_s (max) (percentage) 0.450 -
631.deepsjeng_s 16.000 -
631.deepsjeng_s (avg) 16.000 -
631.deepsjeng_s (avg) (percentage) 0.430 -2.27%
631.deepsjeng_s (max) 11.000 -8.33%
631.deepsjeng_s (max) (percentage) 0.310 -3.13%
631.deepsjeng_s (unexplained diff vs previous) 8.000 300.00%
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.210 320.00%
638.imagick_s 12.000 -
638.imagick_s (avg) 12.000 -
638.imagick_s (avg) (percentage) 0.390 -
638.imagick_s (max) 8.000 -11.11%
638.imagick_s (max) (percentage) 0.280 -
641.leela_s 14.000 -
641.leela_s (avg) 14.000 -
641.leela_s (avg) (percentage) 0.360 -
641.leela_s (max) 17.000 88.89%
641.leela_s (max) (percentage) 0.440 83.33%
641.leela_s (unexplained diff vs previous) 17.000 325.00%
641.leela_s (unexplained diff vs previous) (percentage) 0.430 330.00%
644.nab_s 69.000 -1.43%
644.nab_s (avg) 69.000 -1.43%
644.nab_s (avg) (percentage) 0.680 -
644.nab_s (max) 114.000 -7.32%
644.nab_s (max) (percentage) 1.120 -6.67%
644.nab_s (unexplained diff vs previous) 79.000 58.00%
644.nab_s (unexplained diff vs previous) (percentage) 0.770 57.14%
648.exchange2_s 15.000 -
648.exchange2_s (avg) 15.000 -
648.exchange2_s (avg) (percentage) 1.080 -
648.exchange2_s (max) 8.000 -
648.exchange2_s (max) (percentage) 0.600 -
648.exchange2_s (unexplained diff vs previous) 6.000 20.00%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.420 20.00%
649.fotonik3d_s 68.000 -1.45%
649.fotonik3d_s (avg) 68.000 -1.45%
649.fotonik3d_s (avg) (percentage) 0.710 -1.39%
649.fotonik3d_s (max) 29.000 45.00%
649.fotonik3d_s (max) (percentage) 0.310 47.62%
649.fotonik3d_s (unexplained diff vs previous) 30.000 1400.00%
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.310 1450.00%
654.roms_s 436.000 -1.80%
654.roms_s (avg) 436.000 -1.80%
654.roms_s (avg) (percentage) 1.850 -2.12%
654.roms_s (max) 157.000 -3.09%
654.roms_s (max) (percentage) 0.670 -2.90%
654.roms_s (unexplained diff vs previous) 45.000 -70.59%
654.roms_s (unexplained diff vs previous) (percentage) 0.190 -70.77%
657.xz_s 13.000 -
657.xz_s (avg) 13.000 -
657.xz_s (avg) (percentage) 0.610 -
657.xz_s (max) 6.000 -
657.xz_s (max) (percentage) 0.290 -6.45%
Geometric Mean 6.868 32.71%