Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=eef4ff9b707d738322a5dca82a6a9b0aad76a26e (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/d7ee988c491cde43d04fe25f2b3dbad9d85ded45 (+ 570 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=b3bee76c5f59498b9c189608f0a3132e2013fa1a (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O2-build/138/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0138 (basepoints/gcc-14-06604-gd7ee988c491) 2023-12-11T23:59:10 0:00:00
Previous 0135 (basepoints/gcc-14-06034-g4ee2aca7ca0) 2023-12-08T03:58:21 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T12:51:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 15
Performance Improvements 59 7
Added Tests 0 104
Unchanged Tests 868 810
Total Tests 936

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.35% 671200.000 680228.000 - 8.41% -
511.povray_r 1.22% 841016.000 851252.000 - 0.42% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
554.roms_r 1.03% 17030.000 17205.000 - 0.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
554.roms_r 1.75% 57.000 58.000 - 0.00% -
554.roms_r (avg) 1.75% 57.000 58.000 - 0.00% -
500.perlbench_r 1.08% 93.000 94.000 - 0.00% -
500.perlbench_r (avg) 1.08% 93.000 94.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -4.55% 22.000 21.000 - -8.70% -
nb_execution_successful -4.55% 22.000 21.000 - -8.70% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
544.nab_r -2.09% 172987.000 169363.000 - 0.68% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
519.lbm_r -6.69% 16074.000 14998.000 - -0.05% -
521.wrf_r -2.72% 14986.000 14579.000 - 0.03% -
531.deepsjeng_r -1.52% 8615.000 8484.000 - 0.52% -
541.leela_r -1.32% 14817.000 14621.000 - -2.37% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -67.79% 208.000 67.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -67.79% 1.490 0.480 - 0.00% -
557.xz_r (max) -17.65% 34.000 28.000 - 0.00% -
557.xz_r (max) (percentage) -16.67% 0.300 0.250 - 0.00% -
520.omnetpp_r (max) (percentage) -16.45% 1.520 1.270 - 0.00% -
520.omnetpp_r (max) -16.11% 211.000 177.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -12.68% 0.710 0.620 - 0.00% -
507.cactuBSSN_r (max) -12.50% 88.000 77.000 - 0.00% -
519.lbm_r (max) -12.09% 91.000 80.000 - 0.00% -
510.parest_r (max) (percentage) -8.77% 0.570 0.520 - 0.00% -
510.parest_r (max) -8.59% 128.000 117.000 - 0.00% -
531.deepsjeng_r (max) -7.69% 117.000 108.000 - 0.00% -
500.perlbench_r (max) (percentage) -6.98% 0.430 0.400 - 0.00% -
500.perlbench_r (max) -6.67% 60.000 56.000 - 0.00% -
519.lbm_r -6.52% 46.000 43.000 - 0.00% -
519.lbm_r (avg) -6.52% 46.000 43.000 - 0.00% -
521.wrf_r (max) -6.44% 606.000 567.000 - 0.00% -
508.namd_r (max) -6.15% 65.000 61.000 - 0.00% -
548.exchange2_r (max) -6.12% 49.000 46.000 - 0.00% -
541.leela_r (max) -5.94% 202.000 190.000 - 0.00% -
508.namd_r (max) (percentage) -5.88% 0.680 0.640 - 0.00% -
531.deepsjeng_r (max) (percentage) -5.88% 1.360 1.280 - 0.00% -
548.exchange2_r (max) (percentage) -5.71% 0.350 0.330 - 0.00% -
503.bwaves_r (max) -5.56% 36.000 34.000 - 0.00% -
519.lbm_r (max) (percentage) -5.26% 0.570 0.540 - 0.00% -
554.roms_r (max) (percentage) -5.19% 0.770 0.730 - 0.00% -
541.leela_r (max) (percentage) -5.11% 1.370 1.300 - 0.00% -
505.mcf_r (max) -4.94% 81.000 77.000 - 0.00% -
505.mcf_r (max) (percentage) -4.84% 0.620 0.590 - 0.00% -
525.x264_r (max) -4.76% 21.000 20.000 - 0.00% -
554.roms_r (max) -4.58% 131.000 125.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
538.imagick_r (max) -4.44% 45.000 43.000 - 0.00% -
521.wrf_r (max) (percentage) -3.95% 4.050 3.890 - 0.00% -
549.fotonik3d_r (max) (percentage) -3.67% 1.090 1.050 - 0.00% -
538.imagick_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
544.nab_r (max) -3.30% 91.000 88.000 - 0.00% -
549.fotonik3d_r (max) -3.24% 185.000 179.000 - 0.00% -
544.nab_r (max) (percentage) -3.17% 0.630 0.610 - 0.00% -
526.blender_r (max) (percentage) -3.09% 0.970 0.940 - 0.00% -
521.wrf_r -2.80% 250.000 243.000 - 0.00% -
521.wrf_r (avg) -2.80% 250.000 243.000 - 0.00% -
511.povray_r (max) (percentage) -2.65% 1.510 1.470 - 0.00% -
526.blender_r (max) -2.59% 116.000 113.000 - 0.00% -
511.povray_r (max) -2.57% 311.000 303.000 - 0.00% -
527.cam4_r (max) (percentage) -2.27% 0.880 0.860 - 0.00% -
508.namd_r -2.27% 44.000 43.000 - 0.00% -
508.namd_r (avg) -2.27% 44.000 43.000 - 0.00% -
531.deepsjeng_r -1.28% 78.000 77.000 - 0.00% -
531.deepsjeng_r (avg) -1.28% 78.000 77.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.25% 0.800 0.790 - 0.00% -
541.leela_r -1.22% 82.000 81.000 - 0.00% -
541.leela_r (avg) -1.22% 82.000 81.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests 4.17% 24.000 25.000 - 8.70% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 8.41% 627430.000 680228.000 - 1.35% -
503.bwaves_r 7.24% 26133.000 28025.000 - 0.23% -
510.parest_r 4.75% 7617646.000 7979339.000 - 0.11% -
549.fotonik3d_r 3.61% 295442.000 306096.000 - 0.20% -
521.wrf_r 2.82% 16940662.000 17419161.000 - 0.25% -
548.exchange2_r 2.20% 60513.000 61845.000 - 0.16% -
519.lbm_r 1.71% 14025.000 14265.000 - 0.06% -
500.perlbench_r 1.67% 2118719.000 2154084.000 - 0.06% -
541.leela_r 1.51% 148119.000 150359.000 - 0.16% -
531.deepsjeng_r 1.26% 80953.000 81973.000 - 0.14% -
554.roms_r 1.16% 667946.000 675671.000 - 0.82% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 8.87% 9501.000 10344.000 - 0.30% -
548.exchange2_r 3.51% 13702.000 14183.000 - 0.29% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -8.70% 23.000 21.000 - -4.55% -
nb_execution_successful -8.70% 23.000 21.000 - -4.55% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
526.blender_r -2.54% 12385.000 12070.000 - 0.12% -
507.cactuBSSN_r -2.51% 12742.000 12422.000 - 0.13% -
541.leela_r -2.37% 14976.000 14621.000 - -1.32% -
505.mcf_r -2.16% 13460.000 13169.000 - 0.47% -
549.fotonik3d_r -1.40% 17301.000 17059.000 - 0.45% -
538.imagick_r -1.06% 15307.000 15144.000 - -0.15% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 8.70% 23.000 25.000 - 4.17% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 14032.000 -
502.gcc_r 10533.000 -
503.bwaves_r 20074.000 -
505.mcf_r 13169.000 -
507.cactuBSSN_r 12422.000 -
508.namd_r 9547.000 -
510.parest_r 22502.000 -
511.povray_r 20632.000 -
519.lbm_r 14998.000 -6.69%
520.omnetpp_r 13991.000 -
521.wrf_r 14579.000 -2.72%
525.x264_r 10344.000 -
526.blender_r 12070.000 -
531.deepsjeng_r 8484.000 -1.52%
538.imagick_r 15144.000 -
541.leela_r 14621.000 -1.32%
544.nab_r 14441.000 -
548.exchange2_r 14183.000 -
549.fotonik3d_r 17059.000 -
554.roms_r 17205.000 1.03%
557.xz_r 11486.000 -
Geometric Mean 13937.138 -
Name Current %
500.perlbench_r 2154084.000 -
502.gcc_r 9143930.000 -
503.bwaves_r 28025.000 -
505.mcf_r 21228.000 -
507.cactuBSSN_r 3216385.000 -
508.namd_r 680228.000 1.35%
510.parest_r 7979339.000 -
511.povray_r 851252.000 1.22%
519.lbm_r 14265.000 -
520.omnetpp_r 2020847.000 -
521.wrf_r 17419161.000 -
525.x264_r 446305.000 -
526.blender_r 9852214.000 -
531.deepsjeng_r 81973.000 -
538.imagick_r 1802968.000 -
541.leela_r 150359.000 -
544.nab_r 169363.000 -2.09%
548.exchange2_r 61845.000 -
549.fotonik3d_r 306096.000 -
554.roms_r 675671.000 -
557.xz_r 189333.000 -
Geometric Mean 549819.718 -
Name Current %
nb_compile_successful 21.000 -4.55%
nb_execution_successful 21.000 -4.55%
nb_total_tests 25.000 4.17%
Geometric Mean 22.257 -1.73%
Name Current %
500.perlbench_r 94.000 1.08%
500.perlbench_r (avg) 94.000 1.08%
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 56.000 -6.67%
500.perlbench_r (max) (percentage) 0.400 -6.98%
503.bwaves_r 44.000 -
503.bwaves_r (avg) 44.000 -
503.bwaves_r (avg) (percentage) 0.220 -
503.bwaves_r (max) 34.000 -5.56%
503.bwaves_r (max) (percentage) 0.170 -
505.mcf_r 85.000 -
505.mcf_r (avg) 85.000 -
505.mcf_r (avg) (percentage) 0.650 -
505.mcf_r (max) 77.000 -4.94%
505.mcf_r (max) (percentage) 0.590 -4.84%
507.cactuBSSN_r 70.000 -
507.cactuBSSN_r (avg) 70.000 -
507.cactuBSSN_r (avg) (percentage) 0.570 -
507.cactuBSSN_r (max) 77.000 -12.50%
507.cactuBSSN_r (max) (percentage) 0.620 -12.68%
508.namd_r 43.000 -2.27%
508.namd_r (avg) 43.000 -2.27%
508.namd_r (avg) (percentage) 0.460 -
508.namd_r (max) 61.000 -6.15%
508.namd_r (max) (percentage) 0.640 -5.88%
510.parest_r 38.000 -
510.parest_r (avg) 38.000 -
510.parest_r (avg) (percentage) 0.170 -
510.parest_r (max) 117.000 -8.59%
510.parest_r (max) (percentage) 0.520 -8.77%
511.povray_r 92.000 -
511.povray_r (avg) 92.000 -
511.povray_r (avg) (percentage) 0.450 -
511.povray_r (max) 303.000 -2.57%
511.povray_r (max) (percentage) 1.470 -2.65%
519.lbm_r 43.000 -6.52%
519.lbm_r (avg) 43.000 -6.52%
519.lbm_r (avg) (percentage) 0.290 -
519.lbm_r (max) 80.000 -12.09%
519.lbm_r (max) (percentage) 0.540 -5.26%
520.omnetpp_r 110.000 -
520.omnetpp_r (avg) 110.000 -
520.omnetpp_r (avg) (percentage) 0.790 -1.25%
520.omnetpp_r (max) 177.000 -16.11%
520.omnetpp_r (max) (percentage) 1.270 -16.45%
520.omnetpp_r (unexplained diff vs previous) 67.000 -67.79%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.480 -67.79%
521.wrf_r 243.000 -2.80%
521.wrf_r (avg) 243.000 -2.80%
521.wrf_r (avg) (percentage) 1.670 -
521.wrf_r (max) 567.000 -6.44%
521.wrf_r (max) (percentage) 3.890 -3.95%
523.xalancbmk_r (avg) (percentage) 0.270 -
523.xalancbmk_r (max) (percentage) 0.210 -4.55%
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.170 -
525.x264_r (max) 20.000 -4.76%
525.x264_r (max) (percentage) 0.200 -
526.blender_r 43.000 -
526.blender_r (avg) 43.000 -
526.blender_r (avg) (percentage) 0.360 -
526.blender_r (max) 113.000 -2.59%
526.blender_r (max) (percentage) 0.940 -3.09%
527.cam4_r (avg) (percentage) 0.380 -
527.cam4_r (max) (percentage) 0.860 -2.27%
531.deepsjeng_r 77.000 -1.28%
531.deepsjeng_r (avg) 77.000 -1.28%
531.deepsjeng_r (avg) (percentage) 0.910 -
531.deepsjeng_r (max) 108.000 -7.69%
531.deepsjeng_r (max) (percentage) 1.280 -5.88%
538.imagick_r 15.000 -
538.imagick_r (avg) 15.000 -
538.imagick_r (avg) (percentage) 0.100 -
538.imagick_r (max) 43.000 -4.44%
538.imagick_r (max) (percentage) 0.290 -3.33%
541.leela_r 81.000 -1.22%
541.leela_r (avg) 81.000 -1.22%
541.leela_r (avg) (percentage) 0.560 -
541.leela_r (max) 190.000 -5.94%
541.leela_r (max) (percentage) 1.300 -5.11%
544.nab_r 44.000 -
544.nab_r (avg) 44.000 -
544.nab_r (avg) (percentage) 0.310 -
544.nab_r (max) 88.000 -3.30%
544.nab_r (max) (percentage) 0.610 -3.17%
548.exchange2_r 38.000 -
548.exchange2_r (avg) 38.000 -
548.exchange2_r (avg) (percentage) 0.270 -
548.exchange2_r (max) 46.000 -6.12%
548.exchange2_r (max) (percentage) 0.330 -5.71%
549.fotonik3d_r 119.000 -
549.fotonik3d_r (avg) 119.000 -
549.fotonik3d_r (avg) (percentage) 0.700 -
549.fotonik3d_r (max) 179.000 -3.24%
549.fotonik3d_r (max) (percentage) 1.050 -3.67%
554.roms_r 58.000 1.75%
554.roms_r (avg) 58.000 1.75%
554.roms_r (avg) (percentage) 0.340 -
554.roms_r (max) 125.000 -4.58%
554.roms_r (max) (percentage) 0.730 -5.19%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 28.000 -17.65%
557.xz_r (max) (percentage) 0.250 -16.67%
Geometric Mean 7.982 -5.00%