Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9d9f26d8b1a15561af02370f15be0af0d56ac5fa (+ 287 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4dbb3af1efe55174a714d15c2994cf2842ef8c28 (+ 857 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=721f30116ce653fffb0156e1298c8063833396e3 (+ 82 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=3a9c734cf38026353ce3ea9ca342f4ee2cee4ddd (+ 16318 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3-build/73/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0073 (4-changed-components) 2023-06-30T22:47:14 0:00:00
Previous 0067 (v6.3.9-51603-gece8f5edb883) 2023-06-17T16:40:53 0:00:00
Baseline 0001 (4-changed-components) 2023-02-25T21:59:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 10
Performance Improvements 19 8
Added Tests 5 110
Unchanged Tests 906 820
Total Tests 948

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
511.povray_r 2.71% 998065.000 1025125.000 - 2.02% -
510.parest_r 2.67% 8565743.000 8794072.000 - 2.09% -
503.bwaves_r 2.38% 31065.000 31805.000 - 2.99% -
507.cactuBSSN_r 1.74% 4207471.000 4280867.000 - 1.72% -
523.xalancbmk_r 1.51% 5491350.000 5574310.000 - 1.39% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.38% 8743.000 8864.000 - 1.72% -
521.wrf_r 1.16% 11848.000 11985.000 - 3.65% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.45% 69.000 70.000 - 0.00% -
531.deepsjeng_r (avg) 1.45% 69.000 70.000 - 0.00% -
521.wrf_r 1.44% 209.000 212.000 - 0.00% -
521.wrf_r (avg) 1.44% 209.000 212.000 - 0.00% -
520.omnetpp_r (max) 1.37% 73.000 74.000 - 0.00% -
521.wrf_r (max) 1.33% 376.000 381.000 - 0.00% -
508.namd_r (max) 1.23% 81.000 82.000 - 0.00% -
520.omnetpp_r 1.19% 84.000 85.000 - 0.00% -
520.omnetpp_r (avg) 1.19% 84.000 85.000 - 0.00% -
526.blender_r (max) 1.19% 84.000 85.000 - 0.00% -
531.deepsjeng_r (max) 1.00% 200.000 202.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r -2.31% 405482.000 396106.000 - -2.40% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r -2.22% 12797.000 12513.000 - 0.46% -
511.povray_r -1.74% 19224.000 18889.000 - 0.22% -
507.cactuBSSN_r -1.31% 12424.000 12261.000 - -2.08% -
549.fotonik3d_r -1.24% 18217.000 17992.000 - -1.28% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (max) -2.04% 49.000 48.000 - 0.00% -
554.roms_r (max) -1.72% 58.000 57.000 - 0.00% -
541.leela_r (max) -1.61% 62.000 61.000 - 0.00% -
527.cam4_r -1.56% 64.000 63.000 - 0.00% -
527.cam4_r (avg) -1.56% 64.000 63.000 - 0.00% -
507.cactuBSSN_r -1.54% 65.000 64.000 - 0.00% -
507.cactuBSSN_r (avg) -1.54% 65.000 64.000 - 0.00% -
549.fotonik3d_r -1.39% 72.000 71.000 - 0.00% -
549.fotonik3d_r (avg) -1.39% 72.000 71.000 - 0.00% -
503.bwaves_r -1.35% 74.000 73.000 - 0.00% -
503.bwaves_r (avg) -1.35% 74.000 73.000 - 0.00% -
511.povray_r (max) -1.35% 222.000 219.000 - 0.00% -
507.cactuBSSN_r (max) -1.33% 150.000 148.000 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful 4.55% 22.000 23.000 - 0.00% -

Added Tests - Code Size
525.x264_r

Added Tests - Execution
525.x264_r

Added Tests - sample variability
525.x264_r
525.x264_r (avg)
525.x264_r (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 2.99% 30881.000 31805.000 - 2.38% -
510.parest_r 2.09% 8613813.000 8794072.000 - 2.67% -
511.povray_r 2.02% 1004857.000 1025125.000 - 2.71% -
507.cactuBSSN_r 1.72% 4208684.000 4280867.000 - 1.74% -
523.xalancbmk_r 1.39% 5497633.000 5574310.000 - 1.51% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r 3.65% 11563.000 11985.000 - 1.16% -
544.nab_r 2.01% 14213.000 14498.000 - 0.82% -
531.deepsjeng_r 1.72% 8714.000 8864.000 - 1.38% -
519.lbm_r 1.67% 15084.000 15336.000 - 0.39% -
508.namd_r 1.05% 9234.000 9331.000 - 0.23% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.40% 405866.000 396106.000 - -2.31% -
508.namd_r -1.83% 738062.000 724560.000 - -0.53% -
520.omnetpp_r -1.06% 2247841.000 2224095.000 - 0.68% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -2.16% 6441.000 6302.000 - 0.00% -
507.cactuBSSN_r -2.08% 12522.000 12261.000 - -1.31% -
500.perlbench_r -1.34% 14226.000 14035.000 - -0.33% -
549.fotonik3d_r -1.28% 18226.000 17992.000 - -1.24% -
538.imagick_r -1.20% 15083.000 14902.000 - -0.15% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 14035.000 -
502.gcc_r 10179.000 -
503.bwaves_r 20515.000 -
505.mcf_r 13038.000 -
507.cactuBSSN_r 12261.000 -1.31%
508.namd_r 9331.000 -
510.parest_r 22155.000 -
511.povray_r 18889.000 -1.74%
519.lbm_r 15336.000 -
520.omnetpp_r 13804.000 -
521.wrf_r 11985.000 1.16%
523.xalancbmk_r 13541.000 -
525.x264_r 6302.000 -
526.blender_r 12143.000 -
527.cam4_r 11227.000 -
531.deepsjeng_r 8864.000 1.38%
538.imagick_r 14902.000 -
541.leela_r 12513.000 -2.22%
544.nab_r 14498.000 -
548.exchange2_r 7415.000 -
549.fotonik3d_r 17992.000 -1.24%
554.roms_r 15258.000 -
557.xz_r 11598.000 -
Geometric Mean 12824.620 -3.29%
Name Current %
500.perlbench_r 2409964.000 -
502.gcc_r 10074678.000 -
503.bwaves_r 31805.000 2.38%
505.mcf_r 28696.000 -
507.cactuBSSN_r 4280867.000 1.74%
508.namd_r 724560.000 -
510.parest_r 8794072.000 2.67%
511.povray_r 1025125.000 2.71%
519.lbm_r 15181.000 -
520.omnetpp_r 2224095.000 -
521.wrf_r 19985177.000 -
523.xalancbmk_r 5574310.000 1.51%
525.x264_r 629048.000 -
526.blender_r 11157721.000 -
527.cam4_r 18564402.000 -
531.deepsjeng_r 95701.000 -
538.imagick_r 2143736.000 -
541.leela_r 203610.000 -
544.nab_r 210523.000 -
548.exchange2_r 177465.000 -
549.fotonik3d_r 396106.000 -2.31%
554.roms_r 1063493.000 -
557.xz_r 203237.000 -
Geometric Mean 869941.618 -
Name Current %
nb_compile_successful 23.000 -
nb_execution_successful 23.000 4.55%
nb_total_tests 23.000 -
Geometric Mean 23.000 1.49%
Name Current %
500.perlbench_r 94.000 -
500.perlbench_r (avg) 94.000 -
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 235.000 -
500.perlbench_r (max) (percentage) 1.680 -
503.bwaves_r 73.000 -1.35%
503.bwaves_r (avg) 73.000 -1.35%
503.bwaves_r (avg) (percentage) 0.360 -
503.bwaves_r (max) 71.000 -
503.bwaves_r (max) (percentage) 0.350 -
505.mcf_r 46.000 -
505.mcf_r (avg) 46.000 -
505.mcf_r (avg) (percentage) 0.360 -
505.mcf_r (max) 63.000 -
505.mcf_r (max) (percentage) 0.490 -
507.cactuBSSN_r 64.000 -1.54%
507.cactuBSSN_r (avg) 64.000 -1.54%
507.cactuBSSN_r (avg) (percentage) 0.530 -
507.cactuBSSN_r (max) 148.000 -1.33%
507.cactuBSSN_r (max) (percentage) 1.210 -
508.namd_r 53.000 -
508.namd_r (avg) 53.000 -
508.namd_r (avg) (percentage) 0.570 -
508.namd_r (max) 82.000 1.23%
508.namd_r (max) (percentage) 0.880 -
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 33.000 -
510.parest_r (max) (percentage) 0.150 -
511.povray_r 100.000 -
511.povray_r (avg) 100.000 -
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 219.000 -1.35%
511.povray_r (max) (percentage) 1.160 -
519.lbm_r 38.000 -
519.lbm_r (avg) 38.000 -
519.lbm_r (avg) (percentage) 0.250 -
519.lbm_r (max) 47.000 -
519.lbm_r (max) (percentage) 0.310 -
520.omnetpp_r 85.000 1.19%
520.omnetpp_r (avg) 85.000 1.19%
520.omnetpp_r (avg) (percentage) 0.620 -
520.omnetpp_r (max) 74.000 1.37%
520.omnetpp_r (max) (percentage) 0.540 -
521.wrf_r 212.000 1.44%
521.wrf_r (avg) 212.000 1.44%
521.wrf_r (avg) (percentage) 1.770 -
521.wrf_r (max) 381.000 1.33%
521.wrf_r (max) (percentage) 3.180 -
523.xalancbmk_r 35.000 -
523.xalancbmk_r (avg) 35.000 -
523.xalancbmk_r (avg) (percentage) 0.260 -
523.xalancbmk_r (max) 40.000 -
523.xalancbmk_r (max) (percentage) 0.300 -
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.250 -
525.x264_r (max) 25.000 -
525.x264_r (max) (percentage) 0.400 -
526.blender_r 43.000 -
526.blender_r (avg) 43.000 -
526.blender_r (avg) (percentage) 0.360 -
526.blender_r (max) 85.000 1.19%
526.blender_r (max) (percentage) 0.700 -
527.cam4_r 63.000 -1.56%
527.cam4_r (avg) 63.000 -1.56%
527.cam4_r (avg) (percentage) 0.570 -
527.cam4_r (max) 88.000 -
527.cam4_r (max) (percentage) 0.790 -
531.deepsjeng_r 70.000 1.45%
531.deepsjeng_r (avg) 70.000 1.45%
531.deepsjeng_r (avg) (percentage) 0.790 -
531.deepsjeng_r (max) 202.000 1.00%
531.deepsjeng_r (max) (percentage) 2.290 -
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.150 -
538.imagick_r (max) 40.000 -
538.imagick_r (max) (percentage) 0.270 -
541.leela_r 26.000 -
541.leela_r (avg) 26.000 -
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 61.000 -1.61%
541.leela_r (max) (percentage) 0.490 -
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 121.000 -
544.nab_r (max) (percentage) 0.840 -
548.exchange2_r 32.000 -
548.exchange2_r (avg) 32.000 -
548.exchange2_r (avg) (percentage) 0.440 -
548.exchange2_r (max) 33.000 -
548.exchange2_r (max) (percentage) 0.450 -
549.fotonik3d_r 71.000 -1.39%
549.fotonik3d_r (avg) 71.000 -1.39%
549.fotonik3d_r (avg) (percentage) 0.400 -
549.fotonik3d_r (max) 48.000 -2.04%
549.fotonik3d_r (max) (percentage) 0.270 -
554.roms_r 42.000 -
554.roms_r (avg) 42.000 -
554.roms_r (avg) (percentage) 0.280 -
554.roms_r (max) 57.000 -1.72%
554.roms_r (max) (percentage) 0.380 -
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 13.000 -
557.xz_r (max) (percentage) 0.120 -
Geometric Mean 7.973 2.21%