Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9d9f26d8b1a15561af02370f15be0af0d56ac5fa (+ 287 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4dbb3af1efe55174a714d15c2994cf2842ef8c28 (+ 857 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=721f30116ce653fffb0156e1298c8063833396e3 (+ 82 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=3a9c734cf38026353ce3ea9ca342f4ee2cee4ddd (+ 16318 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3-build/73/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0073 (4-changed-components) 2023-06-30T22:47:14 0:00:00
Previous 0078 (4-changed-components) 2023-07-15T07:27:36 0:00:00
Baseline 0001 (4-changed-components) 2023-02-25T21:59:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 43 10
Performance Improvements 14 8
Added Tests 0 110
Unchanged Tests 891 820
Total Tests 948

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 1.83% 28180.000 28696.000 - -0.28% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.62% 8723.000 8864.000 - 1.72% -
520.omnetpp_r 1.12% 13651.000 13804.000 - -0.16% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
521.wrf_r (max) 12.72% 338.000 381.000 - 0.00% -
549.fotonik3d_r (max) (percentage) 12.50% 0.240 0.270 - 0.00% -
521.wrf_r (max) (percentage) 12.37% 2.830 3.180 - 0.00% -
519.lbm_r (max) 11.90% 42.000 47.000 - 0.00% -
554.roms_r (max) (percentage) 11.76% 0.340 0.380 - 0.00% -
549.fotonik3d_r (max) 11.63% 43.000 48.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) 11.01% 1.090 1.210 - 0.00% -
519.lbm_r (max) (percentage) 10.71% 0.280 0.310 - 0.00% -
544.nab_r (max) 10.00% 110.000 121.000 - 0.00% -
548.exchange2_r (max) 10.00% 30.000 33.000 - 0.00% -
548.exchange2_r (max) (percentage) 9.76% 0.410 0.450 - 0.00% -
507.cactuBSSN_r (max) 9.63% 135.000 148.000 - 0.00% -
554.roms_r (max) 9.62% 52.000 57.000 - 0.00% -
544.nab_r (max) (percentage) 9.09% 0.770 0.840 - 0.00% -
557.xz_r (max) 8.33% 12.000 13.000 - 0.00% -
527.cam4_r (max) 7.32% 82.000 88.000 - 0.00% -
527.cam4_r (max) (percentage) 6.76% 0.740 0.790 - 0.00% -
505.mcf_r (max) (percentage) 6.52% 0.460 0.490 - 0.00% -
508.namd_r (max) 6.49% 77.000 82.000 - 0.00% -
526.blender_r (max) 6.25% 80.000 85.000 - 0.00% -
526.blender_r (max) (percentage) 6.06% 0.660 0.700 - 0.00% -
508.namd_r (max) (percentage) 6.02% 0.830 0.880 - 0.00% -
538.imagick_r (max) 5.26% 38.000 40.000 - 0.00% -
531.deepsjeng_r (max) 5.21% 192.000 202.000 - 0.00% -
541.leela_r (max) 5.17% 58.000 61.000 - 0.00% -
505.mcf_r (max) 5.00% 60.000 63.000 - 0.00% -
541.leela_r (max) (percentage) 4.26% 0.470 0.490 - 0.00% -
525.x264_r (max) 4.17% 24.000 25.000 - 0.00% -
538.imagick_r (max) (percentage) 3.85% 0.260 0.270 - 0.00% -
531.deepsjeng_r (max) (percentage) 3.62% 2.210 2.290 - 0.00% -
523.xalancbmk_r (max) (percentage) 3.45% 0.290 0.300 - 0.00% -
531.deepsjeng_r 2.94% 68.000 70.000 - 0.00% -
531.deepsjeng_r (avg) 2.94% 68.000 70.000 - 0.00% -
523.xalancbmk_r (max) 2.56% 39.000 40.000 - 0.00% -
500.perlbench_r (max) (percentage) 2.44% 1.640 1.680 - 0.00% -
511.povray_r (max) 2.34% 214.000 219.000 - 0.00% -
500.perlbench_r (max) 2.17% 230.000 235.000 - 0.00% -
511.povray_r (max) (percentage) 1.75% 1.140 1.160 - 0.00% -
511.povray_r 1.01% 99.000 100.000 - 0.00% -
511.povray_r (avg) 1.01% 99.000 100.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
557.xz_r -1.32% 205949.000 203237.000 - 0.49% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r -1.54% 12453.000 12261.000 - -2.08% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (max) (percentage) -51.35% 1.110 0.540 - 0.00% -
520.omnetpp_r (max) -50.99% 151.000 74.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -3.13% 0.640 0.620 - 0.00% -
507.cactuBSSN_r -3.03% 66.000 64.000 - 0.00% -
507.cactuBSSN_r (avg) -3.03% 66.000 64.000 - 0.00% -
520.omnetpp_r -2.30% 87.000 85.000 - 0.00% -
520.omnetpp_r (avg) -2.30% 87.000 85.000 - 0.00% -
503.bwaves_r (max) -1.39% 72.000 71.000 - 0.00% -
549.fotonik3d_r -1.39% 72.000 71.000 - 0.00% -
549.fotonik3d_r (avg) -1.39% 72.000 71.000 - 0.00% -
503.bwaves_r -1.35% 74.000 73.000 - 0.00% -
503.bwaves_r (avg) -1.35% 74.000 73.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 2.99% 30881.000 31805.000 - 0.14% -
510.parest_r 2.09% 8613813.000 8794072.000 - 0.07% -
511.povray_r 2.02% 1004857.000 1025125.000 - 0.93% -
507.cactuBSSN_r 1.72% 4208684.000 4280867.000 - -0.27% -
523.xalancbmk_r 1.39% 5497633.000 5574310.000 - -0.12% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r 3.65% 11563.000 11985.000 - 0.13% -
544.nab_r 2.01% 14213.000 14498.000 - 0.64% -
531.deepsjeng_r 1.72% 8714.000 8864.000 - 1.62% -
519.lbm_r 1.67% 15084.000 15336.000 - 0.11% -
508.namd_r 1.05% 9234.000 9331.000 - -0.26% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.40% 405866.000 396106.000 - 0.25% -
508.namd_r -1.83% 738062.000 724560.000 - 0.06% -
520.omnetpp_r -1.06% 2247841.000 2224095.000 - 0.21% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -2.16% 6441.000 6302.000 - 0.85% -
507.cactuBSSN_r -2.08% 12522.000 12261.000 - -1.54% -
500.perlbench_r -1.34% 14226.000 14035.000 - -0.18% -
549.fotonik3d_r -1.28% 18226.000 17992.000 - -0.45% -
538.imagick_r -1.20% 15083.000 14902.000 - -0.23% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 14035.000 -
502.gcc_r 10179.000 -
503.bwaves_r 20515.000 -
505.mcf_r 13038.000 -
507.cactuBSSN_r 12261.000 -1.54%
508.namd_r 9331.000 -
510.parest_r 22155.000 -
511.povray_r 18889.000 -
519.lbm_r 15336.000 -
520.omnetpp_r 13804.000 1.12%
521.wrf_r 11985.000 -
523.xalancbmk_r 13541.000 -
525.x264_r 6302.000 -
526.blender_r 12143.000 -
527.cam4_r 11227.000 -
531.deepsjeng_r 8864.000 1.62%
538.imagick_r 14902.000 -
541.leela_r 12513.000 -
544.nab_r 14498.000 -
548.exchange2_r 7415.000 -
549.fotonik3d_r 17992.000 -
554.roms_r 15258.000 -
557.xz_r 11598.000 -
Geometric Mean 12824.620 -
Name Current %
500.perlbench_r 2409964.000 -
502.gcc_r 10074678.000 -
503.bwaves_r 31805.000 -
505.mcf_r 28696.000 1.83%
507.cactuBSSN_r 4280867.000 -
508.namd_r 724560.000 -
510.parest_r 8794072.000 -
511.povray_r 1025125.000 -
519.lbm_r 15181.000 -
520.omnetpp_r 2224095.000 -
521.wrf_r 19985177.000 -
523.xalancbmk_r 5574310.000 -
525.x264_r 629048.000 -
526.blender_r 11157721.000 -
527.cam4_r 18564402.000 -
531.deepsjeng_r 95701.000 -
538.imagick_r 2143736.000 -
541.leela_r 203610.000 -
544.nab_r 210523.000 -
548.exchange2_r 177465.000 -
549.fotonik3d_r 396106.000 -
554.roms_r 1063493.000 -
557.xz_r 203237.000 -1.32%
Geometric Mean 869941.618 -
Name Current %
500.perlbench_r 94.000 -
500.perlbench_r (avg) 94.000 -
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 235.000 2.17%
500.perlbench_r (max) (percentage) 1.680 2.44%
503.bwaves_r 73.000 -1.35%
503.bwaves_r (avg) 73.000 -1.35%
503.bwaves_r (avg) (percentage) 0.360 -
503.bwaves_r (max) 71.000 -1.39%
503.bwaves_r (max) (percentage) 0.350 -
505.mcf_r 46.000 -
505.mcf_r (avg) 46.000 -
505.mcf_r (avg) (percentage) 0.360 -
505.mcf_r (max) 63.000 5.00%
505.mcf_r (max) (percentage) 0.490 6.52%
507.cactuBSSN_r 64.000 -3.03%
507.cactuBSSN_r (avg) 64.000 -3.03%
507.cactuBSSN_r (avg) (percentage) 0.530 -
507.cactuBSSN_r (max) 148.000 9.63%
507.cactuBSSN_r (max) (percentage) 1.210 11.01%
508.namd_r 53.000 -
508.namd_r (avg) 53.000 -
508.namd_r (avg) (percentage) 0.570 -
508.namd_r (max) 82.000 6.49%
508.namd_r (max) (percentage) 0.880 6.02%
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 33.000 -
510.parest_r (max) (percentage) 0.150 -
511.povray_r 100.000 1.01%
511.povray_r (avg) 100.000 1.01%
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 219.000 2.34%
511.povray_r (max) (percentage) 1.160 1.75%
519.lbm_r 38.000 -
519.lbm_r (avg) 38.000 -
519.lbm_r (avg) (percentage) 0.250 -
519.lbm_r (max) 47.000 11.90%
519.lbm_r (max) (percentage) 0.310 10.71%
520.omnetpp_r 85.000 -2.30%
520.omnetpp_r (avg) 85.000 -2.30%
520.omnetpp_r (avg) (percentage) 0.620 -3.13%
520.omnetpp_r (max) 74.000 -50.99%
520.omnetpp_r (max) (percentage) 0.540 -51.35%
521.wrf_r 212.000 -
521.wrf_r (avg) 212.000 -
521.wrf_r (avg) (percentage) 1.770 -
521.wrf_r (max) 381.000 12.72%
521.wrf_r (max) (percentage) 3.180 12.37%
523.xalancbmk_r 35.000 -
523.xalancbmk_r (avg) 35.000 -
523.xalancbmk_r (avg) (percentage) 0.260 -
523.xalancbmk_r (max) 40.000 2.56%
523.xalancbmk_r (max) (percentage) 0.300 3.45%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.250 -
525.x264_r (max) 25.000 4.17%
525.x264_r (max) (percentage) 0.400 -
526.blender_r 43.000 -
526.blender_r (avg) 43.000 -
526.blender_r (avg) (percentage) 0.360 -
526.blender_r (max) 85.000 6.25%
526.blender_r (max) (percentage) 0.700 6.06%
527.cam4_r 63.000 -
527.cam4_r (avg) 63.000 -
527.cam4_r (avg) (percentage) 0.570 -
527.cam4_r (max) 88.000 7.32%
527.cam4_r (max) (percentage) 0.790 6.76%
531.deepsjeng_r 70.000 2.94%
531.deepsjeng_r (avg) 70.000 2.94%
531.deepsjeng_r (avg) (percentage) 0.790 -
531.deepsjeng_r (max) 202.000 5.21%
531.deepsjeng_r (max) (percentage) 2.290 3.62%
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.150 -
538.imagick_r (max) 40.000 5.26%
538.imagick_r (max) (percentage) 0.270 3.85%
541.leela_r 26.000 -
541.leela_r (avg) 26.000 -
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 61.000 5.17%
541.leela_r (max) (percentage) 0.490 4.26%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 121.000 10.00%
544.nab_r (max) (percentage) 0.840 9.09%
548.exchange2_r 32.000 -
548.exchange2_r (avg) 32.000 -
548.exchange2_r (avg) (percentage) 0.440 -
548.exchange2_r (max) 33.000 10.00%
548.exchange2_r (max) (percentage) 0.450 9.76%
549.fotonik3d_r 71.000 -1.39%
549.fotonik3d_r (avg) 71.000 -1.39%
549.fotonik3d_r (avg) (percentage) 0.400 -
549.fotonik3d_r (max) 48.000 11.63%
549.fotonik3d_r (max) (percentage) 0.270 12.50%
554.roms_r 42.000 -
554.roms_r (avg) 42.000 -
554.roms_r (avg) (percentage) 0.280 -
554.roms_r (max) 57.000 9.62%
554.roms_r (max) (percentage) 0.380 11.76%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 13.000 8.33%
557.xz_r (max) (percentage) 0.120 -
Geometric Mean 7.973 -