Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ea186080fe2b94b21f3ac8ad7941948211d5e67a (+ 42 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/a5f39859d0c14a831e2826f5e5cfe036e56dcd7d (+ 203 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=6b695e5c628734b9801fcf53149687cb4fe6926e (+ 4 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (+ 214 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O2-build/96/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0096 (4-changed-components) 2023-09-23T15:19:54 0:00:00
Previous 0095 (no-change) 2023-09-20T11:57:36 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T12:51:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 13
Performance Improvements 51 4
Added Tests 0 110
Unchanged Tests 882 821
Total Tests 948

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r 3.27% 26393.000 27257.000 - 4.30% -
508.namd_r 3.21% 629136.000 649320.000 - 3.49% -
549.fotonik3d_r 2.59% 297738.000 305442.000 - 3.38% -
548.exchange2_r 2.52% 60193.000 61709.000 - 1.98% -
521.wrf_r 2.04% 16862333.000 17206917.000 - 1.57% -
500.perlbench_r 1.77% 2105796.000 2143132.000 - 1.15% -
531.deepsjeng_r 1.13% 81421.000 82341.000 - 1.71% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r 2.66% 14558.000 14945.000 - -0.21% -
505.mcf_r 1.35% 13080.000 13257.000 - -1.51% -
527.cam4_r 1.08% 11620.000 11746.000 - -0.14% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r 3.53% 85.000 88.000 - 0.00% -
541.leela_r (avg) 3.53% 85.000 88.000 - 0.00% -
527.cam4_r 2.50% 40.000 41.000 - 0.00% -
527.cam4_r (avg) 2.50% 40.000 41.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.37% 0.730 0.740 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -1.84% 14803.000 14530.000 - -0.30% -
500.perlbench_r -1.26% 14046.000 13869.000 - -0.46% -
525.x264_r -1.10% 10497.000 10382.000 - 9.27% -
520.omnetpp_r -1.01% 14308.000 14164.000 - 1.70% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -17.24% 174.000 144.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -16.39% 1.220 1.020 - 0.00% -
508.namd_r (max) -10.20% 49.000 44.000 - 0.00% -
523.xalancbmk_r (max) -10.00% 30.000 27.000 - 0.00% -
549.fotonik3d_r (max) -9.93% 151.000 136.000 - 0.00% -
508.namd_r (max) (percentage) -9.62% 0.520 0.470 - 0.00% -
523.xalancbmk_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
549.fotonik3d_r (max) (percentage) -9.09% 0.880 0.800 - 0.00% -
520.omnetpp_r (max) -8.57% 175.000 160.000 - 0.00% -
520.omnetpp_r (max) (percentage) -8.13% 1.230 1.130 - 0.00% -
507.cactuBSSN_r (max) -7.32% 41.000 38.000 - 0.00% -
544.nab_r (max) -6.67% 60.000 56.000 - 0.00% -
526.blender_r (max) -6.52% 46.000 43.000 - 0.00% -
557.xz_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
507.cactuBSSN_r (max) (percentage) -6.06% 0.330 0.310 - 0.00% -
548.exchange2_r (max) (percentage) -5.75% 0.870 0.820 - 0.00% -
557.xz_r (max) -5.56% 18.000 17.000 - 0.00% -
521.wrf_r (max) -5.28% 492.000 466.000 - 0.00% -
525.x264_r (max) (percentage) -5.26% 0.190 0.180 - 0.00% -
526.blender_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
525.x264_r (max) -5.26% 19.000 18.000 - 0.00% -
554.roms_r (max) -5.13% 39.000 37.000 - 0.00% -
548.exchange2_r (max) -5.04% 119.000 113.000 - 0.00% -
519.lbm_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
544.nab_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
519.lbm_r (max) -4.84% 62.000 59.000 - 0.00% -
531.deepsjeng_r (max) -4.65% 43.000 41.000 - 0.00% -
500.perlbench_r (max) -4.55% 88.000 84.000 - 0.00% -
554.roms_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
525.x264_r -4.35% 23.000 22.000 - 0.00% -
525.x264_r (avg) -4.35% 23.000 22.000 - 0.00% -
527.cam4_r (max) (percentage) -4.08% 0.490 0.470 - 0.00% -
541.leela_r (max) (percentage) -4.05% 0.740 0.710 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
505.mcf_r (max) (percentage) -3.85% 1.040 1.000 - 0.00% -
503.bwaves_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
503.bwaves_r (max) -3.70% 54.000 52.000 - 0.00% -
521.wrf_r (max) (percentage) -3.60% 3.330 3.210 - 0.00% -
500.perlbench_r (max) (percentage) -3.17% 0.630 0.610 - 0.00% -
505.mcf_r (max) -2.94% 136.000 132.000 - 0.00% -
544.nab_r -2.44% 41.000 40.000 - 0.00% -
544.nab_r (avg) -2.44% 41.000 40.000 - 0.00% -
521.wrf_r -2.22% 225.000 220.000 - 0.00% -
521.wrf_r (avg) -2.22% 225.000 220.000 - 0.00% -
511.povray_r (max) (percentage) -2.08% 0.480 0.470 - 0.00% -
527.cam4_r (max) -1.79% 56.000 55.000 - 0.00% -
511.povray_r (max) -1.03% 97.000 96.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 4.30% 26133.000 27257.000 - 3.27% -
508.namd_r 3.49% 627430.000 649320.000 - 3.21% -
549.fotonik3d_r 3.38% 295442.000 305442.000 - 2.59% -
510.parest_r 2.46% 7617646.000 7804900.000 - 0.87% -
541.leela_r 2.27% 148119.000 151481.000 - 0.22% -
548.exchange2_r 1.98% 60513.000 61709.000 - 2.52% -
531.deepsjeng_r 1.71% 80953.000 82341.000 - 1.13% -
521.wrf_r 1.57% 16940662.000 17206917.000 - 2.04% -
500.perlbench_r 1.15% 2118719.000 2143132.000 - 1.77% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 9.27% 9501.000 10382.000 - -1.10% -
519.lbm_r 2.12% 15005.000 15323.000 - 0.00% -
520.omnetpp_r 1.70% 13927.000 14164.000 - -1.01% -
544.nab_r 1.36% 14413.000 14609.000 - -0.29% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -1.51% 13460.000 13257.000 - 1.35% -
549.fotonik3d_r -1.47% 17301.000 17046.000 - -0.72% -
526.blender_r -1.32% 12385.000 12221.000 - -0.52% -
507.cactuBSSN_r -1.31% 12742.000 12575.000 - -0.08% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13869.000 -1.26%
502.gcc_r 10540.000 -
503.bwaves_r 20261.000 -
505.mcf_r 13257.000 1.35%
507.cactuBSSN_r 12575.000 -
508.namd_r 9494.000 -
510.parest_r 22597.000 -
511.povray_r 20463.000 -
519.lbm_r 15323.000 -
520.omnetpp_r 14164.000 -1.01%
521.wrf_r 14530.000 -1.84%
523.xalancbmk_r 13733.000 -
525.x264_r 10382.000 -1.10%
526.blender_r 12221.000 -
527.cam4_r 11746.000 1.08%
531.deepsjeng_r 8521.000 -
538.imagick_r 15419.000 -
541.leela_r 14945.000 2.66%
544.nab_r 14609.000 -
548.exchange2_r 13825.000 -
549.fotonik3d_r 17046.000 -
554.roms_r 17092.000 -
557.xz_r 11570.000 -
Geometric Mean 13875.731 -
Name Current %
500.perlbench_r 2143132.000 1.77%
502.gcc_r 9142294.000 -
503.bwaves_r 27257.000 3.27%
505.mcf_r 21168.000 -
507.cactuBSSN_r 3193146.000 -
508.namd_r 649320.000 3.21%
510.parest_r 7804900.000 -
511.povray_r 844952.000 -
519.lbm_r 14121.000 -
520.omnetpp_r 2013743.000 -
521.wrf_r 17206917.000 2.04%
523.xalancbmk_r 4461106.000 -
525.x264_r 445145.000 -
526.blender_r 9843078.000 -
527.cam4_r 17740490.000 -
531.deepsjeng_r 82341.000 1.13%
538.imagick_r 1800136.000 -
541.leela_r 151481.000 -
544.nab_r 169043.000 -
548.exchange2_r 61709.000 2.52%
549.fotonik3d_r 305442.000 2.59%
554.roms_r 665709.000 -
557.xz_r 188577.000 -
Geometric Mean 695447.447 1.01%
Name Current %
500.perlbench_r 104.000 -
500.perlbench_r (avg) 104.000 -
500.perlbench_r (avg) (percentage) 0.750 -
500.perlbench_r (max) 84.000 -4.55%
500.perlbench_r (max) (percentage) 0.610 -3.17%
503.bwaves_r 56.000 -
503.bwaves_r (avg) 56.000 -
503.bwaves_r (avg) (percentage) 0.280 -
503.bwaves_r (max) 52.000 -3.70%
503.bwaves_r (max) (percentage) 0.260 -3.70%
505.mcf_r 108.000 -
505.mcf_r (avg) 108.000 -
505.mcf_r (avg) (percentage) 0.820 -
505.mcf_r (max) 132.000 -2.94%
505.mcf_r (max) (percentage) 1.000 -3.85%
507.cactuBSSN_r 57.000 -
507.cactuBSSN_r (avg) 57.000 -
507.cactuBSSN_r (avg) (percentage) 0.460 -
507.cactuBSSN_r (max) 38.000 -7.32%
507.cactuBSSN_r (max) (percentage) 0.310 -6.06%
508.namd_r 42.000 -
508.namd_r (avg) 42.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 44.000 -10.20%
508.namd_r (max) (percentage) 0.470 -9.62%
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.100 -
510.parest_r (max) 29.000 -
510.parest_r (max) (percentage) 0.130 -
511.povray_r 77.000 -
511.povray_r (avg) 77.000 -
511.povray_r (avg) (percentage) 0.380 -
511.povray_r (max) 96.000 -1.03%
511.povray_r (max) (percentage) 0.470 -2.08%
519.lbm_r 44.000 -
519.lbm_r (avg) 44.000 -
519.lbm_r (avg) (percentage) 0.290 -
519.lbm_r (max) 59.000 -4.84%
519.lbm_r (max) (percentage) 0.390 -4.88%
520.omnetpp_r 104.000 -
520.omnetpp_r (avg) 104.000 -
520.omnetpp_r (avg) (percentage) 0.740 1.37%
520.omnetpp_r (max) 160.000 -8.57%
520.omnetpp_r (max) (percentage) 1.130 -8.13%
520.omnetpp_r (unexplained diff vs previous) 144.000 -17.24%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.020 -16.39%
521.wrf_r 220.000 -2.22%
521.wrf_r (avg) 220.000 -2.22%
521.wrf_r (avg) (percentage) 1.520 -
521.wrf_r (max) 466.000 -5.28%
521.wrf_r (max) (percentage) 3.210 -3.60%
523.xalancbmk_r 37.000 -
523.xalancbmk_r (avg) 37.000 -
523.xalancbmk_r (avg) (percentage) 0.270 -
523.xalancbmk_r (max) 27.000 -10.00%
523.xalancbmk_r (max) (percentage) 0.200 -9.09%
525.x264_r 22.000 -4.35%
525.x264_r (avg) 22.000 -4.35%
525.x264_r (avg) (percentage) 0.220 -
525.x264_r (max) 18.000 -5.26%
525.x264_r (max) (percentage) 0.180 -5.26%
526.blender_r 35.000 -
526.blender_r (avg) 35.000 -
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 43.000 -6.52%
526.blender_r (max) (percentage) 0.360 -5.26%
527.cam4_r 41.000 2.50%
527.cam4_r (avg) 41.000 2.50%
527.cam4_r (avg) (percentage) 0.350 -
527.cam4_r (max) 55.000 -1.79%
527.cam4_r (max) (percentage) 0.470 -4.08%
531.deepsjeng_r 58.000 -
531.deepsjeng_r (avg) 58.000 -
531.deepsjeng_r (avg) (percentage) 0.690 -
531.deepsjeng_r (max) 41.000 -4.65%
531.deepsjeng_r (max) (percentage) 0.490 -3.92%
538.imagick_r 10.000 -
538.imagick_r (avg) 10.000 -
538.imagick_r (avg) (percentage) 0.070 -
538.imagick_r (max) 10.000 -
538.imagick_r (max) (percentage) 0.070 -
541.leela_r 88.000 3.53%
541.leela_r (avg) 88.000 3.53%
541.leela_r (avg) (percentage) 0.590 -
541.leela_r (max) 106.000 -
541.leela_r (max) (percentage) 0.710 -4.05%
544.nab_r 40.000 -2.44%
544.nab_r (avg) 40.000 -2.44%
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 56.000 -6.67%
544.nab_r (max) (percentage) 0.390 -4.88%
548.exchange2_r 35.000 -
548.exchange2_r (avg) 35.000 -
548.exchange2_r (avg) (percentage) 0.260 -
548.exchange2_r (max) 113.000 -5.04%
548.exchange2_r (max) (percentage) 0.820 -5.75%
549.fotonik3d_r 132.000 -
549.fotonik3d_r (avg) 132.000 -
549.fotonik3d_r (avg) (percentage) 0.780 -
549.fotonik3d_r (max) 136.000 -9.93%
549.fotonik3d_r (max) (percentage) 0.800 -9.09%
554.roms_r 63.000 -
554.roms_r (avg) 63.000 -
554.roms_r (avg) (percentage) 0.370 -
554.roms_r (max) 37.000 -5.13%
554.roms_r (max) (percentage) 0.220 -4.35%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.090 -
557.xz_r (max) 17.000 -5.56%
557.xz_r (max) (percentage) 0.150 -6.25%
Geometric Mean 7.306 -2.36%