Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3422b26537123bb63240996feea4aeb1a317e507 (+ 53 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/d156c6054200237b707f9fb44ae9958d926b0745 (+ 169 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=a363f7075125fa654342c69331e6c075518ec28c (+ 20 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4eea81eb90e0150569d4ce66345b2ada1da2028c (+ 365 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3-build/43/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0043 (4-changed-components) 2023-05-22T19:33:16 0:00:00
Previous 0042 (3-changed-components) 2023-05-19T19:23:03 0:00:00
Baseline 0001 (4-changed-components) 2023-02-25T21:59:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 6
Performance Improvements 44 6
Added Tests 0 110
Unchanged Tests 884 826
Total Tests 948

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 2.00% 13505.000 13775.000 - -0.37% -
531.deepsjeng_r 1.76% 8630.000 8782.000 - 0.78% -
500.perlbench_r 1.22% 13868.000 14037.000 - -1.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) 800.00% 0.030 0.270 - 0.00% -
519.lbm_r (unexplained diff vs previous) 720.00% 5.000 41.000 - 0.00% -
519.lbm_r (max) (percentage) 42.11% 0.190 0.270 - 0.00% -
519.lbm_r (max) 41.38% 29.000 41.000 - 0.00% -
503.bwaves_r (max) 7.50% 120.000 129.000 - 0.00% -
503.bwaves_r (max) (percentage) 6.78% 0.590 0.630 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 6.67% 120.000 128.000 - 0.00% -
503.bwaves_r (avg) (percentage) 5.71% 0.350 0.370 - 0.00% -
503.bwaves_r 5.63% 71.000 75.000 - 0.00% -
503.bwaves_r (avg) 5.63% 71.000 75.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 5.08% 0.590 0.620 - 0.00% -
520.omnetpp_r 2.06% 97.000 99.000 - 0.00% -
520.omnetpp_r (avg) 2.06% 97.000 99.000 - 0.00% -
500.perlbench_r 2.04% 49.000 50.000 - 0.00% -
500.perlbench_r (avg) 2.04% 49.000 50.000 - 0.00% -
531.deepsjeng_r 1.85% 54.000 55.000 - 0.00% -
531.deepsjeng_r (avg) 1.85% 54.000 55.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r -1.05% 6377.000 6310.000 - -2.03% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (unexplained diff vs previous) -41.44% 111.000 65.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -40.98% 0.610 0.360 - 0.00% -
548.exchange2_r (unexplained diff vs previous) -17.14% 35.000 29.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) -17.02% 0.470 0.390 - 0.00% -
525.x264_r (max) -14.29% 7.000 6.000 - 0.00% -
548.exchange2_r (max) (percentage) -10.45% 0.670 0.600 - 0.00% -
548.exchange2_r (max) -10.20% 49.000 44.000 - 0.00% -
549.fotonik3d_r (max) -10.00% 110.000 99.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -9.84% 0.610 0.550 - 0.00% -
520.omnetpp_r (max) (percentage) -8.33% 2.280 2.090 - 0.00% -
554.roms_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
541.leela_r (max) -7.06% 85.000 79.000 - 0.00% -
544.nab_r (max) -6.82% 44.000 41.000 - 0.00% -
520.omnetpp_r (max) -6.51% 307.000 287.000 - 0.00% -
544.nab_r (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
541.leela_r (max) (percentage) -5.97% 0.670 0.630 - 0.00% -
500.perlbench_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
511.povray_r (max) -5.26% 38.000 36.000 - 0.00% -
554.roms_r (max) -5.26% 19.000 18.000 - 0.00% -
511.povray_r (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
557.xz_r (max) -5.00% 20.000 19.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
500.perlbench_r (max) -3.85% 52.000 50.000 - 0.00% -
505.mcf_r (max) (percentage) -3.77% 0.530 0.510 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.73% 1.340 1.290 - 0.00% -
521.wrf_r (max) -3.69% 217.000 209.000 - 0.00% -
507.cactuBSSN_r (max) -3.66% 164.000 158.000 - 0.00% -
508.namd_r (max) -3.64% 55.000 53.000 - 0.00% -
541.leela_r -3.45% 29.000 28.000 - 0.00% -
541.leela_r (avg) -3.45% 29.000 28.000 - 0.00% -
508.namd_r (max) (percentage) -3.39% 0.590 0.570 - 0.00% -
521.wrf_r (max) (percentage) -3.24% 1.850 1.790 - 0.00% -
505.mcf_r (max) -2.94% 68.000 66.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
526.blender_r (max) -2.46% 122.000 119.000 - 0.00% -
523.xalancbmk_r -2.38% 42.000 41.000 - 0.00% -
523.xalancbmk_r (avg) -2.38% 42.000 41.000 - 0.00% -
527.cam4_r (max) (percentage) -2.11% 0.950 0.930 - 0.00% -
523.xalancbmk_r (max) -2.08% 48.000 47.000 - 0.00% -
554.roms_r -2.04% 49.000 48.000 - 0.00% -
554.roms_r (avg) -2.04% 49.000 48.000 - 0.00% -
526.blender_r (max) (percentage) -2.00% 1.000 0.980 - 0.00% -
527.cam4_r (max) -1.89% 106.000 104.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 1.96% 18848.000 19217.000 - 0.42% -
544.nab_r 1.82% 14213.000 14471.000 - 0.01% -
519.lbm_r 1.67% 15084.000 15336.000 - 0.27% -
508.namd_r 1.30% 9234.000 9354.000 - 0.03% -
521.wrf_r 1.26% 11563.000 11709.000 - -0.43% -
541.leela_r 1.13% 12456.000 12597.000 - -0.80% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -1.64% 2247841.000 2210908.000 - -0.36% -
508.namd_r -1.26% 738062.000 728728.000 - 0.26% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -2.03% 6441.000 6310.000 - -1.05% -
507.cactuBSSN_r -1.58% 12522.000 12324.000 - 0.63% -
500.perlbench_r -1.33% 14226.000 14037.000 - 1.22% -
549.fotonik3d_r -1.04% 18226.000 18036.000 - -0.36% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 14037.000 1.22%
502.gcc_r 10212.000 -
503.bwaves_r 20519.000 -
505.mcf_r 13053.000 -
507.cactuBSSN_r 12324.000 -
508.namd_r 9354.000 -
510.parest_r 22137.000 -
511.povray_r 19217.000 -
519.lbm_r 15336.000 -
520.omnetpp_r 13775.000 2.00%
521.wrf_r 11709.000 -
523.xalancbmk_r 13486.000 -
525.x264_r 6310.000 -1.05%
526.blender_r 12203.000 -
527.cam4_r 11213.000 -
531.deepsjeng_r 8782.000 1.76%
538.imagick_r 15028.000 -
541.leela_r 12597.000 -
544.nab_r 14471.000 -
548.exchange2_r 7400.000 -
549.fotonik3d_r 18036.000 -
554.roms_r 15299.000 -
557.xz_r 11654.000 -
Geometric Mean 12833.580 -
Name Current %
500.perlbench_r 2409972.000 -
502.gcc_r 9994478.000 -
503.bwaves_r 31017.000 -
505.mcf_r 28760.000 -
507.cactuBSSN_r 4201931.000 -
508.namd_r 728728.000 -
510.parest_r 8566728.000 -
511.povray_r 997665.000 -
519.lbm_r 15165.000 -
520.omnetpp_r 2210908.000 -
521.wrf_r 20052121.000 -
523.xalancbmk_r 5494979.000 -
525.x264_r 625348.000 -
526.blender_r 11102225.000 -
527.cam4_r 18560370.000 -
531.deepsjeng_r 95689.000 -
538.imagick_r 2139528.000 -
541.leela_r 203287.000 -
544.nab_r 209691.000 -
548.exchange2_r 177601.000 -
549.fotonik3d_r 405066.000 -
554.roms_r 1060021.000 -
557.xz_r 203093.000 -
Geometric Mean 865616.123 -
Name Current %
500.perlbench_r 50.000 2.04%
500.perlbench_r (avg) 50.000 2.04%
500.perlbench_r (avg) (percentage) 0.360 -
500.perlbench_r (max) 50.000 -3.85%
500.perlbench_r (max) (percentage) 0.360 -5.26%
503.bwaves_r 75.000 5.63%
503.bwaves_r (avg) 75.000 5.63%
503.bwaves_r (avg) (percentage) 0.370 5.71%
503.bwaves_r (max) 129.000 7.50%
503.bwaves_r (max) (percentage) 0.630 6.78%
503.bwaves_r (unexplained diff vs previous) 128.000 6.67%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.620 5.08%
505.mcf_r 53.000 -
505.mcf_r (avg) 53.000 -
505.mcf_r (avg) (percentage) 0.410 -
505.mcf_r (max) 66.000 -2.94%
505.mcf_r (max) (percentage) 0.510 -3.77%
507.cactuBSSN_r 72.000 -
507.cactuBSSN_r (avg) 72.000 -
507.cactuBSSN_r (avg) (percentage) 0.590 -
507.cactuBSSN_r (max) 158.000 -3.66%
507.cactuBSSN_r (max) (percentage) 1.290 -3.73%
508.namd_r 45.000 -
508.namd_r (avg) 45.000 -
508.namd_r (avg) (percentage) 0.490 -
508.namd_r (max) 53.000 -3.64%
508.namd_r (max) (percentage) 0.570 -3.39%
510.parest_r 37.000 -
510.parest_r (avg) 37.000 -
510.parest_r (avg) (percentage) 0.170 -
510.parest_r (max) 46.000 -
510.parest_r (max) (percentage) 0.210 -
511.povray_r 101.000 -
511.povray_r (avg) 101.000 -
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 36.000 -5.26%
511.povray_r (max) (percentage) 0.190 -5.00%
519.lbm_r 41.000 -
519.lbm_r (avg) 41.000 -
519.lbm_r (avg) (percentage) 0.270 -
519.lbm_r (max) 41.000 41.38%
519.lbm_r (max) (percentage) 0.270 42.11%
519.lbm_r (unexplained diff vs previous) 41.000 720.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.270 800.00%
520.omnetpp_r 99.000 2.06%
520.omnetpp_r (avg) 99.000 2.06%
520.omnetpp_r (avg) (percentage) 0.720 -
520.omnetpp_r (max) 287.000 -6.51%
520.omnetpp_r (max) (percentage) 2.090 -8.33%
521.wrf_r 152.000 -
521.wrf_r (avg) 152.000 -
521.wrf_r (avg) (percentage) 1.300 -
521.wrf_r (max) 209.000 -3.69%
521.wrf_r (max) (percentage) 1.790 -3.24%
523.xalancbmk_r 41.000 -2.38%
523.xalancbmk_r (avg) 41.000 -2.38%
523.xalancbmk_r (avg) (percentage) 0.310 -
523.xalancbmk_r (max) 47.000 -2.08%
523.xalancbmk_r (max) (percentage) 0.350 -2.78%
525.x264_r 14.000 -
525.x264_r (avg) 14.000 -
525.x264_r (avg) (percentage) 0.230 -
525.x264_r (max) 6.000 -14.29%
525.x264_r (max) (percentage) 0.110 -
526.blender_r 46.000 -
526.blender_r (avg) 46.000 -
526.blender_r (avg) (percentage) 0.380 -
526.blender_r (max) 119.000 -2.46%
526.blender_r (max) (percentage) 0.980 -2.00%
527.cam4_r 50.000 -
527.cam4_r (avg) 50.000 -
527.cam4_r (avg) (percentage) 0.450 -
527.cam4_r (max) 104.000 -1.89%
527.cam4_r (max) (percentage) 0.930 -2.11%
531.deepsjeng_r 55.000 1.85%
531.deepsjeng_r (avg) 55.000 1.85%
531.deepsjeng_r (avg) (percentage) 0.630 -
531.deepsjeng_r (max) 18.000 -
531.deepsjeng_r (max) (percentage) 0.210 -4.55%
538.imagick_r 30.000 -
538.imagick_r (avg) 30.000 -
538.imagick_r (avg) (percentage) 0.200 -
538.imagick_r (max) 51.000 -
538.imagick_r (max) (percentage) 0.340 -
541.leela_r 28.000 -3.45%
541.leela_r (avg) 28.000 -3.45%
541.leela_r (avg) (percentage) 0.230 -
541.leela_r (max) 79.000 -7.06%
541.leela_r (max) (percentage) 0.630 -5.97%
544.nab_r 30.000 -
544.nab_r (avg) 30.000 -
544.nab_r (avg) (percentage) 0.210 -
544.nab_r (max) 41.000 -6.82%
544.nab_r (max) (percentage) 0.290 -6.45%
548.exchange2_r 28.000 -
548.exchange2_r (avg) 28.000 -
548.exchange2_r (avg) (percentage) 0.380 -
548.exchange2_r (max) 44.000 -10.20%
548.exchange2_r (max) (percentage) 0.600 -10.45%
548.exchange2_r (unexplained diff vs previous) 29.000 -17.14%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.390 -17.02%
549.fotonik3d_r 77.000 -
549.fotonik3d_r (avg) 77.000 -
549.fotonik3d_r (avg) (percentage) 0.430 -
549.fotonik3d_r (max) 99.000 -10.00%
549.fotonik3d_r (max) (percentage) 0.550 -9.84%
549.fotonik3d_r (unexplained diff vs previous) 65.000 -41.44%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.360 -40.98%
554.roms_r 48.000 -2.04%
554.roms_r (avg) 48.000 -2.04%
554.roms_r (avg) (percentage) 0.320 -
554.roms_r (max) 18.000 -5.26%
554.roms_r (max) (percentage) 0.120 -7.69%
557.xz_r 16.000 -
557.xz_r (avg) 16.000 -
557.xz_r (avg) (percentage) 0.140 -
557.xz_r (max) 19.000 -5.00%
557.xz_r (max) (percentage) 0.170 -
Geometric Mean 6.949 1.65%