Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=389971df23ca74092314dbde1303310a33766ba7 (+ 44 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fc0553d61e110a293d52405672cfe9919d7ecc12 (+ 144 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=da55fae9e277a0c138d4395fee505e5d2f8b2b84 (+ 14 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=e6a62f955681c58f49b1ce74222d6670fb55bb33 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/40/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0040 (3-changed-components) 2023-05-21T13:36:49 0:00:00
Previous 0039 (3-changed-components) 2023-05-18T11:11:17 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 5
Performance Improvements 45 7
Added Tests 0 110
Unchanged Tests 876 814
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 1.29% 13760.000 13938.000 - 2.12% -
526.blender_r 1.02% 12073.000 12196.000 - 0.18% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 234.69% 0.490 1.640 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 229.85% 67.000 221.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 107.14% 14.000 29.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 100.00% 0.060 0.120 - 0.00% -
520.omnetpp_r (max) (percentage) 97.56% 0.820 1.620 - 0.00% -
520.omnetpp_r (max) 93.75% 112.000 217.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 12.90% 0.620 0.700 - 0.00% -
520.omnetpp_r 11.90% 84.000 94.000 - 0.00% -
520.omnetpp_r (avg) 11.90% 84.000 94.000 - 0.00% -
500.perlbench_r 1.98% 101.000 103.000 - 0.00% -
500.perlbench_r (avg) 1.98% 101.000 103.000 - 0.00% -
507.cactuBSSN_r 1.41% 71.000 72.000 - 0.00% -
507.cactuBSSN_r (avg) 1.41% 71.000 72.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -1.89% 7497.000 7355.000 - -1.18% -
520.omnetpp_r -1.62% 13670.000 13449.000 - 0.22% -
541.leela_r -1.14% 11731.000 11597.000 - -0.34% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r (max) -60.00% 55.000 22.000 - 0.00% -
548.exchange2_r (max) (percentage) -59.46% 0.740 0.300 - 0.00% -
548.exchange2_r (unexplained diff vs previous) -56.00% 25.000 11.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) -54.55% 0.330 0.150 - 0.00% -
519.lbm_r (max) -7.69% 26.000 24.000 - 0.00% -
554.roms_r (max) (percentage) -7.50% 0.400 0.370 - 0.00% -
541.leela_r -7.14% 14.000 13.000 - 0.00% -
541.leela_r (avg) -7.14% 14.000 13.000 - 0.00% -
554.roms_r (max) -6.56% 61.000 57.000 - 0.00% -
548.exchange2_r (avg) (percentage) -6.52% 0.460 0.430 - 0.00% -
519.lbm_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
544.nab_r (max) -6.12% 49.000 46.000 - 0.00% -
510.parest_r (max) -6.00% 50.000 47.000 - 0.00% -
544.nab_r (max) (percentage) -5.88% 0.340 0.320 - 0.00% -
503.bwaves_r -5.88% 85.000 80.000 - 0.00% -
503.bwaves_r (avg) -5.88% 85.000 80.000 - 0.00% -
548.exchange2_r -5.88% 34.000 32.000 - 0.00% -
548.exchange2_r (avg) -5.88% 34.000 32.000 - 0.00% -
508.namd_r (max) -5.56% 54.000 51.000 - 0.00% -
503.bwaves_r (avg) (percentage) -5.56% 0.360 0.340 - 0.00% -
549.fotonik3d_r (max) -5.41% 111.000 105.000 - 0.00% -
525.x264_r (max) -5.00% 20.000 19.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -4.92% 0.610 0.580 - 0.00% -
511.povray_r (max) -4.49% 89.000 85.000 - 0.00% -
510.parest_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
511.povray_r (max) (percentage) -4.17% 0.480 0.460 - 0.00% -
503.bwaves_r (max) -4.08% 49.000 47.000 - 0.00% -
505.mcf_r -4.00% 25.000 24.000 - 0.00% -
505.mcf_r (avg) -4.00% 25.000 24.000 - 0.00% -
531.deepsjeng_r (max) -3.85% 52.000 50.000 - 0.00% -
508.namd_r (max) (percentage) -3.45% 0.580 0.560 - 0.00% -
525.x264_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.86% 0.700 0.680 - 0.00% -
538.imagick_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
500.perlbench_r (max) (percentage) -2.19% 1.370 1.340 - 0.00% -
507.cactuBSSN_r (max) (percentage) -2.02% 0.990 0.970 - 0.00% -
538.imagick_r (max) -2.00% 50.000 49.000 - 0.00% -
521.wrf_r (max) (percentage) -1.73% 1.730 1.700 - 0.00% -
549.fotonik3d_r -1.72% 58.000 57.000 - 0.00% -
549.fotonik3d_r (avg) -1.72% 58.000 57.000 - 0.00% -
523.xalancbmk_r (max) -1.64% 61.000 60.000 - 0.00% -
500.perlbench_r (max) -1.06% 188.000 186.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r 2.35% 11500.000 11770.000 - 0.72% -
500.perlbench_r 2.12% 13648.000 13938.000 - 1.29% -
548.exchange2_r 1.43% 7395.000 7501.000 - -0.15% -
554.roms_r 1.14% 15236.000 15409.000 - -0.36% -
508.namd_r 1.09% 9181.000 9281.000 - -0.39% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -4.10% 108073.000 103644.000 - -0.15% -
520.omnetpp_r -3.35% 1925630.000 1861026.000 - 0.08% -
510.parest_r -1.95% 1726330.000 1692726.000 - -0.05% -
511.povray_r -1.89% 1093239.000 1072603.000 - -0.45% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -3.37% 6489.000 6270.000 - -0.13% -
507.cactuBSSN_r -1.88% 12761.000 12521.000 - 0.91% -
531.deepsjeng_r -1.18% 7443.000 7355.000 - -1.89% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 13938.000 1.29%
502.gcc_r 9948.000 -
503.bwaves_r 23762.000 -
505.mcf_r 11901.000 -
507.cactuBSSN_r 12521.000 -
508.namd_r 9281.000 -
510.parest_r 21686.000 -
511.povray_r 18601.000 -
519.lbm_r 16248.000 -
520.omnetpp_r 13449.000 -1.62%
521.wrf_r 11770.000 -
523.xalancbmk_r 13133.000 -
525.x264_r 6270.000 -
526.blender_r 12196.000 1.02%
527.cam4_r 11015.000 -
531.deepsjeng_r 7355.000 -1.89%
538.imagick_r 14030.000 -
541.leela_r 11597.000 -1.14%
544.nab_r 14421.000 -
548.exchange2_r 7501.000 -
549.fotonik3d_r 18113.000 -
554.roms_r 15409.000 -
557.xz_r 11546.000 -
Geometric Mean 12638.186 -
Name Current %
500.perlbench_r 2660398.000 -
502.gcc_r 10146621.000 -
503.bwaves_r 32648.000 -
505.mcf_r 23304.000 -
507.cactuBSSN_r 3708961.000 -
508.namd_r 708150.000 -
510.parest_r 1692726.000 -
511.povray_r 1072603.000 -
519.lbm_r 12092.000 -
520.omnetpp_r 1861026.000 -
521.wrf_r 15473653.000 -
523.xalancbmk_r 3736140.000 -
525.x264_r 645149.000 -
526.blender_r 11456717.000 -
527.cam4_r 3290803.000 -
531.deepsjeng_r 85195.000 -
538.imagick_r 1575398.000 -
541.leela_r 103644.000 -
544.nab_r 97070.000 -
548.exchange2_r 165141.000 -
549.fotonik3d_r 407417.000 -
554.roms_r 856366.000 -
557.xz_r 146614.000 -
Geometric Mean 640401.863 -
Name Current %
500.perlbench_r 103.000 1.98%
500.perlbench_r (avg) 103.000 1.98%
500.perlbench_r (avg) (percentage) 0.740 -
500.perlbench_r (max) 186.000 -1.06%
500.perlbench_r (max) (percentage) 1.340 -2.19%
503.bwaves_r 80.000 -5.88%
503.bwaves_r (avg) 80.000 -5.88%
503.bwaves_r (avg) (percentage) 0.340 -5.56%
503.bwaves_r (max) 47.000 -4.08%
503.bwaves_r (max) (percentage) 0.200 -
503.bwaves_r (unexplained diff vs previous) 29.000 107.14%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.120 100.00%
505.mcf_r 24.000 -4.00%
505.mcf_r (avg) 24.000 -4.00%
505.mcf_r (avg) (percentage) 0.210 -
505.mcf_r (max) 14.000 -
505.mcf_r (max) (percentage) 0.120 -
507.cactuBSSN_r 72.000 1.41%
507.cactuBSSN_r (avg) 72.000 1.41%
507.cactuBSSN_r (avg) (percentage) 0.580 -
507.cactuBSSN_r (max) 121.000 -
507.cactuBSSN_r (max) (percentage) 0.970 -2.02%
508.namd_r 44.000 -
508.namd_r (avg) 44.000 -
508.namd_r (avg) (percentage) 0.480 -
508.namd_r (max) 51.000 -5.56%
508.namd_r (max) (percentage) 0.560 -3.45%
510.parest_r 45.000 -
510.parest_r (avg) 45.000 -
510.parest_r (avg) (percentage) 0.210 -
510.parest_r (max) 47.000 -6.00%
510.parest_r (max) (percentage) 0.220 -4.35%
511.povray_r 76.000 -
511.povray_r (avg) 76.000 -
511.povray_r (avg) (percentage) 0.410 -
511.povray_r (max) 85.000 -4.49%
511.povray_r (max) (percentage) 0.460 -4.17%
519.lbm_r 22.000 -
519.lbm_r (avg) 22.000 -
519.lbm_r (avg) (percentage) 0.140 -
519.lbm_r (max) 24.000 -7.69%
519.lbm_r (max) (percentage) 0.150 -6.25%
520.omnetpp_r 94.000 11.90%
520.omnetpp_r (avg) 94.000 11.90%
520.omnetpp_r (avg) (percentage) 0.700 12.90%
520.omnetpp_r (max) 217.000 93.75%
520.omnetpp_r (max) (percentage) 1.620 97.56%
520.omnetpp_r (unexplained diff vs previous) 221.000 229.85%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.640 234.69%
521.wrf_r 98.000 -
521.wrf_r (avg) 98.000 -
521.wrf_r (avg) (percentage) 0.840 -
521.wrf_r (max) 200.000 -
521.wrf_r (max) (percentage) 1.700 -1.73%
523.xalancbmk_r 30.000 -
523.xalancbmk_r (avg) 30.000 -
523.xalancbmk_r (avg) (percentage) 0.230 -
523.xalancbmk_r (max) 60.000 -1.64%
523.xalancbmk_r (max) (percentage) 0.460 -
525.x264_r 10.000 -
525.x264_r (avg) 10.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 19.000 -5.00%
525.x264_r (max) (percentage) 0.310 -3.13%
526.blender_r 26.000 -
526.blender_r (avg) 26.000 -
526.blender_r (avg) (percentage) 0.220 -
526.blender_r (max) 24.000 -
526.blender_r (max) (percentage) 0.200 -
527.cam4_r 36.000 -
527.cam4_r (avg) 36.000 -
527.cam4_r (avg) (percentage) 0.330 -
527.cam4_r (max) 40.000 -
527.cam4_r (max) (percentage) 0.370 -
531.deepsjeng_r 38.000 -
531.deepsjeng_r (avg) 38.000 -
531.deepsjeng_r (avg) (percentage) 0.520 -
531.deepsjeng_r (max) 50.000 -3.85%
531.deepsjeng_r (max) (percentage) 0.680 -2.86%
538.imagick_r 15.000 -
538.imagick_r (avg) 15.000 -
538.imagick_r (avg) (percentage) 0.110 -
538.imagick_r (max) 49.000 -2.00%
538.imagick_r (max) (percentage) 0.350 -2.78%
541.leela_r 13.000 -7.14%
541.leela_r (avg) 13.000 -7.14%
541.leela_r (avg) (percentage) 0.120 -
541.leela_r (max) 22.000 -
541.leela_r (max) (percentage) 0.190 -
544.nab_r 46.000 -
544.nab_r (avg) 46.000 -
544.nab_r (avg) (percentage) 0.320 -
544.nab_r (max) 46.000 -6.12%
544.nab_r (max) (percentage) 0.320 -5.88%
548.exchange2_r 32.000 -5.88%
548.exchange2_r (avg) 32.000 -5.88%
548.exchange2_r (avg) (percentage) 0.430 -6.52%
548.exchange2_r (max) 22.000 -60.00%
548.exchange2_r (max) (percentage) 0.300 -59.46%
548.exchange2_r (unexplained diff vs previous) 11.000 -56.00%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.150 -54.55%
549.fotonik3d_r 57.000 -1.72%
549.fotonik3d_r (avg) 57.000 -1.72%
549.fotonik3d_r (avg) (percentage) 0.320 -
549.fotonik3d_r (max) 105.000 -5.41%
549.fotonik3d_r (max) (percentage) 0.580 -4.92%
554.roms_r 49.000 -
554.roms_r (avg) 49.000 -
554.roms_r (avg) (percentage) 0.320 -
554.roms_r (max) 57.000 -6.56%
554.roms_r (max) (percentage) 0.370 -7.50%
557.xz_r 5.000 -
557.xz_r (avg) 5.000 -
557.xz_r (avg) (percentage) 0.050 -
557.xz_r (max) 8.000 -
557.xz_r (max) (percentage) 0.070 -
Geometric Mean 5.696 -