Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=618e9847c576e97724a39077925588e4c19119b2 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/b98c63e9e8ceaf9e04c28d83500f98313284c7f8 (+ 56 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=533deafbdf189f5fbb280c28562dd43ace2f4b0f (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=4b69fbd471e9b8cad99b37c284710edefbf25ee9 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/26/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0026 (basepoints/gcc-14-00196-gb98c63e9e8c) 2023-04-22T23:11:35 0:00:00
Previous 0025 (2-changed-components) 2023-04-21T09:20:11 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 6
Performance Improvements 55 5
Added Tests 0 105
Unchanged Tests 842 796
Total Tests 912

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r 2.55% 164701.000 168909.000 - 2.45% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 2.10% 18600.000 18991.000 - 1.33% -
520.omnetpp_r 1.55% 13552.000 13762.000 - 2.56% -
500.perlbench_r 1.36% 13811.000 13999.000 - 2.57% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) 750.00% 0.180 1.530 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 740.00% 25.000 210.000 - 0.00% -
520.omnetpp_r (max) 545.45% 33.000 213.000 - 0.00% -
520.omnetpp_r (max) (percentage) 520.00% 0.250 1.550 - 0.00% -
520.omnetpp_r 22.08% 77.000 94.000 - 0.00% -
520.omnetpp_r (avg) 22.08% 77.000 94.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 21.05% 0.570 0.690 - 0.00% -
511.povray_r 2.00% 100.000 102.000 - 0.00% -
511.povray_r (avg) 2.00% 100.000 102.000 - 0.00% -
500.perlbench_r 1.15% 87.000 88.000 - 0.00% -
500.perlbench_r (avg) 1.15% 87.000 88.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -3.70% 12007.000 11563.000 - 0.55% -
531.deepsjeng_r -1.16% 7505.000 7418.000 - -0.34% -
502.gcc_r -1.07% 10004.000 9897.000 - -0.07% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) -46.67% 0.600 0.320 - 0.00% -
544.nab_r (unexplained diff vs previous) -45.88% 85.000 46.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) -20.00% 5.000 4.000 - 0.00% -
544.nab_r (max) (percentage) -16.95% 0.590 0.490 - 0.00% -
544.nab_r (max) -16.67% 84.000 70.000 - 0.00% -
538.imagick_r (max) (percentage) -14.29% 0.070 0.060 - 0.00% -
519.lbm_r (avg) (percentage) -13.33% 0.150 0.130 - 0.00% -
519.lbm_r -12.50% 24.000 21.000 - 0.00% -
519.lbm_r (avg) -12.50% 24.000 21.000 - 0.00% -
519.lbm_r (max) -12.50% 16.000 14.000 - 0.00% -
531.deepsjeng_r (max) -11.65% 103.000 91.000 - 0.00% -
503.bwaves_r (max) -11.11% 135.000 120.000 - 0.00% -
538.imagick_r (max) -11.11% 9.000 8.000 - 0.00% -
503.bwaves_r (max) (percentage) -10.53% 0.570 0.510 - 0.00% -
531.deepsjeng_r (max) (percentage) -10.14% 1.380 1.240 - 0.00% -
519.lbm_r (max) (percentage) -10.00% 0.100 0.090 - 0.00% -
554.roms_r (max) (percentage) -8.11% 0.370 0.340 - 0.00% -
554.roms_r (max) -7.14% 56.000 52.000 - 0.00% -
521.wrf_r (max) -6.90% 261.000 243.000 - 0.00% -
508.namd_r (max) -6.74% 89.000 83.000 - 0.00% -
505.mcf_r (max) (percentage) -6.00% 0.500 0.470 - 0.00% -
549.fotonik3d_r (max) (percentage) -5.77% 0.520 0.490 - 0.00% -
541.leela_r (max) -5.56% 36.000 34.000 - 0.00% -
548.exchange2_r (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
500.perlbench_r (max) (percentage) -5.48% 0.730 0.690 - 0.00% -
549.fotonik3d_r (max) -5.38% 93.000 88.000 - 0.00% -
508.namd_r (max) (percentage) -5.21% 0.960 0.910 - 0.00% -
505.mcf_r (max) -5.08% 59.000 56.000 - 0.00% -
511.povray_r (max) (percentage) -4.49% 0.890 0.850 - 0.00% -
500.perlbench_r (max) -4.00% 100.000 96.000 - 0.00% -
548.exchange2_r (max) -3.85% 26.000 25.000 - 0.00% -
521.wrf_r -3.76% 186.000 179.000 - 0.00% -
521.wrf_r (avg) -3.76% 186.000 179.000 - 0.00% -
544.nab_r -3.70% 54.000 52.000 - 0.00% -
544.nab_r (avg) -3.70% 54.000 52.000 - 0.00% -
510.parest_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
541.leela_r (max) (percentage) -3.23% 0.310 0.300 - 0.00% -
521.wrf_r (max) (percentage) -3.21% 2.180 2.110 - 0.00% -
510.parest_r (max) -2.99% 67.000 65.000 - 0.00% -
510.parest_r -2.70% 37.000 36.000 - 0.00% -
510.parest_r (avg) -2.70% 37.000 36.000 - 0.00% -
544.nab_r (avg) (percentage) -2.63% 0.380 0.370 - 0.00% -
511.povray_r (max) -2.42% 165.000 161.000 - 0.00% -
531.deepsjeng_r -2.08% 48.000 47.000 - 0.00% -
531.deepsjeng_r (avg) -2.08% 48.000 47.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -2.00% 0.500 0.490 - 0.00% -
526.blender_r (max) (percentage) -1.89% 0.530 0.520 - 0.00% -
526.blender_r (max) -1.56% 64.000 63.000 - 0.00% -
523.xalancbmk_r (max) -1.54% 65.000 64.000 - 0.00% -
503.bwaves_r -1.20% 83.000 82.000 - 0.00% -
503.bwaves_r (avg) -1.20% 83.000 82.000 - 0.00% -
507.cactuBSSN_r (max) -1.16% 86.000 85.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r 2.45% 164865.000 168909.000 - 2.55% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 2.57% 13648.000 13999.000 - 1.36% -
520.omnetpp_r 2.56% 13419.000 13762.000 - 1.55% -
548.exchange2_r 1.89% 7395.000 7535.000 - 0.59% -
527.cam4_r 1.79% 11105.000 11304.000 - 0.86% -
511.povray_r 1.33% 18742.000 18991.000 - 2.10% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -4.06% 108073.000 103682.000 - 0.08% -
520.omnetpp_r -3.43% 1925630.000 1859620.000 - 0.21% -
510.parest_r -1.67% 1726330.000 1697584.000 - 0.00% -
511.povray_r -1.03% 1093239.000 1082027.000 - 0.31% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r -1.89% 12761.000 12520.000 - 0.23% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13999.000 1.36%
502.gcc_r 9897.000 -1.07%
503.bwaves_r 23710.000 -
505.mcf_r 11967.000 -
507.cactuBSSN_r 12520.000 -
508.namd_r 9207.000 -
510.parest_r 21753.000 -
511.povray_r 18991.000 2.10%
519.lbm_r 16245.000 -
520.omnetpp_r 13762.000 1.55%
521.wrf_r 11563.000 -3.70%
523.xalancbmk_r 13080.000 -
525.x264_r 6489.000 -
526.blender_r 12238.000 -
527.cam4_r 11304.000 -
531.deepsjeng_r 7418.000 -1.16%
538.imagick_r 14100.000 -
541.leela_r 11643.000 -
544.nab_r 14294.000 -
548.exchange2_r 7535.000 -
549.fotonik3d_r 18085.000 -
554.roms_r 15374.000 -
557.xz_r 11606.000 -
Geometric Mean 12691.887 -
Name Current %
500.perlbench_r 2657086.000 -
502.gcc_r 10115285.000 -
503.bwaves_r 32664.000 -
505.mcf_r 23320.000 -
507.cactuBSSN_r 3711855.000 -
508.namd_r 707404.000 -
510.parest_r 1697584.000 -
511.povray_r 1082027.000 -
519.lbm_r 12112.000 -
520.omnetpp_r 1859620.000 -
521.wrf_r 15524053.000 -
523.xalancbmk_r 3740246.000 -
525.x264_r 647989.000 -
526.blender_r 11447807.000 -
527.cam4_r 3299603.000 -
531.deepsjeng_r 85419.000 -
538.imagick_r 1565506.000 -
541.leela_r 103682.000 -
544.nab_r 97122.000 -
548.exchange2_r 168909.000 2.55%
549.fotonik3d_r 411041.000 -
554.roms_r 856142.000 -
557.xz_r 146886.000 -
Geometric Mean 641794.055 -
Name Current %
500.perlbench_r 88.000 1.15%
500.perlbench_r (avg) 88.000 1.15%
500.perlbench_r (avg) (percentage) 0.630 -
500.perlbench_r (max) 96.000 -4.00%
500.perlbench_r (max) (percentage) 0.690 -5.48%
503.bwaves_r 82.000 -1.20%
503.bwaves_r (avg) 82.000 -1.20%
503.bwaves_r (avg) (percentage) 0.350 -
503.bwaves_r (max) 120.000 -11.11%
503.bwaves_r (max) (percentage) 0.510 -10.53%
505.mcf_r 38.000 -
505.mcf_r (avg) 38.000 -
505.mcf_r (avg) (percentage) 0.320 -
505.mcf_r (max) 56.000 -5.08%
505.mcf_r (max) (percentage) 0.470 -6.00%
507.cactuBSSN_r 66.000 -
507.cactuBSSN_r (avg) 66.000 -
507.cactuBSSN_r (avg) (percentage) 0.530 -
507.cactuBSSN_r (max) 85.000 -1.16%
507.cactuBSSN_r (max) (percentage) 0.680 -
508.namd_r 54.000 -
508.namd_r (avg) 54.000 -
508.namd_r (avg) (percentage) 0.590 -
508.namd_r (max) 83.000 -6.74%
508.namd_r (max) (percentage) 0.910 -5.21%
510.parest_r 36.000 -2.70%
510.parest_r (avg) 36.000 -2.70%
510.parest_r (avg) (percentage) 0.170 -
510.parest_r (max) 65.000 -2.99%
510.parest_r (max) (percentage) 0.300 -3.23%
511.povray_r 102.000 2.00%
511.povray_r (avg) 102.000 2.00%
511.povray_r (avg) (percentage) 0.540 -
511.povray_r (max) 161.000 -2.42%
511.povray_r (max) (percentage) 0.850 -4.49%
519.lbm_r 21.000 -12.50%
519.lbm_r (avg) 21.000 -12.50%
519.lbm_r (avg) (percentage) 0.130 -13.33%
519.lbm_r (max) 14.000 -12.50%
519.lbm_r (max) (percentage) 0.090 -10.00%
519.lbm_r (unexplained diff vs previous) 4.000 -20.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.020 -
520.omnetpp_r 94.000 22.08%
520.omnetpp_r (avg) 94.000 22.08%
520.omnetpp_r (avg) (percentage) 0.690 21.05%
520.omnetpp_r (max) 213.000 545.45%
520.omnetpp_r (max) (percentage) 1.550 520.00%
520.omnetpp_r (unexplained diff vs previous) 210.000 740.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.530 750.00%
521.wrf_r 179.000 -3.76%
521.wrf_r (avg) 179.000 -3.76%
521.wrf_r (avg) (percentage) 1.550 -
521.wrf_r (max) 243.000 -6.90%
521.wrf_r (max) (percentage) 2.110 -3.21%
523.xalancbmk_r 36.000 -
523.xalancbmk_r (avg) 36.000 -
523.xalancbmk_r (avg) (percentage) 0.280 -
523.xalancbmk_r (max) 64.000 -1.54%
523.xalancbmk_r (max) (percentage) 0.490 -2.00%
525.x264_r 11.000 -
525.x264_r (avg) 11.000 -
525.x264_r (avg) (percentage) 0.170 -
525.x264_r (max) 17.000 -
525.x264_r (max) (percentage) 0.270 -
526.blender_r 37.000 -
526.blender_r (avg) 37.000 -
526.blender_r (avg) (percentage) 0.310 -
526.blender_r (max) 63.000 -1.56%
526.blender_r (max) (percentage) 0.520 -1.89%
531.deepsjeng_r 47.000 -2.08%
531.deepsjeng_r (avg) 47.000 -2.08%
531.deepsjeng_r (avg) (percentage) 0.640 -
531.deepsjeng_r (max) 91.000 -11.65%
531.deepsjeng_r (max) (percentage) 1.240 -10.14%
538.imagick_r 9.000 -
538.imagick_r (avg) 9.000 -
538.imagick_r (avg) (percentage) 0.070 -
538.imagick_r (max) 8.000 -11.11%
538.imagick_r (max) (percentage) 0.060 -14.29%
541.leela_r 18.000 -
541.leela_r (avg) 18.000 -
541.leela_r (avg) (percentage) 0.160 -
541.leela_r (max) 34.000 -5.56%
541.leela_r (max) (percentage) 0.300 -3.23%
544.nab_r 52.000 -3.70%
544.nab_r (avg) 52.000 -3.70%
544.nab_r (avg) (percentage) 0.370 -2.63%
544.nab_r (max) 70.000 -16.67%
544.nab_r (max) (percentage) 0.490 -16.95%
544.nab_r (unexplained diff vs previous) 46.000 -45.88%
544.nab_r (unexplained diff vs previous) (percentage) 0.320 -46.67%
548.exchange2_r 13.000 -
548.exchange2_r (avg) 13.000 -
548.exchange2_r (avg) (percentage) 0.180 -
548.exchange2_r (max) 25.000 -3.85%
548.exchange2_r (max) (percentage) 0.340 -5.56%
549.fotonik3d_r 68.000 -
549.fotonik3d_r (avg) 68.000 -
549.fotonik3d_r (avg) (percentage) 0.380 -
549.fotonik3d_r (max) 88.000 -5.38%
549.fotonik3d_r (max) (percentage) 0.490 -5.77%
554.roms_r 52.000 -
554.roms_r (avg) 52.000 -
554.roms_r (avg) (percentage) 0.340 -
554.roms_r (max) 52.000 -7.14%
554.roms_r (max) (percentage) 0.340 -8.11%
557.xz_r 6.000 -
557.xz_r (avg) 6.000 -
557.xz_r (avg) (percentage) 0.060 -
557.xz_r (max) 6.000 -
557.xz_r (max) (percentage) 0.060 -
Geometric Mean 6.095 3.26%