Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=12f7174bf069f407d5b6f12e926ceabe45e450e1 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/d08f2e4f74583e27002368989bba197f8eb7f6d2 (+ 78 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=abcf8db7fa46b73fd5b8193ce11f9312301b84c7 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=cf2e1dca2069cc2209ac8aa55b2f686c80d272fe (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3-build/53/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0053 (basepoints/gcc-14-01629-gd08f2e4f745) 2023-06-07T17:22:35 0:00:00
Previous 0052 (basepoints/gcc-14-01551-g2f482a07365) 2023-06-07T04:33:38 0:00:00
Baseline 0001 (4-changed-components) 2023-02-25T21:59:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 13 7
Performance Improvements 62 5
Added Tests 2 109
Unchanged Tests 859 815
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 2.24% 18984.000 19409.000 - 2.98% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r (unexplained diff vs previous) 51.52% 33.000 50.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) 48.89% 0.450 0.670 - 0.00% -
508.namd_r 6.25% 48.000 51.000 - 0.00% -
508.namd_r (avg) 6.25% 48.000 51.000 - 0.00% -
508.namd_r (avg) (percentage) 5.77% 0.520 0.550 - 0.00% -
548.exchange2_r 3.12% 32.000 33.000 - 0.00% -
548.exchange2_r (avg) 3.12% 32.000 33.000 - 0.00% -
511.povray_r 2.48% 121.000 124.000 - 0.00% -
511.povray_r (avg) 2.48% 121.000 124.000 - 0.00% -
548.exchange2_r (avg) (percentage) 2.27% 0.440 0.450 - 0.00% -
531.deepsjeng_r 1.85% 54.000 55.000 - 0.00% -
531.deepsjeng_r (avg) 1.85% 54.000 55.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -2.84% 12034.000 11692.000 - 1.12% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) -73.33% 0.450 0.120 - 0.00% -
544.nab_r (unexplained diff vs previous) -72.31% 65.000 18.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) -60.00% 0.700 0.280 - 0.00% -
503.bwaves_r (unexplained diff vs previous) -59.44% 143.000 58.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) -38.71% 62.000 38.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -37.50% 0.400 0.250 - 0.00% -
508.namd_r (unexplained diff vs previous) -33.90% 118.000 78.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -32.80% 1.250 0.840 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -27.91% 0.430 0.310 - 0.00% -
505.mcf_r (unexplained diff vs previous) -26.79% 56.000 41.000 - 0.00% -
508.namd_r (max) -26.05% 119.000 88.000 - 0.00% -
508.namd_r (max) (percentage) -25.20% 1.270 0.950 - 0.00% -
544.nab_r (max) -24.62% 65.000 49.000 - 0.00% -
544.nab_r (max) (percentage) -24.44% 0.450 0.340 - 0.00% -
519.lbm_r (max) (percentage) -24.39% 0.410 0.310 - 0.00% -
519.lbm_r (max) -24.19% 62.000 47.000 - 0.00% -
520.omnetpp_r (max) -16.76% 173.000 144.000 - 0.00% -
520.omnetpp_r (max) (percentage) -16.67% 1.260 1.050 - 0.00% -
523.xalancbmk_r (max) (percentage) -13.64% 0.440 0.380 - 0.00% -
523.xalancbmk_r (max) -13.56% 59.000 51.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -11.90% 0.420 0.370 - 0.00% -
549.fotonik3d_r (max) -11.84% 76.000 67.000 - 0.00% -
505.mcf_r (max) (percentage) -10.87% 0.460 0.410 - 0.00% -
505.mcf_r (max) -10.17% 59.000 53.000 - 0.00% -
503.bwaves_r (max) (percentage) -10.00% 0.700 0.630 - 0.00% -
548.exchange2_r (max) (percentage) -9.89% 0.910 0.820 - 0.00% -
503.bwaves_r (max) -9.86% 142.000 128.000 - 0.00% -
548.exchange2_r (max) -8.96% 67.000 61.000 - 0.00% -
521.wrf_r (max) -8.28% 169.000 155.000 - 0.00% -
520.omnetpp_r -6.00% 100.000 94.000 - 0.00% -
520.omnetpp_r (avg) -6.00% 100.000 94.000 - 0.00% -
511.povray_r (max) (percentage) -5.67% 1.410 1.330 - 0.00% -
521.wrf_r (max) (percentage) -5.67% 1.410 1.330 - 0.00% -
520.omnetpp_r (avg) (percentage) -5.48% 0.730 0.690 - 0.00% -
527.cam4_r (max) -4.62% 130.000 124.000 - 0.00% -
527.cam4_r (max) (percentage) -4.31% 1.160 1.110 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.29% 0.700 0.670 - 0.00% -
525.x264_r (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
554.roms_r (max) -4.08% 49.000 47.000 - 0.00% -
538.imagick_r (max) -3.85% 52.000 50.000 - 0.00% -
500.perlbench_r (max) -3.65% 274.000 264.000 - 0.00% -
511.povray_r (max) -3.37% 267.000 258.000 - 0.00% -
531.deepsjeng_r (max) -3.33% 60.000 58.000 - 0.00% -
554.roms_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
500.perlbench_r (max) (percentage) -3.05% 1.970 1.910 - 0.00% -
544.nab_r -2.94% 34.000 33.000 - 0.00% -
544.nab_r (avg) -2.94% 34.000 33.000 - 0.00% -
526.blender_r (max) -2.73% 110.000 107.000 - 0.00% -
521.wrf_r -2.63% 152.000 148.000 - 0.00% -
521.wrf_r (avg) -2.63% 152.000 148.000 - 0.00% -
503.bwaves_r (avg) (percentage) -2.56% 0.390 0.380 - 0.00% -
503.bwaves_r -2.53% 79.000 77.000 - 0.00% -
503.bwaves_r (avg) -2.53% 79.000 77.000 - 0.00% -
526.blender_r -2.22% 45.000 44.000 - 0.00% -
526.blender_r (avg) -2.22% 45.000 44.000 - 0.00% -
541.leela_r (max) -1.69% 59.000 58.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -1.64% 0.610 0.600 - 0.00% -
507.cactuBSSN_r (max) -1.33% 75.000 74.000 - 0.00% -
526.blender_r (max) (percentage) -1.11% 0.900 0.890 - 0.00% -
500.perlbench_r -1.11% 90.000 89.000 - 0.00% -
500.perlbench_r (avg) -1.11% 90.000 89.000 - 0.00% -

Added Tests - sample variability
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 2.98% 18848.000 19409.000 - 2.24% -
541.leela_r 2.71% 12456.000 12793.000 - 0.37% -
544.nab_r 1.63% 14213.000 14444.000 - -0.12% -
519.lbm_r 1.32% 15084.000 15283.000 - -0.25% -
521.wrf_r 1.12% 11563.000 11692.000 - -2.84% -
508.namd_r 1.04% 9234.000 9330.000 - -0.83% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -1.65% 2247841.000 2210764.000 - -0.01% -
508.namd_r -1.30% 738062.000 728456.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r -2.76% 14226.000 13834.000 - -0.87% -
538.imagick_r -1.20% 15083.000 14902.000 - 0.07% -
507.cactuBSSN_r -1.17% 12522.000 12376.000 - -0.49% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r (avg) (percentage)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13834.000 -
502.gcc_r 10236.000 -
503.bwaves_r 20398.000 -
505.mcf_r 13047.000 -
507.cactuBSSN_r 12376.000 -
508.namd_r 9330.000 -
510.parest_r 22220.000 -
511.povray_r 19409.000 2.24%
519.lbm_r 15283.000 -
520.omnetpp_r 13762.000 -
521.wrf_r 11692.000 -2.84%
523.xalancbmk_r 13526.000 -
526.blender_r 12129.000 -
527.cam4_r 11237.000 -
531.deepsjeng_r 8768.000 -
538.imagick_r 14902.000 -
541.leela_r 12793.000 -
544.nab_r 14444.000 -
548.exchange2_r 7462.000 -
549.fotonik3d_r 18230.000 -
554.roms_r 15381.000 -
557.xz_r 11614.000 -
Geometric Mean 13263.144 -
Name Current %
500.perlbench_r 2409628.000 -
502.gcc_r 9996398.000 -
503.bwaves_r 31065.000 -
505.mcf_r 28760.000 -
507.cactuBSSN_r 4207471.000 -
508.namd_r 728456.000 -
510.parest_r 8565743.000 -
511.povray_r 998065.000 -
519.lbm_r 15165.000 -
520.omnetpp_r 2210764.000 -
521.wrf_r 20062577.000 -
523.xalancbmk_r 5491350.000 -
526.blender_r 11100545.000 -
527.cam4_r 18565610.000 -
531.deepsjeng_r 95689.000 -
538.imagick_r 2145112.000 -
541.leela_r 203351.000 -
544.nab_r 209691.000 -
548.exchange2_r 177601.000 -
549.fotonik3d_r 405482.000 -
554.roms_r 1061253.000 -
557.xz_r 203097.000 -
Geometric Mean 878818.647 -
Name Current %
500.perlbench_r 89.000 -1.11%
500.perlbench_r (avg) 89.000 -1.11%
500.perlbench_r (avg) (percentage) 0.650 -
500.perlbench_r (max) 264.000 -3.65%
500.perlbench_r (max) (percentage) 1.910 -3.05%
503.bwaves_r 77.000 -2.53%
503.bwaves_r (avg) 77.000 -2.53%
503.bwaves_r (avg) (percentage) 0.380 -2.56%
503.bwaves_r (max) 128.000 -9.86%
503.bwaves_r (max) (percentage) 0.630 -10.00%
503.bwaves_r (unexplained diff vs previous) 58.000 -59.44%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.280 -60.00%
505.mcf_r 49.000 -
505.mcf_r (avg) 49.000 -
505.mcf_r (avg) (percentage) 0.380 -
505.mcf_r (max) 53.000 -10.17%
505.mcf_r (max) (percentage) 0.410 -10.87%
505.mcf_r (unexplained diff vs previous) 41.000 -26.79%
505.mcf_r (unexplained diff vs previous) (percentage) 0.310 -27.91%
507.cactuBSSN_r 55.000 -
507.cactuBSSN_r (avg) 55.000 -
507.cactuBSSN_r (avg) (percentage) 0.450 -
507.cactuBSSN_r (max) 74.000 -1.33%
507.cactuBSSN_r (max) (percentage) 0.600 -1.64%
508.namd_r 51.000 6.25%
508.namd_r (avg) 51.000 6.25%
508.namd_r (avg) (percentage) 0.550 5.77%
508.namd_r (max) 88.000 -26.05%
508.namd_r (max) (percentage) 0.950 -25.20%
508.namd_r (unexplained diff vs previous) 78.000 -33.90%
508.namd_r (unexplained diff vs previous) (percentage) 0.840 -32.80%
510.parest_r 35.000 -
510.parest_r (avg) 35.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 46.000 -
510.parest_r (max) (percentage) 0.210 -
511.povray_r 124.000 2.48%
511.povray_r (avg) 124.000 2.48%
511.povray_r (avg) (percentage) 0.640 -
511.povray_r (max) 258.000 -3.37%
511.povray_r (max) (percentage) 1.330 -5.67%
519.lbm_r 39.000 -
519.lbm_r (avg) 39.000 -
519.lbm_r (avg) (percentage) 0.260 -
519.lbm_r (max) 47.000 -24.19%
519.lbm_r (max) (percentage) 0.310 -24.39%
519.lbm_r (unexplained diff vs previous) 38.000 -38.71%
519.lbm_r (unexplained diff vs previous) (percentage) 0.250 -37.50%
520.omnetpp_r 94.000 -6.00%
520.omnetpp_r (avg) 94.000 -6.00%
520.omnetpp_r (avg) (percentage) 0.690 -5.48%
520.omnetpp_r (max) 144.000 -16.76%
520.omnetpp_r (max) (percentage) 1.050 -16.67%
520.omnetpp_r (unexplained diff vs previous) 0.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.000 -
521.wrf_r 148.000 -2.63%
521.wrf_r (avg) 148.000 -2.63%
521.wrf_r (avg) (percentage) 1.270 -
521.wrf_r (max) 155.000 -8.28%
521.wrf_r (max) (percentage) 1.330 -5.67%
523.xalancbmk_r 40.000 -
523.xalancbmk_r (avg) 40.000 -
523.xalancbmk_r (avg) (percentage) 0.300 -
523.xalancbmk_r (max) 51.000 -13.56%
523.xalancbmk_r (max) (percentage) 0.380 -13.64%
525.x264_r (avg) (percentage) 0.250 -
525.x264_r (max) (percentage) 0.450 -4.26%
526.blender_r 44.000 -2.22%
526.blender_r (avg) 44.000 -2.22%
526.blender_r (avg) (percentage) 0.370 -
526.blender_r (max) 107.000 -2.73%
526.blender_r (max) (percentage) 0.890 -1.11%
527.cam4_r 69.000 -
527.cam4_r (avg) 69.000 -
527.cam4_r (avg) (percentage) 0.620 -
527.cam4_r (max) 124.000 -4.62%
527.cam4_r (max) (percentage) 1.110 -4.31%
531.deepsjeng_r 55.000 1.85%
531.deepsjeng_r (avg) 55.000 1.85%
531.deepsjeng_r (avg) (percentage) 0.630 -
531.deepsjeng_r (max) 58.000 -3.33%
531.deepsjeng_r (max) (percentage) 0.670 -4.29%
538.imagick_r 26.000 -
538.imagick_r (avg) 26.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 50.000 -3.85%
538.imagick_r (max) (percentage) 0.340 -
541.leela_r 24.000 -
541.leela_r (avg) 24.000 -
541.leela_r (avg) (percentage) 0.190 -
541.leela_r (max) 58.000 -1.69%
541.leela_r (max) (percentage) 0.460 -
544.nab_r 33.000 -2.94%
544.nab_r (avg) 33.000 -2.94%
544.nab_r (avg) (percentage) 0.230 -
544.nab_r (max) 49.000 -24.62%
544.nab_r (max) (percentage) 0.340 -24.44%
544.nab_r (unexplained diff vs previous) 18.000 -72.31%
544.nab_r (unexplained diff vs previous) (percentage) 0.120 -73.33%
548.exchange2_r 33.000 3.12%
548.exchange2_r (avg) 33.000 3.12%
548.exchange2_r (avg) (percentage) 0.450 2.27%
548.exchange2_r (max) 61.000 -8.96%
548.exchange2_r (max) (percentage) 0.820 -9.89%
548.exchange2_r (unexplained diff vs previous) 50.000 51.52%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.670 48.89%
549.fotonik3d_r 78.000 -
549.fotonik3d_r (avg) 78.000 -
549.fotonik3d_r (avg) (percentage) 0.430 -
549.fotonik3d_r (max) 67.000 -11.84%
549.fotonik3d_r (max) (percentage) 0.370 -11.90%
554.roms_r 44.000 -
554.roms_r (avg) 44.000 -
554.roms_r (avg) (percentage) 0.290 -
554.roms_r (max) 47.000 -4.08%
554.roms_r (max) (percentage) 0.310 -3.13%
557.xz_r 12.000 -
557.xz_r (avg) 12.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 12.000 -
557.xz_r (max) (percentage) 0.110 -
Geometric Mean 6.012 -23.69%