Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a68f7e9844208ad8cd498f89b5100084ece7d0f6 (+ 43 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/cc0e22b3f25d4b2a326322bce711179c02377e6c (+ 248 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (+ 14 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=78a856ae5f13c9a7deb4bdf7432a0f595c5322fe (+ 664 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/36/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0036 (4-changed-components) 2023-05-08T11:48:45 0:00:00
Previous 0034 (3-changed-components) 2023-05-04T10:33:02 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 3 7
Performance Improvements 47 8
Added Tests 0 110
Unchanged Tests 886 811
Total Tests 936

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.19% 707686.000 716122.000 - 1.20% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.37% 9229.000 9355.000 - 1.90% -
541.leela_r 1.15% 11617.000 11751.000 - 0.98% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r -2.50% 169021.000 164797.000 - -0.04% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r -3.41% 6518.000 6296.000 - -2.97% -
527.cam4_r -3.07% 11281.000 10935.000 - -1.53% -
520.omnetpp_r -2.17% 13668.000 13372.000 - -0.35% -
531.deepsjeng_r -1.72% 7511.000 7382.000 - -0.82% -
526.blender_r -1.30% 12197.000 12039.000 - -1.11% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (max) -10.34% 87.000 78.000 - 0.00% -
503.bwaves_r (max) -9.38% 128.000 116.000 - 0.00% -
503.bwaves_r (max) (percentage) -9.26% 0.540 0.490 - 0.00% -
531.deepsjeng_r (max) (percentage) -8.62% 1.160 1.060 - 0.00% -
505.mcf_r (max) -8.00% 25.000 23.000 - 0.00% -
544.nab_r (max) (percentage) -7.32% 0.410 0.380 - 0.00% -
526.blender_r (max) -7.14% 28.000 26.000 - 0.00% -
508.namd_r (max) (percentage) -6.94% 0.720 0.670 - 0.00% -
544.nab_r (max) -6.90% 58.000 54.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
554.roms_r (max) -6.67% 75.000 70.000 - 0.00% -
519.lbm_r (max) -6.25% 32.000 30.000 - 0.00% -
554.roms_r (max) (percentage) -6.12% 0.490 0.460 - 0.00% -
508.namd_r (max) -6.06% 66.000 62.000 - 0.00% -
549.fotonik3d_r (max) -5.77% 52.000 49.000 - 0.00% -
520.omnetpp_r (max) -5.15% 136.000 129.000 - 0.00% -
519.lbm_r (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
500.perlbench_r (max) (percentage) -4.94% 1.620 1.540 - 0.00% -
526.blender_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
507.cactuBSSN_r (max) -4.32% 139.000 133.000 - 0.00% -
523.xalancbmk_r (max) -4.11% 73.000 70.000 - 0.00% -
500.perlbench_r (max) -4.07% 221.000 212.000 - 0.00% -
541.leela_r (max) (percentage) -3.70% 0.270 0.260 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.57% 1.120 1.080 - 0.00% -
523.xalancbmk_r (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
526.blender_r -3.57% 28.000 27.000 - 0.00% -
526.blender_r (avg) -3.57% 28.000 27.000 - 0.00% -
527.cam4_r (max) -3.57% 28.000 27.000 - 0.00% -
527.cam4_r -3.45% 29.000 28.000 - 0.00% -
527.cam4_r (avg) -3.45% 29.000 28.000 - 0.00% -
510.parest_r (max) (percentage) -3.33% 0.300 0.290 - 0.00% -
541.leela_r (max) -3.23% 31.000 30.000 - 0.00% -
510.parest_r (max) -3.08% 65.000 63.000 - 0.00% -
520.omnetpp_r (max) (percentage) -3.00% 1.000 0.970 - 0.00% -
520.omnetpp_r -2.53% 79.000 77.000 - 0.00% -
520.omnetpp_r (avg) -2.53% 79.000 77.000 - 0.00% -
531.deepsjeng_r -2.17% 46.000 45.000 - 0.00% -
531.deepsjeng_r (avg) -2.17% 46.000 45.000 - 0.00% -
521.wrf_r (max) (percentage) -1.62% 1.850 1.820 - 0.00% -
521.wrf_r (max) -1.40% 215.000 212.000 - 0.00% -
511.povray_r (max) (percentage) -1.37% 0.730 0.720 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 1.54% 2637259.000 2677854.000 - 0.31% -
508.namd_r 1.20% 707624.000 716122.000 - 1.19% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 1.90% 9181.000 9355.000 - 1.37% -
521.wrf_r 1.31% 11500.000 11651.000 - 0.03% -
548.exchange2_r 1.18% 7395.000 7482.000 - -0.43% -
544.nab_r 1.14% 14307.000 14470.000 - 0.56% -
500.perlbench_r 1.03% 13648.000 13789.000 - 0.96% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -3.95% 108073.000 103804.000 - 0.03% -
520.omnetpp_r -3.22% 1925630.000 1863634.000 - 0.21% -
510.parest_r -1.90% 1726330.000 1693518.000 - 0.00% -
511.povray_r -1.44% 1093239.000 1077479.000 - -0.09% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -2.97% 6489.000 6296.000 - -3.41% -
507.cactuBSSN_r -2.81% 12761.000 12403.000 - -0.27% -
527.cam4_r -1.53% 11105.000 10935.000 - -3.07% -
526.blender_r -1.11% 12174.000 12039.000 - -1.30% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 13789.000 -
502.gcc_r 9957.000 -
503.bwaves_r 23693.000 -
505.mcf_r 11969.000 -
507.cactuBSSN_r 12403.000 -
508.namd_r 9355.000 1.37%
510.parest_r 21814.000 -
511.povray_r 18683.000 -
519.lbm_r 16232.000 -
520.omnetpp_r 13372.000 -2.17%
521.wrf_r 11651.000 -
523.xalancbmk_r 13117.000 -
525.x264_r 6296.000 -3.41%
526.blender_r 12039.000 -1.30%
527.cam4_r 10935.000 -3.07%
531.deepsjeng_r 7382.000 -1.72%
538.imagick_r 14048.000 -
541.leela_r 11751.000 1.15%
544.nab_r 14470.000 -
548.exchange2_r 7482.000 -
549.fotonik3d_r 18197.000 -
554.roms_r 15374.000 -
557.xz_r 11623.000 -
Geometric Mean 12635.703 -
Name Current %
500.perlbench_r 2677854.000 -
502.gcc_r 10126953.000 -
503.bwaves_r 32648.000 -
505.mcf_r 23320.000 -
507.cactuBSSN_r 3714201.000 -
508.namd_r 716122.000 1.19%
510.parest_r 1693518.000 -
511.povray_r 1077479.000 -
519.lbm_r 12092.000 -
520.omnetpp_r 1863634.000 -
521.wrf_r 15474901.000 -
523.xalancbmk_r 3740508.000 -
525.x264_r 647153.000 -
526.blender_r 11467489.000 -
527.cam4_r 3304323.000 -
531.deepsjeng_r 85259.000 -
538.imagick_r 1567322.000 -
541.leela_r 103804.000 -
544.nab_r 97350.000 -
548.exchange2_r 164797.000 -2.50%
549.fotonik3d_r 411337.000 -
554.roms_r 860582.000 -
557.xz_r 146462.000 -
Geometric Mean 641658.424 -
Name Current %
500.perlbench_r 111.000 -
500.perlbench_r (avg) 111.000 -
500.perlbench_r (avg) (percentage) 0.810 -
500.perlbench_r (max) 212.000 -4.07%
500.perlbench_r (max) (percentage) 1.540 -4.94%
503.bwaves_r 101.000 -
503.bwaves_r (avg) 101.000 -
503.bwaves_r (avg) (percentage) 0.430 -
503.bwaves_r (max) 116.000 -9.38%
503.bwaves_r (max) (percentage) 0.490 -9.26%
505.mcf_r 31.000 -
505.mcf_r (avg) 31.000 -
505.mcf_r (avg) (percentage) 0.260 -
505.mcf_r (max) 23.000 -8.00%
505.mcf_r (max) (percentage) 0.200 -
507.cactuBSSN_r 70.000 -
507.cactuBSSN_r (avg) 70.000 -
507.cactuBSSN_r (avg) (percentage) 0.570 -
507.cactuBSSN_r (max) 133.000 -4.32%
507.cactuBSSN_r (max) (percentage) 1.080 -3.57%
508.namd_r 47.000 -
508.namd_r (avg) 47.000 -
508.namd_r (avg) (percentage) 0.510 -
508.namd_r (max) 62.000 -6.06%
508.namd_r (max) (percentage) 0.670 -6.94%
510.parest_r 45.000 -
510.parest_r (avg) 45.000 -
510.parest_r (avg) (percentage) 0.210 -
510.parest_r (max) 63.000 -3.08%
510.parest_r (max) (percentage) 0.290 -3.33%
511.povray_r 72.000 -
511.povray_r (avg) 72.000 -
511.povray_r (avg) (percentage) 0.390 -
511.povray_r (max) 134.000 -
511.povray_r (max) (percentage) 0.720 -1.37%
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.130 -
519.lbm_r (max) 30.000 -6.25%
519.lbm_r (max) (percentage) 0.190 -5.00%
520.omnetpp_r 77.000 -2.53%
520.omnetpp_r (avg) 77.000 -2.53%
520.omnetpp_r (avg) (percentage) 0.580 -
520.omnetpp_r (max) 129.000 -5.15%
520.omnetpp_r (max) (percentage) 0.970 -3.00%
521.wrf_r 124.000 -
521.wrf_r (avg) 124.000 -
521.wrf_r (avg) (percentage) 1.070 -
521.wrf_r (max) 212.000 -1.40%
521.wrf_r (max) (percentage) 1.820 -1.62%
523.xalancbmk_r 38.000 -
523.xalancbmk_r (avg) 38.000 -
523.xalancbmk_r (avg) (percentage) 0.290 -
523.xalancbmk_r (max) 70.000 -4.11%
523.xalancbmk_r (max) (percentage) 0.540 -3.57%
525.x264_r 8.000 -
525.x264_r (avg) 8.000 -
525.x264_r (avg) (percentage) 0.130 -
525.x264_r (max) 9.000 -
525.x264_r (max) (percentage) 0.150 -
526.blender_r 27.000 -3.57%
526.blender_r (avg) 27.000 -3.57%
526.blender_r (avg) (percentage) 0.230 -
526.blender_r (max) 26.000 -7.14%
526.blender_r (max) (percentage) 0.220 -4.35%
527.cam4_r 28.000 -3.45%
527.cam4_r (avg) 28.000 -3.45%
527.cam4_r (avg) (percentage) 0.260 -
527.cam4_r (max) 27.000 -3.57%
527.cam4_r (max) (percentage) 0.250 -
531.deepsjeng_r 45.000 -2.17%
531.deepsjeng_r (avg) 45.000 -2.17%
531.deepsjeng_r (avg) (percentage) 0.620 -
531.deepsjeng_r (max) 78.000 -10.34%
531.deepsjeng_r (max) (percentage) 1.060 -8.62%
538.imagick_r 9.000 -
538.imagick_r (avg) 9.000 -
538.imagick_r (avg) (percentage) 0.070 -
538.imagick_r (max) 7.000 -
538.imagick_r (max) (percentage) 0.050 -
541.leela_r 17.000 -
541.leela_r (avg) 17.000 -
541.leela_r (avg) (percentage) 0.150 -
541.leela_r (max) 30.000 -3.23%
541.leela_r (max) (percentage) 0.260 -3.70%
544.nab_r 50.000 -
544.nab_r (avg) 50.000 -
544.nab_r (avg) (percentage) 0.350 -
544.nab_r (max) 54.000 -6.90%
544.nab_r (max) (percentage) 0.380 -7.32%
548.exchange2_r 41.000 -
548.exchange2_r (avg) 41.000 -
548.exchange2_r (avg) (percentage) 0.550 -
548.exchange2_r (max) 55.000 -
548.exchange2_r (max) (percentage) 0.740 -
549.fotonik3d_r 47.000 -
549.fotonik3d_r (avg) 47.000 -
549.fotonik3d_r (avg) (percentage) 0.260 -
549.fotonik3d_r (max) 49.000 -5.77%
549.fotonik3d_r (max) (percentage) 0.270 -6.90%
554.roms_r 52.000 -
554.roms_r (avg) 52.000 -
554.roms_r (avg) (percentage) 0.340 -
554.roms_r (max) 70.000 -6.67%
554.roms_r (max) (percentage) 0.460 -6.12%
557.xz_r 6.000 -
557.xz_r (avg) 6.000 -
557.xz_r (avg) (percentage) 0.060 -
557.xz_r (max) 9.000 -
557.xz_r (max) (percentage) 0.080 -
Geometric Mean 6.047 -1.89%