Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8c8224dc1637a3e695c17e4c1026247196813c48 (+ 183 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/46905fcde00fd84eb06b6bd1a6e788171d32865b (+ 322 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=084fb31bc2c5f95ae0b9e6df4d3cf0ff43471ede (+ 38 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=781419a9bed0586a8ee9c4761e4d961e3f6059aa (+ 442 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/71/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0071 (4-changed-components) 2023-07-30T20:19:03 0:00:00
Previous 0067 (4-changed-components) 2023-07-18T03:54:53 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 4 9
Performance Improvements 44 13
Added Tests 2 110
Unchanged Tests 886 804
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r 1.80% 12903.000 13135.000 - 0.00% -
511.povray_r 1.01% 18308.000 18492.000 - -1.33% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.33% 75.000 76.000 - 0.00% -
507.cactuBSSN_r (avg) 1.33% 75.000 76.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
505.mcf_r -2.13% 23236.000 22740.000 - -2.62% -
549.fotonik3d_r -1.23% 400697.000 395777.000 - -2.90% -
500.perlbench_r -1.11% 2681782.000 2652110.000 - 0.56% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r -4.81% 11656.000 11095.000 - -4.66% -
525.x264_r -1.85% 6341.000 6224.000 - -4.08% -
554.roms_r -1.17% 15429.000 15249.000 - 0.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (max) -80.00% 65.000 13.000 - 0.00% -
519.lbm_r (max) (percentage) -80.00% 0.400 0.080 - 0.00% -
544.nab_r (max) -11.11% 72.000 64.000 - 0.00% -
525.x264_r -10.00% 10.000 9.000 - 0.00% -
525.x264_r (avg) -10.00% 10.000 9.000 - 0.00% -
544.nab_r (max) (percentage) -10.00% 0.500 0.450 - 0.00% -
520.omnetpp_r (max) -8.85% 113.000 103.000 - 0.00% -
520.omnetpp_r (max) (percentage) -8.33% 0.840 0.770 - 0.00% -
505.mcf_r (max) -6.76% 74.000 69.000 - 0.00% -
525.x264_r (max) -6.67% 15.000 14.000 - 0.00% -
548.exchange2_r (max) -6.67% 15.000 14.000 - 0.00% -
505.mcf_r (max) (percentage) -6.45% 0.620 0.580 - 0.00% -
541.leela_r (max) -6.25% 48.000 45.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -5.45% 0.550 0.520 - 0.00% -
541.leela_r -5.26% 19.000 18.000 - 0.00% -
541.leela_r (avg) -5.26% 19.000 18.000 - 0.00% -
549.fotonik3d_r (max) -5.05% 99.000 94.000 - 0.00% -
554.roms_r (max) -5.00% 40.000 38.000 - 0.00% -
503.bwaves_r (max) (percentage) -4.55% 0.660 0.630 - 0.00% -
508.namd_r (max) -4.41% 68.000 65.000 - 0.00% -
503.bwaves_r (max) -4.38% 160.000 153.000 - 0.00% -
508.namd_r (max) (percentage) -4.11% 0.730 0.700 - 0.00% -
525.x264_r (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
554.roms_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
507.cactuBSSN_r (max) (percentage) -3.61% 0.830 0.800 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.40% 2.060 1.990 - 0.00% -
531.deepsjeng_r (max) -3.31% 151.000 146.000 - 0.00% -
507.cactuBSSN_r (max) -2.91% 103.000 100.000 - 0.00% -
541.leela_r (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
526.blender_r (max) (percentage) -1.92% 0.520 0.510 - 0.00% -
500.perlbench_r (max) -1.83% 164.000 161.000 - 0.00% -
521.wrf_r (max) -1.78% 225.000 221.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.65% 1.210 1.190 - 0.00% -
526.blender_r (max) -1.61% 62.000 61.000 - 0.00% -
511.povray_r (max) (percentage) -1.59% 0.630 0.620 - 0.00% -
521.wrf_r (max) (percentage) -1.56% 1.920 1.890 - 0.00% -
520.omnetpp_r -1.08% 93.000 92.000 - 0.00% -
520.omnetpp_r (avg) -1.08% 93.000 92.000 - 0.00% -

Added Tests - sample variability
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
557.xz_r 3.06% 145598.000 150058.000 - 0.02% -
507.cactuBSSN_r 2.20% 3720089.000 3801897.000 - 0.21% -
510.parest_r 2.17% 1726330.000 1763813.000 - 0.16% -
503.bwaves_r 1.80% 32696.000 33284.000 - 0.02% -
531.deepsjeng_r 1.37% 84983.000 86147.000 - 0.06% -
527.cam4_r 1.25% 3290016.000 3331295.000 - 0.25% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 2.28% 9181.000 9390.000 - -0.06% -
521.wrf_r 1.99% 11500.000 11729.000 - 0.01% -
503.bwaves_r 1.64% 23928.000 24320.000 - 0.23% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.90% 407605.000 395777.000 - -1.23% -
505.mcf_r -2.62% 23352.000 22740.000 - -2.13% -
525.x264_r -2.49% 646262.000 630153.000 - -0.17% -
520.omnetpp_r -2.36% 1925630.000 1880217.000 - 0.25% -
538.imagick_r -1.78% 1571438.000 1543422.000 - 0.04% -
541.leela_r -1.31% 108073.000 106658.000 - -0.06% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -4.66% 11637.000 11095.000 - -4.81% -
525.x264_r -4.08% 6489.000 6224.000 - -1.85% -
507.cactuBSSN_r -1.89% 12761.000 12520.000 - 0.51% -
526.blender_r -1.36% 12174.000 12009.000 - -0.12% -
511.povray_r -1.33% 18742.000 18492.000 - 1.01% -
527.cam4_r -1.09% 11105.000 10984.000 - -0.88% -
531.deepsjeng_r -1.06% 7443.000 7364.000 - 0.25% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 13564.000 -
502.gcc_r 9972.000 -
503.bwaves_r 24320.000 -
505.mcf_r 11920.000 -
507.cactuBSSN_r 12520.000 -
508.namd_r 9390.000 -
510.parest_r 21729.000 -
511.povray_r 18492.000 1.01%
519.lbm_r 16284.000 -
520.omnetpp_r 13430.000 -
521.wrf_r 11729.000 -
523.xalancbmk_r 13135.000 1.80%
525.x264_r 6224.000 -1.85%
526.blender_r 12009.000 -
527.cam4_r 10984.000 -
531.deepsjeng_r 7364.000 -
538.imagick_r 14051.000 -
541.leela_r 11095.000 -4.81%
544.nab_r 14341.000 -
548.exchange2_r 7378.000 -
549.fotonik3d_r 18103.000 -
554.roms_r 15249.000 -1.17%
557.xz_r 11528.000 -
Geometric Mean 12585.198 -
Name Current %
500.perlbench_r 2652110.000 -1.11%
502.gcc_r 10184337.000 -
503.bwaves_r 33284.000 -
505.mcf_r 22740.000 -2.13%
507.cactuBSSN_r 3801897.000 -
508.namd_r 707006.000 -
510.parest_r 1763813.000 -
511.povray_r 1083823.000 -
519.lbm_r 12232.000 -
520.omnetpp_r 1880217.000 -
521.wrf_r 15481721.000 -
523.xalancbmk_r 3764678.000 -
525.x264_r 630153.000 -
526.blender_r 11549381.000 -
527.cam4_r 3331295.000 -
531.deepsjeng_r 86147.000 -
538.imagick_r 1543422.000 -
541.leela_r 106658.000 -
544.nab_r 97294.000 -
548.exchange2_r 164573.000 -
549.fotonik3d_r 395777.000 -1.23%
554.roms_r 849934.000 -
557.xz_r 150058.000 -
Geometric Mean 643235.672 -
Name Current %
500.perlbench_r 92.000 -
500.perlbench_r (avg) 92.000 -
500.perlbench_r (avg) (percentage) 0.680 -
500.perlbench_r (max) 161.000 -1.83%
500.perlbench_r (max) (percentage) 1.190 -1.65%
503.bwaves_r 94.000 -
503.bwaves_r (avg) 94.000 -
503.bwaves_r (avg) (percentage) 0.390 -
503.bwaves_r (max) 153.000 -4.38%
503.bwaves_r (max) (percentage) 0.630 -4.55%
505.mcf_r 29.000 -
505.mcf_r (avg) 29.000 -
505.mcf_r (avg) (percentage) 0.250 -
505.mcf_r (max) 69.000 -6.76%
505.mcf_r (max) (percentage) 0.580 -6.45%
507.cactuBSSN_r 76.000 1.33%
507.cactuBSSN_r (avg) 76.000 1.33%
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) 100.000 -2.91%
507.cactuBSSN_r (max) (percentage) 0.800 -3.61%
508.namd_r 42.000 -
508.namd_r (avg) 42.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 65.000 -4.41%
508.namd_r (max) (percentage) 0.700 -4.11%
510.parest_r 36.000 -
510.parest_r (avg) 36.000 -
510.parest_r (avg) (percentage) 0.170 -
510.parest_r (max) 41.000 -
510.parest_r (max) (percentage) 0.190 -
511.povray_r 73.000 -
511.povray_r (avg) 73.000 -
511.povray_r (avg) (percentage) 0.400 -
511.povray_r (max) 114.000 -
511.povray_r (max) (percentage) 0.620 -1.59%
519.lbm_r 24.000 -
519.lbm_r (avg) 24.000 -
519.lbm_r (avg) (percentage) 0.150 -
519.lbm_r (max) 13.000 -80.00%
519.lbm_r (max) (percentage) 0.080 -80.00%
519.lbm_r (unexplained diff vs previous) 1.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.010 -
520.omnetpp_r 92.000 -1.08%
520.omnetpp_r (avg) 92.000 -1.08%
520.omnetpp_r (avg) (percentage) 0.690 -
520.omnetpp_r (max) 103.000 -8.85%
520.omnetpp_r (max) (percentage) 0.770 -8.33%
521.wrf_r 123.000 -
521.wrf_r (avg) 123.000 -
521.wrf_r (avg) (percentage) 1.050 -
521.wrf_r (max) 221.000 -1.78%
521.wrf_r (max) (percentage) 1.890 -1.56%
523.xalancbmk_r 24.000 -
523.xalancbmk_r (avg) 24.000 -
523.xalancbmk_r (avg) (percentage) 0.190 -
523.xalancbmk_r (max) 52.000 -
523.xalancbmk_r (max) (percentage) 0.400 -
525.x264_r 9.000 -10.00%
525.x264_r (avg) 9.000 -10.00%
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 14.000 -6.67%
525.x264_r (max) (percentage) 0.240 -4.00%
526.blender_r 34.000 -
526.blender_r (avg) 34.000 -
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 61.000 -1.61%
526.blender_r (max) (percentage) 0.510 -1.92%
527.cam4_r 36.000 -
527.cam4_r (avg) 36.000 -
527.cam4_r (avg) (percentage) 0.330 -
527.cam4_r (max) 36.000 -
527.cam4_r (max) (percentage) 0.330 -
531.deepsjeng_r 55.000 -
531.deepsjeng_r (avg) 55.000 -
531.deepsjeng_r (avg) (percentage) 0.760 -
531.deepsjeng_r (max) 146.000 -3.31%
531.deepsjeng_r (max) (percentage) 1.990 -3.40%
538.imagick_r 14.000 -
538.imagick_r (avg) 14.000 -
538.imagick_r (avg) (percentage) 0.100 -
538.imagick_r (max) 35.000 -
538.imagick_r (max) (percentage) 0.250 -
541.leela_r 18.000 -5.26%
541.leela_r (avg) 18.000 -5.26%
541.leela_r (avg) (percentage) 0.170 -
541.leela_r (max) 45.000 -6.25%
541.leela_r (max) (percentage) 0.410 -2.38%
544.nab_r 53.000 -
544.nab_r (avg) 53.000 -
544.nab_r (avg) (percentage) 0.370 -
544.nab_r (max) 64.000 -11.11%
544.nab_r (max) (percentage) 0.450 -10.00%
548.exchange2_r 33.000 -
548.exchange2_r (avg) 33.000 -
548.exchange2_r (avg) (percentage) 0.460 -
548.exchange2_r (max) 14.000 -6.67%
548.exchange2_r (max) (percentage) 0.200 -
549.fotonik3d_r 70.000 -
549.fotonik3d_r (avg) 70.000 -
549.fotonik3d_r (avg) (percentage) 0.390 -
549.fotonik3d_r (max) 94.000 -5.05%
549.fotonik3d_r (max) (percentage) 0.520 -5.45%
554.roms_r 41.000 -
554.roms_r (avg) 41.000 -
554.roms_r (avg) (percentage) 0.270 -
554.roms_r (max) 38.000 -5.00%
554.roms_r (max) (percentage) 0.250 -3.85%
557.xz_r 4.000 -
557.xz_r (avg) 4.000 -
557.xz_r (avg) (percentage) 0.040 -
557.xz_r (max) 4.000 -
557.xz_r (max) (percentage) 0.040 -
Geometric Mean 5.786 -11.27%