Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=8c8224dc1637a3e695c17e4c1026247196813c48 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/75f069a6403b5d4217fb5b654a9c656b4dca9dc1 (+ 1971 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=084fb31bc2c5f95ae0b9e6df4d3cf0ff43471ede (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=781419a9bed0586a8ee9c4761e4d961e3f6059aa (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/85/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0085 (basepoints/gcc-14-03880-g75f069a6403) 2023-08-27T06:17:26 0:00:00
Previous 0084 (basepoints/gcc-14-01909-g5a1ef1cfac0) 2023-08-10T23:13:46 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 6
Performance Improvements 46 5
Added Tests 0 95
Unchanged Tests 770 716
Total Tests 822

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
519.lbm_r 1.43% 11183.000 11343.000 - 1.36% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 2.61% 3442.000 3532.000 - 0.06% -
527.cam4_r 1.54% 2472.000 2510.000 - 0.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 7.41% 54.000 58.000 - 0.00% -
520.omnetpp_r (avg) 7.41% 54.000 58.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 5.10% 1.570 1.650 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
538.imagick_r -2.20% 1159179.000 1133675.000 - -2.56% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.65% 2037.000 1983.000 - -1.73% -
554.roms_r -1.85% 31069.000 30494.000 - -0.42% -
557.xz_r -1.54% 2401.000 2364.000 - -1.05% -
541.leela_r -1.18% 4595.000 4541.000 - -2.51% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) -21.54% 3.250 2.550 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -19.64% 112.000 90.000 - 0.00% -
520.omnetpp_r (max) (percentage) -16.83% 3.150 2.620 - 0.00% -
520.omnetpp_r (max) -14.81% 108.000 92.000 - 0.00% -
548.exchange2_r (max) -11.11% 18.000 16.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -9.46% 0.740 0.670 - 0.00% -
549.fotonik3d_r (max) -9.38% 64.000 58.000 - 0.00% -
508.namd_r (max) -9.09% 11.000 10.000 - 0.00% -
511.povray_r (max) -9.09% 11.000 10.000 - 0.00% -
548.exchange2_r (max) (percentage) -8.33% 0.720 0.660 - 0.00% -
507.cactuBSSN_r (max) -7.89% 38.000 35.000 - 0.00% -
554.roms_r (max) -6.27% 351.000 329.000 - 0.00% -
508.namd_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
541.leela_r (max) -5.88% 51.000 48.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -5.77% 0.520 0.490 - 0.00% -
557.xz_r (max) -5.56% 36.000 34.000 - 0.00% -
521.wrf_r (max) -5.48% 73.000 69.000 - 0.00% -
521.wrf_r (max) (percentage) -5.33% 0.750 0.710 - 0.00% -
505.mcf_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
519.lbm_r (max) (percentage) -5.13% 0.390 0.370 - 0.00% -
500.perlbench_r (max) -5.00% 20.000 19.000 - 0.00% -
500.perlbench_r (max) (percentage) -4.90% 1.020 0.970 - 0.00% -
525.x264_r (max) (percentage) -4.76% 0.630 0.600 - 0.00% -
500.perlbench_r -4.76% 21.000 20.000 - 0.00% -
500.perlbench_r (avg) -4.76% 21.000 20.000 - 0.00% -
538.imagick_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
541.leela_r (max) (percentage) -4.46% 1.120 1.070 - 0.00% -
554.roms_r (max) (percentage) -4.42% 1.130 1.080 - 0.00% -
525.x264_r (max) -4.35% 23.000 22.000 - 0.00% -
544.nab_r (max) (percentage) -4.26% 0.470 0.450 - 0.00% -
505.mcf_r (max) -4.00% 25.000 24.000 - 0.00% -
557.xz_r (max) (percentage) -3.90% 1.540 1.480 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.39% 0.590 0.570 - 0.00% -
531.deepsjeng_r (max) -3.23% 31.000 30.000 - 0.00% -
503.bwaves_r (max) -3.12% 32.000 31.000 - 0.00% -
503.bwaves_r (max) (percentage) -2.70% 0.370 0.360 - 0.00% -
544.nab_r (max) -2.70% 37.000 36.000 - 0.00% -
527.cam4_r (max) (percentage) -2.63% 1.520 1.480 - 0.00% -
511.povray_r (max) (percentage) -2.26% 2.660 2.600 - 0.00% -
554.roms_r -1.79% 279.000 274.000 - 0.00% -
554.roms_r (avg) -1.79% 279.000 274.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r 5.18% 74603.000 78471.000 - 0.92% -
519.lbm_r 1.36% 11191.000 11343.000 - 1.43% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r 1.20% 7985.000 8081.000 - 0.82% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.00% 20.000 19.000 - 0.00% -
nb_execution_successful -5.00% 20.000 19.000 - 0.00% -
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -2.56% 1163451.000 1133675.000 - -2.20% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -2.51% 4658.000 4541.000 - -1.18% -
500.perlbench_r -1.73% 2018.000 1983.000 - -2.65% -
507.cactuBSSN_r -1.08% 7423.000 7343.000 - -0.58% -
557.xz_r -1.05% 2389.000 2364.000 - -1.54% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 1983.000 -2.65%
503.bwaves_r 8879.000 -
505.mcf_r 6773.000 -
507.cactuBSSN_r 7343.000 -
508.namd_r 3490.000 -
511.povray_r 423.000 -
519.lbm_r 3824.000 -
520.omnetpp_r 3532.000 2.61%
521.wrf_r 9757.000 -
525.x264_r 3681.000 -
527.cam4_r 2510.000 1.54%
531.deepsjeng_r 5374.000 -
538.imagick_r 4295.000 -
541.leela_r 4541.000 -1.18%
544.nab_r 8081.000 -
548.exchange2_r 2558.000 -
549.fotonik3d_r 8753.000 -
554.roms_r 30494.000 -1.85%
557.xz_r 2364.000 -1.54%
Geometric Mean 4457.534 -
Name Current %
500.perlbench_r 1954126.000 -
503.bwaves_r 29203.000 -
505.mcf_r 20509.000 -
507.cactuBSSN_r 3420527.000 -
508.namd_r 638367.000 -
511.povray_r 792616.000 -
519.lbm_r 11343.000 1.43%
520.omnetpp_r 1383883.000 -
521.wrf_r 14831493.000 -
525.x264_r 440609.000 -
527.cam4_r 2792744.000 -
531.deepsjeng_r 91839.000 -
538.imagick_r 1133675.000 -2.20%
541.leela_r 78471.000 -
544.nab_r 78671.000 -
548.exchange2_r 63050.000 -
549.fotonik3d_r 327770.000 -
554.roms_r 520905.000 -
557.xz_r 129527.000 -
Geometric Mean 324617.246 -
Name Current %
500.perlbench_r 20.000 -4.76%
500.perlbench_r (avg) 20.000 -4.76%
500.perlbench_r (avg) (percentage) 1.050 -
500.perlbench_r (max) 19.000 -5.00%
500.perlbench_r (max) (percentage) 0.970 -4.90%
503.bwaves_r 38.000 -
503.bwaves_r (avg) 38.000 -
503.bwaves_r (avg) (percentage) 0.430 -
503.bwaves_r (max) 31.000 -3.12%
503.bwaves_r (max) (percentage) 0.360 -2.70%
505.mcf_r 55.000 -
505.mcf_r (avg) 55.000 -
505.mcf_r (avg) (percentage) 0.820 -
505.mcf_r (max) 24.000 -4.00%
505.mcf_r (max) (percentage) 0.360 -5.26%
507.cactuBSSN_r 45.000 -
507.cactuBSSN_r (avg) 45.000 -
507.cactuBSSN_r (avg) (percentage) 0.620 -
507.cactuBSSN_r (max) 35.000 -7.89%
507.cactuBSSN_r (max) (percentage) 0.490 -5.77%
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.380 -
508.namd_r (max) 10.000 -9.09%
508.namd_r (max) (percentage) 0.300 -6.25%
511.povray_r 7.000 -
511.povray_r (avg) 7.000 -
511.povray_r (avg) (percentage) 1.750 -
511.povray_r (max) 10.000 -9.09%
511.povray_r (max) (percentage) 2.600 -2.26%
519.lbm_r 13.000 -
519.lbm_r (avg) 13.000 -
519.lbm_r (avg) (percentage) 0.350 -
519.lbm_r (max) 14.000 -
519.lbm_r (max) (percentage) 0.370 -5.13%
520.omnetpp_r 58.000 7.41%
520.omnetpp_r (avg) 58.000 7.41%
520.omnetpp_r (avg) (percentage) 1.650 5.10%
520.omnetpp_r (max) 92.000 -14.81%
520.omnetpp_r (max) (percentage) 2.620 -16.83%
520.omnetpp_r (unexplained diff vs previous) 90.000 -19.64%
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.550 -21.54%
521.wrf_r 80.000 -
521.wrf_r (avg) 80.000 -
521.wrf_r (avg) (percentage) 0.820 -
521.wrf_r (max) 69.000 -5.48%
521.wrf_r (max) (percentage) 0.710 -5.33%
525.x264_r 13.000 -
525.x264_r (avg) 13.000 -
525.x264_r (avg) (percentage) 0.380 -
525.x264_r (max) 22.000 -4.35%
525.x264_r (max) (percentage) 0.600 -4.76%
527.cam4_r 35.000 -
527.cam4_r (avg) 35.000 -
527.cam4_r (avg) (percentage) 1.420 -
527.cam4_r (max) 37.000 -
527.cam4_r (max) (percentage) 1.480 -2.63%
531.deepsjeng_r 19.000 -
531.deepsjeng_r (avg) 19.000 -
531.deepsjeng_r (avg) (percentage) 0.370 -
531.deepsjeng_r (max) 30.000 -3.23%
531.deepsjeng_r (max) (percentage) 0.570 -3.39%
538.imagick_r 14.000 -
538.imagick_r (avg) 14.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 9.000 -
538.imagick_r (max) (percentage) 0.210 -4.55%
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.630 -
541.leela_r (max) 48.000 -5.88%
541.leela_r (max) (percentage) 1.070 -4.46%
544.nab_r 36.000 -
544.nab_r (avg) 36.000 -
544.nab_r (avg) (percentage) 0.450 -
544.nab_r (max) 36.000 -2.70%
544.nab_r (max) (percentage) 0.450 -4.26%
548.exchange2_r 18.000 -
548.exchange2_r (avg) 18.000 -
548.exchange2_r (avg) (percentage) 0.730 -
548.exchange2_r (max) 16.000 -11.11%
548.exchange2_r (max) (percentage) 0.660 -8.33%
549.fotonik3d_r 36.000 -
549.fotonik3d_r (avg) 36.000 -
549.fotonik3d_r (avg) (percentage) 0.420 -
549.fotonik3d_r (max) 58.000 -9.38%
549.fotonik3d_r (max) (percentage) 0.670 -9.46%
554.roms_r 274.000 -1.79%
554.roms_r (avg) 274.000 -1.79%
554.roms_r (avg) (percentage) 0.900 -
554.roms_r (max) 329.000 -6.27%
554.roms_r (max) (percentage) 1.080 -4.42%
557.xz_r 19.000 -
557.xz_r (avg) 19.000 -
557.xz_r (avg) (percentage) 0.810 -
557.xz_r (max) 34.000 -5.56%
557.xz_r (max) (percentage) 1.480 -3.90%
Geometric Mean 6.588 -2.65%