Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a02fcd08ddc5080696248ed7fb4bf50a24763431 (+ 42 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f52bf590e3336979ee47658d74a8478e3234da9b (+ 244 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (+ 14 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=78a856ae5f13c9a7deb4bdf7432a0f595c5322fe (+ 664 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/15/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0015 (4-changed-components) 2023-05-05T16:23:11 0:00:00
Previous 0013 (4-changed-components) 2023-04-28T22:05:43 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 4
Performance Improvements 47 2
Added Tests 0 95
Unchanged Tests 766 721
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r 1.76% 9868.000 10042.000 - 2.76% -
508.namd_r 1.27% 3453.000 3497.000 - 0.03% -
554.roms_r 1.00% 30539.000 30845.000 - 0.73% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r 3.23% 31.000 32.000 - 0.00% -
548.exchange2_r (avg) 3.23% 31.000 32.000 - 0.00% -
538.imagick_r 2.86% 35.000 36.000 - 0.00% -
538.imagick_r (avg) 2.86% 35.000 36.000 - 0.00% -
521.wrf_r 2.33% 86.000 88.000 - 0.00% -
521.wrf_r (avg) 2.33% 86.000 88.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -3.38% 2072.000 2002.000 - -0.79% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -89.90% 0.990 0.100 - 0.00% -
519.lbm_r (unexplained diff vs previous) -89.47% 38.000 4.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -67.65% 1.020 0.330 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -67.42% 89.000 29.000 - 0.00% -
519.lbm_r (max) (percentage) -39.26% 3.490 2.120 - 0.00% -
519.lbm_r (max) -39.10% 133.000 81.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -27.62% 1.050 0.760 - 0.00% -
549.fotonik3d_r (max) -27.47% 91.000 66.000 - 0.00% -
519.lbm_r -21.13% 71.000 56.000 - 0.00% -
519.lbm_r (avg) -21.13% 71.000 56.000 - 0.00% -
519.lbm_r (avg) (percentage) -20.97% 1.860 1.470 - 0.00% -
548.exchange2_r (max) -12.50% 32.000 28.000 - 0.00% -
549.fotonik3d_r -12.50% 64.000 56.000 - 0.00% -
549.fotonik3d_r (avg) -12.50% 64.000 56.000 - 0.00% -
549.fotonik3d_r (avg) (percentage) -12.16% 0.740 0.650 - 0.00% -
548.exchange2_r (max) (percentage) -11.02% 1.270 1.130 - 0.00% -
525.x264_r (max) -7.41% 27.000 25.000 - 0.00% -
500.perlbench_r (max) -6.82% 44.000 41.000 - 0.00% -
507.cactuBSSN_r (max) -6.38% 47.000 44.000 - 0.00% -
508.namd_r (max) (percentage) -6.20% 1.290 1.210 - 0.00% -
507.cactuBSSN_r (max) (percentage) -6.15% 0.650 0.610 - 0.00% -
538.imagick_r (max) -5.56% 36.000 34.000 - 0.00% -
525.x264_r (max) (percentage) -5.33% 0.750 0.710 - 0.00% -
500.perlbench_r -5.00% 20.000 19.000 - 0.00% -
500.perlbench_r (avg) -5.00% 20.000 19.000 - 0.00% -
557.xz_r (max) -5.00% 40.000 38.000 - 0.00% -
557.xz_r (max) (percentage) -4.73% 1.690 1.610 - 0.00% -
521.wrf_r (max) (percentage) -4.71% 0.850 0.810 - 0.00% -
538.imagick_r (max) (percentage) -4.71% 0.850 0.810 - 0.00% -
520.omnetpp_r (max) (percentage) -4.62% 1.730 1.650 - 0.00% -
508.namd_r (max) -4.55% 44.000 42.000 - 0.00% -
544.nab_r (max) -4.55% 22.000 21.000 - 0.00% -
505.mcf_r (max) (percentage) -4.46% 3.590 3.430 - 0.00% -
527.cam4_r (max) (percentage) -4.44% 4.050 3.870 - 0.00% -
527.cam4_r (max) -3.96% 101.000 97.000 - 0.00% -
531.deepsjeng_r (max) -3.85% 26.000 25.000 - 0.00% -
505.mcf_r (max) -3.75% 240.000 231.000 - 0.00% -
544.nab_r (max) (percentage) -3.57% 0.280 0.270 - 0.00% -
511.povray_r (max) (percentage) -3.37% 0.890 0.860 - 0.00% -
520.omnetpp_r (max) -3.33% 60.000 58.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.80% 2.140 2.080 - 0.00% -
521.wrf_r (max) -2.41% 83.000 81.000 - 0.00% -
554.roms_r (max) (percentage) -2.22% 0.900 0.880 - 0.00% -
531.deepsjeng_r (max) (percentage) -2.04% 0.490 0.480 - 0.00% -
541.leela_r (max) (percentage) -1.61% 0.620 0.610 - 0.00% -
554.roms_r (max) -1.09% 274.000 271.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r 2.76% 9772.000 10042.000 - 1.76% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.00% 20.000 19.000 - 0.00% -
nb_execution_successful -5.00% 20.000 19.000 - 0.00% -
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -1.89% 424.000 416.000 - -0.95% -
507.cactuBSSN_r -1.13% 7423.000 7339.000 - -0.56% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 2002.000 -3.38%
503.bwaves_r 8842.000 -
505.mcf_r 6745.000 -
507.cactuBSSN_r 7339.000 -
508.namd_r 3497.000 1.27%
511.povray_r 416.000 -
519.lbm_r 3826.000 -
520.omnetpp_r 3527.000 -
521.wrf_r 10042.000 1.76%
525.x264_r 3660.000 -
527.cam4_r 2524.000 -
531.deepsjeng_r 5377.000 -
538.imagick_r 4295.000 -
541.leela_r 4614.000 -
544.nab_r 7983.000 -
548.exchange2_r 2562.000 -
549.fotonik3d_r 8742.000 -
554.roms_r 30845.000 1.00%
557.xz_r 2377.000 -
Geometric Mean 4465.815 -
Name Current %
500.perlbench_r 1956582.000 -
503.bwaves_r 29255.000 -
505.mcf_r 20541.000 -
507.cactuBSSN_r 3425895.000 -
508.namd_r 638902.000 -
511.povray_r 785423.000 -
519.lbm_r 11191.000 -
520.omnetpp_r 1375394.000 -
521.wrf_r 14836361.000 -
525.x264_r 439893.000 -
527.cam4_r 2794488.000 -
531.deepsjeng_r 91635.000 -
538.imagick_r 1164219.000 -
541.leela_r 74701.000 -
544.nab_r 78855.000 -
548.exchange2_r 62822.000 -
549.fotonik3d_r 327746.000 -
554.roms_r 521009.000 -
557.xz_r 129927.000 -
Geometric Mean 323842.769 -
Name Current %
500.perlbench_r 19.000 -5.00%
500.perlbench_r (avg) 19.000 -5.00%
500.perlbench_r (avg) (percentage) 0.980 -
500.perlbench_r (max) 41.000 -6.82%
500.perlbench_r (max) (percentage) 2.080 -2.80%
503.bwaves_r 61.000 -
503.bwaves_r (avg) 61.000 -
503.bwaves_r (avg) (percentage) 0.690 -
503.bwaves_r (max) 57.000 -
503.bwaves_r (max) (percentage) 0.650 -
505.mcf_r 176.000 -
505.mcf_r (avg) 176.000 -
505.mcf_r (avg) (percentage) 2.620 -
505.mcf_r (max) 231.000 -3.75%
505.mcf_r (max) (percentage) 3.430 -4.46%
507.cactuBSSN_r 41.000 -
507.cactuBSSN_r (avg) 41.000 -
507.cactuBSSN_r (avg) (percentage) 0.560 -
507.cactuBSSN_r (max) 44.000 -6.38%
507.cactuBSSN_r (max) (percentage) 0.610 -6.15%
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.510 -
508.namd_r (max) 42.000 -4.55%
508.namd_r (max) (percentage) 1.210 -6.20%
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 0.810 -
511.povray_r (max) 3.000 -
511.povray_r (max) (percentage) 0.860 -3.37%
519.lbm_r 56.000 -21.13%
519.lbm_r (avg) 56.000 -21.13%
519.lbm_r (avg) (percentage) 1.470 -20.97%
519.lbm_r (max) 81.000 -39.10%
519.lbm_r (max) (percentage) 2.120 -39.26%
519.lbm_r (unexplained diff vs previous) 4.000 -89.47%
519.lbm_r (unexplained diff vs previous) (percentage) 0.100 -89.90%
520.omnetpp_r 38.000 -
520.omnetpp_r (avg) 38.000 -
520.omnetpp_r (avg) (percentage) 1.090 -
520.omnetpp_r (max) 58.000 -3.33%
520.omnetpp_r (max) (percentage) 1.650 -4.62%
521.wrf_r 88.000 2.33%
521.wrf_r (avg) 88.000 2.33%
521.wrf_r (avg) (percentage) 0.880 -
521.wrf_r (max) 81.000 -2.41%
521.wrf_r (max) (percentage) 0.810 -4.71%
525.x264_r 30.000 -
525.x264_r (avg) 30.000 -
525.x264_r (avg) (percentage) 0.830 -
525.x264_r (max) 25.000 -7.41%
525.x264_r (max) (percentage) 0.710 -5.33%
527.cam4_r 130.000 -
527.cam4_r (avg) 130.000 -
527.cam4_r (avg) (percentage) 5.160 -
527.cam4_r (max) 97.000 -3.96%
527.cam4_r (max) (percentage) 3.870 -4.44%
531.deepsjeng_r 23.000 -
531.deepsjeng_r (avg) 23.000 -
531.deepsjeng_r (avg) (percentage) 0.440 -
531.deepsjeng_r (max) 25.000 -3.85%
531.deepsjeng_r (max) (percentage) 0.480 -2.04%
538.imagick_r 36.000 2.86%
538.imagick_r (avg) 36.000 2.86%
538.imagick_r (avg) (percentage) 0.840 -
538.imagick_r (max) 34.000 -5.56%
538.imagick_r (max) (percentage) 0.810 -4.71%
541.leela_r 24.000 -
541.leela_r (avg) 24.000 -
541.leela_r (avg) (percentage) 0.540 -
541.leela_r (max) 28.000 -
541.leela_r (max) (percentage) 0.610 -1.61%
544.nab_r 20.000 -
544.nab_r (avg) 20.000 -
544.nab_r (avg) (percentage) 0.260 -
544.nab_r (max) 21.000 -4.55%
544.nab_r (max) (percentage) 0.270 -3.57%
548.exchange2_r 32.000 3.23%
548.exchange2_r (avg) 32.000 3.23%
548.exchange2_r (avg) (percentage) 1.250 -
548.exchange2_r (max) 28.000 -12.50%
548.exchange2_r (max) (percentage) 1.130 -11.02%
549.fotonik3d_r 56.000 -12.50%
549.fotonik3d_r (avg) 56.000 -12.50%
549.fotonik3d_r (avg) (percentage) 0.650 -12.16%
549.fotonik3d_r (max) 66.000 -27.47%
549.fotonik3d_r (max) (percentage) 0.760 -27.62%
549.fotonik3d_r (unexplained diff vs previous) 29.000 -67.42%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.330 -67.65%
554.roms_r 129.000 -
554.roms_r (avg) 129.000 -
554.roms_r (avg) (percentage) 0.420 -
554.roms_r (max) 271.000 -1.09%
554.roms_r (max) (percentage) 0.880 -2.22%
557.xz_r 33.000 -
557.xz_r (avg) 33.000 -
557.xz_r (avg) (percentage) 1.420 -
557.xz_r (max) 38.000 -5.00%
557.xz_r (max) (percentage) 1.610 -4.73%
Geometric Mean 8.302 -10.43%