Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=664ac93fa86a974aaf42497a58bc1c05dde09909 (+ 254 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/6586422105eeda80f9129f97024ae46fd9da4bc5 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=0e1324e655f3ba9fd3f8ad24678b93b35eee2618 (+ 76 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=3a9c734cf38026353ce3ea9ca342f4ee2cee4ddd (+ 16507 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2_LTO-build/42/
Filter

gnu-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0042 (3-changed-components) 2023-06-27T18:51:00 0:00:00
Previous 0025 (4-changed-components) 2023-06-13T03:34:20 0:00:00
Baseline 0003 (4-changed-components) 2023-04-03T11:11:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 5
Performance Improvements 13 2
Added Tests 0 95
Unchanged Tests 797 720
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
554.roms_r 2.71% 30449.000 31275.000 - 2.13% -
508.namd_r 1.18% 3470.000 3511.000 - 0.43% -
511.povray_r 1.17% 427.000 432.000 - 1.89% -
500.perlbench_r 1.05% 2003.000 2024.000 - 0.30% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (max) 4.17% 24.000 25.000 - 0.00% -
554.roms_r 2.92% 240.000 247.000 - 0.00% -
554.roms_r (avg) 2.92% 240.000 247.000 - 0.00% -
554.roms_r (max) 2.79% 538.000 553.000 - 0.00% -
503.bwaves_r 2.17% 46.000 47.000 - 0.00% -
503.bwaves_r (avg) 2.17% 46.000 47.000 - 0.00% -
500.perlbench_r (max) 1.89% 53.000 54.000 - 0.00% -
503.bwaves_r (max) 1.69% 59.000 60.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r -1.55% 2576.000 2536.000 - -1.44% -
520.omnetpp_r -1.49% 3560.000 3507.000 - -0.65% -
527.cam4_r -1.42% 2533.000 2497.000 - -0.28% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (max) -7.14% 14.000 13.000 - 0.00% -
527.cam4_r (max) -2.08% 48.000 47.000 - 0.00% -
527.cam4_r -1.96% 51.000 50.000 - 0.00% -
527.cam4_r (avg) -1.96% 51.000 50.000 - 0.00% -
505.mcf_r (max) -1.92% 52.000 51.000 - 0.00% -
520.omnetpp_r -1.89% 53.000 52.000 - 0.00% -
520.omnetpp_r (avg) -1.89% 53.000 52.000 - 0.00% -
505.mcf_r -1.20% 83.000 82.000 - 0.00% -
505.mcf_r (avg) -1.20% 83.000 82.000 - 0.00% -
520.omnetpp_r (max) -1.02% 98.000 97.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
554.roms_r 2.13% 30622.000 31275.000 - 2.71% -
511.povray_r 1.89% 424.000 432.000 - 1.17% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.00% 20.000 19.000 - 0.00% -
nb_execution_successful -5.00% 20.000 19.000 - 0.00% -
nb_total_tests -5.00% 20.000 19.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -1.82% 4658.000 4573.000 - -0.61% -
548.exchange2_r -1.44% 2573.000 2536.000 - -1.55% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 2024.000 1.05%
503.bwaves_r 8883.000 -
505.mcf_r 6747.000 -
507.cactuBSSN_r 7352.000 -
508.namd_r 3511.000 1.18%
511.povray_r 432.000 1.17%
519.lbm_r 3825.000 -
520.omnetpp_r 3507.000 -1.49%
521.wrf_r 9683.000 -
525.x264_r 3674.000 -
527.cam4_r 2497.000 -1.42%
531.deepsjeng_r 5420.000 -
538.imagick_r 4300.000 -
541.leela_r 4573.000 -
544.nab_r 7973.000 -
548.exchange2_r 2536.000 -1.55%
549.fotonik3d_r 8780.000 -
554.roms_r 31275.000 2.71%
557.xz_r 2407.000 -
Geometric Mean 4472.764 -
Name Current %
500.perlbench_r 1955862.000 -
503.bwaves_r 29255.000 -
505.mcf_r 20517.000 -
507.cactuBSSN_r 3424079.000 -
508.namd_r 637406.000 -
511.povray_r 784927.000 -
519.lbm_r 11183.000 -
520.omnetpp_r 1374206.000 -
521.wrf_r 14832813.000 -
525.x264_r 439133.000 -
527.cam4_r 2789312.000 -
531.deepsjeng_r 91495.000 -
538.imagick_r 1158499.000 -
541.leela_r 74581.000 -
544.nab_r 78783.000 -
548.exchange2_r 62838.000 -
549.fotonik3d_r 327482.000 -
554.roms_r 520873.000 -
557.xz_r 129943.000 -
Geometric Mean 323500.199 -
Name Current %
500.perlbench_r 30.000 -
500.perlbench_r (avg) 30.000 -
500.perlbench_r (avg) (percentage) 1.530 -
500.perlbench_r (max) 54.000 1.89%
500.perlbench_r (max) (percentage) 2.690 -
503.bwaves_r 47.000 2.17%
503.bwaves_r (avg) 47.000 2.17%
503.bwaves_r (avg) (percentage) 0.530 -
503.bwaves_r (max) 60.000 1.69%
503.bwaves_r (max) (percentage) 0.680 -
505.mcf_r 82.000 -1.20%
505.mcf_r (avg) 82.000 -1.20%
505.mcf_r (avg) (percentage) 1.220 -
505.mcf_r (max) 51.000 -1.92%
505.mcf_r (max) (percentage) 0.770 -
507.cactuBSSN_r 62.000 -
507.cactuBSSN_r (avg) 62.000 -
507.cactuBSSN_r (avg) (percentage) 0.850 -
507.cactuBSSN_r (max) 86.000 -
507.cactuBSSN_r (max) (percentage) 1.180 -
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.390 -
508.namd_r (max) 25.000 4.17%
508.namd_r (max) (percentage) 0.720 -
511.povray_r 8.000 -
511.povray_r (avg) 8.000 -
511.povray_r (avg) (percentage) 2.020 -
511.povray_r (max) 14.000 -
511.povray_r (max) (percentage) 3.390 -
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.500 -
519.lbm_r (max) 13.000 -
519.lbm_r (max) (percentage) 0.350 -
520.omnetpp_r 52.000 -1.89%
520.omnetpp_r (avg) 52.000 -1.89%
520.omnetpp_r (avg) (percentage) 1.490 -
520.omnetpp_r (max) 97.000 -1.02%
520.omnetpp_r (max) (percentage) 2.770 -
521.wrf_r 122.000 -
521.wrf_r (avg) 122.000 -
521.wrf_r (avg) (percentage) 1.260 -
521.wrf_r (max) 227.000 -
521.wrf_r (max) (percentage) 2.350 -
525.x264_r 12.000 -
525.x264_r (avg) 12.000 -
525.x264_r (avg) (percentage) 0.350 -
525.x264_r (max) 13.000 -7.14%
525.x264_r (max) (percentage) 0.380 -
527.cam4_r 50.000 -1.96%
527.cam4_r (avg) 50.000 -1.96%
527.cam4_r (avg) (percentage) 2.020 -
527.cam4_r (max) 47.000 -2.08%
527.cam4_r (max) (percentage) 1.910 -
531.deepsjeng_r 16.000 -
531.deepsjeng_r (avg) 16.000 -
531.deepsjeng_r (avg) (percentage) 0.310 -
531.deepsjeng_r (max) 27.000 -
531.deepsjeng_r (max) (percentage) 0.500 -
538.imagick_r 32.000 -
538.imagick_r (avg) 32.000 -
538.imagick_r (avg) (percentage) 0.760 -
538.imagick_r (max) 34.000 -
538.imagick_r (max) (percentage) 0.800 -
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.630 -
541.leela_r (max) 40.000 -
541.leela_r (max) (percentage) 0.890 -
544.nab_r 37.000 -
544.nab_r (avg) 37.000 -
544.nab_r (avg) (percentage) 0.470 -
544.nab_r (max) 47.000 -
544.nab_r (max) (percentage) 0.590 -
548.exchange2_r 19.000 -
548.exchange2_r (avg) 19.000 -
548.exchange2_r (avg) (percentage) 0.770 -
548.exchange2_r (max) 21.000 -
548.exchange2_r (max) (percentage) 0.850 -
549.fotonik3d_r 36.000 -
549.fotonik3d_r (avg) 36.000 -
549.fotonik3d_r (avg) (percentage) 0.420 -
549.fotonik3d_r (max) 24.000 -
549.fotonik3d_r (max) (percentage) 0.280 -
554.roms_r 247.000 2.92%
554.roms_r (avg) 247.000 2.92%
554.roms_r (avg) (percentage) 0.790 -
554.roms_r (max) 553.000 2.79%
554.roms_r (max) (percentage) 1.770 -
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.760 -
557.xz_r (max) 25.000 -
557.xz_r (max) (percentage) 1.050 -
Geometric Mean 8.132 -