Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=aaa064b75c1469c8ea6d8e4b0b84df51ccfe6fc2 (+ 39 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/44e5ecfd261afe72aa04eba4bf1a9ec782579cab (+ 299 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9fc639f654dc004736836613be703e6bed0c36a8 (+ 6 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (+ 226 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/33/
View Options
Report
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0033 (4-changed-components) 2024-07-01T00:27:35 0:00:00
Previous 0033 (4-changed-components) 2024-07-01T00:27:35 0:00:00
Baseline 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 5
Performance Improvements 0 12
Added Tests 1 106
Unchanged Tests 929 807
Total Tests 930

Run-Over-Run Changes Detail

Added Tests - sample variability
548.exchange2_r (max) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 2.36% 22639.000 23173.000 - 0.00% -
505.mcf_r 1.79% 13186.000 13422.000 - 0.00% -
511.povray_r 1.77% 21015.000 21387.000 - 0.00% -
500.perlbench_r 1.48% 13847.000 14052.000 - 0.00% -
557.xz_r 1.20% 12549.000 12700.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r -1.62% 1813477.000 1784085.000 - 0.00% -
505.mcf_r -1.29% 14249.000 14065.000 - 0.00% -
510.parest_r -1.17% 725746.000 717259.000 - 0.00% -
511.povray_r -1.14% 498628.000 492968.000 - 0.00% -
554.roms_r -1.04% 342780.000 339200.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -4.11% 11114.000 10657.000 - 0.00% -
507.cactuBSSN_r -3.31% 21233.000 20530.000 - 0.00% -
541.leela_r -3.05% 12801.000 12410.000 - 0.00% -
520.omnetpp_r -1.32% 13137.000 12963.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 91.67% 24.000 46.000 - 0.00% -
nb_compile_successful 90.91% 22.000 42.000 - 0.00% -
nb_execution_successful 90.91% 22.000 42.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.34s
Execution (seconds)
Name Current %
500.perlbench_r 14052.000 -
502.gcc_r 10732.000 -
503.bwaves_r 24115.000 -
505.mcf_r 13422.000 -
507.cactuBSSN_r 20530.000 -
508.namd_r 10629.000 -
510.parest_r 23173.000 -
511.povray_r 21387.000 -
519.lbm_r 17575.000 -
520.omnetpp_r 12963.000 -
521.wrf_r 21657.000 -
523.xalancbmk_r 11959.000 -
525.x264_r 14593.000 -
526.blender_r 12552.000 -
531.deepsjeng_r 10657.000 -
538.imagick_r 15390.000 -
541.leela_r 12410.000 -
544.nab_r 11771.000 -
549.fotonik3d_r 19926.000 -
554.roms_r 20186.000 -
557.xz_r 12700.000 -
Geometric Mean 15242.234 -
Code Size (bytes)
Name Current %
500.perlbench_r 1084694.000 -
502.gcc_r 4192381.000 -
503.bwaves_r 17998.000 -
505.mcf_r 14065.000 -
507.cactuBSSN_r 1784085.000 -
508.namd_r 355856.000 -
510.parest_r 717259.000 -
511.povray_r 492968.000 -
519.lbm_r 10113.000 -
520.omnetpp_r 741795.000 -
521.wrf_r 7595015.000 -
523.xalancbmk_r 1572222.000 -
525.x264_r 261290.000 -
526.blender_r 4367764.000 -
531.deepsjeng_r 50277.000 -
538.imagick_r 664554.000 -
541.leela_r 44991.000 -
544.nab_r 49221.000 -
549.fotonik3d_r 182055.000 -
554.roms_r 339200.000 -
557.xz_r 75633.000 -
Geometric Mean 298062.378 -
sample variability
Name Current %
500.perlbench_r 66.000 -
500.perlbench_r (avg) 66.000 -
500.perlbench_r (avg) (percentage) 0.470 -
500.perlbench_r (max) 71.000 -
500.perlbench_r (max) (percentage) 0.510 -
502.gcc_r 31.000 -
502.gcc_r (avg) 31.000 -
502.gcc_r (avg) (percentage) 0.290 -
502.gcc_r (max) 39.000 -
502.gcc_r (max) (percentage) 0.370 -
503.bwaves_r 40.000 -
503.bwaves_r (avg) 40.000 -
503.bwaves_r (avg) (percentage) 0.170 -
503.bwaves_r (max) 24.000 -
503.bwaves_r (max) (percentage) 0.100 -
505.mcf_r 49.000 -
505.mcf_r (avg) 49.000 -
505.mcf_r (avg) (percentage) 0.370 -
505.mcf_r (max) 61.000 -
505.mcf_r (max) (percentage) 0.460 -
507.cactuBSSN_r 51.000 -
507.cactuBSSN_r (avg) 51.000 -
507.cactuBSSN_r (avg) (percentage) 0.250 -
507.cactuBSSN_r (max) 78.000 -
507.cactuBSSN_r (max) (percentage) 0.380 -
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.170 -
508.namd_r (max) 35.000 -
508.namd_r (max) (percentage) 0.330 -
510.parest_r 34.000 -
510.parest_r (avg) 34.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 44.000 -
510.parest_r (max) (percentage) 0.190 -
511.povray_r 91.000 -
511.povray_r (avg) 91.000 -
511.povray_r (avg) (percentage) 0.430 -
511.povray_r (max) 109.000 -
511.povray_r (max) (percentage) 0.510 -
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 38.000 -
519.lbm_r (max) (percentage) 0.220 -
520.omnetpp_r 125.000 -
520.omnetpp_r (avg) 125.000 -
520.omnetpp_r (avg) (percentage) 0.970 -
520.omnetpp_r (max) 291.000 -
520.omnetpp_r (max) (percentage) 2.250 -
520.omnetpp_r (unexplained diff vs previous) 298.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.300 -
521.wrf_r 145.000 -
521.wrf_r (avg) 145.000 -
521.wrf_r (avg) (percentage) 0.670 -
521.wrf_r (max) 134.000 -
521.wrf_r (max) (percentage) 0.620 -
523.xalancbmk_r 57.000 -
523.xalancbmk_r (avg) 57.000 -
523.xalancbmk_r (avg) (percentage) 0.480 -
523.xalancbmk_r (max) 38.000 -
523.xalancbmk_r (max) (percentage) 0.320 -
525.x264_r 26.000 -
525.x264_r (avg) 26.000 -
525.x264_r (avg) (percentage) 0.180 -
525.x264_r (max) 20.000 -
525.x264_r (max) (percentage) 0.140 -
526.blender_r 51.000 -
526.blender_r (avg) 51.000 -
526.blender_r (avg) (percentage) 0.410 -
526.blender_r (max) 100.000 -
526.blender_r (max) (percentage) 0.800 -
531.deepsjeng_r 88.000 -
531.deepsjeng_r (avg) 88.000 -
531.deepsjeng_r (avg) (percentage) 0.830 -
531.deepsjeng_r (max) 87.000 -
531.deepsjeng_r (max) (percentage) 0.820 -
538.imagick_r 47.000 -
538.imagick_r (avg) 47.000 -
538.imagick_r (avg) (percentage) 0.310 -
538.imagick_r (max) 55.000 -
538.imagick_r (max) (percentage) 0.360 -
541.leela_r 34.000 -
541.leela_r (avg) 34.000 -
541.leela_r (avg) (percentage) 0.280 -
541.leela_r (max) 59.000 -
541.leela_r (max) (percentage) 0.480 -
544.nab_r 50.000 -
544.nab_r (avg) 50.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 63.000 -
544.nab_r (max) (percentage) 0.540 -
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 77.000 -
549.fotonik3d_r (avg) 77.000 -
549.fotonik3d_r (avg) (percentage) 0.390 -
549.fotonik3d_r (max) 67.000 -
549.fotonik3d_r (max) (percentage) 0.340 -
554.roms_r 28.000 -
554.roms_r (avg) 28.000 -
554.roms_r (avg) (percentage) 0.140 -
554.roms_r (max) 26.000 -
554.roms_r (max) (percentage) 0.130 -
557.xz_r 53.000 -
557.xz_r (avg) 53.000 -
557.xz_r (avg) (percentage) 0.420 -
557.xz_r (max) 149.000 -
557.xz_r (max) (percentage) 1.180 -
Geometric Mean 6.592 -9.85%