Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=e20c1e410ba1e689cdc0aaf6becc8fd041608aa5 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/670cfd5fe6433ee8f2e86eedb197d2523dbb033b (+ 54 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c444cc1d8335243c5c4e636d6a26c472df85522c (+ 13 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f0a8fd3aaa73ffc8e87ab9da86f27331820085c (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/77/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0077 (3-changed-components) 2024-09-06T13:30:03 0:00:00
Previous 0077 (3-changed-components) 2024-09-06T13:30:03 0:00:00
Baseline 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 4
Performance Improvements 0 15
Added Tests 1 115
Unchanged Tests 965 832
Total Tests 966

Added Tests - sample variability
548.exchange2_r (max) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 2.51% 22639.000 23207.000 - 0.00% -
511.povray_r 2.30% 21015.000 21498.000 - 0.00% -
505.mcf_r 1.37% 13186.000 13367.000 - 0.00% -
523.xalancbmk_r 1.23% 11932.000 12079.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.25% 183875.000 179739.000 - 0.00% -
507.cactuBSSN_r -1.60% 1813477.000 1784485.000 - 0.00% -
510.parest_r -1.23% 725746.000 716795.000 - 0.00% -
541.leela_r -1.18% 45366.000 44831.000 - 0.00% -
511.povray_r -1.14% 498628.000 492944.000 - 0.00% -
505.mcf_r -1.12% 14249.000 14089.000 - 0.00% -
554.roms_r -1.04% 342780.000 339208.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -3.77% 11114.000 10695.000 - 0.00% -
507.cactuBSSN_r -2.94% 21233.000 20608.000 - 0.00% -
541.leela_r -2.53% 12801.000 12477.000 - 0.00% -
525.x264_r -1.13% 14731.000 14565.000 - 0.00% -
526.blender_r -1.06% 12586.000 12452.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 100.00% 22.000 44.000 - 0.00% -
nb_execution_successful 100.00% 22.000 44.000 - 0.00% -
nb_total_tests 83.33% 24.000 44.000 - 0.00% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13947.000 -
502.gcc_r 10816.000 -
503.bwaves_r 24153.000 -
505.mcf_r 13367.000 -
507.cactuBSSN_r 20608.000 -
508.namd_r 10645.000 -
510.parest_r 23207.000 -
511.povray_r 21498.000 -
519.lbm_r 17608.000 -
520.omnetpp_r 13261.000 -
521.wrf_r 22010.000 -
523.xalancbmk_r 12079.000 -
525.x264_r 14565.000 -
526.blender_r 12452.000 -
527.cam4_r 11669.000 -
531.deepsjeng_r 10695.000 -
538.imagick_r 15342.000 -
541.leela_r 12477.000 -
544.nab_r 11733.000 -
549.fotonik3d_r 20024.000 -
554.roms_r 20207.000 -
557.xz_r 12564.000 -
Geometric Mean 15091.376 -
Name Current %
500.perlbench_r 1084856.000 -
502.gcc_r 4192453.000 -
503.bwaves_r 17990.000 -
505.mcf_r 14089.000 -
507.cactuBSSN_r 1784485.000 -
508.namd_r 355856.000 -
510.parest_r 716795.000 -
511.povray_r 492944.000 -
519.lbm_r 10113.000 -
520.omnetpp_r 741619.000 -
521.wrf_r 7595351.000 -
523.xalancbmk_r 1570930.000 -
525.x264_r 261170.000 -
526.blender_r 4367472.000 -
527.cam4_r 1808049.000 -
531.deepsjeng_r 50293.000 -
538.imagick_r 664578.000 -
541.leela_r 44831.000 -
544.nab_r 49365.000 -
549.fotonik3d_r 179739.000 -
554.roms_r 339208.000 -
557.xz_r 75633.000 -
Geometric Mean 323313.733 -
Name Current %
500.perlbench_r 107.000 -
500.perlbench_r (avg) 107.000 -
500.perlbench_r (avg) (percentage) 0.770 -
500.perlbench_r (max) 177.000 -
500.perlbench_r (max) (percentage) 1.270 -
500.perlbench_r (unexplained diff vs previous) 179.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 1.280 -
502.gcc_r 30.000 -
502.gcc_r (avg) 30.000 -
502.gcc_r (avg) (percentage) 0.280 -
502.gcc_r (max) 32.000 -
502.gcc_r (max) (percentage) 0.300 -
502.gcc_r (unexplained diff vs previous) 5.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.050 -
503.bwaves_r 60.000 -
503.bwaves_r (avg) 60.000 -
503.bwaves_r (avg) (percentage) 0.250 -
503.bwaves_r (max) 74.000 -
503.bwaves_r (max) (percentage) 0.310 -
503.bwaves_r (unexplained diff vs previous) 72.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.300 -
505.mcf_r 49.000 -
505.mcf_r (avg) 49.000 -
505.mcf_r (avg) (percentage) 0.370 -
505.mcf_r (max) 65.000 -
505.mcf_r (max) (percentage) 0.490 -
505.mcf_r (unexplained diff vs previous) 53.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.400 -
507.cactuBSSN_r 63.000 -
507.cactuBSSN_r (avg) 63.000 -
507.cactuBSSN_r (avg) (percentage) 0.310 -
507.cactuBSSN_r (max) 111.000 -
507.cactuBSSN_r (max) (percentage) 0.540 -
507.cactuBSSN_r (unexplained diff vs previous) 16.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.080 -
508.namd_r 28.000 -
508.namd_r (avg) 28.000 -
508.namd_r (avg) (percentage) 0.270 -
508.namd_r (max) 79.000 -
508.namd_r (max) (percentage) 0.750 -
508.namd_r (unexplained diff vs previous) 79.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.740 -
510.parest_r 20.000 -
510.parest_r (avg) 20.000 -
510.parest_r (avg) (percentage) 0.090 -
510.parest_r (max) 13.000 -
510.parest_r (max) (percentage) 0.060 -
510.parest_r (unexplained diff vs previous) 9.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.040 -
511.povray_r 85.000 -
511.povray_r (avg) 85.000 -
511.povray_r (avg) (percentage) 0.400 -
511.povray_r (max) 73.000 -
511.povray_r (max) (percentage) 0.340 -
511.povray_r (unexplained diff vs previous) 29.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.130 -
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 24.000 -
519.lbm_r (max) (percentage) 0.140 -
519.lbm_r (unexplained diff vs previous) 10.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.060 -
520.omnetpp_r 137.000 -
520.omnetpp_r (avg) 137.000 -
520.omnetpp_r (avg) (percentage) 1.040 -
520.omnetpp_r (max) 271.000 -
520.omnetpp_r (max) (percentage) 2.050 -
520.omnetpp_r (unexplained diff vs previous) 204.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.540 -
521.wrf_r 107.000 -
521.wrf_r (avg) 107.000 -
521.wrf_r (avg) (percentage) 0.490 -
521.wrf_r (max) 158.000 -
521.wrf_r (max) (percentage) 0.720 -
521.wrf_r (unexplained diff vs previous) 155.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.700 -
523.xalancbmk_r 48.000 -
523.xalancbmk_r (avg) 48.000 -
523.xalancbmk_r (avg) (percentage) 0.400 -
523.xalancbmk_r (max) 44.000 -
523.xalancbmk_r (max) (percentage) 0.370 -
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 72.000 -
525.x264_r (max) (percentage) 0.500 -
525.x264_r (unexplained diff vs previous) 73.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.500 -
526.blender_r 36.000 -
526.blender_r (avg) 36.000 -
526.blender_r (avg) (percentage) 0.290 -
526.blender_r (max) 27.000 -
526.blender_r (max) (percentage) 0.220 -
527.cam4_r 44.000 -
527.cam4_r (avg) 44.000 -
527.cam4_r (avg) (percentage) 0.380 -
527.cam4_r (max) 51.000 -
527.cam4_r (max) (percentage) 0.440 -
527.cam4_r (unexplained diff vs previous) 24.000 -
527.cam4_r (unexplained diff vs previous) (percentage) 0.210 -
531.deepsjeng_r 80.000 -
531.deepsjeng_r (avg) 80.000 -
531.deepsjeng_r (avg) (percentage) 0.750 -
531.deepsjeng_r (max) 45.000 -
531.deepsjeng_r (max) (percentage) 0.430 -
531.deepsjeng_r (unexplained diff vs previous) 24.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.220 -
538.imagick_r 70.000 -
538.imagick_r (avg) 70.000 -
538.imagick_r (avg) (percentage) 0.460 -
538.imagick_r (max) 87.000 -
538.imagick_r (max) (percentage) 0.570 -
538.imagick_r (unexplained diff vs previous) 83.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.540 -
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.240 -
541.leela_r (max) 37.000 -
541.leela_r (max) (percentage) 0.300 -
541.leela_r (unexplained diff vs previous) 34.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.270 -
544.nab_r 62.000 -
544.nab_r (avg) 62.000 -
544.nab_r (avg) (percentage) 0.530 -
544.nab_r (max) 102.000 -
544.nab_r (max) (percentage) 0.870 -
544.nab_r (unexplained diff vs previous) 32.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.270 -
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 64.000 -
549.fotonik3d_r (avg) 64.000 -
549.fotonik3d_r (avg) (percentage) 0.320 -
549.fotonik3d_r (max) 72.000 -
549.fotonik3d_r (max) (percentage) 0.360 -
549.fotonik3d_r (unexplained diff vs previous) 45.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.220 -
554.roms_r 40.000 -
554.roms_r (avg) 40.000 -
554.roms_r (avg) (percentage) 0.200 -
554.roms_r (max) 66.000 -
554.roms_r (max) (percentage) 0.330 -
554.roms_r (unexplained diff vs previous) 66.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.330 -
557.xz_r 26.000 -
557.xz_r (avg) 26.000 -
557.xz_r (avg) (percentage) 0.210 -
557.xz_r (max) 6.000 -
557.xz_r (max) (percentage) 0.050 -
557.xz_r (unexplained diff vs previous) 2.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.020 -
Geometric Mean 5.103 -6.97%