Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=762910fbd19cf703d732ad3d2f2ff0d95c1cbfa2 (+ 13 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/e14c673ea9ab2eca5de4db91b478f0b5297ef321 (+ 57 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=f83e461f1014598a5cb4c89407ce303b9f0bd8ac (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=30e92e8838a078df359a97e36d048f06bbd5bec1 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os_LTO-build/8/
Filter

gnu-arm-master-Os_LTO test results

Run Order Start Time Duration
Current 0008 (3-changed-components) 2024-05-17T03:59:10 0:00:00
Previous 0001 (4-changed-components) 2024-04-26T15:32:22 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 4
Performance Improvements 9
Added Tests 107
Unchanged Tests 810
Total Tests 930

Performance Regressions - Execution Δ Previous Current σ
549.fotonik3d_r 3.51% 19864.000 20562.000 -
520.omnetpp_r 2.80% 13137.000 13505.000 -
510.parest_r 1.86% 22639.000 23060.000 -
505.mcf_r 1.55% 13186.000 13391.000 -

Performance Improvements - Execution Δ Previous Current σ
531.deepsjeng_r -2.83% 11114.000 10800.000 -
541.leela_r -2.57% 12801.000 12472.000 -
511.povray_r -2.07% 21015.000 20581.000 -
507.cactuBSSN_r -1.92% 21233.000 20826.000 -
523.xalancbmk_r -1.91% 11932.000 11704.000 -
500.perlbench_r -1.73% 13847.000 13607.000 -

Performance Improvements - Score Δ Previous Current σ
nb_total_tests 91.67% 24.000 46.000 -
nb_compile_successful 90.91% 22.000 42.000 -
nb_execution_successful 90.91% 22.000 42.000 -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
500.perlbench_r 13607.000 -1.73%
502.gcc_r 10858.000 -
503.bwaves_r 24085.000 -
505.mcf_r 13391.000 1.55%
507.cactuBSSN_r 20826.000 -1.92%
508.namd_r 10647.000 -
510.parest_r 23060.000 1.86%
511.povray_r 20581.000 -2.07%
519.lbm_r 17548.000 -
520.omnetpp_r 13505.000 2.80%
521.wrf_r 21818.000 -
523.xalancbmk_r 11704.000 -1.91%
525.x264_r 14605.000 -
526.blender_r 12506.000 -
531.deepsjeng_r 10800.000 -2.83%
538.imagick_r 15611.000 -
541.leela_r 12472.000 -2.57%
544.nab_r 11831.000 -
549.fotonik3d_r 20562.000 3.51%
554.roms_r 20235.000 -
557.xz_r 12538.000 -
Geometric Mean 15263.825 -
Name Current %
500.perlbench_r 1092752.000 -
502.gcc_r 4231285.000 -
503.bwaves_r 17990.000 -
505.mcf_r 14137.000 -
507.cactuBSSN_r 1812085.000 -
508.namd_r 356812.000 -
510.parest_r 724070.000 -
511.povray_r 497904.000 -
519.lbm_r 10105.000 -
520.omnetpp_r 745787.000 -
521.wrf_r 7621999.000 -
523.xalancbmk_r 1576009.000 -
525.x264_r 262002.000 -
526.blender_r 4392669.000 -
531.deepsjeng_r 50541.000 -
538.imagick_r 670602.000 -
541.leela_r 45342.000 -
544.nab_r 49421.000 -
549.fotonik3d_r 182703.000 -
554.roms_r 340924.000 -
557.xz_r 76061.000 -
Geometric Mean 299746.103 -
Name Current %
nb_compile_successful 42.000 90.91%
nb_execution_successful 42.000 90.91%
nb_total_tests 46.000 91.67%
Geometric Mean 43.293 91.16%
Name Current %
500.perlbench_r 17.000 -
500.perlbench_r (avg) 17.000 -
500.perlbench_r (avg) (percentage) 0.130 -
500.perlbench_r (max) 20.000 -
500.perlbench_r (max) (percentage) 0.150 -
500.perlbench_r (unexplained diff vs previous) 20.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.150 -
502.gcc_r 20.000 -
502.gcc_r (avg) 20.000 -
502.gcc_r (avg) (percentage) 0.190 -
502.gcc_r (max) 20.000 -
502.gcc_r (max) (percentage) 0.190 -
502.gcc_r (unexplained diff vs previous) 21.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.190 -
503.bwaves_r 89.000 -
503.bwaves_r (avg) 89.000 -
503.bwaves_r (avg) (percentage) 0.370 -
503.bwaves_r (max) 89.000 -
503.bwaves_r (max) (percentage) 0.370 -
503.bwaves_r (unexplained diff vs previous) 90.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.370 -
505.mcf_r 76.000 -
505.mcf_r (avg) 76.000 -
505.mcf_r (avg) (percentage) 0.570 -
505.mcf_r (max) 124.000 -
505.mcf_r (max) (percentage) 0.930 -
505.mcf_r (unexplained diff vs previous) 123.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.920 -
507.cactuBSSN_r 31.000 -
507.cactuBSSN_r (avg) 31.000 -
507.cactuBSSN_r (avg) (percentage) 0.150 -
507.cactuBSSN_r (max) 33.000 -
507.cactuBSSN_r (max) (percentage) 0.160 -
507.cactuBSSN_r (unexplained diff vs previous) 33.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.160 -
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.160 -
508.namd_r (max) 19.000 -
508.namd_r (max) (percentage) 0.180 -
508.namd_r (unexplained diff vs previous) 14.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.130 -
510.parest_r 145.000 -
510.parest_r (avg) 145.000 -
510.parest_r (avg) (percentage) 0.630 -
510.parest_r (max) 309.000 -
510.parest_r (max) (percentage) 1.340 -
510.parest_r (unexplained diff vs previous) 1.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.000 -
511.povray_r 174.000 -
511.povray_r (avg) 174.000 -
511.povray_r (avg) (percentage) 0.850 -
511.povray_r (max) 187.000 -
511.povray_r (max) (percentage) 0.910 -
511.povray_r (unexplained diff vs previous) 188.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.910 -
519.lbm_r 21.000 -
519.lbm_r (avg) 21.000 -
519.lbm_r (avg) (percentage) 0.120 -
519.lbm_r (max) 35.000 -
519.lbm_r (max) (percentage) 0.200 -
519.lbm_r (unexplained diff vs previous) 12.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.070 -
520.omnetpp_r 64.000 -
520.omnetpp_r (avg) 64.000 -
520.omnetpp_r (avg) (percentage) 0.480 -
520.omnetpp_r (max) 168.000 -
520.omnetpp_r (max) (percentage) 1.250 -
520.omnetpp_r (unexplained diff vs previous) 8.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.060 -
521.wrf_r 277.000 -
521.wrf_r (avg) 277.000 -
521.wrf_r (avg) (percentage) 1.270 -
521.wrf_r (max) 305.000 -
521.wrf_r (max) (percentage) 1.400 -
521.wrf_r (unexplained diff vs previous) 302.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 1.380 -
523.xalancbmk_r 63.000 -
523.xalancbmk_r (avg) 63.000 -
523.xalancbmk_r (avg) (percentage) 0.540 -
523.xalancbmk_r (max) 65.000 -
523.xalancbmk_r (max) (percentage) 0.560 -
523.xalancbmk_r (unexplained diff vs previous) 65.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.560 -
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 39.000 -
525.x264_r (max) (percentage) 0.270 -
525.x264_r (unexplained diff vs previous) 30.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.210 -
526.blender_r 11.000 -
526.blender_r (avg) 11.000 -
526.blender_r (avg) (percentage) 0.090 -
526.blender_r (max) 11.000 -
526.blender_r (max) (percentage) 0.090 -
526.blender_r (unexplained diff vs previous) 11.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.090 -
531.deepsjeng_r 78.000 -
531.deepsjeng_r (avg) 78.000 -
531.deepsjeng_r (avg) (percentage) 0.730 -
531.deepsjeng_r (max) 166.000 -
531.deepsjeng_r (max) (percentage) 1.540 -
531.deepsjeng_r (unexplained diff vs previous) 1.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.010 -
538.imagick_r 151.000 -
538.imagick_r (avg) 151.000 -
538.imagick_r (avg) (percentage) 0.970 -
538.imagick_r (max) 179.000 -
538.imagick_r (max) (percentage) 1.150 -
538.imagick_r (unexplained diff vs previous) 177.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 1.130 -
541.leela_r 19.000 -
541.leela_r (avg) 19.000 -
541.leela_r (avg) (percentage) 0.160 -
541.leela_r (max) 19.000 -
541.leela_r (max) (percentage) 0.160 -
541.leela_r (unexplained diff vs previous) 20.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.160 -
544.nab_r 52.000 -
544.nab_r (avg) 52.000 -
544.nab_r (avg) (percentage) 0.440 -
544.nab_r (max) 87.000 -
544.nab_r (max) (percentage) 0.740 -
544.nab_r (unexplained diff vs previous) 13.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.110 -
548.exchange2_r (max) (percentage) 0.000 -
549.fotonik3d_r 166.000 -
549.fotonik3d_r (avg) 166.000 -
549.fotonik3d_r (avg) (percentage) 0.810 -
549.fotonik3d_r (max) 172.000 -
549.fotonik3d_r (max) (percentage) 0.840 -
549.fotonik3d_r (unexplained diff vs previous) 146.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.710 -
554.roms_r 30.000 -
554.roms_r (avg) 30.000 -
554.roms_r (avg) (percentage) 0.150 -
554.roms_r (max) 32.000 -
554.roms_r (max) (percentage) 0.160 -
554.roms_r (unexplained diff vs previous) 25.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.120 -
557.xz_r 7.000 -
557.xz_r (avg) 7.000 -
557.xz_r (avg) (percentage) 0.060 -
557.xz_r (max) 11.000 -
557.xz_r (max) (percentage) 0.090 -
557.xz_r (unexplained diff vs previous) 11.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 4.438 -32748760692711967686656.00%