Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=0cec3ce5705b14bfc693c54ab47b65635744b4ce (+ 28 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/b3c686416e88bf135def0e72d316713af01445a1 (+ 72 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2e456ccf0c34a056e3ccafac4a0c7effef14d918 (+ 8 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-Os-build/39/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0039 (3-changed-components) 2024-07-08T02:20:24 0:00:00
Previous 0038 (2-changed-components) 2024-07-04T17:58:23 0:00:00
Baseline 0010 (4-changed-components) 2024-04-27T03:59:14 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 2 4
Performance Improvements 54 10
Added Tests 0 100
Unchanged Tests 814 756
Total Tests 870

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
508.namd_r 1.67% 426540.000 433680.000 - -1.28% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 20.00% 15.000 18.000 0.000 0.00% 0.000

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -5.15% 20949.000 19871.000 - -5.14% -
526.blender_r -4.44% 15217.000 14542.000 - -1.38% -
500.perlbench_r -1.70% 15957.000 15685.000 - -1.68% -
511.povray_r -1.63% 24835.000 24431.000 - -1.31% -
549.fotonik3d_r -1.05% 23040.000 22798.000 - -0.84% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (max) -51.07% 374.000 183.000 - 0.00% -
520.omnetpp_r (max) (percentage) -50.62% 2.410 1.190 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -47.01% 251.000 133.000 0.000 0.00% 0.000
520.omnetpp_r (unexplained diff vs previous) (percentage) -46.91% 1.620 0.860 0.000 0.00% 0.000
525.x264_r (max) -14.29% 14.000 12.000 - 0.00% -
531.deepsjeng_r (max) -10.53% 38.000 34.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
521.wrf_r (max) -8.81% 1124.000 1025.000 - 0.00% -
549.fotonik3d_r (max) -8.49% 271.000 248.000 - 0.00% -
500.perlbench_r (max) -8.46% 130.000 119.000 - 0.00% -
523.xalancbmk_r (max) -8.33% 72.000 66.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -7.63% 1.180 1.090 - 0.00% -
508.namd_r (max) -7.59% 79.000 73.000 - 0.00% -
526.blender_r (max) -7.55% 53.000 49.000 - 0.00% -
500.perlbench_r (max) (percentage) -7.32% 0.820 0.760 - 0.00% -
523.xalancbmk_r (max) (percentage) -7.14% 0.420 0.390 - 0.00% -
511.povray_r (max) -6.92% 419.000 390.000 - 0.00% -
508.namd_r (max) (percentage) -6.76% 0.740 0.690 - 0.00% -
519.lbm_r (max) (percentage) -6.25% 0.160 0.150 - 0.00% -
538.imagick_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
519.lbm_r -6.25% 32.000 30.000 - 0.00% -
519.lbm_r (avg) -6.25% 32.000 30.000 - 0.00% -
519.lbm_r (avg) (percentage) -5.88% 0.170 0.160 - 0.00% -
538.imagick_r (max) -5.45% 55.000 52.000 - 0.00% -
511.povray_r (max) (percentage) -5.33% 1.690 1.600 - 0.00% -
521.wrf_r -5.16% 678.000 643.000 - 0.00% -
521.wrf_r (avg) -5.16% 678.000 643.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
510.parest_r (max) (percentage) -4.29% 1.400 1.340 - 0.00% -
510.parest_r (max) -4.10% 366.000 351.000 - 0.00% -
507.cactuBSSN_r (max) -4.00% 25.000 24.000 - 0.00% -
521.wrf_r (max) (percentage) -3.91% 5.370 5.160 - 0.00% -
557.xz_r -3.45% 29.000 28.000 - 0.00% -
557.xz_r (avg) -3.45% 29.000 28.000 - 0.00% -
519.lbm_r (max) -3.33% 30.000 29.000 - 0.00% -
526.blender_r -3.33% 30.000 29.000 - 0.00% -
526.blender_r (avg) -3.33% 30.000 29.000 - 0.00% -
520.omnetpp_r -2.96% 169.000 164.000 - 0.00% -
520.omnetpp_r (avg) -2.96% 169.000 164.000 - 0.00% -
544.nab_r (max) -2.86% 35.000 34.000 - 0.00% -
500.perlbench_r -2.44% 41.000 40.000 - 0.00% -
500.perlbench_r (avg) -2.44% 41.000 40.000 - 0.00% -
505.mcf_r (max) -2.25% 89.000 87.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.83% 1.090 1.070 - 0.00% -
511.povray_r -1.81% 166.000 163.000 - 0.00% -
511.povray_r (avg) -1.81% 166.000 163.000 - 0.00% -
505.mcf_r (max) (percentage) -1.64% 0.610 0.600 - 0.00% -
549.fotonik3d_r -1.01% 198.000 196.000 - 0.00% -
549.fotonik3d_r (avg) -1.01% 198.000 196.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 2.77% 14218.000 14612.000 - -0.33% -
510.parest_r 1.23% 25923.000 26243.000 - 0.27% -
541.leela_r 1.23% 14907.000 15090.000 - 0.33% -
554.roms_r 1.19% 22152.000 22416.000 - -0.16% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r -1.28% 439292.000 433680.000 - 1.67% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -5.14% 20947.000 19871.000 - -5.15% -
557.xz_r -2.02% 12307.000 12058.000 - -0.46% -
500.perlbench_r -1.68% 15953.000 15685.000 - -1.70% -
526.blender_r -1.38% 14746.000 14542.000 - -4.44% -
538.imagick_r -1.36% 17663.000 17422.000 - 0.34% -
511.povray_r -1.31% 24755.000 24431.000 - -1.63% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 100.00% 21.000 42.000 - 0.00% -
nb_execution_successful 100.00% 21.000 42.000 - 0.00% -
nb_total_tests 100.00% 23.000 46.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 15685.000 -1.70%
502.gcc_r 12954.000 -
503.bwaves_r 23519.000 -
505.mcf_r 14612.000 -
507.cactuBSSN_r 12969.000 -
508.namd_r 10623.000 -
510.parest_r 26243.000 -
511.povray_r 24431.000 -1.63%
519.lbm_r 19357.000 -
520.omnetpp_r 15405.000 -
521.wrf_r 19871.000 -5.15%
523.xalancbmk_r 17112.000 -
525.x264_r 15796.000 -
526.blender_r 14542.000 -4.44%
531.deepsjeng_r 10093.000 -
538.imagick_r 17422.000 -
541.leela_r 15090.000 -
544.nab_r 14856.000 -
549.fotonik3d_r 22798.000 -1.05%
554.roms_r 22416.000 -
557.xz_r 12058.000 -
Geometric Mean 16455.904 -
Name Current %
500.perlbench_r 1804952.000 -
502.gcc_r 7304559.000 -
503.bwaves_r 21661.000 -
505.mcf_r 17579.000 -
507.cactuBSSN_r 2605834.000 -
508.namd_r 433680.000 1.67%
510.parest_r 5212293.000 -
511.povray_r 703302.000 -
519.lbm_r 13076.000 -
520.omnetpp_r 1576976.000 -
521.wrf_r 11898176.000 -
523.xalancbmk_r 3527911.000 -
525.x264_r 357746.000 -
526.blender_r 8276311.000 -
531.deepsjeng_r 68465.000 -
538.imagick_r 1420010.000 -
541.leela_r 108929.000 -
544.nab_r 136115.000 -
549.fotonik3d_r 231911.000 -
554.roms_r 567962.000 -
557.xz_r 156997.000 -
Geometric Mean 529493.323 -
Name Current %
500.perlbench_r 40.000 -2.44%
500.perlbench_r (avg) 40.000 -2.44%
500.perlbench_r (avg) (percentage) 0.260 -
500.perlbench_r (max) 119.000 -8.46%
500.perlbench_r (max) (percentage) 0.760 -7.32%
503.bwaves_r 72.000 -
503.bwaves_r (avg) 72.000 -
503.bwaves_r (avg) (percentage) 0.310 -
503.bwaves_r (max) 14.000 -
503.bwaves_r (max) (percentage) 0.060 -
505.mcf_r 74.000 -
505.mcf_r (avg) 74.000 -
505.mcf_r (avg) (percentage) 0.510 -
505.mcf_r (max) 87.000 -2.25%
505.mcf_r (max) (percentage) 0.600 -1.64%
507.cactuBSSN_r 28.000 -
507.cactuBSSN_r (avg) 28.000 -
507.cactuBSSN_r (avg) (percentage) 0.220 -
507.cactuBSSN_r (max) 24.000 -4.00%
507.cactuBSSN_r (max) (percentage) 0.190 -5.00%
508.namd_r 53.000 -
508.namd_r (avg) 53.000 -
508.namd_r (avg) (percentage) 0.500 -
508.namd_r (max) 73.000 -7.59%
508.namd_r (max) (percentage) 0.690 -6.76%
510.parest_r 78.000 -
510.parest_r (avg) 78.000 -
510.parest_r (avg) (percentage) 0.300 -
510.parest_r (max) 351.000 -4.10%
510.parest_r (max) (percentage) 1.340 -4.29%
511.povray_r 163.000 -1.81%
511.povray_r (avg) 163.000 -1.81%
511.povray_r (avg) (percentage) 0.670 -
511.povray_r (max) 390.000 -6.92%
511.povray_r (max) (percentage) 1.600 -5.33%
519.lbm_r 30.000 -6.25%
519.lbm_r (avg) 30.000 -6.25%
519.lbm_r (avg) (percentage) 0.160 -5.88%
519.lbm_r (max) 29.000 -3.33%
519.lbm_r (max) (percentage) 0.150 -6.25%
519.lbm_r (unexplained diff vs previous) 18.000 20.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.090 -
520.omnetpp_r 164.000 -2.96%
520.omnetpp_r (avg) 164.000 -2.96%
520.omnetpp_r (avg) (percentage) 1.070 -1.83%
520.omnetpp_r (max) 183.000 -51.07%
520.omnetpp_r (max) (percentage) 1.190 -50.62%
520.omnetpp_r (unexplained diff vs previous) 133.000 -47.01%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.860 -46.91%
521.wrf_r 643.000 -5.16%
521.wrf_r (avg) 643.000 -5.16%
521.wrf_r (avg) (percentage) 3.240 -
521.wrf_r (max) 1025.000 -8.81%
521.wrf_r (max) (percentage) 5.160 -3.91%
523.xalancbmk_r 58.000 -
523.xalancbmk_r (avg) 58.000 -
523.xalancbmk_r (avg) (percentage) 0.340 -
523.xalancbmk_r (max) 66.000 -8.33%
523.xalancbmk_r (max) (percentage) 0.390 -7.14%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.100 -
525.x264_r (max) 12.000 -14.29%
525.x264_r (max) (percentage) 0.080 -
526.blender_r 29.000 -3.33%
526.blender_r (avg) 29.000 -3.33%
526.blender_r (avg) (percentage) 0.200 -
526.blender_r (max) 49.000 -7.55%
526.blender_r (max) (percentage) 0.340 -
531.deepsjeng_r 60.000 -
531.deepsjeng_r (avg) 60.000 -
531.deepsjeng_r (avg) (percentage) 0.600 -
531.deepsjeng_r (max) 34.000 -10.53%
531.deepsjeng_r (max) (percentage) 0.340 -10.53%
538.imagick_r 34.000 -
538.imagick_r (avg) 34.000 -
538.imagick_r (avg) (percentage) 0.200 -
538.imagick_r (max) 52.000 -5.45%
538.imagick_r (max) (percentage) 0.300 -6.25%
541.leela_r 45.000 -
541.leela_r (avg) 45.000 -
541.leela_r (avg) (percentage) 0.300 -
541.leela_r (max) 48.000 -
541.leela_r (max) (percentage) 0.320 -
544.nab_r 41.000 -
544.nab_r (avg) 41.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 34.000 -2.86%
544.nab_r (max) (percentage) 0.230 -
549.fotonik3d_r 196.000 -1.01%
549.fotonik3d_r (avg) 196.000 -1.01%
549.fotonik3d_r (avg) (percentage) 0.860 -
549.fotonik3d_r (max) 248.000 -8.49%
549.fotonik3d_r (max) (percentage) 1.090 -7.63%
554.roms_r 69.000 -
554.roms_r (avg) 69.000 -
554.roms_r (avg) (percentage) 0.310 -
554.roms_r (max) 94.000 -
554.roms_r (max) (percentage) 0.420 -
557.xz_r 28.000 -3.45%
557.xz_r (avg) 28.000 -3.45%
557.xz_r (avg) (percentage) 0.240 -
557.xz_r (max) 32.000 -
557.xz_r (max) (percentage) 0.270 -
Geometric Mean 8.190 -4.71%