Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=ca25db0641f0fed03a55fa918feec4977d88a973 (+ 74 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/9045ab75b4b125827ed703fadabc17832f25de8f (+ 194 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2be0572f3a41d5d5a8bb3b2b04244b7c01ac0f58 (+ 38 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/cc71765a6f9373fe9d1c70677b6d3e33dee6fa1e (+ 125 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3-build/197/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0197 (4-changed-components) 2024-08-07T03:15:48 0:00:00
Previous 0197 (4-changed-components) 2024-08-07T03:15:48 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T00:00:32 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 0 20
Added Tests 2 91
Unchanged Tests 802 686
Total Tests 804

Added Tests - sample variability
549.fotonik3d_r (unexplained diff vs previous)
549.fotonik3d_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
557.xz_r 1.81% 185326.000 188674.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
554.roms_r 9.87% 24297.000 26695.000 - 0.00% -
521.wrf_r 8.60% 8650.000 9394.000 - 0.00% -
500.perlbench_r 8.02% 2008.000 2169.000 - 0.00% -
549.fotonik3d_r 4.41% 8572.000 8950.000 - 0.00% -
502.gcc_r 2.40% 3586.000 3672.000 - 0.00% -
525.x264_r 1.07% 2793.000 2823.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -25.04% 26771734.000 20068465.000 - 0.00% -
554.roms_r -16.34% 1093999.000 915282.000 - 0.00% -
549.fotonik3d_r -12.83% 409644.000 357075.000 - 0.00% -
505.mcf_r -8.16% 33037.000 30341.000 - 0.00% -
507.cactuBSSN_r -6.32% 4933079.000 4621230.000 - 0.00% -
508.namd_r -5.76% 856450.000 807096.000 - 0.00% -
531.deepsjeng_r -4.67% 107353.000 102337.000 - 0.00% -
544.nab_r -2.51% 201046.000 195998.000 - 0.00% -
525.x264_r -1.67% 582533.000 572792.000 - 0.00% -
541.leela_r -1.47% 184371.000 181656.000 - 0.00% -
538.imagick_r -1.45% 1969073.000 1940423.000 - 0.00% -
520.omnetpp_r -1.45% 1814986.000 1788587.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -4.25% 6702.000 6417.000 - 0.00% -
520.omnetpp_r -3.37% 3617.000 3495.000 - 0.00% -
531.deepsjeng_r -2.47% 5543.000 5406.000 - 0.00% -
544.nab_r -1.99% 7929.000 7771.000 - 0.00% -
519.lbm_r -1.27% 3300.000 3258.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 120.00% 20.000 44.000 - 0.00% -
nb_compile_successful 80.00% 20.000 36.000 - 0.00% -
nb_execution_successful 80.00% 20.000 36.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
549.fotonik3d_r (unexplained diff vs previous)
549.fotonik3d_r (unexplained diff vs previous) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 2169.000 -
502.gcc_r 3672.000 -
503.bwaves_r 8582.000 -
505.mcf_r 6417.000 -
507.cactuBSSN_r 6738.000 -
508.namd_r 3776.000 -
511.povray_r 437.000 -
519.lbm_r 3258.000 -
520.omnetpp_r 3495.000 -
521.wrf_r 9394.000 -
525.x264_r 2823.000 -
531.deepsjeng_r 5406.000 -
538.imagick_r 4022.000 -
541.leela_r 4608.000 -
544.nab_r 7771.000 -
549.fotonik3d_r 8950.000 -
554.roms_r 26695.000 -
557.xz_r 2348.000 -
Geometric Mean 4529.176 -
Name Current %
500.perlbench_r 2187354.000 -
502.gcc_r 9184223.000 -
503.bwaves_r 29904.000 -
505.mcf_r 30341.000 -
507.cactuBSSN_r 4621230.000 -
508.namd_r 807096.000 -
511.povray_r 945045.000 -
519.lbm_r 14482.000 -
520.omnetpp_r 1788587.000 -
521.wrf_r 20068465.000 -
525.x264_r 572792.000 -
531.deepsjeng_r 102337.000 -
538.imagick_r 1940423.000 -
541.leela_r 181656.000 -
544.nab_r 195998.000 -
549.fotonik3d_r 357075.000 -
554.roms_r 915282.000 -
557.xz_r 188674.000 -
Geometric Mean 522206.610 -
Name Current %
500.perlbench_r 21.000 -
500.perlbench_r (avg) 21.000 -
500.perlbench_r (avg) (percentage) 1.000 -
500.perlbench_r (max) 34.000 -
500.perlbench_r (max) (percentage) 1.580 -
503.bwaves_r 44.000 -
503.bwaves_r (avg) 44.000 -
503.bwaves_r (avg) (percentage) 0.520 -
503.bwaves_r (max) 42.000 -
503.bwaves_r (max) (percentage) 0.500 -
503.bwaves_r (unexplained diff vs previous) 31.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.360 -
505.mcf_r 67.000 -
505.mcf_r (avg) 67.000 -
505.mcf_r (avg) (percentage) 1.050 -
505.mcf_r (max) 109.000 -
505.mcf_r (max) (percentage) 1.700 -
505.mcf_r (unexplained diff vs previous) 41.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.640 -
507.cactuBSSN_r 64.000 -
507.cactuBSSN_r (avg) 64.000 -
507.cactuBSSN_r (avg) (percentage) 0.960 -
507.cactuBSSN_r (max) 69.000 -
507.cactuBSSN_r (max) (percentage) 1.030 -
508.namd_r 18.000 -
508.namd_r (avg) 18.000 -
508.namd_r (avg) (percentage) 0.500 -
508.namd_r (max) 17.000 -
508.namd_r (max) (percentage) 0.460 -
508.namd_r (unexplained diff vs previous) 11.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.290 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.090 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.570 -
519.lbm_r 16.000 -
519.lbm_r (avg) 16.000 -
519.lbm_r (avg) (percentage) 0.500 -
519.lbm_r (max) 51.000 -
519.lbm_r (max) (percentage) 1.580 -
519.lbm_r (unexplained diff vs previous) 7.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.210 -
520.omnetpp_r 43.000 -
520.omnetpp_r (avg) 43.000 -
520.omnetpp_r (avg) (percentage) 1.240 -
520.omnetpp_r (max) 63.000 -
520.omnetpp_r (max) (percentage) 1.820 -
520.omnetpp_r (unexplained diff vs previous) 3.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.090 -
521.wrf_r 135.000 -
521.wrf_r (avg) 135.000 -
521.wrf_r (avg) (percentage) 1.440 -
521.wrf_r (max) 113.000 -
521.wrf_r (max) (percentage) 1.210 -
525.x264_r 22.000 -
525.x264_r (avg) 22.000 -
525.x264_r (avg) (percentage) 0.800 -
525.x264_r (max) 44.000 -
525.x264_r (max) (percentage) 1.570 -
527.cam4_r (avg) (percentage) 0.900 -
527.cam4_r (max) (percentage) 0.450 -
531.deepsjeng_r 18.000 -
531.deepsjeng_r (avg) 18.000 -
531.deepsjeng_r (avg) (percentage) 0.340 -
531.deepsjeng_r (max) 67.000 -
531.deepsjeng_r (max) (percentage) 1.250 -
538.imagick_r 13.000 -
538.imagick_r (avg) 13.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 11.000 -
538.imagick_r (max) (percentage) 0.280 -
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.630 -
541.leela_r (max) 40.000 -
541.leela_r (max) (percentage) 0.880 -
544.nab_r 36.000 -
544.nab_r (avg) 36.000 -
544.nab_r (avg) (percentage) 0.470 -
544.nab_r (max) 27.000 -
544.nab_r (max) (percentage) 0.350 -
548.exchange2_r (avg) (percentage) 0.720 -
548.exchange2_r (max) (percentage) 0.350 -
549.fotonik3d_r 50.000 -
549.fotonik3d_r (avg) 50.000 -
549.fotonik3d_r (avg) (percentage) 0.560 -
549.fotonik3d_r (max) 39.000 -
549.fotonik3d_r (max) (percentage) 0.440 -
549.fotonik3d_r (unexplained diff vs previous) 0.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.000 -
554.roms_r 210.000 -
554.roms_r (avg) 210.000 -
554.roms_r (avg) (percentage) 0.790 -
554.roms_r (max) 312.000 -
554.roms_r (max) (percentage) 1.170 -
554.roms_r (unexplained diff vs previous) 219.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.820 -
557.xz_r 19.000 -
557.xz_r (avg) 19.000 -
557.xz_r (avg) (percentage) 0.810 -
557.xz_r (max) 37.000 -
557.xz_r (max) (percentage) 1.590 -
Geometric Mean 4.957 -19.27%