Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=632c5372771a6f167f3be554b2f84582169ffc07 (+ 35 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/747a06017196b6344e3f664706a11231ba712548 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4228baef1a94e8bde84ad74f2e0358120a2bcac7 (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=6670d3223c125525bfabe75225d7e699a776d705 (+ 251 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/206/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0206 (3-changed-components) 2024-06-24T13:13:44 0:00:00
Previous 0206 (3-changed-components) 2024-06-24T13:13:44 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 23
Performance Improvements 0 14
Added Tests 4 108
Unchanged Tests 908 767
Total Tests 912

Added Tests - sample variability
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 8.45% 32696.000 35460.000 - 0.00% -
521.wrf_r 8.19% 15543490.000 16816900.000 - 0.00% -
507.cactuBSSN_r 4.37% 3720089.000 3882615.000 - 0.00% -
500.perlbench_r 4.30% 2637259.000 2750726.000 - 0.00% -
508.namd_r 4.01% 707624.000 735998.000 - 0.00% -
557.xz_r 3.77% 145598.000 151086.000 - 0.00% -
510.parest_r 3.27% 1726330.000 1782770.000 - 0.00% -
554.roms_r 2.43% 855831.000 876660.000 - 0.00% -
526.blender_r 2.22% 11495020.000 11750698.000 - 0.00% -
538.imagick_r 2.13% 1571438.000 1604846.000 - 0.00% -
544.nab_r 1.91% 97442.000 99306.000 - 0.00% -
523.xalancbmk_r 1.83% 3738165.000 3806391.000 - 0.00% -
502.gcc_r 1.59% 10139425.000 10300997.000 - 0.00% -
511.povray_r 1.26% 1093239.000 1107029.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 11.53% 16274.000 18150.000 - 0.00% -
549.fotonik3d_r 10.36% 18173.000 20055.000 - 0.00% -
521.wrf_r 4.23% 11500.000 11986.000 - 0.00% -
508.namd_r 2.69% 9181.000 9428.000 - 0.00% -
505.mcf_r 2.23% 11867.000 12132.000 - 0.00% -
544.nab_r 1.87% 14307.000 14575.000 - 0.00% -
526.blender_r 1.54% 12174.000 12361.000 - 0.00% -
554.roms_r 1.14% 15236.000 15409.000 - 0.00% -
503.bwaves_r 1.05% 23928.000 24180.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -4.26% 646262.000 618717.000 - 0.00% -
520.omnetpp_r -3.00% 1925630.000 1867837.000 - 0.00% -
549.fotonik3d_r -2.46% 407605.000 397596.000 - 0.00% -
519.lbm_r -1.82% 12112.000 11892.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -4.84% 6489.000 6175.000 - 0.00% -
541.leela_r -4.61% 11637.000 11101.000 - 0.00% -
557.xz_r -3.28% 11553.000 11174.000 - 0.00% -
507.cactuBSSN_r -2.23% 12761.000 12476.000 - 0.00% -
511.povray_r -1.65% 18742.000 18432.000 - 0.00% -
538.imagick_r -1.13% 14062.000 13903.000 - 0.00% -
523.xalancbmk_r -1.06% 13135.000 12996.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 100.00% 23.000 46.000 - 0.00% -
nb_compile_successful 82.61% 23.000 42.000 - 0.00% -
nb_execution_successful 82.61% 23.000 42.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 13625.000 -
502.gcc_r 9976.000 -
503.bwaves_r 24180.000 -
505.mcf_r 12132.000 -
507.cactuBSSN_r 12476.000 -
508.namd_r 9428.000 -
510.parest_r 21704.000 -
511.povray_r 18432.000 -
519.lbm_r 18150.000 -
520.omnetpp_r 13441.000 -
521.wrf_r 11986.000 -
523.xalancbmk_r 12996.000 -
525.x264_r 6175.000 -
526.blender_r 12361.000 -
531.deepsjeng_r 7447.000 -
538.imagick_r 13903.000 -
541.leela_r 11101.000 -
544.nab_r 14575.000 -
549.fotonik3d_r 20055.000 -
554.roms_r 15409.000 -
557.xz_r 11174.000 -
Geometric Mean 13150.861 -
Name Current %
500.perlbench_r 2750726.000 -
502.gcc_r 10300997.000 -
503.bwaves_r 35460.000 -
505.mcf_r 23240.000 -
507.cactuBSSN_r 3882615.000 -
508.namd_r 735998.000 -
510.parest_r 1782770.000 -
511.povray_r 1107029.000 -
519.lbm_r 11892.000 -
520.omnetpp_r 1867837.000 -
521.wrf_r 16816900.000 -
523.xalancbmk_r 3806391.000 -
525.x264_r 618717.000 -
526.blender_r 11750698.000 -
531.deepsjeng_r 84779.000 -
538.imagick_r 1604846.000 -
541.leela_r 107023.000 -
544.nab_r 99306.000 -
549.fotonik3d_r 397596.000 -
554.roms_r 876660.000 -
557.xz_r 151086.000 -
Geometric Mean 646053.443 -
Name Current %
500.perlbench_r 96.000 -
500.perlbench_r (avg) 96.000 -
500.perlbench_r (avg) (percentage) 0.710 -
500.perlbench_r (max) 102.000 -
500.perlbench_r (max) (percentage) 0.750 -
500.perlbench_r (unexplained diff vs previous) 99.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.730 -
503.bwaves_r 101.000 -
503.bwaves_r (avg) 101.000 -
503.bwaves_r (avg) (percentage) 0.420 -
503.bwaves_r (max) 101.000 -
503.bwaves_r (max) (percentage) 0.420 -
503.bwaves_r (unexplained diff vs previous) 83.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.340 -
505.mcf_r 35.000 -
505.mcf_r (avg) 35.000 -
505.mcf_r (avg) (percentage) 0.290 -
505.mcf_r (max) 61.000 -
505.mcf_r (max) (percentage) 0.510 -
505.mcf_r (unexplained diff vs previous) 22.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.180 -
507.cactuBSSN_r 73.000 -
507.cactuBSSN_r (avg) 73.000 -
507.cactuBSSN_r (avg) (percentage) 0.590 -
507.cactuBSSN_r (max) 96.000 -
507.cactuBSSN_r (max) (percentage) 0.770 -
507.cactuBSSN_r (unexplained diff vs previous) 68.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.550 -
508.namd_r 42.000 -
508.namd_r (avg) 42.000 -
508.namd_r (avg) (percentage) 0.450 -
508.namd_r (max) 52.000 -
508.namd_r (max) (percentage) 0.560 -
508.namd_r (unexplained diff vs previous) 53.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.560 -
510.parest_r 49.000 -
510.parest_r (avg) 49.000 -
510.parest_r (avg) (percentage) 0.230 -
510.parest_r (max) 93.000 -
510.parest_r (max) (percentage) 0.430 -
510.parest_r (unexplained diff vs previous) 56.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.260 -
511.povray_r 112.000 -
511.povray_r (avg) 112.000 -
511.povray_r (avg) (percentage) 0.610 -
511.povray_r (max) 221.000 -
511.povray_r (max) (percentage) 1.200 -
511.povray_r (unexplained diff vs previous) 214.000 -
511.povray_r (unexplained diff vs previous) (percentage) 1.160 -
519.lbm_r 39.000 -
519.lbm_r (avg) 39.000 -
519.lbm_r (avg) (percentage) 0.220 -
519.lbm_r (max) 50.000 -
519.lbm_r (max) (percentage) 0.280 -
519.lbm_r (unexplained diff vs previous) 29.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.160 -
520.omnetpp_r 87.000 -
520.omnetpp_r (avg) 87.000 -
520.omnetpp_r (avg) (percentage) 0.650 -
520.omnetpp_r (max) 170.000 -
520.omnetpp_r (max) (percentage) 1.270 -
520.omnetpp_r (unexplained diff vs previous) 0.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.000 -
521.wrf_r 118.000 -
521.wrf_r (avg) 118.000 -
521.wrf_r (avg) (percentage) 0.990 -
521.wrf_r (max) 196.000 -
521.wrf_r (max) (percentage) 1.640 -
521.wrf_r (unexplained diff vs previous) 147.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 1.230 -
523.xalancbmk_r 25.000 -
523.xalancbmk_r (avg) 25.000 -
523.xalancbmk_r (avg) (percentage) 0.200 -
523.xalancbmk_r (max) 36.000 -
523.xalancbmk_r (max) (percentage) 0.280 -
523.xalancbmk_r (unexplained diff vs previous) 0.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.000 -
525.x264_r 14.000 -
525.x264_r (avg) 14.000 -
525.x264_r (avg) (percentage) 0.240 -
525.x264_r (max) 41.000 -
525.x264_r (max) (percentage) 0.680 -
525.x264_r (unexplained diff vs previous) 42.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.680 -
526.blender_r 51.000 -
526.blender_r (avg) 51.000 -
526.blender_r (avg) (percentage) 0.420 -
526.blender_r (max) 123.000 -
526.blender_r (max) (percentage) 1.000 -
526.blender_r (unexplained diff vs previous) 122.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.990 -
527.cam4_r (avg) (percentage) 0.330 -
527.cam4_r (max) (percentage) 0.260 -
531.deepsjeng_r 61.000 -
531.deepsjeng_r (avg) 61.000 -
531.deepsjeng_r (avg) (percentage) 0.820 -
531.deepsjeng_r (max) 110.000 -
531.deepsjeng_r (max) (percentage) 1.480 -
531.deepsjeng_r (unexplained diff vs previous) 28.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.380 -
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.160 -
538.imagick_r (max) 31.000 -
538.imagick_r (max) (percentage) 0.230 -
538.imagick_r (unexplained diff vs previous) 8.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.060 -
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 29.000 -
541.leela_r (max) (percentage) 0.270 -
541.leela_r (unexplained diff vs previous) 25.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.230 -
544.nab_r 39.000 -
544.nab_r (avg) 39.000 -
544.nab_r (avg) (percentage) 0.270 -
544.nab_r (max) 64.000 -
544.nab_r (max) (percentage) 0.440 -
544.nab_r (unexplained diff vs previous) 64.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.440 -
548.exchange2_r (avg) (percentage) 0.360 -
548.exchange2_r (max) (percentage) 0.220 -
549.fotonik3d_r 94.000 -
549.fotonik3d_r (avg) 94.000 -
549.fotonik3d_r (avg) (percentage) 0.470 -
549.fotonik3d_r (max) 164.000 -
549.fotonik3d_r (max) (percentage) 0.820 -
549.fotonik3d_r (unexplained diff vs previous) 17.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.080 -
554.roms_r 49.000 -
554.roms_r (avg) 49.000 -
554.roms_r (avg) (percentage) 0.320 -
554.roms_r (max) 103.000 -
554.roms_r (max) (percentage) 0.670 -
554.roms_r (unexplained diff vs previous) 71.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.460 -
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.140 -
557.xz_r (max) 29.000 -
557.xz_r (max) (percentage) 0.260 -
557.xz_r (unexplained diff vs previous) 20.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.180 -
Geometric Mean 4.609 -26.42%