Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=66e545391e25dabd9ed4b6c42bc58bc30dd6b22e (+ 77 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/747a06017196b6344e3f664706a11231ba712548 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=9fc639f654dc004736836613be703e6bed0c36a8 (+ 20 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (+ 226 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3_LTO-build/215/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0215 (3-changed-components) 2024-06-30T11:02:55 0:00:00
Previous 0215 (3-changed-components) 2024-06-30T11:02:55 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T13:01:06 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 22
Performance Improvements 0 12
Added Tests 0 104
Unchanged Tests 912 774
Total Tests 912

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 8.45% 32696.000 35460.000 - 0.00% -
521.wrf_r 8.19% 15543490.000 16816900.000 - 0.00% -
507.cactuBSSN_r 4.37% 3720089.000 3882647.000 - 0.00% -
500.perlbench_r 4.30% 2637259.000 2750726.000 - 0.00% -
508.namd_r 4.01% 707624.000 735998.000 - 0.00% -
557.xz_r 3.77% 145598.000 151086.000 - 0.00% -
510.parest_r 3.27% 1726330.000 1782770.000 - 0.00% -
554.roms_r 2.43% 855831.000 876660.000 - 0.00% -
526.blender_r 2.22% 11495020.000 11750698.000 - 0.00% -
538.imagick_r 2.13% 1571438.000 1604846.000 - 0.00% -
544.nab_r 1.91% 97442.000 99306.000 - 0.00% -
523.xalancbmk_r 1.83% 3738165.000 3806391.000 - 0.00% -
502.gcc_r 1.59% 10139425.000 10300997.000 - 0.00% -
511.povray_r 1.26% 1093239.000 1107029.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 11.58% 16274.000 18159.000 - 0.00% -
549.fotonik3d_r 10.74% 18173.000 20125.000 - 0.00% -
531.deepsjeng_r 3.35% 7443.000 7692.000 - 0.00% -
508.namd_r 2.98% 9181.000 9455.000 - 0.00% -
521.wrf_r 2.64% 11500.000 11804.000 - 0.00% -
544.nab_r 2.45% 14307.000 14658.000 - 0.00% -
505.mcf_r 2.33% 11867.000 12143.000 - 0.00% -
554.roms_r 1.23% 15236.000 15423.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -4.26% 646262.000 618717.000 - 0.00% -
520.omnetpp_r -3.00% 1925630.000 1867837.000 - 0.00% -
549.fotonik3d_r -2.46% 407605.000 397596.000 - 0.00% -
519.lbm_r -1.82% 12112.000 11892.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -5.46% 6489.000 6135.000 - 0.00% -
541.leela_r -4.41% 11637.000 11124.000 - 0.00% -
557.xz_r -3.19% 11553.000 11184.000 - 0.00% -
507.cactuBSSN_r -3.15% 12761.000 12359.000 - 0.00% -
511.povray_r -2.35% 18742.000 18301.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 100.00% 23.000 46.000 - 0.00% -
nb_compile_successful 82.61% 23.000 42.000 - 0.00% -
nb_execution_successful 82.61% 23.000 42.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.32s
Name Current %
500.perlbench_r 13606.000 -
502.gcc_r 9947.000 -
503.bwaves_r 24100.000 -
505.mcf_r 12143.000 -
507.cactuBSSN_r 12359.000 -
508.namd_r 9455.000 -
510.parest_r 21691.000 -
511.povray_r 18301.000 -
519.lbm_r 18159.000 -
520.omnetpp_r 13393.000 -
521.wrf_r 11804.000 -
523.xalancbmk_r 13007.000 -
525.x264_r 6135.000 -
526.blender_r 12187.000 -
531.deepsjeng_r 7692.000 -
538.imagick_r 13924.000 -
541.leela_r 11124.000 -
544.nab_r 14658.000 -
549.fotonik3d_r 20125.000 -
554.roms_r 15423.000 -
557.xz_r 11184.000 -
Geometric Mean 13143.157 -
Name Current %
500.perlbench_r 2750726.000 -
502.gcc_r 10300997.000 -
503.bwaves_r 35460.000 -
505.mcf_r 23240.000 -
507.cactuBSSN_r 3882647.000 -
508.namd_r 735998.000 -
510.parest_r 1782770.000 -
511.povray_r 1107029.000 -
519.lbm_r 11892.000 -
520.omnetpp_r 1867837.000 -
521.wrf_r 16816900.000 -
523.xalancbmk_r 3806391.000 -
525.x264_r 618717.000 -
526.blender_r 11750698.000 -
531.deepsjeng_r 84779.000 -
538.imagick_r 1604846.000 -
541.leela_r 107023.000 -
544.nab_r 99306.000 -
549.fotonik3d_r 397596.000 -
554.roms_r 876660.000 -
557.xz_r 151086.000 -
Geometric Mean 646053.696 -
Name Current %
500.perlbench_r 91.000 -
500.perlbench_r (avg) 91.000 -
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 88.000 -
500.perlbench_r (max) (percentage) 0.650 -
500.perlbench_r (unexplained diff vs previous) 19.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.140 -
503.bwaves_r 101.000 -
503.bwaves_r (avg) 101.000 -
503.bwaves_r (avg) (percentage) 0.420 -
503.bwaves_r (max) 91.000 -
503.bwaves_r (max) (percentage) 0.380 -
503.bwaves_r (unexplained diff vs previous) 80.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.330 -
505.mcf_r 34.000 -
505.mcf_r (avg) 34.000 -
505.mcf_r (avg) (percentage) 0.280 -
505.mcf_r (max) 19.000 -
505.mcf_r (max) (percentage) 0.160 -
505.mcf_r (unexplained diff vs previous) 11.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.090 -
507.cactuBSSN_r 72.000 -
507.cactuBSSN_r (avg) 72.000 -
507.cactuBSSN_r (avg) (percentage) 0.590 -
507.cactuBSSN_r (max) 88.000 -
507.cactuBSSN_r (max) (percentage) 0.720 -
508.namd_r 41.000 -
508.namd_r (avg) 41.000 -
508.namd_r (avg) (percentage) 0.440 -
508.namd_r (max) 44.000 -
508.namd_r (max) (percentage) 0.470 -
508.namd_r (unexplained diff vs previous) 27.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.290 -
510.parest_r 47.000 -
510.parest_r (avg) 47.000 -
510.parest_r (avg) (percentage) 0.220 -
510.parest_r (max) 52.000 -
510.parest_r (max) (percentage) 0.240 -
510.parest_r (unexplained diff vs previous) 13.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.060 -
511.povray_r 111.000 -
511.povray_r (avg) 111.000 -
511.povray_r (avg) (percentage) 0.610 -
511.povray_r (max) 206.000 -
511.povray_r (max) (percentage) 1.130 -
511.povray_r (unexplained diff vs previous) 131.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.720 -
519.lbm_r 39.000 -
519.lbm_r (avg) 39.000 -
519.lbm_r (avg) (percentage) 0.220 -
519.lbm_r (max) 49.000 -
519.lbm_r (max) (percentage) 0.270 -
519.lbm_r (unexplained diff vs previous) 9.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.050 -
520.omnetpp_r 85.000 -
520.omnetpp_r (avg) 85.000 -
520.omnetpp_r (avg) (percentage) 0.640 -
520.omnetpp_r (max) 154.000 -
520.omnetpp_r (max) (percentage) 1.150 -
520.omnetpp_r (unexplained diff vs previous) 48.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.360 -
521.wrf_r 121.000 -
521.wrf_r (avg) 121.000 -
521.wrf_r (avg) (percentage) 1.030 -
521.wrf_r (max) 192.000 -
521.wrf_r (max) (percentage) 1.630 -
521.wrf_r (unexplained diff vs previous) 182.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 1.540 -
523.xalancbmk_r 24.000 -
523.xalancbmk_r (avg) 24.000 -
523.xalancbmk_r (avg) (percentage) 0.190 -
523.xalancbmk_r (max) 33.000 -
523.xalancbmk_r (max) (percentage) 0.260 -
523.xalancbmk_r (unexplained diff vs previous) 11.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.080 -
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.260 -
525.x264_r (max) 39.000 -
525.x264_r (max) (percentage) 0.650 -
525.x264_r (unexplained diff vs previous) 40.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.650 -
526.blender_r 59.000 -
526.blender_r (avg) 59.000 -
526.blender_r (avg) (percentage) 0.490 -
526.blender_r (max) 171.000 -
526.blender_r (max) (percentage) 1.410 -
526.blender_r (unexplained diff vs previous) 174.000 -
526.blender_r (unexplained diff vs previous) (percentage) 1.430 -
527.cam4_r (avg) (percentage) 0.330 -
527.cam4_r (max) (percentage) 0.260 -
531.deepsjeng_r 71.000 -
531.deepsjeng_r (avg) 71.000 -
531.deepsjeng_r (avg) (percentage) 0.930 -
531.deepsjeng_r (max) 253.000 -
531.deepsjeng_r (max) (percentage) 3.290 -
531.deepsjeng_r (unexplained diff vs previous) 245.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 3.190 -
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.160 -
538.imagick_r (max) 30.000 -
538.imagick_r (max) (percentage) 0.220 -
538.imagick_r (unexplained diff vs previous) 21.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.150 -
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 23.000 -
541.leela_r (max) (percentage) 0.210 -
541.leela_r (unexplained diff vs previous) 23.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.210 -
544.nab_r 41.000 -
544.nab_r (avg) 41.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 83.000 -
544.nab_r (max) (percentage) 0.570 -
544.nab_r (unexplained diff vs previous) 83.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.570 -
548.exchange2_r (avg) (percentage) 0.360 -
548.exchange2_r (max) (percentage) 0.220 -
549.fotonik3d_r 94.000 -
549.fotonik3d_r (avg) 94.000 -
549.fotonik3d_r (avg) (percentage) 0.470 -
549.fotonik3d_r (max) 154.000 -
549.fotonik3d_r (max) (percentage) 0.770 -
549.fotonik3d_r (unexplained diff vs previous) 70.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.350 -
554.roms_r 47.000 -
554.roms_r (avg) 47.000 -
554.roms_r (avg) (percentage) 0.310 -
554.roms_r (max) 95.000 -
554.roms_r (max) (percentage) 0.620 -
554.roms_r (unexplained diff vs previous) 14.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.090 -
557.xz_r 14.000 -
557.xz_r (avg) 14.000 -
557.xz_r (avg) (percentage) 0.130 -
557.xz_r (max) 25.000 -
557.xz_r (max) (percentage) 0.230 -
557.xz_r (unexplained diff vs previous) 10.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 5.668 -