Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7846287a38e2b996c2faa6b3319a8a83564e6b40 (+ 20 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/44c9403ed1833ae71a59e84f9e37af3182be0df5 (+ 50 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c8b4ce0b368115714bd4cce131e1683759471099 (+ 5 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/213/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0213 (3-changed-components) 2024-07-11T19:57:44 0:00:00
Previous 0213 (3-changed-components) 2024-07-11T19:57:44 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 12
Performance Improvements 0 23
Added Tests 3 109
Unchanged Tests 951 810
Total Tests 954

Added Tests - sample variability
628.pop2_s
628.pop2_s (avg)
628.pop2_s (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 5.12% 150385.000 158085.000 - 0.00% -
508.namd_r 4.25% 707624.000 737678.000 - 0.00% -
600.perlbench_s 4.10% 2649560.000 2758203.000 - 0.00% -
607.cactuBSSN_s 3.89% 3684442.000 3827616.000 - 0.00% -
654.roms_s 2.41% 863494.000 884283.000 - 0.00% -
526.blender_r 2.10% 11474556.000 11715814.000 - 0.00% -
510.parest_r 2.08% 1733486.000 1769582.000 - 0.00% -
623.xalancbmk_s 1.17% 3748643.000 3792484.000 - 0.00% -
644.nab_s 1.16% 105482.000 106710.000 - 0.00% -
511.povray_r 1.01% 1093239.000 1104245.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 2.84% 10194.000 10483.000 - 0.00% -
607.cactuBSSN_s 2.61% 4798.000 4923.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -4.92% 646275.000 614482.000 - 0.00% -
648.exchange2_s -4.60% 164878.000 157286.000 - 0.00% -
620.omnetpp_s -2.92% 1922167.000 1866082.000 - 0.00% -
641.leela_s -2.60% 108742.000 105916.000 - 0.00% -
619.lbm_s -1.73% 13445.000 13213.000 - 0.00% -
603.bwaves_s -1.07% 52595.000 52031.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
628.pop2_s -99.74% 10109.000 26.000 - 0.00% -
625.x264_s -8.67% 1626.000 1485.000 - 0.00% -
600.perlbench_s -7.67% 2152.000 1987.000 - 0.00% -
623.xalancbmk_s -7.25% 3407.000 3160.000 - 0.00% -
511.povray_r -5.90% 373.000 351.000 - 0.00% -
657.xz_s -5.39% 2319.000 2194.000 - 0.00% -
605.mcf_s -4.58% 6394.000 6101.000 - 0.00% -
641.leela_s -3.69% 3605.000 3472.000 - 0.00% -
648.exchange2_s -3.31% 1422.000 1375.000 - 0.00% -
602.gcc_s -2.79% 4126.000 4011.000 - 0.00% -
654.roms_s -2.42% 24034.000 23453.000 - 0.00% -
649.fotonik3d_s -2.35% 10088.000 9851.000 - 0.00% -
526.blender_r -1.60% 9950.000 9791.000 - 0.00% -
631.deepsjeng_s -1.05% 3425.000 3389.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 100.00% 24.000 48.000 - 0.00% -
nb_compile_successful 83.33% 24.000 44.000 - 0.00% -
nb_execution_successful 82.61% 23.000 42.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s (avg) (percentage)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2426.000 -
510.parest_r 5466.000 -
511.povray_r 351.000 -
526.blender_r 9791.000 -
600.perlbench_s 1987.000 -
602.gcc_s 4011.000 -
603.bwaves_s 9067.000 -
605.mcf_s 6101.000 -
607.cactuBSSN_s 4923.000 -
619.lbm_s 29937.000 -
620.omnetpp_s 3901.000 -
623.xalancbmk_s 3160.000 -
625.x264_s 1485.000 -
628.pop2_s 26.000 -
631.deepsjeng_s 3389.000 -
638.imagick_s 3339.000 -
641.leela_s 3472.000 -
644.nab_s 10483.000 -
648.exchange2_s 1375.000 -
649.fotonik3d_s 9851.000 -
654.roms_s 23453.000 -
657.xz_s 2194.000 -
Geometric Mean 3369.692 -
Name Current %
508.namd_r 737678.000 -
510.parest_r 1769582.000 -
511.povray_r 1104245.000 -
526.blender_r 11715814.000 -
600.perlbench_s 2758203.000 -
602.gcc_s 10230910.000 -
603.bwaves_s 52031.000 -
605.mcf_s 23253.000 -
607.cactuBSSN_s 3827616.000 -
619.lbm_s 13213.000 -
620.omnetpp_s 1866082.000 -
623.xalancbmk_s 3792484.000 -
625.x264_s 614482.000 -
631.deepsjeng_s 85036.000 -
638.imagick_s 1689050.000 -
641.leela_s 105916.000 -
644.nab_s 106710.000 -
648.exchange2_s 157286.000 -
649.fotonik3d_s 341833.000 -
654.roms_s 884283.000 -
657.xz_s 158085.000 -
Geometric Mean 528824.827 -
Name Current %
508.namd_r 12.000 -
508.namd_r (avg) 12.000 -
508.namd_r (avg) (percentage) 0.510 -
508.namd_r (max) 8.000 -
508.namd_r (max) (percentage) 0.340 -
508.namd_r (unexplained diff vs previous) 8.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.330 -
510.parest_r 31.000 -
510.parest_r (avg) 31.000 -
510.parest_r (avg) (percentage) 0.570 -
510.parest_r (max) 22.000 -
510.parest_r (max) (percentage) 0.410 -
510.parest_r (unexplained diff vs previous) 10.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.180 -
511.povray_r 3.000 -
511.povray_r (avg) 3.000 -
511.povray_r (avg) (percentage) 1.070 -
511.povray_r (max) 4.000 -
511.povray_r (max) (percentage) 1.330 -
511.povray_r (unexplained diff vs previous) 4.000 -
511.povray_r (unexplained diff vs previous) (percentage) 1.140 -
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.390 -
526.blender_r (max) 46.000 -
526.blender_r (max) (percentage) 0.470 -
526.blender_r (unexplained diff vs previous) 46.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.470 -
600.perlbench_s 20.000 -
600.perlbench_s (avg) 20.000 -
600.perlbench_s (avg) (percentage) 1.030 -
600.perlbench_s (max) 33.000 -
600.perlbench_s (max) (percentage) 1.710 -
600.perlbench_s (unexplained diff vs previous) 19.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.960 -
603.bwaves_s 109.000 -
603.bwaves_s (avg) 109.000 -
603.bwaves_s (avg) (percentage) 1.210 -
603.bwaves_s (max) 93.000 -
603.bwaves_s (max) (percentage) 1.030 -
603.bwaves_s (unexplained diff vs previous) 3.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.030 -
605.mcf_s 64.000 -
605.mcf_s (avg) 64.000 -
605.mcf_s (avg) (percentage) 1.050 -
605.mcf_s (max) 71.000 -
605.mcf_s (max) (percentage) 1.180 -
605.mcf_s (unexplained diff vs previous) 32.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.520 -
607.cactuBSSN_s 69.000 -
607.cactuBSSN_s (avg) 69.000 -
607.cactuBSSN_s (avg) (percentage) 1.420 -
607.cactuBSSN_s (max) 81.000 -
607.cactuBSSN_s (max) (percentage) 1.650 -
607.cactuBSSN_s (unexplained diff vs previous) 59.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.200 -
619.lbm_s 652.000 -
619.lbm_s (avg) 652.000 -
619.lbm_s (avg) (percentage) 2.180 -
619.lbm_s (max) 353.000 -
619.lbm_s (max) (percentage) 1.180 -
619.lbm_s (unexplained diff vs previous) 28.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 0.090 -
620.omnetpp_s 47.000 -
620.omnetpp_s (avg) 47.000 -
620.omnetpp_s (avg) (percentage) 1.230 -
620.omnetpp_s (max) 73.000 -
620.omnetpp_s (max) (percentage) 1.890 -
620.omnetpp_s (unexplained diff vs previous) 58.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.490 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) (percentage) 0.960 -
623.xalancbmk_s 18.000 -
623.xalancbmk_s (avg) 18.000 -
623.xalancbmk_s (avg) (percentage) 0.580 -
623.xalancbmk_s (max) 27.000 -
623.xalancbmk_s (max) (percentage) 0.880 -
623.xalancbmk_s (unexplained diff vs previous) 28.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.890 -
625.x264_s 9.000 -
625.x264_s (avg) 9.000 -
625.x264_s (avg) (percentage) 0.640 -
625.x264_s (max) 10.000 -
625.x264_s (max) (percentage) 0.740 -
625.x264_s (unexplained diff vs previous) 11.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.740 -
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) (percentage) 8.620 -
628.pop2_s 0.000 -
628.pop2_s (avg) 0.000 -
628.pop2_s (avg) (percentage) 0.830 -
628.pop2_s (max) 0.000 -
628.pop2_s (max) (percentage) 0.460 -
631.deepsjeng_s 13.000 -
631.deepsjeng_s (avg) 13.000 -
631.deepsjeng_s (avg) (percentage) 0.400 -
631.deepsjeng_s (max) 11.000 -
631.deepsjeng_s (max) (percentage) 0.330 -
631.deepsjeng_s (unexplained diff vs previous) 5.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.150 -
638.imagick_s 8.000 -
638.imagick_s (avg) 8.000 -
638.imagick_s (avg) (percentage) 0.260 -
638.imagick_s (max) 9.000 -
638.imagick_s (max) (percentage) 0.270 -
638.imagick_s (unexplained diff vs previous) 2.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.060 -
641.leela_s 15.000 -
641.leela_s (avg) 15.000 -
641.leela_s (avg) (percentage) 0.450 -
641.leela_s (max) 36.000 -
641.leela_s (max) (percentage) 1.040 -
641.leela_s (unexplained diff vs previous) 2.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.060 -
644.nab_s 50.000 -
644.nab_s (avg) 50.000 -
644.nab_s (avg) (percentage) 0.480 -
644.nab_s (max) 48.000 -
644.nab_s (max) (percentage) 0.460 -
644.nab_s (unexplained diff vs previous) 17.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.160 -
648.exchange2_s 11.000 -
648.exchange2_s (avg) 11.000 -
648.exchange2_s (avg) (percentage) 0.860 -
648.exchange2_s (max) 12.000 -
648.exchange2_s (max) (percentage) 0.930 -
648.exchange2_s (unexplained diff vs previous) 10.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.730 -
649.fotonik3d_s 72.000 -
649.fotonik3d_s (avg) 72.000 -
649.fotonik3d_s (avg) (percentage) 0.740 -
649.fotonik3d_s (max) 66.000 -
649.fotonik3d_s (max) (percentage) 0.670 -
649.fotonik3d_s (unexplained diff vs previous) 26.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.260 -
654.roms_s 234.000 -
654.roms_s (avg) 234.000 -
654.roms_s (avg) (percentage) 1.000 -
654.roms_s (max) 164.000 -
654.roms_s (max) (percentage) 0.700 -
654.roms_s (unexplained diff vs previous) 96.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.410 -
657.xz_s 12.000 -
657.xz_s (avg) 12.000 -
657.xz_s (avg) (percentage) 0.550 -
657.xz_s (max) 8.000 -
657.xz_s (max) (percentage) 0.390 -
657.xz_s (unexplained diff vs previous) 1.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.050 -
Geometric Mean 3.695 -19.44%