Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7a5fa3dbe555794ce401a7435cb91f8695fc9847 (+ 7 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c23ce23e9ce162c49bca8900c8a20079b49501c9 (+ 31 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=5d00c201b9a2da768a79ea8d5311f257871c0b43 (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=fa6f8700a990ab643c50f053d9aae1f5801befc3 (+ 214 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/107/
Filter

gnu-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0107 (3-changed-components) 2023-09-18T13:02:52 0:00:00
Previous 0107 (3-changed-components) 2023-09-18T13:02:52 0:00:00
Baseline 0001 (4-changed-components) 2023-03-05T09:27:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 14
Performance Improvements 0 20
Added Tests 2 114
Unchanged Tests 964 818
Total Tests 966

Added Tests - sample variability
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 3.30% 150385.000 155353.000 - 0.00% -
607.cactuBSSN_s 2.95% 3684442.000 3792984.000 - 0.00% -
508.namd_r 2.86% 707624.000 727866.000 - 0.00% -
631.deepsjeng_s 2.40% 84996.000 87032.000 - 0.00% -
510.parest_r 2.39% 1733486.000 1774833.000 - 0.00% -
628.pop2_s 2.26% 3413948.000 3491087.000 - 0.00% -
603.bwaves_s 1.81% 52595.000 53547.000 - 0.00% -
526.blender_r 1.62% 11474556.000 11660321.000 - 0.00% -
602.gcc_s 1.55% 10139438.000 10296586.000 - 0.00% -
600.perlbench_s 1.44% 2649560.000 2687747.000 - 0.00% -
654.roms_s 1.16% 863494.000 873497.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
620.omnetpp_s 2.90% 3937.000 4051.000 - 0.00% -
644.nab_s 2.79% 10194.000 10478.000 - 0.00% -
605.mcf_s 1.77% 6394.000 6507.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s -3.82% 164878.000 158582.000 - 0.00% -
620.omnetpp_s -2.03% 1922167.000 1883174.000 - 0.00% -
641.leela_s -2.01% 108742.000 106559.000 - 0.00% -
625.x264_s -1.88% 646275.000 634138.000 - 0.00% -
605.mcf_s -1.58% 23365.000 22997.000 - 0.00% -
638.imagick_s -1.23% 1700122.000 1679290.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -7.07% 1626.000 1511.000 - 0.00% -
600.perlbench_s -4.93% 2152.000 2046.000 - 0.00% -
619.lbm_s -4.86% 29971.000 28514.000 - 0.00% -
657.xz_s -4.83% 2319.000 2207.000 - 0.00% -
648.exchange2_s -4.50% 1422.000 1358.000 - 0.00% -
621.wrf_s -4.25% 6687.000 6403.000 - 0.00% -
654.roms_s -3.20% 24034.000 23264.000 - 0.00% -
649.fotonik3d_s -3.10% 10088.000 9775.000 - 0.00% -
641.leela_s -2.27% 3605.000 3523.000 - 0.00% -
623.xalancbmk_s -2.11% 3407.000 3335.000 - 0.00% -
628.pop2_s -1.90% 10109.000 9917.000 - 0.00% -
511.povray_r -1.88% 373.000 366.000 - 0.00% -
631.deepsjeng_s -1.61% 3425.000 3370.000 - 0.00% -
638.imagick_s -1.07% 3368.000 3332.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s (avg) (percentage)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 2416.000 -
510.parest_r 5480.000 -
511.povray_r 366.000 -
526.blender_r 9904.000 -
600.perlbench_s 2046.000 -
602.gcc_s 4142.000 -
603.bwaves_s 9016.000 -
605.mcf_s 6507.000 -
607.cactuBSSN_s 4802.000 -
619.lbm_s 28514.000 -
620.omnetpp_s 4051.000 -
621.wrf_s 6403.000 -
623.xalancbmk_s 3335.000 -
625.x264_s 1511.000 -
628.pop2_s 9917.000 -
631.deepsjeng_s 3370.000 -
638.imagick_s 3332.000 -
641.leela_s 3523.000 -
644.nab_s 10478.000 -
648.exchange2_s 1358.000 -
649.fotonik3d_s 9775.000 -
654.roms_s 23264.000 -
657.xz_s 2207.000 -
Geometric Mean 4524.388 -
Name Current %
508.namd_r 727866.000 -
510.parest_r 1774833.000 -
511.povray_r 1092606.000 -
526.blender_r 11660321.000 -
600.perlbench_s 2687747.000 -
602.gcc_s 10296586.000 -
603.bwaves_s 53547.000 -
605.mcf_s 22997.000 -
607.cactuBSSN_s 3792984.000 -
619.lbm_s 13433.000 -
620.omnetpp_s 1883174.000 -
621.wrf_s 15723646.000 -
623.xalancbmk_s 3780619.000 -
625.x264_s 634138.000 -
628.pop2_s 3491087.000 -
631.deepsjeng_s 87032.000 -
638.imagick_s 1679290.000 -
641.leela_s 106559.000 -
644.nab_s 105882.000 -
648.exchange2_s 158582.000 -
649.fotonik3d_s 343946.000 -
654.roms_s 873497.000 -
657.xz_s 155353.000 -
Geometric Mean 665787.406 -
Name Current %
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.600 -
508.namd_r (max) 17.000 -
508.namd_r (max) (percentage) 0.720 -
508.namd_r (unexplained diff vs previous) 0.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.000 -
510.parest_r 52.000 -
510.parest_r (avg) 52.000 -
510.parest_r (avg) (percentage) 0.960 -
510.parest_r (max) 82.000 -
510.parest_r (max) (percentage) 1.500 -
510.parest_r (unexplained diff vs previous) 11.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.200 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.200 -
511.povray_r (max) 7.000 -
511.povray_r (max) (percentage) 1.940 -
511.povray_r (unexplained diff vs previous) 1.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.270 -
526.blender_r 44.000 -
526.blender_r (avg) 44.000 -
526.blender_r (avg) (percentage) 0.450 -
526.blender_r (max) 96.000 -
526.blender_r (max) (percentage) 0.970 -
526.blender_r (unexplained diff vs previous) 61.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.620 -
600.perlbench_s 23.000 -
600.perlbench_s (avg) 23.000 -
600.perlbench_s (avg) (percentage) 1.130 -
600.perlbench_s (max) 33.000 -
600.perlbench_s (max) (percentage) 1.630 -
600.perlbench_s (unexplained diff vs previous) 34.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 1.660 -
603.bwaves_s 199.000 -
603.bwaves_s (avg) 199.000 -
603.bwaves_s (avg) (percentage) 2.210 -
603.bwaves_s (max) 311.000 -
603.bwaves_s (max) (percentage) 3.450 -
603.bwaves_s (unexplained diff vs previous) 64.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.710 -
605.mcf_s 70.000 -
605.mcf_s (avg) 70.000 -
605.mcf_s (avg) (percentage) 1.080 -
605.mcf_s (max) 76.000 -
605.mcf_s (max) (percentage) 1.180 -
605.mcf_s (unexplained diff vs previous) 64.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.980 -
607.cactuBSSN_s 80.000 -
607.cactuBSSN_s (avg) 80.000 -
607.cactuBSSN_s (avg) (percentage) 1.680 -
607.cactuBSSN_s (max) 156.000 -
607.cactuBSSN_s (max) (percentage) 3.260 -
607.cactuBSSN_s (unexplained diff vs previous) 76.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.580 -
619.lbm_s 1331.000 -
619.lbm_s (avg) 1331.000 -
619.lbm_s (avg) (percentage) 4.670 -
619.lbm_s (max) 2053.000 -
619.lbm_s (max) (percentage) 7.200 -
619.lbm_s (unexplained diff vs previous) 9.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 0.030 -
620.omnetpp_s 70.000 -
620.omnetpp_s (avg) 70.000 -
620.omnetpp_s (avg) (percentage) 1.740 -
620.omnetpp_s (max) 79.000 -
620.omnetpp_s (max) (percentage) 1.970 -
620.omnetpp_s (unexplained diff vs previous) 64.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 1.580 -
621.wrf_s 120.000 -
621.wrf_s (avg) 120.000 -
621.wrf_s (avg) (percentage) 1.880 -
621.wrf_s (max) 62.000 -
621.wrf_s (max) (percentage) 0.970 -
623.xalancbmk_s 19.000 -
623.xalancbmk_s (avg) 19.000 -
623.xalancbmk_s (avg) (percentage) 0.570 -
623.xalancbmk_s (max) 15.000 -
623.xalancbmk_s (max) (percentage) 0.460 -
623.xalancbmk_s (unexplained diff vs previous) 10.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.300 -
625.x264_s 12.000 -
625.x264_s (avg) 12.000 -
625.x264_s (avg) (percentage) 0.830 -
625.x264_s (max) 12.000 -
625.x264_s (max) (percentage) 0.850 -
625.x264_s (unexplained diff vs previous) 9.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.600 -
627.cam4_s (avg) (percentage) 11.260 -
627.cam4_s (max) (percentage) 10.350 -
628.pop2_s 102.000 -
628.pop2_s (avg) 102.000 -
628.pop2_s (avg) (percentage) 1.030 -
628.pop2_s (max) 237.000 -
628.pop2_s (max) (percentage) 2.390 -
631.deepsjeng_s 16.000 -
631.deepsjeng_s (avg) 16.000 -
631.deepsjeng_s (avg) (percentage) 0.480 -
631.deepsjeng_s (max) 38.000 -
631.deepsjeng_s (max) (percentage) 1.140 -
631.deepsjeng_s (unexplained diff vs previous) 7.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.210 -
638.imagick_s 13.000 -
638.imagick_s (avg) 13.000 -
638.imagick_s (avg) (percentage) 0.410 -
638.imagick_s (max) 36.000 -
638.imagick_s (max) (percentage) 1.100 -
638.imagick_s (unexplained diff vs previous) 2.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.060 -
641.leela_s 15.000 -
641.leela_s (avg) 15.000 -
641.leela_s (avg) (percentage) 0.450 -
641.leela_s (max) 35.000 -
641.leela_s (max) (percentage) 1.000 -
641.leela_s (unexplained diff vs previous) 3.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.090 -
644.nab_s 62.000 -
644.nab_s (avg) 62.000 -
644.nab_s (avg) (percentage) 0.600 -
644.nab_s (max) 24.000 -
644.nab_s (max) (percentage) 0.230 -
644.nab_s (unexplained diff vs previous) 11.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.100 -
648.exchange2_s 12.000 -
648.exchange2_s (avg) 12.000 -
648.exchange2_s (avg) (percentage) 0.890 -
648.exchange2_s (max) 19.000 -
648.exchange2_s (max) (percentage) 1.470 -
648.exchange2_s (unexplained diff vs previous) 3.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.220 -
649.fotonik3d_s 99.000 -
649.fotonik3d_s (avg) 99.000 -
649.fotonik3d_s (avg) (percentage) 1.020 -
649.fotonik3d_s (max) 159.000 -
649.fotonik3d_s (max) (percentage) 1.630 -
649.fotonik3d_s (unexplained diff vs previous) 1.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.010 -
654.roms_s 439.000 -
654.roms_s (avg) 439.000 -
654.roms_s (avg) (percentage) 1.890 -
654.roms_s (max) 628.000 -
654.roms_s (max) (percentage) 2.700 -
654.roms_s (unexplained diff vs previous) 2.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.010 -
657.xz_s 19.000 -
657.xz_s (avg) 19.000 -
657.xz_s (avg) (percentage) 0.900 -
657.xz_s (max) 33.000 -
657.xz_s (max) (percentage) 1.500 -
657.xz_s (unexplained diff vs previous) 1.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.050 -
Geometric Mean 5.624 -13.57%