Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0523bf1eca4475edafc8aab830c2ce48b01900c3 (+ 838 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O2-build/257/
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0257 (llvmorg-18-init-14608-g0523bf1eca44) 2023-12-09T05:13:10 0:00:00
Previous 0256 (no-change) 2023-12-05T08:45:27 0:00:00
Baseline 0002 (llvmorg-17-init-03259-g0303eafcb346) 2023-02-26T22:18:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 6 5
Performance Improvements 32 10
Added Tests 0 79
Unchanged Tests 688 632
Total Tests 726

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
631.deepsjeng_s 1.34% 12714.000 12884.000 - -2.86% -
619.lbm_s 1.32% 39173.000 39689.000 - -4.51% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
619.lbm_s 1.65% 242.000 246.000 - 0.00% -
619.lbm_s (avg) 1.65% 242.000 246.000 - 0.00% -
631.deepsjeng_s 1.01% 99.000 100.000 - 0.00% -
631.deepsjeng_s (avg) 1.01% 99.000 100.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
600.perlbench_s -3.28% 19068.000 18442.000 - -7.62% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -72.20% 482.000 134.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -72.08% 2.830 0.790 - 0.00% -
620.omnetpp_s (max) -25.80% 469.000 348.000 - 0.00% -
620.omnetpp_s (max) (percentage) -25.09% 2.750 2.060 - 0.00% -
605.mcf_s (max) (percentage) -10.22% 1.860 1.670 - 0.00% -
605.mcf_s (max) -10.17% 541.000 486.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -9.73% 1.130 1.020 - 0.00% -
641.leela_s (max) (percentage) -9.38% 0.320 0.290 - 0.00% -
641.leela_s (max) -8.51% 47.000 43.000 - 0.00% -
631.deepsjeng_s (max) -8.39% 143.000 131.000 - 0.00% -
644.nab_s (max) -7.89% 190.000 175.000 - 0.00% -
623.xalancbmk_s (max) -7.62% 643.000 594.000 - 0.00% -
625.x264_s (max) -7.27% 55.000 51.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -7.27% 3.440 3.190 - 0.00% -
625.x264_s (max) (percentage) -6.45% 0.620 0.580 - 0.00% -
600.perlbench_s (max) -6.25% 80.000 75.000 - 0.00% -
619.lbm_s (max) (percentage) -3.69% 2.440 2.350 - 0.00% -
600.perlbench_s -3.51% 57.000 55.000 - 0.00% -
600.perlbench_s (avg) -3.51% 57.000 55.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.45% 2.900 2.800 - 0.00% -
602.gcc_s (max) -3.39% 442.000 427.000 - 0.00% -
657.xz_s (max) (percentage) -3.13% 6.080 5.890 - 0.00% -
602.gcc_s (max) (percentage) -2.81% 1.780 1.730 - 0.00% -
607.cactuBSSN_s (max) -2.56% 2583.000 2517.000 - 0.00% -
657.xz_s (max) -2.42% 8346.000 8144.000 - 0.00% -
619.lbm_s (max) -2.41% 955.000 932.000 - 0.00% -
600.perlbench_s (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
620.omnetpp_s -2.22% 361.000 353.000 - 0.00% -
620.omnetpp_s (avg) -2.22% 361.000 353.000 - 0.00% -
620.omnetpp_s (avg) (percentage) -1.42% 2.120 2.090 - 0.00% -
621.wrf_s (max) (percentage) -1.04% 0.960 0.950 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 12.96% 122401.000 138269.000 - 0.72% -
641.leela_s 1.58% 14724.000 14956.000 - 0.73% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -35.00% 20.000 13.000 - 0.00% -
nb_compile_successful -23.53% 17.000 13.000 - 0.00% -
nb_execution_successful -18.75% 16.000 13.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s -2.27% 3792061.000 3706082.000 - 0.06% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
602.gcc_s -9.61% 27313.000 24689.000 - -0.58% -
620.omnetpp_s -8.23% 18442.000 16925.000 - -0.79% -
600.perlbench_s -7.62% 19963.000 18442.000 - -3.28% -
619.lbm_s -4.51% 41563.000 39689.000 - 1.32% -
605.mcf_s -4.15% 30397.000 29136.000 - 0.11% -
631.deepsjeng_s -2.86% 13263.000 12884.000 - 1.34% -
638.imagick_s -1.96% 184180.000 180579.000 - 0.66% -
625.x264_s -1.16% 8983.000 8879.000 - -0.08% -
623.xalancbmk_s -1.07% 18831.000 18629.000 - -0.46% -

Added Tests - sample variability
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
602.gcc_s
602.gcc_s (avg)
602.gcc_s (avg) (percentage)
602.gcc_s (max)
602.gcc_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s (avg) (percentage)
627.cam4_s (max) (percentage)
628.pop2_s (avg) (percentage)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.23s
Name Current %
600.perlbench_s 18442.000 -3.28%
602.gcc_s 24689.000 -
605.mcf_s 29136.000 -
607.cactuBSSN_s 89921.000 -
619.lbm_s 39689.000 1.32%
620.omnetpp_s 16925.000 -
623.xalancbmk_s 18629.000 -
625.x264_s 8879.000 -
631.deepsjeng_s 12884.000 1.34%
638.imagick_s 180579.000 -
641.leela_s 14956.000 -
644.nab_s 159408.000 -
657.xz_s 138269.000 -
Geometric Mean 34594.694 -
Name Current %
600.perlbench_s 2144059.000 -
602.gcc_s 8923470.000 -
605.mcf_s 27161.000 -
607.cactuBSSN_s 3706082.000 -
619.lbm_s 17883.000 -
620.omnetpp_s 2151171.000 -
623.xalancbmk_s 4710831.000 -
625.x264_s 496952.000 -
631.deepsjeng_s 81376.000 -
638.imagick_s 1805499.000 -
641.leela_s 144609.000 -
644.nab_s 201838.000 -
657.xz_s 180071.000 -
Geometric Mean 503580.360 -
Name Current %
600.perlbench_s 55.000 -3.51%
600.perlbench_s (avg) 55.000 -3.51%
600.perlbench_s (avg) (percentage) 0.300 -
600.perlbench_s (max) 75.000 -6.25%
600.perlbench_s (max) (percentage) 0.410 -2.38%
602.gcc_s 162.000 -
602.gcc_s (avg) 162.000 -
602.gcc_s (avg) (percentage) 0.660 -
602.gcc_s (max) 427.000 -3.39%
602.gcc_s (max) (percentage) 1.730 -2.81%
603.bwaves_s (avg) (percentage) 0.740 -
603.bwaves_s (max) (percentage) 2.280 -
605.mcf_s 358.000 -
605.mcf_s (avg) 358.000 -
605.mcf_s (avg) (percentage) 1.230 -
605.mcf_s (max) 486.000 -10.17%
605.mcf_s (max) (percentage) 1.670 -10.22%
607.cactuBSSN_s 674.000 -
607.cactuBSSN_s (avg) 674.000 -
607.cactuBSSN_s (avg) (percentage) 0.750 -
607.cactuBSSN_s (max) 2517.000 -2.56%
607.cactuBSSN_s (max) (percentage) 2.800 -3.45%
619.lbm_s 246.000 1.65%
619.lbm_s (avg) 246.000 1.65%
619.lbm_s (avg) (percentage) 0.620 -
619.lbm_s (max) 932.000 -2.41%
619.lbm_s (max) (percentage) 2.350 -3.69%
620.omnetpp_s 353.000 -2.22%
620.omnetpp_s (avg) 353.000 -2.22%
620.omnetpp_s (avg) (percentage) 2.090 -1.42%
620.omnetpp_s (max) 348.000 -25.80%
620.omnetpp_s (max) (percentage) 2.060 -25.09%
620.omnetpp_s (unexplained diff vs previous) 134.000 -72.20%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.790 -72.08%
621.wrf_s (avg) (percentage) 0.700 -
621.wrf_s (max) (percentage) 0.950 -1.04%
623.xalancbmk_s 393.000 -
623.xalancbmk_s (avg) 393.000 -
623.xalancbmk_s (avg) (percentage) 2.110 -
623.xalancbmk_s (max) 594.000 -7.62%
623.xalancbmk_s (max) (percentage) 3.190 -7.27%
625.x264_s 30.000 -
625.x264_s (avg) 30.000 -
625.x264_s (avg) (percentage) 0.340 -
625.x264_s (max) 51.000 -7.27%
625.x264_s (max) (percentage) 0.580 -6.45%
627.cam4_s (avg) (percentage) 0.110 -
627.cam4_s (max) (percentage) 0.110 -
628.pop2_s (avg) (percentage) 0.160 -
628.pop2_s (max) (percentage) 0.160 -
631.deepsjeng_s 100.000 1.01%
631.deepsjeng_s (avg) 100.000 1.01%
631.deepsjeng_s (avg) (percentage) 0.780 -
631.deepsjeng_s (max) 131.000 -8.39%
631.deepsjeng_s (max) (percentage) 1.020 -9.73%
638.imagick_s 108.000 -
638.imagick_s (avg) 108.000 -
638.imagick_s (avg) (percentage) 0.060 -
638.imagick_s (max) 252.000 -
638.imagick_s (max) (percentage) 0.140 -
641.leela_s 26.000 -
641.leela_s (avg) 26.000 -
641.leela_s (avg) (percentage) 0.180 -
641.leela_s (max) 43.000 -8.51%
641.leela_s (max) (percentage) 0.290 -9.38%
644.nab_s 143.000 -
644.nab_s (avg) 143.000 -
644.nab_s (avg) (percentage) 0.090 -
644.nab_s (max) 175.000 -7.89%
644.nab_s (max) (percentage) 0.110 -
648.exchange2_s (avg) (percentage) 0.190 -
648.exchange2_s (max) (percentage) 0.080 -
649.fotonik3d_s (avg) (percentage) 5.950 -
649.fotonik3d_s (max) (percentage) 5.780 -
654.roms_s (avg) (percentage) 2.210 -
654.roms_s (max) (percentage) 4.220 -
657.xz_s 3968.000 -
657.xz_s (avg) 3968.000 -
657.xz_s (avg) (percentage) 2.870 -
657.xz_s (max) 8144.000 -2.42%
657.xz_s (max) (percentage) 5.890 -3.13%
Geometric Mean 12.101 -5.50%