Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/d333c0e062e76df466cd06b1b04d52749acd944d (+ 85 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O3-build/222/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0222 (llvmorg-18-init-12566-gd333c0e062e7) 2023-11-20T14:38:40 0:00:00
Previous 0221 (llvmorg-18-init-12481-g48f5855e4c48) 2023-11-17T08:48:50 0:00:00
Baseline 0001 (llvmorg-17-init-03218-g58de24ebbb35) 2023-02-25T18:39:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 7 3
Performance Improvements 9 9
Added Tests 2 75
Unchanged Tests 672 603
Total Tests 690

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s 11.11% 16331.000 18146.000 - 3.45% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (max) 11.21% 437.000 486.000 - 0.00% -
620.omnetpp_s 11.14% 359.000 399.000 - 0.00% -
620.omnetpp_s (avg) 11.14% 359.000 399.000 - 0.00% -
625.x264_s 3.70% 27.000 28.000 - 0.00% -
625.x264_s (avg) 3.70% 27.000 28.000 - 0.00% -
625.x264_s (max) 1.61% 62.000 63.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
641.leela_s -1.74% 14159.000 13912.000 - -1.54% -
605.mcf_s -1.50% 29406.000 28966.000 - -2.99% -
623.xalancbmk_s -1.38% 19044.000 18781.000 - -2.87% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
623.xalancbmk_s -1.40% 358.000 353.000 - 0.00% -
623.xalancbmk_s (avg) -1.40% 358.000 353.000 - 0.00% -
605.mcf_s (max) -1.39% 502.000 495.000 - 0.00% -
605.mcf_s -1.37% 364.000 359.000 - 0.00% -
605.mcf_s (avg) -1.37% 364.000 359.000 - 0.00% -
623.xalancbmk_s (max) -1.33% 525.000 518.000 - 0.00% -

Added Tests - Score
nb_compile_successful
nb_execution_successful

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 8.61% 126911.000 137834.000 - 0.06% -
620.omnetpp_s 3.45% 17541.000 18146.000 - 11.11% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -65.00% 20.000 7.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
625.x264_s -6.73% 8350.000 7788.000 - 0.23% -
619.lbm_s -5.62% 42215.000 39841.000 - -0.47% -
602.gcc_s -4.93% 22619.000 21505.000 - -0.27% -
631.deepsjeng_s -3.21% 13255.000 12830.000 - 0.53% -
605.mcf_s -2.99% 29858.000 28966.000 - -1.50% -
623.xalancbmk_s -2.87% 19336.000 18781.000 - -1.38% -
600.perlbench_s -2.54% 20326.000 19810.000 - 0.12% -
641.leela_s -1.54% 14129.000 13912.000 - -1.74% -
638.imagick_s -1.07% 168091.000 166293.000 - 0.01% -

Added Tests - sample variability
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
602.gcc_s
602.gcc_s (avg)
602.gcc_s (avg) (percentage)
602.gcc_s (max)
602.gcc_s (max) (percentage)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max) (percentage)
654.roms_s (avg) (percentage)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)

Added Tests - Score
nb_compile_successful
nb_execution_successful


Report Time: 0.22s
Name Current %
600.perlbench_s 19810.000 -
602.gcc_s 21505.000 -
605.mcf_s 28966.000 -1.50%
607.cactuBSSN_s 89504.000 -
619.lbm_s 39841.000 -
620.omnetpp_s 18146.000 11.11%
623.xalancbmk_s 18781.000 -1.38%
625.x264_s 7788.000 -
631.deepsjeng_s 12830.000 -
638.imagick_s 166293.000 -
641.leela_s 13912.000 -1.74%
644.nab_s 160217.000 -
657.xz_s 137834.000 -
Geometric Mean 33848.220 -
Name Current %
600.perlbench_s 43.000 -
600.perlbench_s (avg) 43.000 -
600.perlbench_s (avg) (percentage) 0.220 -
600.perlbench_s (max) 75.000 -
600.perlbench_s (max) (percentage) 0.380 -
602.gcc_s 320.000 -
602.gcc_s (avg) 320.000 -
602.gcc_s (avg) (percentage) 1.490 -
602.gcc_s (max) 131.000 -
602.gcc_s (max) (percentage) 0.610 -
603.bwaves_s (avg) (percentage) 0.970 -
603.bwaves_s (max) (percentage) 1.070 -
605.mcf_s 359.000 -1.37%
605.mcf_s (avg) 359.000 -1.37%
605.mcf_s (avg) (percentage) 1.240 -
605.mcf_s (max) 495.000 -1.39%
605.mcf_s (max) (percentage) 1.710 -
607.cactuBSSN_s 895.000 -
607.cactuBSSN_s (avg) 895.000 -
607.cactuBSSN_s (avg) (percentage) 1.000 -
607.cactuBSSN_s (max) 1163.000 -
607.cactuBSSN_s (max) (percentage) 1.300 -
619.lbm_s 207.000 -
619.lbm_s (avg) 207.000 -
619.lbm_s (avg) (percentage) 0.520 -
619.lbm_s (max) 657.000 -
619.lbm_s (max) (percentage) 1.650 -
620.omnetpp_s 399.000 11.14%
620.omnetpp_s (avg) 399.000 11.14%
620.omnetpp_s (avg) (percentage) 2.200 -
620.omnetpp_s (max) 486.000 11.21%
620.omnetpp_s (max) (percentage) 2.680 -
621.wrf_s (avg) (percentage) 0.750 -
621.wrf_s (max) (percentage) 1.140 -
623.xalancbmk_s 353.000 -1.40%
623.xalancbmk_s (avg) 353.000 -1.40%
623.xalancbmk_s (avg) (percentage) 1.880 -
623.xalancbmk_s (max) 518.000 -1.33%
623.xalancbmk_s (max) (percentage) 2.760 -
625.x264_s 28.000 3.70%
625.x264_s (avg) 28.000 3.70%
625.x264_s (avg) (percentage) 0.360 -
625.x264_s (max) 63.000 1.61%
625.x264_s (max) (percentage) 0.810 -
631.deepsjeng_s 129.000 -
631.deepsjeng_s (avg) 129.000 -
631.deepsjeng_s (avg) (percentage) 1.010 -
631.deepsjeng_s (max) 182.000 -
631.deepsjeng_s (max) (percentage) 1.420 -
638.imagick_s 116.000 -
638.imagick_s (avg) 116.000 -
638.imagick_s (avg) (percentage) 0.070 -
638.imagick_s (max) 182.000 -
638.imagick_s (max) (percentage) 0.110 -
641.leela_s 22.000 -
641.leela_s (avg) 22.000 -
641.leela_s (avg) (percentage) 0.160 -
641.leela_s (max) 19.000 -
641.leela_s (max) (percentage) 0.140 -
644.nab_s 160.000 -
644.nab_s (avg) 160.000 -
644.nab_s (avg) (percentage) 0.100 -
644.nab_s (max) 160.000 -
644.nab_s (max) (percentage) 0.100 -
648.exchange2_s (avg) (percentage) 0.330 -
648.exchange2_s (max) (percentage) 0.260 -
654.roms_s (avg) (percentage) 1.750 -
654.roms_s (max) (percentage) 1.400 -
657.xz_s 5347.000 -
657.xz_s (avg) 5347.000 -
657.xz_s (avg) (percentage) 3.880 -
657.xz_s (max) 8545.000 -
657.xz_s (max) (percentage) 6.200 -
Geometric Mean 15.539 -