Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/56379b29042db9dfc63e74f065cc50b7fb01eddf (+ 371 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O2-build/645/
Filter

llvm-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0645 (llvmorg-21-init-03092-g56379b29042d) 2025-02-24T19:41:18 0:00:00
Previous 0644 (llvmorg-21-init-02721-g2071ea24a27c) 2025-02-23T00:48:39 0:00:00
Baseline 0002 (llvmorg-17-init-03259-g0303eafcb346) 2023-02-26T22:18:13 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 22
Performance Improvements 42 10
Added Tests 2 108
Unchanged Tests 766 670
Total Tests 810

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
620.omnetpp_s (unexplained diff vs previous) -51.47% 272.000 132.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) -51.27% 1.580 0.770 - 0.00% -
619.lbm_s (unexplained diff vs previous) -13.45% 119.000 103.000 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) -13.33% 0.300 0.260 - 0.00% -
620.omnetpp_s (max) -13.09% 275.000 239.000 - 0.00% -
620.omnetpp_s (max) (percentage) -12.50% 1.600 1.400 - 0.00% -
644.nab_s (max) -11.23% 374.000 332.000 - 0.00% -
644.nab_s (max) (percentage) -11.11% 0.180 0.160 - 0.00% -
625.x264_s (max) -7.14% 42.000 39.000 - 0.00% -
625.x264_s (max) (percentage) -6.52% 0.460 0.430 - 0.00% -
605.mcf_s (max) -6.48% 324.000 303.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -6.25% 1.600 1.500 - 0.00% -
619.lbm_s (max) (percentage) -6.25% 0.960 0.900 - 0.00% -
619.lbm_s (max) -6.02% 382.000 359.000 - 0.00% -
631.deepsjeng_s (max) -5.97% 201.000 189.000 - 0.00% -
641.leela_s (max) -5.88% 51.000 48.000 - 0.00% -
605.mcf_s (max) (percentage) -5.61% 1.070 1.010 - 0.00% -
641.leela_s (max) (percentage) -5.56% 0.360 0.340 - 0.00% -
654.roms_s (max) -5.38% 5615.000 5313.000 - 0.00% -
654.roms_s (max) (percentage) -5.14% 3.500 3.320 - 0.00% -
600.perlbench_s (max) -5.13% 39.000 37.000 - 0.00% -
600.perlbench_s (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
603.bwaves_s (max) -4.96% 3530.000 3355.000 - 0.00% -
649.fotonik3d_s (max) -4.70% 2492.000 2375.000 - 0.00% -
607.cactuBSSN_s (max) -4.49% 1782.000 1702.000 - 0.00% -
628.pop2_s (max) -4.38% 297.000 284.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -4.36% 5.510 5.270 - 0.00% -
603.bwaves_s (max) (percentage) -4.32% 1.390 1.330 - 0.00% -
607.cactuBSSN_s (max) (percentage) -4.30% 1.860 1.780 - 0.00% -
657.xz_s (max) -4.16% 16484.000 15799.000 - 0.00% -
621.wrf_s (max) -4.02% 373.000 358.000 - 0.00% -
621.wrf_s (max) (percentage) -4.00% 0.500 0.480 - 0.00% -
628.pop2_s (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
657.xz_s (max) (percentage) -3.97% 12.600 12.100 - 0.00% -
627.cam4_s (max) -3.53% 368.000 355.000 - 0.00% -
627.cam4_s (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
623.xalancbmk_s (max) -2.29% 481.000 470.000 - 0.00% -
623.xalancbmk_s (max) (percentage) -2.01% 2.490 2.440 - 0.00% -
620.omnetpp_s -1.49% 269.000 265.000 - 0.00% -
620.omnetpp_s (avg) -1.49% 269.000 265.000 - 0.00% -
605.mcf_s -1.09% 276.000 273.000 - 0.00% -
605.mcf_s (avg) -1.09% 276.000 273.000 - 0.00% -

Added Tests - sample variability
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 70.82% 3792061.000 6477684.000 - -0.00% -
654.roms_s 23.22% 3081820.000 3797391.000 - -0.02% -
648.exchange2_s 21.81% 2555609.000 3112911.000 - 0.00% -
631.deepsjeng_s 20.66% 81284.000 98076.000 - -0.01% -
605.mcf_s 19.38% 27321.000 32615.000 - -0.10% -
621.wrf_s 13.74% 24218766.000 27546972.000 - 0.01% -
625.x264_s 11.01% 501020.000 556204.000 - 0.02% -
638.imagick_s 10.27% 1820691.000 2007731.000 - -0.15% -
619.lbm_s 7.45% 17979.000 19319.000 - 0.00% -
644.nab_s 6.67% 202862.000 216397.000 - -0.01% -
641.leela_s 5.42% 144877.000 152731.000 - 0.01% -
657.xz_s 4.56% 181307.000 189571.000 - -0.03% -
623.xalancbmk_s 3.44% 4726781.000 4889174.000 - -0.03% -
602.gcc_s 2.87% 8922066.000 9178114.000 - 0.00% -
600.perlbench_s 2.80% 2155453.000 2215871.000 - 0.01% -
620.omnetpp_s 2.57% 2149689.000 2204915.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 63.67% 21783.000 35653.000 - -0.01% -
644.nab_s 29.42% 160468.000 207679.000 - -0.15% -
607.cactuBSSN_s 6.77% 89584.000 95648.000 - -0.21% -
657.xz_s 6.67% 122401.000 130571.000 - -0.19% -
625.x264_s 3.54% 8983.000 9301.000 - -0.19% -
623.xalancbmk_s 2.36% 18831.000 19275.000 - -0.31% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -47.50% 142382.000 74756.000 - 0.18% -
654.roms_s -46.88% 301295.000 160039.000 - -0.25% -
602.gcc_s -7.65% 27313.000 25223.000 - 0.24% -
620.omnetpp_s -7.19% 18442.000 17116.000 - -0.77% -
631.deepsjeng_s -4.61% 13263.000 12651.000 - 0.34% -
619.lbm_s -3.93% 41563.000 39931.000 - 0.26% -
641.leela_s -2.55% 14724.000 14348.000 - -0.49% -
638.imagick_s -2.18% 184180.000 180167.000 - -0.17% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 25.00% 16.000 20.000 - 0.00% -
nb_compile_successful 17.65% 17.000 20.000 - 0.00% -

Added Tests - Code Size
603.bwaves_s
627.cam4_s
628.pop2_s
649.fotonik3d_s

Added Tests - Execution
603.bwaves_s
627.cam4_s
628.pop2_s
649.fotonik3d_s

Added Tests - sample variability
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
602.gcc_s
602.gcc_s (avg)
602.gcc_s (avg) (percentage)
602.gcc_s (max)
602.gcc_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
600.perlbench_s 19957.000 -
602.gcc_s 25223.000 -
603.bwaves_s 252326.000 -
605.mcf_s 30096.000 -
607.cactuBSSN_s 95648.000 -
619.lbm_s 39931.000 -
620.omnetpp_s 17116.000 -
621.wrf_s 74756.000 -
623.xalancbmk_s 19275.000 -
625.x264_s 9301.000 -
627.cam4_s 114715.000 -
628.pop2_s 118595.000 -
631.deepsjeng_s 12651.000 -
638.imagick_s 180167.000 -
641.leela_s 14348.000 -
644.nab_s 207679.000 -
648.exchange2_s 35653.000 -
649.fotonik3d_s 45079.000 -
654.roms_s 160039.000 -
657.xz_s 130571.000 -
Geometric Mean 50215.378 -
Name Current %
600.perlbench_s 2215871.000 -
602.gcc_s 9178114.000 -
603.bwaves_s 767482.000 -
605.mcf_s 32615.000 -
607.cactuBSSN_s 6477684.000 -
619.lbm_s 19319.000 -
620.omnetpp_s 2204915.000 -
621.wrf_s 27546972.000 -
623.xalancbmk_s 4889174.000 -
625.x264_s 556204.000 -
627.cam4_s 11802331.000 -
628.pop2_s 13274137.000 -
631.deepsjeng_s 98076.000 -
638.imagick_s 2007731.000 -
641.leela_s 152731.000 -
644.nab_s 216397.000 -
648.exchange2_s 3112911.000 -
649.fotonik3d_s 1331177.000 -
654.roms_s 3797391.000 -
657.xz_s 189571.000 -
Geometric Mean 1189214.476 -
Name Current %
600.perlbench_s 47.000 -
600.perlbench_s (avg) 47.000 -
600.perlbench_s (avg) (percentage) 0.240 -
600.perlbench_s (max) 37.000 -5.13%
600.perlbench_s (max) (percentage) 0.190 -5.00%
602.gcc_s 156.000 -
602.gcc_s (avg) 156.000 -
602.gcc_s (avg) (percentage) 0.620 -
602.gcc_s (max) 348.000 -
602.gcc_s (max) (percentage) 1.380 -
603.bwaves_s 1665.000 -
603.bwaves_s (avg) 1665.000 -
603.bwaves_s (avg) (percentage) 0.660 -
603.bwaves_s (max) 3355.000 -4.96%
603.bwaves_s (max) (percentage) 1.330 -4.32%
605.mcf_s 273.000 -1.09%
605.mcf_s (avg) 273.000 -1.09%
605.mcf_s (avg) (percentage) 0.910 -
605.mcf_s (max) 303.000 -6.48%
605.mcf_s (max) (percentage) 1.010 -5.61%
607.cactuBSSN_s 975.000 -
607.cactuBSSN_s (avg) 975.000 -
607.cactuBSSN_s (avg) (percentage) 1.020 -
607.cactuBSSN_s (max) 1702.000 -4.49%
607.cactuBSSN_s (max) (percentage) 1.780 -4.30%
619.lbm_s 243.000 -
619.lbm_s (avg) 243.000 -
619.lbm_s (avg) (percentage) 0.610 -
619.lbm_s (max) 359.000 -6.02%
619.lbm_s (max) (percentage) 0.900 -6.25%
619.lbm_s (unexplained diff vs previous) 103.000 -13.45%
619.lbm_s (unexplained diff vs previous) (percentage) 0.260 -13.33%
620.omnetpp_s 265.000 -1.49%
620.omnetpp_s (avg) 265.000 -1.49%
620.omnetpp_s (avg) (percentage) 1.550 -
620.omnetpp_s (max) 239.000 -13.09%
620.omnetpp_s (max) (percentage) 1.400 -12.50%
620.omnetpp_s (unexplained diff vs previous) 132.000 -51.47%
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.770 -51.27%
621.wrf_s 194.000 -
621.wrf_s (avg) 194.000 -
621.wrf_s (avg) (percentage) 0.260 -
621.wrf_s (max) 358.000 -4.02%
621.wrf_s (max) (percentage) 0.480 -4.00%
623.xalancbmk_s 329.000 -
623.xalancbmk_s (avg) 329.000 -
623.xalancbmk_s (avg) (percentage) 1.710 -
623.xalancbmk_s (max) 470.000 -2.29%
623.xalancbmk_s (max) (percentage) 2.440 -2.01%
625.x264_s 27.000 -
625.x264_s (avg) 27.000 -
625.x264_s (avg) (percentage) 0.300 -
625.x264_s (max) 39.000 -7.14%
625.x264_s (max) (percentage) 0.430 -6.52%
625.x264_s (unexplained diff vs previous) 18.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.190 -
627.cam4_s 160.000 -
627.cam4_s (avg) 160.000 -
627.cam4_s (avg) (percentage) 0.140 -
627.cam4_s (max) 355.000 -3.53%
627.cam4_s (max) (percentage) 0.310 -3.13%
628.pop2_s 142.000 -
628.pop2_s (avg) 142.000 -
628.pop2_s (avg) (percentage) 0.120 -
628.pop2_s (max) 284.000 -4.38%
628.pop2_s (max) (percentage) 0.240 -4.00%
631.deepsjeng_s 115.000 -
631.deepsjeng_s (avg) 115.000 -
631.deepsjeng_s (avg) (percentage) 0.910 -
631.deepsjeng_s (max) 189.000 -5.97%
631.deepsjeng_s (max) (percentage) 1.500 -6.25%
638.imagick_s 108.000 -
638.imagick_s (avg) 108.000 -
638.imagick_s (avg) (percentage) 0.060 -
638.imagick_s (max) 162.000 -
638.imagick_s (max) (percentage) 0.090 -
641.leela_s 27.000 -
641.leela_s (avg) 27.000 -
641.leela_s (avg) (percentage) 0.190 -
641.leela_s (max) 48.000 -5.88%
641.leela_s (max) (percentage) 0.340 -5.56%
644.nab_s 809.000 -
644.nab_s (avg) 809.000 -
644.nab_s (avg) (percentage) 0.390 -
644.nab_s (max) 332.000 -11.23%
644.nab_s (max) (percentage) 0.160 -11.11%
648.exchange2_s 21.000 -
648.exchange2_s (avg) 21.000 -
648.exchange2_s (avg) (percentage) 0.060 -
648.exchange2_s (max) 10.000 -
648.exchange2_s (max) (percentage) 0.030 -
648.exchange2_s (unexplained diff vs previous) 3.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.010 -
649.fotonik3d_s 1248.000 -
649.fotonik3d_s (avg) 1248.000 -
649.fotonik3d_s (avg) (percentage) 2.770 -
649.fotonik3d_s (max) 2375.000 -4.70%
649.fotonik3d_s (max) (percentage) 5.270 -4.36%
654.roms_s 2576.000 -
654.roms_s (avg) 2576.000 -
654.roms_s (avg) (percentage) 1.610 -
654.roms_s (max) 5313.000 -5.38%
654.roms_s (max) (percentage) 3.320 -5.14%
657.xz_s 6032.000 -
657.xz_s (avg) 6032.000 -
657.xz_s (avg) (percentage) 4.620 -
657.xz_s (max) 15799.000 -4.16%
657.xz_s (max) (percentage) 12.100 -3.97%
Geometric Mean 20.032 -11.81%