Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/aa7497a66c4272669fa63f7ec61a3f01aa9dabaf (+ 1 commits)
regression LLVM-1329
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--llvm-aarch64-master-O3_LTO-build/169/
Filter

llvm-aarch64-master-O3_LTO test results

Run Order Start Time Duration
Current 0169 (llvmorg-20-init-03910-gaa7497a66c42) 2024-08-28T19:52:12 0:00:00
Previous 0168 (llvmorg-20-init-03909-ge61d6066e267) 2024-08-28T19:50:44 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 5
Performance Improvements 6
Added Tests 93
Unchanged Tests 742
Total Tests 846

Performance Regressions - Execution Δ Previous Current σ
654.roms_s 9.40% 24983.000 27332.000 -
619.lbm_s 1.14% 31479.000 31839.000 -
638.imagick_s 1.01% 3155.000 3187.000 -

Performance Regressions - Score Δ Previous Current σ
nb_execution_successful -4.55% 44.000 42.000 -
nb_compile_successful -4.35% 46.000 44.000 -

Performance Improvements - Execution Δ Previous Current σ
607.cactuBSSN_s -4.02% 4499.000 4318.000 -
605.mcf_s -3.25% 6031.000 5835.000 -
511.povray_r -2.41% 415.000 405.000 -
603.bwaves_s -2.34% 9130.000 8916.000 -
602.gcc_s -1.12% 4034.000 3989.000 -

Performance Improvements - Score Δ Previous Current σ
nb_total_tests 4.35% 46.000 48.000 -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.25s
Name Current %
508.namd_r 2499.000 -
511.povray_r 405.000 -2.41%
526.blender_r 8422.000 -
600.perlbench_s 2254.000 -
602.gcc_s 3989.000 -1.12%
603.bwaves_s 8916.000 -2.34%
605.mcf_s 5835.000 -3.25%
607.cactuBSSN_s 4318.000 -4.02%
619.lbm_s 31839.000 1.14%
620.omnetpp_s 3645.000 -
623.xalancbmk_s 3206.000 -
625.x264_s 1360.000 -
627.cam4_s 190.000 -
628.pop2_s 12870.000 -
631.deepsjeng_s 3537.000 -
638.imagick_s 3187.000 1.01%
641.leela_s 3395.000 -
644.nab_s 11207.000 -
648.exchange2_s 1695.000 -
649.fotonik3d_s 9811.000 -
654.roms_s 27332.000 9.40%
657.xz_s 2112.000 -
Geometric Mean 3875.429 -
Name Current %
508.namd_r 483631.000 -
511.povray_r 1134131.000 -
526.blender_r 16322718.000 -
600.perlbench_s 2559255.000 -
602.gcc_s 11062009.000 -
603.bwaves_s 755218.000 -
605.mcf_s 22181.000 -
607.cactuBSSN_s 3571403.000 -
619.lbm_s 14027.000 -
620.omnetpp_s 2018426.000 -
623.xalancbmk_s 4098828.000 -
625.x264_s 598688.000 -
628.pop2_s 11653814.000 -
631.deepsjeng_s 87305.000 -
638.imagick_s 1442783.000 -
641.leela_s 91528.000 -
644.nab_s 97762.000 -
648.exchange2_s 2496019.000 -
649.fotonik3d_s 1107708.000 -
654.roms_s 2930795.000 -
657.xz_s 139599.000 -
Geometric Mean 820407.385 -
Name Current %
nb_compile_successful 44.000 -4.35%
nb_execution_successful 42.000 -4.55%
nb_total_tests 48.000 4.35%
Geometric Mean 44.598 -1.60%
Name Current %
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.640 -
508.namd_r (max) 15.000 -
508.namd_r (max) (percentage) 0.640 -
508.namd_r (unexplained diff vs previous) 16.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.640 -
510.parest_r (max) (percentage) 0.000 -
511.povray_r 9.000 -
511.povray_r (avg) 9.000 -
511.povray_r (avg) (percentage) 2.410 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.410 -
511.povray_r (unexplained diff vs previous) 10.000 -
511.povray_r (unexplained diff vs previous) (percentage) 2.470 -
526.blender_r 31.000 -
526.blender_r (avg) 31.000 -
526.blender_r (avg) (percentage) 0.370 -
526.blender_r (max) 31.000 -
526.blender_r (max) (percentage) 0.370 -
526.blender_r (unexplained diff vs previous) 31.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.370 -
600.perlbench_s 0.000 -
600.perlbench_s (avg) 0.000 -
600.perlbench_s (avg) (percentage) 0.040 -
600.perlbench_s (max) 0.000 -
600.perlbench_s (max) (percentage) 0.040 -
600.perlbench_s (unexplained diff vs previous) 1.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.040 -
603.bwaves_s 208.000 -
603.bwaves_s (avg) 208.000 -
603.bwaves_s (avg) (percentage) 2.340 -
603.bwaves_s (max) 208.000 -
603.bwaves_s (max) (percentage) 2.340 -
603.bwaves_s (unexplained diff vs previous) 214.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 2.400 -
605.mcf_s 189.000 -
605.mcf_s (avg) 189.000 -
605.mcf_s (avg) (percentage) 3.250 -
605.mcf_s (max) 189.000 -
605.mcf_s (max) (percentage) 3.250 -
605.mcf_s (unexplained diff vs previous) 196.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 3.360 -
607.cactuBSSN_s 173.000 -
607.cactuBSSN_s (avg) 173.000 -
607.cactuBSSN_s (avg) (percentage) 4.020 -
607.cactuBSSN_s (max) 173.000 -
607.cactuBSSN_s (max) (percentage) 4.020 -
607.cactuBSSN_s (unexplained diff vs previous) 181.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 4.190 -
619.lbm_s 362.000 -
619.lbm_s (avg) 362.000 -
619.lbm_s (avg) (percentage) 1.140 -
619.lbm_s (max) 362.000 -
619.lbm_s (max) (percentage) 1.140 -
619.lbm_s (unexplained diff vs previous) 360.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 1.130 -
620.omnetpp_s 16.000 -
620.omnetpp_s (avg) 16.000 -
620.omnetpp_s (avg) (percentage) 0.440 -
620.omnetpp_s (max) 16.000 -
620.omnetpp_s (max) (percentage) 0.440 -
620.omnetpp_s (unexplained diff vs previous) 16.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.440 -
623.xalancbmk_s 27.000 -
623.xalancbmk_s (avg) 27.000 -
623.xalancbmk_s (avg) (percentage) 0.870 -
623.xalancbmk_s (max) 27.000 -
623.xalancbmk_s (max) (percentage) 0.870 -
623.xalancbmk_s (unexplained diff vs previous) 28.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.870 -
625.x264_s 6.000 -
625.x264_s (avg) 6.000 -
625.x264_s (avg) (percentage) 0.510 -
625.x264_s (max) 6.000 -
625.x264_s (max) (percentage) 0.510 -
625.x264_s (unexplained diff vs previous) 7.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.510 -
631.deepsjeng_s 2.000 -
631.deepsjeng_s (avg) 2.000 -
631.deepsjeng_s (avg) (percentage) 0.060 -
631.deepsjeng_s (max) 2.000 -
631.deepsjeng_s (max) (percentage) 0.060 -
631.deepsjeng_s (unexplained diff vs previous) 2.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.060 -
638.imagick_s 32.000 -
638.imagick_s (avg) 32.000 -
638.imagick_s (avg) (percentage) 1.010 -
638.imagick_s (max) 32.000 -
638.imagick_s (max) (percentage) 1.010 -
638.imagick_s (unexplained diff vs previous) 32.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 1.000 -
641.leela_s 15.000 -
641.leela_s (avg) 15.000 -
641.leela_s (avg) (percentage) 0.470 -
641.leela_s (max) 15.000 -
641.leela_s (max) (percentage) 0.470 -
641.leela_s (unexplained diff vs previous) 16.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.470 -
644.nab_s 97.000 -
644.nab_s (avg) 97.000 -
644.nab_s (avg) (percentage) 0.870 -
644.nab_s (max) 97.000 -
644.nab_s (max) (percentage) 0.870 -
644.nab_s (unexplained diff vs previous) 98.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.870 -
648.exchange2_s 1.000 -
648.exchange2_s (avg) 1.000 -
648.exchange2_s (avg) (percentage) 0.060 -
648.exchange2_s (max) 1.000 -
648.exchange2_s (max) (percentage) 0.060 -
648.exchange2_s (unexplained diff vs previous) 1.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.060 -
649.fotonik3d_s 22.000 -
649.fotonik3d_s (avg) 22.000 -
649.fotonik3d_s (avg) (percentage) 0.230 -
649.fotonik3d_s (max) 22.000 -
649.fotonik3d_s (max) (percentage) 0.230 -
649.fotonik3d_s (unexplained diff vs previous) 23.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.230 -
654.roms_s (max) 0.000 -
654.roms_s (max) (percentage) 0.000 -
657.xz_s 1.000 -
657.xz_s (avg) 1.000 -
657.xz_s (avg) (percentage) 0.090 -
657.xz_s (max) 1.000 -
657.xz_s (max) (percentage) 0.090 -
657.xz_s (unexplained diff vs previous) 2.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 2.512 1684991212461326073856.00%