Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/87d7aebdd43102160d93d8e5859228d860ea072d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--llvm-aarch64-master-O3-build/258/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0258 (no-change) 2025-01-10T22:03:27 0:00:00
Previous 0258 (no-change) 2025-01-10T22:03:27 0:00:00
Baseline 0001 (llvmorg-17-init-03866-g7abf6c2524d0) 2023-03-05T03:58:54 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 12
Performance Improvements 0 19
Added Tests 5 116
Unchanged Tests 901 759
Total Tests 906

Added Tests - sample variability
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
654.roms_s 25.08% 3088820.000 3863531.000 - 0.00% -
648.exchange2_s 19.31% 2570753.000 3067087.000 - 0.00% -
508.namd_r 4.41% 607655.000 634469.000 - 0.00% -
602.gcc_s 2.81% 9686862.000 9959126.000 - 0.00% -
510.parest_r 1.81% 9174001.000 9340045.000 - 0.00% -
641.leela_s 1.78% 153985.000 156731.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
648.exchange2_s 27.82% 3515.000 4493.000 - 0.00% -
526.blender_r 4.52% 8183.000 8553.000 - 0.00% -
607.cactuBSSN_s 3.52% 4173.000 4320.000 - 0.00% -
605.mcf_s 2.62% 6223.000 6386.000 - 0.00% -
508.namd_r 2.28% 2460.000 2516.000 - 0.00% -
510.parest_r 1.10% 5288.000 5346.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
621.wrf_s -7.57% 24612422.000 22748080.000 - 0.00% -
619.lbm_s -2.06% 18491.000 18111.000 - 0.00% -
607.cactuBSSN_s -1.94% 3910049.000 3834348.000 - 0.00% -
605.mcf_s -1.68% 28401.000 27925.000 - 0.00% -
625.x264_s -1.40% 561864.000 553976.000 - 0.00% -
657.xz_s -1.13% 195599.000 193379.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
654.roms_s -29.07% 31849.000 22591.000 - 0.00% -
621.wrf_s -15.31% 7419.000 6283.000 - 0.00% -
511.povray_r -7.58% 462.000 427.000 - 0.00% -
625.x264_s -6.15% 1463.000 1373.000 - 0.00% -
657.xz_s -4.49% 2247.000 2146.000 - 0.00% -
619.lbm_s -4.46% 30384.000 29030.000 - 0.00% -
638.imagick_s -3.33% 3240.000 3132.000 - 0.00% -
600.perlbench_s -2.29% 2576.000 2517.000 - 0.00% -
631.deepsjeng_s -1.83% 4033.000 3959.000 - 0.00% -
641.leela_s -1.48% 4115.000 4054.000 - 0.00% -
602.gcc_s -1.26% 4215.000 4162.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 15.00% 20.000 23.000 - 0.00% -
nb_compile_successful 14.29% 21.000 24.000 - 0.00% -

Added Tests - Code Size
603.bwaves_s
628.pop2_s
649.fotonik3d_s

Added Tests - Execution
603.bwaves_s
627.cam4_s
628.pop2_s
649.fotonik3d_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.32s
Name Current %
508.namd_r 2516.000 -
510.parest_r 5346.000 -
511.povray_r 427.000 -
526.blender_r 8553.000 -
600.perlbench_s 2517.000 -
602.gcc_s 4162.000 -
603.bwaves_s 8583.000 -
605.mcf_s 6386.000 -
607.cactuBSSN_s 4320.000 -
619.lbm_s 29030.000 -
620.omnetpp_s 3820.000 -
621.wrf_s 6283.000 -
623.xalancbmk_s 4015.000 -
625.x264_s 1373.000 -
627.cam4_s 205.000 -
628.pop2_s 12795.000 -
631.deepsjeng_s 3959.000 -
638.imagick_s 3132.000 -
641.leela_s 4054.000 -
644.nab_s 11689.000 -
648.exchange2_s 4493.000 -
649.fotonik3d_s 8765.000 -
654.roms_s 22591.000 -
657.xz_s 2146.000 -
Geometric Mean 4273.567 -
Name Current %
508.namd_r 634469.000 -
510.parest_r 9340045.000 -
511.povray_r 973641.000 -
526.blender_r 14384961.000 -
600.perlbench_s 2252719.000 -
602.gcc_s 9959126.000 -
603.bwaves_s 752606.000 -
605.mcf_s 27925.000 -
607.cactuBSSN_s 3834348.000 -
619.lbm_s 18111.000 -
620.omnetpp_s 2242352.000 -
621.wrf_s 22748080.000 -
623.xalancbmk_s 4893342.000 -
625.x264_s 553976.000 -
628.pop2_s 14529213.000 -
631.deepsjeng_s 90584.000 -
638.imagick_s 1905707.000 -
641.leela_s 156731.000 -
644.nab_s 210527.000 -
648.exchange2_s 3067087.000 -
649.fotonik3d_s 1166629.000 -
654.roms_s 3863531.000 -
657.xz_s 193379.000 -
Geometric Mean 1211907.761 -
Name Current %
508.namd_r 21.000 -
508.namd_r (avg) 21.000 -
508.namd_r (avg) (percentage) 0.840 -
508.namd_r (max) 28.000 -
508.namd_r (max) (percentage) 1.120 -
508.namd_r (unexplained diff vs previous) 2.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.080 -
510.parest_r 55.000 -
510.parest_r (avg) 55.000 -
510.parest_r (avg) (percentage) 1.040 -
510.parest_r (max) 144.000 -
510.parest_r (max) (percentage) 2.700 -
510.parest_r (unexplained diff vs previous) 39.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.730 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.230 -
511.povray_r (max) 8.000 -
511.povray_r (max) (percentage) 1.940 -
511.povray_r (unexplained diff vs previous) 7.000 -
511.povray_r (unexplained diff vs previous) (percentage) 1.640 -
526.blender_r 61.000 -
526.blender_r (avg) 61.000 -
526.blender_r (avg) (percentage) 0.720 -
526.blender_r (max) 65.000 -
526.blender_r (max) (percentage) 0.770 -
526.blender_r (unexplained diff vs previous) 41.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.480 -
600.perlbench_s 35.000 -
600.perlbench_s (avg) 35.000 -
600.perlbench_s (avg) (percentage) 1.420 -
600.perlbench_s (max) 23.000 -
600.perlbench_s (max) (percentage) 0.940 -
600.perlbench_s (unexplained diff vs previous) 24.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 0.950 -
603.bwaves_s 172.000 -
603.bwaves_s (avg) 172.000 -
603.bwaves_s (avg) (percentage) 2.010 -
603.bwaves_s (max) 292.000 -
603.bwaves_s (max) (percentage) 3.410 -
603.bwaves_s (unexplained diff vs previous) 40.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 0.470 -
605.mcf_s 107.000 -
605.mcf_s (avg) 107.000 -
605.mcf_s (avg) (percentage) 1.690 -
605.mcf_s (max) 338.000 -
605.mcf_s (max) (percentage) 5.300 -
605.mcf_s (unexplained diff vs previous) 63.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.990 -
607.cactuBSSN_s 81.000 -
607.cactuBSSN_s (avg) 81.000 -
607.cactuBSSN_s (avg) (percentage) 1.890 -
607.cactuBSSN_s (max) 77.000 -
607.cactuBSSN_s (max) (percentage) 1.800 -
607.cactuBSSN_s (unexplained diff vs previous) 79.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 1.830 -
619.lbm_s 1936.000 -
619.lbm_s (avg) 1936.000 -
619.lbm_s (avg) (percentage) 6.670 -
619.lbm_s (max) 2827.000 -
619.lbm_s (max) (percentage) 9.740 -
619.lbm_s (unexplained diff vs previous) 3132.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 10.790 -
620.omnetpp_s 60.000 -
620.omnetpp_s (avg) 60.000 -
620.omnetpp_s (avg) (percentage) 1.580 -
620.omnetpp_s (max) 32.000 -
620.omnetpp_s (max) (percentage) 0.850 -
620.omnetpp_s (unexplained diff vs previous) 8.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.210 -
621.wrf_s 0.000 -
621.wrf_s (avg) 0.000 -
621.wrf_s (avg) (percentage) 0.000 -
621.wrf_s (max) 0.000 -
621.wrf_s (max) (percentage) 0.000 -
623.xalancbmk_s 28.000 -
623.xalancbmk_s (avg) 28.000 -
623.xalancbmk_s (avg) (percentage) 0.700 -
623.xalancbmk_s (max) 19.000 -
623.xalancbmk_s (max) (percentage) 0.480 -
623.xalancbmk_s (unexplained diff vs previous) 15.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 0.370 -
625.x264_s 11.000 -
625.x264_s (avg) 11.000 -
625.x264_s (avg) (percentage) 0.870 -
625.x264_s (max) 4.000 -
625.x264_s (max) (percentage) 0.350 -
625.x264_s (unexplained diff vs previous) 1.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.070 -
631.deepsjeng_s 21.000 -
631.deepsjeng_s (avg) 21.000 -
631.deepsjeng_s (avg) (percentage) 0.540 -
631.deepsjeng_s (max) 19.000 -
631.deepsjeng_s (max) (percentage) 0.500 -
631.deepsjeng_s (unexplained diff vs previous) 12.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.300 -
638.imagick_s 44.000 -
638.imagick_s (avg) 44.000 -
638.imagick_s (avg) (percentage) 1.420 -
638.imagick_s (max) 32.000 -
638.imagick_s (max) (percentage) 1.040 -
638.imagick_s (unexplained diff vs previous) 33.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 1.050 -
641.leela_s 20.000 -
641.leela_s (avg) 20.000 -
641.leela_s (avg) (percentage) 0.500 -
641.leela_s (max) 19.000 -
641.leela_s (max) (percentage) 0.480 -
641.leela_s (unexplained diff vs previous) 9.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.220 -
644.nab_s 82.000 -
644.nab_s (avg) 82.000 -
644.nab_s (avg) (percentage) 0.710 -
644.nab_s (max) 37.000 -
644.nab_s (max) (percentage) 0.320 -
644.nab_s (unexplained diff vs previous) 8.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.070 -
648.exchange2_s 13.000 -
648.exchange2_s (avg) 13.000 -
648.exchange2_s (avg) (percentage) 0.300 -
648.exchange2_s (max) 8.000 -
648.exchange2_s (max) (percentage) 0.200 -
648.exchange2_s (unexplained diff vs previous) 9.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.200 -
649.fotonik3d_s 76.000 -
649.fotonik3d_s (avg) 76.000 -
649.fotonik3d_s (avg) (percentage) 0.870 -
649.fotonik3d_s (max) 165.000 -
649.fotonik3d_s (max) (percentage) 1.890 -
649.fotonik3d_s (unexplained diff vs previous) 169.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 1.930 -
654.roms_s 142.000 -
654.roms_s (avg) 142.000 -
654.roms_s (avg) (percentage) 0.630 -
654.roms_s (max) 135.000 -
654.roms_s (max) (percentage) 0.600 -
657.xz_s 47.000 -
657.xz_s (avg) 47.000 -
657.xz_s (avg) (percentage) 2.230 -
657.xz_s (max) 45.000 -
657.xz_s (max) (percentage) 2.140 -
657.xz_s (unexplained diff vs previous) 47.000 -
657.xz_s (unexplained diff vs previous) (percentage) 2.190 -
Geometric Mean 5.334 -32.59%