Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/c62fa63ff1a043dc62b88270680657483f307fae (+ 405 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz-build/190/
Filter

llvm-aarch64-master-Oz test results

Run Order Start Time Duration
Current 0190 (llvmorg-20-init-03238-gc62fa63ff1a0) 2024-08-18T19:05:48 0:00:00
Previous 0190 (llvmorg-20-init-03238-gc62fa63ff1a0) 2024-08-18T19:05:48 0:00:00
Baseline 0140 (llvmorg-19-init-07219-g72e2e4f7dc68) 2024-04-03T16:00:23 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 4
Performance Improvements 0 3
Added Tests 0 144
Unchanged Tests 750 599
Total Tests 750

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
510.parest_r 21.09% 5139.000 6223.000 - 0.00% -
526.blender_r 7.94% 9432.000 10181.000 - 0.00% -
508.namd_r 4.68% 2583.000 2704.000 - 0.00% -
511.povray_r 1.25% 479.000 485.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 950.00% 4.000 42.000 - 0.00% -
nb_total_tests 116.67% 24.000 52.000 - 0.00% -
nb_compile_successful 100.00% 22.000 44.000 - 0.00% -

Added Tests - Code Size
600.perlbench_s
602.gcc_s
603.bwaves_s
605.mcf_s
619.lbm_s
620.omnetpp_s
621.wrf_s
625.x264_s
628.pop2_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
648.exchange2_s
649.fotonik3d_s
654.roms_s
657.xz_s

Added Tests - Execution
600.perlbench_s
602.gcc_s
603.bwaves_s
605.mcf_s
619.lbm_s
620.omnetpp_s
621.wrf_s
625.x264_s
627.cam4_s
628.pop2_s
631.deepsjeng_s
638.imagick_s
641.leela_s
644.nab_s
648.exchange2_s
649.fotonik3d_s
654.roms_s
657.xz_s

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
603.bwaves_s (unexplained diff vs previous)
603.bwaves_s (unexplained diff vs previous) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
605.mcf_s (unexplained diff vs previous)
605.mcf_s (unexplained diff vs previous) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
619.lbm_s (unexplained diff vs previous)
619.lbm_s (unexplained diff vs previous) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
620.omnetpp_s (unexplained diff vs previous)
620.omnetpp_s (unexplained diff vs previous) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
648.exchange2_s (unexplained diff vs previous)
648.exchange2_s (unexplained diff vs previous) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
649.fotonik3d_s (unexplained diff vs previous)
649.fotonik3d_s (unexplained diff vs previous) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
654.roms_s (unexplained diff vs previous)
654.roms_s (unexplained diff vs previous) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.22s
Name Current %
508.namd_r 2704.000 -
510.parest_r 6223.000 -
511.povray_r 485.000 -
526.blender_r 10181.000 -
600.perlbench_s 2873.000 -
602.gcc_s 5146.000 -
603.bwaves_s 36658.000 -
605.mcf_s 6910.000 -
619.lbm_s 27762.000 -
620.omnetpp_s 4331.000 -
621.wrf_s 56955.000 -
625.x264_s 4846.000 -
627.cam4_s 1914.000 -
628.pop2_s 83995.000 -
631.deepsjeng_s 4466.000 -
638.imagick_s 3126.000 -
641.leela_s 5370.000 -
644.nab_s 11790.000 -
648.exchange2_s 55686.000 -
649.fotonik3d_s 40308.000 -
654.roms_s 136793.000 -
657.xz_s 2274.000 -
Geometric Mean 9016.210 -
Name Current %
508.namd_r 420373.000 -
510.parest_r 5508711.000 -
511.povray_r 737250.000 -
526.blender_r 12048031.000 -
600.perlbench_s 1871262.000 -
602.gcc_s 7359319.000 -
603.bwaves_s 824508.000 -
605.mcf_s 17572.000 -
619.lbm_s 17086.000 -
620.omnetpp_s 1735038.000 -
621.wrf_s 61638697.000 -
625.x264_s 372340.000 -
628.pop2_s 14584682.000 -
631.deepsjeng_s 72453.000 -
638.imagick_s 1375379.000 -
641.leela_s 119086.000 -
644.nab_s 154172.000 -
648.exchange2_s 2650308.000 -
649.fotonik3d_s 3489752.000 -
654.roms_s 4333835.000 -
657.xz_s 160076.000 -
Geometric Mean 965466.135 -
Name Current %
508.namd_r 13.000 -
508.namd_r (avg) 13.000 -
508.namd_r (avg) (percentage) 0.510 -
508.namd_r (max) 21.000 -
508.namd_r (max) (percentage) 0.790 -
510.parest_r 51.000 -
510.parest_r (avg) 51.000 -
510.parest_r (avg) (percentage) 0.820 -
510.parest_r (max) 27.000 -
510.parest_r (max) (percentage) 0.440 -
511.povray_r 6.000 -
511.povray_r (avg) 6.000 -
511.povray_r (avg) (percentage) 1.280 -
511.povray_r (max) 8.000 -
511.povray_r (max) (percentage) 1.780 -
526.blender_r 38.000 -
526.blender_r (avg) 38.000 -
526.blender_r (avg) (percentage) 0.380 -
526.blender_r (max) 55.000 -
526.blender_r (max) (percentage) 0.550 -
600.perlbench_s 14.000 -
600.perlbench_s (avg) 14.000 -
600.perlbench_s (avg) (percentage) 0.490 -
600.perlbench_s (max) 12.000 -
600.perlbench_s (max) (percentage) 0.450 -
603.bwaves_s 179.000 -
603.bwaves_s (avg) 179.000 -
603.bwaves_s (avg) (percentage) 0.490 -
603.bwaves_s (max) 406.000 -
603.bwaves_s (max) (percentage) 1.110 -
603.bwaves_s (unexplained diff vs previous) 372.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.010 -
605.mcf_s 29.000 -
605.mcf_s (avg) 29.000 -
605.mcf_s (avg) (percentage) 0.430 -
605.mcf_s (max) 18.000 -
605.mcf_s (max) (percentage) 0.270 -
605.mcf_s (unexplained diff vs previous) 19.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.270 -
619.lbm_s 1687.000 -
619.lbm_s (avg) 1687.000 -
619.lbm_s (avg) (percentage) 6.080 -
619.lbm_s (max) 3522.000 -
619.lbm_s (max) (percentage) 12.690 -
619.lbm_s (unexplained diff vs previous) 4035.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 14.530 -
620.omnetpp_s 43.000 -
620.omnetpp_s (avg) 43.000 -
620.omnetpp_s (avg) (percentage) 1.000 -
620.omnetpp_s (max) 32.000 -
620.omnetpp_s (max) (percentage) 0.740 -
620.omnetpp_s (unexplained diff vs previous) 8.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.180 -
625.x264_s 7.000 -
625.x264_s (avg) 7.000 -
625.x264_s (avg) (percentage) 0.150 -
625.x264_s (max) 4.000 -
625.x264_s (max) (percentage) 0.090 -
628.pop2_s 92.000 -
628.pop2_s (avg) 92.000 -
628.pop2_s (avg) (percentage) 0.110 -
628.pop2_s (max) 201.000 -
628.pop2_s (max) (percentage) 0.240 -
631.deepsjeng_s 22.000 -
631.deepsjeng_s (avg) 22.000 -
631.deepsjeng_s (avg) (percentage) 0.510 -
631.deepsjeng_s (max) 25.000 -
631.deepsjeng_s (max) (percentage) 0.560 -
638.imagick_s 55.000 -
638.imagick_s (avg) 55.000 -
638.imagick_s (avg) (percentage) 1.760 -
638.imagick_s (max) 182.000 -
638.imagick_s (max) (percentage) 5.830 -
641.leela_s 16.000 -
641.leela_s (avg) 16.000 -
641.leela_s (avg) (percentage) 0.300 -
641.leela_s (max) 27.000 -
641.leela_s (max) (percentage) 0.510 -
644.nab_s 81.000 -
644.nab_s (avg) 81.000 -
644.nab_s (avg) (percentage) 0.690 -
644.nab_s (max) 89.000 -
644.nab_s (max) (percentage) 0.760 -
648.exchange2_s 172.000 -
648.exchange2_s (avg) 172.000 -
648.exchange2_s (avg) (percentage) 0.310 -
648.exchange2_s (max) 211.000 -
648.exchange2_s (max) (percentage) 0.380 -
648.exchange2_s (unexplained diff vs previous) 94.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.170 -
649.fotonik3d_s 76.000 -
649.fotonik3d_s (avg) 76.000 -
649.fotonik3d_s (avg) (percentage) 0.190 -
649.fotonik3d_s (max) 100.000 -
649.fotonik3d_s (max) (percentage) 0.250 -
649.fotonik3d_s (unexplained diff vs previous) 102.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.250 -
654.roms_s 232.000 -
654.roms_s (avg) 232.000 -
654.roms_s (avg) (percentage) 0.170 -
654.roms_s (max) 259.000 -
654.roms_s (max) (percentage) 0.190 -
654.roms_s (unexplained diff vs previous) 65.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.050 -
657.xz_s 29.000 -
657.xz_s (avg) 29.000 -
657.xz_s (avg) (percentage) 1.290 -
657.xz_s (max) 42.000 -
657.xz_s (max) (percentage) 1.890 -
Geometric Mean 8.276 -