Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=5966e2eb3fed61ebe5c091a074b368b9238a68c1 (+ 10 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/fe99ab1f5e9920fd46ef8148fcffde6729d68523 (+ 31 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=14e56bd4ce15ac2d1cc43f762eb2e6b83fec1afe (+ 2 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=486067966cd308763a6ec811296e2ed4581f4af6 (+ 145 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-Os-build/166/
Filter

gnu-aarch64-master-Os test results

Run Order Start Time Duration
Current 0166 (4-changed-components) 2024-04-10T04:48:13 0:00:00
Previous 0166 (4-changed-components) 2024-04-10T04:48:13 0:00:00
Baseline 0001 (4-changed-components) 2023-02-27T01:05:11 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 3
Performance Improvements 0 22
Added Tests 0 107
Unchanged Tests 930 798
Total Tests 930

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
644.nab_s 2.60% 12363.000 12684.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -8.33% 24.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
649.fotonik3d_s -5.60% 272124.000 256872.000 - 0.00% -
603.bwaves_s -4.89% 46959.000 44662.000 - 0.00% -
654.roms_s -1.84% 589234.000 578413.000 - 0.00% -
511.povray_r -1.37% 711805.000 702082.000 - 0.00% -
619.lbm_s -1.01% 15041.000 14889.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -16.82% 36505.000 30366.000 - 0.00% -
603.bwaves_s -15.75% 11127.000 9374.000 - 0.00% -
511.povray_r -7.94% 529.000 487.000 - 0.00% -
657.xz_s -7.15% 2728.000 2533.000 - 0.00% -
526.blender_r -4.32% 13182.000 12612.000 - 0.00% -
620.omnetpp_s -4.16% 4519.000 4331.000 - 0.00% -
654.roms_s -3.71% 36958.000 35588.000 - 0.00% -
600.perlbench_s -3.55% 2394.000 2309.000 - 0.00% -
602.gcc_s -3.05% 5117.000 4961.000 - 0.00% -
625.x264_s -2.58% 4062.000 3957.000 - 0.00% -
628.pop2_s -2.34% 14534.000 14194.000 - 0.00% -
508.namd_r -2.33% 3520.000 3438.000 - 0.00% -
638.imagick_s -2.04% 6078.000 5954.000 - 0.00% -
607.cactuBSSN_s -1.86% 5175.000 5079.000 - 0.00% -
510.parest_r -1.38% 6757.000 6664.000 - 0.00% -
623.xalancbmk_s -1.35% 5248.000 5177.000 - 0.00% -
605.mcf_s -1.04% 7307.000 7231.000 - 0.00% -

Added Tests - sample variability
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s (avg) (percentage)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.35s
Name Current %
508.namd_r 3438.000 -
510.parest_r 6664.000 -
511.povray_r 487.000 -
526.blender_r 12612.000 -
600.perlbench_s 2309.000 -
602.gcc_s 4961.000 -
603.bwaves_s 9374.000 -
605.mcf_s 7231.000 -
607.cactuBSSN_s 5079.000 -
619.lbm_s 30366.000 -
620.omnetpp_s 4331.000 -
623.xalancbmk_s 5177.000 -
625.x264_s 3957.000 -
628.pop2_s 14194.000 -
631.deepsjeng_s 4443.000 -
638.imagick_s 5954.000 -
641.leela_s 5172.000 -
644.nab_s 12684.000 -
648.exchange2_s 3415.000 -
649.fotonik3d_s 10521.000 -
654.roms_s 35588.000 -
657.xz_s 2533.000 -
Geometric Mean 5973.203 -
Name Current %
508.namd_r 439292.000 -
510.parest_r 5255908.000 -
511.povray_r 702082.000 -
526.blender_r 8295246.000 -
600.perlbench_s 1815837.000 -
602.gcc_s 7318556.000 -
603.bwaves_s 44662.000 -
605.mcf_s 17720.000 -
607.cactuBSSN_s 2641963.000 -
619.lbm_s 14889.000 -
620.omnetpp_s 1584981.000 -
623.xalancbmk_s 3543639.000 -
625.x264_s 361383.000 -
628.pop2_s 24710087.000 -
631.deepsjeng_s 69014.000 -
638.imagick_s 1492038.000 -
641.leela_s 109542.000 -
644.nab_s 144607.000 -
648.exchange2_s 52829.000 -
649.fotonik3d_s 256872.000 -
654.roms_s 578413.000 -
657.xz_s 159907.000 -
Geometric Mean 520257.944 -
Name Current %
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.590 -
508.namd_r (max) 26.000 -
508.namd_r (max) (percentage) 0.780 -
508.namd_r (unexplained diff vs previous) 2.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.060 -
510.parest_r 51.000 -
510.parest_r (avg) 51.000 -
510.parest_r (avg) (percentage) 0.770 -
510.parest_r (max) 94.000 -
510.parest_r (max) (percentage) 1.420 -
510.parest_r (unexplained diff vs previous) 4.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.060 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.000 -
511.povray_r (max) 5.000 -
511.povray_r (max) (percentage) 1.060 -
511.povray_r (unexplained diff vs previous) 2.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.410 -
526.blender_r 68.000 -
526.blender_r (avg) 68.000 -
526.blender_r (avg) (percentage) 0.540 -
526.blender_r (max) 27.000 -
526.blender_r (max) (percentage) 0.220 -
526.blender_r (unexplained diff vs previous) 11.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.090 -
600.perlbench_s 36.000 -
600.perlbench_s (avg) 36.000 -
600.perlbench_s (avg) (percentage) 1.570 -
600.perlbench_s (max) 105.000 -
600.perlbench_s (max) (percentage) 4.550 -
600.perlbench_s (unexplained diff vs previous) 39.000 -
600.perlbench_s (unexplained diff vs previous) (percentage) 1.690 -
603.bwaves_s 201.000 -
603.bwaves_s (avg) 201.000 -
603.bwaves_s (avg) (percentage) 2.150 -
603.bwaves_s (max) 298.000 -
603.bwaves_s (max) (percentage) 3.180 -
603.bwaves_s (unexplained diff vs previous) 146.000 -
603.bwaves_s (unexplained diff vs previous) (percentage) 1.560 -
605.mcf_s 81.000 -
605.mcf_s (avg) 81.000 -
605.mcf_s (avg) (percentage) 1.130 -
605.mcf_s (max) 78.000 -
605.mcf_s (max) (percentage) 1.090 -
605.mcf_s (unexplained diff vs previous) 43.000 -
605.mcf_s (unexplained diff vs previous) (percentage) 0.590 -
607.cactuBSSN_s 169.000 -
607.cactuBSSN_s (avg) 169.000 -
607.cactuBSSN_s (avg) (percentage) 3.330 -
607.cactuBSSN_s (max) 414.000 -
607.cactuBSSN_s (max) (percentage) 8.160 -
607.cactuBSSN_s (unexplained diff vs previous) 44.000 -
607.cactuBSSN_s (unexplained diff vs previous) (percentage) 0.870 -
619.lbm_s 2657.000 -
619.lbm_s (avg) 2657.000 -
619.lbm_s (avg) (percentage) 8.750 -
619.lbm_s (max) 3759.000 -
619.lbm_s (max) (percentage) 12.380 -
619.lbm_s (unexplained diff vs previous) 274.000 -
619.lbm_s (unexplained diff vs previous) (percentage) 0.900 -
620.omnetpp_s 60.000 -
620.omnetpp_s (avg) 60.000 -
620.omnetpp_s (avg) (percentage) 1.390 -
620.omnetpp_s (max) 76.000 -
620.omnetpp_s (max) (percentage) 1.760 -
620.omnetpp_s (unexplained diff vs previous) 15.000 -
620.omnetpp_s (unexplained diff vs previous) (percentage) 0.350 -
621.wrf_s (avg) (percentage) 5.370 -
621.wrf_s (max) (percentage) 2.920 -
623.xalancbmk_s 71.000 -
623.xalancbmk_s (avg) 71.000 -
623.xalancbmk_s (avg) (percentage) 1.390 -
623.xalancbmk_s (max) 166.000 -
623.xalancbmk_s (max) (percentage) 3.210 -
625.x264_s 21.000 -
625.x264_s (avg) 21.000 -
625.x264_s (avg) (percentage) 0.540 -
625.x264_s (max) 26.000 -
625.x264_s (max) (percentage) 0.660 -
625.x264_s (unexplained diff vs previous) 3.000 -
625.x264_s (unexplained diff vs previous) (percentage) 0.080 -
628.pop2_s 100.000 -
628.pop2_s (avg) 100.000 -
628.pop2_s (avg) (percentage) 0.710 -
628.pop2_s (max) 164.000 -
628.pop2_s (max) (percentage) 1.160 -
628.pop2_s (unexplained diff vs previous) 25.000 -
628.pop2_s (unexplained diff vs previous) (percentage) 0.180 -
631.deepsjeng_s 27.000 -
631.deepsjeng_s (avg) 27.000 -
631.deepsjeng_s (avg) (percentage) 0.620 -
631.deepsjeng_s (max) 54.000 -
631.deepsjeng_s (max) (percentage) 1.230 -
631.deepsjeng_s (unexplained diff vs previous) 1.000 -
631.deepsjeng_s (unexplained diff vs previous) (percentage) 0.020 -
638.imagick_s 54.000 -
638.imagick_s (avg) 54.000 -
638.imagick_s (avg) (percentage) 0.920 -
638.imagick_s (max) 98.000 -
638.imagick_s (max) (percentage) 1.660 -
638.imagick_s (unexplained diff vs previous) 12.000 -
638.imagick_s (unexplained diff vs previous) (percentage) 0.200 -
641.leela_s 25.000 -
641.leela_s (avg) 25.000 -
641.leela_s (avg) (percentage) 0.490 -
641.leela_s (max) 26.000 -
641.leela_s (max) (percentage) 0.510 -
641.leela_s (unexplained diff vs previous) 1.000 -
641.leela_s (unexplained diff vs previous) (percentage) 0.020 -
644.nab_s 54.000 -
644.nab_s (avg) 54.000 -
644.nab_s (avg) (percentage) 0.430 -
644.nab_s (max) 93.000 -
644.nab_s (max) (percentage) 0.740 -
644.nab_s (unexplained diff vs previous) 27.000 -
644.nab_s (unexplained diff vs previous) (percentage) 0.210 -
648.exchange2_s 17.000 -
648.exchange2_s (avg) 17.000 -
648.exchange2_s (avg) (percentage) 0.510 -
648.exchange2_s (max) 28.000 -
648.exchange2_s (max) (percentage) 0.840 -
648.exchange2_s (unexplained diff vs previous) 12.000 -
648.exchange2_s (unexplained diff vs previous) (percentage) 0.350 -
649.fotonik3d_s 155.000 -
649.fotonik3d_s (avg) 155.000 -
649.fotonik3d_s (avg) (percentage) 1.480 -
649.fotonik3d_s (max) 299.000 -
649.fotonik3d_s (max) (percentage) 2.850 -
649.fotonik3d_s (unexplained diff vs previous) 17.000 -
649.fotonik3d_s (unexplained diff vs previous) (percentage) 0.160 -
654.roms_s 928.000 -
654.roms_s (avg) 928.000 -
654.roms_s (avg) (percentage) 2.610 -
654.roms_s (max) 2217.000 -
654.roms_s (max) (percentage) 6.230 -
654.roms_s (unexplained diff vs previous) 145.000 -
654.roms_s (unexplained diff vs previous) (percentage) 0.410 -
657.xz_s 36.000 -
657.xz_s (avg) 36.000 -
657.xz_s (avg) (percentage) 1.440 -
657.xz_s (max) 61.000 -
657.xz_s (max) (percentage) 2.430 -
657.xz_s (unexplained diff vs previous) 24.000 -
657.xz_s (unexplained diff vs previous) (percentage) 0.950 -
Geometric Mean 8.344 -