Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7da4814ad420b5197e51c732c69c685c2640918b (+ 75 commits) |
git_gcc | https://gcc.gnu.org/git/gcc.git (13699eb9883d6abcfbe971c9c98d113b00553779) (+ 206 commits) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=b2970d5e5be3142f4f50d589b886b53567818bcc (+ 37 commits) |
git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/5ba594f2049bc9eb2781500c137e3e9fcc87ef69 (+ 781 commits) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--gnu-aarch64-master-O2_LTO-build/413/ |
Filter
gnu-aarch64-master-O2_LTO test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0413 (4-changed-components) | 2025-05-26T12:27:34 | 0:00:00 |
Previous | 0411 (4-changed-components) | 2025-05-19T00:37:03 | 0:00:00 |
Baseline | 0001 (4-changed-components) | 2023-03-24T00:16:56 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 22 | 23 |
Performance Improvements | 63 | 11 |
Added Tests | 18 | 110 |
Unchanged Tests | 815 | 774 |
Total Tests | 918 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
627.cam4_s | 8.15% | 135.000 | 146.000 | - | 0.00% | - |
511.povray_r | 2.50% | 400.000 | 410.000 | - | 1.49% | - |
623.xalancbmk_s | 1.19% | 3115.000 | 3152.000 | - | -3.28% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
631.deepsjeng_s (unexplained diff vs previous) (percentage) | 250.00% | 0.080 | 0.280 | - | 0.00% | - |
631.deepsjeng_s (unexplained diff vs previous) | 233.33% | 3.000 | 10.000 | - | 0.00% | - |
620.omnetpp_s (max) (percentage) | 155.88% | 0.680 | 1.740 | - | 0.00% | - |
620.omnetpp_s (max) | 155.56% | 27.000 | 69.000 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) (percentage) | 125.00% | 0.120 | 0.270 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) | 121.05% | 38.000 | 84.000 | - | 0.00% | - |
625.x264_s (unexplained diff vs previous) | 100.00% | 2.000 | 4.000 | - | 0.00% | - |
625.x264_s (unexplained diff vs previous) (percentage) | 87.50% | 0.080 | 0.150 | - | 0.00% | - |
607.cactuBSSN_s (unexplained diff vs previous) | 85.71% | 14.000 | 26.000 | - | 0.00% | - |
607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 85.71% | 0.280 | 0.520 | - | 0.00% | - |
623.xalancbmk_s (max) | 76.19% | 21.000 | 37.000 | - | 0.00% | - |
623.xalancbmk_s (max) (percentage) | 70.00% | 0.700 | 1.190 | - | 0.00% | - |
511.povray_r | 33.33% | 3.000 | 4.000 | - | 0.00% | - |
511.povray_r (avg) | 33.33% | 3.000 | 4.000 | - | 0.00% | - |
644.nab_s (max) (percentage) | 15.05% | 0.930 | 1.070 | - | 0.00% | - |
644.nab_s (max) | 14.71% | 102.000 | 117.000 | - | 0.00% | - |
623.xalancbmk_s | 4.00% | 25.000 | 26.000 | - | 0.00% | - |
623.xalancbmk_s (avg) | 4.00% | 25.000 | 26.000 | - | 0.00% | - |
623.xalancbmk_s (avg) (percentage) | 1.22% | 0.820 | 0.830 | - | 0.00% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
620.omnetpp_s | -1.74% | 4069.000 | 3998.000 | - | -2.20% | - |
510.parest_r | -1.08% | 5837.000 | 5774.000 | - | 0.16% | - |
644.nab_s | -1.07% | 11059.000 | 10941.000 | - | 4.34% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
657.xz_s (unexplained diff vs previous) (percentage) | -92.86% | 0.560 | 0.040 | - | 0.00% | - |
657.xz_s (unexplained diff vs previous) | -92.31% | 13.000 | 1.000 | - | 0.00% | - |
654.roms_s (max) | -79.91% | 1862.000 | 374.000 | - | 0.00% | - |
654.roms_s (max) (percentage) | -79.78% | 6.380 | 1.290 | - | 0.00% | - |
657.xz_s (max) | -71.79% | 39.000 | 11.000 | - | 0.00% | - |
657.xz_s (max) (percentage) | -70.59% | 1.700 | 0.500 | - | 0.00% | - |
603.bwaves_s (max) (percentage) | -56.36% | 2.360 | 1.030 | - | 0.00% | - |
603.bwaves_s (max) | -56.34% | 213.000 | 93.000 | - | 0.00% | - |
605.mcf_s (max) | -44.57% | 92.000 | 51.000 | - | 0.00% | - |
605.mcf_s (max) (percentage) | -44.12% | 1.360 | 0.760 | - | 0.00% | - |
625.x264_s (max) | -7.14% | 14.000 | 13.000 | - | 0.00% | - |
508.namd_r | -4.55% | 22.000 | 21.000 | - | 0.00% | - |
508.namd_r (avg) | -4.55% | 22.000 | 21.000 | - | 0.00% | - |
510.parest_r (max) | -4.55% | 88.000 | 84.000 | - | 0.00% | - |
631.deepsjeng_s (max) | -3.70% | 27.000 | 26.000 | - | 0.00% | - |
625.x264_s (max) (percentage) | -3.64% | 0.550 | 0.530 | - | 0.00% | - |
631.deepsjeng_s | -3.23% | 31.000 | 30.000 | - | 0.00% | - |
631.deepsjeng_s (avg) | -3.23% | 31.000 | 30.000 | - | 0.00% | - |
511.povray_r (max) (percentage) | -3.19% | 1.880 | 1.820 | - | 0.00% | - |
649.fotonik3d_s (max) | -3.12% | 96.000 | 93.000 | - | 0.00% | - |
649.fotonik3d_s (max) (percentage) | -3.03% | 0.990 | 0.960 | - | 0.00% | - |
600.perlbench_s (max) | -3.03% | 33.000 | 32.000 | - | 0.00% | - |
510.parest_r (max) (percentage) | -2.65% | 1.510 | 1.470 | - | 0.00% | - |
631.deepsjeng_s (max) (percentage) | -2.56% | 0.780 | 0.760 | - | 0.00% | - |
607.cactuBSSN_s (max) | -2.35% | 85.000 | 83.000 | - | 0.00% | - |
508.namd_r (max) (percentage) | -2.15% | 0.930 | 0.910 | - | 0.00% | - |
628.pop2_s (avg) (percentage) | -2.02% | 0.990 | 0.970 | - | 0.00% | - |
628.pop2_s | -1.98% | 101.000 | 99.000 | - | 0.00% | - |
628.pop2_s (avg) | -1.98% | 101.000 | 99.000 | - | 0.00% | - |
649.fotonik3d_s | -1.85% | 162.000 | 159.000 | - | 0.00% | - |
649.fotonik3d_s (avg) | -1.85% | 162.000 | 159.000 | - | 0.00% | - |
654.roms_s | -1.85% | 974.000 | 956.000 | - | 0.00% | - |
654.roms_s (avg) | -1.85% | 974.000 | 956.000 | - | 0.00% | - |
649.fotonik3d_s (avg) (percentage) | -1.81% | 1.660 | 1.630 | - | 0.00% | - |
607.cactuBSSN_s (max) (percentage) | -1.76% | 1.700 | 1.670 | - | 0.00% | - |
620.omnetpp_s | -1.61% | 62.000 | 61.000 | - | 0.00% | - |
620.omnetpp_s (avg) | -1.61% | 62.000 | 61.000 | - | 0.00% | - |
657.xz_s (avg) (percentage) | -1.52% | 1.320 | 1.300 | - | 0.00% | - |
654.roms_s (avg) (percentage) | -1.50% | 3.340 | 3.290 | - | 0.00% | - |
607.cactuBSSN_s (avg) (percentage) | -1.49% | 2.680 | 2.640 | - | 0.00% | - |
607.cactuBSSN_s | -1.49% | 134.000 | 132.000 | - | 0.00% | - |
607.cactuBSSN_s (avg) | -1.49% | 134.000 | 132.000 | - | 0.00% | - |
644.nab_s | -1.49% | 67.000 | 66.000 | - | 0.00% | - |
644.nab_s (avg) | -1.49% | 67.000 | 66.000 | - | 0.00% | - |
510.parest_r | -1.45% | 69.000 | 68.000 | - | 0.00% | - |
510.parest_r (avg) | -1.45% | 69.000 | 68.000 | - | 0.00% | - |
603.bwaves_s (avg) (percentage) | -1.40% | 2.140 | 2.110 | - | 0.00% | - |
605.mcf_s | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
605.mcf_s (avg) | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
508.namd_r (avg) (percentage) | -1.30% | 0.770 | 0.760 | - | 0.00% | - |
600.perlbench_s (max) (percentage) | -1.20% | 1.660 | 1.640 | - | 0.00% | - |
631.deepsjeng_s (avg) (percentage) | -1.14% | 0.880 | 0.870 | - | 0.00% | - |
526.blender_r (max) (percentage) | -1.10% | 0.910 | 0.900 | - | 0.00% | - |
526.blender_r (max) | -1.04% | 96.000 | 95.000 | - | 0.00% | - |
603.bwaves_s | -1.04% | 193.000 | 191.000 | - | 0.00% | - |
603.bwaves_s (avg) | -1.04% | 193.000 | 191.000 | - | 0.00% | - |
625.x264_s (avg) (percentage) | -1.02% | 0.980 | 0.970 | - | 0.00% | - |
619.lbm_s (avg) (percentage) | -1.01% | 6.960 | 6.890 | - | 0.00% | - |
Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
nb_compile_successful | 4.35% | 23.000 | 24.000 | - | 0.00% | - |
nb_total_tests | 4.35% | 23.000 | 24.000 | - | 0.00% | - |
Added Tests - sample variability |
---|
508.namd_r (unexplained diff vs previous) |
508.namd_r (unexplained diff vs previous) (percentage) |
603.bwaves_s (unexplained diff vs previous) |
603.bwaves_s (unexplained diff vs previous) (percentage) |
605.mcf_s (unexplained diff vs previous) |
605.mcf_s (unexplained diff vs previous) (percentage) |
623.xalancbmk_s (unexplained diff vs previous) |
623.xalancbmk_s (unexplained diff vs previous) (percentage) |
628.pop2_s (unexplained diff vs previous) |
628.pop2_s (unexplained diff vs previous) (percentage) |
644.nab_s (unexplained diff vs previous) |
644.nab_s (unexplained diff vs previous) (percentage) |
648.exchange2_s (unexplained diff vs previous) |
648.exchange2_s (unexplained diff vs previous) (percentage) |
649.fotonik3d_s (unexplained diff vs previous) |
649.fotonik3d_s (unexplained diff vs previous) (percentage) |
654.roms_s (unexplained diff vs previous) |
654.roms_s (unexplained diff vs previous) (percentage) |
Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
621.wrf_s | 4.81% | 13460511.000 | 14107298.000 | - | -0.06% | - |
508.namd_r | 3.71% | 613265.000 | 635992.000 | - | 0.00% | - |
510.parest_r | 2.82% | 1458341.000 | 1499508.000 | - | -0.27% | - |
657.xz_s | 2.40% | 135153.000 | 138393.000 | - | 0.00% | - |
607.cactuBSSN_s | 1.99% | 2773236.000 | 2828526.000 | - | 0.00% | - |
628.pop2_s | 1.71% | 2872616.000 | 2921617.000 | - | 0.00% | - |
605.mcf_s | 1.47% | 16285.000 | 16525.000 | - | 0.00% | - |
625.x264_s | 1.36% | 435471.000 | 441381.000 | - | 0.00% | - |
600.perlbench_s | 1.22% | 2151136.000 | 2177403.000 | - | -0.94% | - |
641.leela_s | 1.10% | 80027.000 | 80907.000 | - | 0.00% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
638.imagick_s | 64.79% | 3334.000 | 5494.000 | - | 0.27% | - |
508.namd_r | 18.62% | 2428.000 | 2880.000 | - | -0.48% | - |
648.exchange2_s | 9.59% | 2221.000 | 2434.000 | - | 0.00% | - |
625.x264_s | 9.50% | 2359.000 | 2583.000 | - | 0.16% | - |
619.lbm_s | 9.08% | 28600.000 | 31198.000 | - | 0.27% | - |
654.roms_s | 6.71% | 27239.000 | 29067.000 | - | -0.42% | - |
526.blender_r | 5.91% | 10028.000 | 10621.000 | - | 0.22% | - |
657.xz_s | 5.88% | 2211.000 | 2341.000 | - | 0.04% | - |
644.nab_s | 4.34% | 10486.000 | 10941.000 | - | -1.07% | - |
607.cactuBSSN_s | 3.97% | 4835.000 | 5027.000 | - | 0.52% | - |
641.leela_s | 2.95% | 4176.000 | 4299.000 | - | 0.58% | - |
631.deepsjeng_s | 1.84% | 3479.000 | 3543.000 | - | -0.28% | - |
511.povray_r | 1.49% | 404.000 | 410.000 | - | 2.50% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
648.exchange2_s | -10.80% | 60958.000 | 54376.000 | - | 0.00% | - |
619.lbm_s | -2.62% | 12965.000 | 12625.000 | - | 0.00% | - |
649.fotonik3d_s | -2.00% | 295938.000 | 290028.000 | - | 0.00% | - |
638.imagick_s | -1.70% | 1298946.000 | 1276870.000 | - | 0.01% | - |
644.nab_s | -1.36% | 91858.000 | 90606.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
621.wrf_s | -22.59% | 9272.000 | 7177.000 | - | -0.17% | - |
628.pop2_s | -3.55% | 10608.000 | 10231.000 | - | -0.49% | - |
600.perlbench_s | -3.51% | 2080.000 | 2007.000 | - | 0.60% | - |
623.xalancbmk_s | -3.28% | 3259.000 | 3152.000 | - | 1.19% | - |
620.omnetpp_s | -2.20% | 4088.000 | 3998.000 | - | -1.74% | - |
602.gcc_s | -1.77% | 4182.000 | 4108.000 | - | 0.83% | - |
Added Tests - Execution |
---|
627.cam4_s |
Added Tests - sample variability |
---|
508.namd_r |
508.namd_r (avg) |
508.namd_r (avg) (percentage) |
508.namd_r (max) |
508.namd_r (max) (percentage) |
510.parest_r |
510.parest_r (avg) |
510.parest_r (avg) (percentage) |
510.parest_r (max) |
510.parest_r (max) (percentage) |
511.povray_r |
511.povray_r (avg) |
511.povray_r (avg) (percentage) |
511.povray_r (max) |
511.povray_r (max) (percentage) |
526.blender_r |
526.blender_r (avg) |
526.blender_r (avg) (percentage) |
526.blender_r (max) |
526.blender_r (max) (percentage) |
600.perlbench_s |
600.perlbench_s (avg) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) |
600.perlbench_s (max) (percentage) |
603.bwaves_s |
603.bwaves_s (avg) |
603.bwaves_s (avg) (percentage) |
603.bwaves_s (max) |
603.bwaves_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
607.cactuBSSN_s |
607.cactuBSSN_s (avg) |
607.cactuBSSN_s (avg) (percentage) |
607.cactuBSSN_s (max) |
607.cactuBSSN_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
623.xalancbmk_s |
623.xalancbmk_s (avg) |
623.xalancbmk_s (avg) (percentage) |
623.xalancbmk_s (max) |
623.xalancbmk_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (avg) (percentage) |
628.pop2_s (max) |
628.pop2_s (max) (percentage) |
628.pop2_s (unexplained diff vs previous) |
628.pop2_s (unexplained diff vs previous) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
648.exchange2_s |
648.exchange2_s (avg) |
648.exchange2_s (avg) (percentage) |
648.exchange2_s (max) |
648.exchange2_s (max) (percentage) |
648.exchange2_s (unexplained diff vs previous) |
648.exchange2_s (unexplained diff vs previous) (percentage) |
649.fotonik3d_s |
649.fotonik3d_s (avg) |
649.fotonik3d_s (avg) (percentage) |
649.fotonik3d_s (max) |
649.fotonik3d_s (max) (percentage) |
654.roms_s |
654.roms_s (avg) |
654.roms_s (avg) (percentage) |
654.roms_s (max) |
654.roms_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
Report Time: 0.35s