Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=37afef6fe1378d671643624439e76453ade7c4af (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (1b35b929354c41f3e2682aa7a30013e1bfe31bd4) (+ 1155 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e5893e6349541d871e8a25120bca014551d13ff5 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/68b02c3ac18b9686154702eb4aa2e5327d35e3ac (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/489/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0489 (basepoints/gcc-15-05167-g1b35b929354) 2025-02-28T00:37:39 0:00:00
Previous 0487 (basepoints/gcc-15-04012-gba7632674a2a) 2025-02-27T00:28:06 0:00:00
Baseline 0002 (4-changed-components) 2023-02-28T02:02:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 31 19
Performance Improvements 53 17
Added Tests 5 100
Unchanged Tests 769 722
Total Tests 858

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 1.79% 353422.000 359758.000 - 1.63% -
654.roms_s 1.10% 956577.000 967065.000 - -10.10% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
603.bwaves_s (unexplained diff vs previous) 20787.80% 41.000 8564.000 - 0.00% -
603.bwaves_s (unexplained diff vs previous) (percentage) 17700.00% 0.020 3.560 - 0.00% -
648.exchange2_s (unexplained diff vs previous) (percentage) 3200.00% 0.010 0.330 - 0.00% -
648.exchange2_s (unexplained diff vs previous) 2600.00% 1.000 27.000 - 0.00% -
623.xalancbmk_s (max) (percentage) 1810.00% 0.200 3.820 - 0.00% -
623.xalancbmk_s (max) 1735.71% 42.000 771.000 - 0.00% -
648.exchange2_s (max) 420.00% 5.000 26.000 - 0.00% -
648.exchange2_s (max) (percentage) 357.14% 0.070 0.320 - 0.00% -
603.bwaves_s (max) (percentage) 211.82% 1.100 3.430 - 0.00% -
603.bwaves_s (max) 201.09% 2743.000 8259.000 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) (percentage) 143.62% 4.470 10.890 - 0.00% -
619.lbm_s (unexplained diff vs previous) (percentage) 123.33% 3.900 8.710 - 0.00% -
620.omnetpp_s (unexplained diff vs previous) 120.00% 790.000 1738.000 - 0.00% -
619.lbm_s (max) (percentage) 113.60% 3.750 8.010 - 0.00% -
620.omnetpp_s (max) (percentage) 110.28% 4.670 9.820 - 0.00% -
619.lbm_s (unexplained diff vs previous) 105.35% 1663.000 3415.000 - 0.00% -
619.lbm_s (max) 96.50% 1599.000 3142.000 - 0.00% -
620.omnetpp_s (max) 89.59% 826.000 1566.000 - 0.00% -
619.lbm_s (avg) (percentage) 46.15% 0.390 0.570 - 0.00% -
619.lbm_s 34.34% 166.000 223.000 - 0.00% -
619.lbm_s (avg) 34.34% 166.000 223.000 - 0.00% -
603.bwaves_s (avg) (percentage) 16.00% 0.500 0.580 - 0.00% -
603.bwaves_s 12.04% 1246.000 1396.000 - 0.00% -
603.bwaves_s (avg) 12.04% 1246.000 1396.000 - 0.00% -
620.omnetpp_s (avg) (percentage) 7.84% 2.040 2.200 - 0.00% -
623.xalancbmk_s (avg) (percentage) 4.85% 1.650 1.730 - 0.00% -
600.perlbench_s 1.67% 60.000 61.000 - 0.00% -
600.perlbench_s (avg) 1.67% 60.000 61.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -5.00% 20.000 19.000 - -5.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
628.pop2_s -99.96% 78292.000 28.000 - -99.97% -
620.omnetpp_s -9.82% 17691.000 15953.000 - -3.87% -
619.lbm_s -8.01% 42645.000 39230.000 - -0.27% -
641.leela_s -6.08% 13383.000 12569.000 - -8.46% -
607.cactuBSSN_s -5.36% 107984.000 102195.000 - -4.30% -
627.cam4_s -4.54% 106857.000 102008.000 - 2.85% -
605.mcf_s -4.11% 34002.000 32604.000 - 13.89% -
623.xalancbmk_s -3.82% 21006.000 20204.000 - 11.26% -
603.bwaves_s -3.43% 249376.000 240812.000 - 0.66% -
657.xz_s -3.18% 131839.000 127648.000 - 3.90% -
625.x264_s -2.19% 8143.000 7965.000 - -7.15% -
621.wrf_s -1.80% 69943.000 68683.000 - -38.92% -
602.gcc_s -1.53% 22947.000 22595.000 - 5.68% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
605.mcf_s (max) -9.50% 958.000 867.000 - 0.00% -
644.nab_s (max) (percentage) -9.09% 0.440 0.400 - 0.00% -
644.nab_s (max) -8.73% 607.000 554.000 - 0.00% -
657.xz_s (max) -8.22% 15952.000 14641.000 - 0.00% -
625.x264_s (max) -8.00% 25.000 23.000 - 0.00% -
641.leela_s -8.00% 25.000 23.000 - 0.00% -
641.leela_s (avg) -8.00% 25.000 23.000 - 0.00% -
641.leela_s (max) -8.00% 25.000 23.000 - 0.00% -
602.gcc_s (max) -7.70% 844.000 779.000 - 0.00% -
607.cactuBSSN_s (max) -7.44% 1479.000 1369.000 - 0.00% -
625.x264_s (max) (percentage) -6.45% 0.310 0.290 - 0.00% -
602.gcc_s (max) (percentage) -6.25% 3.680 3.450 - 0.00% -
600.perlbench_s (max) -6.06% 66.000 62.000 - 0.00% -
621.wrf_s (max) -5.99% 167.000 157.000 - 0.00% -
605.mcf_s (max) (percentage) -5.67% 2.820 2.660 - 0.00% -
607.cactuBSSN_s -5.28% 701.000 664.000 - 0.00% -
607.cactuBSSN_s (avg) -5.28% 701.000 664.000 - 0.00% -
657.xz_s (max) (percentage) -5.21% 12.100 11.470 - 0.00% -
600.perlbench_s (max) (percentage) -5.13% 0.390 0.370 - 0.00% -
627.cam4_s -4.69% 128.000 122.000 - 0.00% -
627.cam4_s (avg) -4.69% 128.000 122.000 - 0.00% -
649.fotonik3d_s (max) -4.63% 1273.000 1214.000 - 0.00% -
627.cam4_s (max) -4.38% 160.000 153.000 - 0.00% -
649.fotonik3d_s (max) (percentage) -4.37% 1.830 1.750 - 0.00% -
625.x264_s -4.17% 24.000 23.000 - 0.00% -
625.x264_s (avg) -4.17% 24.000 23.000 - 0.00% -
605.mcf_s -4.04% 669.000 642.000 - 0.00% -
605.mcf_s (avg) -4.04% 669.000 642.000 - 0.00% -
628.pop2_s (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
657.xz_s -3.18% 7172.000 6944.000 - 0.00% -
657.xz_s (avg) -3.18% 7172.000 6944.000 - 0.00% -
620.omnetpp_s -2.78% 360.000 350.000 - 0.00% -
620.omnetpp_s (avg) -2.78% 360.000 350.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -2.19% 1.370 1.340 - 0.00% -
602.gcc_s -1.68% 477.000 469.000 - 0.00% -
602.gcc_s (avg) -1.68% 477.000 469.000 - 0.00% -
654.roms_s (max) (percentage) -1.56% 1.920 1.890 - 0.00% -
621.wrf_s -1.54% 195.000 192.000 - 0.00% -
621.wrf_s (avg) -1.54% 195.000 192.000 - 0.00% -
654.roms_s (max) -1.37% 1537.000 1516.000 - 0.00% -

Added Tests - sample variability
623.xalancbmk_s (unexplained diff vs previous)
623.xalancbmk_s (unexplained diff vs previous) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 18.97% 4214065.000 5013401.000 - 0.34% -
623.xalancbmk_s 8.65% 5497646.000 5973175.000 - 0.10% -
600.perlbench_s 8.40% 2404724.000 2606759.000 - 0.46% -
657.xz_s 7.49% 205531.000 220915.000 - -0.00% -
644.nab_s 7.41% 218975.000 235193.000 - -0.11% -
602.gcc_s 6.54% 10008387.000 10662999.000 - -0.03% -
631.deepsjeng_s 5.36% 95946.000 101086.000 - -0.06% -
638.imagick_s 4.75% 2221370.000 2326802.000 - -0.54% -
620.omnetpp_s 4.31% 2247854.000 2344737.000 - 0.20% -
641.leela_s 2.62% 202615.000 207925.000 - -0.88% -
649.fotonik3d_s 1.63% 353975.000 359758.000 - 1.79% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
605.mcf_s 13.89% 28627.000 32604.000 - -4.11% -
649.fotonik3d_s 11.94% 62018.000 69425.000 - -0.21% -
623.xalancbmk_s 11.26% 18160.000 20204.000 - -3.82% -
648.exchange2_s 8.78% 7633.000 8303.000 - -0.32% -
602.gcc_s 5.68% 21380.000 22595.000 - -1.53% -
657.xz_s 3.90% 122860.000 127648.000 - -3.18% -
627.cam4_s 2.85% 99181.000 102008.000 - -4.54% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.00% 20.000 19.000 - -5.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -17.86% 21250.000 17454.000 - 0.00% -
654.roms_s -10.10% 1075717.000 967065.000 - 1.10% -
605.mcf_s -5.86% 28789.000 27103.000 - 0.00% -
603.bwaves_s -2.01% 53831.000 52749.000 - -0.06% -
625.x264_s -1.54% 626778.000 617153.000 - 0.15% -
648.exchange2_s -1.00% 177422.000 175640.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
628.pop2_s -99.97% 100834.000 28.000 - -99.96% -
654.roms_s -62.59% 214456.000 80220.000 - 0.14% -
621.wrf_s -38.92% 112446.000 68683.000 - -1.80% -
644.nab_s -13.84% 160803.000 138540.000 - 0.27% -
641.leela_s -8.46% 13731.000 12569.000 - -6.08% -
625.x264_s -7.15% 8578.000 7965.000 - -2.19% -
600.perlbench_s -6.14% 18097.000 16985.000 - 0.32% -
638.imagick_s -4.60% 202929.000 193586.000 - -0.19% -
607.cactuBSSN_s -4.30% 106786.000 102195.000 - -5.36% -
631.deepsjeng_s -4.26% 12764.000 12220.000 - 0.16% -
620.omnetpp_s -3.87% 16595.000 15953.000 - -9.82% -

Added Tests - sample variability
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
602.gcc_s
602.gcc_s (avg)
602.gcc_s (avg) (percentage)
602.gcc_s (max)
602.gcc_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.33s
Name Current %
600.perlbench_s 16985.000 -
602.gcc_s 22595.000 -1.53%
603.bwaves_s 240812.000 -3.43%
605.mcf_s 32604.000 -4.11%
607.cactuBSSN_s 102195.000 -5.36%
619.lbm_s 39230.000 -8.01%
620.omnetpp_s 15953.000 -9.82%
621.wrf_s 68683.000 -1.80%
623.xalancbmk_s 20204.000 -3.82%
625.x264_s 7965.000 -2.19%
627.cam4_s 102008.000 -4.54%
628.pop2_s 28.000 -99.96%
631.deepsjeng_s 12220.000 -
638.imagick_s 193586.000 -
641.leela_s 12569.000 -6.08%
644.nab_s 138540.000 -
648.exchange2_s 8303.000 -
649.fotonik3d_s 69425.000 -
654.roms_s 80220.000 -
657.xz_s 127648.000 -3.18%
Geometric Mean 28741.048 -34.59%
Name Current %
600.perlbench_s 2606759.000 -
602.gcc_s 10662999.000 -
603.bwaves_s 52749.000 -
605.mcf_s 27103.000 -
607.cactuBSSN_s 5013401.000 -
619.lbm_s 17454.000 -
620.omnetpp_s 2344737.000 -
621.wrf_s 20459077.000 -
623.xalancbmk_s 5973175.000 -
625.x264_s 617153.000 -
627.cam4_s 19008182.000 -
631.deepsjeng_s 101086.000 -
638.imagick_s 2326802.000 -
641.leela_s 207925.000 -
644.nab_s 235193.000 -
648.exchange2_s 175640.000 -
649.fotonik3d_s 359758.000 1.79%
654.roms_s 967065.000 1.10%
657.xz_s 220915.000 -
Geometric Mean 717346.823 -
Name Current %
nb_compile_successful 20.000 -
nb_execution_successful 19.000 -5.00%
nb_total_tests 20.000 -
Geometric Mean 19.661 -1.70%
Name Current %
600.perlbench_s 61.000 1.67%
600.perlbench_s (avg) 61.000 1.67%
600.perlbench_s (avg) (percentage) 0.360 -
600.perlbench_s (max) 62.000 -6.06%
600.perlbench_s (max) (percentage) 0.370 -5.13%
602.gcc_s 469.000 -1.68%
602.gcc_s (avg) 469.000 -1.68%
602.gcc_s (avg) (percentage) 2.080 -
602.gcc_s (max) 779.000 -7.70%
602.gcc_s (max) (percentage) 3.450 -6.25%
603.bwaves_s 1396.000 12.04%
603.bwaves_s (avg) 1396.000 12.04%
603.bwaves_s (avg) (percentage) 0.580 16.00%
603.bwaves_s (max) 8259.000 201.09%
603.bwaves_s (max) (percentage) 3.430 211.82%
603.bwaves_s (unexplained diff vs previous) 8564.000 20787.80%
603.bwaves_s (unexplained diff vs previous) (percentage) 3.560 17700.00%
605.mcf_s 642.000 -4.04%
605.mcf_s (avg) 642.000 -4.04%
605.mcf_s (avg) (percentage) 1.970 -
605.mcf_s (max) 867.000 -9.50%
605.mcf_s (max) (percentage) 2.660 -5.67%
607.cactuBSSN_s 664.000 -5.28%
607.cactuBSSN_s (avg) 664.000 -5.28%
607.cactuBSSN_s (avg) (percentage) 0.650 -
607.cactuBSSN_s (max) 1369.000 -7.44%
607.cactuBSSN_s (max) (percentage) 1.340 -2.19%
619.lbm_s 223.000 34.34%
619.lbm_s (avg) 223.000 34.34%
619.lbm_s (avg) (percentage) 0.570 46.15%
619.lbm_s (max) 3142.000 96.50%
619.lbm_s (max) (percentage) 8.010 113.60%
619.lbm_s (unexplained diff vs previous) 3415.000 105.35%
619.lbm_s (unexplained diff vs previous) (percentage) 8.710 123.33%
620.omnetpp_s 350.000 -2.78%
620.omnetpp_s (avg) 350.000 -2.78%
620.omnetpp_s (avg) (percentage) 2.200 7.84%
620.omnetpp_s (max) 1566.000 89.59%
620.omnetpp_s (max) (percentage) 9.820 110.28%
620.omnetpp_s (unexplained diff vs previous) 1738.000 120.00%
620.omnetpp_s (unexplained diff vs previous) (percentage) 10.890 143.62%
621.wrf_s 192.000 -1.54%
621.wrf_s (avg) 192.000 -1.54%
621.wrf_s (avg) (percentage) 0.280 -
621.wrf_s (max) 157.000 -5.99%
621.wrf_s (max) (percentage) 0.230 -
623.xalancbmk_s 349.000 -
623.xalancbmk_s (avg) 349.000 -
623.xalancbmk_s (avg) (percentage) 1.730 4.85%
623.xalancbmk_s (max) 771.000 1735.71%
623.xalancbmk_s (max) (percentage) 3.820 1810.00%
623.xalancbmk_s (unexplained diff vs previous) 802.000 -
623.xalancbmk_s (unexplained diff vs previous) (percentage) 3.970 -
625.x264_s 23.000 -4.17%
625.x264_s (avg) 23.000 -4.17%
625.x264_s (avg) (percentage) 0.300 -
625.x264_s (max) 23.000 -8.00%
625.x264_s (max) (percentage) 0.290 -6.45%
627.cam4_s 122.000 -4.69%
627.cam4_s (avg) 122.000 -4.69%
627.cam4_s (avg) (percentage) 0.120 -
627.cam4_s (max) 153.000 -4.38%
627.cam4_s (max) (percentage) 0.150 -
628.pop2_s 0.000 -
628.pop2_s (avg) 0.000 -
628.pop2_s (avg) (percentage) 0.220 -
628.pop2_s (max) 0.000 -
628.pop2_s (max) (percentage) 0.250 -3.85%
631.deepsjeng_s 140.000 -
631.deepsjeng_s (avg) 140.000 -
631.deepsjeng_s (avg) (percentage) 1.150 -
631.deepsjeng_s (max) 224.000 -
631.deepsjeng_s (max) (percentage) 1.840 -
638.imagick_s 193.000 -
638.imagick_s (avg) 193.000 -
638.imagick_s (avg) (percentage) 0.100 -
638.imagick_s (max) 251.000 -
638.imagick_s (max) (percentage) 0.130 -
641.leela_s 23.000 -8.00%
641.leela_s (avg) 23.000 -8.00%
641.leela_s (avg) (percentage) 0.190 -
641.leela_s (max) 23.000 -8.00%
641.leela_s (max) (percentage) 0.190 -
644.nab_s 193.000 -
644.nab_s (avg) 193.000 -
644.nab_s (avg) (percentage) 0.140 -
644.nab_s (max) 554.000 -8.73%
644.nab_s (max) (percentage) 0.400 -9.09%
648.exchange2_s 32.000 -
648.exchange2_s (avg) 32.000 -
648.exchange2_s (avg) (percentage) 0.390 -
648.exchange2_s (max) 26.000 420.00%
648.exchange2_s (max) (percentage) 0.320 357.14%
648.exchange2_s (unexplained diff vs previous) 27.000 2600.00%
648.exchange2_s (unexplained diff vs previous) (percentage) 0.330 3200.00%
649.fotonik3d_s 1256.000 -
649.fotonik3d_s (avg) 1256.000 -
649.fotonik3d_s (avg) (percentage) 1.810 -
649.fotonik3d_s (max) 1214.000 -4.63%
649.fotonik3d_s (max) (percentage) 1.750 -4.37%
654.roms_s 1131.000 -
654.roms_s (avg) 1131.000 -
654.roms_s (avg) (percentage) 1.410 -
654.roms_s (max) 1516.000 -1.37%
654.roms_s (max) (percentage) 1.890 -1.56%
657.xz_s 6944.000 -3.18%
657.xz_s (avg) 6944.000 -3.18%
657.xz_s (avg) (percentage) 5.440 -
657.xz_s (max) 14641.000 -8.22%
657.xz_s (max) (percentage) 11.470 -5.21%
Geometric Mean 20.546 -