Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=37afef6fe1378d671643624439e76453ade7c4af (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (56d0ee7a8652a212f23148038c6c0c8afcdb66ad) (+ 3046 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e5893e6349541d871e8a25120bca014551d13ff5 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/68b02c3ac18b9686154702eb4aa2e5327d35e3ac (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/486/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0486 (basepoints/gcc-15-04011-g56d0ee7a8652) 2025-02-25T00:08:59 0:00:00
Previous 0484 (3-changed-components) 2025-02-20T23:30:46 0:00:00
Baseline 0002 (4-changed-components) 2023-02-28T02:02:59 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 55 21
Performance Improvements 42 14
Added Tests 5 100
Unchanged Tests 756 723
Total Tests 858

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
648.exchange2_s 7.38% 163566.000 175644.000 - -1.00% -
625.x264_s 1.69% 605973.000 616209.000 - -1.69% -
621.wrf_s 1.53% 20035841.000 20342541.000 - 0.20% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 18.01% 62830.000 74144.000 - 19.55% -
657.xz_s 15.17% 129379.000 149011.000 - 21.29% -
619.lbm_s 12.67% 39325.000 44308.000 - 12.64% -
602.gcc_s 11.46% 20585.000 22945.000 - 7.32% -
648.exchange2_s 9.73% 7592.000 8331.000 - 9.14% -
605.mcf_s 9.59% 30334.000 33242.000 - 16.12% -
654.roms_s 8.11% 80193.000 86698.000 - -59.57% -
641.leela_s 6.13% 12607.000 13380.000 - -2.56% -
620.omnetpp_s 5.53% 16015.000 16901.000 - 1.84% -
607.cactuBSSN_s 5.30% 102668.000 108107.000 - 1.24% -
628.pop2_s 3.88% 77029.000 80015.000 - -20.65% -
603.bwaves_s 3.54% 240811.000 249335.000 - 4.22% -
631.deepsjeng_s 3.16% 12393.000 12784.000 - 0.16% -
627.cam4_s 2.78% 100526.000 103317.000 - 4.17% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s 18.03% 1137.000 1342.000 - 0.00% -
649.fotonik3d_s (avg) 18.03% 1137.000 1342.000 - 0.00% -
657.xz_s 15.17% 7038.000 8106.000 - 0.00% -
657.xz_s (avg) 15.17% 7038.000 8106.000 - 0.00% -
619.lbm_s (max) 14.29% 7.000 8.000 - 0.00% -
619.lbm_s 13.22% 121.000 137.000 - 0.00% -
619.lbm_s (avg) 13.22% 121.000 137.000 - 0.00% -
602.gcc_s 11.45% 428.000 477.000 - 0.00% -
602.gcc_s (avg) 11.45% 428.000 477.000 - 0.00% -
648.exchange2_s 10.00% 30.000 33.000 - 0.00% -
648.exchange2_s (avg) 10.00% 30.000 33.000 - 0.00% -
605.mcf_s 9.60% 594.000 651.000 - 0.00% -
605.mcf_s (avg) 9.60% 594.000 651.000 - 0.00% -
641.leela_s 8.70% 23.000 25.000 - 0.00% -
641.leela_s (avg) 8.70% 23.000 25.000 - 0.00% -
654.roms_s 8.14% 1130.000 1222.000 - 0.00% -
654.roms_s (avg) 8.14% 1130.000 1222.000 - 0.00% -
648.exchange2_s (max) 6.52% 46.000 49.000 - 0.00% -
649.fotonik3d_s (max) 6.14% 1369.000 1453.000 - 0.00% -
657.xz_s (max) 5.55% 18268.000 19282.000 - 0.00% -
620.omnetpp_s 5.36% 317.000 334.000 - 0.00% -
620.omnetpp_s (avg) 5.36% 317.000 334.000 - 0.00% -
607.cactuBSSN_s 5.32% 677.000 713.000 - 0.00% -
607.cactuBSSN_s (avg) 5.32% 677.000 713.000 - 0.00% -
654.roms_s (max) 4.94% 1619.000 1699.000 - 0.00% -
628.pop2_s 4.14% 169.000 176.000 - 0.00% -
628.pop2_s (avg) 4.14% 169.000 176.000 - 0.00% -
631.deepsjeng_s 3.52% 142.000 147.000 - 0.00% -
631.deepsjeng_s (avg) 3.52% 142.000 147.000 - 0.00% -
603.bwaves_s 3.50% 1228.000 1271.000 - 0.00% -
603.bwaves_s (avg) 3.50% 1228.000 1271.000 - 0.00% -
605.mcf_s (max) 3.40% 1028.000 1063.000 - 0.00% -
627.cam4_s (max) 3.12% 160.000 165.000 - 0.00% -
627.cam4_s 2.50% 120.000 123.000 - 0.00% -
627.cam4_s (avg) 2.50% 120.000 123.000 - 0.00% -
631.deepsjeng_s (max) 2.17% 230.000 235.000 - 0.00% -
607.cactuBSSN_s (max) 1.72% 1509.000 1535.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -4.76% 21.000 20.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
649.fotonik3d_s -2.24% 361719.000 353614.000 - -0.10% -
603.bwaves_s -1.38% 53517.000 52781.000 - -1.95% -
619.lbm_s -1.09% 17646.000 17454.000 - -17.86% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
638.imagick_s -7.18% 208985.000 193989.000 - -4.41% -
600.perlbench_s -4.41% 17569.000 16795.000 - -7.19% -
625.x264_s -2.75% 8355.000 8125.000 - -5.28% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
638.imagick_s (max) -18.86% 334.000 271.000 - 0.00% -
641.leela_s (max) (percentage) -16.00% 0.250 0.210 - 0.00% -
602.gcc_s (max) (percentage) -12.61% 4.600 4.020 - 0.00% -
638.imagick_s (max) (percentage) -12.50% 0.160 0.140 - 0.00% -
603.bwaves_s (max) (percentage) -12.32% 1.380 1.210 - 0.00% -
625.x264_s (max) -11.76% 34.000 30.000 - 0.00% -
600.perlbench_s (max) -11.69% 77.000 68.000 - 0.00% -
620.omnetpp_s (max) (percentage) -10.39% 0.770 0.690 - 0.00% -
649.fotonik3d_s (max) (percentage) -10.09% 2.180 1.960 - 0.00% -
641.leela_s (max) -9.68% 31.000 28.000 - 0.00% -
603.bwaves_s (max) -9.24% 3323.000 3016.000 - 0.00% -
657.xz_s (max) (percentage) -8.36% 14.120 12.940 - 0.00% -
621.wrf_s (max) -7.94% 189.000 174.000 - 0.00% -
621.wrf_s (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
625.x264_s (max) (percentage) -7.32% 0.410 0.380 - 0.00% -
638.imagick_s -7.21% 208.000 193.000 - 0.00% -
638.imagick_s (avg) -7.21% 208.000 193.000 - 0.00% -
628.pop2_s (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
600.perlbench_s (max) (percentage) -6.82% 0.440 0.410 - 0.00% -
620.omnetpp_s (max) -5.69% 123.000 116.000 - 0.00% -
605.mcf_s (max) (percentage) -5.60% 3.390 3.200 - 0.00% -
600.perlbench_s -4.76% 63.000 60.000 - 0.00% -
600.perlbench_s (avg) -4.76% 63.000 60.000 - 0.00% -
644.nab_s (max) -4.43% 406.000 388.000 - 0.00% -
625.x264_s -4.00% 25.000 24.000 - 0.00% -
625.x264_s (avg) -4.00% 25.000 24.000 - 0.00% -
607.cactuBSSN_s (max) (percentage) -3.40% 1.470 1.420 - 0.00% -
648.exchange2_s (max) (percentage) -3.28% 0.610 0.590 - 0.00% -
628.pop2_s (max) -3.14% 223.000 216.000 - 0.00% -
654.roms_s (max) (percentage) -2.97% 2.020 1.960 - 0.00% -
602.gcc_s (max) -2.54% 946.000 922.000 - 0.00% -
644.nab_s -1.10% 182.000 180.000 - 0.00% -
644.nab_s (avg) -1.10% 182.000 180.000 - 0.00% -
631.deepsjeng_s (max) (percentage) -1.08% 1.860 1.840 - 0.00% -

Performance Improvements - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful 5.26% 19.000 20.000 - 0.00% -
nb_execution_successful 5.26% 19.000 20.000 - 0.00% -

Added Tests - Code Size
623.xalancbmk_s

Added Tests - Execution
623.xalancbmk_s

Added Tests - sample variability
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (max)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
607.cactuBSSN_s 18.57% 4214065.000 4996629.000 - 0.63% -
623.xalancbmk_s 8.54% 5497646.000 5967275.000 - 0.00% -
600.perlbench_s 7.90% 2404724.000 2594639.000 - 0.75% -
644.nab_s 7.52% 218975.000 235441.000 - -0.55% -
657.xz_s 7.51% 205531.000 220963.000 - 0.13% -
602.gcc_s 6.58% 10008387.000 10666511.000 - -0.10% -
631.deepsjeng_s 5.47% 95946.000 101190.000 - -0.39% -
638.imagick_s 4.85% 2221370.000 2329090.000 - 0.54% -
620.omnetpp_s 4.10% 2247854.000 2340013.000 - -0.20% -
641.leela_s 3.53% 202615.000 209764.000 - -0.42% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
657.xz_s 21.29% 122860.000 149011.000 - 15.17% -
649.fotonik3d_s 19.55% 62018.000 74144.000 - 18.01% -
605.mcf_s 16.12% 28627.000 33242.000 - 9.59% -
623.xalancbmk_s 15.70% 18160.000 21012.000 - 0.00% -
619.lbm_s 12.64% 39335.000 44308.000 - 12.67% -
648.exchange2_s 9.14% 7633.000 8331.000 - 9.73% -
602.gcc_s 7.32% 21380.000 22945.000 - 11.46% -
603.bwaves_s 4.22% 239232.000 249335.000 - 3.54% -
627.cam4_s 4.17% 99181.000 103317.000 - 2.78% -
620.omnetpp_s 1.84% 16595.000 16901.000 - 5.53% -
607.cactuBSSN_s 1.24% 106786.000 108107.000 - 5.30% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
619.lbm_s -17.86% 21250.000 17454.000 - -1.09% -
654.roms_s -11.08% 1075717.000 956545.000 - -0.74% -
605.mcf_s -5.86% 28789.000 27103.000 - 0.91% -
603.bwaves_s -1.95% 53831.000 52781.000 - -1.38% -
625.x264_s -1.69% 626778.000 616209.000 - 1.69% -
648.exchange2_s -1.00% 177422.000 175644.000 - 7.38% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
654.roms_s -59.57% 214456.000 86698.000 - 8.11% -
621.wrf_s -37.90% 112446.000 69825.000 - -0.30% -
628.pop2_s -20.65% 100834.000 80015.000 - 3.88% -
644.nab_s -13.70% 160803.000 138774.000 - -0.95% -
600.perlbench_s -7.19% 18097.000 16795.000 - -4.41% -
625.x264_s -5.28% 8578.000 8125.000 - -2.75% -
638.imagick_s -4.41% 202929.000 193989.000 - -7.18% -
641.leela_s -2.56% 13731.000 13380.000 - 6.13% -

Added Tests - sample variability
600.perlbench_s
600.perlbench_s (avg)
600.perlbench_s (avg) (percentage)
600.perlbench_s (max)
600.perlbench_s (max) (percentage)
602.gcc_s
602.gcc_s (avg)
602.gcc_s (avg) (percentage)
602.gcc_s (max)
602.gcc_s (max) (percentage)
603.bwaves_s
603.bwaves_s (avg)
603.bwaves_s (avg) (percentage)
603.bwaves_s (max)
603.bwaves_s (max) (percentage)
605.mcf_s
605.mcf_s (avg)
605.mcf_s (avg) (percentage)
605.mcf_s (max)
605.mcf_s (max) (percentage)
607.cactuBSSN_s
607.cactuBSSN_s (avg)
607.cactuBSSN_s (avg) (percentage)
607.cactuBSSN_s (max)
607.cactuBSSN_s (max) (percentage)
619.lbm_s
619.lbm_s (avg)
619.lbm_s (avg) (percentage)
619.lbm_s (max)
619.lbm_s (max) (percentage)
620.omnetpp_s
620.omnetpp_s (avg)
620.omnetpp_s (avg) (percentage)
620.omnetpp_s (max)
620.omnetpp_s (max) (percentage)
621.wrf_s
621.wrf_s (avg)
621.wrf_s (avg) (percentage)
621.wrf_s (max)
621.wrf_s (max) (percentage)
623.xalancbmk_s
623.xalancbmk_s (avg)
623.xalancbmk_s (avg) (percentage)
623.xalancbmk_s (max)
623.xalancbmk_s (max) (percentage)
625.x264_s
625.x264_s (avg)
625.x264_s (avg) (percentage)
625.x264_s (max)
625.x264_s (max) (percentage)
627.cam4_s
627.cam4_s (avg)
627.cam4_s (avg) (percentage)
627.cam4_s (max)
627.cam4_s (max) (percentage)
628.pop2_s
628.pop2_s (avg)
628.pop2_s (avg) (percentage)
628.pop2_s (max)
628.pop2_s (max) (percentage)
631.deepsjeng_s
631.deepsjeng_s (avg)
631.deepsjeng_s (avg) (percentage)
631.deepsjeng_s (max)
631.deepsjeng_s (max) (percentage)
638.imagick_s
638.imagick_s (avg)
638.imagick_s (avg) (percentage)
638.imagick_s (max)
638.imagick_s (max) (percentage)
641.leela_s
641.leela_s (avg)
641.leela_s (avg) (percentage)
641.leela_s (max)
641.leela_s (max) (percentage)
644.nab_s
644.nab_s (avg)
644.nab_s (avg) (percentage)
644.nab_s (max)
644.nab_s (max) (percentage)
648.exchange2_s
648.exchange2_s (avg)
648.exchange2_s (avg) (percentage)
648.exchange2_s (max)
648.exchange2_s (max) (percentage)
649.fotonik3d_s
649.fotonik3d_s (avg)
649.fotonik3d_s (avg) (percentage)
649.fotonik3d_s (max)
649.fotonik3d_s (max) (percentage)
654.roms_s
654.roms_s (avg)
654.roms_s (avg) (percentage)
654.roms_s (max)
654.roms_s (max) (percentage)
657.xz_s
657.xz_s (avg)
657.xz_s (avg) (percentage)
657.xz_s (max)
657.xz_s (max) (percentage)


Report Time: 0.23s
Name Current %
600.perlbench_s 16795.000 -4.41%
602.gcc_s 22945.000 11.46%
603.bwaves_s 249335.000 3.54%
605.mcf_s 33242.000 9.59%
607.cactuBSSN_s 108107.000 5.30%
619.lbm_s 44308.000 12.67%
620.omnetpp_s 16901.000 5.53%
621.wrf_s 69825.000 -
623.xalancbmk_s 21012.000 -
625.x264_s 8125.000 -2.75%
627.cam4_s 103317.000 2.78%
628.pop2_s 80015.000 3.88%
631.deepsjeng_s 12784.000 3.16%
638.imagick_s 193989.000 -7.18%
641.leela_s 13380.000 6.13%
644.nab_s 138774.000 -
648.exchange2_s 8331.000 9.73%
649.fotonik3d_s 74144.000 18.01%
654.roms_s 86698.000 8.11%
657.xz_s 149011.000 15.17%
Geometric Mean 44521.729 -
Name Current %
600.perlbench_s 2594639.000 -
602.gcc_s 10666511.000 -
603.bwaves_s 52781.000 -1.38%
605.mcf_s 27103.000 -
607.cactuBSSN_s 4996629.000 -
619.lbm_s 17454.000 -1.09%
620.omnetpp_s 2340013.000 -
621.wrf_s 20342541.000 1.53%
623.xalancbmk_s 5967275.000 -
625.x264_s 616209.000 1.69%
627.cam4_s 18984670.000 -
628.pop2_s 26276502.000 -
631.deepsjeng_s 101190.000 -
638.imagick_s 2329090.000 -
641.leela_s 209764.000 -
644.nab_s 235441.000 -
648.exchange2_s 175644.000 7.38%
649.fotonik3d_s 353614.000 -2.24%
654.roms_s 956545.000 -
657.xz_s 220963.000 -
Geometric Mean 857372.323 11.10%
Name Current %
nb_compile_successful 20.000 5.26%
nb_execution_successful 20.000 5.26%
nb_total_tests 20.000 -4.76%
Geometric Mean 20.000 1.81%
Name Current %
600.perlbench_s 60.000 -4.76%
600.perlbench_s (avg) 60.000 -4.76%
600.perlbench_s (avg) (percentage) 0.360 -
600.perlbench_s (max) 68.000 -11.69%
600.perlbench_s (max) (percentage) 0.410 -6.82%
602.gcc_s 477.000 11.45%
602.gcc_s (avg) 477.000 11.45%
602.gcc_s (avg) (percentage) 2.080 -
602.gcc_s (max) 922.000 -2.54%
602.gcc_s (max) (percentage) 4.020 -12.61%
603.bwaves_s 1271.000 3.50%
603.bwaves_s (avg) 1271.000 3.50%
603.bwaves_s (avg) (percentage) 0.510 -
603.bwaves_s (max) 3016.000 -9.24%
603.bwaves_s (max) (percentage) 1.210 -12.32%
605.mcf_s 651.000 9.60%
605.mcf_s (avg) 651.000 9.60%
605.mcf_s (avg) (percentage) 1.960 -
605.mcf_s (max) 1063.000 3.40%
605.mcf_s (max) (percentage) 3.200 -5.60%
607.cactuBSSN_s 713.000 5.32%
607.cactuBSSN_s (avg) 713.000 5.32%
607.cactuBSSN_s (avg) (percentage) 0.660 -
607.cactuBSSN_s (max) 1535.000 1.72%
607.cactuBSSN_s (max) (percentage) 1.420 -3.40%
619.lbm_s 137.000 13.22%
619.lbm_s (avg) 137.000 13.22%
619.lbm_s (avg) (percentage) 0.310 -
619.lbm_s (max) 8.000 14.29%
619.lbm_s (max) (percentage) 0.020 -
620.omnetpp_s 334.000 5.36%
620.omnetpp_s (avg) 334.000 5.36%
620.omnetpp_s (avg) (percentage) 1.980 -
620.omnetpp_s (max) 116.000 -5.69%
620.omnetpp_s (max) (percentage) 0.690 -10.39%
621.wrf_s 195.000 -
621.wrf_s (avg) 195.000 -
621.wrf_s (avg) (percentage) 0.280 -
621.wrf_s (max) 174.000 -7.94%
621.wrf_s (max) (percentage) 0.250 -7.41%
623.xalancbmk_s 346.000 -
623.xalancbmk_s (avg) 346.000 -
623.xalancbmk_s (avg) (percentage) 1.650 -
623.xalancbmk_s (max) 42.000 -
623.xalancbmk_s (max) (percentage) 0.200 -
625.x264_s 24.000 -4.00%
625.x264_s (avg) 24.000 -4.00%
625.x264_s (avg) (percentage) 0.300 -
625.x264_s (max) 30.000 -11.76%
625.x264_s (max) (percentage) 0.380 -7.32%
627.cam4_s 123.000 2.50%
627.cam4_s (avg) 123.000 2.50%
627.cam4_s (avg) (percentage) 0.120 -
627.cam4_s (max) 165.000 3.12%
627.cam4_s (max) (percentage) 0.160 -
628.pop2_s 176.000 4.14%
628.pop2_s (avg) 176.000 4.14%
628.pop2_s (avg) (percentage) 0.220 -
628.pop2_s (max) 216.000 -3.14%
628.pop2_s (max) (percentage) 0.270 -6.90%
631.deepsjeng_s 147.000 3.52%
631.deepsjeng_s (avg) 147.000 3.52%
631.deepsjeng_s (avg) (percentage) 1.150 -
631.deepsjeng_s (max) 235.000 2.17%
631.deepsjeng_s (max) (percentage) 1.840 -1.08%
638.imagick_s 193.000 -7.21%
638.imagick_s (avg) 193.000 -7.21%
638.imagick_s (avg) (percentage) 0.100 -
638.imagick_s (max) 271.000 -18.86%
638.imagick_s (max) (percentage) 0.140 -12.50%
641.leela_s 25.000 8.70%
641.leela_s (avg) 25.000 8.70%
641.leela_s (avg) (percentage) 0.190 -
641.leela_s (max) 28.000 -9.68%
641.leela_s (max) (percentage) 0.210 -16.00%
644.nab_s 180.000 -1.10%
644.nab_s (avg) 180.000 -1.10%
644.nab_s (avg) (percentage) 0.130 -
644.nab_s (max) 388.000 -4.43%
644.nab_s (max) (percentage) 0.280 -
648.exchange2_s 33.000 10.00%
648.exchange2_s (avg) 33.000 10.00%
648.exchange2_s (avg) (percentage) 0.400 -
648.exchange2_s (max) 49.000 6.52%
648.exchange2_s (max) (percentage) 0.590 -3.28%
649.fotonik3d_s 1342.000 18.03%
649.fotonik3d_s (avg) 1342.000 18.03%
649.fotonik3d_s (avg) (percentage) 1.810 -
649.fotonik3d_s (max) 1453.000 6.14%
649.fotonik3d_s (max) (percentage) 1.960 -10.09%
654.roms_s 1222.000 8.14%
654.roms_s (avg) 1222.000 8.14%
654.roms_s (avg) (percentage) 1.410 -
654.roms_s (max) 1699.000 4.94%
654.roms_s (max) (percentage) 1.960 -2.97%
657.xz_s 8106.000 15.17%
657.xz_s (avg) 8106.000 15.17%
657.xz_s (avg) (percentage) 5.440 -
657.xz_s (max) 19282.000 5.55%
657.xz_s (max) (percentage) 12.940 -8.36%
Geometric Mean 22.818 6.52%