Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=37afef6fe1378d671643624439e76453ade7c4af (unchanged) |
git_gcc | https://gcc.gnu.org/git/gcc.git (1b35b929354c41f3e2682aa7a30013e1bfe31bd4) (+ 1155 commits) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=e5893e6349541d871e8a25120bca014551d13ff5 (unchanged) |
git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/68b02c3ac18b9686154702eb4aa2e5327d35e3ac (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--gnu-aarch64-master-O3-build/489/ |
Filter
gnu-aarch64-master-O3 test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0489 (basepoints/gcc-15-05167-g1b35b929354) | 2025-02-28T00:37:39 | 0:00:00 |
Previous | 0487 (basepoints/gcc-15-04012-gba7632674a2a) | 2025-02-27T00:28:06 | 0:00:00 |
Baseline | 0002 (4-changed-components) | 2023-02-28T02:02:59 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 31 | 19 |
Performance Improvements | 53 | 17 |
Added Tests | 5 | 100 |
Unchanged Tests | 769 | 722 |
Total Tests | 858 |
Performance Regressions - Code Size | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
649.fotonik3d_s | 1.79% | 353422.000 | 359758.000 | - | 1.63% | - |
654.roms_s | 1.10% | 956577.000 | 967065.000 | - | -10.10% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
603.bwaves_s (unexplained diff vs previous) | 20787.80% | 41.000 | 8564.000 | - | 0.00% | - |
603.bwaves_s (unexplained diff vs previous) (percentage) | 17700.00% | 0.020 | 3.560 | - | 0.00% | - |
648.exchange2_s (unexplained diff vs previous) (percentage) | 3200.00% | 0.010 | 0.330 | - | 0.00% | - |
648.exchange2_s (unexplained diff vs previous) | 2600.00% | 1.000 | 27.000 | - | 0.00% | - |
623.xalancbmk_s (max) (percentage) | 1810.00% | 0.200 | 3.820 | - | 0.00% | - |
623.xalancbmk_s (max) | 1735.71% | 42.000 | 771.000 | - | 0.00% | - |
648.exchange2_s (max) | 420.00% | 5.000 | 26.000 | - | 0.00% | - |
648.exchange2_s (max) (percentage) | 357.14% | 0.070 | 0.320 | - | 0.00% | - |
603.bwaves_s (max) (percentage) | 211.82% | 1.100 | 3.430 | - | 0.00% | - |
603.bwaves_s (max) | 201.09% | 2743.000 | 8259.000 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) (percentage) | 143.62% | 4.470 | 10.890 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) (percentage) | 123.33% | 3.900 | 8.710 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) | 120.00% | 790.000 | 1738.000 | - | 0.00% | - |
619.lbm_s (max) (percentage) | 113.60% | 3.750 | 8.010 | - | 0.00% | - |
620.omnetpp_s (max) (percentage) | 110.28% | 4.670 | 9.820 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) | 105.35% | 1663.000 | 3415.000 | - | 0.00% | - |
619.lbm_s (max) | 96.50% | 1599.000 | 3142.000 | - | 0.00% | - |
620.omnetpp_s (max) | 89.59% | 826.000 | 1566.000 | - | 0.00% | - |
619.lbm_s (avg) (percentage) | 46.15% | 0.390 | 0.570 | - | 0.00% | - |
619.lbm_s | 34.34% | 166.000 | 223.000 | - | 0.00% | - |
619.lbm_s (avg) | 34.34% | 166.000 | 223.000 | - | 0.00% | - |
603.bwaves_s (avg) (percentage) | 16.00% | 0.500 | 0.580 | - | 0.00% | - |
603.bwaves_s | 12.04% | 1246.000 | 1396.000 | - | 0.00% | - |
603.bwaves_s (avg) | 12.04% | 1246.000 | 1396.000 | - | 0.00% | - |
620.omnetpp_s (avg) (percentage) | 7.84% | 2.040 | 2.200 | - | 0.00% | - |
623.xalancbmk_s (avg) (percentage) | 4.85% | 1.650 | 1.730 | - | 0.00% | - |
600.perlbench_s | 1.67% | 60.000 | 61.000 | - | 0.00% | - |
600.perlbench_s (avg) | 1.67% | 60.000 | 61.000 | - | 0.00% | - |
Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
nb_execution_successful | -5.00% | 20.000 | 19.000 | - | -5.00% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
628.pop2_s | -99.96% | 78292.000 | 28.000 | - | -99.97% | - |
620.omnetpp_s | -9.82% | 17691.000 | 15953.000 | - | -3.87% | - |
619.lbm_s | -8.01% | 42645.000 | 39230.000 | - | -0.27% | - |
641.leela_s | -6.08% | 13383.000 | 12569.000 | - | -8.46% | - |
607.cactuBSSN_s | -5.36% | 107984.000 | 102195.000 | - | -4.30% | - |
627.cam4_s | -4.54% | 106857.000 | 102008.000 | - | 2.85% | - |
605.mcf_s | -4.11% | 34002.000 | 32604.000 | - | 13.89% | - |
623.xalancbmk_s | -3.82% | 21006.000 | 20204.000 | - | 11.26% | - |
603.bwaves_s | -3.43% | 249376.000 | 240812.000 | - | 0.66% | - |
657.xz_s | -3.18% | 131839.000 | 127648.000 | - | 3.90% | - |
625.x264_s | -2.19% | 8143.000 | 7965.000 | - | -7.15% | - |
621.wrf_s | -1.80% | 69943.000 | 68683.000 | - | -38.92% | - |
602.gcc_s | -1.53% | 22947.000 | 22595.000 | - | 5.68% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
605.mcf_s (max) | -9.50% | 958.000 | 867.000 | - | 0.00% | - |
644.nab_s (max) (percentage) | -9.09% | 0.440 | 0.400 | - | 0.00% | - |
644.nab_s (max) | -8.73% | 607.000 | 554.000 | - | 0.00% | - |
657.xz_s (max) | -8.22% | 15952.000 | 14641.000 | - | 0.00% | - |
625.x264_s (max) | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
641.leela_s | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
641.leela_s (avg) | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
641.leela_s (max) | -8.00% | 25.000 | 23.000 | - | 0.00% | - |
602.gcc_s (max) | -7.70% | 844.000 | 779.000 | - | 0.00% | - |
607.cactuBSSN_s (max) | -7.44% | 1479.000 | 1369.000 | - | 0.00% | - |
625.x264_s (max) (percentage) | -6.45% | 0.310 | 0.290 | - | 0.00% | - |
602.gcc_s (max) (percentage) | -6.25% | 3.680 | 3.450 | - | 0.00% | - |
600.perlbench_s (max) | -6.06% | 66.000 | 62.000 | - | 0.00% | - |
621.wrf_s (max) | -5.99% | 167.000 | 157.000 | - | 0.00% | - |
605.mcf_s (max) (percentage) | -5.67% | 2.820 | 2.660 | - | 0.00% | - |
607.cactuBSSN_s | -5.28% | 701.000 | 664.000 | - | 0.00% | - |
607.cactuBSSN_s (avg) | -5.28% | 701.000 | 664.000 | - | 0.00% | - |
657.xz_s (max) (percentage) | -5.21% | 12.100 | 11.470 | - | 0.00% | - |
600.perlbench_s (max) (percentage) | -5.13% | 0.390 | 0.370 | - | 0.00% | - |
627.cam4_s | -4.69% | 128.000 | 122.000 | - | 0.00% | - |
627.cam4_s (avg) | -4.69% | 128.000 | 122.000 | - | 0.00% | - |
649.fotonik3d_s (max) | -4.63% | 1273.000 | 1214.000 | - | 0.00% | - |
627.cam4_s (max) | -4.38% | 160.000 | 153.000 | - | 0.00% | - |
649.fotonik3d_s (max) (percentage) | -4.37% | 1.830 | 1.750 | - | 0.00% | - |
625.x264_s | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
625.x264_s (avg) | -4.17% | 24.000 | 23.000 | - | 0.00% | - |
605.mcf_s | -4.04% | 669.000 | 642.000 | - | 0.00% | - |
605.mcf_s (avg) | -4.04% | 669.000 | 642.000 | - | 0.00% | - |
628.pop2_s (max) (percentage) | -3.85% | 0.260 | 0.250 | - | 0.00% | - |
657.xz_s | -3.18% | 7172.000 | 6944.000 | - | 0.00% | - |
657.xz_s (avg) | -3.18% | 7172.000 | 6944.000 | - | 0.00% | - |
620.omnetpp_s | -2.78% | 360.000 | 350.000 | - | 0.00% | - |
620.omnetpp_s (avg) | -2.78% | 360.000 | 350.000 | - | 0.00% | - |
607.cactuBSSN_s (max) (percentage) | -2.19% | 1.370 | 1.340 | - | 0.00% | - |
602.gcc_s | -1.68% | 477.000 | 469.000 | - | 0.00% | - |
602.gcc_s (avg) | -1.68% | 477.000 | 469.000 | - | 0.00% | - |
654.roms_s (max) (percentage) | -1.56% | 1.920 | 1.890 | - | 0.00% | - |
621.wrf_s | -1.54% | 195.000 | 192.000 | - | 0.00% | - |
621.wrf_s (avg) | -1.54% | 195.000 | 192.000 | - | 0.00% | - |
654.roms_s (max) | -1.37% | 1537.000 | 1516.000 | - | 0.00% | - |
Added Tests - sample variability |
---|
623.xalancbmk_s (unexplained diff vs previous) |
623.xalancbmk_s (unexplained diff vs previous) (percentage) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (max) |
Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
607.cactuBSSN_s | 18.97% | 4214065.000 | 5013401.000 | - | 0.34% | - |
623.xalancbmk_s | 8.65% | 5497646.000 | 5973175.000 | - | 0.10% | - |
600.perlbench_s | 8.40% | 2404724.000 | 2606759.000 | - | 0.46% | - |
657.xz_s | 7.49% | 205531.000 | 220915.000 | - | -0.00% | - |
644.nab_s | 7.41% | 218975.000 | 235193.000 | - | -0.11% | - |
602.gcc_s | 6.54% | 10008387.000 | 10662999.000 | - | -0.03% | - |
631.deepsjeng_s | 5.36% | 95946.000 | 101086.000 | - | -0.06% | - |
638.imagick_s | 4.75% | 2221370.000 | 2326802.000 | - | -0.54% | - |
620.omnetpp_s | 4.31% | 2247854.000 | 2344737.000 | - | 0.20% | - |
641.leela_s | 2.62% | 202615.000 | 207925.000 | - | -0.88% | - |
649.fotonik3d_s | 1.63% | 353975.000 | 359758.000 | - | 1.79% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
605.mcf_s | 13.89% | 28627.000 | 32604.000 | - | -4.11% | - |
649.fotonik3d_s | 11.94% | 62018.000 | 69425.000 | - | -0.21% | - |
623.xalancbmk_s | 11.26% | 18160.000 | 20204.000 | - | -3.82% | - |
648.exchange2_s | 8.78% | 7633.000 | 8303.000 | - | -0.32% | - |
602.gcc_s | 5.68% | 21380.000 | 22595.000 | - | -1.53% | - |
657.xz_s | 3.90% | 122860.000 | 127648.000 | - | -3.18% | - |
627.cam4_s | 2.85% | 99181.000 | 102008.000 | - | -4.54% | - |
Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
nb_execution_successful | -5.00% | 20.000 | 19.000 | - | -5.00% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
619.lbm_s | -17.86% | 21250.000 | 17454.000 | - | 0.00% | - |
654.roms_s | -10.10% | 1075717.000 | 967065.000 | - | 1.10% | - |
605.mcf_s | -5.86% | 28789.000 | 27103.000 | - | 0.00% | - |
603.bwaves_s | -2.01% | 53831.000 | 52749.000 | - | -0.06% | - |
625.x264_s | -1.54% | 626778.000 | 617153.000 | - | 0.15% | - |
648.exchange2_s | -1.00% | 177422.000 | 175640.000 | - | -0.00% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
628.pop2_s | -99.97% | 100834.000 | 28.000 | - | -99.96% | - |
654.roms_s | -62.59% | 214456.000 | 80220.000 | - | 0.14% | - |
621.wrf_s | -38.92% | 112446.000 | 68683.000 | - | -1.80% | - |
644.nab_s | -13.84% | 160803.000 | 138540.000 | - | 0.27% | - |
641.leela_s | -8.46% | 13731.000 | 12569.000 | - | -6.08% | - |
625.x264_s | -7.15% | 8578.000 | 7965.000 | - | -2.19% | - |
600.perlbench_s | -6.14% | 18097.000 | 16985.000 | - | 0.32% | - |
638.imagick_s | -4.60% | 202929.000 | 193586.000 | - | -0.19% | - |
607.cactuBSSN_s | -4.30% | 106786.000 | 102195.000 | - | -5.36% | - |
631.deepsjeng_s | -4.26% | 12764.000 | 12220.000 | - | 0.16% | - |
620.omnetpp_s | -3.87% | 16595.000 | 15953.000 | - | -9.82% | - |
Added Tests - sample variability |
---|
600.perlbench_s |
600.perlbench_s (avg) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) |
600.perlbench_s (max) (percentage) |
602.gcc_s |
602.gcc_s (avg) |
602.gcc_s (avg) (percentage) |
602.gcc_s (max) |
602.gcc_s (max) (percentage) |
603.bwaves_s |
603.bwaves_s (avg) |
603.bwaves_s (avg) (percentage) |
603.bwaves_s (max) |
603.bwaves_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
607.cactuBSSN_s |
607.cactuBSSN_s (avg) |
607.cactuBSSN_s (avg) (percentage) |
607.cactuBSSN_s (max) |
607.cactuBSSN_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
621.wrf_s |
621.wrf_s (avg) |
621.wrf_s (avg) (percentage) |
621.wrf_s (max) |
621.wrf_s (max) (percentage) |
623.xalancbmk_s |
623.xalancbmk_s (avg) |
623.xalancbmk_s (avg) (percentage) |
623.xalancbmk_s (max) |
623.xalancbmk_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
627.cam4_s |
627.cam4_s (avg) |
627.cam4_s (avg) (percentage) |
627.cam4_s (max) |
627.cam4_s (max) (percentage) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (avg) (percentage) |
628.pop2_s (max) |
628.pop2_s (max) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
648.exchange2_s |
648.exchange2_s (avg) |
648.exchange2_s (avg) (percentage) |
648.exchange2_s (max) |
648.exchange2_s (max) (percentage) |
649.fotonik3d_s |
649.fotonik3d_s (avg) |
649.fotonik3d_s (avg) (percentage) |
649.fotonik3d_s (max) |
649.fotonik3d_s (max) (percentage) |
654.roms_s |
654.roms_s (avg) |
654.roms_s (avg) (percentage) |
654.roms_s (max) |
654.roms_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
Report Time: 0.33s