Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=3622898cf318697604caba330884c26c1a043265 (+ 46 commits) |
git_gcc | https://gcc.gnu.org/git/gcc.git (a63b97e918b8592d0f6af94c5355efc82a49e06d) (+ 120 commits) |
git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=d1b27eeda3d92f33314e93537437cab11ddf4777 (+ 15 commits) |
git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/b0d369dbad20a8c9702607e7294d63c4a0c8e0fe (unchanged) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017fast--gnu-aarch64-master-O3_LTO-build/339/ |
Filter
gnu-aarch64-master-O3_LTO test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0339 (3-changed-components) | 2025-06-12T02:50:48 | 0:00:00 |
Previous | 0337 (4-changed-components) | 2025-06-06T18:57:46 | 0:00:00 |
Baseline | 0001 (4-changed-components) | 2023-03-05T09:27:13 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 38 | 17 |
Performance Improvements | 53 | 22 |
Added Tests | 20 | 116 |
Unchanged Tests | 867 | 823 |
Total Tests | 978 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
627.cam4_s | 5.34% | 131.000 | 138.000 | - | 0.00% | - |
607.cactuBSSN_s | 2.49% | 4936.000 | 5059.000 | - | 5.44% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
508.namd_r (unexplained diff vs previous) (percentage) | 1550.00% | 0.040 | 0.660 | - | 0.00% | - |
508.namd_r (unexplained diff vs previous) | 1500.00% | 1.000 | 16.000 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) (percentage) | 550.00% | 0.020 | 0.130 | - | 0.00% | - |
619.lbm_s (unexplained diff vs previous) | 533.33% | 6.000 | 38.000 | - | 0.00% | - |
511.povray_r (max) | 250.00% | 2.000 | 7.000 | - | 0.00% | - |
649.fotonik3d_s (unexplained diff vs previous) | 233.33% | 3.000 | 10.000 | - | 0.00% | - |
649.fotonik3d_s (unexplained diff vs previous) (percentage) | 233.33% | 0.030 | 0.100 | - | 0.00% | - |
511.povray_r (max) (percentage) | 192.11% | 0.760 | 2.220 | - | 0.00% | - |
625.x264_s (max) | 175.00% | 4.000 | 11.000 | - | 0.00% | - |
648.exchange2_s (max) | 166.67% | 3.000 | 8.000 | - | 0.00% | - |
648.exchange2_s (unexplained diff vs previous) | 166.67% | 3.000 | 8.000 | - | 0.00% | - |
648.exchange2_s (max) (percentage) | 165.22% | 0.230 | 0.610 | - | 0.00% | - |
648.exchange2_s (unexplained diff vs previous) (percentage) | 165.22% | 0.230 | 0.610 | - | 0.00% | - |
625.x264_s (max) (percentage) | 147.22% | 0.360 | 0.890 | - | 0.00% | - |
607.cactuBSSN_s (max) | 131.48% | 54.000 | 125.000 | - | 0.00% | - |
607.cactuBSSN_s (max) (percentage) | 124.32% | 1.110 | 2.490 | - | 0.00% | - |
619.lbm_s (max) | 46.15% | 26.000 | 38.000 | - | 0.00% | - |
619.lbm_s (max) (percentage) | 44.44% | 0.090 | 0.130 | - | 0.00% | - |
628.pop2_s (max) (percentage) | 39.58% | 0.480 | 0.670 | - | 0.00% | - |
628.pop2_s (max) | 38.30% | 47.000 | 65.000 | - | 0.00% | - |
623.xalancbmk_s (max) (percentage) | 27.96% | 0.930 | 1.190 | - | 0.00% | - |
623.xalancbmk_s (max) | 27.59% | 29.000 | 37.000 | - | 0.00% | - |
620.omnetpp_s (max) | 20.83% | 24.000 | 29.000 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) | 20.83% | 24.000 | 29.000 | - | 0.00% | - |
620.omnetpp_s (unexplained diff vs previous) (percentage) | 20.00% | 0.600 | 0.720 | - | 0.00% | - |
620.omnetpp_s (max) (percentage) | 19.67% | 0.610 | 0.730 | - | 0.00% | - |
627.cam4_s (max) | 12.50% | 8.000 | 9.000 | - | 0.00% | - |
627.cam4_s | 7.14% | 14.000 | 15.000 | - | 0.00% | - |
627.cam4_s (avg) | 7.14% | 14.000 | 15.000 | - | 0.00% | - |
508.namd_r (max) | 6.67% | 15.000 | 16.000 | - | 0.00% | - |
511.povray_r (avg) (percentage) | 3.81% | 1.050 | 1.090 | - | 0.00% | - |
508.namd_r (max) (percentage) | 3.08% | 0.650 | 0.670 | - | 0.00% | - |
648.exchange2_s (avg) (percentage) | 2.33% | 0.430 | 0.440 | - | 0.00% | - |
621.wrf_s (max) | 1.64% | 61.000 | 62.000 | - | 0.00% | - |
607.cactuBSSN_s | 1.35% | 148.000 | 150.000 | - | 0.00% | - |
607.cactuBSSN_s (avg) | 1.35% | 148.000 | 150.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
511.povray_r | -2.22% | 361.000 | 353.000 | - | -5.36% | - |
644.nab_s | -1.31% | 10289.000 | 10154.000 | - | -0.39% | - |
623.xalancbmk_s | -1.19% | 3205.000 | 3167.000 | - | -7.04% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
631.deepsjeng_s (unexplained diff vs previous) (percentage) | -57.69% | 0.260 | 0.110 | - | 0.00% | - |
631.deepsjeng_s (unexplained diff vs previous) | -55.56% | 9.000 | 4.000 | - | 0.00% | - |
657.xz_s (max) (percentage) | -15.38% | 0.390 | 0.330 | - | 0.00% | - |
657.xz_s (max) | -12.50% | 8.000 | 7.000 | - | 0.00% | - |
603.bwaves_s (max) (percentage) | -8.26% | 2.300 | 2.110 | - | 0.00% | - |
603.bwaves_s (max) | -8.21% | 207.000 | 190.000 | - | 0.00% | - |
625.x264_s | -7.14% | 14.000 | 13.000 | - | 0.00% | - |
625.x264_s (avg) | -7.14% | 14.000 | 13.000 | - | 0.00% | - |
654.roms_s (max) | -6.93% | 101.000 | 94.000 | - | 0.00% | - |
654.roms_s (max) (percentage) | -6.82% | 0.440 | 0.410 | - | 0.00% | - |
649.fotonik3d_s (max) | -6.67% | 105.000 | 98.000 | - | 0.00% | - |
649.fotonik3d_s (max) (percentage) | -6.42% | 1.090 | 1.020 | - | 0.00% | - |
510.parest_r (max) (percentage) | -5.43% | 0.920 | 0.870 | - | 0.00% | - |
644.nab_s (max) | -5.08% | 118.000 | 112.000 | - | 0.00% | - |
510.parest_r (max) | -4.08% | 49.000 | 47.000 | - | 0.00% | - |
641.leela_s (max) (percentage) | -3.85% | 0.520 | 0.500 | - | 0.00% | - |
641.leela_s | -3.85% | 26.000 | 25.000 | - | 0.00% | - |
641.leela_s (avg) | -3.85% | 26.000 | 25.000 | - | 0.00% | - |
510.parest_r (avg) (percentage) | -3.52% | 2.270 | 2.190 | - | 0.00% | - |
644.nab_s (max) (percentage) | -3.48% | 1.150 | 1.110 | - | 0.00% | - |
510.parest_r | -3.25% | 123.000 | 119.000 | - | 0.00% | - |
510.parest_r (avg) | -3.25% | 123.000 | 119.000 | - | 0.00% | - |
649.fotonik3d_s | -2.69% | 186.000 | 181.000 | - | 0.00% | - |
649.fotonik3d_s (avg) | -2.69% | 186.000 | 181.000 | - | 0.00% | - |
654.roms_s (avg) (percentage) | -2.65% | 3.770 | 3.670 | - | 0.00% | - |
654.roms_s | -2.64% | 872.000 | 849.000 | - | 0.00% | - |
654.roms_s (avg) | -2.64% | 872.000 | 849.000 | - | 0.00% | - |
641.leela_s (avg) (percentage) | -2.60% | 0.770 | 0.750 | - | 0.00% | - |
649.fotonik3d_s (avg) (percentage) | -2.59% | 1.930 | 1.880 | - | 0.00% | - |
657.xz_s (avg) (percentage) | -2.58% | 1.550 | 1.510 | - | 0.00% | - |
631.deepsjeng_s (avg) (percentage) | -2.54% | 1.180 | 1.150 | - | 0.00% | - |
631.deepsjeng_s | -2.44% | 41.000 | 40.000 | - | 0.00% | - |
631.deepsjeng_s (avg) | -2.44% | 41.000 | 40.000 | - | 0.00% | - |
603.bwaves_s | -2.34% | 171.000 | 167.000 | - | 0.00% | - |
603.bwaves_s (avg) | -2.34% | 171.000 | 167.000 | - | 0.00% | - |
603.bwaves_s (avg) (percentage) | -2.11% | 1.900 | 1.860 | - | 0.00% | - |
605.mcf_s (max) (percentage) | -2.11% | 0.950 | 0.930 | - | 0.00% | - |
631.deepsjeng_s (max) (percentage) | -1.96% | 0.510 | 0.500 | - | 0.00% | - |
605.mcf_s (avg) (percentage) | -1.83% | 1.640 | 1.610 | - | 0.00% | - |
619.lbm_s | -1.78% | 1070.000 | 1051.000 | - | 0.00% | - |
619.lbm_s (avg) | -1.78% | 1070.000 | 1051.000 | - | 0.00% | - |
605.mcf_s (max) | -1.72% | 58.000 | 57.000 | - | 0.00% | - |
628.pop2_s | -1.72% | 58.000 | 57.000 | - | 0.00% | - |
628.pop2_s (avg) | -1.72% | 58.000 | 57.000 | - | 0.00% | - |
619.lbm_s (avg) (percentage) | -1.67% | 3.600 | 3.540 | - | 0.00% | - |
526.blender_r (max) | -1.45% | 69.000 | 68.000 | - | 0.00% | - |
526.blender_r (max) (percentage) | -1.41% | 0.710 | 0.700 | - | 0.00% | - |
644.nab_s | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
644.nab_s (avg) | -1.35% | 74.000 | 73.000 | - | 0.00% | - |
620.omnetpp_s (avg) (percentage) | -1.11% | 1.800 | 1.780 | - | 0.00% | - |
Added Tests - sample variability |
---|
510.parest_r (unexplained diff vs previous) |
510.parest_r (unexplained diff vs previous) (percentage) |
511.povray_r (unexplained diff vs previous) |
511.povray_r (unexplained diff vs previous) (percentage) |
603.bwaves_s (unexplained diff vs previous) |
603.bwaves_s (unexplained diff vs previous) (percentage) |
605.mcf_s (unexplained diff vs previous) |
605.mcf_s (unexplained diff vs previous) (percentage) |
607.cactuBSSN_s (unexplained diff vs previous) |
607.cactuBSSN_s (unexplained diff vs previous) (percentage) |
623.xalancbmk_s (unexplained diff vs previous) |
623.xalancbmk_s (unexplained diff vs previous) (percentage) |
625.x264_s (unexplained diff vs previous) |
625.x264_s (unexplained diff vs previous) (percentage) |
628.pop2_s (unexplained diff vs previous) |
628.pop2_s (unexplained diff vs previous) (percentage) |
654.roms_s (unexplained diff vs previous) |
654.roms_s (unexplained diff vs previous) (percentage) |
657.xz_s (unexplained diff vs previous) |
657.xz_s (unexplained diff vs previous) (percentage) |
Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
508.namd_r | 14.27% | 707624.000 | 808594.000 | - | 0.00% | - |
526.blender_r | 14.11% | 11474556.000 | 13093242.000 | - | 0.06% | - |
657.xz_s | 10.73% | 150385.000 | 166521.000 | - | 0.00% | - |
607.cactuBSSN_s | 7.69% | 3684442.000 | 3967731.000 | - | 0.00% | - |
600.perlbench_s | 7.35% | 2649560.000 | 2844195.000 | - | -0.00% | - |
648.exchange2_s | 5.73% | 164878.000 | 174320.000 | - | 0.00% | - |
605.mcf_s | 5.31% | 23365.000 | 24605.000 | - | 0.00% | - |
623.xalancbmk_s | 4.44% | 3748643.000 | 3915062.000 | - | 0.00% | - |
602.gcc_s | 2.98% | 10139438.000 | 10441474.000 | - | 0.20% | - |
510.parest_r | 2.80% | 1733486.000 | 1781959.000 | - | 0.00% | - |
628.pop2_s | 1.99% | 3413948.000 | 3481725.000 | - | 0.00% | - |
511.povray_r | 1.69% | 1093239.000 | 1111767.000 | - | 0.00% | - |
631.deepsjeng_s | 1.61% | 84996.000 | 86368.000 | - | 0.00% | - |
638.imagick_s | 1.40% | 1700122.000 | 1723886.000 | - | 0.00% | - |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
607.cactuBSSN_s | 5.44% | 4798.000 | 5059.000 | - | 2.49% | - |
620.omnetpp_s | 2.06% | 3937.000 | 4018.000 | - | 0.73% | - |
631.deepsjeng_s | 1.69% | 3425.000 | 3483.000 | - | 0.11% | - |
Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
625.x264_s | -4.39% | 646275.000 | 617913.000 | - | 0.00% | - |
649.fotonik3d_s | -3.62% | 343226.000 | 330816.000 | - | 0.00% | - |
654.roms_s | -2.56% | 863494.000 | 841413.000 | - | 0.00% | - |
620.omnetpp_s | -1.78% | 1922167.000 | 1888013.000 | - | 0.00% | - |
603.bwaves_s | -1.71% | 52595.000 | 51695.000 | - | 0.00% | - |
619.lbm_s | -1.67% | 13445.000 | 13221.000 | - | 0.00% | - |
641.leela_s | -1.33% | 108742.000 | 107297.000 | - | 0.00% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
625.x264_s | -18.02% | 1626.000 | 1333.000 | - | -0.89% | - |
600.perlbench_s | -7.95% | 2152.000 | 1981.000 | - | -1.00% | - |
648.exchange2_s | -7.38% | 1422.000 | 1317.000 | - | 0.61% | - |
623.xalancbmk_s | -7.04% | 3407.000 | 3167.000 | - | -1.19% | - |
638.imagick_s | -6.59% | 3368.000 | 3146.000 | - | 0.06% | - |
657.xz_s | -5.69% | 2319.000 | 2187.000 | - | 0.05% | - |
511.povray_r | -5.36% | 373.000 | 353.000 | - | -2.22% | - |
641.leela_s | -5.10% | 3605.000 | 3421.000 | - | -0.09% | - |
649.fotonik3d_s | -4.16% | 10088.000 | 9668.000 | - | 0.10% | - |
654.roms_s | -3.69% | 24034.000 | 23147.000 | - | 0.07% | - |
628.pop2_s | -3.16% | 10109.000 | 9790.000 | - | -0.67% | - |
605.mcf_s | -2.78% | 6394.000 | 6216.000 | - | 0.42% | - |
602.gcc_s | -2.23% | 4126.000 | 4034.000 | - | -0.05% | - |
526.blender_r | -1.49% | 9950.000 | 9802.000 | - | 0.22% | - |
621.wrf_s | -1.44% | 6687.000 | 6591.000 | - | 1.00% | - |
Added Tests - Execution |
---|
627.cam4_s |
Added Tests - sample variability |
---|
508.namd_r |
508.namd_r (avg) |
508.namd_r (avg) (percentage) |
508.namd_r (max) |
508.namd_r (max) (percentage) |
510.parest_r |
510.parest_r (avg) |
510.parest_r (avg) (percentage) |
510.parest_r (max) |
510.parest_r (max) (percentage) |
511.povray_r |
511.povray_r (avg) |
511.povray_r (avg) (percentage) |
511.povray_r (max) |
511.povray_r (max) (percentage) |
526.blender_r |
526.blender_r (avg) |
526.blender_r (avg) (percentage) |
526.blender_r (max) |
526.blender_r (max) (percentage) |
600.perlbench_s |
600.perlbench_s (avg) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) |
600.perlbench_s (max) (percentage) |
603.bwaves_s |
603.bwaves_s (avg) |
603.bwaves_s (avg) (percentage) |
603.bwaves_s (max) |
603.bwaves_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
607.cactuBSSN_s |
607.cactuBSSN_s (avg) |
607.cactuBSSN_s (avg) (percentage) |
607.cactuBSSN_s (max) |
607.cactuBSSN_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
621.wrf_s |
621.wrf_s (avg) |
621.wrf_s (avg) (percentage) |
621.wrf_s (max) |
621.wrf_s (max) (percentage) |
623.xalancbmk_s |
623.xalancbmk_s (avg) |
623.xalancbmk_s (avg) (percentage) |
623.xalancbmk_s (max) |
623.xalancbmk_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
627.cam4_s |
627.cam4_s (avg) |
627.cam4_s (avg) (percentage) |
627.cam4_s (max) |
627.cam4_s (max) (percentage) |
628.pop2_s |
628.pop2_s (avg) |
628.pop2_s (avg) (percentage) |
628.pop2_s (max) |
628.pop2_s (max) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
648.exchange2_s |
648.exchange2_s (avg) |
648.exchange2_s (avg) (percentage) |
648.exchange2_s (max) |
648.exchange2_s (max) (percentage) |
649.fotonik3d_s |
649.fotonik3d_s (avg) |
649.fotonik3d_s (avg) (percentage) |
649.fotonik3d_s (max) |
649.fotonik3d_s (max) (percentage) |
654.roms_s |
654.roms_s (avg) |
654.roms_s (avg) (percentage) |
654.roms_s (max) |
654.roms_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
Report Time: 0.36s