Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/af68927a831c45b92248b1f6fc24d445be42dd91 (+ 644 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/311/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0311 (llvmorg-21-init-02961-gaf68927a831c) | 2025-02-21T20:08:37 | 0:00:00 |
| Previous | 0308 (llvmorg-21-init-02317-g8fc03e4ff1b3) | 2025-02-18T01:27:15 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 81 | 9 |
| Performance Improvements | 16 | 15 |
| Added Tests | 20 | 120 |
| Unchanged Tests | 693 | 666 |
| Total Tests | 810 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | 70.78% | 29063.000 | 49633.000 | - | 15.50% | - |
| 657.xz_s | 28.04% | 2379.000 | 3046.000 | - | 3.36% | - |
| 654.roms_s | 23.32% | 38734.000 | 47768.000 | - | 0.00% | - |
| 649.fotonik3d_s | 22.99% | 12562.000 | 15450.000 | - | 0.00% | - |
| 638.imagick_s | 13.14% | 3257.000 | 3685.000 | - | 7.94% | - |
| 605.mcf_s | 12.38% | 6487.000 | 7290.000 | - | 14.23% | - |
| 620.omnetpp_s | 12.07% | 4442.000 | 4978.000 | - | 0.00% | - |
| 510.parest_r | 9.76% | 6150.000 | 6750.000 | - | 0.00% | - |
| 602.gcc_s | 8.84% | 6334.000 | 6894.000 | - | 7.27% | - |
| 600.perlbench_s | 6.91% | 3400.000 | 3635.000 | - | 3.06% | - |
| 508.namd_r | 6.02% | 2722.000 | 2886.000 | - | 6.77% | - |
| 631.deepsjeng_s | 4.38% | 4291.000 | 4479.000 | - | -0.82% | - |
| 625.x264_s | 4.02% | 4929.000 | 5127.000 | - | 4.31% | - |
| 641.leela_s | 3.54% | 4607.000 | 4770.000 | - | 0.00% | - |
| 526.blender_r | 1.74% | 11231.000 | 11426.000 | - | 10.60% | - |
| 644.nab_s | 1.71% | 11432.000 | 11628.000 | - | 0.99% | - |
| 511.povray_r | 1.52% | 525.000 | 533.000 | - | 0.19% | - |
| 623.xalancbmk_s | 1.05% | 7431.000 | 7509.000 | - | 0.00% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 625.x264_s (max) | 2188.89% | 9.000 | 206.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 2015.79% | 0.190 | 4.020 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | 1415.91% | 44.000 | 667.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | 1083.78% | 1.850 | 21.900 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | 918.75% | 16.000 | 163.000 | - | 0.00% | - |
| 641.leela_s (max) | 888.24% | 17.000 | 168.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 877.14% | 0.350 | 3.420 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | 856.76% | 0.370 | 3.540 | - | 0.00% | - |
| 510.parest_r (max) | 743.59% | 78.000 | 658.000 | - | 0.00% | - |
| 619.lbm_s (max) | 722.91% | 4269.000 | 35130.000 | - | 0.00% | - |
| 657.xz_s (max) | 690.74% | 108.000 | 854.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | 662.50% | 1.280 | 9.760 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) | 650.00% | 80.000 | 600.000 | - | 0.00% | - |
| 605.mcf_s (max) | 615.87% | 126.000 | 902.000 | - | 0.00% | - |
| 510.parest_r (unexplained diff vs previous) (percentage) | 583.85% | 1.300 | 8.890 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 534.87% | 1.950 | 12.380 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 522.48% | 129.000 | 803.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | 513.57% | 4.570 | 28.040 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 453.77% | 1.990 | 11.020 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 396.14% | 4146.000 | 20570.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 381.82% | 14.690 | 70.780 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 190.40% | 14.270 | 41.440 | - | 0.00% | - |
| 619.lbm_s | 111.28% | 1339.000 | 2829.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 111.28% | 1339.000 | 2829.000 | - | 0.00% | - |
| 510.parest_r | 80.00% | 25.000 | 45.000 | - | 0.00% | - |
| 510.parest_r (avg) | 80.00% | 25.000 | 45.000 | - | 0.00% | - |
| 657.xz_s | 75.76% | 33.000 | 58.000 | - | 0.00% | - |
| 657.xz_s (avg) | 75.76% | 33.000 | 58.000 | - | 0.00% | - |
| 510.parest_r (avg) (percentage) | 59.52% | 0.420 | 0.670 | - | 0.00% | - |
| 625.x264_s | 50.00% | 10.000 | 15.000 | - | 0.00% | - |
| 625.x264_s (avg) | 50.00% | 10.000 | 15.000 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 42.86% | 0.210 | 0.300 | - | 0.00% | - |
| 605.mcf_s | 38.89% | 54.000 | 75.000 | - | 0.00% | - |
| 605.mcf_s (avg) | 38.89% | 54.000 | 75.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | 37.41% | 1.390 | 1.910 | - | 0.00% | - |
| 641.leela_s | 28.57% | 14.000 | 18.000 | - | 0.00% | - |
| 641.leela_s (avg) | 28.57% | 14.000 | 18.000 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | 23.81% | 0.840 | 1.040 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 23.64% | 4.610 | 5.700 | - | 0.00% | - |
| 649.fotonik3d_s | 23.36% | 244.000 | 301.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 23.36% | 244.000 | 301.000 | - | 0.00% | - |
| 654.roms_s | 23.30% | 631.000 | 778.000 | - | 0.00% | - |
| 654.roms_s (avg) | 23.30% | 631.000 | 778.000 | - | 0.00% | - |
| 641.leela_s (avg) (percentage) | 21.88% | 0.320 | 0.390 | - | 0.00% | - |
| 649.fotonik3d_s (max) | 20.11% | 900.000 | 1081.000 | - | 0.00% | - |
| 654.roms_s (max) | 19.21% | 1390.000 | 1657.000 | - | 0.00% | - |
| 620.omnetpp_s | 13.04% | 46.000 | 52.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 13.04% | 46.000 | 52.000 | - | 0.00% | - |
| 638.imagick_s | 11.11% | 36.000 | 40.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 11.11% | 36.000 | 40.000 | - | 0.00% | - |
| 508.namd_r | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 508.namd_r (avg) | 9.09% | 11.000 | 12.000 | - | 0.00% | - |
| 638.imagick_s (max) | 8.11% | 37.000 | 40.000 | - | 0.00% | - |
| 631.deepsjeng_s | 6.67% | 15.000 | 16.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 6.67% | 15.000 | 16.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | 5.56% | 54.000 | 57.000 | - | 0.00% | - |
| 600.perlbench_s | 4.55% | 22.000 | 23.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | 4.55% | 22.000 | 23.000 | - | 0.00% | - |
| 526.blender_r | 2.38% | 42.000 | 43.000 | - | 0.00% | - |
| 526.blender_r (avg) | 2.38% | 42.000 | 43.000 | - | 0.00% | - |
| 644.nab_s | 1.32% | 76.000 | 77.000 | - | 0.00% | - |
| 644.nab_s (avg) | 1.32% | 76.000 | 77.000 | - | 0.00% | - |
| Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_total_tests | -16.67% | 30.000 | 25.000 | - | 4.17% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s (max) (percentage) | -10.64% | 0.470 | 0.420 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -10.00% | 20.000 | 18.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -9.52% | 1.680 | 1.520 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -5.74% | 1.220 | 1.150 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -4.72% | 1.060 | 1.010 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -4.62% | 1.300 | 1.240 | - | 0.00% | - |
| 508.namd_r (max) | -4.44% | 45.000 | 43.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -4.42% | 5.430 | 5.190 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -4.35% | 1.150 | 1.100 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -3.34% | 3.590 | 3.470 | - | 0.00% | - |
| 644.nab_s (max) | -3.31% | 121.000 | 117.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -2.56% | 0.390 | 0.380 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -2.37% | 7.170 | 7.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -1.63% | 1.230 | 1.210 | - | 0.00% | - |
| Performance Improvements - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| nb_compile_successful | 27.78% | 18.000 | 23.000 | - | 64.29% | - |
| nb_execution_successful | 22.22% | 18.000 | 22.000 | - | 83.33% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 621.wrf_s |
| 628.pop2_s |
| 648.exchange2_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 621.wrf_s |
| 627.cam4_s |
| 628.pop2_s |
| 648.exchange2_s |
| Added Tests - sample variability |
|---|
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (max) |
| 625.x264_s (unexplained diff vs previous) |
| 625.x264_s (unexplained diff vs previous) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (max) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (max) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | 15.50% | 42973.000 | 49633.000 | - | 70.78% | - |
| 605.mcf_s | 14.23% | 6382.000 | 7290.000 | - | 12.38% | - |
| 526.blender_r | 10.60% | 10331.000 | 11426.000 | - | 1.74% | - |
| 638.imagick_s | 7.94% | 3414.000 | 3685.000 | - | 13.14% | - |
| 602.gcc_s | 7.27% | 6427.000 | 6894.000 | - | 8.84% | - |
| 508.namd_r | 6.77% | 2703.000 | 2886.000 | - | 6.02% | - |
| 625.x264_s | 4.31% | 4915.000 | 5127.000 | - | 4.02% | - |
| 657.xz_s | 3.36% | 2947.000 | 3046.000 | - | 28.04% | - |
| 600.perlbench_s | 3.06% | 3527.000 | 3635.000 | - | 6.91% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -6.49% | 59343.000 | 55491.000 | - | -0.17% | - |
| 602.gcc_s | -3.65% | 6613082.000 | 6371714.000 | - | 0.01% | - |
| 644.nab_s | -3.01% | 82210.000 | 79735.000 | - | 0.03% | - |
| 511.povray_r | -2.92% | 692391.000 | 672153.000 | - | 0.03% | - |
| 605.mcf_s | -2.80% | 14136.000 | 13740.000 | - | 0.00% | - |
| 600.perlbench_s | -2.62% | 1727039.000 | 1681739.000 | - | -0.00% | - |
| 638.imagick_s | -2.62% | 957572.000 | 932478.000 | - | 0.01% | - |
| 657.xz_s | -2.46% | 107659.000 | 105015.000 | - | 0.00% | - |
| 526.blender_r | -2.28% | 10533211.000 | 10292633.000 | - | -0.00% | - |
| 625.x264_s | -1.34% | 362800.000 | 357948.000 | - | 0.00% | - |
| 508.namd_r | -1.29% | 326657.000 | 322445.000 | - | -0.22% | - |
| 619.lbm_s | -1.10% | 13782.000 | 13630.000 | - | 0.00% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 83.33% | 12.000 | 22.000 | - | 22.22% | - |
| nb_compile_successful | 64.29% | 14.000 | 23.000 | - | 27.78% | - |
| nb_total_tests | 4.17% | 24.000 | 25.000 | - | -16.67% | - |
| Added Tests - Code Size |
|---|
| 510.parest_r |
| 603.bwaves_s |
| 620.omnetpp_s |
| 621.wrf_s |
| 623.xalancbmk_s |
| 628.pop2_s |
| 641.leela_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - Execution |
|---|
| 510.parest_r |
| 603.bwaves_s |
| 620.omnetpp_s |
| 621.wrf_s |
| 623.xalancbmk_s |
| 627.cam4_s |
| 628.pop2_s |
| 641.leela_s |
| 648.exchange2_s |
| 649.fotonik3d_s |
| 654.roms_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 510.parest_r (unexplained diff vs previous) |
| 510.parest_r (unexplained diff vs previous) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 641.leela_s (unexplained diff vs previous) |
| 641.leela_s (unexplained diff vs previous) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.34s