Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/4551e5035565606eb04253a35f31d51685657436 (+ 448 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Oz_LTO-build/359/ |
Filter
llvm-aarch64-master-Oz_LTO test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0359 (llvmorg-21-init-15187-g4551e5035565) | 2025-06-07T20:04:51 | 0:00:00 |
| Previous | 0358 (llvmorg-21-init-14739-g392bd577e37d) | 2025-06-03T07:20:20 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03810-g04a9c62554cf) | 2023-03-03T19:15:36 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 14 | 3 |
| Performance Improvements | 39 | 18 |
| Added Tests | 10 | 85 |
| Unchanged Tests | 627 | 584 |
| Total Tests | 690 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 638.imagick_s | 3.16% | 3258.000 | 3361.000 | - | -1.55% | - |
| 526.blender_r | 1.57% | 10813.000 | 10983.000 | - | 6.31% | - |
| 623.xalancbmk_s | 1.42% | 7322.000 | 7426.000 | - | 0.00% | - |
| 602.gcc_s | 1.30% | 6254.000 | 6335.000 | - | -1.43% | - |
| 508.namd_r | 1.12% | 2667.000 | 2697.000 | - | -0.22% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s (unexplained diff vs previous) (percentage) | 15.03% | 3.260 | 3.750 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 11.01% | 1008.000 | 1119.000 | - | 0.00% | - |
| 508.namd_r | 7.14% | 14.000 | 15.000 | - | 0.00% | - |
| 508.namd_r (avg) | 7.14% | 14.000 | 15.000 | - | 0.00% | - |
| 638.imagick_s | 2.86% | 35.000 | 36.000 | - | 0.00% | - |
| 638.imagick_s (avg) | 2.86% | 35.000 | 36.000 | - | 0.00% | - |
| 620.omnetpp_s | 2.27% | 44.000 | 45.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | 2.27% | 44.000 | 45.000 | - | 0.00% | - |
| 638.imagick_s (max) | 1.75% | 57.000 | 58.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 619.lbm_s | -3.61% | 30957.000 | 29838.000 | - | -30.57% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s (max) (percentage) | -43.48% | 0.460 | 0.260 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -42.11% | 19.000 | 11.000 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) (percentage) | -26.00% | 1.500 | 1.110 | - | 0.00% | - |
| 508.namd_r (unexplained diff vs previous) | -25.00% | 40.000 | 30.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | -12.16% | 1.480 | 1.300 | - | 0.00% | - |
| 508.namd_r (max) | -10.26% | 39.000 | 35.000 | - | 0.00% | - |
| 619.lbm_s (max) | -9.12% | 2216.000 | 2014.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -7.34% | 1.090 | 1.010 | - | 0.00% | - |
| 605.mcf_s (max) | -6.38% | 94.000 | 88.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | -6.25% | 1.440 | 1.350 | - | 0.00% | - |
| 641.leela_s (max) | -6.12% | 49.000 | 46.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -5.99% | 1.670 | 1.570 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -5.73% | 7.160 | 6.750 | - | 0.00% | - |
| 644.nab_s (max) | -5.26% | 190.000 | 180.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -5.18% | 5.020 | 4.760 | - | 0.00% | - |
| 657.xz_s (max) | -4.96% | 121.000 | 115.000 | - | 0.00% | - |
| 619.lbm_s | -4.23% | 1987.000 | 1903.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -4.23% | 1987.000 | 1903.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | -3.68% | 1.360 | 1.310 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -3.65% | 1.370 | 1.320 | - | 0.00% | - |
| 620.omnetpp_s (max) | -3.33% | 60.000 | 58.000 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -2.94% | 0.340 | 0.330 | - | 0.00% | - |
| 638.imagick_s (max) (percentage) | -2.81% | 1.780 | 1.730 | - | 0.00% | - |
| 511.povray_r (avg) (percentage) | -2.50% | 0.800 | 0.780 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -2.50% | 0.400 | 0.390 | - | 0.00% | - |
| 510.parest_r (max) | -2.27% | 309.000 | 302.000 | - | 0.00% | - |
| 510.parest_r (max) (percentage) | -2.16% | 5.100 | 4.990 | - | 0.00% | - |
| 657.xz_s | -2.08% | 48.000 | 47.000 | - | 0.00% | - |
| 657.xz_s (avg) | -2.08% | 48.000 | 47.000 | - | 0.00% | - |
| 526.blender_r (max) (percentage) | -1.72% | 0.580 | 0.570 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -1.67% | 1.200 | 1.180 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -1.30% | 0.770 | 0.760 | - | 0.00% | - |
| 605.mcf_s | -1.28% | 78.000 | 77.000 | - | 0.00% | - |
| 605.mcf_s (avg) | -1.28% | 78.000 | 77.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -1.11% | 9.890 | 9.780 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -1.10% | 10.880 | 10.760 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | -1.05% | 10.480 | 10.370 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -1.01% | 1.990 | 1.970 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 511.povray_r (unexplained diff vs previous) |
| 511.povray_r (unexplained diff vs previous) (percentage) |
| 605.mcf_s (unexplained diff vs previous) |
| 605.mcf_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s (unexplained diff vs previous) |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) |
| 644.nab_s (unexplained diff vs previous) |
| 644.nab_s (unexplained diff vs previous) (percentage) |
| 657.xz_s (unexplained diff vs previous) |
| 657.xz_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 526.blender_r | 6.31% | 10331.000 | 10983.000 | - | 1.57% | - |
| 605.mcf_s | 2.43% | 6382.000 | 6537.000 | - | 0.11% | - |
| 511.povray_r | 1.69% | 532.000 | 541.000 | - | 0.19% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s | -6.21% | 59343.000 | 55658.000 | - | 0.00% | - |
| 602.gcc_s | -3.71% | 6613082.000 | 6367851.000 | - | -0.00% | - |
| 644.nab_s | -2.98% | 82210.000 | 79763.000 | - | 0.00% | - |
| 511.povray_r | -2.91% | 692391.000 | 672273.000 | - | 0.00% | - |
| 638.imagick_s | -2.66% | 957572.000 | 932107.000 | - | -0.00% | - |
| 605.mcf_s | -2.63% | 14136.000 | 13764.000 | - | 0.00% | - |
| 657.xz_s | -2.60% | 107659.000 | 104863.000 | - | 0.00% | - |
| 526.blender_r | -2.22% | 10533211.000 | 10299369.000 | - | -0.00% | - |
| 508.namd_r | -1.44% | 326657.000 | 321968.000 | - | 0.00% | - |
| 625.x264_s | -1.29% | 362800.000 | 358123.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 619.lbm_s | -30.57% | 42973.000 | 29838.000 | - | -3.61% | - |
| 657.xz_s | -17.61% | 2947.000 | 2428.000 | - | 0.62% | - |
| 631.deepsjeng_s | -6.24% | 4516.000 | 4234.000 | - | 0.12% | - |
| 638.imagick_s | -1.55% | 3414.000 | 3361.000 | - | 3.16% | - |
| 602.gcc_s | -1.43% | 6427.000 | 6335.000 | - | 1.30% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 33.33% | 24.000 | 32.000 | - | 0.00% | - |
| nb_execution_successful | 25.00% | 12.000 | 15.000 | - | 0.00% | - |
| nb_compile_successful | 14.29% | 14.000 | 16.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Added Tests - Execution |
|---|
| 510.parest_r |
| 620.omnetpp_s |
| 623.xalancbmk_s |
| 641.leela_s |
| Added Tests - sample variability |
|---|
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 510.parest_r |
| 510.parest_r (avg) |
| 510.parest_r (avg) (percentage) |
| 510.parest_r (max) |
| 510.parest_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 526.blender_r |
| 526.blender_r (avg) |
| 526.blender_r (avg) (percentage) |
| 526.blender_r (max) |
| 526.blender_r (max) (percentage) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) (percentage) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) (percentage) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.22s