Fields
hardware | None |
os | None |
Parameters
Fields
Name | Value |
---|
Parameters
Name | Value |
---|---|
git_llvm | https://github.com/llvm/llvm-project/commit/6da4ecdf9285225ccc8fa4441b7e9f65e8f4f49c (+ 615 commits) |
test_url | https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-Os_LTO-build/92/ |
Filter
llvm-aarch64-master-Os_LTO test results
Run | Order | Start Time | Duration |
---|---|---|---|
Current | 0092 (llvmorg-18-init-12112-g6da4ecdf9285) | 2023-11-14T00:13:19 | 0:00:00 |
Previous | 0091 (llvmorg-18-init-11497-ga533b76468ac) | 2023-11-09T17:11:25 | 0:00:00 |
Baseline | 0001 (llvmorg-17-init-03361-gd77f96a9e0c8) | 2023-02-27T23:41:40 | 0:00:00 |
Tests Summary
Status Group | # | # (B) |
---|---|---|
Performance Regressions | 19 | 8 |
Performance Improvements | 8 | 5 |
Added Tests | 2 | 77 |
Unchanged Tests | 673 | 612 |
Total Tests | 702 |
Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
600.perlbench_s | 4.54% | 2270.000 | 2373.000 | - | 3.26% | - |
638.imagick_s | 4.46% | 3072.000 | 3209.000 | - | -1.50% | - |
511.povray_r | 2.65% | 415.000 | 426.000 | - | -5.75% | - |
644.nab_s | 2.08% | 11217.000 | 11450.000 | - | 3.07% | - |
508.namd_r | 1.79% | 2509.000 | 2554.000 | - | 4.46% | - |
602.gcc_s | 1.39% | 4167.000 | 4225.000 | - | 0.52% | - |
641.leela_s | 1.09% | 4043.000 | 4087.000 | - | 2.43% | - |
Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
511.povray_r (max) | 14.29% | 7.000 | 8.000 | - | 0.00% | - |
600.perlbench_s (max) | 4.52% | 310.000 | 324.000 | - | 0.00% | - |
638.imagick_s (max) | 4.43% | 406.000 | 424.000 | - | 0.00% | - |
638.imagick_s | 4.35% | 207.000 | 216.000 | - | 0.00% | - |
638.imagick_s (avg) | 4.35% | 207.000 | 216.000 | - | 0.00% | - |
600.perlbench_s | 3.91% | 128.000 | 133.000 | - | 0.00% | - |
600.perlbench_s (avg) | 3.91% | 128.000 | 133.000 | - | 0.00% | - |
508.namd_r (max) | 2.14% | 187.000 | 191.000 | - | 0.00% | - |
644.nab_s | 1.90% | 158.000 | 161.000 | - | 0.00% | - |
644.nab_s (avg) | 1.90% | 158.000 | 161.000 | - | 0.00% | - |
644.nab_s (max) | 1.88% | 160.000 | 163.000 | - | 0.00% | - |
Performance Regressions - Score | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
nb_total_tests | -33.33% | 24.000 | 16.000 | - | -33.33% | - |
Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
619.lbm_s | -4.03% | 31467.000 | 30198.000 | - | -2.78% | - |
526.blender_r | -1.25% | 9041.000 | 8928.000 | - | 4.07% | - |
Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
---|---|---|---|---|---|---|
619.lbm_s (max) | -4.04% | 17914.000 | 17191.000 | - | 0.00% | - |
619.lbm_s | -4.03% | 6856.000 | 6580.000 | - | 0.00% | - |
619.lbm_s (avg) | -4.03% | 6856.000 | 6580.000 | - | 0.00% | - |
526.blender_r | -1.36% | 220.000 | 217.000 | - | 0.00% | - |
526.blender_r (avg) | -1.36% | 220.000 | 217.000 | - | 0.00% | - |
526.blender_r (max) | -1.26% | 398.000 | 393.000 | - | 0.00% | - |
Added Tests - Score |
---|
nb_compile_successful |
nb_execution_successful |
Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
508.namd_r | 4.46% | 2445.000 | 2554.000 | - | 1.79% | - |
526.blender_r | 4.07% | 8579.000 | 8928.000 | - | -1.25% | - |
600.perlbench_s | 3.26% | 2298.000 | 2373.000 | - | 4.54% | - |
644.nab_s | 3.07% | 11109.000 | 11450.000 | - | 2.08% | - |
641.leela_s | 2.43% | 3990.000 | 4087.000 | - | 1.09% | - |
620.omnetpp_s | 1.49% | 3747.000 | 3803.000 | - | 0.66% | - |
625.x264_s | 1.09% | 2662.000 | 2691.000 | - | 0.37% | - |
Performance Regressions - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
nb_total_tests | -33.33% | 24.000 | 16.000 | - | -33.33% | - |
Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
---|---|---|---|---|---|---|
511.povray_r | -5.75% | 452.000 | 426.000 | - | 2.65% | - |
631.deepsjeng_s | -3.00% | 3596.000 | 3488.000 | - | 0.43% | - |
619.lbm_s | -2.78% | 31060.000 | 30198.000 | - | -4.03% | - |
623.xalancbmk_s | -1.52% | 3621.000 | 3566.000 | - | -0.42% | - |
638.imagick_s | -1.50% | 3258.000 | 3209.000 | - | 4.46% | - |
Added Tests - sample variability |
---|
508.namd_r |
508.namd_r (avg) |
508.namd_r (avg) (percentage) |
508.namd_r (max) |
508.namd_r (max) (percentage) |
510.parest_r |
510.parest_r (avg) |
510.parest_r (avg) (percentage) |
510.parest_r (max) |
510.parest_r (max) (percentage) |
511.povray_r |
511.povray_r (avg) |
511.povray_r (avg) (percentage) |
511.povray_r (max) |
511.povray_r (max) (percentage) |
526.blender_r |
526.blender_r (avg) |
526.blender_r (avg) (percentage) |
526.blender_r (max) |
526.blender_r (max) (percentage) |
600.perlbench_s |
600.perlbench_s (avg) |
600.perlbench_s (avg) (percentage) |
600.perlbench_s (max) |
600.perlbench_s (max) (percentage) |
605.mcf_s |
605.mcf_s (avg) |
605.mcf_s (avg) (percentage) |
605.mcf_s (max) |
605.mcf_s (max) (percentage) |
619.lbm_s |
619.lbm_s (avg) |
619.lbm_s (avg) (percentage) |
619.lbm_s (max) |
619.lbm_s (max) (percentage) |
620.omnetpp_s |
620.omnetpp_s (avg) |
620.omnetpp_s (avg) (percentage) |
620.omnetpp_s (max) |
620.omnetpp_s (max) (percentage) |
623.xalancbmk_s |
623.xalancbmk_s (avg) |
623.xalancbmk_s (avg) (percentage) |
623.xalancbmk_s (max) |
623.xalancbmk_s (max) (percentage) |
625.x264_s |
625.x264_s (avg) |
625.x264_s (avg) (percentage) |
625.x264_s (max) |
625.x264_s (max) (percentage) |
631.deepsjeng_s |
631.deepsjeng_s (avg) |
631.deepsjeng_s (avg) (percentage) |
631.deepsjeng_s (max) |
631.deepsjeng_s (max) (percentage) |
638.imagick_s |
638.imagick_s (avg) |
638.imagick_s (avg) (percentage) |
638.imagick_s (max) |
638.imagick_s (max) (percentage) |
641.leela_s |
641.leela_s (avg) |
641.leela_s (avg) (percentage) |
641.leela_s (max) |
641.leela_s (max) (percentage) |
644.nab_s |
644.nab_s (avg) |
644.nab_s (avg) (percentage) |
644.nab_s (max) |
644.nab_s (max) (percentage) |
657.xz_s |
657.xz_s (avg) |
657.xz_s (avg) (percentage) |
657.xz_s (max) |
657.xz_s (max) (percentage) |
Added Tests - Score |
---|
nb_compile_successful |
nb_execution_successful |
Report Time: 0.22s