Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/c645981f2d6b18d4ac93cb4132e1da54b11ce5d6 (+ 48 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O2-build/639/ |
Filter
llvm-aarch64-master-O2 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0639 (llvmorg-21-init-02646-gc645981f2d6b) | 2025-02-20T18:10:58 | 0:00:00 |
| Previous | 0638 (llvmorg-21-init-02598-g7e4fef69f9f9) | 2025-02-19T05:39:01 | 0:00:00 |
| Baseline | 0002 (llvmorg-17-init-03259-g0303eafcb346) | 2023-02-26T22:18:13 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 69 | 23 |
| Performance Improvements | 28 | 10 |
| Added Tests | 20 | 116 |
| Unchanged Tests | 741 | 709 |
| Total Tests | 858 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s | 15.12% | 127168.000 | 146394.000 | - | 19.60% | - |
| 649.fotonik3d_s | 5.64% | 45358.000 | 47917.000 | - | 0.00% | - |
| 654.roms_s | 4.09% | 160460.000 | 167020.000 | - | -44.57% | - |
| 607.cactuBSSN_s | 2.97% | 95607.000 | 98445.000 | - | 9.89% | - |
| 631.deepsjeng_s | 2.24% | 12563.000 | 12844.000 | - | -3.16% | - |
| 603.bwaves_s | 1.39% | 251790.000 | 255283.000 | - | 0.00% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 631.deepsjeng_s (unexplained diff vs previous) | 28000.00% | 1.000 | 281.000 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | 21800.00% | 0.010 | 2.190 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 1646.67% | 15.000 | 262.000 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 1620.00% | 0.050 | 0.860 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | 656.04% | 2543.000 | 19226.000 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) (percentage) | 556.50% | 2.000 | 13.130 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 500.00% | 8.000 | 48.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) (percentage) | 477.78% | 0.090 | 0.520 | - | 0.00% | - |
| 621.wrf_s (max) (percentage) | 280.00% | 0.150 | 0.570 | - | 0.00% | - |
| 621.wrf_s (max) | 278.57% | 112.000 | 424.000 | - | 0.00% | - |
| 625.x264_s (max) (percentage) | 271.43% | 0.140 | 0.520 | - | 0.00% | - |
| 625.x264_s (max) | 269.23% | 13.000 | 48.000 | - | 0.00% | - |
| 654.roms_s (max) | 249.05% | 1957.000 | 6831.000 | - | 0.00% | - |
| 654.roms_s (max) (percentage) | 235.25% | 1.220 | 4.090 | - | 0.00% | - |
| 607.cactuBSSN_s (max) | 159.13% | 1128.000 | 2923.000 | - | 0.00% | - |
| 607.cactuBSSN_s (max) (percentage) | 151.69% | 1.180 | 2.970 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) | 147.86% | 1145.000 | 2838.000 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 140.00% | 1.200 | 2.880 | - | 0.00% | - |
| 619.lbm_s (max) | 120.56% | 180.000 | 397.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | 117.78% | 0.450 | 0.980 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | 116.57% | 181.000 | 392.000 | - | 0.00% | - |
| 657.xz_s (max) | 115.96% | 10249.000 | 22134.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | 115.56% | 0.450 | 0.970 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | 87.59% | 8.060 | 15.120 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 65.22% | 0.230 | 0.380 | - | 0.00% | - |
| 605.mcf_s (max) | 62.58% | 163.000 | 265.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) | 61.76% | 34.000 | 55.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) | 61.24% | 178.000 | 287.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 61.11% | 0.540 | 0.870 | - | 0.00% | - |
| 649.fotonik3d_s (max) | 58.94% | 1700.000 | 2702.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | 57.75% | 1.420 | 2.240 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | 50.40% | 3.750 | 5.640 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | 41.18% | 0.170 | 0.240 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | 41.18% | 0.170 | 0.240 | - | 0.00% | - |
| 644.nab_s (max) | 40.91% | 352.000 | 496.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | 40.00% | 350.000 | 490.000 | - | 0.00% | - |
| 603.bwaves_s (max) | 26.99% | 2794.000 | 3548.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | 25.23% | 1.110 | 1.390 | - | 0.00% | - |
| 657.xz_s | 20.00% | 5684.000 | 6821.000 | - | 0.00% | - |
| 657.xz_s (avg) | 20.00% | 5684.000 | 6821.000 | - | 0.00% | - |
| 654.roms_s | 12.73% | 2326.000 | 2622.000 | - | 0.00% | - |
| 654.roms_s (avg) | 12.73% | 2326.000 | 2622.000 | - | 0.00% | - |
| 649.fotonik3d_s | 10.90% | 1183.000 | 1312.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | 10.90% | 1183.000 | 1312.000 | - | 0.00% | - |
| 621.wrf_s (avg) (percentage) | 8.70% | 0.230 | 0.250 | - | 0.00% | - |
| 654.roms_s (avg) (percentage) | 8.28% | 1.450 | 1.570 | - | 0.00% | - |
| 621.wrf_s | 8.14% | 172.000 | 186.000 | - | 0.00% | - |
| 621.wrf_s (avg) | 8.14% | 172.000 | 186.000 | - | 0.00% | - |
| 607.cactuBSSN_s | 7.01% | 956.000 | 1023.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | 7.01% | 956.000 | 1023.000 | - | 0.00% | - |
| 603.bwaves_s | 6.28% | 1561.000 | 1659.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | 6.28% | 1561.000 | 1659.000 | - | 0.00% | - |
| 631.deepsjeng_s | 5.45% | 110.000 | 116.000 | - | 0.00% | - |
| 631.deepsjeng_s (avg) | 5.45% | 110.000 | 116.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | 4.98% | 2.610 | 2.740 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | 4.84% | 0.620 | 0.650 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | 4.25% | 4.470 | 4.660 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | 4.00% | 1.000 | 1.040 | - | 0.00% | - |
| 625.x264_s (avg) (percentage) | 3.45% | 0.290 | 0.300 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | 3.41% | 0.880 | 0.910 | - | 0.00% | - |
| 619.lbm_s | 2.45% | 245.000 | 251.000 | - | 0.00% | - |
| 619.lbm_s (avg) | 2.45% | 245.000 | 251.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | 1.64% | 0.610 | 0.620 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -56.72% | 1.340 | 0.580 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -56.58% | 228.000 | 99.000 | - | 0.00% | - |
| 648.exchange2_s (max) (percentage) | -20.00% | 0.050 | 0.040 | - | 0.00% | - |
| 648.exchange2_s (max) | -17.65% | 17.000 | 14.000 | - | 0.00% | - |
| 620.omnetpp_s (max) | -13.04% | 230.000 | 200.000 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -12.59% | 1.350 | 1.180 | - | 0.00% | - |
| 627.cam4_s (max) | -10.76% | 437.000 | 390.000 | - | 0.00% | - |
| 627.cam4_s (max) (percentage) | -10.53% | 0.380 | 0.340 | - | 0.00% | - |
| 641.leela_s (max) | -6.82% | 88.000 | 82.000 | - | 0.00% | - |
| 628.pop2_s (max) | -6.70% | 179.000 | 167.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -6.56% | 0.610 | 0.570 | - | 0.00% | - |
| 627.cam4_s | -6.52% | 184.000 | 172.000 | - | 0.00% | - |
| 627.cam4_s (avg) | -6.52% | 184.000 | 172.000 | - | 0.00% | - |
| 627.cam4_s (avg) (percentage) | -6.25% | 0.160 | 0.150 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -4.55% | 0.220 | 0.210 | - | 0.00% | - |
| 600.perlbench_s (max) | -4.55% | 44.000 | 42.000 | - | 0.00% | - |
| 600.perlbench_s (avg) (percentage) | -4.00% | 0.250 | 0.240 | - | 0.00% | - |
| 600.perlbench_s | -4.00% | 50.000 | 48.000 | - | 0.00% | - |
| 600.perlbench_s (avg) | -4.00% | 50.000 | 48.000 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -3.24% | 2.780 | 2.690 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -3.14% | 542.000 | 525.000 | - | 0.00% | - |
| 623.xalancbmk_s | -2.35% | 341.000 | 333.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | -2.35% | 341.000 | 333.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | -2.29% | 1.750 | 1.710 | - | 0.00% | - |
| 620.omnetpp_s | -1.82% | 274.000 | 269.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) | -1.82% | 274.000 | 269.000 | - | 0.00% | - |
| 620.omnetpp_s (avg) (percentage) | -1.24% | 1.610 | 1.590 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -1.08% | 0.930 | 0.920 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 600.perlbench_s (unexplained diff vs previous) |
| 600.perlbench_s (unexplained diff vs previous) (percentage) |
| 602.gcc_s (unexplained diff vs previous) |
| 602.gcc_s (unexplained diff vs previous) (percentage) |
| 603.bwaves_s (unexplained diff vs previous) |
| 603.bwaves_s (unexplained diff vs previous) (percentage) |
| 621.wrf_s (unexplained diff vs previous) |
| 621.wrf_s (unexplained diff vs previous) (percentage) |
| 623.xalancbmk_s (unexplained diff vs previous) |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) |
| 627.cam4_s (unexplained diff vs previous) |
| 627.cam4_s (unexplained diff vs previous) (percentage) |
| 628.pop2_s (unexplained diff vs previous) |
| 628.pop2_s (unexplained diff vs previous) (percentage) |
| 648.exchange2_s (unexplained diff vs previous) |
| 648.exchange2_s (unexplained diff vs previous) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| 654.roms_s (unexplained diff vs previous) |
| 654.roms_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | 70.84% | 3792061.000 | 6478364.000 | - | 0.00% | - |
| 654.roms_s | 23.24% | 3081820.000 | 3798015.000 | - | 0.00% | - |
| 648.exchange2_s | 21.83% | 2555609.000 | 3113471.000 | - | 0.00% | - |
| 631.deepsjeng_s | 20.67% | 81284.000 | 98084.000 | - | 0.00% | - |
| 605.mcf_s | 19.49% | 27321.000 | 32647.000 | - | 0.00% | - |
| 621.wrf_s | 13.66% | 24218766.000 | 27526012.000 | - | 0.00% | - |
| 625.x264_s | 11.06% | 501020.000 | 556436.000 | - | 0.00% | - |
| 638.imagick_s | 10.43% | 1820691.000 | 2010611.000 | - | -0.00% | - |
| 619.lbm_s | 7.45% | 17979.000 | 19319.000 | - | 0.00% | - |
| 644.nab_s | 6.69% | 202862.000 | 216429.000 | - | 0.00% | - |
| 641.leela_s | 5.40% | 144877.000 | 152707.000 | - | 0.00% | - |
| 657.xz_s | 4.59% | 181307.000 | 189627.000 | - | 0.00% | - |
| 623.xalancbmk_s | 3.47% | 4726781.000 | 4890726.000 | - | 0.00% | - |
| 602.gcc_s | 2.87% | 8922066.000 | 9178498.000 | - | 0.00% | - |
| 600.perlbench_s | 2.78% | 2155453.000 | 2215295.000 | - | 0.00% | - |
| 620.omnetpp_s | 2.57% | 2149689.000 | 2204859.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 64.66% | 21783.000 | 35867.000 | - | -0.03% | - |
| 644.nab_s | 28.84% | 160468.000 | 206743.000 | - | -0.24% | - |
| 657.xz_s | 19.60% | 122401.000 | 146394.000 | - | 15.12% | - |
| 607.cactuBSSN_s | 9.89% | 89584.000 | 98445.000 | - | 2.97% | - |
| 623.xalancbmk_s | 3.72% | 18831.000 | 19532.000 | - | 0.02% | - |
| 625.x264_s | 3.17% | 8983.000 | 9268.000 | - | -0.52% | - |
| 600.perlbench_s | 1.44% | 19963.000 | 20251.000 | - | -0.02% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 621.wrf_s | -47.68% | 142382.000 | 74494.000 | - | -0.57% | - |
| 654.roms_s | -44.57% | 301295.000 | 167020.000 | - | 4.09% | - |
| 602.gcc_s | -8.18% | 27313.000 | 25080.000 | - | 0.67% | - |
| 620.omnetpp_s | -8.00% | 18442.000 | 16966.000 | - | -0.58% | - |
| 631.deepsjeng_s | -3.16% | 13263.000 | 12844.000 | - | 2.24% | - |
| 619.lbm_s | -2.41% | 41563.000 | 40562.000 | - | 0.98% | - |
| 638.imagick_s | -1.95% | 184180.000 | 180587.000 | - | 0.10% | - |
| 641.leela_s | -1.69% | 14724.000 | 14475.000 | - | -0.38% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 25.00% | 16.000 | 20.000 | - | 0.00% | - |
| nb_compile_successful | 17.65% | 17.000 | 20.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 603.bwaves_s (unexplained diff vs previous) |
| 603.bwaves_s (unexplained diff vs previous) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s |
| 627.cam4_s (avg) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) |
| 627.cam4_s (max) (percentage) |
| 627.cam4_s (unexplained diff vs previous) |
| 627.cam4_s (unexplained diff vs previous) (percentage) |
| 628.pop2_s |
| 628.pop2_s (avg) |
| 628.pop2_s (avg) (percentage) |
| 628.pop2_s (max) |
| 628.pop2_s (max) (percentage) |
| 628.pop2_s (unexplained diff vs previous) |
| 628.pop2_s (unexplained diff vs previous) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.33s