Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_llvm | https://github.com/llvm/llvm-project/commit/cf5947be13e7af67219379e07bc0128f1f1e7f88 (+ 60 commits) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-fujitsu_speed-cpu2017speed--llvm-aarch64-master-O3-build/650/ |
Filter
llvm-aarch64-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0650 (llvmorg-21-init-01223-gcf5947be13e7) | 2025-02-07T14:48:15 | 0:00:00 |
| Previous | 0649 (llvmorg-21-init-01163-g605a9e37b64b) | 2025-02-06T09:59:56 | 0:00:00 |
| Baseline | 0001 (llvmorg-17-init-03218-g58de24ebbb35) | 2023-02-25T18:39:57 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 22 | 20 |
| Performance Improvements | 53 | 10 |
| Added Tests | 4 | 107 |
| Unchanged Tests | 731 | 673 |
| Total Tests | 810 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 623.xalancbmk_s | 3.23% | 18717.000 | 19321.000 | - | -0.08% | - |
| 602.gcc_s | 1.18% | 21361.000 | 21614.000 | - | -4.44% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 641.leela_s (unexplained diff vs previous) | 1500.00% | 1.000 | 16.000 | - | 0.00% | - |
| 641.leela_s (unexplained diff vs previous) (percentage) | 1000.00% | 0.010 | 0.110 | - | 0.00% | - |
| 602.gcc_s (max) | 318.03% | 61.000 | 255.000 | - | 0.00% | - |
| 602.gcc_s (max) (percentage) | 306.90% | 0.290 | 1.180 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) (percentage) | 125.00% | 0.080 | 0.180 | - | 0.00% | - |
| 607.cactuBSSN_s (unexplained diff vs previous) | 120.78% | 77.000 | 170.000 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) | 95.45% | 22.000 | 43.000 | - | 0.00% | - |
| 600.perlbench_s (unexplained diff vs previous) (percentage) | 90.91% | 0.110 | 0.210 | - | 0.00% | - |
| 605.mcf_s (max) | 76.81% | 69.000 | 122.000 | - | 0.00% | - |
| 605.mcf_s (max) (percentage) | 75.00% | 0.240 | 0.420 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) (percentage) | 75.00% | 0.240 | 0.420 | - | 0.00% | - |
| 605.mcf_s (unexplained diff vs previous) | 70.42% | 71.000 | 121.000 | - | 0.00% | - |
| 625.x264_s (unexplained diff vs previous) | 12.50% | 8.000 | 9.000 | - | 0.00% | - |
| 638.imagick_s (unexplained diff vs previous) | 12.50% | 16.000 | 18.000 | - | 0.00% | - |
| 623.xalancbmk_s | 5.86% | 273.000 | 289.000 | - | 0.00% | - |
| 623.xalancbmk_s (avg) | 5.86% | 273.000 | 289.000 | - | 0.00% | - |
| 602.gcc_s | 4.62% | 130.000 | 136.000 | - | 0.00% | - |
| 602.gcc_s (avg) | 4.62% | 130.000 | 136.000 | - | 0.00% | - |
| 602.gcc_s (avg) (percentage) | 3.28% | 0.610 | 0.630 | - | 0.00% | - |
| 623.xalancbmk_s (avg) (percentage) | 2.74% | 1.460 | 1.500 | - | 0.00% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 657.xz_s (unexplained diff vs previous) (percentage) | -98.76% | 2.410 | 0.030 | - | 0.00% | - |
| 657.xz_s (unexplained diff vs previous) | -98.60% | 3072.000 | 43.000 | - | 0.00% | - |
| 603.bwaves_s (max) | -90.02% | 1794.000 | 179.000 | - | 0.00% | - |
| 603.bwaves_s (max) (percentage) | -90.00% | 0.700 | 0.070 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) | -81.82% | 55.000 | 10.000 | - | 0.00% | - |
| 619.lbm_s (unexplained diff vs previous) (percentage) | -78.57% | 0.140 | 0.030 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) (percentage) | -77.78% | 0.090 | 0.020 | - | 0.00% | - |
| 603.bwaves_s (unexplained diff vs previous) | -75.78% | 223.000 | 54.000 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) (percentage) | -67.74% | 0.310 | 0.100 | - | 0.00% | - |
| 631.deepsjeng_s (unexplained diff vs previous) | -66.67% | 39.000 | 13.000 | - | 0.00% | - |
| 649.fotonik3d_s (max) (percentage) | -66.39% | 2.410 | 0.810 | - | 0.00% | - |
| 649.fotonik3d_s (max) | -66.33% | 1081.000 | 364.000 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) | -64.58% | 0.960 | 0.340 | - | 0.00% | - |
| 649.fotonik3d_s (unexplained diff vs previous) | -64.35% | 432.000 | 154.000 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) (percentage) | -43.75% | 0.160 | 0.090 | - | 0.00% | - |
| 644.nab_s (unexplained diff vs previous) | -40.49% | 326.000 | 194.000 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) (percentage) | -28.57% | 0.700 | 0.500 | - | 0.00% | - |
| 620.omnetpp_s (unexplained diff vs previous) | -28.12% | 128.000 | 92.000 | - | 0.00% | - |
| 644.nab_s (max) | -18.86% | 334.000 | 271.000 | - | 0.00% | - |
| 644.nab_s (max) (percentage) | -18.75% | 0.160 | 0.130 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) (percentage) | -14.48% | 3.660 | 3.130 | - | 0.00% | - |
| 620.omnetpp_s (max) (percentage) | -13.04% | 0.690 | 0.600 | - | 0.00% | - |
| 620.omnetpp_s (max) | -12.70% | 126.000 | 110.000 | - | 0.00% | - |
| 623.xalancbmk_s (unexplained diff vs previous) | -11.82% | 685.000 | 604.000 | - | 0.00% | - |
| 631.deepsjeng_s (max) (percentage) | -7.02% | 1.140 | 1.060 | - | 0.00% | - |
| 631.deepsjeng_s (max) | -6.90% | 145.000 | 135.000 | - | 0.00% | - |
| 619.lbm_s (max) | -6.30% | 127.000 | 119.000 | - | 0.00% | - |
| 619.lbm_s (max) (percentage) | -6.25% | 0.320 | 0.300 | - | 0.00% | - |
| 623.xalancbmk_s (max) (percentage) | -5.67% | 3.530 | 3.330 | - | 0.00% | - |
| 600.perlbench_s (max) (percentage) | -5.41% | 0.370 | 0.350 | - | 0.00% | - |
| 600.perlbench_s (max) | -5.41% | 74.000 | 70.000 | - | 0.00% | - |
| 641.leela_s (max) | -5.36% | 56.000 | 53.000 | - | 0.00% | - |
| 641.leela_s (max) (percentage) | -5.00% | 0.400 | 0.380 | - | 0.00% | - |
| 603.bwaves_s | -4.14% | 1256.000 | 1204.000 | - | 0.00% | - |
| 603.bwaves_s (avg) | -4.14% | 1256.000 | 1204.000 | - | 0.00% | - |
| 603.bwaves_s (avg) (percentage) | -4.08% | 0.490 | 0.470 | - | 0.00% | - |
| 649.fotonik3d_s (avg) (percentage) | -3.72% | 1.880 | 1.810 | - | 0.00% | - |
| 649.fotonik3d_s | -3.44% | 843.000 | 814.000 | - | 0.00% | - |
| 649.fotonik3d_s (avg) | -3.44% | 843.000 | 814.000 | - | 0.00% | - |
| 657.xz_s (max) | -2.72% | 4741.000 | 4612.000 | - | 0.00% | - |
| 657.xz_s (max) (percentage) | -2.69% | 3.720 | 3.620 | - | 0.00% | - |
| 623.xalancbmk_s (max) | -2.58% | 660.000 | 643.000 | - | 0.00% | - |
| 619.lbm_s | -2.01% | 199.000 | 195.000 | - | 0.00% | - |
| 619.lbm_s (avg) | -2.01% | 199.000 | 195.000 | - | 0.00% | - |
| 619.lbm_s (avg) (percentage) | -2.00% | 0.500 | 0.490 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) (percentage) | -1.89% | 1.060 | 1.040 | - | 0.00% | - |
| 607.cactuBSSN_s | -1.78% | 1013.000 | 995.000 | - | 0.00% | - |
| 607.cactuBSSN_s (avg) | -1.78% | 1013.000 | 995.000 | - | 0.00% | - |
| 657.xz_s | -1.45% | 5365.000 | 5287.000 | - | 0.00% | - |
| 657.xz_s (avg) | -1.45% | 5365.000 | 5287.000 | - | 0.00% | - |
| 657.xz_s (avg) (percentage) | -1.43% | 4.210 | 4.150 | - | 0.00% | - |
| 605.mcf_s (avg) (percentage) | -1.27% | 0.790 | 0.780 | - | 0.00% | - |
| 631.deepsjeng_s (avg) (percentage) | -1.23% | 0.810 | 0.800 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 602.gcc_s (unexplained diff vs previous) |
| 602.gcc_s (unexplained diff vs previous) (percentage) |
| 648.exchange2_s (unexplained diff vs previous) |
| 648.exchange2_s (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 607.cactuBSSN_s | 69.77% | 3909905.000 | 6637812.000 | - | 0.00% | - |
| 631.deepsjeng_s | 34.58% | 90832.000 | 122244.000 | - | 0.00% | - |
| 654.roms_s | 33.66% | 3086796.000 | 4125775.000 | - | 0.01% | - |
| 619.lbm_s | 32.60% | 18491.000 | 24519.000 | - | 0.00% | - |
| 648.exchange2_s | 23.23% | 2567097.000 | 3163559.000 | - | 0.00% | - |
| 605.mcf_s | 17.63% | 28401.000 | 33407.000 | - | 0.00% | - |
| 621.wrf_s | 16.30% | 24593974.000 | 28603140.000 | - | -0.00% | - |
| 638.imagick_s | 13.08% | 1914135.000 | 2164419.000 | - | 0.00% | - |
| 625.x264_s | 7.99% | 562344.000 | 607248.000 | - | 0.00% | - |
| 644.nab_s | 7.86% | 210558.000 | 227109.000 | - | 0.00% | - |
| 641.leela_s | 7.77% | 153985.000 | 165951.000 | - | 0.00% | - |
| 623.xalancbmk_s | 4.18% | 4853229.000 | 5055910.000 | - | 0.00% | - |
| 602.gcc_s | 3.72% | 9686310.000 | 10046322.000 | - | 0.00% | - |
| 600.perlbench_s | 3.18% | 2263585.000 | 2335455.000 | - | 0.00% | - |
| 657.xz_s | 3.15% | 195635.000 | 201795.000 | - | 0.00% | - |
| 620.omnetpp_s | 2.48% | 2221518.000 | 2276548.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 648.exchange2_s | 68.46% | 20971.000 | 35327.000 | - | 0.01% | - |
| 644.nab_s | 29.61% | 161383.000 | 209170.000 | - | 0.09% | - |
| 607.cactuBSSN_s | 7.43% | 89127.000 | 95745.000 | - | 0.18% | - |
| 620.omnetpp_s | 5.24% | 17541.000 | 18460.000 | - | 0.50% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 654.roms_s | -67.89% | 306683.000 | 98465.000 | - | -0.06% | - |
| 621.wrf_s | -47.30% | 139583.000 | 73560.000 | - | -0.15% | - |
| 619.lbm_s | -5.44% | 42215.000 | 39919.000 | - | -0.03% | - |
| 602.gcc_s | -4.44% | 22619.000 | 21614.000 | - | 1.18% | - |
| 631.deepsjeng_s | -3.79% | 13255.000 | 12753.000 | - | 0.10% | - |
| 625.x264_s | -2.56% | 8350.000 | 8136.000 | - | -0.11% | - |
| 605.mcf_s | -2.44% | 29858.000 | 29128.000 | - | 0.42% | - |
| 600.perlbench_s | -1.36% | 20326.000 | 20049.000 | - | 0.21% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_execution_successful | 25.00% | 16.000 | 20.000 | - | 0.00% | - |
| nb_compile_successful | 17.65% | 17.000 | 20.000 | - | 0.00% | - |
| Added Tests - Code Size |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - Execution |
|---|
| 603.bwaves_s |
| 627.cam4_s |
| 628.pop2_s |
| 649.fotonik3d_s |
| Added Tests - sample variability |
|---|
| 600.perlbench_s |
| 600.perlbench_s (avg) |
| 600.perlbench_s (avg) (percentage) |
| 600.perlbench_s (max) |
| 600.perlbench_s (max) (percentage) |
| 602.gcc_s |
| 602.gcc_s (avg) |
| 602.gcc_s (avg) (percentage) |
| 602.gcc_s (max) |
| 602.gcc_s (max) (percentage) |
| 603.bwaves_s |
| 603.bwaves_s (avg) |
| 603.bwaves_s (avg) (percentage) |
| 603.bwaves_s (max) |
| 603.bwaves_s (max) (percentage) |
| 603.bwaves_s (unexplained diff vs previous) |
| 603.bwaves_s (unexplained diff vs previous) (percentage) |
| 605.mcf_s |
| 605.mcf_s (avg) |
| 605.mcf_s (avg) (percentage) |
| 605.mcf_s (max) |
| 605.mcf_s (max) (percentage) |
| 607.cactuBSSN_s |
| 607.cactuBSSN_s (avg) |
| 607.cactuBSSN_s (avg) (percentage) |
| 607.cactuBSSN_s (max) |
| 607.cactuBSSN_s (max) (percentage) |
| 619.lbm_s |
| 619.lbm_s (avg) |
| 619.lbm_s (avg) (percentage) |
| 619.lbm_s (max) |
| 619.lbm_s (max) (percentage) |
| 620.omnetpp_s |
| 620.omnetpp_s (avg) |
| 620.omnetpp_s (avg) (percentage) |
| 620.omnetpp_s (max) |
| 620.omnetpp_s (max) (percentage) |
| 621.wrf_s |
| 621.wrf_s (avg) |
| 621.wrf_s (avg) (percentage) |
| 621.wrf_s (max) |
| 621.wrf_s (max) (percentage) |
| 623.xalancbmk_s |
| 623.xalancbmk_s (avg) |
| 623.xalancbmk_s (avg) (percentage) |
| 623.xalancbmk_s (max) |
| 623.xalancbmk_s (max) (percentage) |
| 625.x264_s |
| 625.x264_s (avg) |
| 625.x264_s (avg) (percentage) |
| 625.x264_s (max) |
| 625.x264_s (max) (percentage) |
| 627.cam4_s |
| 627.cam4_s (avg) |
| 627.cam4_s (avg) (percentage) |
| 627.cam4_s (max) |
| 627.cam4_s (max) (percentage) |
| 631.deepsjeng_s |
| 631.deepsjeng_s (avg) |
| 631.deepsjeng_s (avg) (percentage) |
| 631.deepsjeng_s (max) |
| 631.deepsjeng_s (max) (percentage) |
| 638.imagick_s |
| 638.imagick_s (avg) |
| 638.imagick_s (avg) (percentage) |
| 638.imagick_s (max) |
| 638.imagick_s (max) (percentage) |
| 641.leela_s |
| 641.leela_s (avg) |
| 641.leela_s (avg) (percentage) |
| 641.leela_s (max) |
| 641.leela_s (max) (percentage) |
| 644.nab_s |
| 644.nab_s (avg) |
| 644.nab_s (avg) (percentage) |
| 644.nab_s (max) |
| 644.nab_s (max) (percentage) |
| 648.exchange2_s |
| 648.exchange2_s (avg) |
| 648.exchange2_s (avg) (percentage) |
| 648.exchange2_s (max) |
| 648.exchange2_s (max) (percentage) |
| 649.fotonik3d_s |
| 649.fotonik3d_s (avg) |
| 649.fotonik3d_s (avg) (percentage) |
| 649.fotonik3d_s (max) |
| 649.fotonik3d_s (max) (percentage) |
| 649.fotonik3d_s (unexplained diff vs previous) |
| 649.fotonik3d_s (unexplained diff vs previous) (percentage) |
| 654.roms_s |
| 654.roms_s (avg) |
| 654.roms_s (avg) (percentage) |
| 654.roms_s (max) |
| 654.roms_s (max) (percentage) |
| 657.xz_s |
| 657.xz_s (avg) |
| 657.xz_s (avg) (percentage) |
| 657.xz_s (max) |
| 657.xz_s (max) (percentage) |
Report Time: 0.35s