Fields
| hardware | None |
| os | None |
Parameters
Fields
| Name | Value |
|---|
Parameters
| Name | Value |
|---|---|
| git_binutils | https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=7846287a38e2b996c2faa6b3319a8a83564e6b40 (+ 29 commits) |
| git_gcc | https://github.com/gcc-mirror/gcc/commit/944e4251b67aeea1146256c2d37b8925b51fa441 (+ 63 commits) |
| git_glibc | https://sourceware.org/git/?p=glibc.git;a=commit;h=c8b4ce0b368115714bd4cce131e1683759471099 (+ 6 commits) |
| git_linux | https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/0c5b83b8e0d8ab9a82cb0bdbcc46a1e0ded4345e (unchanged) |
| test_url | https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3-build/188/ |
Filter
gnu-arm-master-O3 test results
| Run | Order | Start Time | Duration |
|---|---|---|---|
| Current | 0188 (3-changed-components) | 2024-07-10T22:02:45 | 0:00:00 |
| Previous | 0187 (3-changed-components) | 2024-07-07T19:48:58 | 0:00:00 |
| Baseline | 0001 (4-changed-components) | 2023-03-08T00:00:32 | 0:00:00 |
Tests Summary
| Status Group | # | # (B) |
|---|---|---|
| Performance Regressions | 39 | 6 |
| Performance Improvements | 39 | 22 |
| Added Tests | 20 | 89 |
| Unchanged Tests | 700 | 681 |
| Total Tests | 798 |
| Performance Regressions - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 511.povray_r | 2.09% | 430.000 | 439.000 | - | -0.45% | - |
| 521.wrf_r | 1.49% | 9397.000 | 9537.000 | - | 10.25% | - |
| Performance Regressions - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 531.deepsjeng_r (unexplained diff vs previous) | 1100.00% | 2.000 | 24.000 | 0.000 | 0.00% | 0.000 |
| 531.deepsjeng_r (unexplained diff vs previous) (percentage) | 1025.00% | 0.040 | 0.450 | 0.000 | 0.00% | 0.000 |
| 500.perlbench_r (max) | 242.86% | 14.000 | 48.000 | - | 0.00% | - |
| 500.perlbench_r (max) (percentage) | 240.91% | 0.660 | 2.250 | - | 0.00% | - |
| 520.omnetpp_r (unexplained diff vs previous) (percentage) | 132.52% | 2.060 | 4.790 | 0.000 | 0.00% | 0.000 |
| 511.povray_r (max) | 125.00% | 4.000 | 9.000 | - | 0.00% | - |
| 520.omnetpp_r (unexplained diff vs previous) | 121.92% | 73.000 | 162.000 | 0.000 | 0.00% | 0.000 |
| 520.omnetpp_r (max) (percentage) | 117.62% | 2.100 | 4.570 | - | 0.00% | - |
| 520.omnetpp_r (max) | 108.11% | 74.000 | 154.000 | - | 0.00% | - |
| 511.povray_r (max) (percentage) | 102.91% | 1.030 | 2.090 | - | 0.00% | - |
| 557.xz_r (max) (percentage) | 76.34% | 0.930 | 1.640 | - | 0.00% | - |
| 557.xz_r (max) | 72.73% | 22.000 | 38.000 | - | 0.00% | - |
| 538.imagick_r (max) (percentage) | 44.44% | 0.450 | 0.650 | - | 0.00% | - |
| 538.imagick_r (max) | 38.89% | 18.000 | 25.000 | - | 0.00% | - |
| 525.x264_r (max) (percentage) | 17.37% | 1.670 | 1.960 | - | 0.00% | - |
| 505.mcf_r (unexplained diff vs previous) | 16.67% | 42.000 | 49.000 | 0.000 | 0.00% | 0.000 |
| 505.mcf_r (unexplained diff vs previous) (percentage) | 15.15% | 0.660 | 0.760 | 0.000 | 0.00% | 0.000 |
| 525.x264_r (max) | 14.89% | 47.000 | 54.000 | - | 0.00% | - |
| 508.namd_r (max) (percentage) | 13.11% | 0.610 | 0.690 | - | 0.00% | - |
| 508.namd_r (max) | 8.70% | 23.000 | 25.000 | - | 0.00% | - |
| 538.imagick_r | 8.33% | 12.000 | 13.000 | - | 0.00% | - |
| 538.imagick_r (avg) | 8.33% | 12.000 | 13.000 | - | 0.00% | - |
| 538.imagick_r (avg) (percentage) | 6.25% | 0.320 | 0.340 | - | 0.00% | - |
| 520.omnetpp_r (avg) (percentage) | 6.03% | 1.160 | 1.230 | - | 0.00% | - |
| 500.perlbench_r (avg) (percentage) | 5.49% | 0.910 | 0.960 | - | 0.00% | - |
| 525.x264_r (avg) (percentage) | 5.13% | 0.780 | 0.820 | - | 0.00% | - |
| 557.xz_r (avg) (percentage) | 4.17% | 0.720 | 0.750 | - | 0.00% | - |
| 511.povray_r (avg) (percentage) | 3.81% | 1.050 | 1.090 | - | 0.00% | - |
| 503.bwaves_r (avg) (percentage) | 3.77% | 0.530 | 0.550 | - | 0.00% | - |
| 554.roms_r (avg) (percentage) | 2.78% | 0.720 | 0.740 | - | 0.00% | - |
| 521.wrf_r | 2.19% | 137.000 | 140.000 | - | 0.00% | - |
| 521.wrf_r (avg) | 2.19% | 137.000 | 140.000 | - | 0.00% | - |
| 503.bwaves_r | 2.17% | 46.000 | 47.000 | - | 0.00% | - |
| 503.bwaves_r (avg) | 2.17% | 46.000 | 47.000 | - | 0.00% | - |
| 508.namd_r (avg) (percentage) | 2.04% | 0.490 | 0.500 | - | 0.00% | - |
| 554.roms_r | 1.58% | 190.000 | 193.000 | - | 0.00% | - |
| 554.roms_r (avg) | 1.58% | 190.000 | 193.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 520.omnetpp_r | -4.57% | 3542.000 | 3380.000 | - | -6.55% | - |
| 500.perlbench_r | -2.25% | 2227.000 | 2177.000 | - | 8.42% | - |
| 525.x264_r | -1.96% | 2856.000 | 2800.000 | - | 0.25% | - |
| 557.xz_r | -1.64% | 2372.000 | 2333.000 | - | -0.60% | - |
| 554.roms_r | -1.18% | 26394.000 | 26082.000 | - | 7.35% | - |
| 503.bwaves_r | -1.00% | 8695.000 | 8608.000 | - | 0.43% | - |
| Performance Improvements - sample variability | Δ | Previous | Current | σ | Δ (B) | σ (B) |
|---|---|---|---|---|---|---|
| 519.lbm_r (unexplained diff vs previous) | -50.00% | 6.000 | 3.000 | 0.000 | 0.00% | 0.000 |
| 519.lbm_r (unexplained diff vs previous) (percentage) | -50.00% | 0.180 | 0.090 | 0.000 | 0.00% | 0.000 |
| 503.bwaves_r (unexplained diff vs previous) | -40.82% | 147.000 | 87.000 | 0.000 | 0.00% | 0.000 |
| 503.bwaves_r (unexplained diff vs previous) (percentage) | -40.24% | 1.690 | 1.010 | 0.000 | 0.00% | 0.000 |
| 519.lbm_r (max) | -37.50% | 8.000 | 5.000 | - | 0.00% | - |
| 519.lbm_r (max) (percentage) | -36.00% | 0.250 | 0.160 | - | 0.00% | - |
| 549.fotonik3d_r (unexplained diff vs previous) (percentage) | -25.00% | 0.040 | 0.030 | 0.000 | 0.00% | 0.000 |
| 549.fotonik3d_r (unexplained diff vs previous) | -25.00% | 4.000 | 3.000 | 0.000 | 0.00% | 0.000 |
| 554.roms_r (unexplained diff vs previous) | -18.75% | 384.000 | 312.000 | 0.000 | 0.00% | 0.000 |
| 554.roms_r (unexplained diff vs previous) (percentage) | -17.24% | 1.450 | 1.200 | 0.000 | 0.00% | 0.000 |
| 507.cactuBSSN_r (max) (percentage) | -11.65% | 1.030 | 0.910 | - | 0.00% | - |
| 507.cactuBSSN_r (max) | -11.59% | 69.000 | 61.000 | - | 0.00% | - |
| 544.nab_r (max) (percentage) | -10.87% | 0.920 | 0.820 | - | 0.00% | - |
| 544.nab_r (max) | -9.86% | 71.000 | 64.000 | - | 0.00% | - |
| 503.bwaves_r (max) | -8.72% | 149.000 | 136.000 | - | 0.00% | - |
| 503.bwaves_r (max) (percentage) | -8.14% | 1.720 | 1.580 | - | 0.00% | - |
| 554.roms_r (max) | -7.18% | 390.000 | 362.000 | - | 0.00% | - |
| 554.roms_r (max) (percentage) | -6.08% | 1.480 | 1.390 | - | 0.00% | - |
| 505.mcf_r (max) (percentage) | -3.37% | 0.890 | 0.860 | - | 0.00% | - |
| 549.fotonik3d_r (avg) (percentage) | -3.28% | 0.610 | 0.590 | - | 0.00% | - |
| 549.fotonik3d_r (max) | -2.50% | 120.000 | 117.000 | - | 0.00% | - |
| 541.leela_r (max) | -2.27% | 44.000 | 43.000 | - | 0.00% | - |
| 549.fotonik3d_r (max) (percentage) | -2.24% | 1.340 | 1.310 | - | 0.00% | - |
| 507.cactuBSSN_r (avg) (percentage) | -1.98% | 1.010 | 0.990 | - | 0.00% | - |
| 549.fotonik3d_r | -1.85% | 54.000 | 53.000 | - | 0.00% | - |
| 549.fotonik3d_r (avg) | -1.85% | 54.000 | 53.000 | - | 0.00% | - |
| 505.mcf_r (max) | -1.79% | 56.000 | 55.000 | - | 0.00% | - |
| 541.leela_r (avg) (percentage) | -1.64% | 0.610 | 0.600 | - | 0.00% | - |
| 521.wrf_r (max) (percentage) | -1.56% | 3.200 | 3.150 | - | 0.00% | - |
| 507.cactuBSSN_r | -1.49% | 67.000 | 66.000 | - | 0.00% | - |
| 507.cactuBSSN_r (avg) | -1.49% | 67.000 | 66.000 | - | 0.00% | - |
| 505.mcf_r (avg) (percentage) | -1.05% | 0.950 | 0.940 | - | 0.00% | - |
| 541.leela_r (max) (percentage) | -1.03% | 0.970 | 0.960 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 500.perlbench_r (unexplained diff vs previous) |
| 500.perlbench_r (unexplained diff vs previous) (percentage) |
| 507.cactuBSSN_r (unexplained diff vs previous) |
| 507.cactuBSSN_r (unexplained diff vs previous) (percentage) |
| 508.namd_r (unexplained diff vs previous) |
| 508.namd_r (unexplained diff vs previous) (percentage) |
| 511.povray_r (unexplained diff vs previous) |
| 511.povray_r (unexplained diff vs previous) (percentage) |
| 521.wrf_r (unexplained diff vs previous) |
| 521.wrf_r (unexplained diff vs previous) (percentage) |
| 525.x264_r (unexplained diff vs previous) |
| 525.x264_r (unexplained diff vs previous) (percentage) |
| 538.imagick_r (unexplained diff vs previous) |
| 538.imagick_r (unexplained diff vs previous) (percentage) |
| 541.leela_r (unexplained diff vs previous) |
| 541.leela_r (unexplained diff vs previous) (percentage) |
| 544.nab_r (unexplained diff vs previous) |
| 544.nab_r (unexplained diff vs previous) (percentage) |
| 557.xz_r (unexplained diff vs previous) |
| 557.xz_r (unexplained diff vs previous) (percentage) |
| Performance Regressions - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 557.xz_r | 1.70% | 185326.000 | 188474.000 | - | 0.00% | - |
| Performance Regressions - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 521.wrf_r | 10.25% | 8650.000 | 9537.000 | - | 1.49% | - |
| 500.perlbench_r | 8.42% | 2008.000 | 2177.000 | - | -2.25% | - |
| 554.roms_r | 7.35% | 24297.000 | 26082.000 | - | -1.18% | - |
| 549.fotonik3d_r | 5.02% | 8572.000 | 9002.000 | - | -0.03% | - |
| 502.gcc_r | 1.90% | 3586.000 | 3654.000 | - | -0.90% | - |
| Performance Improvements - Code Size | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 521.wrf_r | -25.04% | 26771734.000 | 20068705.000 | - | 0.00% | - |
| 554.roms_r | -16.35% | 1093999.000 | 915154.000 | - | 0.00% | - |
| 549.fotonik3d_r | -11.53% | 409644.000 | 362424.000 | - | 0.00% | - |
| 505.mcf_r | -8.16% | 33037.000 | 30341.000 | - | 0.00% | - |
| 507.cactuBSSN_r | -6.33% | 4933079.000 | 4620686.000 | - | 0.00% | - |
| 508.namd_r | -5.81% | 856450.000 | 806648.000 | - | 0.00% | - |
| 531.deepsjeng_r | -4.60% | 107353.000 | 102417.000 | - | 0.00% | - |
| 544.nab_r | -2.55% | 201046.000 | 195918.000 | - | 0.00% | - |
| 525.x264_r | -1.74% | 582533.000 | 572392.000 | - | 0.00% | - |
| 538.imagick_r | -1.51% | 1969073.000 | 1939255.000 | - | 0.00% | - |
| 520.omnetpp_r | -1.42% | 1814986.000 | 1789231.000 | - | 0.00% | - |
| 541.leela_r | -1.19% | 184371.000 | 182176.000 | - | 0.00% | - |
| Performance Improvements - Execution | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| 520.omnetpp_r | -6.55% | 3617.000 | 3380.000 | - | -4.57% | - |
| 505.mcf_r | -4.18% | 6702.000 | 6422.000 | - | 0.77% | - |
| 531.deepsjeng_r | -3.28% | 5543.000 | 5361.000 | - | -0.45% | - |
| 519.lbm_r | -1.52% | 3300.000 | 3250.000 | - | -0.09% | - |
| 541.leela_r | -1.34% | 4610.000 | 4548.000 | - | -0.52% | - |
| 544.nab_r | -1.29% | 7929.000 | 7827.000 | - | 0.49% | - |
| 508.namd_r | -1.16% | 3789.000 | 3745.000 | - | -0.69% | - |
| Performance Improvements - Score | Δ (B) | Baseline | Current | σ (B) | Δ | σ |
|---|---|---|---|---|---|---|
| nb_total_tests | 100.00% | 20.000 | 40.000 | - | 0.00% | - |
| nb_compile_successful | 80.00% | 20.000 | 36.000 | - | 0.00% | - |
| nb_execution_successful | 80.00% | 20.000 | 36.000 | - | 0.00% | - |
| Added Tests - sample variability |
|---|
| 500.perlbench_r |
| 500.perlbench_r (avg) |
| 500.perlbench_r (avg) (percentage) |
| 500.perlbench_r (max) |
| 500.perlbench_r (max) (percentage) |
| 503.bwaves_r |
| 503.bwaves_r (avg) |
| 503.bwaves_r (avg) (percentage) |
| 503.bwaves_r (max) |
| 503.bwaves_r (max) (percentage) |
| 505.mcf_r |
| 505.mcf_r (avg) |
| 505.mcf_r (avg) (percentage) |
| 505.mcf_r (max) |
| 505.mcf_r (max) (percentage) |
| 507.cactuBSSN_r |
| 507.cactuBSSN_r (avg) |
| 507.cactuBSSN_r (avg) (percentage) |
| 507.cactuBSSN_r (max) |
| 507.cactuBSSN_r (max) (percentage) |
| 508.namd_r |
| 508.namd_r (avg) |
| 508.namd_r (avg) (percentage) |
| 508.namd_r (max) |
| 508.namd_r (max) (percentage) |
| 511.povray_r |
| 511.povray_r (avg) |
| 511.povray_r (avg) (percentage) |
| 511.povray_r (max) |
| 511.povray_r (max) (percentage) |
| 519.lbm_r |
| 519.lbm_r (avg) |
| 519.lbm_r (avg) (percentage) |
| 519.lbm_r (max) |
| 519.lbm_r (max) (percentage) |
| 520.omnetpp_r |
| 520.omnetpp_r (avg) |
| 520.omnetpp_r (avg) (percentage) |
| 520.omnetpp_r (max) |
| 520.omnetpp_r (max) (percentage) |
| 521.wrf_r |
| 521.wrf_r (avg) |
| 521.wrf_r (avg) (percentage) |
| 521.wrf_r (max) |
| 521.wrf_r (max) (percentage) |
| 525.x264_r |
| 525.x264_r (avg) |
| 525.x264_r (avg) (percentage) |
| 525.x264_r (max) |
| 525.x264_r (max) (percentage) |
| 527.cam4_r (avg) (percentage) |
| 527.cam4_r (max) (percentage) |
| 531.deepsjeng_r |
| 531.deepsjeng_r (avg) |
| 531.deepsjeng_r (avg) (percentage) |
| 531.deepsjeng_r (max) |
| 531.deepsjeng_r (max) (percentage) |
| 538.imagick_r |
| 538.imagick_r (avg) |
| 538.imagick_r (avg) (percentage) |
| 538.imagick_r (max) |
| 538.imagick_r (max) (percentage) |
| 541.leela_r |
| 541.leela_r (avg) |
| 541.leela_r (avg) (percentage) |
| 541.leela_r (max) |
| 541.leela_r (max) (percentage) |
| 544.nab_r |
| 544.nab_r (avg) |
| 544.nab_r (avg) (percentage) |
| 544.nab_r (max) |
| 544.nab_r (max) (percentage) |
| 548.exchange2_r (avg) (percentage) |
| 548.exchange2_r (max) (percentage) |
| 549.fotonik3d_r |
| 549.fotonik3d_r (avg) |
| 549.fotonik3d_r (avg) (percentage) |
| 549.fotonik3d_r (max) |
| 549.fotonik3d_r (max) (percentage) |
| 554.roms_r |
| 554.roms_r (avg) |
| 554.roms_r (avg) (percentage) |
| 554.roms_r (max) |
| 554.roms_r (max) (percentage) |
| 557.xz_r |
| 557.xz_r (avg) |
| 557.xz_r (avg) (percentage) |
| 557.xz_r (max) |
| 557.xz_r (max) (percentage) |
Report Time: 0.23s