Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=38b95a529385e32adc39428231c6fc8b0e8d6f21 (+ 41 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/003f388cddbbd3c8ff936f98355a90acda619030 (+ 186 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (+ 18 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2-build/14/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0014 (3-changed-components) 2023-05-06T04:49:09 0:00:00
Previous 0012 (3-changed-components) 2023-05-01T05:57:08 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T11:44:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 4
Performance Improvements 41 1
Added Tests 0 95
Unchanged Tests 763 722
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r 3.80% 3605.000 3742.000 - 2.24% -
511.povray_r 2.33% 430.000 440.000 - -0.23% -
505.mcf_r 1.08% 6036.000 6101.000 - -0.02% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (unexplained diff vs previous) 1216.67% 6.000 79.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 1200.00% 0.070 0.910 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 328.12% 32.000 137.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 311.24% 0.890 3.660 - 0.00% -
520.omnetpp_r (max) 39.22% 102.000 142.000 - 0.00% -
520.omnetpp_r (max) (percentage) 33.80% 2.840 3.800 - 0.00% -
520.omnetpp_r 29.09% 55.000 71.000 - 0.00% -
520.omnetpp_r (avg) 29.09% 55.000 71.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 24.68% 1.540 1.920 - 0.00% -
549.fotonik3d_r (avg) (percentage) 14.29% 0.490 0.560 - 0.00% -
549.fotonik3d_r 14.29% 42.000 48.000 - 0.00% -
549.fotonik3d_r (avg) 14.29% 42.000 48.000 - 0.00% -
549.fotonik3d_r (max) 2.60% 77.000 79.000 - 0.00% -
549.fotonik3d_r (max) (percentage) 1.11% 0.900 0.910 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_execution_successful -5.00% 20.000 19.000 - -5.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -31.58% 0.190 0.130 - 0.00% -
519.lbm_r (unexplained diff vs previous) -28.57% 7.000 5.000 - 0.00% -
519.lbm_r (avg) (percentage) -11.90% 0.420 0.370 - 0.00% -
557.xz_r (max) (percentage) -9.88% 2.530 2.280 - 0.00% -
557.xz_r (max) -9.84% 61.000 55.000 - 0.00% -
507.cactuBSSN_r (max) -8.89% 45.000 41.000 - 0.00% -
508.namd_r (max) -8.33% 24.000 22.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -8.20% 0.610 0.560 - 0.00% -
548.exchange2_r (max) (percentage) -7.69% 0.130 0.120 - 0.00% -
531.deepsjeng_r (max) (percentage) -7.41% 0.270 0.250 - 0.00% -
525.x264_r (max) -7.14% 14.000 13.000 - 0.00% -
531.deepsjeng_r (max) -7.14% 14.000 13.000 - 0.00% -
519.lbm_r -6.67% 15.000 14.000 - 0.00% -
519.lbm_r (avg) -6.67% 15.000 14.000 - 0.00% -
500.perlbench_r (max) (percentage) -6.51% 1.690 1.580 - 0.00% -
511.povray_r (max) (percentage) -6.28% 2.230 2.090 - 0.00% -
544.nab_r (max) -6.25% 32.000 30.000 - 0.00% -
500.perlbench_r (max) -5.88% 34.000 32.000 - 0.00% -
541.leela_r (max) -5.88% 17.000 16.000 - 0.00% -
505.mcf_r (max) (percentage) -5.82% 2.920 2.750 - 0.00% -
508.namd_r (max) (percentage) -5.80% 0.690 0.650 - 0.00% -
519.lbm_r (max) (percentage) -5.45% 0.550 0.520 - 0.00% -
527.cam4_r (max) -5.43% 92.000 87.000 - 0.00% -
503.bwaves_r (max) (percentage) -5.15% 1.360 1.290 - 0.00% -
503.bwaves_r (max) -5.13% 117.000 111.000 - 0.00% -
505.mcf_r (max) -5.11% 176.000 167.000 - 0.00% -
525.x264_r (max) (percentage) -5.00% 0.400 0.380 - 0.00% -
519.lbm_r (max) -5.00% 20.000 19.000 - 0.00% -
544.nab_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
538.imagick_r (max) (percentage) -4.80% 1.250 1.190 - 0.00% -
527.cam4_r (max) (percentage) -4.47% 3.580 3.420 - 0.00% -
500.perlbench_r -3.85% 26.000 25.000 - 0.00% -
500.perlbench_r (avg) -3.85% 26.000 25.000 - 0.00% -
538.imagick_r (max) -3.77% 53.000 51.000 - 0.00% -
554.roms_r (max) (percentage) -3.33% 1.500 1.450 - 0.00% -
541.leela_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
554.roms_r (max) -2.61% 459.000 447.000 - 0.00% -
521.wrf_r (max) (percentage) -2.59% 1.160 1.130 - 0.00% -
521.wrf_r (max) -1.80% 111.000 109.000 - 0.00% -
527.cam4_r -1.39% 72.000 71.000 - 0.00% -
527.cam4_r (avg) -1.39% 72.000 71.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 2.24% 3660.000 3742.000 - 3.80% -
527.cam4_r 1.99% 2516.000 2566.000 - -0.23% -
531.deepsjeng_r 1.00% 5274.000 5327.000 - 0.85% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful -5.00% 20.000 19.000 - -5.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r -2.32% 3874.000 3784.000 - 0.13% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 2046.000 -
503.bwaves_r 8676.000 -
505.mcf_r 6101.000 1.08%
507.cactuBSSN_r 7347.000 -
508.namd_r 3470.000 -
511.povray_r 440.000 2.33%
519.lbm_r 3784.000 -
520.omnetpp_r 3742.000 3.80%
521.wrf_r 9668.000 -
525.x264_r 3676.000 -
527.cam4_r 2566.000 -
531.deepsjeng_r 5327.000 -
538.imagick_r 4293.000 -
541.leela_r 5223.000 -
544.nab_r 7948.000 -
548.exchange2_r 2563.000 -
549.fotonik3d_r 8724.000 -
554.roms_r 30859.000 -
557.xz_r 2426.000 -
Geometric Mean 4492.188 -
Name Current %
500.perlbench_r 1881248.000 -
503.bwaves_r 28743.000 -
505.mcf_r 24893.000 -
507.cactuBSSN_r 3795005.000 -
508.namd_r 642828.000 -
511.povray_r 764572.000 -
519.lbm_r 13274.000 -
520.omnetpp_r 1572162.000 -
521.wrf_r 18636249.000 -
525.x264_r 437305.000 -
527.cam4_r 15739618.000 -
531.deepsjeng_r 90069.000 -
538.imagick_r 1667785.000 -
541.leela_r 128042.000 -
544.nab_r 149250.000 -
548.exchange2_r 63090.000 -
549.fotonik3d_r 333932.000 -
554.roms_r 691426.000 -
557.xz_r 171394.000 -
Geometric Mean 411985.627 -
Name Current %
nb_compile_successful 20.000 -
nb_execution_successful 19.000 -5.00%
nb_total_tests 20.000 -
Geometric Mean 19.661 -1.70%
Name Current %
500.perlbench_r 25.000 -3.85%
500.perlbench_r (avg) 25.000 -3.85%
500.perlbench_r (avg) (percentage) 1.260 -
500.perlbench_r (max) 32.000 -5.88%
500.perlbench_r (max) (percentage) 1.580 -6.51%
503.bwaves_r 87.000 -
503.bwaves_r (avg) 87.000 -
503.bwaves_r (avg) (percentage) 1.010 -
503.bwaves_r (max) 111.000 -5.13%
503.bwaves_r (max) (percentage) 1.290 -5.15%
505.mcf_r 62.000 -
505.mcf_r (avg) 62.000 -
505.mcf_r (avg) (percentage) 1.030 -
505.mcf_r (max) 167.000 -5.11%
505.mcf_r (max) (percentage) 2.750 -5.82%
507.cactuBSSN_r 33.000 -
507.cactuBSSN_r (avg) 33.000 -
507.cactuBSSN_r (avg) (percentage) 0.450 -
507.cactuBSSN_r (max) 41.000 -8.89%
507.cactuBSSN_r (max) (percentage) 0.560 -8.20%
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.430 -
508.namd_r (max) 22.000 -8.33%
508.namd_r (max) (percentage) 0.650 -5.80%
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.210 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.090 -6.28%
519.lbm_r 14.000 -6.67%
519.lbm_r (avg) 14.000 -6.67%
519.lbm_r (avg) (percentage) 0.370 -11.90%
519.lbm_r (max) 19.000 -5.00%
519.lbm_r (max) (percentage) 0.520 -5.45%
519.lbm_r (unexplained diff vs previous) 5.000 -28.57%
519.lbm_r (unexplained diff vs previous) (percentage) 0.130 -31.58%
520.omnetpp_r 71.000 29.09%
520.omnetpp_r (avg) 71.000 29.09%
520.omnetpp_r (avg) (percentage) 1.920 24.68%
520.omnetpp_r (max) 142.000 39.22%
520.omnetpp_r (max) (percentage) 3.800 33.80%
520.omnetpp_r (unexplained diff vs previous) 137.000 328.12%
520.omnetpp_r (unexplained diff vs previous) (percentage) 3.660 311.24%
521.wrf_r 66.000 -
521.wrf_r (avg) 66.000 -
521.wrf_r (avg) (percentage) 0.690 -
521.wrf_r (max) 109.000 -1.80%
521.wrf_r (max) (percentage) 1.130 -2.59%
525.x264_r 12.000 -
525.x264_r (avg) 12.000 -
525.x264_r (avg) (percentage) 0.350 -
525.x264_r (max) 13.000 -7.14%
525.x264_r (max) (percentage) 0.380 -5.00%
527.cam4_r 71.000 -1.39%
527.cam4_r (avg) 71.000 -1.39%
527.cam4_r (avg) (percentage) 2.800 -
527.cam4_r (max) 87.000 -5.43%
527.cam4_r (max) (percentage) 3.420 -4.47%
531.deepsjeng_r 16.000 -
531.deepsjeng_r (avg) 16.000 -
531.deepsjeng_r (avg) (percentage) 0.310 -
531.deepsjeng_r (max) 13.000 -7.14%
531.deepsjeng_r (max) (percentage) 0.250 -7.41%
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.530 -
538.imagick_r (max) 51.000 -3.77%
538.imagick_r (max) (percentage) 1.190 -4.80%
541.leela_r 13.000 -
541.leela_r (avg) 13.000 -
541.leela_r (avg) (percentage) 0.250 -
541.leela_r (max) 16.000 -5.88%
541.leela_r (max) (percentage) 0.320 -3.03%
544.nab_r 27.000 -
544.nab_r (avg) 27.000 -
544.nab_r (avg) (percentage) 0.340 -
544.nab_r (max) 30.000 -6.25%
544.nab_r (max) (percentage) 0.390 -4.88%
548.exchange2_r 4.000 -
548.exchange2_r (avg) 4.000 -
548.exchange2_r (avg) (percentage) 0.180 -
548.exchange2_r (max) 3.000 -
548.exchange2_r (max) (percentage) 0.120 -7.69%
549.fotonik3d_r 48.000 14.29%
549.fotonik3d_r (avg) 48.000 14.29%
549.fotonik3d_r (avg) (percentage) 0.560 14.29%
549.fotonik3d_r (max) 79.000 2.60%
549.fotonik3d_r (max) (percentage) 0.910 1.11%
549.fotonik3d_r (unexplained diff vs previous) 79.000 1216.67%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.910 1200.00%
554.roms_r 394.000 -
554.roms_r (avg) 394.000 -
554.roms_r (avg) (percentage) 1.280 -
554.roms_r (max) 447.000 -2.61%
554.roms_r (max) (percentage) 1.450 -3.33%
557.xz_r 25.000 -
557.xz_r (avg) 25.000 -
557.xz_r (avg) (percentage) 1.050 -
557.xz_r (max) 55.000 -9.84%
557.xz_r (max) (percentage) 2.280 -9.88%
Geometric Mean 7.060 6.99%