Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=025e84f93566c8ced594ef48ddee1dec7e5b4cdd (+ 55 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/8a96f240d71d367a2955ab9e0f0fef3a0b0e2a74 (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=87ced255bdf2681f5bf6c89d7121e59f6f342161 (+ 18 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=569306fa74e3adbe699e8548698815473469e440 (+ 235 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-O2-build/71/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0071 (3-changed-components) 2023-08-22T20:25:27 0:00:00
Previous 0068 (2-changed-components) 2023-08-17T13:07:25 0:00:00
Baseline 0001 (4-changed-components) 2023-03-26T11:44:58 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 44 2
Performance Improvements 59 7
Added Tests 0 95
Unchanged Tests 719 718
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
505.mcf_r 1.26% 6103.000 6180.000 - 1.28% -
500.perlbench_r 1.20% 2005.000 2029.000 - -1.36% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) 550.00% 4.000 26.000 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 545.45% 0.110 0.710 - 0.00% -
554.roms_r (unexplained diff vs previous) 442.22% 45.000 244.000 - 0.00% -
554.roms_r (unexplained diff vs previous) (percentage) 433.33% 0.150 0.800 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 291.30% 0.230 0.900 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 285.00% 20.000 77.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 187.50% 0.160 0.460 - 0.00% -
544.nab_r (unexplained diff vs previous) 184.62% 13.000 37.000 - 0.00% -
527.cam4_r (unexplained diff vs previous) (percentage) 118.31% 0.710 1.550 - 0.00% -
527.cam4_r (unexplained diff vs previous) 116.67% 18.000 39.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) (percentage) 108.00% 1.000 2.080 - 0.00% -
521.wrf_r (unexplained diff vs previous) 104.08% 98.000 200.000 - 0.00% -
521.wrf_r (max) (percentage) 101.98% 1.010 2.040 - 0.00% -
548.exchange2_r (unexplained diff vs previous) 100.00% 9.000 18.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) 100.00% 0.350 0.700 - 0.00% -
521.wrf_r (max) 97.98% 99.000 196.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) 77.78% 9.000 16.000 - 0.00% -
538.imagick_r (max) (percentage) 76.19% 0.210 0.370 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 76.19% 0.210 0.370 - 0.00% -
505.mcf_r (unexplained diff vs previous) 71.11% 45.000 77.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 68.92% 0.740 1.250 - 0.00% -
538.imagick_r (max) 66.67% 9.000 15.000 - 0.00% -
525.x264_r (max) (percentage) 48.94% 0.470 0.700 - 0.00% -
525.x264_r (max) 47.06% 17.000 25.000 - 0.00% -
541.leela_r (unexplained diff vs previous) 35.71% 14.000 19.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 33.33% 0.270 0.360 - 0.00% -
503.bwaves_r (max) (percentage) 32.84% 0.670 0.890 - 0.00% -
503.bwaves_r (max) 31.58% 57.000 75.000 - 0.00% -
527.cam4_r (max) 26.67% 30.000 38.000 - 0.00% -
527.cam4_r (max) (percentage) 26.45% 1.210 1.530 - 0.00% -
521.wrf_r (avg) (percentage) 21.79% 0.780 0.950 - 0.00% -
521.wrf_r 19.74% 76.000 91.000 - 0.00% -
521.wrf_r (avg) 19.74% 76.000 91.000 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) 18.25% 1.370 1.620 - 0.00% -
511.povray_r (unexplained diff vs previous) 16.67% 6.000 7.000 - 0.00% -
525.x264_r (avg) (percentage) 4.35% 0.460 0.480 - 0.00% -
538.imagick_r (avg) (percentage) 3.85% 0.260 0.270 - 0.00% -
527.cam4_r (avg) (percentage) 3.39% 1.180 1.220 - 0.00% -
511.povray_r (avg) (percentage) 3.33% 1.200 1.240 - 0.00% -
503.bwaves_r (avg) (percentage) 3.23% 0.620 0.640 - 0.00% -
503.bwaves_r 1.89% 53.000 54.000 - 0.00% -
503.bwaves_r (avg) 1.89% 53.000 54.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -2.04% 9824.000 9624.000 - -1.01% -
511.povray_r -1.59% 439.000 432.000 - -2.04% -
527.cam4_r -1.53% 2551.000 2512.000 - -0.16% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) (percentage) -61.54% 0.130 0.050 - 0.00% -
519.lbm_r (unexplained diff vs previous) -60.00% 5.000 2.000 - 0.00% -
549.fotonik3d_r (max) -55.43% 92.000 41.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -54.72% 1.060 0.480 - 0.00% -
500.perlbench_r (unexplained diff vs previous) (percentage) -46.12% 2.190 1.180 - 0.00% -
500.perlbench_r (unexplained diff vs previous) -45.45% 44.000 24.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -35.29% 0.170 0.110 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -33.33% 6.000 4.000 - 0.00% -
508.namd_r (unexplained diff vs previous) -31.25% 16.000 11.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -30.43% 0.460 0.320 - 0.00% -
500.perlbench_r (max) (percentage) -16.74% 2.150 1.790 - 0.00% -
500.perlbench_r (max) -16.28% 43.000 36.000 - 0.00% -
519.lbm_r (max) (percentage) -15.38% 0.130 0.110 - 0.00% -
511.povray_r (max) -14.29% 7.000 6.000 - 0.00% -
554.roms_r (max) -11.30% 354.000 314.000 - 0.00% -
505.mcf_r (max) (percentage) -11.19% 1.430 1.270 - 0.00% -
541.leela_r (max) -10.81% 74.000 66.000 - 0.00% -
541.leela_r (max) (percentage) -10.56% 1.420 1.270 - 0.00% -
554.roms_r (max) (percentage) -10.43% 1.150 1.030 - 0.00% -
505.mcf_r (max) -10.34% 87.000 78.000 - 0.00% -
548.exchange2_r (max) -9.52% 21.000 19.000 - 0.00% -
507.cactuBSSN_r -9.38% 32.000 29.000 - 0.00% -
507.cactuBSSN_r (avg) -9.38% 32.000 29.000 - 0.00% -
508.namd_r (max) (percentage) -9.09% 0.660 0.600 - 0.00% -
508.namd_r (max) -9.09% 22.000 20.000 - 0.00% -
507.cactuBSSN_r (avg) (percentage) -9.09% 0.440 0.400 - 0.00% -
520.omnetpp_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
544.nab_r (max) -8.33% 72.000 66.000 - 0.00% -
548.exchange2_r (max) (percentage) -8.33% 0.840 0.770 - 0.00% -
544.nab_r (max) (percentage) -7.78% 0.900 0.830 - 0.00% -
531.deepsjeng_r (avg) (percentage) -7.69% 0.390 0.360 - 0.00% -
519.lbm_r -7.69% 13.000 12.000 - 0.00% -
519.lbm_r (avg) -7.69% 13.000 12.000 - 0.00% -
557.xz_r (max) (percentage) -7.14% 1.400 1.300 - 0.00% -
520.omnetpp_r (avg) (percentage) -6.59% 0.910 0.850 - 0.00% -
520.omnetpp_r -6.25% 32.000 30.000 - 0.00% -
520.omnetpp_r (avg) -6.25% 32.000 30.000 - 0.00% -
557.xz_r (max) -6.06% 33.000 31.000 - 0.00% -
508.namd_r -5.56% 18.000 17.000 - 0.00% -
508.namd_r (avg) -5.56% 18.000 17.000 - 0.00% -
519.lbm_r (avg) (percentage) -5.56% 0.360 0.340 - 0.00% -
531.deepsjeng_r -5.00% 20.000 19.000 - 0.00% -
531.deepsjeng_r (avg) -5.00% 20.000 19.000 - 0.00% -
511.povray_r (max) (percentage) -4.79% 1.670 1.590 - 0.00% -
531.deepsjeng_r (max) -4.65% 43.000 41.000 - 0.00% -
557.xz_r (avg) (percentage) -4.55% 0.660 0.630 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -4.55% 44.000 42.000 - 0.00% -
507.cactuBSSN_r (max) -4.29% 70.000 67.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -4.17% 0.960 0.920 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -4.00% 0.500 0.480 - 0.00% -
508.namd_r (avg) (percentage) -3.77% 0.530 0.510 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.66% 0.820 0.790 - 0.00% -
549.fotonik3d_r -2.13% 47.000 46.000 - 0.00% -
549.fotonik3d_r (avg) -2.13% 47.000 46.000 - 0.00% -
500.perlbench_r (avg) (percentage) -2.04% 1.470 1.440 - 0.00% -
549.fotonik3d_r (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 1.28% 6102.000 6180.000 - 1.26% -
548.exchange2_r 1.02% 2547.000 2573.000 - -0.69% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r -2.66% 3874.000 3771.000 - -0.05% -
503.bwaves_r -2.52% 8747.000 8527.000 - -0.89% -
511.povray_r -2.04% 441.000 432.000 - -1.59% -
500.perlbench_r -1.36% 2057.000 2029.000 - 1.20% -
557.xz_r -1.15% 2430.000 2402.000 - 0.33% -
520.omnetpp_r -1.04% 3660.000 3622.000 - 0.11% -
521.wrf_r -1.01% 9722.000 9624.000 - -2.04% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 2029.000 1.20%
502.gcc_r 3723.000 -
503.bwaves_r 8527.000 -
505.mcf_r 6180.000 1.26%
507.cactuBSSN_r 7348.000 -
508.namd_r 3456.000 -
511.povray_r 432.000 -1.59%
519.lbm_r 3771.000 -
520.omnetpp_r 3622.000 -
521.wrf_r 9624.000 -2.04%
525.x264_r 3675.000 -
527.cam4_r 2512.000 -1.53%
531.deepsjeng_r 5284.000 -
538.imagick_r 4272.000 -
541.leela_r 5231.000 -
544.nab_r 7973.000 -
548.exchange2_r 2573.000 -
549.fotonik3d_r 8724.000 -
554.roms_r 30581.000 -
557.xz_r 2402.000 -
Geometric Mean 4423.441 -
Name Current %
500.perlbench_r 1879688.000 -
502.gcc_r 8087263.000 -
503.bwaves_r 28743.000 -
505.mcf_r 24837.000 -
507.cactuBSSN_r 3793417.000 -
508.namd_r 639964.000 -
511.povray_r 763980.000 -
519.lbm_r 13274.000 -
520.omnetpp_r 1570882.000 -
521.wrf_r 18630209.000 -
525.x264_r 437049.000 -
527.cam4_r 15734194.000 -
531.deepsjeng_r 89677.000 -
538.imagick_r 1661353.000 -
541.leela_r 128046.000 -
544.nab_r 149142.000 -
548.exchange2_r 63046.000 -
549.fotonik3d_r 333796.000 -
554.roms_r 691018.000 -
557.xz_r 171402.000 -
Geometric Mean 477599.502 -
Name Current %
500.perlbench_r 29.000 -
500.perlbench_r (avg) 29.000 -
500.perlbench_r (avg) (percentage) 1.440 -2.04%
500.perlbench_r (max) 36.000 -16.28%
500.perlbench_r (max) (percentage) 1.790 -16.74%
500.perlbench_r (unexplained diff vs previous) 24.000 -45.45%
500.perlbench_r (unexplained diff vs previous) (percentage) 1.180 -46.12%
503.bwaves_r 54.000 1.89%
503.bwaves_r (avg) 54.000 1.89%
503.bwaves_r (avg) (percentage) 0.640 3.23%
503.bwaves_r (max) 75.000 31.58%
503.bwaves_r (max) (percentage) 0.890 32.84%
503.bwaves_r (unexplained diff vs previous) 77.000 285.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.900 291.30%
505.mcf_r 81.000 -
505.mcf_r (avg) 81.000 -
505.mcf_r (avg) (percentage) 1.320 -
505.mcf_r (max) 78.000 -10.34%
505.mcf_r (max) (percentage) 1.270 -11.19%
505.mcf_r (unexplained diff vs previous) 77.000 71.11%
505.mcf_r (unexplained diff vs previous) (percentage) 1.250 68.92%
507.cactuBSSN_r 29.000 -9.38%
507.cactuBSSN_r (avg) 29.000 -9.38%
507.cactuBSSN_r (avg) (percentage) 0.400 -9.09%
507.cactuBSSN_r (max) 67.000 -4.29%
507.cactuBSSN_r (max) (percentage) 0.920 -4.17%
507.cactuBSSN_r (unexplained diff vs previous) 1.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.010 -
508.namd_r 17.000 -5.56%
508.namd_r (avg) 17.000 -5.56%
508.namd_r (avg) (percentage) 0.510 -3.77%
508.namd_r (max) 20.000 -9.09%
508.namd_r (max) (percentage) 0.600 -9.09%
508.namd_r (unexplained diff vs previous) 11.000 -31.25%
508.namd_r (unexplained diff vs previous) (percentage) 0.320 -30.43%
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.240 3.33%
511.povray_r (max) 6.000 -14.29%
511.povray_r (max) (percentage) 1.590 -4.79%
511.povray_r (unexplained diff vs previous) 7.000 16.67%
511.povray_r (unexplained diff vs previous) (percentage) 1.620 18.25%
519.lbm_r 12.000 -7.69%
519.lbm_r (avg) 12.000 -7.69%
519.lbm_r (avg) (percentage) 0.340 -5.56%
519.lbm_r (max) 4.000 -
519.lbm_r (max) (percentage) 0.110 -15.38%
519.lbm_r (unexplained diff vs previous) 2.000 -60.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.050 -61.54%
520.omnetpp_r 30.000 -6.25%
520.omnetpp_r (avg) 30.000 -6.25%
520.omnetpp_r (avg) (percentage) 0.850 -6.59%
520.omnetpp_r (max) 7.000 -
520.omnetpp_r (max) (percentage) 0.200 -9.09%
520.omnetpp_r (unexplained diff vs previous) 4.000 -33.33%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.110 -35.29%
521.wrf_r 91.000 19.74%
521.wrf_r (avg) 91.000 19.74%
521.wrf_r (avg) (percentage) 0.950 21.79%
521.wrf_r (max) 196.000 97.98%
521.wrf_r (max) (percentage) 2.040 101.98%
521.wrf_r (unexplained diff vs previous) 200.000 104.08%
521.wrf_r (unexplained diff vs previous) (percentage) 2.080 108.00%
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.480 4.35%
525.x264_r (max) 25.000 47.06%
525.x264_r (max) (percentage) 0.700 48.94%
525.x264_r (unexplained diff vs previous) 26.000 550.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.710 545.45%
527.cam4_r 30.000 -
527.cam4_r (avg) 30.000 -
527.cam4_r (avg) (percentage) 1.220 3.39%
527.cam4_r (max) 38.000 26.67%
527.cam4_r (max) (percentage) 1.530 26.45%
527.cam4_r (unexplained diff vs previous) 39.000 116.67%
527.cam4_r (unexplained diff vs previous) (percentage) 1.550 118.31%
531.deepsjeng_r 19.000 -5.00%
531.deepsjeng_r (avg) 19.000 -5.00%
531.deepsjeng_r (avg) (percentage) 0.360 -7.69%
531.deepsjeng_r (max) 41.000 -4.65%
531.deepsjeng_r (max) (percentage) 0.790 -3.66%
531.deepsjeng_r (unexplained diff vs previous) 3.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.060 -
538.imagick_r 11.000 -
538.imagick_r (avg) 11.000 -
538.imagick_r (avg) (percentage) 0.270 3.85%
538.imagick_r (max) 15.000 66.67%
538.imagick_r (max) (percentage) 0.370 76.19%
538.imagick_r (unexplained diff vs previous) 16.000 77.78%
538.imagick_r (unexplained diff vs previous) (percentage) 0.370 76.19%
541.leela_r 24.000 -
541.leela_r (avg) 24.000 -
541.leela_r (avg) (percentage) 0.460 -
541.leela_r (max) 66.000 -10.81%
541.leela_r (max) (percentage) 1.270 -10.56%
541.leela_r (unexplained diff vs previous) 19.000 35.71%
541.leela_r (unexplained diff vs previous) (percentage) 0.360 33.33%
544.nab_r 33.000 -
544.nab_r (avg) 33.000 -
544.nab_r (avg) (percentage) 0.420 -
544.nab_r (max) 66.000 -8.33%
544.nab_r (max) (percentage) 0.830 -7.78%
544.nab_r (unexplained diff vs previous) 37.000 184.62%
544.nab_r (unexplained diff vs previous) (percentage) 0.460 187.50%
548.exchange2_r 18.000 -
548.exchange2_r (avg) 18.000 -
548.exchange2_r (avg) (percentage) 0.700 -
548.exchange2_r (max) 19.000 -9.52%
548.exchange2_r (max) (percentage) 0.770 -8.33%
548.exchange2_r (unexplained diff vs previous) 18.000 100.00%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.700 100.00%
549.fotonik3d_r 46.000 -2.13%
549.fotonik3d_r (avg) 46.000 -2.13%
549.fotonik3d_r (avg) (percentage) 0.530 -1.85%
549.fotonik3d_r (max) 41.000 -55.43%
549.fotonik3d_r (max) (percentage) 0.480 -54.72%
549.fotonik3d_r (unexplained diff vs previous) 42.000 -4.55%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.480 -4.00%
554.roms_r 241.000 -
554.roms_r (avg) 241.000 -
554.roms_r (avg) (percentage) 0.790 -
554.roms_r (max) 314.000 -11.30%
554.roms_r (max) (percentage) 1.030 -10.43%
554.roms_r (unexplained diff vs previous) 244.000 442.22%
554.roms_r (unexplained diff vs previous) (percentage) 0.800 433.33%
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.630 -4.55%
557.xz_r (max) 31.000 -6.06%
557.xz_r (max) (percentage) 1.300 -7.14%
557.xz_r (unexplained diff vs previous) 8.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.330 -
Geometric Mean 5.165 62.35%