Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1c37b30945073f34bbb685d2ac47ab01e0c93d45 (+ 93 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/3ec8ecb8e92faec889bc6f7aeac9ff59e82b4f7f (+ 286 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=c06e10c8130358c409c1d2837f8171ef70169d03 (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=c476bbdaa3d7d176526c35c3353242443b07a27e (+ 158 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/86/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0086 (4-changed-components) 2023-10-10T23:03:31 0:00:00
Previous 0082 (4-changed-components) 2023-10-03T03:07:25 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 12 15
Performance Improvements 38 2
Added Tests 2 110
Unchanged Tests 896 821
Total Tests 948

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r 1.68% 10031.000 10200.000 - 1.96% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) 1500.00% 1.000 16.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 1500.00% 0.010 0.160 - 0.00% -
508.namd_r (max) 275.00% 4.000 15.000 - 0.00% -
508.namd_r (max) (percentage) 220.00% 0.050 0.160 - 0.00% -
505.mcf_r (max) 42.86% 35.000 50.000 - 0.00% -
505.mcf_r (max) (percentage) 42.31% 0.260 0.370 - 0.00% -
523.xalancbmk_r 1.54% 65.000 66.000 - 0.00% -
523.xalancbmk_r (avg) 1.54% 65.000 66.000 - 0.00% -
523.xalancbmk_r (max) 1.38% 145.000 147.000 - 0.00% -
521.wrf_r 1.18% 85.000 86.000 - 0.00% -
521.wrf_r (avg) 1.18% 85.000 86.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r -1.26% 11408.000 11264.000 - 1.10% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) (percentage) -70.97% 1.240 0.360 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -70.83% 144.000 42.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -50.00% 0.080 0.040 - 0.00% -
520.omnetpp_r (max) -43.48% 230.000 130.000 - 0.00% -
520.omnetpp_r (max) (percentage) -43.22% 1.990 1.130 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -42.86% 14.000 8.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) -17.31% 52.000 43.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -16.13% 0.310 0.260 - 0.00% -
519.lbm_r (max) -13.46% 52.000 45.000 - 0.00% -
519.lbm_r (max) (percentage) -12.90% 0.310 0.270 - 0.00% -
549.fotonik3d_r (max) -8.00% 75.000 69.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -7.32% 0.410 0.380 - 0.00% -
554.roms_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
554.roms_r (max) -7.14% 28.000 26.000 - 0.00% -
525.x264_r (max) (percentage) -5.00% 0.200 0.190 - 0.00% -
548.exchange2_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
531.deepsjeng_r (max) -4.47% 179.000 171.000 - 0.00% -
548.exchange2_r (max) -3.85% 26.000 25.000 - 0.00% -
521.wrf_r (max) (percentage) -3.75% 2.670 2.570 - 0.00% -
525.x264_r (max) -3.57% 28.000 27.000 - 0.00% -
520.omnetpp_r -3.52% 142.000 137.000 - 0.00% -
520.omnetpp_r (avg) -3.52% 142.000 137.000 - 0.00% -
521.wrf_r (max) -3.34% 449.000 434.000 - 0.00% -
500.perlbench_r (max) -3.28% 122.000 118.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -3.25% 1.230 1.190 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.18% 1.570 1.520 - 0.00% -
544.nab_r (max) (percentage) -3.13% 0.320 0.310 - 0.00% -
544.nab_r (max) -2.63% 38.000 37.000 - 0.00% -
500.perlbench_r (max) (percentage) -2.15% 0.930 0.910 - 0.00% -
507.cactuBSSN_r (max) -1.97% 458.000 449.000 - 0.00% -
526.blender_r (max) (percentage) -1.32% 0.760 0.750 - 0.00% -
500.perlbench_r -1.25% 80.000 79.000 - 0.00% -
500.perlbench_r (avg) -1.25% 80.000 79.000 - 0.00% -
526.blender_r (max) -1.20% 83.000 82.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -1.16% 1.730 1.710 - 0.00% -
531.deepsjeng_r -1.05% 95.000 94.000 - 0.00% -
531.deepsjeng_r (avg) -1.05% 95.000 94.000 - 0.00% -

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 7.52% 28615.000 30767.000 - -0.03% -
541.leela_r 4.33% 126444.000 131919.000 - -0.09% -
510.parest_r 3.18% 6402190.000 6605603.000 - -0.03% -
548.exchange2_r 2.98% 62982.000 64862.000 - -0.31% -
521.wrf_r 2.18% 18630170.000 19036009.000 - -0.17% -
505.mcf_r 2.03% 24877.000 25381.000 - 0.00% -
508.namd_r 1.92% 643020.000 655356.000 - -0.03% -
549.fotonik3d_r 1.45% 333924.000 338756.000 - 0.00% -
500.perlbench_r 1.10% 1879803.000 1900440.000 - -0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
523.xalancbmk_r 1.96% 10004.000 10200.000 - 1.68% -
527.cam4_r 1.26% 10705.000 10840.000 - -0.39% -
505.mcf_r 1.17% 13471.000 13628.000 - 0.37% -
502.gcc_r 1.16% 9245.000 9352.000 - 0.04% -
531.deepsjeng_r 1.10% 11141.000 11264.000 - -1.26% -
548.exchange2_r 1.07% 11801.000 11927.000 - -0.76% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
523.xalancbmk_r -1.46% 3639697.000 3586398.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -6.24% 12900.000 12095.000 - 0.50% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13008.000 -
502.gcc_r 9352.000 -
503.bwaves_r 22950.000 -
505.mcf_r 13628.000 -
507.cactuBSSN_r 26304.000 -
508.namd_r 9828.000 -
510.parest_r 20801.000 -
511.povray_r 18125.000 -
519.lbm_r 16850.000 -
520.omnetpp_r 11531.000 -
521.wrf_r 16895.000 -
523.xalancbmk_r 10200.000 1.68%
525.x264_r 14259.000 -
526.blender_r 10962.000 -
527.cam4_r 10840.000 -
531.deepsjeng_r 11264.000 -1.26%
538.imagick_r 15494.000 -
541.leela_r 12738.000 -
544.nab_r 12095.000 -
548.exchange2_r 11927.000 -
549.fotonik3d_r 18416.000 -
554.roms_r 20468.000 -
557.xz_r 10669.000 -
Geometric Mean 14102.064 -
Name Current %
500.perlbench_r 1900440.000 -
502.gcc_r 8145743.000 -
503.bwaves_r 30767.000 -
505.mcf_r 25381.000 -
507.cactuBSSN_r 3803717.000 -
508.namd_r 655356.000 -
510.parest_r 6605603.000 -
511.povray_r 766796.000 -
519.lbm_r 13378.000 -
520.omnetpp_r 1572800.000 -
521.wrf_r 19036009.000 -
523.xalancbmk_r 3586398.000 -
525.x264_r 441189.000 -
526.blender_r 7863924.000 -
527.cam4_r 15864850.000 -
531.deepsjeng_r 90717.000 -
538.imagick_r 1668777.000 -
541.leela_r 131919.000 -
544.nab_r 150118.000 -
548.exchange2_r 64862.000 -
549.fotonik3d_r 338756.000 -
554.roms_r 693226.000 -
557.xz_r 171546.000 -
Geometric Mean 668385.098 -
Name Current %
500.perlbench_r 79.000 -1.25%
500.perlbench_r (avg) 79.000 -1.25%
500.perlbench_r (avg) (percentage) 0.610 -
500.perlbench_r (max) 118.000 -3.28%
500.perlbench_r (max) (percentage) 0.910 -2.15%
502.gcc_r 24.000 -
502.gcc_r (avg) 24.000 -
502.gcc_r (avg) (percentage) 0.260 -
502.gcc_r (max) 33.000 -
502.gcc_r (max) (percentage) 0.360 -
503.bwaves_r 64.000 -
503.bwaves_r (avg) 64.000 -
503.bwaves_r (avg) (percentage) 0.280 -
503.bwaves_r (max) 36.000 -
503.bwaves_r (max) (percentage) 0.160 -
505.mcf_r 40.000 -
505.mcf_r (avg) 40.000 -
505.mcf_r (avg) (percentage) 0.300 -
505.mcf_r (max) 50.000 42.86%
505.mcf_r (max) (percentage) 0.370 42.31%
505.mcf_r (unexplained diff vs previous) 50.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.370 -
507.cactuBSSN_r 165.000 -
507.cactuBSSN_r (avg) 165.000 -
507.cactuBSSN_r (avg) (percentage) 0.630 -
507.cactuBSSN_r (max) 449.000 -1.97%
507.cactuBSSN_r (max) (percentage) 1.710 -1.16%
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.160 -
508.namd_r (max) 15.000 275.00%
508.namd_r (max) (percentage) 0.160 220.00%
508.namd_r (unexplained diff vs previous) 16.000 1500.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.160 1500.00%
510.parest_r 18.000 -
510.parest_r (avg) 18.000 -
510.parest_r (avg) (percentage) 0.090 -
510.parest_r (max) 52.000 -
510.parest_r (max) (percentage) 0.250 -
511.povray_r 54.000 -
511.povray_r (avg) 54.000 -
511.povray_r (avg) (percentage) 0.300 -
511.povray_r (max) 110.000 -
511.povray_r (max) (percentage) 0.610 -
519.lbm_r 28.000 -
519.lbm_r (avg) 28.000 -
519.lbm_r (avg) (percentage) 0.170 -
519.lbm_r (max) 45.000 -13.46%
519.lbm_r (max) (percentage) 0.270 -12.90%
519.lbm_r (unexplained diff vs previous) 43.000 -17.31%
519.lbm_r (unexplained diff vs previous) (percentage) 0.260 -16.13%
520.omnetpp_r 137.000 -3.52%
520.omnetpp_r (avg) 137.000 -3.52%
520.omnetpp_r (avg) (percentage) 1.190 -3.25%
520.omnetpp_r (max) 130.000 -43.48%
520.omnetpp_r (max) (percentage) 1.130 -43.22%
520.omnetpp_r (unexplained diff vs previous) 42.000 -70.83%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.360 -70.97%
521.wrf_r 86.000 1.18%
521.wrf_r (avg) 86.000 1.18%
521.wrf_r (avg) (percentage) 0.510 -
521.wrf_r (max) 434.000 -3.34%
521.wrf_r (max) (percentage) 2.570 -3.75%
523.xalancbmk_r 66.000 1.54%
523.xalancbmk_r (avg) 66.000 1.54%
523.xalancbmk_r (avg) (percentage) 0.650 -
523.xalancbmk_r (max) 147.000 1.38%
523.xalancbmk_r (max) (percentage) 1.450 -
525.x264_r 18.000 -
525.x264_r (avg) 18.000 -
525.x264_r (avg) (percentage) 0.130 -
525.x264_r (max) 27.000 -3.57%
525.x264_r (max) (percentage) 0.190 -5.00%
526.blender_r 42.000 -
526.blender_r (avg) 42.000 -
526.blender_r (avg) (percentage) 0.390 -
526.blender_r (max) 82.000 -1.20%
526.blender_r (max) (percentage) 0.750 -1.32%
531.deepsjeng_r 94.000 -1.05%
531.deepsjeng_r (avg) 94.000 -1.05%
531.deepsjeng_r (avg) (percentage) 0.840 -
531.deepsjeng_r (max) 171.000 -4.47%
531.deepsjeng_r (max) (percentage) 1.520 -3.18%
538.imagick_r 55.000 -
538.imagick_r (avg) 55.000 -
538.imagick_r (avg) (percentage) 0.360 -
538.imagick_r (max) 60.000 -
538.imagick_r (max) (percentage) 0.390 -
541.leela_r 36.000 -
541.leela_r (avg) 36.000 -
541.leela_r (avg) (percentage) 0.290 -
541.leela_r (max) 49.000 -
541.leela_r (max) (percentage) 0.390 -
544.nab_r 36.000 -
544.nab_r (avg) 36.000 -
544.nab_r (avg) (percentage) 0.300 -
544.nab_r (max) 37.000 -2.63%
544.nab_r (max) (percentage) 0.310 -3.13%
548.exchange2_r 25.000 -
548.exchange2_r (avg) 25.000 -
548.exchange2_r (avg) (percentage) 0.210 -
548.exchange2_r (max) 25.000 -3.85%
548.exchange2_r (max) (percentage) 0.210 -4.55%
549.fotonik3d_r 16.000 -
549.fotonik3d_r (avg) 16.000 -
549.fotonik3d_r (avg) (percentage) 0.090 -
549.fotonik3d_r (max) 69.000 -8.00%
549.fotonik3d_r (max) (percentage) 0.380 -7.32%
549.fotonik3d_r (unexplained diff vs previous) 8.000 -42.86%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.040 -50.00%
554.roms_r 30.000 -
554.roms_r (avg) 30.000 -
554.roms_r (avg) (percentage) 0.150 -
554.roms_r (max) 26.000 -7.14%
554.roms_r (max) (percentage) 0.130 -7.14%
557.xz_r 8.000 -
557.xz_r (avg) 8.000 -
557.xz_r (avg) (percentage) 0.080 -
557.xz_r (max) 11.000 -
557.xz_r (max) (percentage) 0.110 -
Geometric Mean 5.935 1.43%