Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=077a1f08485e88f3b234af1dbb8b907b16045e6a (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/821ef93976e750c118d42a2ad33b96dbd1b9f3a5 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=4e506f67cbe6cd935377da65909f0606014459aa (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3_LTO-build/47/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0047 (-00000-) 2023-04-30T14:23:24 0:00:00
Previous 0046 (-00000-) 2023-04-30T03:28:01 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T16:28:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 31 6
Performance Improvements 58 6
Added Tests 4 95
Unchanged Tests 855 841
Total Tests 948

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (unexplained diff vs previous) 2300.00% 1.000 24.000 - 0.00% -
544.nab_r (unexplained diff vs previous) 2066.67% 3.000 65.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 1733.33% 0.030 0.550 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 1200.00% 0.010 0.130 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 600.00% 0.020 0.140 - 0.00% -
505.mcf_r (unexplained diff vs previous) 466.67% 3.000 17.000 - 0.00% -
523.xalancbmk_r (max) 430.30% 33.000 175.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 427.78% 0.360 1.900 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 380.00% 0.050 0.240 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 372.73% 11.000 52.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) 250.00% 0.020 0.070 - 0.00% -
548.exchange2_r (unexplained diff vs previous) 200.00% 2.000 6.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 100.00% 37.000 74.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 100.00% 0.320 0.640 - 0.00% -
505.mcf_r (max) (percentage) 55.56% 0.090 0.140 - 0.00% -
505.mcf_r (max) 54.55% 11.000 17.000 - 0.00% -
508.namd_r (unexplained diff vs previous) 50.00% 2.000 3.000 - 0.00% -
549.fotonik3d_r (max) 33.33% 18.000 24.000 - 0.00% -
549.fotonik3d_r (max) (percentage) 30.00% 0.100 0.130 - 0.00% -
523.xalancbmk_r (avg) (percentage) 27.08% 0.480 0.610 - 0.00% -
523.xalancbmk_r 24.44% 45.000 56.000 - 0.00% -
523.xalancbmk_r (avg) 24.44% 45.000 56.000 - 0.00% -
503.bwaves_r (max) (percentage) 20.00% 0.200 0.240 - 0.00% -
503.bwaves_r (max) 18.60% 43.000 51.000 - 0.00% -
544.nab_r (max) 8.33% 60.000 65.000 - 0.00% -
544.nab_r (avg) (percentage) 8.00% 0.250 0.270 - 0.00% -
544.nab_r (max) (percentage) 7.84% 0.510 0.550 - 0.00% -
544.nab_r 6.90% 29.000 31.000 - 0.00% -
544.nab_r (avg) 6.90% 29.000 31.000 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_compile_successful -21.74% 23.000 18.000 - -21.74% -
nb_execution_successful -21.74% 23.000 18.000 - -21.74% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -1.90% 9392.000 9214.000 - 0.75% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) (percentage) -95.60% 0.910 0.040 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -95.45% 110.000 5.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) -86.18% 152.000 21.000 - 0.00% -
521.wrf_r (unexplained diff vs previous) (percentage) -85.87% 0.920 0.130 - 0.00% -
500.perlbench_r (unexplained diff vs previous) (percentage) -75.68% 0.740 0.180 - 0.00% -
500.perlbench_r (unexplained diff vs previous) -75.00% 96.000 24.000 - 0.00% -
500.perlbench_r (max) (percentage) -60.74% 1.630 0.640 - 0.00% -
500.perlbench_r (max) -60.66% 211.000 83.000 - 0.00% -
531.deepsjeng_r (max) -58.62% 232.000 96.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -58.55% 1.930 0.800 - 0.00% -
541.leela_r (max) -48.00% 50.000 26.000 - 0.00% -
541.leela_r (max) (percentage) -48.00% 0.500 0.260 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -35.00% 0.200 0.130 - 0.00% -
519.lbm_r (unexplained diff vs previous) -33.33% 27.000 18.000 - 0.00% -
521.wrf_r (max) -16.56% 151.000 126.000 - 0.00% -
521.wrf_r (max) (percentage) -16.30% 0.920 0.770 - 0.00% -
519.lbm_r (max) (percentage) -10.53% 0.570 0.510 - 0.00% -
519.lbm_r (max) -10.39% 77.000 69.000 - 0.00% -
520.omnetpp_r (max) (percentage) -10.31% 0.970 0.870 - 0.00% -
520.omnetpp_r (max) -9.91% 111.000 100.000 - 0.00% -
541.leela_r -9.09% 44.000 40.000 - 0.00% -
541.leela_r (avg) -9.09% 44.000 40.000 - 0.00% -
541.leela_r (avg) (percentage) -9.09% 0.440 0.400 - 0.00% -
554.roms_r (max) (percentage) -8.82% 0.340 0.310 - 0.00% -
554.roms_r (max) -8.77% 57.000 52.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) -8.64% 0.810 0.740 - 0.00% -
531.deepsjeng_r -8.25% 97.000 89.000 - 0.00% -
531.deepsjeng_r (avg) -8.25% 97.000 89.000 - 0.00% -
557.xz_r (avg) (percentage) -7.69% 0.130 0.120 - 0.00% -
508.namd_r (max) -7.69% 13.000 12.000 - 0.00% -
548.exchange2_r (max) -7.69% 13.000 12.000 - 0.00% -
557.xz_r -7.69% 13.000 12.000 - 0.00% -
557.xz_r (avg) -7.69% 13.000 12.000 - 0.00% -
502.gcc_r (max) (percentage) -7.41% 0.540 0.500 - 0.00% -
507.cactuBSSN_r (max) (percentage) -7.36% 1.630 1.510 - 0.00% -
508.namd_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
508.namd_r -7.14% 14.000 13.000 - 0.00% -
508.namd_r (avg) -7.14% 14.000 13.000 - 0.00% -
510.parest_r (max) -6.45% 31.000 29.000 - 0.00% -
521.wrf_r -6.25% 80.000 75.000 - 0.00% -
521.wrf_r (avg) -6.25% 80.000 75.000 - 0.00% -
521.wrf_r (avg) (percentage) -6.12% 0.490 0.460 - 0.00% -
500.perlbench_r (avg) (percentage) -5.56% 0.720 0.680 - 0.00% -
500.perlbench_r -5.38% 93.000 88.000 - 0.00% -
500.perlbench_r (avg) -5.38% 93.000 88.000 - 0.00% -
548.exchange2_r -5.26% 19.000 18.000 - 0.00% -
548.exchange2_r (avg) -5.26% 19.000 18.000 - 0.00% -
511.povray_r (max) (percentage) -3.85% 0.260 0.250 - 0.00% -
519.lbm_r -3.57% 28.000 27.000 - 0.00% -
519.lbm_r (avg) -3.57% 28.000 27.000 - 0.00% -
525.x264_r (max) (percentage) -3.03% 0.330 0.320 - 0.00% -
538.imagick_r (max) -2.60% 77.000 75.000 - 0.00% -
526.blender_r (max) (percentage) -2.56% 0.390 0.380 - 0.00% -
520.omnetpp_r (avg) (percentage) -2.13% 0.940 0.920 - 0.00% -
520.omnetpp_r -1.87% 107.000 105.000 - 0.00% -
520.omnetpp_r (avg) -1.87% 107.000 105.000 - 0.00% -
538.imagick_r (max) (percentage) -1.82% 0.550 0.540 - 0.00% -

Added Tests - sample variability
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r 3.99% 11076.000 11518.000 - 0.65% -
500.perlbench_r 3.05% 12607.000 12992.000 - 0.19% -
521.wrf_r 1.32% 16247.000 16461.000 - 0.13% -
549.fotonik3d_r 1.23% 18607.000 18835.000 - 0.13% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -21.74% 23.000 18.000 - -21.74% -
nb_execution_successful -21.74% 23.000 18.000 - -21.74% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
520.omnetpp_r -4.11% 1620416.000 1553781.000 - 0.00% -
541.leela_r -3.81% 100201.000 96387.000 - 0.00% -
510.parest_r -2.07% 1675273.000 1640641.000 - -0.00% -
554.roms_r -1.31% 873970.000 862549.000 - -0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -8.79% 12966.000 11826.000 - -0.55% -
541.leela_r -3.62% 10449.000 10071.000 - -0.07% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r (avg) (percentage)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r (avg) (percentage)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r (avg) (percentage)
525.x264_r (max) (percentage)
526.blender_r (avg) (percentage)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 12992.000 -
503.bwaves_r 21643.000 -
505.mcf_r 12472.000 -
508.namd_r 9749.000 -
510.parest_r 21190.000 -
519.lbm_r 13664.000 -
520.omnetpp_r 11518.000 -
521.wrf_r 16461.000 -
523.xalancbmk_r 9214.000 -1.90%
527.cam4_r 9825.000 -
531.deepsjeng_r 12044.000 -
538.imagick_r 14066.000 -
541.leela_r 10071.000 -
544.nab_r 11826.000 -
548.exchange2_r 9072.000 -
549.fotonik3d_r 18835.000 -
554.roms_r 17070.000 -
557.xz_r 10462.000 -
Geometric Mean 12947.889 -
Name Current %
500.perlbench_r 2482546.000 -
503.bwaves_r 28114.000 -
505.mcf_r 28397.000 -
508.namd_r 854915.000 -
510.parest_r 1640641.000 -
519.lbm_r 11415.000 -
520.omnetpp_r 1553781.000 -
521.wrf_r 21187101.000 -
523.xalancbmk_r 3398993.000 -
527.cam4_r 3574276.000 -
531.deepsjeng_r 111739.000 -
538.imagick_r 1559091.000 -
541.leela_r 96387.000 -
544.nab_r 97375.000 -
548.exchange2_r 152826.000 -
549.fotonik3d_r 399322.000 -
554.roms_r 862549.000 -
557.xz_r 146083.000 -
Geometric Mean 419166.095 -
Name Current %
nb_compile_successful 18.000 -21.74%
nb_execution_successful 18.000 -21.74%
nb_total_tests 23.000 -
Geometric Mean 19.532 -15.08%
Name Current %
500.perlbench_r 88.000 -5.38%
500.perlbench_r (avg) 88.000 -5.38%
500.perlbench_r (avg) (percentage) 0.680 -5.56%
500.perlbench_r (max) 83.000 -60.66%
500.perlbench_r (max) (percentage) 0.640 -60.74%
500.perlbench_r (unexplained diff vs previous) 24.000 -75.00%
500.perlbench_r (unexplained diff vs previous) (percentage) 0.180 -75.68%
502.gcc_r (avg) (percentage) 0.290 -
502.gcc_r (max) (percentage) 0.500 -7.41%
503.bwaves_r 38.000 -
503.bwaves_r (avg) 38.000 -
503.bwaves_r (avg) (percentage) 0.180 -
503.bwaves_r (max) 51.000 18.60%
503.bwaves_r (max) (percentage) 0.240 20.00%
503.bwaves_r (unexplained diff vs previous) 52.000 372.73%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.240 380.00%
505.mcf_r 18.000 -
505.mcf_r (avg) 18.000 -
505.mcf_r (avg) (percentage) 0.150 -
505.mcf_r (max) 17.000 54.55%
505.mcf_r (max) (percentage) 0.140 55.56%
505.mcf_r (unexplained diff vs previous) 17.000 466.67%
505.mcf_r (unexplained diff vs previous) (percentage) 0.140 600.00%
507.cactuBSSN_r (avg) (percentage) 0.420 -
507.cactuBSSN_r (max) (percentage) 1.510 -7.36%
508.namd_r 13.000 -7.14%
508.namd_r (avg) 13.000 -7.14%
508.namd_r (avg) (percentage) 0.140 -
508.namd_r (max) 12.000 -7.69%
508.namd_r (max) (percentage) 0.130 -7.14%
508.namd_r (unexplained diff vs previous) 3.000 50.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.030 -
510.parest_r 25.000 -
510.parest_r (avg) 25.000 -
510.parest_r (avg) (percentage) 0.120 -
510.parest_r (max) 29.000 -6.45%
510.parest_r (max) (percentage) 0.140 -
511.povray_r (avg) (percentage) 0.190 -
511.povray_r (max) (percentage) 0.250 -3.85%
519.lbm_r 27.000 -3.57%
519.lbm_r (avg) 27.000 -3.57%
519.lbm_r (avg) (percentage) 0.200 -
519.lbm_r (max) 69.000 -10.39%
519.lbm_r (max) (percentage) 0.510 -10.53%
519.lbm_r (unexplained diff vs previous) 18.000 -33.33%
519.lbm_r (unexplained diff vs previous) (percentage) 0.130 -35.00%
520.omnetpp_r 105.000 -1.87%
520.omnetpp_r (avg) 105.000 -1.87%
520.omnetpp_r (avg) (percentage) 0.920 -2.13%
520.omnetpp_r (max) 100.000 -9.91%
520.omnetpp_r (max) (percentage) 0.870 -10.31%
520.omnetpp_r (unexplained diff vs previous) 74.000 100.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.640 100.00%
521.wrf_r 75.000 -6.25%
521.wrf_r (avg) 75.000 -6.25%
521.wrf_r (avg) (percentage) 0.460 -6.12%
521.wrf_r (max) 126.000 -16.56%
521.wrf_r (max) (percentage) 0.770 -16.30%
521.wrf_r (unexplained diff vs previous) 21.000 -86.18%
521.wrf_r (unexplained diff vs previous) (percentage) 0.130 -85.87%
523.xalancbmk_r 56.000 24.44%
523.xalancbmk_r (avg) 56.000 24.44%
523.xalancbmk_r (avg) (percentage) 0.610 27.08%
523.xalancbmk_r (max) 175.000 430.30%
523.xalancbmk_r (max) (percentage) 1.900 427.78%
523.xalancbmk_r (unexplained diff vs previous) 178.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 1.930 -
525.x264_r (avg) (percentage) 0.220 -
525.x264_r (max) (percentage) 0.320 -3.03%
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) (percentage) 0.380 -2.56%
531.deepsjeng_r 89.000 -8.25%
531.deepsjeng_r (avg) 89.000 -8.25%
531.deepsjeng_r (avg) (percentage) 0.740 -8.64%
531.deepsjeng_r (max) 96.000 -58.62%
531.deepsjeng_r (max) (percentage) 0.800 -58.55%
531.deepsjeng_r (unexplained diff vs previous) 5.000 -95.45%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.040 -95.60%
538.imagick_r 52.000 -
538.imagick_r (avg) 52.000 -
538.imagick_r (avg) (percentage) 0.370 -
538.imagick_r (max) 75.000 -2.60%
538.imagick_r (max) (percentage) 0.540 -1.82%
541.leela_r 40.000 -9.09%
541.leela_r (avg) 40.000 -9.09%
541.leela_r (avg) (percentage) 0.400 -9.09%
541.leela_r (max) 26.000 -48.00%
541.leela_r (max) (percentage) 0.260 -48.00%
541.leela_r (unexplained diff vs previous) 7.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.070 -
544.nab_r 31.000 6.90%
544.nab_r (avg) 31.000 6.90%
544.nab_r (avg) (percentage) 0.270 8.00%
544.nab_r (max) 65.000 8.33%
544.nab_r (max) (percentage) 0.550 7.84%
544.nab_r (unexplained diff vs previous) 65.000 2066.67%
544.nab_r (unexplained diff vs previous) (percentage) 0.550 1733.33%
548.exchange2_r 18.000 -5.26%
548.exchange2_r (avg) 18.000 -5.26%
548.exchange2_r (avg) (percentage) 0.200 -
548.exchange2_r (max) 12.000 -7.69%
548.exchange2_r (max) (percentage) 0.140 -
548.exchange2_r (unexplained diff vs previous) 6.000 200.00%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.070 250.00%
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 24.000 33.33%
549.fotonik3d_r (max) (percentage) 0.130 30.00%
549.fotonik3d_r (unexplained diff vs previous) 24.000 2300.00%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.130 1200.00%
554.roms_r 32.000 -
554.roms_r (avg) 32.000 -
554.roms_r (avg) (percentage) 0.190 -
554.roms_r (max) 52.000 -8.77%
554.roms_r (max) (percentage) 0.310 -8.82%
557.xz_r 12.000 -7.69%
557.xz_r (avg) 12.000 -7.69%
557.xz_r (avg) (percentage) 0.120 -7.69%
557.xz_r (max) 26.000 -
557.xz_r (max) (percentage) 0.250 -
557.xz_r (unexplained diff vs previous) 11.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.110 -
Geometric Mean 3.443 24.28%