Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=2db414c36b4f030782c2c8a24c916c3033261af0 (+ 33 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/d7cbcfe7c33645eaf95f175f19884d443817857b (+ 202 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=54c1efdac55b756a4e2ea95590bcc3ba396a6568 (+ 13 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=b84a9523bab4a2483d7b7566b81a7859c2fd9a78 (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O2-build/205/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0205 (3-changed-components) 2024-06-01T14:53:08 0:00:00
Previous 0203 (3-changed-components) 2024-05-28T15:47:21 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T12:51:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 23 10
Performance Improvements 37 8
Added Tests 0 104
Unchanged Tests 864 802
Total Tests 924

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r 1.20% 300592.000 304206.000 - 2.97% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r 1.91% 10327.000 10524.000 - 10.77% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
508.namd_r (unexplained diff vs previous) (percentage) 475.00% 0.080 0.460 0.000 0.00% 0.000
508.namd_r (unexplained diff vs previous) 450.00% 8.000 44.000 0.000 0.00% 0.000
520.omnetpp_r (unexplained diff vs previous) (percentage) 118.75% 0.480 1.050 0.000 0.00% 0.000
520.omnetpp_r (unexplained diff vs previous) 116.42% 67.000 145.000 0.000 0.00% 0.000
503.bwaves_r (max) 100.00% 54.000 108.000 - 0.00% -
503.bwaves_r (max) (percentage) 100.00% 0.270 0.540 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 100.00% 0.270 0.540 0.000 0.00% 0.000
503.bwaves_r (unexplained diff vs previous) 98.18% 55.000 109.000 0.000 0.00% 0.000
508.namd_r (max) 69.23% 26.000 44.000 - 0.00% -
508.namd_r (max) (percentage) 67.86% 0.280 0.470 - 0.00% -
520.omnetpp_r (max) (percentage) 48.57% 0.700 1.040 - 0.00% -
520.omnetpp_r (max) 47.42% 97.000 143.000 - 0.00% -
505.mcf_r (max) 27.03% 37.000 47.000 - 0.00% -
505.mcf_r (max) (percentage) 24.14% 0.290 0.360 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) 24.14% 0.290 0.360 0.000 0.00% 0.000
505.mcf_r (unexplained diff vs previous) 23.68% 38.000 47.000 0.000 0.00% 0.000
503.bwaves_r (avg) (percentage) 3.85% 0.260 0.270 - 0.00% -
503.bwaves_r 3.85% 52.000 54.000 - 0.00% -
503.bwaves_r (avg) 3.85% 52.000 54.000 - 0.00% -
508.namd_r 3.03% 33.000 34.000 - 0.00% -
508.namd_r (avg) 3.03% 33.000 34.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -6.09% 15285.000 14354.000 - -1.51% -
511.povray_r -1.55% 21358.000 21026.000 - 2.41% -
520.omnetpp_r -1.04% 13971.000 13826.000 - -0.73% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r (unexplained diff vs previous) (percentage) -86.67% 0.150 0.020 0.000 0.00% 0.000
531.deepsjeng_r (unexplained diff vs previous) -84.62% 13.000 2.000 0.000 0.00% 0.000
521.wrf_r (max) -10.28% 574.000 515.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -8.70% 0.230 0.210 0.000 0.00% 0.000
557.xz_r (unexplained diff vs previous) -7.41% 27.000 25.000 0.000 0.00% 0.000
526.blender_r (max) -6.33% 158.000 148.000 - 0.00% -
526.blender_r (max) (percentage) -6.11% 1.310 1.230 - 0.00% -
511.povray_r (max) -6.01% 333.000 313.000 - 0.00% -
521.wrf_r -5.91% 372.000 350.000 - 0.00% -
521.wrf_r (avg) -5.91% 372.000 350.000 - 0.00% -
510.parest_r (max) (percentage) -5.88% 0.340 0.320 - 0.00% -
507.cactuBSSN_r (max) -5.81% 86.000 81.000 - 0.00% -
525.x264_r (max) -5.56% 18.000 17.000 - 0.00% -
554.roms_r (max) -5.41% 37.000 35.000 - 0.00% -
510.parest_r (max) -5.26% 76.000 72.000 - 0.00% -
531.deepsjeng_r -4.62% 65.000 62.000 - 0.00% -
531.deepsjeng_r (avg) -4.62% 65.000 62.000 - 0.00% -
554.roms_r (max) (percentage) -4.55% 0.220 0.210 - 0.00% -
521.wrf_r (max) (percentage) -4.52% 3.760 3.590 - 0.00% -
511.povray_r (max) (percentage) -4.49% 1.560 1.490 - 0.00% -
557.xz_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
507.cactuBSSN_r (max) (percentage) -4.35% 0.690 0.660 - 0.00% -
549.fotonik3d_r (max) (percentage) -4.30% 0.930 0.890 - 0.00% -
531.deepsjeng_r (avg) (percentage) -3.90% 0.770 0.740 - 0.00% -
557.xz_r (max) -3.85% 26.000 25.000 - 0.00% -
541.leela_r (max) (percentage) -3.79% 1.320 1.270 - 0.00% -
549.fotonik3d_r (max) -3.77% 159.000 153.000 - 0.00% -
544.nab_r (max) -3.03% 66.000 64.000 - 0.00% -
541.leela_r (max) -2.66% 188.000 183.000 - 0.00% -
544.nab_r (max) (percentage) -2.17% 0.460 0.450 - 0.00% -
500.perlbench_r -1.41% 71.000 70.000 - 0.00% -
500.perlbench_r (avg) -1.41% 71.000 70.000 - 0.00% -
507.cactuBSSN_r -1.32% 76.000 75.000 - 0.00% -
507.cactuBSSN_r (avg) -1.32% 76.000 75.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 7.12% 26133.000 27993.000 - 0.00% -
531.deepsjeng_r 6.07% 80953.000 85865.000 - 0.00% -
510.parest_r 4.36% 7617646.000 7949939.000 - -0.12% -
544.nab_r 3.02% 168219.000 173291.000 - 0.00% -
508.namd_r 3.00% 627430.000 646264.000 - 0.00% -
549.fotonik3d_r 2.97% 295442.000 304206.000 - 1.20% -
541.leela_r 1.94% 148119.000 150990.000 - 0.02% -
500.perlbench_r 1.10% 2118719.000 2141930.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 10.77% 9501.000 10524.000 - 1.91% -
511.povray_r 2.41% 20532.000 21026.000 - -1.55% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -3.59% 14976.000 14439.000 - 0.94% -
505.mcf_r -2.70% 13460.000 13096.000 - 0.36% -
507.cactuBSSN_r -2.62% 12742.000 12408.000 - -0.56% -
526.blender_r -2.44% 12385.000 12083.000 - -0.12% -
521.wrf_r -1.51% 14574.000 14354.000 - -6.09% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 100.00% 23.000 46.000 - 0.00% -
nb_compile_successful 82.61% 23.000 42.000 - 0.00% -
nb_execution_successful 82.61% 23.000 42.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13892.000 -
502.gcc_r 10522.000 -
503.bwaves_r 20066.000 -
505.mcf_r 13096.000 -
507.cactuBSSN_r 12408.000 -
508.namd_r 9469.000 -
510.parest_r 22598.000 -
511.povray_r 21026.000 -1.55%
519.lbm_r 14929.000 -
520.omnetpp_r 13826.000 -1.04%
521.wrf_r 14354.000 -6.09%
523.xalancbmk_r 13744.000 -
525.x264_r 10524.000 1.91%
526.blender_r 12083.000 -
531.deepsjeng_r 8498.000 -
538.imagick_r 15326.000 -
541.leela_r 14439.000 -
544.nab_r 14367.000 -
549.fotonik3d_r 17255.000 -
554.roms_r 17066.000 -
557.xz_r 11634.000 -
Geometric Mean 13913.080 -
Name Current %
500.perlbench_r 2141930.000 -
502.gcc_r 9132038.000 -
503.bwaves_r 27993.000 -
505.mcf_r 21232.000 -
507.cactuBSSN_r 3232685.000 -
508.namd_r 646264.000 -
510.parest_r 7949939.000 -
511.povray_r 846144.000 -
519.lbm_r 14161.000 -
520.omnetpp_r 2020179.000 -
521.wrf_r 17013048.000 -
523.xalancbmk_r 4502131.000 -
525.x264_r 445753.000 -
526.blender_r 9843779.000 -
531.deepsjeng_r 85865.000 -
538.imagick_r 1801906.000 -
541.leela_r 150990.000 -
544.nab_r 173291.000 -
549.fotonik3d_r 304206.000 1.20%
554.roms_r 664585.000 -
557.xz_r 189181.000 -
Geometric Mean 672829.333 -
Name Current %
500.perlbench_r 70.000 -1.41%
500.perlbench_r (avg) 70.000 -1.41%
500.perlbench_r (avg) (percentage) 0.510 -
500.perlbench_r (max) 104.000 -
500.perlbench_r (max) (percentage) 0.750 -
503.bwaves_r 54.000 3.85%
503.bwaves_r (avg) 54.000 3.85%
503.bwaves_r (avg) (percentage) 0.270 3.85%
503.bwaves_r (max) 108.000 100.00%
503.bwaves_r (max) (percentage) 0.540 100.00%
503.bwaves_r (unexplained diff vs previous) 109.000 98.18%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.540 100.00%
505.mcf_r 56.000 -
505.mcf_r (avg) 56.000 -
505.mcf_r (avg) (percentage) 0.430 -
505.mcf_r (max) 47.000 27.03%
505.mcf_r (max) (percentage) 0.360 24.14%
505.mcf_r (unexplained diff vs previous) 47.000 23.68%
505.mcf_r (unexplained diff vs previous) (percentage) 0.360 24.14%
507.cactuBSSN_r 75.000 -1.32%
507.cactuBSSN_r (avg) 75.000 -1.32%
507.cactuBSSN_r (avg) (percentage) 0.610 -
507.cactuBSSN_r (max) 81.000 -5.81%
507.cactuBSSN_r (max) (percentage) 0.660 -4.35%
508.namd_r 34.000 3.03%
508.namd_r (avg) 34.000 3.03%
508.namd_r (avg) (percentage) 0.360 -
508.namd_r (max) 44.000 69.23%
508.namd_r (max) (percentage) 0.470 67.86%
508.namd_r (unexplained diff vs previous) 44.000 450.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.460 475.00%
510.parest_r 40.000 -
510.parest_r (avg) 40.000 -
510.parest_r (avg) (percentage) 0.180 -
510.parest_r (max) 72.000 -5.26%
510.parest_r (max) (percentage) 0.320 -5.88%
511.povray_r 103.000 -
511.povray_r (avg) 103.000 -
511.povray_r (avg) (percentage) 0.490 -
511.povray_r (max) 313.000 -6.01%
511.povray_r (max) (percentage) 1.490 -4.49%
519.lbm_r 31.000 -
519.lbm_r (avg) 31.000 -
519.lbm_r (avg) (percentage) 0.210 -
519.lbm_r (max) 29.000 -
519.lbm_r (max) (percentage) 0.200 -
519.lbm_r (unexplained diff vs previous) 27.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.180 -
520.omnetpp_r 110.000 -
520.omnetpp_r (avg) 110.000 -
520.omnetpp_r (avg) (percentage) 0.800 -
520.omnetpp_r (max) 143.000 47.42%
520.omnetpp_r (max) (percentage) 1.040 48.57%
520.omnetpp_r (unexplained diff vs previous) 145.000 116.42%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.050 118.75%
521.wrf_r 350.000 -5.91%
521.wrf_r (avg) 350.000 -5.91%
521.wrf_r (avg) (percentage) 2.440 -
521.wrf_r (max) 515.000 -10.28%
521.wrf_r (max) (percentage) 3.590 -4.52%
523.xalancbmk_r 35.000 -
523.xalancbmk_r (avg) 35.000 -
523.xalancbmk_r (avg) (percentage) 0.260 -
523.xalancbmk_r (max) 27.000 -
523.xalancbmk_r (max) (percentage) 0.200 -
525.x264_r 14.000 -
525.x264_r (avg) 14.000 -
525.x264_r (avg) (percentage) 0.140 -
525.x264_r (max) 17.000 -5.56%
525.x264_r (max) (percentage) 0.170 -
526.blender_r 56.000 -
526.blender_r (avg) 56.000 -
526.blender_r (avg) (percentage) 0.470 -
526.blender_r (max) 148.000 -6.33%
526.blender_r (max) (percentage) 1.230 -6.11%
527.cam4_r (avg) (percentage) 0.380 -
527.cam4_r (max) (percentage) 0.580 -
531.deepsjeng_r 62.000 -4.62%
531.deepsjeng_r (avg) 62.000 -4.62%
531.deepsjeng_r (avg) (percentage) 0.740 -3.90%
531.deepsjeng_r (max) 14.000 -
531.deepsjeng_r (max) (percentage) 0.170 -
531.deepsjeng_r (unexplained diff vs previous) 2.000 -84.62%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.020 -86.67%
538.imagick_r 12.000 -
538.imagick_r (avg) 12.000 -
538.imagick_r (avg) (percentage) 0.080 -
538.imagick_r (max) 19.000 -
538.imagick_r (max) (percentage) 0.130 -
541.leela_r 67.000 -
541.leela_r (avg) 67.000 -
541.leela_r (avg) (percentage) 0.470 -
541.leela_r (max) 183.000 -2.66%
541.leela_r (max) (percentage) 1.270 -3.79%
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 64.000 -3.03%
544.nab_r (max) (percentage) 0.450 -2.17%
548.exchange2_r (avg) (percentage) 0.230 -
548.exchange2_r (max) (percentage) 0.210 -
549.fotonik3d_r 101.000 -
549.fotonik3d_r (avg) 101.000 -
549.fotonik3d_r (avg) (percentage) 0.590 -
549.fotonik3d_r (max) 153.000 -3.77%
549.fotonik3d_r (max) (percentage) 0.890 -4.30%
554.roms_r 51.000 -
554.roms_r (avg) 51.000 -
554.roms_r (avg) (percentage) 0.300 -
554.roms_r (max) 35.000 -5.41%
554.roms_r (max) (percentage) 0.210 -4.55%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 25.000 -3.85%
557.xz_r (max) (percentage) 0.220 -4.35%
557.xz_r (unexplained diff vs previous) 25.000 -7.41%
557.xz_r (unexplained diff vs previous) (percentage) 0.210 -8.70%
Geometric Mean 6.183 23.74%