Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=86dfe011797b3e442622d427e9abd1e0f70f3a62 (+ 65 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/4d9bc81a5d8d884dee7a7781fa4c1577a6c9681a (+ 200 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=542b1105852568c3ebc712225ae78b8c8ba31a78 (+ 21 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=781419a9bed0586a8ee9c4761e4d961e3f6059aa (+ 205 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O2-build/75/
Filter

gnu-aarch64-master-O2 test results

Run Order Start Time Duration
Current 0075 (4-changed-components) 2023-07-30T01:31:07 0:00:00
Previous 0070 (4-changed-components) 2023-07-17T13:34:22 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T12:51:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 18 8
Performance Improvements 51 7
Added Tests 14 110
Unchanged Tests 865 823
Total Tests 948

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r 1.40% 296706.000 300866.000 - 1.84% -
554.roms_r 1.21% 667381.000 675469.000 - 1.13% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (max) 234.48% 29.000 97.000 - 0.00% -
519.lbm_r (max) (percentage) 231.58% 0.190 0.630 - 0.00% -
510.parest_r (max) (percentage) 62.50% 0.080 0.130 - 0.00% -
510.parest_r (max) 61.11% 18.000 29.000 - 0.00% -
503.bwaves_r (max) 50.00% 24.000 36.000 - 0.00% -
503.bwaves_r (max) (percentage) 50.00% 0.120 0.180 - 0.00% -
520.omnetpp_r (max) 44.29% 70.000 101.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 44.29% 70.000 101.000 - 0.00% -
520.omnetpp_r (max) (percentage) 44.00% 0.500 0.720 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 42.00% 0.500 0.710 - 0.00% -
519.lbm_r 10.26% 39.000 43.000 - 0.00% -
519.lbm_r (avg) 10.26% 39.000 43.000 - 0.00% -
519.lbm_r (avg) (percentage) 7.69% 0.260 0.280 - 0.00% -
508.namd_r 2.94% 34.000 35.000 - 0.00% -
508.namd_r (avg) 2.94% 34.000 35.000 - 0.00% -
508.namd_r (avg) (percentage) 2.70% 0.370 0.380 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r -1.66% 13916.000 13685.000 - -1.28% -
541.leela_r -1.09% 15175.000 15010.000 - 0.23% -
531.deepsjeng_r -1.06% 8522.000 8432.000 - -0.09% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) -60.96% 146.000 57.000 - 0.00% -
505.mcf_r (max) (percentage) -60.71% 1.120 0.440 - 0.00% -
505.mcf_r (unexplained diff vs previous) -60.26% 78.000 31.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -60.00% 0.600 0.240 - 0.00% -
548.exchange2_r (max) -35.19% 54.000 35.000 - 0.00% -
548.exchange2_r (max) (percentage) -35.00% 0.400 0.260 - 0.00% -
508.namd_r (max) -21.28% 94.000 74.000 - 0.00% -
508.namd_r (max) (percentage) -21.00% 1.000 0.790 - 0.00% -
557.xz_r (max) (percentage) -8.00% 0.250 0.230 - 0.00% -
557.xz_r (max) -7.14% 28.000 26.000 - 0.00% -
523.xalancbmk_r (max) -6.82% 44.000 41.000 - 0.00% -
548.exchange2_r -6.67% 30.000 28.000 - 0.00% -
548.exchange2_r (avg) -6.67% 30.000 28.000 - 0.00% -
523.xalancbmk_r (max) (percentage) -6.25% 0.320 0.300 - 0.00% -
554.roms_r (max) -6.25% 96.000 90.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -5.66% 1.060 1.000 - 0.00% -
549.fotonik3d_r (max) -5.56% 180.000 170.000 - 0.00% -
554.roms_r (max) (percentage) -5.36% 0.560 0.530 - 0.00% -
511.povray_r (max) -5.05% 99.000 94.000 - 0.00% -
541.leela_r (max) -4.94% 162.000 154.000 - 0.00% -
531.deepsjeng_r (max) -4.82% 83.000 79.000 - 0.00% -
544.nab_r -4.76% 42.000 40.000 - 0.00% -
544.nab_r (avg) -4.76% 42.000 40.000 - 0.00% -
548.exchange2_r (avg) (percentage) -4.55% 0.220 0.210 - 0.00% -
500.perlbench_r (max) -4.48% 223.000 213.000 - 0.00% -
500.perlbench_r (max) (percentage) -4.46% 1.570 1.500 - 0.00% -
544.nab_r (max) (percentage) -4.35% 0.230 0.220 - 0.00% -
527.cam4_r (max) -4.17% 24.000 23.000 - 0.00% -
511.povray_r (max) (percentage) -4.08% 0.490 0.470 - 0.00% -
531.deepsjeng_r (max) (percentage) -4.08% 0.980 0.940 - 0.00% -
541.leela_r (max) (percentage) -3.74% 1.070 1.030 - 0.00% -
505.mcf_r -3.74% 107.000 103.000 - 0.00% -
505.mcf_r (avg) -3.74% 107.000 103.000 - 0.00% -
505.mcf_r (avg) (percentage) -3.66% 0.820 0.790 - 0.00% -
521.wrf_r (max) (percentage) -3.61% 2.490 2.400 - 0.00% -
521.wrf_r (max) -3.61% 360.000 347.000 - 0.00% -
526.blender_r (max) -3.45% 87.000 84.000 - 0.00% -
544.nab_r (max) -3.03% 33.000 32.000 - 0.00% -
526.blender_r (max) (percentage) -2.82% 0.710 0.690 - 0.00% -
507.cactuBSSN_r (max) (percentage) -2.53% 1.580 1.540 - 0.00% -
507.cactuBSSN_r (max) -2.53% 198.000 193.000 - 0.00% -
531.deepsjeng_r -2.17% 46.000 45.000 - 0.00% -
531.deepsjeng_r (avg) -2.17% 46.000 45.000 - 0.00% -
541.leela_r -1.30% 77.000 76.000 - 0.00% -
541.leela_r (avg) -1.30% 77.000 76.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.25% 0.800 0.790 - 0.00% -
511.povray_r -1.18% 85.000 84.000 - 0.00% -
511.povray_r (avg) -1.18% 85.000 84.000 - 0.00% -

Added Tests - sample variability
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
548.exchange2_r (unexplained diff vs previous)
548.exchange2_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r 1.84% 295442.000 300866.000 - 1.40% -
541.leela_r 1.58% 148119.000 150462.000 - -0.05% -
554.roms_r 1.13% 667946.000 675469.000 - 1.21% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r 10.02% 9501.000 10453.000 - 0.72% -
519.lbm_r 2.77% 15005.000 15420.000 - 0.63% -
500.perlbench_r 1.99% 13933.000 14210.000 - -0.22% -
520.omnetpp_r 1.62% 13927.000 14152.000 - 0.72% -
544.nab_r 1.53% 14413.000 14634.000 - -0.04% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -1.61% 847676.000 834004.000 - 0.00% -
523.xalancbmk_r -1.43% 4498417.000 4434162.000 - -0.26% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -2.51% 13460.000 13122.000 - 0.24% -
511.povray_r -2.21% 20532.000 20078.000 - -0.90% -
507.cactuBSSN_r -1.34% 12742.000 12571.000 - -0.15% -
523.xalancbmk_r -1.28% 13863.000 13685.000 - -1.66% -
549.fotonik3d_r -1.21% 17301.000 17092.000 - 0.18% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.34s
Name Current %
500.perlbench_r 14210.000 -
502.gcc_r 10564.000 -
503.bwaves_r 20144.000 -
505.mcf_r 13122.000 -
507.cactuBSSN_r 12571.000 -
508.namd_r 9465.000 -
510.parest_r 22606.000 -
511.povray_r 20078.000 -
519.lbm_r 15420.000 -
520.omnetpp_r 14152.000 -
521.wrf_r 14473.000 -
523.xalancbmk_r 13685.000 -1.66%
525.x264_r 10453.000 -
526.blender_r 12277.000 -
527.cam4_r 11748.000 -
531.deepsjeng_r 8432.000 -1.06%
538.imagick_r 15289.000 -
541.leela_r 15010.000 -1.09%
544.nab_r 14634.000 -
548.exchange2_r 13626.000 -
549.fotonik3d_r 17092.000 -
554.roms_r 17047.000 -
557.xz_r 11583.000 -
Geometric Mean 13858.800 -
Name Current %
500.perlbench_r 2121108.000 -
502.gcc_r 9088370.000 -
503.bwaves_r 26265.000 -
505.mcf_r 20940.000 -
507.cactuBSSN_r 3174806.000 -
508.namd_r 625688.000 -
510.parest_r 7688736.000 -
511.povray_r 834004.000 -
519.lbm_r 14121.000 -
520.omnetpp_r 2012423.000 -
521.wrf_r 16862697.000 -
523.xalancbmk_r 4434162.000 -
525.x264_r 439625.000 -
526.blender_r 9744242.000 -
527.cam4_r 17609822.000 -
531.deepsjeng_r 80961.000 -
538.imagick_r 1792188.000 -
541.leela_r 150462.000 -
544.nab_r 167179.000 -
548.exchange2_r 60221.000 -
549.fotonik3d_r 300866.000 1.40%
554.roms_r 675469.000 1.21%
557.xz_r 188493.000 -
Geometric Mean 687735.929 -
Name Current %
500.perlbench_r 119.000 -
500.perlbench_r (avg) 119.000 -
500.perlbench_r (avg) (percentage) 0.840 -
500.perlbench_r (max) 213.000 -4.48%
500.perlbench_r (max) (percentage) 1.500 -4.46%
503.bwaves_r 52.000 -
503.bwaves_r (avg) 52.000 -
503.bwaves_r (avg) (percentage) 0.260 -
503.bwaves_r (max) 36.000 50.00%
503.bwaves_r (max) (percentage) 0.180 50.00%
503.bwaves_r (unexplained diff vs previous) 37.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.180 -
505.mcf_r 103.000 -3.74%
505.mcf_r (avg) 103.000 -3.74%
505.mcf_r (avg) (percentage) 0.790 -3.66%
505.mcf_r (max) 57.000 -60.96%
505.mcf_r (max) (percentage) 0.440 -60.71%
505.mcf_r (unexplained diff vs previous) 31.000 -60.26%
505.mcf_r (unexplained diff vs previous) (percentage) 0.240 -60.00%
507.cactuBSSN_r 66.000 -
507.cactuBSSN_r (avg) 66.000 -
507.cactuBSSN_r (avg) (percentage) 0.530 -
507.cactuBSSN_r (max) 193.000 -2.53%
507.cactuBSSN_r (max) (percentage) 1.540 -2.53%
508.namd_r 35.000 2.94%
508.namd_r (avg) 35.000 2.94%
508.namd_r (avg) (percentage) 0.380 2.70%
508.namd_r (max) 74.000 -21.28%
508.namd_r (max) (percentage) 0.790 -21.00%
508.namd_r (unexplained diff vs previous) 42.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.440 -
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.100 -
510.parest_r (max) 29.000 61.11%
510.parest_r (max) (percentage) 0.130 62.50%
510.parest_r (unexplained diff vs previous) 29.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.130 -
511.povray_r 84.000 -1.18%
511.povray_r (avg) 84.000 -1.18%
511.povray_r (avg) (percentage) 0.420 -
511.povray_r (max) 94.000 -5.05%
511.povray_r (max) (percentage) 0.470 -4.08%
519.lbm_r 43.000 10.26%
519.lbm_r (avg) 43.000 10.26%
519.lbm_r (avg) (percentage) 0.280 7.69%
519.lbm_r (max) 97.000 234.48%
519.lbm_r (max) (percentage) 0.630 231.58%
519.lbm_r (unexplained diff vs previous) 97.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.630 -
520.omnetpp_r 111.000 -
520.omnetpp_r (avg) 111.000 -
520.omnetpp_r (avg) (percentage) 0.790 -1.25%
520.omnetpp_r (max) 101.000 44.29%
520.omnetpp_r (max) (percentage) 0.720 44.00%
520.omnetpp_r (unexplained diff vs previous) 101.000 44.29%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.710 42.00%
521.wrf_r 218.000 -
521.wrf_r (avg) 218.000 -
521.wrf_r (avg) (percentage) 1.510 -
521.wrf_r (max) 347.000 -3.61%
521.wrf_r (max) (percentage) 2.400 -3.61%
523.xalancbmk_r 34.000 -
523.xalancbmk_r (avg) 34.000 -
523.xalancbmk_r (avg) (percentage) 0.250 -
523.xalancbmk_r (max) 41.000 -6.82%
523.xalancbmk_r (max) (percentage) 0.300 -6.25%
525.x264_r 30.000 -
525.x264_r (avg) 30.000 -
525.x264_r (avg) (percentage) 0.290 -
525.x264_r (max) 30.000 -
525.x264_r (max) (percentage) 0.290 -
526.blender_r 39.000 -
526.blender_r (avg) 39.000 -
526.blender_r (avg) (percentage) 0.320 -
526.blender_r (max) 84.000 -3.45%
526.blender_r (max) (percentage) 0.690 -2.82%
527.cam4_r 38.000 -
527.cam4_r (avg) 38.000 -
527.cam4_r (avg) (percentage) 0.330 -
527.cam4_r (max) 23.000 -4.17%
527.cam4_r (max) (percentage) 0.200 -
531.deepsjeng_r 45.000 -2.17%
531.deepsjeng_r (avg) 45.000 -2.17%
531.deepsjeng_r (avg) (percentage) 0.540 -
531.deepsjeng_r (max) 79.000 -4.82%
531.deepsjeng_r (max) (percentage) 0.940 -4.08%
538.imagick_r 13.000 -
538.imagick_r (avg) 13.000 -
538.imagick_r (avg) (percentage) 0.090 -
538.imagick_r (max) 16.000 -
538.imagick_r (max) (percentage) 0.110 -
541.leela_r 76.000 -1.30%
541.leela_r (avg) 76.000 -1.30%
541.leela_r (avg) (percentage) 0.510 -
541.leela_r (max) 154.000 -4.94%
541.leela_r (max) (percentage) 1.030 -3.74%
544.nab_r 40.000 -4.76%
544.nab_r (avg) 40.000 -4.76%
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 32.000 -3.03%
544.nab_r (max) (percentage) 0.220 -4.35%
544.nab_r (unexplained diff vs previous) 6.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.040 -
548.exchange2_r 28.000 -6.67%
548.exchange2_r (avg) 28.000 -6.67%
548.exchange2_r (avg) (percentage) 0.210 -4.55%
548.exchange2_r (max) 35.000 -35.19%
548.exchange2_r (max) (percentage) 0.260 -35.00%
548.exchange2_r (unexplained diff vs previous) 17.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.120 -
549.fotonik3d_r 136.000 -
549.fotonik3d_r (avg) 136.000 -
549.fotonik3d_r (avg) (percentage) 0.800 -
549.fotonik3d_r (max) 170.000 -5.56%
549.fotonik3d_r (max) (percentage) 1.000 -5.66%
554.roms_r 68.000 -
554.roms_r (avg) 68.000 -
554.roms_r (avg) (percentage) 0.400 -
554.roms_r (max) 90.000 -6.25%
554.roms_r (max) (percentage) 0.530 -5.36%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 26.000 -7.14%
557.xz_r (max) (percentage) 0.230 -8.00%
557.xz_r (unexplained diff vs previous) 11.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.090 -
Geometric Mean 6.587 -14.41%