Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=aa5b8b8cc3c0246f00617ec23ebf15203fd75242 (+ 120 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/39204ae9ddbfca710880d7f5fda48234a1e85e4e (+ 267 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=881546979d0219c18337e1b4f4d00cfacab13c40 (+ 34 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=f81dd77a54dc1b07631bd269cfc001434e4cf5b8 (+ 274 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O3-build/82/
Filter

gnu-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0082 (4-changed-components) 2023-07-28T14:55:25 0:00:00
Previous 0078 (4-changed-components) 2023-07-15T07:27:36 0:00:00
Baseline 0001 (4-changed-components) 2023-02-25T21:59:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 11 11
Performance Improvements 45 11
Added Tests 6 110
Unchanged Tests 886 816
Total Tests 948

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 2.35% 18791.000 19233.000 - 2.04% -
505.mcf_r 1.76% 13046.000 13275.000 - 1.94% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (max) 288.33% 60.000 233.000 - 0.00% -
505.mcf_r (max) (percentage) 282.61% 0.460 1.760 - 0.00% -
505.mcf_r 23.91% 46.000 57.000 - 0.00% -
505.mcf_r (avg) 23.91% 46.000 57.000 - 0.00% -
505.mcf_r (avg) (percentage) 19.44% 0.360 0.430 - 0.00% -
511.povray_r 2.02% 99.000 101.000 - 0.00% -
511.povray_r (avg) 2.02% 99.000 101.000 - 0.00% -
531.deepsjeng_r 1.47% 68.000 69.000 - 0.00% -
531.deepsjeng_r (avg) 1.47% 68.000 69.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r -3.77% 12539.000 12066.000 - -3.13% -
500.perlbench_r -1.79% 14061.000 13810.000 - -2.92% -
507.cactuBSSN_r -1.41% 12453.000 12277.000 - -1.96% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (max) (percentage) -17.86% 0.280 0.230 - 0.00% -
519.lbm_r (max) -16.67% 42.000 35.000 - 0.00% -
548.exchange2_r (max) -13.33% 30.000 26.000 - 0.00% -
548.exchange2_r (max) (percentage) -12.20% 0.410 0.360 - 0.00% -
549.fotonik3d_r (max) -9.30% 43.000 39.000 - 0.00% -
510.parest_r (max) -9.09% 33.000 30.000 - 0.00% -
507.cactuBSSN_r (max) -8.89% 135.000 123.000 - 0.00% -
520.omnetpp_r (max) -8.61% 151.000 138.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -8.33% 0.240 0.220 - 0.00% -
520.omnetpp_r (max) (percentage) -8.11% 1.110 1.020 - 0.00% -
507.cactuBSSN_r (max) (percentage) -7.34% 1.090 1.010 - 0.00% -
544.nab_r (max) (percentage) -6.49% 0.770 0.720 - 0.00% -
521.wrf_r (max) (percentage) -6.36% 2.830 2.650 - 0.00% -
521.wrf_r (max) -5.92% 338.000 318.000 - 0.00% -
554.roms_r (max) (percentage) -5.88% 0.340 0.320 - 0.00% -
554.roms_r (max) -5.77% 52.000 49.000 - 0.00% -
544.nab_r (max) -5.45% 110.000 104.000 - 0.00% -
527.cam4_r (max) (percentage) -5.41% 0.740 0.700 - 0.00% -
508.namd_r (max) -5.19% 77.000 73.000 - 0.00% -
541.leela_r (max) -5.17% 58.000 55.000 - 0.00% -
526.blender_r (max) -5.00% 80.000 76.000 - 0.00% -
527.cam4_r (max) -4.88% 82.000 78.000 - 0.00% -
508.namd_r (max) (percentage) -4.82% 0.830 0.790 - 0.00% -
526.blender_r (max) (percentage) -4.55% 0.660 0.630 - 0.00% -
541.leela_r -3.85% 26.000 25.000 - 0.00% -
541.leela_r (avg) -3.85% 26.000 25.000 - 0.00% -
500.perlbench_r (max) -3.48% 230.000 222.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -3.17% 2.210 2.140 - 0.00% -
548.exchange2_r -3.12% 32.000 31.000 - 0.00% -
548.exchange2_r (avg) -3.12% 32.000 31.000 - 0.00% -
523.xalancbmk_r -2.86% 35.000 34.000 - 0.00% -
523.xalancbmk_r (avg) -2.86% 35.000 34.000 - 0.00% -
511.povray_r (max) (percentage) -2.63% 1.140 1.110 - 0.00% -
531.deepsjeng_r (max) -2.60% 192.000 187.000 - 0.00% -
523.xalancbmk_r (max) -2.56% 39.000 38.000 - 0.00% -
525.x264_r (max) (percentage) -2.50% 0.400 0.390 - 0.00% -
548.exchange2_r (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
500.perlbench_r -2.13% 94.000 92.000 - 0.00% -
500.perlbench_r (avg) -2.13% 94.000 92.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.83% 1.640 1.610 - 0.00% -
507.cactuBSSN_r -1.52% 66.000 65.000 - 0.00% -
507.cactuBSSN_r (avg) -1.52% 66.000 65.000 - 0.00% -

Added Tests - sample variability
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
548.exchange2_r (unexplained diff vs previous)
548.exchange2_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 2.80% 30881.000 31745.000 - -0.05% -
507.cactuBSSN_r 2.14% 4208684.000 4298870.000 - 0.15% -
510.parest_r 1.98% 8613813.000 8784092.000 - -0.04% -
557.xz_r 1.81% 202253.000 205921.000 - -0.01% -
511.povray_r 1.06% 1004857.000 1015481.000 - -0.02% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r 3.98% 11563.000 12023.000 - 0.45% -
511.povray_r 2.04% 18848.000 19233.000 - 2.35% -
505.mcf_r 1.94% 13023.000 13275.000 - 1.76% -
544.nab_r 1.75% 14213.000 14462.000 - 0.39% -
519.lbm_r 1.70% 15084.000 15341.000 - 0.14% -
508.namd_r 1.23% 9234.000 9348.000 - -0.07% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.59% 405866.000 395338.000 - 0.05% -
505.mcf_r -2.07% 28776.000 28180.000 - 0.00% -
520.omnetpp_r -1.40% 2247841.000 2216319.000 - -0.14% -
508.namd_r -1.26% 738062.000 728760.000 - 0.64% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -3.40% 6441.000 6222.000 - -0.43% -
541.leela_r -3.13% 12456.000 12066.000 - -3.77% -
500.perlbench_r -2.92% 14226.000 13810.000 - -1.79% -
507.cactuBSSN_r -1.96% 12522.000 12277.000 - -1.41% -
520.omnetpp_r -1.44% 13826.000 13627.000 - -0.18% -
538.imagick_r -1.29% 15083.000 14888.000 - -0.32% -
523.xalancbmk_r -1.27% 13571.000 13398.000 - -0.48% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13810.000 -1.79%
502.gcc_r 10228.000 -
503.bwaves_r 20623.000 -
505.mcf_r 13275.000 1.76%
507.cactuBSSN_r 12277.000 -1.41%
508.namd_r 9348.000 -
510.parest_r 22126.000 -
511.povray_r 19233.000 2.35%
519.lbm_r 15341.000 -
520.omnetpp_r 13627.000 -
521.wrf_r 12023.000 -
523.xalancbmk_r 13398.000 -
525.x264_r 6222.000 -
526.blender_r 12159.000 -
527.cam4_r 11218.000 -
531.deepsjeng_r 8767.000 -
538.imagick_r 14888.000 -
541.leela_r 12066.000 -3.77%
544.nab_r 14462.000 -
548.exchange2_r 7404.000 -
549.fotonik3d_r 18063.000 -
554.roms_r 15330.000 -
557.xz_r 11580.000 -
Geometric Mean 12799.152 -
Name Current %
500.perlbench_r 2401212.000 -
502.gcc_r 10085986.000 -
503.bwaves_r 31745.000 -
505.mcf_r 28180.000 -
507.cactuBSSN_r 4298870.000 -
508.namd_r 728760.000 -
510.parest_r 8784092.000 -
511.povray_r 1015481.000 -
519.lbm_r 15117.000 -
520.omnetpp_r 2216319.000 -
521.wrf_r 20027025.000 -
523.xalancbmk_r 5527642.000 -
525.x264_r 630792.000 -
526.blender_r 11134809.000 -
527.cam4_r 18620798.000 -
531.deepsjeng_r 95833.000 -
538.imagick_r 2140740.000 -
541.leela_r 204082.000 -
544.nab_r 210251.000 -
548.exchange2_r 177617.000 -
549.fotonik3d_r 395338.000 -
554.roms_r 1062021.000 -
557.xz_r 205921.000 -
Geometric Mean 869117.275 -
Name Current %
500.perlbench_r 92.000 -2.13%
500.perlbench_r (avg) 92.000 -2.13%
500.perlbench_r (avg) (percentage) 0.670 -
500.perlbench_r (max) 222.000 -3.48%
500.perlbench_r (max) (percentage) 1.610 -1.83%
503.bwaves_r 74.000 -
503.bwaves_r (avg) 74.000 -
503.bwaves_r (avg) (percentage) 0.360 -
503.bwaves_r (max) 72.000 -
503.bwaves_r (max) (percentage) 0.350 -
505.mcf_r 57.000 23.91%
505.mcf_r (avg) 57.000 23.91%
505.mcf_r (avg) (percentage) 0.430 19.44%
505.mcf_r (max) 233.000 288.33%
505.mcf_r (max) (percentage) 1.760 282.61%
505.mcf_r (unexplained diff vs previous) 229.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 1.730 -
507.cactuBSSN_r 65.000 -1.52%
507.cactuBSSN_r (avg) 65.000 -1.52%
507.cactuBSSN_r (avg) (percentage) 0.530 -
507.cactuBSSN_r (max) 123.000 -8.89%
507.cactuBSSN_r (max) (percentage) 1.010 -7.34%
508.namd_r 53.000 -
508.namd_r (avg) 53.000 -
508.namd_r (avg) (percentage) 0.570 -
508.namd_r (max) 73.000 -5.19%
508.namd_r (max) (percentage) 0.790 -4.82%
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 30.000 -9.09%
510.parest_r (max) (percentage) 0.140 -
511.povray_r 101.000 2.02%
511.povray_r (avg) 101.000 2.02%
511.povray_r (avg) (percentage) 0.530 -
511.povray_r (max) 213.000 -
511.povray_r (max) (percentage) 1.110 -2.63%
519.lbm_r 38.000 -
519.lbm_r (avg) 38.000 -
519.lbm_r (avg) (percentage) 0.250 -
519.lbm_r (max) 35.000 -16.67%
519.lbm_r (max) (percentage) 0.230 -17.86%
519.lbm_r (unexplained diff vs previous) 22.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.140 -
520.omnetpp_r 87.000 -
520.omnetpp_r (avg) 87.000 -
520.omnetpp_r (avg) (percentage) 0.640 -
520.omnetpp_r (max) 138.000 -8.61%
520.omnetpp_r (max) (percentage) 1.020 -8.11%
521.wrf_r 212.000 -
521.wrf_r (avg) 212.000 -
521.wrf_r (avg) (percentage) 1.770 -
521.wrf_r (max) 318.000 -5.92%
521.wrf_r (max) (percentage) 2.650 -6.36%
523.xalancbmk_r 34.000 -2.86%
523.xalancbmk_r (avg) 34.000 -2.86%
523.xalancbmk_r (avg) (percentage) 0.260 -
523.xalancbmk_r (max) 38.000 -2.56%
523.xalancbmk_r (max) (percentage) 0.290 -
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.250 -
525.x264_r (max) 24.000 -
525.x264_r (max) (percentage) 0.390 -2.50%
526.blender_r 43.000 -
526.blender_r (avg) 43.000 -
526.blender_r (avg) (percentage) 0.360 -
526.blender_r (max) 76.000 -5.00%
526.blender_r (max) (percentage) 0.630 -4.55%
527.cam4_r 63.000 -
527.cam4_r (avg) 63.000 -
527.cam4_r (avg) (percentage) 0.570 -
527.cam4_r (max) 78.000 -4.88%
527.cam4_r (max) (percentage) 0.700 -5.41%
531.deepsjeng_r 69.000 1.47%
531.deepsjeng_r (avg) 69.000 1.47%
531.deepsjeng_r (avg) (percentage) 0.790 -
531.deepsjeng_r (max) 187.000 -2.60%
531.deepsjeng_r (max) (percentage) 2.140 -3.17%
538.imagick_r 22.000 -
538.imagick_r (avg) 22.000 -
538.imagick_r (avg) (percentage) 0.150 -
538.imagick_r (max) 38.000 -
538.imagick_r (max) (percentage) 0.260 -
541.leela_r 25.000 -3.85%
541.leela_r (avg) 25.000 -3.85%
541.leela_r (avg) (percentage) 0.210 -
541.leela_r (max) 55.000 -5.17%
541.leela_r (max) (percentage) 0.460 -
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 104.000 -5.45%
544.nab_r (max) (percentage) 0.720 -6.49%
548.exchange2_r 31.000 -3.12%
548.exchange2_r (avg) 31.000 -3.12%
548.exchange2_r (avg) (percentage) 0.430 -2.27%
548.exchange2_r (max) 26.000 -13.33%
548.exchange2_r (max) (percentage) 0.360 -12.20%
548.exchange2_r (unexplained diff vs previous) 22.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.300 -
549.fotonik3d_r 72.000 -
549.fotonik3d_r (avg) 72.000 -
549.fotonik3d_r (avg) (percentage) 0.400 -
549.fotonik3d_r (max) 39.000 -9.30%
549.fotonik3d_r (max) (percentage) 0.220 -8.33%
554.roms_r 42.000 -
554.roms_r (avg) 42.000 -
554.roms_r (avg) (percentage) 0.280 -
554.roms_r (max) 49.000 -5.77%
554.roms_r (max) (percentage) 0.320 -5.88%
557.xz_r 11.000 -
557.xz_r (avg) 11.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 12.000 -
557.xz_r (max) (percentage) 0.110 -
Geometric Mean 7.725 -2.23%