Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a0094f1a70e1d5a7a8124e7c988fc1ddd1886f19 (+ 23 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/1acd4576435974f36dc91a8cc707cdcdccd049be (+ 72 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=2aa0974d2573441bffd596b07bff8698b1f2f18c (+ 1 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=87c70f5e18e519ad859e54636487afdabd89dfbd (+ 191 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3-build/92/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0092 (4-changed-components) 2023-10-21T05:37:23 0:00:00
Previous 0091 (3-changed-components) 2023-10-19T00:19:32 0:00:00
Baseline 0090 (4-changed-components) 2023-10-17T12:24:51 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 21 2
Performance Improvements 13 4
Added Tests 51 86
Unchanged Tests 767 760
Total Tests 852

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 288.89% 9.000 35.000 - 0.00% -
519.lbm_r (max) 277.78% 9.000 34.000 - 0.00% -
519.lbm_r (max) (percentage) 266.67% 0.060 0.220 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 266.67% 0.060 0.220 - 0.00% -
519.lbm_r 188.89% 9.000 26.000 - 0.00% -
519.lbm_r (avg) 188.89% 9.000 26.000 - 0.00% -
519.lbm_r (avg) (percentage) 183.33% 0.060 0.170 - 0.00% -
520.omnetpp_r (max) 61.54% 13.000 21.000 - 0.00% -
520.omnetpp_r (max) (percentage) 61.54% 0.130 0.210 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 61.54% 0.130 0.210 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 57.14% 14.000 22.000 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) 47.62% 21.000 31.000 - 0.00% -
507.cactuBSSN_r (max) 42.86% 21.000 30.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) 40.00% 0.100 0.140 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 40.00% 0.100 0.140 - 0.00% -
520.omnetpp_r 38.46% 13.000 18.000 - 0.00% -
520.omnetpp_r (avg) 38.46% 13.000 18.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 38.46% 0.130 0.180 - 0.00% -
507.cactuBSSN_r 33.33% 21.000 28.000 - 0.00% -
507.cactuBSSN_r (avg) 33.33% 21.000 28.000 - 0.00% -
507.cactuBSSN_r (avg) (percentage) 30.00% 0.100 0.130 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
548.exchange2_r -3.49% 9209.000 8888.000 - -3.62% -
549.fotonik3d_r -2.45% 18591.000 18136.000 - -2.43% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
544.nab_r (unexplained diff vs previous) (percentage) -87.50% 0.640 0.080 - 0.00% -
544.nab_r (unexplained diff vs previous) -86.84% 76.000 10.000 - 0.00% -
544.nab_r -57.89% 76.000 32.000 - 0.00% -
544.nab_r (avg) -57.89% 76.000 32.000 - 0.00% -
544.nab_r (avg) (percentage) -57.81% 0.640 0.270 - 0.00% -
544.nab_r (max) -26.32% 76.000 56.000 - 0.00% -
544.nab_r (max) (percentage) -25.00% 0.640 0.480 - 0.00% -
503.bwaves_r (max) -25.00% 48.000 36.000 - 0.00% -
548.exchange2_r (max) -25.00% 12.000 9.000 - 0.00% -
503.bwaves_r (max) (percentage) -23.81% 0.210 0.160 - 0.00% -
548.exchange2_r (max) (percentage) -21.43% 0.140 0.110 - 0.00% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 2.79% 12334.000 12678.000 - 0.21% -
527.cam4_r 1.28% 9947.000 10074.000 - 0.12% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -2.18% 108133.000 105781.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r -3.62% 9222.000 8888.000 - -3.49% -
549.fotonik3d_r -2.43% 18587.000 18136.000 - -2.45% -
523.xalancbmk_r -2.02% 9869.000 9670.000 - -0.09% -

Added Tests - sample variability
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.23s
Name Current %
500.perlbench_r 13282.000 -
502.gcc_r 8956.000 -
503.bwaves_r 23026.000 -
505.mcf_r 13575.000 -
507.cactuBSSN_r 21938.000 -
508.namd_r 9720.000 -
510.parest_r 21495.000 -
511.povray_r 17594.000 -
519.lbm_r 15738.000 -
520.omnetpp_r 10449.000 -
521.wrf_r 16476.000 -
523.xalancbmk_r 9670.000 -
525.x264_r 10857.000 -
526.blender_r 10870.000 -
527.cam4_r 10074.000 -
531.deepsjeng_r 12678.000 -
538.imagick_r 14145.000 -
541.leela_r 11209.000 -
544.nab_r 11871.000 -
548.exchange2_r 8888.000 -3.49%
549.fotonik3d_r 18136.000 -2.45%
554.roms_r 16989.000 -
557.xz_r 10498.000 -
Geometric Mean 13244.308 -
Name Current %
500.perlbench_r 2202404.000 -
502.gcc_r 9268215.000 -
503.bwaves_r 30947.000 -
505.mcf_r 36021.000 -
507.cactuBSSN_r 4949262.000 -
508.namd_r 905156.000 -
510.parest_r 8366991.000 -
511.povray_r 966172.000 -
519.lbm_r 14506.000 -
520.omnetpp_r 1790842.000 -
521.wrf_r 27035645.000 -
523.xalancbmk_r 4933254.000 -
525.x264_r 592272.000 -
526.blender_r 9337040.000 -
527.cam4_r 17246442.000 -
531.deepsjeng_r 105781.000 -
538.imagick_r 1985001.000 -
541.leela_r 183854.000 -
544.nab_r 202246.000 -
548.exchange2_r 159670.000 -
549.fotonik3d_r 404652.000 -
554.roms_r 1086882.000 -
557.xz_r 187970.000 -
Geometric Mean 856108.063 -
Name Current %
500.perlbench_r (max) 0.000 -
500.perlbench_r (max) (percentage) 0.000 -
502.gcc_r (max) 0.000 -
502.gcc_r (max) (percentage) 0.000 -
503.bwaves_r 48.000 -
503.bwaves_r (avg) 48.000 -
503.bwaves_r (avg) (percentage) 0.210 -
503.bwaves_r (max) 36.000 -25.00%
503.bwaves_r (max) (percentage) 0.160 -23.81%
505.mcf_r 16.000 -
505.mcf_r (avg) 16.000 -
505.mcf_r (avg) (percentage) 0.120 -
505.mcf_r (max) 16.000 -
505.mcf_r (max) (percentage) 0.120 -
505.mcf_r (unexplained diff vs previous) 16.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.120 -
507.cactuBSSN_r 28.000 33.33%
507.cactuBSSN_r (avg) 28.000 33.33%
507.cactuBSSN_r (avg) (percentage) 0.130 30.00%
507.cactuBSSN_r (max) 30.000 42.86%
507.cactuBSSN_r (max) (percentage) 0.140 40.00%
507.cactuBSSN_r (unexplained diff vs previous) 31.000 47.62%
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.140 40.00%
508.namd_r (max) 0.000 -
508.namd_r (max) (percentage) 0.000 -
510.parest_r 12.000 -
510.parest_r (avg) 12.000 -
510.parest_r (avg) (percentage) 0.060 -
510.parest_r (max) 12.000 -
510.parest_r (max) (percentage) 0.060 -
510.parest_r (unexplained diff vs previous) 13.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.060 -
511.povray_r (max) 0.000 -
511.povray_r (max) (percentage) 0.000 -
519.lbm_r 26.000 188.89%
519.lbm_r (avg) 26.000 188.89%
519.lbm_r (avg) (percentage) 0.170 183.33%
519.lbm_r (max) 34.000 277.78%
519.lbm_r (max) (percentage) 0.220 266.67%
519.lbm_r (unexplained diff vs previous) 35.000 288.89%
519.lbm_r (unexplained diff vs previous) (percentage) 0.220 266.67%
520.omnetpp_r 18.000 38.46%
520.omnetpp_r (avg) 18.000 38.46%
520.omnetpp_r (avg) (percentage) 0.180 38.46%
520.omnetpp_r (max) 21.000 61.54%
520.omnetpp_r (max) (percentage) 0.210 61.54%
520.omnetpp_r (unexplained diff vs previous) 22.000 57.14%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.210 61.54%
521.wrf_r (max) 0.000 -
521.wrf_r (max) (percentage) 0.000 -
523.xalancbmk_r 8.000 -
523.xalancbmk_r (avg) 8.000 -
523.xalancbmk_r (avg) (percentage) 0.090 -
523.xalancbmk_r (max) 8.000 -
523.xalancbmk_r (max) (percentage) 0.090 -
523.xalancbmk_r (unexplained diff vs previous) 9.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.090 -
525.x264_r (max) 0.000 -
525.x264_r (max) (percentage) 0.000 -
526.blender_r (max) 0.000 -
526.blender_r (max) (percentage) 0.000 -
531.deepsjeng_r 26.000 -
531.deepsjeng_r (avg) 26.000 -
531.deepsjeng_r (avg) (percentage) 0.210 -
531.deepsjeng_r (max) 26.000 -
531.deepsjeng_r (max) (percentage) 0.210 -
531.deepsjeng_r (unexplained diff vs previous) 27.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.210 -
538.imagick_r 36.000 -
538.imagick_r (avg) 36.000 -
538.imagick_r (avg) (percentage) 0.260 -
538.imagick_r (max) 36.000 -
538.imagick_r (max) (percentage) 0.260 -
538.imagick_r (unexplained diff vs previous) 37.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.260 -
541.leela_r 103.000 -
541.leela_r (avg) 103.000 -
541.leela_r (avg) (percentage) 0.920 -
541.leela_r (max) 103.000 -
541.leela_r (max) (percentage) 0.920 -
541.leela_r (unexplained diff vs previous) 104.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.930 -
544.nab_r 32.000 -57.89%
544.nab_r (avg) 32.000 -57.89%
544.nab_r (avg) (percentage) 0.270 -57.81%
544.nab_r (max) 56.000 -26.32%
544.nab_r (max) (percentage) 0.480 -25.00%
544.nab_r (unexplained diff vs previous) 10.000 -86.84%
544.nab_r (unexplained diff vs previous) (percentage) 0.080 -87.50%
548.exchange2_r 12.000 -
548.exchange2_r (avg) 12.000 -
548.exchange2_r (avg) (percentage) 0.140 -
548.exchange2_r (max) 9.000 -25.00%
548.exchange2_r (max) (percentage) 0.110 -21.43%
549.fotonik3d_r 3.000 -
549.fotonik3d_r (avg) 3.000 -
549.fotonik3d_r (avg) (percentage) 0.020 -
549.fotonik3d_r (max) 3.000 -
549.fotonik3d_r (max) (percentage) 0.020 -
554.roms_r (max) 0.000 -
554.roms_r (max) (percentage) 0.000 -
557.xz_r 3.000 -
557.xz_r (avg) 3.000 -
557.xz_r (avg) (percentage) 0.030 -
557.xz_r (max) 3.000 -
557.xz_r (max) (percentage) 0.030 -
557.xz_r (unexplained diff vs previous) 3.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.030 -
Geometric Mean 0.521 178.95%