Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=943e09db6058e10dbb5f9be9d58a46b6706a8b01 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c58b426d64ac2513dc0ed19165740604e891e9df (+ 105 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d1dcb565a1fb5829f9476a1438c30eccc4027d04 (+ 2 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=288a2f83ed42ce91cf92c2b08dad298a3da0cd9a (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3-build/97/
View Options
Report
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0097 (3-changed-components) 2023-11-08T05:16:07 0:00:00
Previous 0097 (3-changed-components) 2023-11-08T05:16:07 0:00:00
Baseline 0090 (4-changed-components) 2023-10-17T12:24:51 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 2
Performance Improvements 0 8
Added Tests 3 110
Unchanged Tests 945 828
Total Tests 948

Run-Over-Run Changes Detail

Added Tests - sample variability
502.gcc_r
502.gcc_r (avg)
502.gcc_r (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 3.01% 12334.000 12705.000 - 0.00% -
511.povray_r 2.54% 17737.000 18187.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -2.26% 108133.000 105685.000 - 0.00% -
511.povray_r -1.29% 966116.000 953692.000 - 0.00% -
502.gcc_r -1.14% 9267975.000 9161999.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r -3.65% 9222.000 8885.000 - 0.00% -
549.fotonik3d_r -2.41% 18587.000 18139.000 - 0.00% -
523.xalancbmk_r -2.16% 9869.000 9656.000 - 0.00% -
520.omnetpp_r -1.59% 10457.000 10291.000 - 0.00% -
526.blender_r -1.23% 10851.000 10718.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.35s
Execution (seconds)
Name Current %
500.perlbench_r 13310.000 -
502.gcc_r 8885.000 -
503.bwaves_r 23046.000 -
505.mcf_r 13543.000 -
507.cactuBSSN_r 22104.000 -
508.namd_r 9725.000 -
510.parest_r 21477.000 -
511.povray_r 18187.000 -
519.lbm_r 15724.000 -
520.omnetpp_r 10291.000 -
521.wrf_r 16480.000 -
523.xalancbmk_r 9656.000 -
525.x264_r 10914.000 -
526.blender_r 10718.000 -
527.cam4_r 10004.000 -
531.deepsjeng_r 12705.000 -
538.imagick_r 14290.000 -
541.leela_r 11176.000 -
544.nab_r 11832.000 -
548.exchange2_r 8885.000 -
549.fotonik3d_r 18139.000 -
554.roms_r 17013.000 -
557.xz_r 10452.000 -
Geometric Mean 13245.922 -
Code Size (bytes)
Name Current %
500.perlbench_r 2181036.000 -
502.gcc_r 9161999.000 -
503.bwaves_r 31019.000 -
505.mcf_r 36029.000 -
507.cactuBSSN_r 4949298.000 -
508.namd_r 905364.000 -
510.parest_r 8367035.000 -
511.povray_r 953692.000 -
519.lbm_r 14498.000 -
520.omnetpp_r 1784386.000 -
521.wrf_r 26987153.000 -
523.xalancbmk_r 4924870.000 -
525.x264_r 592096.000 -
526.blender_r 9320476.000 -
527.cam4_r 17243134.000 -
531.deepsjeng_r 105685.000 -
538.imagick_r 1972849.000 -
541.leela_r 183886.000 -
544.nab_r 201666.000 -
548.exchange2_r 159298.000 -
549.fotonik3d_r 404648.000 -
554.roms_r 1086162.000 -
557.xz_r 187530.000 -
Geometric Mean 854007.302 -
sample variability
Name Current %
500.perlbench_r 31.000 -
500.perlbench_r (avg) 31.000 -
500.perlbench_r (avg) (percentage) 0.240 -
500.perlbench_r (max) 31.000 -
500.perlbench_r (max) (percentage) 0.240 -
500.perlbench_r (unexplained diff vs previous) 32.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.240 -
502.gcc_r 0.000 -
502.gcc_r (avg) 0.000 -
502.gcc_r (avg) (percentage) 0.010 -
502.gcc_r (max) 0.000 -
502.gcc_r (max) (percentage) 0.010 -
502.gcc_r (unexplained diff vs previous) 1.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.010 -
503.bwaves_r 106.000 -
503.bwaves_r (avg) 106.000 -
503.bwaves_r (avg) (percentage) 0.460 -
503.bwaves_r (max) 147.000 -
503.bwaves_r (max) (percentage) 0.640 -
503.bwaves_r (unexplained diff vs previous) 59.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.260 -
505.mcf_r 29.000 -
505.mcf_r (avg) 29.000 -
505.mcf_r (avg) (percentage) 0.220 -
505.mcf_r (max) 55.000 -
505.mcf_r (max) (percentage) 0.410 -
505.mcf_r (unexplained diff vs previous) 56.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.410 -
507.cactuBSSN_r 37.000 -
507.cactuBSSN_r (avg) 37.000 -
507.cactuBSSN_r (avg) (percentage) 0.170 -
507.cactuBSSN_r (max) 39.000 -
507.cactuBSSN_r (max) (percentage) 0.180 -
508.namd_r 10.000 -
508.namd_r (avg) 10.000 -
508.namd_r (avg) (percentage) 0.110 -
508.namd_r (max) 16.000 -
508.namd_r (max) (percentage) 0.170 -
508.namd_r (unexplained diff vs previous) 3.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.030 -
510.parest_r 8.000 -
510.parest_r (avg) 8.000 -
510.parest_r (avg) (percentage) 0.040 -
510.parest_r (max) 19.000 -
510.parest_r (max) (percentage) 0.090 -
510.parest_r (unexplained diff vs previous) 2.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.010 -
511.povray_r 118.000 -
511.povray_r (avg) 118.000 -
511.povray_r (avg) (percentage) 0.650 -
511.povray_r (max) 138.000 -
511.povray_r (max) (percentage) 0.760 -
511.povray_r (unexplained diff vs previous) 90.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.490 -
519.lbm_r 23.000 -
519.lbm_r (avg) 23.000 -
519.lbm_r (avg) (percentage) 0.150 -
519.lbm_r (max) 25.000 -
519.lbm_r (max) (percentage) 0.160 -
519.lbm_r (unexplained diff vs previous) 22.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.140 -
520.omnetpp_r 55.000 -
520.omnetpp_r (avg) 55.000 -
520.omnetpp_r (avg) (percentage) 0.540 -
520.omnetpp_r (max) 29.000 -
520.omnetpp_r (max) (percentage) 0.290 -
520.omnetpp_r (unexplained diff vs previous) 30.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.290 -
521.wrf_r 49.000 -
521.wrf_r (avg) 49.000 -
521.wrf_r (avg) (percentage) 0.300 -
521.wrf_r (max) 74.000 -
521.wrf_r (max) (percentage) 0.450 -
521.wrf_r (unexplained diff vs previous) 49.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.300 -
523.xalancbmk_r 74.000 -
523.xalancbmk_r (avg) 74.000 -
523.xalancbmk_r (avg) (percentage) 0.770 -
523.xalancbmk_r (max) 89.000 -
523.xalancbmk_r (max) (percentage) 0.930 -
525.x264_r 57.000 -
525.x264_r (avg) 57.000 -
525.x264_r (avg) (percentage) 0.530 -
525.x264_r (max) 70.000 -
525.x264_r (max) (percentage) 0.650 -
525.x264_r (unexplained diff vs previous) 71.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.650 -
526.blender_r 4.000 -
526.blender_r (avg) 4.000 -
526.blender_r (avg) (percentage) 0.040 -
526.blender_r (max) 4.000 -
526.blender_r (max) (percentage) 0.040 -
526.blender_r (unexplained diff vs previous) 4.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.040 -
531.deepsjeng_r 34.000 -
531.deepsjeng_r (avg) 34.000 -
531.deepsjeng_r (avg) (percentage) 0.270 -
531.deepsjeng_r (max) 59.000 -
531.deepsjeng_r (max) (percentage) 0.470 -
531.deepsjeng_r (unexplained diff vs previous) 12.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.090 -
538.imagick_r 25.000 -
538.imagick_r (avg) 25.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 45.000 -
538.imagick_r (max) (percentage) 0.320 -
538.imagick_r (unexplained diff vs previous) 3.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.020 -
541.leela_r 34.000 -
541.leela_r (avg) 34.000 -
541.leela_r (avg) (percentage) 0.310 -
541.leela_r (max) 65.000 -
541.leela_r (max) (percentage) 0.590 -
544.nab_r 48.000 -
544.nab_r (avg) 48.000 -
544.nab_r (avg) (percentage) 0.410 -
544.nab_r (max) 59.000 -
544.nab_r (max) (percentage) 0.500 -
544.nab_r (unexplained diff vs previous) 33.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.280 -
548.exchange2_r 20.000 -
548.exchange2_r (avg) 20.000 -
548.exchange2_r (avg) (percentage) 0.230 -
548.exchange2_r (max) 28.000 -
548.exchange2_r (max) (percentage) 0.320 -
548.exchange2_r (unexplained diff vs previous) 20.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.230 -
549.fotonik3d_r 14.000 -
549.fotonik3d_r (avg) 14.000 -
549.fotonik3d_r (avg) (percentage) 0.080 -
549.fotonik3d_r (max) 23.000 -
549.fotonik3d_r (max) (percentage) 0.130 -
549.fotonik3d_r (unexplained diff vs previous) 16.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.090 -
554.roms_r 52.000 -
554.roms_r (avg) 52.000 -
554.roms_r (avg) (percentage) 0.310 -
554.roms_r (max) 85.000 -
554.roms_r (max) (percentage) 0.500 -
554.roms_r (unexplained diff vs previous) 34.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.200 -
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 15.000 -
557.xz_r (max) (percentage) 0.150 -
557.xz_r (unexplained diff vs previous) 6.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.060 -
Geometric Mean 2.518 -18.92%