Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=1b346e50485ee450e8103e4b1704b43f61bc39f7 (+ 340 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/c9d029ba2ceb435e31492c1f3f0fd3edf0e386be (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=e0590f41fe1e7a54169e8f8828efe62b5064139e (+ 109 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=2b9ecbe948c1ec32542ac4e57cc4033daff9936c (+ 504 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3-build/119/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0119 (3-changed-components) 2023-12-28T19:37:02 0:00:00
Previous 0119 (3-changed-components) 2023-12-28T19:37:02 0:00:00
Baseline 0090 (4-changed-components) 2023-10-17T12:24:51 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 3
Performance Improvements 0 6
Added Tests 2 112
Unchanged Tests 946 827
Total Tests 948

Added Tests - sample variability
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 3.62% 12334.000 12781.000 - 0.00% -
520.omnetpp_r 1.55% 10457.000 10619.000 - 0.00% -
500.perlbench_r 1.35% 13223.000 13402.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r -2.52% 108133.000 105405.000 - 0.00% -
511.povray_r -1.28% 966116.000 953732.000 - 0.00% -
502.gcc_r -1.15% 9267975.000 9161767.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r -3.94% 9222.000 8859.000 - 0.00% -
549.fotonik3d_r -2.41% 18587.000 18139.000 - 0.00% -
541.leela_r -1.22% 11161.000 11025.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 13402.000 -
502.gcc_r 8920.000 -
503.bwaves_r 22966.000 -
505.mcf_r 13550.000 -
507.cactuBSSN_r 22095.000 -
508.namd_r 9739.000 -
510.parest_r 21473.000 -
511.povray_r 17786.000 -
519.lbm_r 15765.000 -
520.omnetpp_r 10619.000 -
521.wrf_r 16497.000 -
523.xalancbmk_r 9786.000 -
525.x264_r 10835.000 -
526.blender_r 10837.000 -
527.cam4_r 10004.000 -
531.deepsjeng_r 12781.000 -
538.imagick_r 14260.000 -
541.leela_r 11025.000 -
544.nab_r 11880.000 -
548.exchange2_r 8859.000 -
549.fotonik3d_r 18139.000 -
554.roms_r 16979.000 -
557.xz_r 10464.000 -
Geometric Mean 13262.687 -
Name Current %
500.perlbench_r 2182322.000 -
502.gcc_r 9161767.000 -
503.bwaves_r 31035.000 -
505.mcf_r 36029.000 -
507.cactuBSSN_r 4948922.000 -
508.namd_r 907700.000 -
510.parest_r 8409243.000 -
511.povray_r 953732.000 -
519.lbm_r 14506.000 -
520.omnetpp_r 1779987.000 -
521.wrf_r 26994025.000 -
523.xalancbmk_r 4918326.000 -
525.x264_r 592232.000 -
526.blender_r 9325256.000 -
527.cam4_r 17245922.000 -
531.deepsjeng_r 105405.000 -
538.imagick_r 1972511.000 -
541.leela_r 182307.000 -
544.nab_r 201674.000 -
548.exchange2_r 160274.000 -
549.fotonik3d_r 404704.000 -
554.roms_r 1086058.000 -
557.xz_r 187554.000 -
Geometric Mean 854060.666 -
Name Current %
500.perlbench_r 40.000 -
500.perlbench_r (avg) 40.000 -
500.perlbench_r (avg) (percentage) 0.300 -
500.perlbench_r (max) 60.000 -
500.perlbench_r (max) (percentage) 0.450 -
502.gcc_r 41.000 -
502.gcc_r (avg) 41.000 -
502.gcc_r (avg) (percentage) 0.460 -
502.gcc_r (max) 63.000 -
502.gcc_r (max) (percentage) 0.710 -
502.gcc_r (unexplained diff vs previous) 64.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.720 -
503.bwaves_r 71.000 -
503.bwaves_r (avg) 71.000 -
503.bwaves_r (avg) (percentage) 0.310 -
503.bwaves_r (max) 62.000 -
503.bwaves_r (max) (percentage) 0.270 -
503.bwaves_r (unexplained diff vs previous) 42.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.180 -
505.mcf_r 24.000 -
505.mcf_r (avg) 24.000 -
505.mcf_r (avg) (percentage) 0.180 -
505.mcf_r (max) 62.000 -
505.mcf_r (max) (percentage) 0.460 -
505.mcf_r (unexplained diff vs previous) 15.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.110 -
507.cactuBSSN_r 70.000 -
507.cactuBSSN_r (avg) 70.000 -
507.cactuBSSN_r (avg) (percentage) 0.320 -
507.cactuBSSN_r (max) 108.000 -
507.cactuBSSN_r (max) (percentage) 0.490 -
507.cactuBSSN_r (unexplained diff vs previous) 72.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.330 -
508.namd_r 14.000 -
508.namd_r (avg) 14.000 -
508.namd_r (avg) (percentage) 0.150 -
508.namd_r (max) 23.000 -
508.namd_r (max) (percentage) 0.240 -
508.namd_r (unexplained diff vs previous) 21.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.220 -
510.parest_r 15.000 -
510.parest_r (avg) 15.000 -
510.parest_r (avg) (percentage) 0.070 -
510.parest_r (max) 30.000 -
510.parest_r (max) (percentage) 0.140 -
510.parest_r (unexplained diff vs previous) 3.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.010 -
511.povray_r 76.000 -
511.povray_r (avg) 76.000 -
511.povray_r (avg) (percentage) 0.430 -
511.povray_r (max) 104.000 -
511.povray_r (max) (percentage) 0.590 -
511.povray_r (unexplained diff vs previous) 104.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.580 -
519.lbm_r 28.000 -
519.lbm_r (avg) 28.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 42.000 -
519.lbm_r (max) (percentage) 0.270 -
519.lbm_r (unexplained diff vs previous) 38.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.240 -
520.omnetpp_r 81.000 -
520.omnetpp_r (avg) 81.000 -
520.omnetpp_r (avg) (percentage) 0.770 -
520.omnetpp_r (max) 276.000 -
520.omnetpp_r (max) (percentage) 2.600 -
520.omnetpp_r (unexplained diff vs previous) 46.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.430 -
521.wrf_r 84.000 -
521.wrf_r (avg) 84.000 -
521.wrf_r (avg) (percentage) 0.510 -
521.wrf_r (max) 130.000 -
521.wrf_r (max) (percentage) 0.790 -
521.wrf_r (unexplained diff vs previous) 93.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.560 -
523.xalancbmk_r 49.000 -
523.xalancbmk_r (avg) 49.000 -
523.xalancbmk_r (avg) (percentage) 0.510 -
523.xalancbmk_r (max) 75.000 -
523.xalancbmk_r (max) (percentage) 0.770 -
523.xalancbmk_r (unexplained diff vs previous) 75.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.770 -
525.x264_r 29.000 -
525.x264_r (avg) 29.000 -
525.x264_r (avg) (percentage) 0.270 -
525.x264_r (max) 26.000 -
525.x264_r (max) (percentage) 0.240 -
525.x264_r (unexplained diff vs previous) 23.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.210 -
526.blender_r 30.000 -
526.blender_r (avg) 30.000 -
526.blender_r (avg) (percentage) 0.280 -
526.blender_r (max) 71.000 -
526.blender_r (max) (percentage) 0.660 -
526.blender_r (unexplained diff vs previous) 15.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.140 -
531.deepsjeng_r 52.000 -
531.deepsjeng_r (avg) 52.000 -
531.deepsjeng_r (avg) (percentage) 0.410 -
531.deepsjeng_r (max) 69.000 -
531.deepsjeng_r (max) (percentage) 0.540 -
531.deepsjeng_r (unexplained diff vs previous) 0.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.000 -
538.imagick_r 47.000 -
538.imagick_r (avg) 47.000 -
538.imagick_r (avg) (percentage) 0.330 -
538.imagick_r (max) 75.000 -
538.imagick_r (max) (percentage) 0.530 -
541.leela_r 25.000 -
541.leela_r (avg) 25.000 -
541.leela_r (avg) (percentage) 0.230 -
541.leela_r (max) 42.000 -
541.leela_r (max) (percentage) 0.390 -
541.leela_r (unexplained diff vs previous) 10.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.090 -
544.nab_r 67.000 -
544.nab_r (avg) 67.000 -
544.nab_r (avg) (percentage) 0.570 -
544.nab_r (max) 104.000 -
544.nab_r (max) (percentage) 0.880 -
544.nab_r (unexplained diff vs previous) 2.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.020 -
548.exchange2_r 33.000 -
548.exchange2_r (avg) 33.000 -
548.exchange2_r (avg) (percentage) 0.380 -
548.exchange2_r (max) 45.000 -
548.exchange2_r (max) (percentage) 0.510 -
548.exchange2_r (unexplained diff vs previous) 16.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.180 -
549.fotonik3d_r 14.000 -
549.fotonik3d_r (avg) 14.000 -
549.fotonik3d_r (avg) (percentage) 0.080 -
549.fotonik3d_r (max) 41.000 -
549.fotonik3d_r (max) (percentage) 0.230 -
549.fotonik3d_r (unexplained diff vs previous) 41.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.230 -
554.roms_r 37.000 -
554.roms_r (avg) 37.000 -
554.roms_r (avg) (percentage) 0.220 -
554.roms_r (max) 39.000 -
554.roms_r (max) (percentage) 0.230 -
554.roms_r (unexplained diff vs previous) 23.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.140 -
557.xz_r 8.000 -
557.xz_r (avg) 8.000 -
557.xz_r (avg) (percentage) 0.080 -
557.xz_r (max) 8.000 -
557.xz_r (max) (percentage) 0.080 -
557.xz_r (unexplained diff vs previous) 3.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.030 -
Geometric Mean 3.936 -13.32%