Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=38b95a529385e32adc39428231c6fc8b0e8d6f21 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/ca2f64d5d08c1699ca4b7cb2bf6a76692e809e0f (+ 83 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=d6c72f976c61d3c1465699f2bcad77e62bafe61d (unchanged)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=7e83b5e75b20f49d4940bf35dfc1e38f3f95e5dc (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3-build/23/
Filter

gnu-arm-master-O3 test results

Run Order Start Time Duration
Current 0023 (basepoints/gcc-14-00568-gca2f64d5d08) 2023-05-07T23:40:20 0:00:00
Previous 0001 (4-changed-components) 2023-03-08T00:00:32 0:00:00
No Baseline Run


Tests Summary

Status Group #
Performance Regressions 5
Performance Improvements 8
Added Tests 95
Unchanged Tests 714
Total Tests 822

Performance Regressions - Execution Δ Previous Current σ
527.cam4_r 4.60% 2326.000 2433.000 -
500.perlbench_r 3.59% 2008.000 2080.000 -
525.x264_r 1.72% 2793.000 2841.000 -
502.gcc_r 1.59% 3586.000 3643.000 -
511.povray_r 1.36% 441.000 447.000 -

Performance Improvements - Code Size Δ Previous Current σ
520.omnetpp_r -1.55% 1814986.000 1786865.000 -
549.fotonik3d_r -1.13% 409644.000 404996.000 -

Performance Improvements - Execution Δ Previous Current σ
505.mcf_r -2.18% 6702.000 6556.000 -
548.exchange2_r -1.68% 1848.000 1817.000 -
544.nab_r -1.30% 7929.000 7826.000 -
519.lbm_r -1.21% 3300.000 3260.000 -
521.wrf_r -1.17% 8650.000 8549.000 -
554.roms_r -1.04% 24297.000 24045.000 -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.20s
Name Current %
500.perlbench_r 2080.000 3.59%
502.gcc_r 3643.000 1.59%
503.bwaves_r 8592.000 -
505.mcf_r 6556.000 -2.18%
507.cactuBSSN_r 6718.000 -
508.namd_r 3779.000 -
511.povray_r 447.000 1.36%
519.lbm_r 3260.000 -1.21%
520.omnetpp_r 3592.000 -
521.wrf_r 8549.000 -1.17%
525.x264_r 2841.000 1.72%
527.cam4_r 2433.000 4.60%
531.deepsjeng_r 5565.000 -
538.imagick_r 4031.000 -
541.leela_r 4624.000 -
544.nab_r 7826.000 -1.30%
548.exchange2_r 1817.000 -1.68%
549.fotonik3d_r 8619.000 -
554.roms_r 24045.000 -1.04%
557.xz_r 2369.000 -
Geometric Mean 4161.549 -
Name Current %
500.perlbench_r 2178932.000 -
502.gcc_r 9122919.000 -
503.bwaves_r 29871.000 -
505.mcf_r 33037.000 -
507.cactuBSSN_r 4920770.000 -
508.namd_r 857380.000 -
511.povray_r 934012.000 -
519.lbm_r 14530.000 -
520.omnetpp_r 1786865.000 -1.55%
521.wrf_r 26757777.000 -
525.x264_r 587160.000 -
527.cam4_r 17146418.000 -
531.deepsjeng_r 107537.000 -
538.imagick_r 1968889.000 -
541.leela_r 183514.000 -
544.nab_r 200638.000 -
548.exchange2_r 159494.000 -
549.fotonik3d_r 404996.000 -1.13%
554.roms_r 1084234.000 -
557.xz_r 185254.000 -
Geometric Mean 612200.333 -
Name Current %
500.perlbench_r 19.000 -
500.perlbench_r (avg) 19.000 -
500.perlbench_r (avg) (percentage) 0.960 -
500.perlbench_r (max) 47.000 -
500.perlbench_r (max) (percentage) 2.300 -
500.perlbench_r (unexplained diff vs previous) 23.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 1.110 -
503.bwaves_r 88.000 -
503.bwaves_r (avg) 88.000 -
503.bwaves_r (avg) (percentage) 1.030 -
503.bwaves_r (max) 110.000 -
503.bwaves_r (max) (percentage) 1.290 -
503.bwaves_r (unexplained diff vs previous) 95.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 1.110 -
505.mcf_r 54.000 -
505.mcf_r (avg) 54.000 -
505.mcf_r (avg) (percentage) 0.830 -
505.mcf_r (max) 41.000 -
505.mcf_r (max) (percentage) 0.640 -
505.mcf_r (unexplained diff vs previous) 29.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.440 -
507.cactuBSSN_r 85.000 -
507.cactuBSSN_r (avg) 85.000 -
507.cactuBSSN_r (avg) (percentage) 1.280 -
507.cactuBSSN_r (max) 92.000 -
507.cactuBSSN_r (max) (percentage) 1.370 -
507.cactuBSSN_r (unexplained diff vs previous) 26.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.390 -
508.namd_r 10.000 -
508.namd_r (avg) 10.000 -
508.namd_r (avg) (percentage) 0.290 -
508.namd_r (max) 10.000 -
508.namd_r (max) (percentage) 0.290 -
508.namd_r (unexplained diff vs previous) 11.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.290 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.290 -
511.povray_r (max) 8.000 -
511.povray_r (max) (percentage) 1.900 -
519.lbm_r 39.000 -
519.lbm_r (avg) 39.000 -
519.lbm_r (avg) (percentage) 1.200 -
519.lbm_r (max) 59.000 -
519.lbm_r (max) (percentage) 1.840 -
519.lbm_r (unexplained diff vs previous) 2.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.060 -
520.omnetpp_r 58.000 -
520.omnetpp_r (avg) 58.000 -
520.omnetpp_r (avg) (percentage) 1.620 -
520.omnetpp_r (max) 52.000 -
520.omnetpp_r (max) (percentage) 1.470 -
520.omnetpp_r (unexplained diff vs previous) 53.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.480 -
521.wrf_r 128.000 -
521.wrf_r (avg) 128.000 -
521.wrf_r (avg) (percentage) 1.500 -
521.wrf_r (max) 215.000 -
521.wrf_r (max) (percentage) 2.520 -
521.wrf_r (unexplained diff vs previous) 14.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.160 -
525.x264_r 23.000 -
525.x264_r (avg) 23.000 -
525.x264_r (avg) (percentage) 0.810 -
525.x264_r (max) 55.000 -
525.x264_r (max) (percentage) 1.950 -
525.x264_r (unexplained diff vs previous) 5.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.180 -
527.cam4_r 27.000 -
527.cam4_r (avg) 27.000 -
527.cam4_r (avg) (percentage) 1.140 -
527.cam4_r (max) 44.000 -
527.cam4_r (max) (percentage) 1.840 -
527.cam4_r (unexplained diff vs previous) 27.000 -
527.cam4_r (unexplained diff vs previous) (percentage) 1.110 -
531.deepsjeng_r 12.000 -
531.deepsjeng_r (avg) 12.000 -
531.deepsjeng_r (avg) (percentage) 0.230 -
531.deepsjeng_r (max) 18.000 -
531.deepsjeng_r (max) (percentage) 0.340 -
531.deepsjeng_r (unexplained diff vs previous) 1.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.020 -
538.imagick_r 16.000 -
538.imagick_r (avg) 16.000 -
538.imagick_r (avg) (percentage) 0.420 -
538.imagick_r (max) 46.000 -
538.imagick_r (max) (percentage) 1.150 -
538.imagick_r (unexplained diff vs previous) 2.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.050 -
541.leela_r 22.000 -
541.leela_r (avg) 22.000 -
541.leela_r (avg) (percentage) 0.490 -
541.leela_r (max) 29.000 -
541.leela_r (max) (percentage) 0.640 -
541.leela_r (unexplained diff vs previous) 20.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.430 -
544.nab_r 39.000 -
544.nab_r (avg) 39.000 -
544.nab_r (avg) (percentage) 0.500 -
544.nab_r (max) 53.000 -
544.nab_r (max) (percentage) 0.680 -
544.nab_r (unexplained diff vs previous) 53.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.680 -
548.exchange2_r 17.000 -
548.exchange2_r (avg) 17.000 -
548.exchange2_r (avg) (percentage) 0.970 -
548.exchange2_r (max) 29.000 -
548.exchange2_r (max) (percentage) 1.610 -
548.exchange2_r (unexplained diff vs previous) 21.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 1.160 -
549.fotonik3d_r 66.000 -
549.fotonik3d_r (avg) 66.000 -
549.fotonik3d_r (avg) (percentage) 0.770 -
549.fotonik3d_r (max) 49.000 -
549.fotonik3d_r (max) (percentage) 0.570 -
549.fotonik3d_r (unexplained diff vs previous) 49.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.570 -
554.roms_r 317.000 -
554.roms_r (avg) 317.000 -
554.roms_r (avg) (percentage) 1.320 -
554.roms_r (max) 709.000 -
554.roms_r (max) (percentage) 2.950 -
554.roms_r (unexplained diff vs previous) 133.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.550 -
557.xz_r 19.000 -
557.xz_r (avg) 19.000 -
557.xz_r (avg) (percentage) 0.820 -
557.xz_r (max) 13.000 -
557.xz_r (max) (percentage) 0.590 -
557.xz_r (unexplained diff vs previous) 14.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.590 -
Geometric Mean 6.101 4092518085324685443072.00%