Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=28c3bf55f0f9aca8619c6d01be34a02a887c5577 (unchanged)
git_gcc https://github.com/gcc-mirror/gcc/commit/ab18785840d7b8afd9f716bab9d1eab415bc4fe9 (+ 1 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=734e7f91e752f44984fe42c2384c23a0290b6e56 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/3b6df5ec957d4f6d871ecd63a14fdc98bd24dc2d (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-aarch64-master-O2_LTO-build/258/
Filter

gnu-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0258 (basepoints/gcc-15-02820-gab18785840d7) 2024-08-19T19:42:24 0:00:00
Previous 0259 (basepoints/gcc-15-03068-gfd7dabc116b) 2024-08-20T14:29:42 0:00:00
Baseline 0258 (basepoints/gcc-15-02820-gab18785840d7) 2024-08-19T19:42:24 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 52 0
Performance Improvements 17 0
Added Tests 32 2
Unchanged Tests 805 904
Total Tests 906

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 1.48% 2177718.000 2209878.000 - 0.00% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
511.povray_r 1.43% 19834.000 20117.000 - 0.00% -
531.deepsjeng_r 1.34% 7672.000 7775.000 - 0.00% -
541.leela_r 1.32% 12206.000 12367.000 - 0.00% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) 900.00% 1.000 10.000 0.000 0.00% 0.000
519.lbm_r (unexplained diff vs previous) (percentage) 500.00% 0.010 0.060 0.000 0.00% 0.000
520.omnetpp_r (max) 12.90% 93.000 105.000 - 0.00% -
520.omnetpp_r (max) (percentage) 12.86% 0.700 0.790 - 0.00% -
519.lbm_r (max) (percentage) 12.50% 0.320 0.360 - 0.00% -
519.lbm_r (max) 12.07% 58.000 65.000 - 0.00% -
503.bwaves_r (max) 8.65% 104.000 113.000 - 0.00% -
544.nab_r (max) (percentage) 7.94% 0.630 0.680 - 0.00% -
544.nab_r (max) 7.78% 90.000 97.000 - 0.00% -
503.bwaves_r (max) (percentage) 7.69% 0.520 0.560 - 0.00% -
554.roms_r (max) 7.06% 85.000 91.000 - 0.00% -
531.deepsjeng_r (max) 6.94% 72.000 77.000 - 0.00% -
549.fotonik3d_r (max) (percentage) 6.52% 0.920 0.980 - 0.00% -
511.povray_r (max) 6.17% 81.000 86.000 - 0.00% -
554.roms_r (max) (percentage) 6.00% 0.500 0.530 - 0.00% -
526.blender_r (max) 5.88% 68.000 72.000 - 0.00% -
549.fotonik3d_r (max) 5.70% 158.000 167.000 - 0.00% -
526.blender_r (max) (percentage) 5.26% 0.570 0.600 - 0.00% -
531.deepsjeng_r (max) (percentage) 5.26% 0.950 1.000 - 0.00% -
525.x264_r (max) (percentage) 5.26% 0.190 0.200 - 0.00% -
521.wrf_r (max) (percentage) 5.16% 3.100 3.260 - 0.00% -
525.x264_r (max) 5.00% 20.000 21.000 - 0.00% -
511.povray_r (max) (percentage) 4.88% 0.410 0.430 - 0.00% -
508.namd_r (max) 4.76% 63.000 66.000 - 0.00% -
500.perlbench_r (max) (percentage) 4.69% 0.640 0.670 - 0.00% -
500.perlbench_r (max) 4.60% 87.000 91.000 - 0.00% -
508.namd_r (max) (percentage) 4.48% 0.670 0.700 - 0.00% -
523.xalancbmk_r (max) 4.00% 50.000 52.000 - 0.00% -
541.leela_r (max) 3.92% 51.000 53.000 - 0.00% -
548.exchange2_r (max) (percentage) 3.70% 0.270 0.280 - 0.00% -
521.wrf_r (max) 3.49% 459.000 475.000 - 0.00% -
505.mcf_r (max) 2.96% 135.000 139.000 - 0.00% -
505.mcf_r (max) (percentage) 2.94% 1.020 1.050 - 0.00% -
527.cam4_r (max) 2.82% 71.000 73.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 2.78% 0.360 0.370 - 0.00% -
523.xalancbmk_r 2.50% 40.000 41.000 - 0.00% -
523.xalancbmk_r (avg) 2.50% 40.000 41.000 - 0.00% -
541.leela_r (max) (percentage) 2.38% 0.420 0.430 - 0.00% -
531.deepsjeng_r 2.17% 46.000 47.000 - 0.00% -
531.deepsjeng_r (avg) 2.17% 46.000 47.000 - 0.00% -
507.cactuBSSN_r 2.00% 50.000 51.000 - 0.00% -
507.cactuBSSN_r (avg) 2.00% 50.000 51.000 - 0.00% -
527.cam4_r (max) (percentage) 1.59% 0.630 0.640 - 0.00% -
527.cam4_r 1.59% 63.000 64.000 - 0.00% -
527.cam4_r (avg) 1.59% 63.000 64.000 - 0.00% -
549.fotonik3d_r (avg) (percentage) 1.37% 0.730 0.740 - 0.00% -
511.povray_r 1.12% 89.000 90.000 - 0.00% -
511.povray_r (avg) 1.12% 89.000 90.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r -1.63% 14828.000 14587.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -94.44% 90.000 5.000 0.000 0.00% 0.000
520.omnetpp_r (unexplained diff vs previous) (percentage) -94.03% 0.670 0.040 0.000 0.00% 0.000
510.parest_r (unexplained diff vs previous) (percentage) -87.88% 0.330 0.040 0.000 0.00% 0.000
510.parest_r (unexplained diff vs previous) -87.67% 73.000 9.000 0.000 0.00% 0.000
510.parest_r (max) -52.05% 73.000 35.000 - 0.00% -
510.parest_r (max) (percentage) -51.52% 0.330 0.160 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -31.25% 96.000 66.000 0.000 0.00% 0.000
549.fotonik3d_r (unexplained diff vs previous) (percentage) -30.36% 0.560 0.390 0.000 0.00% 0.000
525.x264_r -7.14% 14.000 13.000 - 0.00% -
525.x264_r (avg) -7.14% 14.000 13.000 - 0.00% -
521.wrf_r -1.73% 289.000 284.000 - 0.00% -
521.wrf_r (avg) -1.73% 289.000 284.000 - 0.00% -
500.perlbench_r -1.49% 67.000 66.000 - 0.00% -
500.perlbench_r (avg) -1.49% 67.000 66.000 - 0.00% -
520.omnetpp_r -1.19% 84.000 83.000 - 0.00% -
520.omnetpp_r (avg) -1.19% 84.000 83.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r (unexplained diff vs previous)
505.mcf_r (unexplained diff vs previous) (percentage)
507.cactuBSSN_r (unexplained diff vs previous)
507.cactuBSSN_r (unexplained diff vs previous) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
521.wrf_r (unexplained diff vs previous)
521.wrf_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r (unexplained diff vs previous)
531.deepsjeng_r (unexplained diff vs previous) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
554.roms_r (unexplained diff vs previous)
554.roms_r (unexplained diff vs previous) (percentage)
557.xz_r (unexplained diff vs previous)
557.xz_r (unexplained diff vs previous) (percentage)

Added Tests - sample variability
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 13603.000 -
502.gcc_r 10000.000 -
503.bwaves_r 20185.000 -
505.mcf_r 13284.000 -
507.cactuBSSN_r 12477.000 -
508.namd_r 9459.000 -
510.parest_r 22239.000 -
511.povray_r 20117.000 1.43%
519.lbm_r 18159.000 -
520.omnetpp_r 13328.000 -
521.wrf_r 14587.000 -1.63%
523.xalancbmk_r 14191.000 -
525.x264_r 10747.000 -
526.blender_r 12095.000 -
527.cam4_r 11430.000 -
531.deepsjeng_r 7775.000 1.34%
538.imagick_r 14834.000 -
541.leela_r 12367.000 1.32%
544.nab_r 14368.000 -
549.fotonik3d_r 17114.000 -
554.roms_r 17213.000 -
557.xz_r 11624.000 -
Geometric Mean 13692.448 -
Name Current %
500.perlbench_r 2209878.000 1.48%
502.gcc_r 8932045.000 -
503.bwaves_r 26613.000 -
505.mcf_r 16408.000 -
507.cactuBSSN_r 2799986.000 -
508.namd_r 633349.000 -
510.parest_r 1493667.000 -
511.povray_r 840204.000 -
519.lbm_r 11692.000 -
520.omnetpp_r 1686123.000 -
521.wrf_r 13478876.000 -
523.xalancbmk_r 3438474.000 -
525.x264_r 437829.000 -
526.blender_r 9382369.000 -
527.cam4_r 2742829.000 -
531.deepsjeng_r 71099.000 -
538.imagick_r 1212234.000 -
541.leela_r 81422.000 -
544.nab_r 83974.000 -
549.fotonik3d_r 282020.000 -
554.roms_r 496458.000 -
557.xz_r 135854.000 -
Geometric Mean 553297.457 -
Name Current %
500.perlbench_r 66.000 -1.49%
500.perlbench_r (avg) 66.000 -1.49%
500.perlbench_r (avg) (percentage) 0.490 -
500.perlbench_r (max) 91.000 4.60%
500.perlbench_r (max) (percentage) 0.670 4.69%
500.perlbench_r (unexplained diff vs previous) 44.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.320 -
503.bwaves_r 56.000 -
503.bwaves_r (avg) 56.000 -
503.bwaves_r (avg) (percentage) 0.280 -
503.bwaves_r (max) 113.000 8.65%
503.bwaves_r (max) (percentage) 0.560 7.69%
503.bwaves_r (unexplained diff vs previous) 34.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.170 -
505.mcf_r 62.000 -
505.mcf_r (avg) 62.000 -
505.mcf_r (avg) (percentage) 0.470 -
505.mcf_r (max) 139.000 2.96%
505.mcf_r (max) (percentage) 1.050 2.94%
505.mcf_r (unexplained diff vs previous) 25.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.190 -
507.cactuBSSN_r 51.000 2.00%
507.cactuBSSN_r (avg) 51.000 2.00%
507.cactuBSSN_r (avg) (percentage) 0.410 -
507.cactuBSSN_r (max) 59.000 -
507.cactuBSSN_r (max) (percentage) 0.480 -
507.cactuBSSN_r (unexplained diff vs previous) 51.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.410 -
508.namd_r 38.000 -
508.namd_r (avg) 38.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 66.000 4.76%
508.namd_r (max) (percentage) 0.700 4.48%
508.namd_r (unexplained diff vs previous) 63.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.670 -
510.parest_r 33.000 -
510.parest_r (avg) 33.000 -
510.parest_r (avg) (percentage) 0.150 -
510.parest_r (max) 35.000 -52.05%
510.parest_r (max) (percentage) 0.160 -51.52%
510.parest_r (unexplained diff vs previous) 9.000 -87.67%
510.parest_r (unexplained diff vs previous) (percentage) 0.040 -87.88%
511.povray_r 90.000 1.12%
511.povray_r (avg) 90.000 1.12%
511.povray_r (avg) (percentage) 0.450 -
511.povray_r (max) 86.000 6.17%
511.povray_r (max) (percentage) 0.430 4.88%
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
519.lbm_r 30.000 -
519.lbm_r (avg) 30.000 -
519.lbm_r (avg) (percentage) 0.170 -
519.lbm_r (max) 65.000 12.07%
519.lbm_r (max) (percentage) 0.360 12.50%
519.lbm_r (unexplained diff vs previous) 10.000 900.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.060 500.00%
520.omnetpp_r 83.000 -1.19%
520.omnetpp_r (avg) 83.000 -1.19%
520.omnetpp_r (avg) (percentage) 0.630 -
520.omnetpp_r (max) 105.000 12.90%
520.omnetpp_r (max) (percentage) 0.790 12.86%
520.omnetpp_r (unexplained diff vs previous) 5.000 -94.44%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.040 -94.03%
521.wrf_r 284.000 -1.73%
521.wrf_r (avg) 284.000 -1.73%
521.wrf_r (avg) (percentage) 1.950 -
521.wrf_r (max) 475.000 3.49%
521.wrf_r (max) (percentage) 3.260 5.16%
521.wrf_r (unexplained diff vs previous) 492.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 3.370 -
523.xalancbmk_r 41.000 2.50%
523.xalancbmk_r (avg) 41.000 2.50%
523.xalancbmk_r (avg) (percentage) 0.290 -
523.xalancbmk_r (max) 52.000 4.00%
523.xalancbmk_r (max) (percentage) 0.370 2.78%
523.xalancbmk_r (unexplained diff vs previous) 38.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.270 -
525.x264_r 13.000 -7.14%
525.x264_r (avg) 13.000 -7.14%
525.x264_r (avg) (percentage) 0.130 -
525.x264_r (max) 21.000 5.00%
525.x264_r (max) (percentage) 0.200 5.26%
526.blender_r 55.000 -
526.blender_r (avg) 55.000 -
526.blender_r (avg) (percentage) 0.460 -
526.blender_r (max) 72.000 5.88%
526.blender_r (max) (percentage) 0.600 5.26%
526.blender_r (unexplained diff vs previous) 8.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.070 -
527.cam4_r 64.000 1.59%
527.cam4_r (avg) 64.000 1.59%
527.cam4_r (avg) (percentage) 0.560 -
527.cam4_r (max) 73.000 2.82%
527.cam4_r (max) (percentage) 0.640 1.59%
527.cam4_r (unexplained diff vs previous) 73.000 -
527.cam4_r (unexplained diff vs previous) (percentage) 0.640 -
531.deepsjeng_r 47.000 2.17%
531.deepsjeng_r (avg) 47.000 2.17%
531.deepsjeng_r (avg) (percentage) 0.610 -
531.deepsjeng_r (max) 77.000 6.94%
531.deepsjeng_r (max) (percentage) 1.000 5.26%
531.deepsjeng_r (unexplained diff vs previous) 77.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.990 -
538.imagick_r 17.000 -
538.imagick_r (avg) 17.000 -
538.imagick_r (avg) (percentage) 0.120 -
538.imagick_r (max) 20.000 -
538.imagick_r (max) (percentage) 0.140 -
538.imagick_r (unexplained diff vs previous) 15.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.100 -
541.leela_r 39.000 -
541.leela_r (avg) 39.000 -
541.leela_r (avg) (percentage) 0.320 -
541.leela_r (max) 53.000 3.92%
541.leela_r (max) (percentage) 0.430 2.38%
541.leela_r (unexplained diff vs previous) 30.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.240 -
544.nab_r 40.000 -
544.nab_r (avg) 40.000 -
544.nab_r (avg) (percentage) 0.280 -
544.nab_r (max) 97.000 7.78%
544.nab_r (max) (percentage) 0.680 7.94%
544.nab_r (unexplained diff vs previous) 25.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.170 -
548.exchange2_r (avg) (percentage) 0.230 -
548.exchange2_r (max) (percentage) 0.280 3.70%
549.fotonik3d_r 126.000 -
549.fotonik3d_r (avg) 126.000 -
549.fotonik3d_r (avg) (percentage) 0.740 1.37%
549.fotonik3d_r (max) 167.000 5.70%
549.fotonik3d_r (max) (percentage) 0.980 6.52%
549.fotonik3d_r (unexplained diff vs previous) 66.000 -31.25%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.390 -30.36%
554.roms_r 61.000 -
554.roms_r (avg) 61.000 -
554.roms_r (avg) (percentage) 0.360 -
554.roms_r (max) 91.000 7.06%
554.roms_r (max) (percentage) 0.530 6.00%
554.roms_r (unexplained diff vs previous) 10.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.060 -
557.xz_r 12.000 -
557.xz_r (avg) 12.000 -
557.xz_r (avg) (percentage) 0.110 -
557.xz_r (max) 9.000 -
557.xz_r (max) (percentage) 0.080 -
557.xz_r (unexplained diff vs previous) 5.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.040 -
Geometric Mean 4.632 -30.43%