Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fcce95b68cbb1fbeb3bdaa1429defc347678fb2b (+ 16 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (007392c0f93cf46b9e87aebdd04e123e3381fc07) (+ 47 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=69f8b3e7deaca579511957959f8a7676a7428f49 (+ 17 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/3394ade23d7e3934a166e973e664046ea6f559d4 (+ 774 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3_LTO-build/279/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0279 (4-changed-components) 2025-06-17T00:36:57 0:00:00
Previous 0278 (3-changed-components) 2025-06-13T03:21:14 0:00:00
Baseline 0073 (4-changed-components) 2023-10-17T22:44:19 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 19 12
Performance Improvements 55 18
Added Tests 0 115
Unchanged Tests 838 767
Total Tests 912

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
503.bwaves_r 2.06% 7913.000 8076.000 - 2.15% -
554.roms_r 1.16% 25237.000 25531.000 - 10.45% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 900.00% 0.030 0.300 - 0.00% -
507.cactuBSSN_r (unexplained diff vs previous) 900.00% 2.000 20.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 552.00% 25.000 163.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 531.25% 0.320 2.020 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 355.56% 0.090 0.410 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 340.00% 5.000 22.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 150.00% 8.000 20.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 147.83% 0.230 0.570 - 0.00% -
519.lbm_r (unexplained diff vs previous) 64.71% 17.000 28.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 63.46% 0.520 0.850 - 0.00% -
519.lbm_r (max) 47.37% 19.000 28.000 - 0.00% -
519.lbm_r (max) (percentage) 44.07% 0.590 0.850 - 0.00% -
503.bwaves_r 5.88% 51.000 54.000 - 0.00% -
503.bwaves_r (avg) 5.88% 51.000 54.000 - 0.00% -
503.bwaves_r (avg) (percentage) 4.62% 0.650 0.680 - 0.00% -
554.roms_r 1.15% 174.000 176.000 - 0.00% -
554.roms_r (avg) 1.15% 174.000 176.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
502.gcc_r -2.38% 3621.000 3535.000 - 0.00% -
557.xz_r -2.04% 2403.000 2354.000 - -0.25% -
521.wrf_r -1.71% 9341.000 9181.000 - 7.91% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
549.fotonik3d_r (unexplained diff vs previous) -97.97% 148.000 3.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -97.75% 1.780 0.040 - 0.00% -
508.namd_r (unexplained diff vs previous) -78.95% 19.000 4.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -78.00% 0.500 0.110 - 0.00% -
505.mcf_r (unexplained diff vs previous) -47.30% 74.000 39.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -47.27% 1.100 0.580 - 0.00% -
541.leela_r (max) (percentage) -42.31% 0.520 0.300 - 0.00% -
541.leela_r (max) -40.00% 20.000 12.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -37.50% 0.400 0.250 - 0.00% -
541.leela_r (unexplained diff vs previous) -37.50% 16.000 10.000 - 0.00% -
508.namd_r (max) -16.67% 18.000 15.000 - 0.00% -
508.namd_r (max) (percentage) -16.00% 0.500 0.420 - 0.00% -
505.mcf_r (max) (percentage) -12.84% 1.090 0.950 - 0.00% -
505.mcf_r (max) -12.50% 72.000 63.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -11.11% 0.720 0.640 - 0.00% -
507.cactuBSSN_r (max) -10.64% 47.000 42.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -9.71% 1.750 1.580 - 0.00% -
549.fotonik3d_r (max) -9.66% 145.000 131.000 - 0.00% -
554.roms_r (max) (percentage) -8.57% 1.050 0.960 - 0.00% -
531.deepsjeng_r (max) (percentage) -8.00% 0.500 0.460 - 0.00% -
531.deepsjeng_r (max) -7.69% 26.000 24.000 - 0.00% -
557.xz_r (max) -7.69% 26.000 24.000 - 0.00% -
554.roms_r (max) -7.20% 264.000 245.000 - 0.00% -
520.omnetpp_r (max) -6.76% 74.000 69.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.60% 2.120 1.980 - 0.00% -
503.bwaves_r (max) (percentage) -6.58% 2.280 2.130 - 0.00% -
544.nab_r (max) -6.06% 66.000 62.000 - 0.00% -
544.nab_r (max) (percentage) -4.71% 0.850 0.810 - 0.00% -
557.xz_r (max) (percentage) -4.59% 1.090 1.040 - 0.00% -
503.bwaves_r (max) -4.44% 180.000 172.000 - 0.00% -
521.wrf_r (max) -3.83% 235.000 226.000 - 0.00% -
527.cam4_r (max) -3.45% 29.000 28.000 - 0.00% -
541.leela_r -3.23% 31.000 30.000 - 0.00% -
541.leela_r (avg) -3.23% 31.000 30.000 - 0.00% -
527.cam4_r (max) (percentage) -2.46% 1.220 1.190 - 0.00% -
511.povray_r (max) (percentage) -2.35% 2.130 2.080 - 0.00% -
520.omnetpp_r -2.33% 43.000 42.000 - 0.00% -
520.omnetpp_r (avg) -2.33% 43.000 42.000 - 0.00% -
508.namd_r (avg) (percentage) -2.27% 0.440 0.430 - 0.00% -
525.x264_r (max) (percentage) -2.27% 0.440 0.430 - 0.00% -
549.fotonik3d_r -2.17% 46.000 45.000 - 0.00% -
549.fotonik3d_r (avg) -2.17% 46.000 45.000 - 0.00% -
521.wrf_r -2.11% 95.000 93.000 - 0.00% -
521.wrf_r (avg) -2.11% 95.000 93.000 - 0.00% -
521.wrf_r (max) (percentage) -1.98% 2.520 2.470 - 0.00% -
507.cactuBSSN_r (avg) (percentage) -1.85% 0.540 0.530 - 0.00% -
549.fotonik3d_r (avg) (percentage) -1.79% 0.560 0.550 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.60% 1.250 1.230 - 0.00% -
500.perlbench_r (max) -1.59% 63.000 62.000 - 0.00% -
500.perlbench_r (max) (percentage) -1.35% 2.960 2.920 - 0.00% -
541.leela_r (avg) (percentage) -1.28% 0.780 0.770 - 0.00% -
505.mcf_r (avg) (percentage) -1.00% 1.000 0.990 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 3.53% 28586.000 29595.000 - 0.00% -
531.deepsjeng_r 1.55% 111823.000 113551.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
554.roms_r 10.45% 23116.000 25531.000 - 1.16% -
521.wrf_r 7.91% 8508.000 9181.000 - -1.71% -
500.perlbench_r 7.11% 2011.000 2154.000 - 0.05% -
527.cam4_r 4.13% 2298.000 2393.000 - 0.50% -
505.mcf_r 3.50% 6508.000 6736.000 - 0.58% -
531.deepsjeng_r 2.39% 5271.000 5397.000 - 0.41% -
503.bwaves_r 2.15% 7906.000 8076.000 - 2.06% -
520.omnetpp_r 2.01% 3426.000 3495.000 - -0.57% -
525.x264_r 1.61% 2787.000 2832.000 - 0.46% -
511.povray_r 1.40% 428.000 434.000 - 0.46% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -27.24% 21470017.000 15622321.000 - -0.00% -
554.roms_r -16.71% 864093.000 719677.000 - 0.00% -
549.fotonik3d_r -12.51% 398186.000 348373.000 - 0.00% -
508.namd_r -10.60% 901164.000 805629.000 - -0.01% -
527.cam4_r -10.23% 3616716.000 3246576.000 - -0.00% -
505.mcf_r -6.31% 28293.000 26509.000 - 0.00% -
544.nab_r -5.84% 98295.000 92551.000 - -0.03% -
507.cactuBSSN_r -5.51% 4609579.000 4355502.000 - -0.00% -
538.imagick_r -2.83% 1561691.000 1517463.000 - -0.18% -
525.x264_r -2.07% 599185.000 586768.000 - -0.02% -
511.povray_r -1.36% 1104695.000 1089669.000 - -0.02% -
541.leela_r -1.10% 100263.000 99162.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -2.88% 8562.000 8315.000 - -0.04% -
507.cactuBSSN_r -1.69% 6785.000 6670.000 - 0.30% -
544.nab_r -1.50% 7848.000 7730.000 - -0.76% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 15.79% 19.000 22.000 - 0.00% -
nb_execution_successful 15.79% 19.000 22.000 - 0.00% -
nb_total_tests 15.79% 19.000 22.000 - 0.00% -

Added Tests - Code Size
502.gcc_r
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
502.gcc_r
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 2154.000 -
502.gcc_r 3535.000 -2.38%
503.bwaves_r 8076.000 2.06%
505.mcf_r 6736.000 -
507.cactuBSSN_r 6670.000 -
508.namd_r 3759.000 -
510.parest_r 5946.000 -
511.povray_r 434.000 -
519.lbm_r 3305.000 -
520.omnetpp_r 3495.000 -
521.wrf_r 9181.000 -1.71%
523.xalancbmk_r 3222.000 -
525.x264_r 2832.000 -
526.blender_r 10677.000 -
527.cam4_r 2393.000 -
531.deepsjeng_r 5397.000 -
538.imagick_r 3990.000 -
541.leela_r 4010.000 -
544.nab_r 7730.000 -
549.fotonik3d_r 8315.000 -
554.roms_r 25531.000 1.16%
557.xz_r 2354.000 -2.04%
Geometric Mean 4487.666 -
Name Current %
500.perlbench_r 2526850.000 -
502.gcc_r 9644156.000 -
503.bwaves_r 29595.000 -
505.mcf_r 26509.000 -
507.cactuBSSN_r 4355502.000 -
508.namd_r 805629.000 -
510.parest_r 1639265.000 -
511.povray_r 1089669.000 -
519.lbm_r 11399.000 -
520.omnetpp_r 1582416.000 -
521.wrf_r 15622321.000 -
523.xalancbmk_r 3316337.000 -
525.x264_r 586768.000 -
526.blender_r 10174285.000 -
527.cam4_r 3246576.000 -
531.deepsjeng_r 113551.000 -
538.imagick_r 1517463.000 -
541.leela_r 99162.000 -
544.nab_r 92551.000 -
549.fotonik3d_r 348373.000 -
554.roms_r 719677.000 -
557.xz_r 149679.000 -
Geometric Mean 665547.444 -
Name Current %
500.perlbench_r 28.000 -
500.perlbench_r (avg) 28.000 -
500.perlbench_r (avg) (percentage) 1.330 -
500.perlbench_r (max) 62.000 -1.59%
500.perlbench_r (max) (percentage) 2.920 -1.35%
503.bwaves_r 54.000 5.88%
503.bwaves_r (avg) 54.000 5.88%
503.bwaves_r (avg) (percentage) 0.680 4.62%
503.bwaves_r (max) 172.000 -4.44%
503.bwaves_r (max) (percentage) 2.130 -6.58%
503.bwaves_r (unexplained diff vs previous) 163.000 552.00%
503.bwaves_r (unexplained diff vs previous) (percentage) 2.020 531.25%
505.mcf_r 66.000 -
505.mcf_r (avg) 66.000 -
505.mcf_r (avg) (percentage) 0.990 -1.00%
505.mcf_r (max) 63.000 -12.50%
505.mcf_r (max) (percentage) 0.950 -12.84%
505.mcf_r (unexplained diff vs previous) 39.000 -47.30%
505.mcf_r (unexplained diff vs previous) (percentage) 0.580 -47.27%
507.cactuBSSN_r 35.000 -
507.cactuBSSN_r (avg) 35.000 -
507.cactuBSSN_r (avg) (percentage) 0.530 -1.85%
507.cactuBSSN_r (max) 42.000 -10.64%
507.cactuBSSN_r (max) (percentage) 0.640 -11.11%
507.cactuBSSN_r (unexplained diff vs previous) 20.000 900.00%
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.300 900.00%
508.namd_r 16.000 -
508.namd_r (avg) 16.000 -
508.namd_r (avg) (percentage) 0.430 -2.27%
508.namd_r (max) 15.000 -16.67%
508.namd_r (max) (percentage) 0.420 -16.00%
508.namd_r (unexplained diff vs previous) 4.000 -78.95%
508.namd_r (unexplained diff vs previous) (percentage) 0.110 -78.00%
510.parest_r 23.000 -
510.parest_r (avg) 23.000 -
510.parest_r (avg) (percentage) 0.390 -
510.parest_r (max) 30.000 -
510.parest_r (max) (percentage) 0.510 -
511.povray_r 4.000 -
511.povray_r (avg) 4.000 -
511.povray_r (avg) (percentage) 1.010 -
511.povray_r (max) 9.000 -
511.povray_r (max) (percentage) 2.080 -2.35%
519.lbm_r 24.000 -
519.lbm_r (avg) 24.000 -
519.lbm_r (avg) (percentage) 0.750 -
519.lbm_r (max) 28.000 47.37%
519.lbm_r (max) (percentage) 0.850 44.07%
519.lbm_r (unexplained diff vs previous) 28.000 64.71%
519.lbm_r (unexplained diff vs previous) (percentage) 0.850 63.46%
520.omnetpp_r 42.000 -2.33%
520.omnetpp_r (avg) 42.000 -2.33%
520.omnetpp_r (avg) (percentage) 1.230 -1.60%
520.omnetpp_r (max) 69.000 -6.76%
520.omnetpp_r (max) (percentage) 1.980 -6.60%
520.omnetpp_r (unexplained diff vs previous) 20.000 150.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.570 147.83%
521.wrf_r 93.000 -2.11%
521.wrf_r (avg) 93.000 -2.11%
521.wrf_r (avg) (percentage) 1.020 -
521.wrf_r (max) 226.000 -3.83%
521.wrf_r (max) (percentage) 2.470 -1.98%
523.xalancbmk_r 20.000 -
523.xalancbmk_r (avg) 20.000 -
523.xalancbmk_r (avg) (percentage) 0.630 -
523.xalancbmk_r (max) 30.000 -
523.xalancbmk_r (max) (percentage) 0.960 -
525.x264_r 27.000 -
525.x264_r (avg) 27.000 -
525.x264_r (avg) (percentage) 0.960 -
525.x264_r (max) 12.000 -
525.x264_r (max) (percentage) 0.430 -2.27%
526.blender_r 59.000 -
526.blender_r (avg) 59.000 -
526.blender_r (avg) (percentage) 0.560 -
526.blender_r (max) 109.000 -
526.blender_r (max) (percentage) 1.030 -
527.cam4_r 37.000 -
527.cam4_r (avg) 37.000 -
527.cam4_r (avg) (percentage) 1.560 -
527.cam4_r (max) 28.000 -3.45%
527.cam4_r (max) (percentage) 1.190 -2.46%
531.deepsjeng_r 24.000 -
531.deepsjeng_r (avg) 24.000 -
531.deepsjeng_r (avg) (percentage) 0.460 -
531.deepsjeng_r (max) 24.000 -7.69%
531.deepsjeng_r (max) (percentage) 0.460 -8.00%
531.deepsjeng_r (unexplained diff vs previous) 22.000 340.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.410 355.56%
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.190 -
538.imagick_r (max) 11.000 -
538.imagick_r (max) (percentage) 0.290 -
541.leela_r 30.000 -3.23%
541.leela_r (avg) 30.000 -3.23%
541.leela_r (avg) (percentage) 0.770 -1.28%
541.leela_r (max) 12.000 -40.00%
541.leela_r (max) (percentage) 0.300 -42.31%
541.leela_r (unexplained diff vs previous) 10.000 -37.50%
541.leela_r (unexplained diff vs previous) (percentage) 0.250 -37.50%
544.nab_r 37.000 -
544.nab_r (avg) 37.000 -
544.nab_r (avg) (percentage) 0.480 -
544.nab_r (max) 62.000 -6.06%
544.nab_r (max) (percentage) 0.810 -4.71%
548.exchange2_r (avg) (percentage) 0.990 -
548.exchange2_r (max) (percentage) 1.240 -
549.fotonik3d_r 45.000 -2.17%
549.fotonik3d_r (avg) 45.000 -2.17%
549.fotonik3d_r (avg) (percentage) 0.550 -1.79%
549.fotonik3d_r (max) 131.000 -9.66%
549.fotonik3d_r (max) (percentage) 1.580 -9.71%
549.fotonik3d_r (unexplained diff vs previous) 3.000 -97.97%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.040 -97.75%
554.roms_r 176.000 1.15%
554.roms_r (avg) 176.000 1.15%
554.roms_r (avg) (percentage) 0.690 -
554.roms_r (max) 245.000 -7.20%
554.roms_r (max) (percentage) 0.960 -8.57%
557.xz_r 19.000 -
557.xz_r (avg) 19.000 -
557.xz_r (avg) (percentage) 0.830 -
557.xz_r (max) 24.000 -7.69%
557.xz_r (max) (percentage) 1.040 -4.59%
Geometric Mean 6.245 -1.07%