Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=fcf8f3237cbaa0f97e57a161d7354cdb89a1ffa4 (+ 31 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/f079d69d7b1338522562516537d96e9e1285c95e (+ 74 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=cf11e74b0d81d389bcad5cdbba020ba475f0ac4b (+ 6 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=6e2e529ecc5462e387479b9e323ab0746336190e (+ 282 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-cpu2017rate--gnu-arm-master-O3_LTO-build/153/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0153 (4-changed-components) 2024-04-08T15:46:21 0:00:00
Previous 0152 (3-changed-components) 2024-04-05T09:13:29 0:00:00
Baseline 0073 (4-changed-components) 2023-10-17T22:44:19 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 9 8
Performance Improvements 40 5
Added Tests 0 92
Unchanged Tests 755 699
Total Tests 804

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r 2.25% 2132.000 2180.000 - 8.40% -
531.deepsjeng_r 1.06% 5274.000 5330.000 - 1.12% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) 800.00% 4.000 36.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 775.00% 0.120 1.050 - 0.00% -
548.exchange2_r (unexplained diff vs previous) 300.00% 4.000 16.000 - 0.00% -
548.exchange2_r (unexplained diff vs previous) (percentage) 295.65% 0.230 0.910 - 0.00% -
531.deepsjeng_r (max) 5.56% 18.000 19.000 - 0.00% -
500.perlbench_r 2.70% 37.000 38.000 - 0.00% -
500.perlbench_r (avg) 2.70% 37.000 38.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r -2.44% 4099.000 3999.000 - -0.60% -
511.povray_r -1.15% 435.000 430.000 - 0.47% -
520.omnetpp_r -1.04% 3477.000 3441.000 - 0.44% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) -50.00% 4.000 2.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -50.00% 0.120 0.060 - 0.00% -
519.lbm_r (max) -33.33% 3.000 2.000 - 0.00% -
519.lbm_r (max) (percentage) -25.00% 0.120 0.090 - 0.00% -
538.imagick_r (max) -14.29% 7.000 6.000 - 0.00% -
511.povray_r (max) -12.50% 8.000 7.000 - 0.00% -
507.cactuBSSN_r (max) -8.11% 37.000 34.000 - 0.00% -
505.mcf_r (max) -7.14% 70.000 65.000 - 0.00% -
554.roms_r (max) -6.82% 220.000 205.000 - 0.00% -
520.omnetpp_r (max) -6.78% 59.000 55.000 - 0.00% -
511.povray_r (max) (percentage) -6.52% 1.840 1.720 - 0.00% -
505.mcf_r (max) (percentage) -6.48% 1.080 1.010 - 0.00% -
520.omnetpp_r (max) (percentage) -6.43% 1.710 1.600 - 0.00% -
544.nab_r (max) -6.38% 47.000 44.000 - 0.00% -
554.roms_r (max) (percentage) -6.32% 0.950 0.890 - 0.00% -
557.xz_r (max) -6.25% 16.000 15.000 - 0.00% -
508.namd_r (max) -5.88% 17.000 16.000 - 0.00% -
525.x264_r (max) -5.88% 51.000 48.000 - 0.00% -
525.x264_r (max) (percentage) -5.49% 1.820 1.720 - 0.00% -
507.cactuBSSN_r (max) (percentage) -5.45% 0.550 0.520 - 0.00% -
500.perlbench_r (max) (percentage) -5.44% 3.310 3.130 - 0.00% -
544.nab_r (max) (percentage) -5.00% 0.600 0.570 - 0.00% -
541.leela_r (max) -4.92% 61.000 58.000 - 0.00% -
549.fotonik3d_r (max) -4.69% 64.000 61.000 - 0.00% -
503.bwaves_r (max) -4.55% 44.000 42.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -4.29% 0.700 0.670 - 0.00% -
548.exchange2_r (max) (percentage) -4.23% 1.890 1.810 - 0.00% -
503.bwaves_r (max) (percentage) -3.57% 0.560 0.540 - 0.00% -
548.exchange2_r (max) -3.12% 32.000 31.000 - 0.00% -
557.xz_r (max) (percentage) -2.99% 0.670 0.650 - 0.00% -
520.omnetpp_r -2.94% 34.000 33.000 - 0.00% -
520.omnetpp_r (avg) -2.94% 34.000 33.000 - 0.00% -
500.perlbench_r (max) -2.86% 70.000 68.000 - 0.00% -
541.leela_r (max) (percentage) -2.65% 1.510 1.470 - 0.00% -
521.wrf_r (max) (percentage) -1.61% 1.860 1.830 - 0.00% -
521.wrf_r (max) -1.24% 161.000 159.000 - 0.00% -
527.cam4_r (max) (percentage) -1.03% 0.970 0.960 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r 8.40% 2011.000 2180.000 - 2.25% -
549.fotonik3d_r 6.35% 8562.000 9106.000 - -0.97% -
521.wrf_r 2.52% 8508.000 8722.000 - 0.29% -
557.xz_r 2.08% 2360.000 2409.000 - 0.75% -
525.x264_r 1.72% 2787.000 2835.000 - -0.60% -
531.deepsjeng_r 1.12% 5271.000 5330.000 - 1.06% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -5.26% 19.000 18.000 - 0.00% -
nb_execution_successful -5.26% 19.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r -1.14% 1561691.000 1543875.000 - -0.01% -
548.exchange2_r -1.09% 151886.000 150226.000 - -0.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
548.exchange2_r -3.62% 1824.000 1758.000 - 0.92% -
507.cactuBSSN_r -1.52% 6785.000 6682.000 - -0.71% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 5.26% 19.000 20.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
527.cam4_r (avg) (percentage)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.24s
Name Current %
500.perlbench_r 2180.000 2.25%
503.bwaves_r 7873.000 -
505.mcf_r 6457.000 -
507.cactuBSSN_r 6682.000 -
508.namd_r 3776.000 -
511.povray_r 430.000 -1.15%
519.lbm_r 3288.000 -
520.omnetpp_r 3441.000 -1.04%
521.wrf_r 8722.000 -
525.x264_r 2835.000 -
531.deepsjeng_r 5330.000 1.06%
538.imagick_r 4019.000 -
541.leela_r 3999.000 -2.44%
544.nab_r 7818.000 -
548.exchange2_r 1758.000 -
549.fotonik3d_r 9106.000 -
554.roms_r 23086.000 -
557.xz_r 2409.000 -
Geometric Mean 4245.242 -
Name Current %
500.perlbench_r 2497366.000 -
503.bwaves_r 28507.000 -
505.mcf_r 28245.000 -
507.cactuBSSN_r 4611239.000 -
508.namd_r 903480.000 -
511.povray_r 1095384.000 -
519.lbm_r 11431.000 -
520.omnetpp_r 1576169.000 -
521.wrf_r 21413737.000 -
525.x264_r 594997.000 -
531.deepsjeng_r 112455.000 -
538.imagick_r 1543875.000 -
541.leela_r 99679.000 -
544.nab_r 98563.000 -
548.exchange2_r 150226.000 -
549.fotonik3d_r 398042.000 -
554.roms_r 864489.000 -
557.xz_r 149439.000 -
Geometric Mean 380353.720 -
Name Current %
500.perlbench_r 38.000 2.70%
500.perlbench_r (avg) 38.000 2.70%
500.perlbench_r (avg) (percentage) 1.750 -
500.perlbench_r (max) 68.000 -2.86%
500.perlbench_r (max) (percentage) 3.130 -5.44%
503.bwaves_r 34.000 -
503.bwaves_r (avg) 34.000 -
503.bwaves_r (avg) (percentage) 0.440 -
503.bwaves_r (max) 42.000 -4.55%
503.bwaves_r (max) (percentage) 0.540 -3.57%
505.mcf_r 43.000 -
505.mcf_r (avg) 43.000 -
505.mcf_r (avg) (percentage) 0.670 -
505.mcf_r (max) 65.000 -7.14%
505.mcf_r (max) (percentage) 1.010 -6.48%
507.cactuBSSN_r 50.000 -
507.cactuBSSN_r (avg) 50.000 -
507.cactuBSSN_r (avg) (percentage) 0.750 -
507.cactuBSSN_r (max) 34.000 -8.11%
507.cactuBSSN_r (max) (percentage) 0.520 -5.45%
508.namd_r 15.000 -
508.namd_r (avg) 15.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 16.000 -5.88%
508.namd_r (max) (percentage) 0.450 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.220 -
511.povray_r (max) 7.000 -12.50%
511.povray_r (max) (percentage) 1.720 -6.52%
519.lbm_r 4.000 -
519.lbm_r (avg) 4.000 -
519.lbm_r (avg) (percentage) 0.140 -
519.lbm_r (max) 2.000 -33.33%
519.lbm_r (max) (percentage) 0.090 -25.00%
519.lbm_r (unexplained diff vs previous) 2.000 -50.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.060 -50.00%
520.omnetpp_r 33.000 -2.94%
520.omnetpp_r (avg) 33.000 -2.94%
520.omnetpp_r (avg) (percentage) 0.980 -
520.omnetpp_r (max) 55.000 -6.78%
520.omnetpp_r (max) (percentage) 1.600 -6.43%
520.omnetpp_r (unexplained diff vs previous) 36.000 800.00%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.050 775.00%
521.wrf_r 97.000 -
521.wrf_r (avg) 97.000 -
521.wrf_r (avg) (percentage) 1.120 -
521.wrf_r (max) 159.000 -1.24%
521.wrf_r (max) (percentage) 1.830 -1.61%
525.x264_r 21.000 -
525.x264_r (avg) 21.000 -
525.x264_r (avg) (percentage) 0.770 -
525.x264_r (max) 48.000 -5.88%
525.x264_r (max) (percentage) 1.720 -5.49%
527.cam4_r (avg) (percentage) 1.410 -
527.cam4_r (max) (percentage) 0.960 -1.03%
531.deepsjeng_r 27.000 -
531.deepsjeng_r (avg) 27.000 -
531.deepsjeng_r (avg) (percentage) 0.520 -
531.deepsjeng_r (max) 19.000 5.56%
531.deepsjeng_r (max) (percentage) 0.360 -
538.imagick_r 7.000 -
538.imagick_r (avg) 7.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 6.000 -14.29%
538.imagick_r (max) (percentage) 0.170 -
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.730 -
541.leela_r (max) 58.000 -4.92%
541.leela_r (max) (percentage) 1.470 -2.65%
544.nab_r 25.000 -
544.nab_r (avg) 25.000 -
544.nab_r (avg) (percentage) 0.330 -
544.nab_r (max) 44.000 -6.38%
544.nab_r (max) (percentage) 0.570 -5.00%
548.exchange2_r 16.000 -
548.exchange2_r (avg) 16.000 -
548.exchange2_r (avg) (percentage) 0.940 -
548.exchange2_r (max) 31.000 -3.12%
548.exchange2_r (max) (percentage) 1.810 -4.23%
548.exchange2_r (unexplained diff vs previous) 16.000 300.00%
548.exchange2_r (unexplained diff vs previous) (percentage) 0.910 295.65%
549.fotonik3d_r 36.000 -
549.fotonik3d_r (avg) 36.000 -
549.fotonik3d_r (avg) (percentage) 0.400 -
549.fotonik3d_r (max) 61.000 -4.69%
549.fotonik3d_r (max) (percentage) 0.670 -4.29%
554.roms_r 117.000 -
554.roms_r (avg) 117.000 -
554.roms_r (avg) (percentage) 0.510 -
554.roms_r (max) 205.000 -6.82%
554.roms_r (max) (percentage) 0.890 -6.32%
557.xz_r 14.000 -
557.xz_r (avg) 14.000 -
557.xz_r (avg) (percentage) 0.620 -
557.xz_r (max) 15.000 -6.25%
557.xz_r (max) (percentage) 0.650 -2.99%
Geometric Mean 5.495 3.33%