Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=00c57bf85d0b3033e24535e0fb45c22b995abc59 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (9e4c57f7a69d7060612c83867ecff61a719b97af) (+ 1028 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=689a62a4217fae78b9ce0db781dc2a421f2b1ab4 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9c1d44dcc377f4dab42cd34fbbcff8be86bdaa4e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/292/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0292 (basepoints/gcc-15-07685-g9e4c57f7a69) 2025-02-17T00:04:23 0:00:00
Previous 0291 (basepoints/gcc-15-06657-g405c99c17210) 2025-02-09T13:56:52 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 30
Performance Improvements 39 10
Added Tests 2 107
Unchanged Tests 890 789
Total Tests 936

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.17% 27475.000 27797.000 - 6.08% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
507.cactuBSSN_r 1.83% 109.000 111.000 - 0.00% -
507.cactuBSSN_r (avg) 1.83% 109.000 111.000 - 0.00% -
531.deepsjeng_r 1.16% 86.000 87.000 - 0.00% -
531.deepsjeng_r (avg) 1.16% 86.000 87.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
525.x264_r -1.45% 14185.000 13980.000 - -2.49% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
519.lbm_r (unexplained diff vs previous) -96.02% 201.000 8.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -95.76% 1.180 0.050 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) -78.01% 391.000 86.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -77.68% 3.540 0.790 - 0.00% -
520.omnetpp_r (max) -17.51% 377.000 311.000 - 0.00% -
520.omnetpp_r (max) (percentage) -16.67% 3.420 2.850 - 0.00% -
519.lbm_r (max) (percentage) -12.61% 1.190 1.040 - 0.00% -
519.lbm_r (max) -12.38% 202.000 177.000 - 0.00% -
505.mcf_r (max) -6.25% 96.000 90.000 - 0.00% -
505.mcf_r (max) (percentage) -5.71% 0.700 0.660 - 0.00% -
557.xz_r (max) -5.56% 18.000 17.000 - 0.00% -
541.leela_r (max) (percentage) -5.26% 0.190 0.180 - 0.00% -
508.namd_r -4.76% 21.000 20.000 - 0.00% -
508.namd_r (avg) -4.76% 21.000 20.000 - 0.00% -
508.namd_r (avg) (percentage) -4.55% 0.220 0.210 - 0.00% -
541.leela_r (max) -4.55% 22.000 21.000 - 0.00% -
503.bwaves_r (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
554.roms_r (max) (percentage) -4.00% 0.250 0.240 - 0.00% -
503.bwaves_r (max) -4.00% 100.000 96.000 - 0.00% -
554.roms_r (max) -3.77% 53.000 51.000 - 0.00% -
508.namd_r (max) -3.75% 80.000 77.000 - 0.00% -
508.namd_r (max) (percentage) -3.66% 0.820 0.790 - 0.00% -
502.gcc_r (max) -3.45% 29.000 28.000 - 0.00% -
519.lbm_r (avg) (percentage) -3.23% 0.310 0.300 - 0.00% -
526.blender_r (max) (percentage) -2.99% 0.670 0.650 - 0.00% -
521.wrf_r (max) -2.99% 67.000 65.000 - 0.00% -
526.blender_r (max) -2.78% 72.000 70.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -2.50% 0.800 0.780 - 0.00% -
521.wrf_r (max) (percentage) -2.50% 0.400 0.390 - 0.00% -
519.lbm_r -1.92% 52.000 51.000 - 0.00% -
519.lbm_r (avg) -1.92% 52.000 51.000 - 0.00% -
544.nab_r (max) (percentage) -1.85% 0.540 0.530 - 0.00% -
523.xalancbmk_r (max) (percentage) -1.83% 1.640 1.610 - 0.00% -
523.xalancbmk_r (max) -1.80% 167.000 164.000 - 0.00% -
544.nab_r (max) -1.67% 60.000 59.000 - 0.00% -
520.omnetpp_r -1.54% 130.000 128.000 - 0.00% -
520.omnetpp_r (avg) -1.54% 130.000 128.000 - 0.00% -
507.cactuBSSN_r (max) -1.37% 219.000 216.000 - 0.00% -

Added Tests - sample variability
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 8.97% 28615.000 31182.000 - 0.03% -
510.parest_r 8.51% 6402190.000 6947083.000 - 0.01% -
541.leela_r 7.95% 126444.000 136502.000 - -0.54% -
520.omnetpp_r 6.67% 1579795.000 1685104.000 - 0.01% -
557.xz_r 6.33% 171382.000 182234.000 - -0.02% -
526.blender_r 6.23% 7841603.000 8329793.000 - 0.00% -
507.cactuBSSN_r 5.82% 3793035.000 4013756.000 - 0.00% -
519.lbm_r 4.57% 13274.000 13881.000 - 0.00% -
521.wrf_r 4.25% 18630170.000 19421977.000 - 0.20% -
523.xalancbmk_r 4.16% 3639697.000 3790950.000 - 0.00% -
502.gcc_r 4.13% 8093137.000 8427651.000 - 0.00% -
500.perlbench_r 3.96% 1879803.000 1954162.000 - 0.00% -
544.nab_r 3.94% 149498.000 155390.000 - -0.03% -
508.namd_r 3.13% 643020.000 663120.000 - 0.00% -
505.mcf_r 2.78% 24877.000 25569.000 - 0.00% -
525.x264_r 2.78% 438558.000 450745.000 - 0.04% -
511.povray_r 2.43% 771450.000 790200.000 - -0.01% -
531.deepsjeng_r 1.82% 90159.000 91801.000 - -0.04% -
554.roms_r 1.67% 691655.000 703229.000 - -0.01% -
538.imagick_r 1.48% 1669137.000 1693911.000 - 0.02% -
527.cam4_r 1.39% 15743687.000 15962539.000 - -0.01% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
507.cactuBSSN_r 6.08% 26205.000 27797.000 - 1.17% -
554.roms_r 4.44% 20494.000 21403.000 - 0.23% -
531.deepsjeng_r 3.09% 11141.000 11485.000 - 0.43% -
523.xalancbmk_r 2.35% 10004.000 10239.000 - 0.30% -
505.mcf_r 1.90% 13471.000 13727.000 - 0.00% -
519.lbm_r 1.34% 16818.000 17044.000 - -0.05% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -12.51% 12900.000 11286.000 - 0.26% -
541.leela_r -6.18% 12835.000 12042.000 - -0.07% -
557.xz_r -5.67% 10659.000 10055.000 - -0.45% -
520.omnetpp_r -4.59% 11471.000 10945.000 - -0.78% -
503.bwaves_r -4.49% 22913.000 21884.000 - -0.31% -
511.povray_r -3.93% 18060.000 17351.000 - -0.42% -
538.imagick_r -2.78% 15456.000 15027.000 - -0.27% -
525.x264_r -2.49% 14337.000 13980.000 - -1.45% -
502.gcc_r -2.17% 9245.000 9044.000 - -0.30% -
526.blender_r -1.33% 11021.000 10874.000 - 0.27% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.37s
Name Current %
500.perlbench_r 12986.000 -
502.gcc_r 9044.000 -
503.bwaves_r 21884.000 -
505.mcf_r 13727.000 -
507.cactuBSSN_r 27797.000 1.17%
508.namd_r 9862.000 -
510.parest_r 20696.000 -
511.povray_r 17351.000 -
519.lbm_r 17044.000 -
520.omnetpp_r 10945.000 -
521.wrf_r 16732.000 -
523.xalancbmk_r 10239.000 -
525.x264_r 13980.000 -1.45%
526.blender_r 10874.000 -
527.cam4_r 10688.000 -
531.deepsjeng_r 11485.000 -
538.imagick_r 15027.000 -
541.leela_r 12042.000 -
544.nab_r 11286.000 -
549.fotonik3d_r 18483.000 -
554.roms_r 21403.000 -
557.xz_r 10055.000 -
Geometric Mean 14016.351 -
Name Current %
500.perlbench_r 1954162.000 -
502.gcc_r 8427651.000 -
503.bwaves_r 31182.000 -
505.mcf_r 25569.000 -
507.cactuBSSN_r 4013756.000 -
508.namd_r 663120.000 -
510.parest_r 6947083.000 -
511.povray_r 790200.000 -
519.lbm_r 13881.000 -
520.omnetpp_r 1685104.000 -
521.wrf_r 19421977.000 -
523.xalancbmk_r 3790950.000 -
525.x264_r 450745.000 -
526.blender_r 8329793.000 -
527.cam4_r 15962539.000 -
531.deepsjeng_r 91801.000 -
538.imagick_r 1693911.000 -
541.leela_r 136502.000 -
544.nab_r 155390.000 -
549.fotonik3d_r 333226.000 -
554.roms_r 703229.000 -
557.xz_r 182234.000 -
Geometric Mean 765395.398 -
Name Current %
500.perlbench_r 63.000 -
500.perlbench_r (avg) 63.000 -
500.perlbench_r (avg) (percentage) 0.490 -
500.perlbench_r (max) 127.000 -
500.perlbench_r (max) (percentage) 0.980 -
502.gcc_r 34.000 -
502.gcc_r (avg) 34.000 -
502.gcc_r (avg) (percentage) 0.380 -
502.gcc_r (max) 28.000 -3.45%
502.gcc_r (max) (percentage) 0.320 -
503.bwaves_r 48.000 -
503.bwaves_r (avg) 48.000 -
503.bwaves_r (avg) (percentage) 0.220 -
503.bwaves_r (max) 96.000 -4.00%
503.bwaves_r (max) (percentage) 0.440 -4.35%
505.mcf_r 37.000 -
505.mcf_r (avg) 37.000 -
505.mcf_r (avg) (percentage) 0.270 -
505.mcf_r (max) 90.000 -6.25%
505.mcf_r (max) (percentage) 0.660 -5.71%
507.cactuBSSN_r 111.000 1.83%
507.cactuBSSN_r (avg) 111.000 1.83%
507.cactuBSSN_r (avg) (percentage) 0.400 -
507.cactuBSSN_r (max) 216.000 -1.37%
507.cactuBSSN_r (max) (percentage) 0.780 -2.50%
508.namd_r 20.000 -4.76%
508.namd_r (avg) 20.000 -4.76%
508.namd_r (avg) (percentage) 0.210 -4.55%
508.namd_r (max) 77.000 -3.75%
508.namd_r (max) (percentage) 0.790 -3.66%
508.namd_r (unexplained diff vs previous) 10.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.100 -
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.110 -
510.parest_r (max) 22.000 -
510.parest_r (max) (percentage) 0.110 -
511.povray_r 55.000 -
511.povray_r (avg) 55.000 -
511.povray_r (avg) (percentage) 0.320 -
511.povray_r (max) 19.000 -
511.povray_r (max) (percentage) 0.110 -
519.lbm_r 51.000 -1.92%
519.lbm_r (avg) 51.000 -1.92%
519.lbm_r (avg) (percentage) 0.300 -3.23%
519.lbm_r (max) 177.000 -12.38%
519.lbm_r (max) (percentage) 1.040 -12.61%
519.lbm_r (unexplained diff vs previous) 8.000 -96.02%
519.lbm_r (unexplained diff vs previous) (percentage) 0.050 -95.76%
520.omnetpp_r 128.000 -1.54%
520.omnetpp_r (avg) 128.000 -1.54%
520.omnetpp_r (avg) (percentage) 1.170 -
520.omnetpp_r (max) 311.000 -17.51%
520.omnetpp_r (max) (percentage) 2.850 -16.67%
520.omnetpp_r (unexplained diff vs previous) 86.000 -78.01%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.790 -77.68%
521.wrf_r 75.000 -
521.wrf_r (avg) 75.000 -
521.wrf_r (avg) (percentage) 0.450 -
521.wrf_r (max) 65.000 -2.99%
521.wrf_r (max) (percentage) 0.390 -2.50%
523.xalancbmk_r 61.000 -
523.xalancbmk_r (avg) 61.000 -
523.xalancbmk_r (avg) (percentage) 0.600 -
523.xalancbmk_r (max) 164.000 -1.80%
523.xalancbmk_r (max) (percentage) 1.610 -1.83%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 22.000 -
525.x264_r (max) (percentage) 0.160 -
526.blender_r 36.000 -
526.blender_r (avg) 36.000 -
526.blender_r (avg) (percentage) 0.340 -
526.blender_r (max) 70.000 -2.78%
526.blender_r (max) (percentage) 0.650 -2.99%
531.deepsjeng_r 87.000 1.16%
531.deepsjeng_r (avg) 87.000 1.16%
531.deepsjeng_r (avg) (percentage) 0.760 -
531.deepsjeng_r (max) 24.000 -
531.deepsjeng_r (max) (percentage) 0.210 -
538.imagick_r 45.000 -
538.imagick_r (avg) 45.000 -
538.imagick_r (avg) (percentage) 0.300 -
538.imagick_r (max) 57.000 -
538.imagick_r (max) (percentage) 0.380 -
541.leela_r 28.000 -
541.leela_r (avg) 28.000 -
541.leela_r (avg) (percentage) 0.240 -
541.leela_r (max) 21.000 -4.55%
541.leela_r (max) (percentage) 0.180 -5.26%
544.nab_r 37.000 -
544.nab_r (avg) 37.000 -
544.nab_r (avg) (percentage) 0.330 -
544.nab_r (max) 59.000 -1.67%
544.nab_r (max) (percentage) 0.530 -1.85%
548.exchange2_r (avg) (percentage) 0.280 -
548.exchange2_r (max) (percentage) 0.300 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 25.000 -
549.fotonik3d_r (max) (percentage) 0.140 -
554.roms_r 36.000 -
554.roms_r (avg) 36.000 -
554.roms_r (avg) (percentage) 0.170 -
554.roms_r (max) 51.000 -3.77%
554.roms_r (max) (percentage) 0.240 -4.00%
557.xz_r 10.000 -
557.xz_r (avg) 10.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 17.000 -5.56%
557.xz_r (max) (percentage) 0.170 -
Geometric Mean 5.658 -12.27%