Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=00c57bf85d0b3033e24535e0fb45c22b995abc59 (unchanged)
git_gcc https://gcc.gnu.org/git/gcc.git (90b735b397c21688d95f1bbb42fba8ad3e17b30e) (+ 1032 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=689a62a4217fae78b9ce0db781dc2a421f2b1ab4 (unchanged)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9c1d44dcc377f4dab42cd34fbbcff8be86bdaa4e (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-Os-build/194/
Filter

gnu-arm-master-Os test results

Run Order Start Time Duration
Current 0194 (basepoints/gcc-15-07689-g90b735b397c) 2025-02-17T04:19:26 0:00:00
Previous 0193 (basepoints/gcc-15-06657-g405c99c1721) 2025-02-09T08:21:00 0:00:00
Baseline 0068 (4-changed-components) 2024-05-28T12:35:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 5 11
Performance Improvements 45 9
Added Tests 4 114
Unchanged Tests 888 808
Total Tests 942

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
541.leela_r 1.22% 14043.000 14214.000 - 1.92% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
527.cam4_r (max) (percentage) 21.21% 0.330 0.400 - 0.00% -
527.cam4_r (max) 20.51% 39.000 47.000 - 0.00% -
511.povray_r 1.05% 95.000 96.000 - 0.00% -
511.povray_r (avg) 1.05% 95.000 96.000 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
500.perlbench_r -2.16% 14065.000 13761.000 - -3.94% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -75.83% 211.000 51.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -75.62% 1.600 0.390 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -33.33% 0.330 0.220 - 0.00% -
519.lbm_r (unexplained diff vs previous) -33.33% 57.000 38.000 - 0.00% -
520.omnetpp_r (max) -25.58% 215.000 160.000 - 0.00% -
520.omnetpp_r (max) (percentage) -25.15% 1.630 1.220 - 0.00% -
503.bwaves_r (max) -17.20% 93.000 77.000 - 0.00% -
503.bwaves_r (max) (percentage) -16.22% 0.370 0.310 - 0.00% -
519.lbm_r (max) -12.50% 56.000 49.000 - 0.00% -
519.lbm_r (max) (percentage) -12.12% 0.330 0.290 - 0.00% -
549.fotonik3d_r (max) -9.09% 22.000 20.000 - 0.00% -
500.perlbench_r (max) -7.78% 90.000 83.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -7.59% 0.790 0.730 - 0.00% -
531.deepsjeng_r (max) -7.23% 83.000 77.000 - 0.00% -
541.leela_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
508.namd_r (max) (percentage) -6.90% 0.290 0.270 - 0.00% -
508.namd_r (max) -6.67% 30.000 28.000 - 0.00% -
541.leela_r (max) -5.26% 19.000 18.000 - 0.00% -
500.perlbench_r (max) (percentage) -4.69% 0.640 0.610 - 0.00% -
544.nab_r (max) (percentage) -4.35% 0.460 0.440 - 0.00% -
538.imagick_r (max) -4.18% 287.000 275.000 - 0.00% -
557.xz_r (max) (percentage) -3.95% 0.760 0.730 - 0.00% -
525.x264_r (max) (percentage) -3.92% 0.510 0.490 - 0.00% -
544.nab_r (max) -3.77% 53.000 51.000 - 0.00% -
538.imagick_r (max) (percentage) -3.74% 1.870 1.800 - 0.00% -
523.xalancbmk_r (max) -3.51% 57.000 55.000 - 0.00% -
557.xz_r (max) -3.19% 94.000 91.000 - 0.00% -
508.namd_r -2.86% 35.000 34.000 - 0.00% -
508.namd_r (avg) -2.86% 35.000 34.000 - 0.00% -
526.blender_r (max) -2.86% 35.000 34.000 - 0.00% -
525.x264_r (max) -2.70% 74.000 72.000 - 0.00% -
511.povray_r (max) (percentage) -2.56% 0.780 0.760 - 0.00% -
520.omnetpp_r -2.46% 122.000 119.000 - 0.00% -
520.omnetpp_r (avg) -2.46% 122.000 119.000 - 0.00% -
521.wrf_r (max) (percentage) -2.38% 0.420 0.410 - 0.00% -
507.cactuBSSN_r (max) (percentage) -2.33% 0.430 0.420 - 0.00% -
507.cactuBSSN_r (max) -2.25% 89.000 87.000 - 0.00% -
521.wrf_r (max) -2.20% 91.000 89.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -2.15% 0.930 0.910 - 0.00% -
500.perlbench_r -1.94% 258.000 253.000 - 0.00% -
500.perlbench_r (avg) -1.94% 258.000 253.000 - 0.00% -
511.povray_r (max) -1.86% 161.000 158.000 - 0.00% -
523.xalancbmk_r -1.75% 57.000 56.000 - 0.00% -
523.xalancbmk_r (avg) -1.75% 57.000 56.000 - 0.00% -

Added Tests - sample variability
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 3.50% 19136.000 19806.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 4.35% 20027.000 20898.000 - 0.69% -
503.bwaves_r 3.22% 24304.000 25086.000 - -0.24% -
520.omnetpp_r 2.12% 12869.000 13142.000 - -0.39% -
541.leela_r 1.92% 13946.000 14214.000 - 1.22% -
544.nab_r 1.88% 11569.000 11786.000 - 0.82% -
525.x264_r 1.52% 14484.000 14704.000 - 0.86% -
554.roms_r 1.22% 21900.000 22168.000 - 0.26% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -52.17% 46.000 22.000 - 0.00% -
nb_compile_successful -47.62% 42.000 22.000 - 0.00% -
nb_execution_successful -47.62% 42.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
541.leela_r -2.40% 74463.000 72676.000 - -0.41% -
538.imagick_r -1.82% 1030211.000 1011433.000 - -0.02% -
549.fotonik3d_r -1.67% 191204.000 188020.000 - -0.02% -
510.parest_r -1.25% 3020884.000 2983262.000 - -0.13% -
507.cactuBSSN_r -1.03% 2081969.000 2060549.000 - -0.02% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
500.perlbench_r -3.94% 14325.000 13761.000 - -2.16% -
549.fotonik3d_r -1.98% 20523.000 20117.000 - -0.03% -
538.imagick_r -1.48% 15514.000 15285.000 - -0.60% -
502.gcc_r -1.06% 10552.000 10440.000 - 0.44% -

Added Tests - Code Size
527.cam4_r

Added Tests - Execution
527.cam4_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
527.cam4_r (unexplained diff vs previous)
527.cam4_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.36s
Name Current %
500.perlbench_r 13761.000 -2.16%
502.gcc_r 10440.000 -
503.bwaves_r 25086.000 -
505.mcf_r 13910.000 -
507.cactuBSSN_r 20786.000 -
508.namd_r 10570.000 -
510.parest_r 23099.000 -
511.povray_r 20898.000 -
519.lbm_r 17196.000 -
520.omnetpp_r 13142.000 -
521.wrf_r 21751.000 -
523.xalancbmk_r 12086.000 -
525.x264_r 14704.000 -
526.blender_r 12257.000 -
527.cam4_r 11864.000 -
531.deepsjeng_r 10595.000 -
538.imagick_r 15285.000 -
541.leela_r 14214.000 1.22%
544.nab_r 11786.000 -
549.fotonik3d_r 20117.000 -
554.roms_r 22168.000 -
557.xz_r 12477.000 -
Geometric Mean 15212.485 -
Name Current %
500.perlbench_r 1145316.000 -
502.gcc_r 4533170.000 -
503.bwaves_r 19806.000 -
505.mcf_r 16021.000 -
507.cactuBSSN_r 2060549.000 -
508.namd_r 358477.000 -
510.parest_r 2983262.000 -
511.povray_r 520987.000 -
519.lbm_r 12012.000 -
520.omnetpp_r 911965.000 -
521.wrf_r 9676692.000 -
523.xalancbmk_r 2046701.000 -
525.x264_r 264594.000 -
526.blender_r 4960253.000 -
527.cam4_r 13681919.000 -
531.deepsjeng_r 55728.000 -
538.imagick_r 1011433.000 -
541.leela_r 72676.000 -
544.nab_r 89658.000 -
549.fotonik3d_r 188020.000 -
554.roms_r 440586.000 -
557.xz_r 111726.000 -
Geometric Mean 451324.761 -
Name Current %
500.perlbench_r 253.000 -1.94%
500.perlbench_r (avg) 253.000 -1.94%
500.perlbench_r (avg) (percentage) 1.840 -
500.perlbench_r (max) 83.000 -7.78%
500.perlbench_r (max) (percentage) 0.610 -4.69%
502.gcc_r 28.000 -
502.gcc_r (avg) 28.000 -
502.gcc_r (avg) (percentage) 0.270 -
502.gcc_r (max) 3.000 -
502.gcc_r (max) (percentage) 0.030 -
503.bwaves_r 60.000 -
503.bwaves_r (avg) 60.000 -
503.bwaves_r (avg) (percentage) 0.240 -
503.bwaves_r (max) 77.000 -17.20%
503.bwaves_r (max) (percentage) 0.310 -16.22%
503.bwaves_r (unexplained diff vs previous) 60.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.240 -
505.mcf_r 38.000 -
505.mcf_r (avg) 38.000 -
505.mcf_r (avg) (percentage) 0.280 -
505.mcf_r (max) 61.000 -
505.mcf_r (max) (percentage) 0.440 -
507.cactuBSSN_r 68.000 -
507.cactuBSSN_r (avg) 68.000 -
507.cactuBSSN_r (avg) (percentage) 0.330 -
507.cactuBSSN_r (max) 87.000 -2.25%
507.cactuBSSN_r (max) (percentage) 0.420 -2.33%
508.namd_r 34.000 -2.86%
508.namd_r (avg) 34.000 -2.86%
508.namd_r (avg) (percentage) 0.330 -
508.namd_r (max) 28.000 -6.67%
508.namd_r (max) (percentage) 0.270 -6.90%
510.parest_r 30.000 -
510.parest_r (avg) 30.000 -
510.parest_r (avg) (percentage) 0.130 -
510.parest_r (max) 20.000 -
510.parest_r (max) (percentage) 0.090 -
511.povray_r 96.000 1.05%
511.povray_r (avg) 96.000 1.05%
511.povray_r (avg) (percentage) 0.460 -
511.povray_r (max) 158.000 -1.86%
511.povray_r (max) (percentage) 0.760 -2.56%
519.lbm_r 27.000 -
519.lbm_r (avg) 27.000 -
519.lbm_r (avg) (percentage) 0.160 -
519.lbm_r (max) 49.000 -12.50%
519.lbm_r (max) (percentage) 0.290 -12.12%
519.lbm_r (unexplained diff vs previous) 38.000 -33.33%
519.lbm_r (unexplained diff vs previous) (percentage) 0.220 -33.33%
520.omnetpp_r 119.000 -2.46%
520.omnetpp_r (avg) 119.000 -2.46%
520.omnetpp_r (avg) (percentage) 0.910 -2.15%
520.omnetpp_r (max) 160.000 -25.58%
520.omnetpp_r (max) (percentage) 1.220 -25.15%
520.omnetpp_r (unexplained diff vs previous) 51.000 -75.83%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.390 -75.62%
521.wrf_r 89.000 -
521.wrf_r (avg) 89.000 -
521.wrf_r (avg) (percentage) 0.410 -
521.wrf_r (max) 89.000 -2.20%
521.wrf_r (max) (percentage) 0.410 -2.38%
523.xalancbmk_r 56.000 -1.75%
523.xalancbmk_r (avg) 56.000 -1.75%
523.xalancbmk_r (avg) (percentage) 0.470 -
523.xalancbmk_r (max) 55.000 -3.51%
523.xalancbmk_r (max) (percentage) 0.460 -
525.x264_r 26.000 -
525.x264_r (avg) 26.000 -
525.x264_r (avg) (percentage) 0.180 -
525.x264_r (max) 72.000 -2.70%
525.x264_r (max) (percentage) 0.490 -3.92%
526.blender_r 28.000 -
526.blender_r (avg) 28.000 -
526.blender_r (avg) (percentage) 0.230 -
526.blender_r (max) 34.000 -2.86%
526.blender_r (max) (percentage) 0.280 -
527.cam4_r 46.000 -
527.cam4_r (avg) 46.000 -
527.cam4_r (avg) (percentage) 0.390 -
527.cam4_r (max) 47.000 20.51%
527.cam4_r (max) (percentage) 0.400 21.21%
527.cam4_r (unexplained diff vs previous) 48.000 -
527.cam4_r (unexplained diff vs previous) (percentage) 0.400 -
531.deepsjeng_r 85.000 -
531.deepsjeng_r (avg) 85.000 -
531.deepsjeng_r (avg) (percentage) 0.810 -
531.deepsjeng_r (max) 77.000 -7.23%
531.deepsjeng_r (max) (percentage) 0.730 -7.59%
538.imagick_r 87.000 -
538.imagick_r (avg) 87.000 -
538.imagick_r (avg) (percentage) 0.570 -
538.imagick_r (max) 275.000 -4.18%
538.imagick_r (max) (percentage) 1.800 -3.74%
541.leela_r 36.000 -
541.leela_r (avg) 36.000 -
541.leela_r (avg) (percentage) 0.260 -
541.leela_r (max) 18.000 -5.26%
541.leela_r (max) (percentage) 0.130 -7.14%
544.nab_r 50.000 -
544.nab_r (avg) 50.000 -
544.nab_r (avg) (percentage) 0.430 -
544.nab_r (max) 51.000 -3.77%
544.nab_r (max) (percentage) 0.440 -4.35%
549.fotonik3d_r 70.000 -
549.fotonik3d_r (avg) 70.000 -
549.fotonik3d_r (avg) (percentage) 0.350 -
549.fotonik3d_r (max) 20.000 -9.09%
549.fotonik3d_r (max) (percentage) 0.100 -
554.roms_r 37.000 -
554.roms_r (avg) 37.000 -
554.roms_r (avg) (percentage) 0.170 -
554.roms_r (max) 35.000 -
554.roms_r (max) (percentage) 0.160 -
557.xz_r 29.000 -
557.xz_r (avg) 29.000 -
557.xz_r (avg) (percentage) 0.240 -
557.xz_r (max) 91.000 -3.19%
557.xz_r (max) (percentage) 0.730 -3.95%
Geometric Mean 6.708 -6.74%