Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=291b72ad02fa2881a7557954d1d9a7c83098e782 (+ 25 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (57f6e6e25638a4f82083aa8f9fb2e258599bde99) (+ 91 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=319f94dea2b7eeff12adb22ee50b46b64dd6a52d (+ 20 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/6f871ce2482ed3a48ea0e1080bfeb7e4d6e99f78 (+ 146 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--gnu-arm-master-Os-build/252/
Filter

gnu-arm-master-Os test results

Run Order Start Time Duration
Current 0252 (4-changed-components) 2025-05-18T01:19:24 0:00:00
Previous 0252 (4-changed-components) 2025-05-18T01:19:24 0:00:00
Baseline 0001 (4-changed-components) 2023-03-08T07:17:35 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 5
Performance Improvements 0 18
Added Tests 2 119
Unchanged Tests 922 782
Total Tests 924

Added Tests - sample variability
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 4.33% 19111.000 19938.000 - 0.00% -
511.povray_r 1.13% 516007.000 521835.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
527.cam4_r 1.77% 2830.000 2880.000 - 0.00% -
541.leela_r 1.77% 5774.000 5876.000 - 0.00% -
500.perlbench_r 1.03% 2141.000 2163.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r -4.69% 13392.000 12764.000 - 0.00% -
549.fotonik3d_r -2.28% 193913.000 189497.000 - 0.00% -
538.imagick_r -2.14% 1020801.000 998975.000 - 0.00% -
541.leela_r -1.81% 73798.000 72464.000 - 0.00% -
544.nab_r -1.26% 91892.000 90736.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
549.fotonik3d_r -5.73% 10941.000 10314.000 - 0.00% -
519.lbm_r -4.37% 4627.000 4425.000 - 0.00% -
511.povray_r -4.21% 523.000 501.000 - 0.00% -
557.xz_r -3.92% 2883.000 2770.000 - 0.00% -
505.mcf_r -3.67% 7174.000 6911.000 - 0.00% -
507.cactuBSSN_r -3.55% 5824.000 5617.000 - 0.00% -
520.omnetpp_r -3.49% 3982.000 3843.000 - 0.00% -
502.gcc_r -3.36% 4343.000 4197.000 - 0.00% -
554.roms_r -3.02% 38476.000 37314.000 - 0.00% -
538.imagick_r -2.24% 4329.000 4232.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 10.00% 20.000 22.000 - 0.00% -
nb_execution_successful 10.00% 20.000 22.000 - 0.00% -
nb_total_tests 10.00% 20.000 22.000 - 0.00% -

Added Tests - Code Size
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - Execution
510.parest_r
523.xalancbmk_r
526.blender_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
510.parest_r (unexplained diff vs previous)
510.parest_r (unexplained diff vs previous) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
511.povray_r (unexplained diff vs previous)
511.povray_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
527.cam4_r
527.cam4_r (avg)
527.cam4_r (avg) (percentage)
527.cam4_r (max)
527.cam4_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 2163.000 -
502.gcc_r 4197.000 -
503.bwaves_r 10499.000 -
505.mcf_r 6911.000 -
507.cactuBSSN_r 5617.000 -
508.namd_r 4270.000 -
510.parest_r 7323.000 -
511.povray_r 501.000 -
519.lbm_r 4425.000 -
520.omnetpp_r 3843.000 -
521.wrf_r 12912.000 -
523.xalancbmk_r 4583.000 -
525.x264_r 4172.000 -
526.blender_r 13542.000 -
527.cam4_r 2880.000 -
531.deepsjeng_r 5432.000 -
538.imagick_r 4232.000 -
541.leela_r 5876.000 -
544.nab_r 8747.000 -
549.fotonik3d_r 10314.000 -
554.roms_r 37314.000 -
557.xz_r 2770.000 -
Geometric Mean 5380.172 -
Name Current %
500.perlbench_r 1146976.000 -
502.gcc_r 4529356.000 -
503.bwaves_r 19938.000 -
505.mcf_r 16545.000 -
507.cactuBSSN_r 2061193.000 -
508.namd_r 358619.000 -
510.parest_r 2985185.000 -
511.povray_r 521835.000 -
519.lbm_r 12764.000 -
520.omnetpp_r 911519.000 -
521.wrf_r 9754742.000 -
523.xalancbmk_r 2047229.000 -
525.x264_r 265450.000 -
526.blender_r 4963997.000 -
527.cam4_r 13692507.000 -
531.deepsjeng_r 55876.000 -
538.imagick_r 998975.000 -
541.leela_r 72464.000 -
544.nab_r 90736.000 -
549.fotonik3d_r 189497.000 -
554.roms_r 441747.000 -
557.xz_r 111822.000 -
Geometric Mean 453923.210 -
Name Current %
500.perlbench_r 20.000 -
500.perlbench_r (avg) 20.000 -
500.perlbench_r (avg) (percentage) 0.960 -
500.perlbench_r (max) 40.000 -
500.perlbench_r (max) (percentage) 1.870 -
500.perlbench_r (unexplained diff vs previous) 9.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.420 -
503.bwaves_r 34.000 -
503.bwaves_r (avg) 34.000 -
503.bwaves_r (avg) (percentage) 0.330 -
503.bwaves_r (max) 68.000 -
503.bwaves_r (max) (percentage) 0.650 -
503.bwaves_r (unexplained diff vs previous) 13.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.120 -
505.mcf_r 57.000 -
505.mcf_r (avg) 57.000 -
505.mcf_r (avg) (percentage) 0.830 -
505.mcf_r (max) 20.000 -
505.mcf_r (max) (percentage) 0.290 -
505.mcf_r (unexplained diff vs previous) 20.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.290 -
507.cactuBSSN_r 30.000 -
507.cactuBSSN_r (avg) 30.000 -
507.cactuBSSN_r (avg) (percentage) 0.550 -
507.cactuBSSN_r (max) 41.000 -
507.cactuBSSN_r (max) (percentage) 0.740 -
507.cactuBSSN_r (unexplained diff vs previous) 42.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.750 -
508.namd_r 17.000 -
508.namd_r (avg) 17.000 -
508.namd_r (avg) (percentage) 0.410 -
508.namd_r (max) 46.000 -
508.namd_r (max) (percentage) 1.080 -
508.namd_r (unexplained diff vs previous) 10.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.230 -
510.parest_r 17.000 -
510.parest_r (avg) 17.000 -
510.parest_r (avg) (percentage) 0.240 -
510.parest_r (max) 41.000 -
510.parest_r (max) (percentage) 0.570 -
510.parest_r (unexplained diff vs previous) 1.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.010 -
511.povray_r 5.000 -
511.povray_r (avg) 5.000 -
511.povray_r (avg) (percentage) 1.050 -
511.povray_r (max) 6.000 -
511.povray_r (max) (percentage) 1.270 -
511.povray_r (unexplained diff vs previous) 0.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.000 -
519.lbm_r 8.000 -
519.lbm_r (avg) 8.000 -
519.lbm_r (avg) (percentage) 0.190 -
519.lbm_r (max) 23.000 -
519.lbm_r (max) (percentage) 0.520 -
519.lbm_r (unexplained diff vs previous) 10.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.230 -
520.omnetpp_r 44.000 -
520.omnetpp_r (avg) 44.000 -
520.omnetpp_r (avg) (percentage) 1.160 -
520.omnetpp_r (max) 81.000 -
520.omnetpp_r (max) (percentage) 2.130 -
520.omnetpp_r (unexplained diff vs previous) 80.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 2.080 -
521.wrf_r 89.000 -
521.wrf_r (avg) 89.000 -
521.wrf_r (avg) (percentage) 0.690 -
521.wrf_r (max) 94.000 -
521.wrf_r (max) (percentage) 0.730 -
521.wrf_r (unexplained diff vs previous) 94.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.730 -
523.xalancbmk_r 18.000 -
523.xalancbmk_r (avg) 18.000 -
523.xalancbmk_r (avg) (percentage) 0.400 -
523.xalancbmk_r (max) 18.000 -
523.xalancbmk_r (max) (percentage) 0.400 -
525.x264_r 18.000 -
525.x264_r (avg) 18.000 -
525.x264_r (avg) (percentage) 0.450 -
525.x264_r (max) 12.000 -
525.x264_r (max) (percentage) 0.310 -
525.x264_r (unexplained diff vs previous) 1.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.020 -
526.blender_r 29.000 -
526.blender_r (avg) 29.000 -
526.blender_r (avg) (percentage) 0.220 -
526.blender_r (max) 79.000 -
526.blender_r (max) (percentage) 0.590 -
526.blender_r (unexplained diff vs previous) 80.000 -
526.blender_r (unexplained diff vs previous) (percentage) 0.590 -
527.cam4_r 36.000 -
527.cam4_r (avg) 36.000 -
527.cam4_r (avg) (percentage) 1.270 -
527.cam4_r (max) 40.000 -
527.cam4_r (max) (percentage) 1.410 -
527.cam4_r (unexplained diff vs previous) 14.000 -
527.cam4_r (unexplained diff vs previous) (percentage) 0.490 -
531.deepsjeng_r 24.000 -
531.deepsjeng_r (avg) 24.000 -
531.deepsjeng_r (avg) (percentage) 0.450 -
531.deepsjeng_r (max) 39.000 -
531.deepsjeng_r (max) (percentage) 0.730 -
531.deepsjeng_r (unexplained diff vs previous) 36.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.660 -
538.imagick_r 12.000 -
538.imagick_r (avg) 12.000 -
538.imagick_r (avg) (percentage) 0.290 -
538.imagick_r (max) 7.000 -
538.imagick_r (max) (percentage) 0.170 -
538.imagick_r (unexplained diff vs previous) 6.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.140 -
541.leela_r 33.000 -
541.leela_r (avg) 33.000 -
541.leela_r (avg) (percentage) 0.570 -
541.leela_r (max) 22.000 -
541.leela_r (max) (percentage) 0.380 -
541.leela_r (unexplained diff vs previous) 19.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.320 -
544.nab_r 35.000 -
544.nab_r (avg) 35.000 -
544.nab_r (avg) (percentage) 0.410 -
544.nab_r (max) 54.000 -
544.nab_r (max) (percentage) 0.620 -
544.nab_r (unexplained diff vs previous) 54.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.620 -
548.exchange2_r (avg) (percentage) 0.410 -
548.exchange2_r (max) (percentage) 0.740 -
549.fotonik3d_r 33.000 -
549.fotonik3d_r (avg) 33.000 -
549.fotonik3d_r (avg) (percentage) 0.320 -
549.fotonik3d_r (max) 21.000 -
549.fotonik3d_r (max) (percentage) 0.210 -
549.fotonik3d_r (unexplained diff vs previous) 13.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.130 -
554.roms_r 276.000 -
554.roms_r (avg) 276.000 -
554.roms_r (avg) (percentage) 0.740 -
554.roms_r (max) 194.000 -
554.roms_r (max) (percentage) 0.520 -
554.roms_r (unexplained diff vs previous) 138.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.370 -
557.xz_r 15.000 -
557.xz_r (avg) 15.000 -
557.xz_r (avg) (percentage) 0.550 -
557.xz_r (max) 41.000 -
557.xz_r (max) (percentage) 1.490 -
557.xz_r (unexplained diff vs previous) 4.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.140 -
Geometric Mean 3.787 -13.53%