Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=f2cc668e2b0c75d8baaf1b754d9a311084508db3 (+ 1136 commits)
git_gcc https://gcc.gnu.org/git/gcc.git (f242f79b8afeec58477e99c44530bd503878c6d5) (unchanged)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=3fd2ff7685e3ee85c8cd2896f28ad62f67d7c483 (+ 611 commits)
git_linux https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable/commit/9c1d44dcc377f4dab42cd34fbbcff8be86bdaa4e (+ 34703 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O3_LTO-build/348/
Filter

gnu-arm-master-O3_LTO test results

Run Order Start Time Duration
Current 0348 (3-changed-components) 2025-01-04T12:26:40 0:00:00
Previous 0348 (3-changed-components) 2025-01-04T12:26:40 0:00:00
Baseline 0001 (4-changed-components) 2023-02-23T16:28:31 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 0 20
Performance Improvements 0 21
Added Tests 0 107
Unchanged Tests 936 788
Total Tests 936

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
526.blender_r 5.64% 9961079.000 10523349.000 - 0.00% -
557.xz_r 5.58% 145387.000 153499.000 - 0.00% -
541.leela_r 3.72% 100201.000 103929.000 - 0.00% -
519.lbm_r 3.32% 11415.000 11794.000 - 0.00% -
502.gcc_r 3.32% 9512398.000 9827848.000 - 0.00% -
500.perlbench_r 3.28% 2484215.000 2565658.000 - 0.00% -
520.omnetpp_r 1.75% 1620416.000 1648852.000 - 0.00% -
511.povray_r 1.61% 1086933.000 1104431.000 - 0.00% -
510.parest_r 1.28% 1675273.000 1696779.000 - 0.00% -
523.xalancbmk_r 1.15% 3395003.000 3433876.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r 28.78% 13661.000 17592.000 - 0.00% -
554.roms_r 5.72% 17036.000 18011.000 - 0.00% -
508.namd_r 4.27% 9834.000 10254.000 - 0.00% -
503.bwaves_r 3.97% 21603.000 22460.000 - 0.00% -
523.xalancbmk_r 3.27% 9145.000 9444.000 - 0.00% -
521.wrf_r 2.16% 16247.000 16598.000 - 0.00% -
525.x264_r 2.00% 10876.000 11093.000 - 0.00% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
521.wrf_r -25.57% 21211054.000 15788153.000 - 0.00% -
554.roms_r -17.19% 873970.000 723728.000 - 0.00% -
549.fotonik3d_r -13.59% 403090.000 348301.000 - 0.00% -
527.cam4_r -8.48% 3573957.000 3270968.000 - 0.00% -
507.cactuBSSN_r -6.49% 4586703.000 4289210.000 - 0.00% -
508.namd_r -5.54% 853851.000 806557.000 - 0.00% -
544.nab_r -3.78% 97555.000 93871.000 - 0.00% -
525.x264_r -3.01% 607922.000 589609.000 - 0.00% -
505.mcf_r -2.27% 28397.000 27753.000 - 0.00% -
531.deepsjeng_r -2.03% 112861.000 110571.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -13.63% 12966.000 11199.000 - 0.00% -
520.omnetpp_r -8.39% 11076.000 10147.000 - 0.00% -
541.leela_r -5.85% 10449.000 9838.000 - 0.00% -
510.parest_r -4.86% 21273.000 20240.000 - 0.00% -
531.deepsjeng_r -4.71% 12160.000 11587.000 - 0.00% -
557.xz_r -4.47% 10492.000 10023.000 - 0.00% -
505.mcf_r -2.17% 12541.000 12269.000 - 0.00% -
502.gcc_r -2.04% 8756.000 8577.000 - 0.00% -
507.cactuBSSN_r -1.66% 22118.000 21751.000 - 0.00% -
511.povray_r -1.65% 17933.000 17638.000 - 0.00% -
500.perlbench_r -1.21% 12607.000 12454.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.46s
Name Current %
500.perlbench_r 12454.000 -
502.gcc_r 8577.000 -
503.bwaves_r 22460.000 -
505.mcf_r 12269.000 -
507.cactuBSSN_r 21751.000 -
508.namd_r 10254.000 -
510.parest_r 20240.000 -
511.povray_r 17638.000 -
519.lbm_r 17592.000 -
520.omnetpp_r 10147.000 -
521.wrf_r 16598.000 -
523.xalancbmk_r 9444.000 -
525.x264_r 11093.000 -
526.blender_r 10951.000 -
527.cam4_r 9817.000 -
531.deepsjeng_r 11587.000 -
538.imagick_r 14142.000 -
541.leela_r 9838.000 -
544.nab_r 11199.000 -
549.fotonik3d_r 18421.000 -
554.roms_r 18011.000 -
557.xz_r 10023.000 -
Geometric Mean 13226.320 -
Name Current %
500.perlbench_r 2565658.000 -
502.gcc_r 9827848.000 -
503.bwaves_r 28121.000 -
505.mcf_r 27753.000 -
507.cactuBSSN_r 4289210.000 -
508.namd_r 806557.000 -
510.parest_r 1696779.000 -
511.povray_r 1104431.000 -
519.lbm_r 11794.000 -
520.omnetpp_r 1648852.000 -
521.wrf_r 15788153.000 -
523.xalancbmk_r 3433876.000 -
525.x264_r 589609.000 -
526.blender_r 10523349.000 -
527.cam4_r 3270968.000 -
531.deepsjeng_r 110571.000 -
538.imagick_r 1547975.000 -
541.leela_r 103929.000 -
544.nab_r 93871.000 -
549.fotonik3d_r 348301.000 -
554.roms_r 723728.000 -
557.xz_r 153499.000 -
Geometric Mean 675123.875 -
Name Current %
500.perlbench_r 68.000 -
500.perlbench_r (avg) 68.000 -
500.perlbench_r (avg) (percentage) 0.550 -
500.perlbench_r (max) 119.000 -
500.perlbench_r (max) (percentage) 0.960 -
500.perlbench_r (unexplained diff vs previous) 114.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.920 -
502.gcc_r 28.000 -
502.gcc_r (avg) 28.000 -
502.gcc_r (avg) (percentage) 0.330 -
502.gcc_r (max) 54.000 -
502.gcc_r (max) (percentage) 0.640 -
502.gcc_r (unexplained diff vs previous) 55.000 -
502.gcc_r (unexplained diff vs previous) (percentage) 0.640 -
503.bwaves_r 44.000 -
503.bwaves_r (avg) 44.000 -
503.bwaves_r (avg) (percentage) 0.200 -
503.bwaves_r (max) 49.000 -
503.bwaves_r (max) (percentage) 0.220 -
503.bwaves_r (unexplained diff vs previous) 18.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.080 -
505.mcf_r 50.000 -
505.mcf_r (avg) 50.000 -
505.mcf_r (avg) (percentage) 0.410 -
505.mcf_r (max) 105.000 -
505.mcf_r (max) (percentage) 0.860 -
505.mcf_r (unexplained diff vs previous) 94.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.770 -
507.cactuBSSN_r 123.000 -
507.cactuBSSN_r (avg) 123.000 -
507.cactuBSSN_r (avg) (percentage) 0.570 -
507.cactuBSSN_r (max) 215.000 -
507.cactuBSSN_r (max) (percentage) 0.990 -
507.cactuBSSN_r (unexplained diff vs previous) 174.000 -
507.cactuBSSN_r (unexplained diff vs previous) (percentage) 0.800 -
508.namd_r 19.000 -
508.namd_r (avg) 19.000 -
508.namd_r (avg) (percentage) 0.190 -
508.namd_r (max) 19.000 -
508.namd_r (max) (percentage) 0.190 -
508.namd_r (unexplained diff vs previous) 9.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.090 -
510.parest_r 32.000 -
510.parest_r (avg) 32.000 -
510.parest_r (avg) (percentage) 0.160 -
510.parest_r (max) 38.000 -
510.parest_r (max) (percentage) 0.190 -
510.parest_r (unexplained diff vs previous) 12.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.060 -
511.povray_r 67.000 -
511.povray_r (avg) 67.000 -
511.povray_r (avg) (percentage) 0.380 -
511.povray_r (max) 199.000 -
511.povray_r (max) (percentage) 1.130 -
511.povray_r (unexplained diff vs previous) 51.000 -
511.povray_r (unexplained diff vs previous) (percentage) 0.290 -
519.lbm_r 31.000 -
519.lbm_r (avg) 31.000 -
519.lbm_r (avg) (percentage) 0.180 -
519.lbm_r (max) 58.000 -
519.lbm_r (max) (percentage) 0.330 -
519.lbm_r (unexplained diff vs previous) 58.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.330 -
520.omnetpp_r 85.000 -
520.omnetpp_r (avg) 85.000 -
520.omnetpp_r (avg) (percentage) 0.840 -
520.omnetpp_r (max) 114.000 -
520.omnetpp_r (max) (percentage) 1.130 -
520.omnetpp_r (unexplained diff vs previous) 61.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.600 -
521.wrf_r 112.000 -
521.wrf_r (avg) 112.000 -
521.wrf_r (avg) (percentage) 0.680 -
521.wrf_r (max) 219.000 -
521.wrf_r (max) (percentage) 1.320 -
521.wrf_r (unexplained diff vs previous) 70.000 -
521.wrf_r (unexplained diff vs previous) (percentage) 0.420 -
523.xalancbmk_r 62.000 -
523.xalancbmk_r (avg) 62.000 -
523.xalancbmk_r (avg) (percentage) 0.660 -
523.xalancbmk_r (max) 71.000 -
523.xalancbmk_r (max) (percentage) 0.760 -
523.xalancbmk_r (unexplained diff vs previous) 29.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.310 -
525.x264_r 17.000 -
525.x264_r (avg) 17.000 -
525.x264_r (avg) (percentage) 0.160 -
525.x264_r (max) 4.000 -
525.x264_r (max) (percentage) 0.040 -
525.x264_r (unexplained diff vs previous) 4.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.040 -
526.blender_r 53.000 -
526.blender_r (avg) 53.000 -
526.blender_r (avg) (percentage) 0.490 -
526.blender_r (max) 151.000 -
526.blender_r (max) (percentage) 1.380 -
526.blender_r (unexplained diff vs previous) 153.000 -
526.blender_r (unexplained diff vs previous) (percentage) 1.400 -
531.deepsjeng_r 111.000 -
531.deepsjeng_r (avg) 111.000 -
531.deepsjeng_r (avg) (percentage) 0.960 -
531.deepsjeng_r (max) 234.000 -
531.deepsjeng_r (max) (percentage) 2.020 -
538.imagick_r 48.000 -
538.imagick_r (avg) 48.000 -
538.imagick_r (avg) (percentage) 0.340 -
538.imagick_r (max) 120.000 -
538.imagick_r (max) (percentage) 0.850 -
538.imagick_r (unexplained diff vs previous) 119.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.840 -
541.leela_r 36.000 -
541.leela_r (avg) 36.000 -
541.leela_r (avg) (percentage) 0.370 -
541.leela_r (max) 32.000 -
541.leela_r (max) (percentage) 0.330 -
541.leela_r (unexplained diff vs previous) 17.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.170 -
544.nab_r 39.000 -
544.nab_r (avg) 39.000 -
544.nab_r (avg) (percentage) 0.350 -
544.nab_r (max) 33.000 -
544.nab_r (max) (percentage) 0.300 -
544.nab_r (unexplained diff vs previous) 34.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.300 -
548.exchange2_r (avg) (percentage) 0.340 -
548.exchange2_r (max) (percentage) 0.570 -
549.fotonik3d_r 22.000 -
549.fotonik3d_r (avg) 22.000 -
549.fotonik3d_r (avg) (percentage) 0.120 -
549.fotonik3d_r (max) 16.000 -
549.fotonik3d_r (max) (percentage) 0.090 -
549.fotonik3d_r (unexplained diff vs previous) 13.000 -
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.070 -
554.roms_r 39.000 -
554.roms_r (avg) 39.000 -
554.roms_r (avg) (percentage) 0.220 -
554.roms_r (max) 86.000 -
554.roms_r (max) (percentage) 0.480 -
554.roms_r (unexplained diff vs previous) 87.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.480 -
557.xz_r 18.000 -
557.xz_r (avg) 18.000 -
557.xz_r (avg) (percentage) 0.180 -
557.xz_r (max) 15.000 -
557.xz_r (max) (percentage) 0.150 -
557.xz_r (unexplained diff vs previous) 1.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.010 -
Geometric Mean 5.400 -