Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_binutils https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=a9505c74206cfb797d3baac526b19ba7055675dc (+ 142 commits)
git_gcc https://github.com/gcc-mirror/gcc/commit/5c749db15fab032df757b72e8114b89572783a20 (+ 127 commits)
git_glibc https://sourceware.org/git/?p=glibc.git;a=commit;h=95c70fd0d467450e75354316453824693f07c3cc (+ 11 commits)
git_linux https://git.linaro.org/kernel-org/linux-stable.git/commit/?id=82ff59b5737ee25ce8b7eae81833be9b249e58c3 (+ 17459 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--gnu-arm-master-O2-build/149/
Filter

gnu-arm-master-O2 test results

Run Order Start Time Duration
Current 0149 (4-changed-components) 2024-03-27T08:16:33 0:00:00
Previous 0148 (4-changed-components) 2024-03-20T00:22:03 0:00:00
Baseline 0002 (4-changed-components) 2023-02-27T19:12:28 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 13
Performance Improvements 40 7
Added Tests 0 110
Unchanged Tests 888 818
Total Tests 948

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
531.deepsjeng_r 1.16% 11231.000 11361.000 - 1.97% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
510.parest_r (unexplained diff vs previous) (percentage) 500.00% 0.010 0.060 - 0.00% -
510.parest_r (unexplained diff vs previous) 333.33% 3.000 13.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) 80.00% 20.000 36.000 - 0.00% -
519.lbm_r (max) 75.00% 20.000 35.000 - 0.00% -
519.lbm_r (max) (percentage) 75.00% 0.120 0.210 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 75.00% 0.120 0.210 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 37.65% 0.850 1.170 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 36.73% 98.000 134.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 33.33% 0.240 0.320 - 0.00% -
508.namd_r (unexplained diff vs previous) 29.17% 24.000 31.000 - 0.00% -
503.bwaves_r (unexplained diff vs previous) (percentage) 21.88% 0.320 0.390 - 0.00% -
503.bwaves_r (unexplained diff vs previous) 20.27% 74.000 89.000 - 0.00% -
503.bwaves_r (max) 8.54% 82.000 89.000 - 0.00% -
503.bwaves_r (max) (percentage) 8.33% 0.360 0.390 - 0.00% -
548.exchange2_r 3.03% 33.000 34.000 - 0.00% -
548.exchange2_r (avg) 3.03% 33.000 34.000 - 0.00% -
503.bwaves_r 1.92% 52.000 53.000 - 0.00% -
503.bwaves_r (avg) 1.92% 52.000 53.000 - 0.00% -
520.omnetpp_r (avg) (percentage) 1.04% 0.960 0.970 - 0.00% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r -1.16% 11551.000 11417.000 - -0.47% -
526.blender_r -1.12% 10999.000 10876.000 - -1.32% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
541.leela_r (max) (percentage) -10.53% 0.380 0.340 - 0.00% -
541.leela_r (max) -10.42% 48.000 43.000 - 0.00% -
505.mcf_r (max) -10.14% 69.000 62.000 - 0.00% -
505.mcf_r (max) (percentage) -9.80% 0.510 0.460 - 0.00% -
525.x264_r (max) (percentage) -7.14% 0.140 0.130 - 0.00% -
526.blender_r (max) -7.02% 114.000 106.000 - 0.00% -
531.deepsjeng_r (max) (percentage) -6.42% 2.180 2.040 - 0.00% -
548.exchange2_r (max) -6.25% 48.000 45.000 - 0.00% -
502.gcc_r (max) -5.97% 67.000 63.000 - 0.00% -
554.roms_r (max) (percentage) -5.88% 0.170 0.160 - 0.00% -
523.xalancbmk_r (max) -5.88% 102.000 96.000 - 0.00% -
554.roms_r (max) -5.88% 34.000 32.000 - 0.00% -
526.blender_r (max) (percentage) -5.77% 1.040 0.980 - 0.00% -
502.gcc_r (max) (percentage) -5.48% 0.730 0.690 - 0.00% -
521.wrf_r (max) (percentage) -5.45% 2.020 1.910 - 0.00% -
531.deepsjeng_r (max) -5.33% 244.000 231.000 - 0.00% -
521.wrf_r (max) -5.28% 341.000 323.000 - 0.00% -
544.nab_r (max) (percentage) -5.26% 0.380 0.360 - 0.00% -
525.x264_r (max) -5.26% 19.000 18.000 - 0.00% -
511.povray_r (max) -5.22% 115.000 109.000 - 0.00% -
511.povray_r (max) (percentage) -5.00% 0.600 0.570 - 0.00% -
523.xalancbmk_r (max) (percentage) -4.90% 1.020 0.970 - 0.00% -
548.exchange2_r (max) (percentage) -4.88% 0.410 0.390 - 0.00% -
544.nab_r (max) -4.44% 45.000 43.000 - 0.00% -
507.cactuBSSN_r (max) -4.21% 190.000 182.000 - 0.00% -
507.cactuBSSN_r (max) (percentage) -4.11% 0.730 0.700 - 0.00% -
520.omnetpp_r (max) -4.06% 197.000 189.000 - 0.00% -
508.namd_r (max) -3.95% 76.000 73.000 - 0.00% -
508.namd_r (max) (percentage) -3.85% 0.780 0.750 - 0.00% -
520.omnetpp_r (max) (percentage) -2.92% 1.710 1.660 - 0.00% -
500.perlbench_r (max) (percentage) -2.00% 0.500 0.490 - 0.00% -
523.xalancbmk_r -2.00% 50.000 49.000 - 0.00% -
523.xalancbmk_r (avg) -2.00% 50.000 49.000 - 0.00% -
538.imagick_r (max) (percentage) -1.92% 0.520 0.510 - 0.00% -
500.perlbench_r (max) -1.61% 62.000 61.000 - 0.00% -
511.povray_r -1.27% 79.000 78.000 - 0.00% -
511.povray_r (avg) -1.27% 79.000 78.000 - 0.00% -
538.imagick_r (max) -1.25% 80.000 79.000 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
503.bwaves_r 7.38% 28615.000 30728.000 - 0.00% -
541.leela_r 5.08% 126444.000 132869.000 - 0.71% -
548.exchange2_r 3.40% 62982.000 65122.000 - -0.15% -
510.parest_r 3.36% 6402190.000 6617087.000 - -0.03% -
521.wrf_r 2.20% 18630170.000 19039957.000 - 0.02% -
505.mcf_r 2.12% 24877.000 25405.000 - 0.13% -
508.namd_r 1.87% 643020.000 655048.000 - 0.00% -
549.fotonik3d_r 1.32% 333924.000 338336.000 - -0.06% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
511.povray_r 6.57% 18060.000 19246.000 - -0.35% -
531.deepsjeng_r 1.97% 11141.000 11361.000 - 1.16% -
505.mcf_r 1.31% 13471.000 13647.000 - -0.07% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful -4.35% 23.000 22.000 - 0.00% -
nb_execution_successful -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
511.povray_r -2.22% 771450.000 754297.000 - 0.01% -
538.imagick_r -1.35% 1669137.000 1646667.000 - 0.07% -
523.xalancbmk_r -1.25% 3639697.000 3594198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
544.nab_r -7.09% 12900.000 11985.000 - -0.56% -
500.perlbench_r -3.35% 13010.000 12574.000 - 0.32% -
526.blender_r -1.32% 11021.000 10876.000 - -1.12% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 4.35% 23.000 24.000 - 0.00% -

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.33s
Name Current %
500.perlbench_r 12574.000 -
502.gcc_r 9235.000 -
503.bwaves_r 23054.000 -
505.mcf_r 13647.000 -
507.cactuBSSN_r 26089.000 -
508.namd_r 9818.000 -
510.parest_r 20816.000 -
511.povray_r 19246.000 -
519.lbm_r 16827.000 -
520.omnetpp_r 11417.000 -1.16%
521.wrf_r 16912.000 -
523.xalancbmk_r 9981.000 -
525.x264_r 14259.000 -
526.blender_r 10876.000 -1.12%
531.deepsjeng_r 11361.000 1.16%
538.imagick_r 15506.000 -
541.leela_r 12811.000 -
544.nab_r 11985.000 -
548.exchange2_r 11740.000 -
549.fotonik3d_r 18410.000 -
554.roms_r 20412.000 -
557.xz_r 10665.000 -
Geometric Mean 14244.299 -
Name Current %
500.perlbench_r 1884394.000 -
502.gcc_r 8051619.000 -
503.bwaves_r 30728.000 -
505.mcf_r 25405.000 -
507.cactuBSSN_r 3803661.000 -
508.namd_r 655048.000 -
510.parest_r 6617087.000 -
511.povray_r 754297.000 -
519.lbm_r 13386.000 -
520.omnetpp_r 1564780.000 -
521.wrf_r 19039957.000 -
523.xalancbmk_r 3594198.000 -
525.x264_r 440621.000 -
526.blender_r 7856320.000 -
531.deepsjeng_r 90633.000 -
538.imagick_r 1646667.000 -
541.leela_r 132869.000 -
544.nab_r 149830.000 -
548.exchange2_r 65122.000 -
549.fotonik3d_r 338336.000 -
554.roms_r 692278.000 -
557.xz_r 171226.000 -
Geometric Mean 577472.561 -
Name Current %
500.perlbench_r 57.000 -
500.perlbench_r (avg) 57.000 -
500.perlbench_r (avg) (percentage) 0.460 -
500.perlbench_r (max) 61.000 -1.61%
500.perlbench_r (max) (percentage) 0.490 -2.00%
502.gcc_r 35.000 -
502.gcc_r (avg) 35.000 -
502.gcc_r (avg) (percentage) 0.380 -
502.gcc_r (max) 63.000 -5.97%
502.gcc_r (max) (percentage) 0.690 -5.48%
503.bwaves_r 53.000 1.92%
503.bwaves_r (avg) 53.000 1.92%
503.bwaves_r (avg) (percentage) 0.230 -
503.bwaves_r (max) 89.000 8.54%
503.bwaves_r (max) (percentage) 0.390 8.33%
503.bwaves_r (unexplained diff vs previous) 89.000 20.27%
503.bwaves_r (unexplained diff vs previous) (percentage) 0.390 21.88%
505.mcf_r 32.000 -
505.mcf_r (avg) 32.000 -
505.mcf_r (avg) (percentage) 0.240 -
505.mcf_r (max) 62.000 -10.14%
505.mcf_r (max) (percentage) 0.460 -9.80%
507.cactuBSSN_r 86.000 -
507.cactuBSSN_r (avg) 86.000 -
507.cactuBSSN_r (avg) (percentage) 0.330 -
507.cactuBSSN_r (max) 182.000 -4.21%
507.cactuBSSN_r (max) (percentage) 0.700 -4.11%
508.namd_r 20.000 -
508.namd_r (avg) 20.000 -
508.namd_r (avg) (percentage) 0.210 -
508.namd_r (max) 73.000 -3.95%
508.namd_r (max) (percentage) 0.750 -3.85%
508.namd_r (unexplained diff vs previous) 31.000 29.17%
508.namd_r (unexplained diff vs previous) (percentage) 0.320 33.33%
510.parest_r 16.000 -
510.parest_r (avg) 16.000 -
510.parest_r (avg) (percentage) 0.080 -
510.parest_r (max) 14.000 -
510.parest_r (max) (percentage) 0.070 -
510.parest_r (unexplained diff vs previous) 13.000 333.33%
510.parest_r (unexplained diff vs previous) (percentage) 0.060 500.00%
511.povray_r 78.000 -1.27%
511.povray_r (avg) 78.000 -1.27%
511.povray_r (avg) (percentage) 0.410 -
511.povray_r (max) 109.000 -5.22%
511.povray_r (max) (percentage) 0.570 -5.00%
519.lbm_r 26.000 -
519.lbm_r (avg) 26.000 -
519.lbm_r (avg) (percentage) 0.160 -
519.lbm_r (max) 35.000 75.00%
519.lbm_r (max) (percentage) 0.210 75.00%
519.lbm_r (unexplained diff vs previous) 36.000 80.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.210 75.00%
520.omnetpp_r 110.000 -
520.omnetpp_r (avg) 110.000 -
520.omnetpp_r (avg) (percentage) 0.970 1.04%
520.omnetpp_r (max) 189.000 -4.06%
520.omnetpp_r (max) (percentage) 1.660 -2.92%
520.omnetpp_r (unexplained diff vs previous) 134.000 36.73%
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.170 37.65%
521.wrf_r 79.000 -
521.wrf_r (avg) 79.000 -
521.wrf_r (avg) (percentage) 0.470 -
521.wrf_r (max) 323.000 -5.28%
521.wrf_r (max) (percentage) 1.910 -5.45%
523.xalancbmk_r 49.000 -2.00%
523.xalancbmk_r (avg) 49.000 -2.00%
523.xalancbmk_r (avg) (percentage) 0.500 -
523.xalancbmk_r (max) 96.000 -5.88%
523.xalancbmk_r (max) (percentage) 0.970 -4.90%
525.x264_r 15.000 -
525.x264_r (avg) 15.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 18.000 -5.26%
525.x264_r (max) (percentage) 0.130 -7.14%
526.blender_r 41.000 -
526.blender_r (avg) 41.000 -
526.blender_r (avg) (percentage) 0.380 -
526.blender_r (max) 106.000 -7.02%
526.blender_r (max) (percentage) 0.980 -5.77%
531.deepsjeng_r 115.000 -
531.deepsjeng_r (avg) 115.000 -
531.deepsjeng_r (avg) (percentage) 1.020 -
531.deepsjeng_r (max) 231.000 -5.33%
531.deepsjeng_r (max) (percentage) 2.040 -6.42%
538.imagick_r 49.000 -
538.imagick_r (avg) 49.000 -
538.imagick_r (avg) (percentage) 0.320 -
538.imagick_r (max) 79.000 -1.25%
538.imagick_r (max) (percentage) 0.510 -1.92%
541.leela_r 40.000 -
541.leela_r (avg) 40.000 -
541.leela_r (avg) (percentage) 0.320 -
541.leela_r (max) 43.000 -10.42%
541.leela_r (max) (percentage) 0.340 -10.53%
544.nab_r 34.000 -
544.nab_r (avg) 34.000 -
544.nab_r (avg) (percentage) 0.290 -
544.nab_r (max) 43.000 -4.44%
544.nab_r (max) (percentage) 0.360 -5.26%
548.exchange2_r 34.000 3.03%
548.exchange2_r (avg) 34.000 3.03%
548.exchange2_r (avg) (percentage) 0.290 -
548.exchange2_r (max) 45.000 -6.25%
548.exchange2_r (max) (percentage) 0.390 -4.88%
549.fotonik3d_r 16.000 -
549.fotonik3d_r (avg) 16.000 -
549.fotonik3d_r (avg) (percentage) 0.090 -
549.fotonik3d_r (max) 16.000 -
549.fotonik3d_r (max) (percentage) 0.090 -
554.roms_r 28.000 -
554.roms_r (avg) 28.000 -
554.roms_r (avg) (percentage) 0.140 -
554.roms_r (max) 32.000 -5.88%
554.roms_r (max) (percentage) 0.160 -5.88%
557.xz_r 9.000 -
557.xz_r (avg) 9.000 -
557.xz_r (avg) (percentage) 0.090 -
557.xz_r (max) 21.000 -
557.xz_r (max) (percentage) 0.200 -
Geometric Mean 6.081 4.60%