Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/74638f16349768c5ddde0f2dd43715471d5de910 (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-qc_speed-cpu2017rate--llvm-aarch64-master-O3-build/792/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0792 (llvmorg-21-init-03517-g74638f163497) 2025-03-01T20:55:56 0:00:00
Previous 0791 (llvmorg-21-init-03516-g1b1dc5050573) 2025-03-01T12:56:36 0:00:00
Baseline 0021 (llvmorg-18-init-04204-g10c86197010e) 2023-09-01T02:42:53 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 15 18
Performance Improvements 58 15
Added Tests 4 116
Unchanged Tests 799 727
Total Tests 876

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
521.wrf_r 2.53% 1581.000 1621.000 - 0.00% -
527.cam4_r 1.63% 1845.000 1875.000 - 0.00% -
502.gcc_r 1.15% 1834.000 1855.000 - -3.74% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
523.xalancbmk_r (unexplained diff vs previous) (percentage) 322.22% 0.090 0.380 - 0.00% -
523.xalancbmk_r (max) 300.00% 2.000 8.000 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 171.43% 0.140 0.380 - 0.00% -
525.x264_r (unexplained diff vs previous) (percentage) 68.00% 0.250 0.420 - 0.00% -
525.x264_r (max) 66.67% 3.000 5.000 - 0.00% -
525.x264_r (unexplained diff vs previous) 66.67% 3.000 5.000 - 0.00% -
525.x264_r (max) (percentage) 55.56% 0.270 0.420 - 0.00% -
544.nab_r (unexplained diff vs previous) 5.56% 18.000 19.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 4.88% 0.820 0.860 - 0.00% -
521.wrf_r (max) 2.70% 37.000 38.000 - 0.00% -
500.perlbench_r (avg) (percentage) 2.33% 0.430 0.440 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
520.omnetpp_r (unexplained diff vs previous) -94.37% 71.000 4.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) -94.29% 2.450 0.140 - 0.00% -
557.xz_r (unexplained diff vs previous) -87.50% 8.000 1.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) -85.71% 0.210 0.030 - 0.00% -
520.omnetpp_r (max) -77.69% 242.000 54.000 - 0.00% -
520.omnetpp_r (max) (percentage) -77.51% 8.360 1.880 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) -70.27% 37.000 11.000 - 0.00% -
549.fotonik3d_r (unexplained diff vs previous) (percentage) -70.05% 2.170 0.650 - 0.00% -
531.deepsjeng_r (max) -66.67% 3.000 1.000 - 0.00% -
541.leela_r (unexplained diff vs previous) -66.67% 3.000 1.000 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) -66.67% 0.090 0.030 - 0.00% -
531.deepsjeng_r (max) (percentage) -57.14% 0.140 0.060 - 0.00% -
519.lbm_r (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) -50.00% 0.120 0.060 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) -50.00% 2.000 1.000 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) -46.43% 0.560 0.300 - 0.00% -
526.blender_r (unexplained diff vs previous) -45.45% 11.000 6.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) -42.86% 0.070 0.040 - 0.00% -
510.parest_r (unexplained diff vs previous) -41.18% 17.000 10.000 - 0.00% -
510.parest_r (unexplained diff vs previous) (percentage) -40.74% 0.540 0.320 - 0.00% -
557.xz_r (max) -37.50% 8.000 5.000 - 0.00% -
510.parest_r (max) -33.33% 18.000 12.000 - 0.00% -
510.parest_r (max) (percentage) -32.20% 0.590 0.400 - 0.00% -
557.xz_r (max) (percentage) -27.27% 0.220 0.160 - 0.00% -
526.blender_r (max) (percentage) -25.45% 0.550 0.410 - 0.00% -
500.perlbench_r (unexplained diff vs previous) -23.26% 43.000 33.000 - 0.00% -
500.perlbench_r (unexplained diff vs previous) (percentage) -23.08% 1.300 1.000 - 0.00% -
508.namd_r (unexplained diff vs previous) -20.00% 5.000 4.000 - 0.00% -
526.blender_r (max) -20.00% 10.000 8.000 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) -18.52% 0.270 0.220 - 0.00% -
538.imagick_r (max) -16.67% 6.000 5.000 - 0.00% -
538.imagick_r (max) (percentage) -16.67% 0.180 0.150 - 0.00% -
538.imagick_r (unexplained diff vs previous) -16.67% 6.000 5.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) -16.67% 0.180 0.150 - 0.00% -
503.bwaves_r -14.29% 7.000 6.000 - 0.00% -
503.bwaves_r (avg) -14.29% 7.000 6.000 - 0.00% -
508.namd_r (max) -14.29% 7.000 6.000 - 0.00% -
503.bwaves_r (max) -11.76% 17.000 15.000 - 0.00% -
500.perlbench_r (max) -11.63% 43.000 38.000 - 0.00% -
500.perlbench_r (max) (percentage) -9.92% 1.310 1.180 - 0.00% -
541.leela_r (max) (percentage) -9.09% 0.220 0.200 - 0.00% -
503.bwaves_r (max) (percentage) -8.86% 0.790 0.720 - 0.00% -
544.nab_r (max) (percentage) -8.62% 1.160 1.060 - 0.00% -
505.mcf_r (max) -8.33% 12.000 11.000 - 0.00% -
523.xalancbmk_r -8.33% 12.000 11.000 - 0.00% -
523.xalancbmk_r (avg) -8.33% 12.000 11.000 - 0.00% -
549.fotonik3d_r (max) -8.33% 36.000 33.000 - 0.00% -
544.nab_r (max) -8.00% 25.000 23.000 - 0.00% -
549.fotonik3d_r (max) (percentage) -7.55% 2.120 1.960 - 0.00% -
505.mcf_r (max) (percentage) -6.38% 0.470 0.440 - 0.00% -
511.povray_r (unexplained diff vs previous) (percentage) -5.77% 0.520 0.490 - 0.00% -
511.povray_r (unexplained diff vs previous) -5.56% 18.000 17.000 - 0.00% -
508.namd_r (max) (percentage) -5.00% 0.400 0.380 - 0.00% -
511.povray_r (max) (percentage) -3.85% 0.520 0.500 - 0.00% -
503.bwaves_r (avg) (percentage) -3.03% 0.330 0.320 - 0.00% -
520.omnetpp_r -1.39% 144.000 142.000 - 0.00% -
520.omnetpp_r (avg) -1.39% 144.000 142.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.20% 5.000 4.940 - 0.00% -

Added Tests - sample variability
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
519.lbm_r
519.lbm_r (avg)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 16.30% 624203.000 725921.000 - 0.00% -
510.parest_r 9.31% 9300501.000 10166289.000 - 0.00% -
531.deepsjeng_r 5.21% 90266.000 94966.000 - 0.00% -
541.leela_r 5.15% 154167.000 162113.000 - 0.00% -
519.lbm_r 4.87% 13715.000 14383.000 - 0.00% -
505.mcf_r 4.80% 28151.000 29503.000 - 0.00% -
523.xalancbmk_r 4.48% 4887443.000 5106216.000 - 0.00% -
511.povray_r 4.18% 975686.000 1016497.000 - 0.00% -
544.nab_r 4.14% 199400.000 207656.000 - 0.00% -
520.omnetpp_r 3.01% 2225798.000 2292818.000 - 0.00% -
526.blender_r 2.79% 14428010.000 14830097.000 - 0.00% -
500.perlbench_r 2.43% 2248763.000 2303325.000 - 0.00% -
557.xz_r 2.38% 191208.000 195752.000 - 0.00% -
507.cactuBSSN_r 2.16% 3821259.000 3903742.000 - 0.00% -
525.x264_r 1.67% 558366.000 567670.000 - 0.00% -
538.imagick_r 1.46% 1800965.000 1827285.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
538.imagick_r 1.06% 3305.000 3340.000 - 0.15% -

Performance Regressions - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests -4.35% 23.000 22.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
525.x264_r -7.13% 1290.000 1198.000 - 0.42% -
520.omnetpp_r -5.15% 3050.000 2893.000 - -0.14% -
505.mcf_r -4.78% 2824.000 2689.000 - 0.15% -
502.gcc_r -3.74% 1927.000 1855.000 - 1.15% -
531.deepsjeng_r -2.92% 2907.000 2822.000 - -0.04% -
511.povray_r -2.38% 3532.000 3448.000 - 0.50% -
523.xalancbmk_r -2.34% 2175.000 2124.000 - 0.38% -
508.namd_r -2.25% 1870.000 1828.000 - 0.22% -
541.leela_r -1.63% 3559.000 3501.000 - -0.03% -
510.parest_r -1.48% 3181.000 3134.000 - -0.32% -
557.xz_r -1.40% 3778.000 3725.000 - -0.03% -
500.perlbench_r -1.38% 3332.000 3286.000 - -0.99% -
544.nab_r -1.03% 2230.000 2207.000 - 0.87% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 29.41% 17.000 22.000 - 0.00% -
nb_execution_successful 29.41% 17.000 22.000 - 0.00% -

Added Tests - Code Size
503.bwaves_r
521.wrf_r
527.cam4_r
549.fotonik3d_r
554.roms_r

Added Tests - Execution
503.bwaves_r
521.wrf_r
527.cam4_r
549.fotonik3d_r
554.roms_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r
521.wrf_r (avg)
521.wrf_r (avg) (percentage)
521.wrf_r (max)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max) (percentage)
549.fotonik3d_r
549.fotonik3d_r (avg)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max)
549.fotonik3d_r (max) (percentage)
549.fotonik3d_r (unexplained diff vs previous)
549.fotonik3d_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.35s
Name Current %
500.perlbench_r 3286.000 -
502.gcc_r 1855.000 1.15%
503.bwaves_r 2174.000 -
505.mcf_r 2689.000 -
507.cactuBSSN_r 1702.000 -
508.namd_r 1828.000 -
510.parest_r 3134.000 -
511.povray_r 3448.000 -
519.lbm_r 1607.000 -
520.omnetpp_r 2893.000 -
521.wrf_r 1621.000 2.53%
523.xalancbmk_r 2124.000 -
525.x264_r 1198.000 -
526.blender_r 1983.000 -
527.cam4_r 1875.000 1.63%
531.deepsjeng_r 2822.000 -
538.imagick_r 3340.000 -
541.leela_r 3501.000 -
544.nab_r 2207.000 -
549.fotonik3d_r 1696.000 -
554.roms_r 1650.000 -
557.xz_r 3725.000 -
Geometric Mean 2265.090 -
Name Current %
500.perlbench_r 2303325.000 -
502.gcc_r 9966752.000 -
503.bwaves_r 741725.000 -
505.mcf_r 29503.000 -
507.cactuBSSN_r 3903742.000 -
508.namd_r 725921.000 -
510.parest_r 10166289.000 -
511.povray_r 1016497.000 -
519.lbm_r 14383.000 -
520.omnetpp_r 2292818.000 -
521.wrf_r 23507339.000 -
523.xalancbmk_r 5106216.000 -
525.x264_r 567670.000 -
526.blender_r 14830097.000 -
527.cam4_r 10715038.000 -
531.deepsjeng_r 94966.000 -
538.imagick_r 1827285.000 -
541.leela_r 162113.000 -
544.nab_r 207656.000 -
549.fotonik3d_r 1159776.000 -
554.roms_r 3868669.000 -
557.xz_r 195752.000 -
Geometric Mean 1161520.461 -
Name Current %
500.perlbench_r 14.000 -
500.perlbench_r (avg) 14.000 -
500.perlbench_r (avg) (percentage) 0.440 2.33%
500.perlbench_r (max) 38.000 -11.63%
500.perlbench_r (max) (percentage) 1.180 -9.92%
500.perlbench_r (unexplained diff vs previous) 33.000 -23.26%
500.perlbench_r (unexplained diff vs previous) (percentage) 1.000 -23.08%
502.gcc_r 8.000 -
502.gcc_r (avg) 8.000 -
502.gcc_r (avg) (percentage) 0.450 -
502.gcc_r (max) 9.000 -
502.gcc_r (max) (percentage) 0.500 -
503.bwaves_r 6.000 -14.29%
503.bwaves_r (avg) 6.000 -14.29%
503.bwaves_r (avg) (percentage) 0.320 -3.03%
503.bwaves_r (max) 15.000 -11.76%
503.bwaves_r (max) (percentage) 0.720 -8.86%
503.bwaves_r (unexplained diff vs previous) 0.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.000 -
505.mcf_r 10.000 -
505.mcf_r (avg) 10.000 -
505.mcf_r (avg) (percentage) 0.390 -
505.mcf_r (max) 11.000 -8.33%
505.mcf_r (max) (percentage) 0.440 -6.38%
505.mcf_r (unexplained diff vs previous) 4.000 -
505.mcf_r (unexplained diff vs previous) (percentage) 0.150 -
507.cactuBSSN_r 27.000 -
507.cactuBSSN_r (avg) 27.000 -
507.cactuBSSN_r (avg) (percentage) 1.630 -
507.cactuBSSN_r (max) 22.000 -
507.cactuBSSN_r (max) (percentage) 1.320 -
508.namd_r 5.000 -
508.namd_r (avg) 5.000 -
508.namd_r (avg) (percentage) 0.290 -
508.namd_r (max) 6.000 -14.29%
508.namd_r (max) (percentage) 0.380 -5.00%
508.namd_r (unexplained diff vs previous) 4.000 -20.00%
508.namd_r (unexplained diff vs previous) (percentage) 0.220 -18.52%
510.parest_r 10.000 -
510.parest_r (avg) 10.000 -
510.parest_r (avg) (percentage) 0.340 -
510.parest_r (max) 12.000 -33.33%
510.parest_r (max) (percentage) 0.400 -32.20%
510.parest_r (unexplained diff vs previous) 10.000 -41.18%
510.parest_r (unexplained diff vs previous) (percentage) 0.320 -40.74%
511.povray_r 17.000 -
511.povray_r (avg) 17.000 -
511.povray_r (avg) (percentage) 0.510 -
511.povray_r (max) 17.000 -
511.povray_r (max) (percentage) 0.500 -3.85%
511.povray_r (unexplained diff vs previous) 17.000 -5.56%
511.povray_r (unexplained diff vs previous) (percentage) 0.490 -5.77%
519.lbm_r 0.000 -
519.lbm_r (avg) 0.000 -
519.lbm_r (avg) (percentage) 0.050 -
519.lbm_r (max) 1.000 -
519.lbm_r (max) (percentage) 0.110 -
519.lbm_r (unexplained diff vs previous) 1.000 -50.00%
519.lbm_r (unexplained diff vs previous) (percentage) 0.060 -50.00%
520.omnetpp_r 142.000 -1.39%
520.omnetpp_r (avg) 142.000 -1.39%
520.omnetpp_r (avg) (percentage) 4.940 -1.20%
520.omnetpp_r (max) 54.000 -77.69%
520.omnetpp_r (max) (percentage) 1.880 -77.51%
520.omnetpp_r (unexplained diff vs previous) 4.000 -94.37%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.140 -94.29%
521.wrf_r 22.000 -
521.wrf_r (avg) 22.000 -
521.wrf_r (avg) (percentage) 1.400 -
521.wrf_r (max) 38.000 2.70%
521.wrf_r (max) (percentage) 2.360 -
523.xalancbmk_r 11.000 -8.33%
523.xalancbmk_r (avg) 11.000 -8.33%
523.xalancbmk_r (avg) (percentage) 0.560 -
523.xalancbmk_r (max) 8.000 300.00%
523.xalancbmk_r (max) (percentage) 0.380 171.43%
523.xalancbmk_r (unexplained diff vs previous) 8.000 300.00%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.380 322.22%
525.x264_r 4.000 -
525.x264_r (avg) 4.000 -
525.x264_r (avg) (percentage) 0.360 -
525.x264_r (max) 5.000 66.67%
525.x264_r (max) (percentage) 0.420 55.56%
525.x264_r (unexplained diff vs previous) 5.000 66.67%
525.x264_r (unexplained diff vs previous) (percentage) 0.420 68.00%
526.blender_r 13.000 -
526.blender_r (avg) 13.000 -
526.blender_r (avg) (percentage) 0.680 -
526.blender_r (max) 8.000 -20.00%
526.blender_r (max) (percentage) 0.410 -25.45%
526.blender_r (unexplained diff vs previous) 6.000 -45.45%
526.blender_r (unexplained diff vs previous) (percentage) 0.300 -46.43%
531.deepsjeng_r 3.000 -
531.deepsjeng_r (avg) 3.000 -
531.deepsjeng_r (avg) (percentage) 0.120 -
531.deepsjeng_r (max) 1.000 -66.67%
531.deepsjeng_r (max) (percentage) 0.060 -57.14%
531.deepsjeng_r (unexplained diff vs previous) 1.000 -50.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.040 -42.86%
538.imagick_r 3.000 -
538.imagick_r (avg) 3.000 -
538.imagick_r (avg) (percentage) 0.100 -
538.imagick_r (max) 5.000 -16.67%
538.imagick_r (max) (percentage) 0.150 -16.67%
538.imagick_r (unexplained diff vs previous) 5.000 -16.67%
538.imagick_r (unexplained diff vs previous) (percentage) 0.150 -16.67%
541.leela_r 8.000 -
541.leela_r (avg) 8.000 -
541.leela_r (avg) (percentage) 0.230 -
541.leela_r (max) 7.000 -
541.leela_r (max) (percentage) 0.200 -9.09%
541.leela_r (unexplained diff vs previous) 1.000 -66.67%
541.leela_r (unexplained diff vs previous) (percentage) 0.030 -66.67%
544.nab_r 19.000 -
544.nab_r (avg) 19.000 -
544.nab_r (avg) (percentage) 0.880 -
544.nab_r (max) 23.000 -8.00%
544.nab_r (max) (percentage) 1.060 -8.62%
544.nab_r (unexplained diff vs previous) 19.000 5.56%
544.nab_r (unexplained diff vs previous) (percentage) 0.860 4.88%
548.exchange2_r (avg) (percentage) 0.100 -
548.exchange2_r (max) (percentage) 0.090 -
549.fotonik3d_r 20.000 -
549.fotonik3d_r (avg) 20.000 -
549.fotonik3d_r (avg) (percentage) 1.200 -
549.fotonik3d_r (max) 33.000 -8.33%
549.fotonik3d_r (max) (percentage) 1.960 -7.55%
549.fotonik3d_r (unexplained diff vs previous) 11.000 -70.27%
549.fotonik3d_r (unexplained diff vs previous) (percentage) 0.650 -70.05%
557.xz_r 4.000 -
557.xz_r (avg) 4.000 -
557.xz_r (avg) (percentage) 0.120 -
557.xz_r (max) 5.000 -37.50%
557.xz_r (max) (percentage) 0.160 -27.27%
557.xz_r (unexplained diff vs previous) 1.000 -87.50%
557.xz_r (unexplained diff vs previous) (percentage) 0.030 -85.71%
Geometric Mean 1.576 -28.07%