Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/b74e588e1f460eb48ceb1a30cf8ac870b7537dcc (+ 550 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O2_LTO-build/230/
Filter

llvm-arm-master-O2_LTO test results

Run Order Start Time Duration
Current 0230 (llvmorg-20-init-10775-gb74e588e1f46) 2024-10-28T08:51:24 0:00:00
Previous 0229 (llvmorg-20-init-10225-gc9f01f699cc5) 2024-10-24T02:40:06 0:00:00
Baseline 0015 (llvmorg-17-init-07395-g3283a6fb0df3) 2023-04-07T14:40:57 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 55 3
Performance Improvements 27 2
Added Tests 0 126
Unchanged Tests 608 559
Total Tests 690

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
525.x264_r (unexplained diff vs previous) (percentage) 3600.00% 0.020 0.740 - 0.00% -
525.x264_r (unexplained diff vs previous) 3500.00% 2.000 72.000 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 1900.00% 0.040 0.800 - 0.00% -
531.deepsjeng_r (unexplained diff vs previous) 1860.00% 5.000 98.000 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) (percentage) 508.33% 0.120 0.730 - 0.00% -
520.omnetpp_r (unexplained diff vs previous) 485.71% 14.000 82.000 - 0.00% -
508.namd_r (max) 337.50% 8.000 35.000 - 0.00% -
557.xz_r (unexplained diff vs previous) 300.00% 2.000 8.000 - 0.00% -
557.xz_r (unexplained diff vs previous) (percentage) 300.00% 0.020 0.080 - 0.00% -
508.namd_r (max) (percentage) 290.00% 0.100 0.390 - 0.00% -
508.namd_r (unexplained diff vs previous) (percentage) 290.00% 0.100 0.390 - 0.00% -
508.namd_r (unexplained diff vs previous) 288.89% 9.000 35.000 - 0.00% -
525.x264_r (max) 260.00% 20.000 72.000 - 0.00% -
525.x264_r (max) (percentage) 257.14% 0.210 0.750 - 0.00% -
531.deepsjeng_r (max) 196.97% 33.000 98.000 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 192.86% 0.140 0.410 - 0.00% -
531.deepsjeng_r (max) (percentage) 189.29% 0.280 0.810 - 0.00% -
523.xalancbmk_r (unexplained diff vs previous) 184.62% 13.000 37.000 - 0.00% -
544.nab_r (unexplained diff vs previous) (percentage) 144.00% 0.250 0.610 - 0.00% -
544.nab_r (unexplained diff vs previous) 142.86% 28.000 68.000 - 0.00% -
519.lbm_r (unexplained diff vs previous) (percentage) 88.89% 0.090 0.170 - 0.00% -
519.lbm_r (unexplained diff vs previous) 78.57% 14.000 25.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) 54.17% 24.000 37.000 - 0.00% -
538.imagick_r (unexplained diff vs previous) (percentage) 50.00% 0.180 0.270 - 0.00% -
544.nab_r (max) 48.89% 45.000 67.000 - 0.00% -
544.nab_r (max) (percentage) 48.78% 0.410 0.610 - 0.00% -
523.xalancbmk_r (max) 48.00% 25.000 37.000 - 0.00% -
519.lbm_r (max) 47.06% 17.000 25.000 - 0.00% -
523.xalancbmk_r (max) (percentage) 46.43% 0.280 0.410 - 0.00% -
519.lbm_r (max) (percentage) 41.67% 0.120 0.170 - 0.00% -
541.leela_r (unexplained diff vs previous) (percentage) 40.00% 0.050 0.070 - 0.00% -
541.leela_r (unexplained diff vs previous) 40.00% 5.000 7.000 - 0.00% -
526.blender_r (unexplained diff vs previous) 29.79% 47.000 61.000 - 0.00% -
526.blender_r (max) (percentage) 29.55% 0.440 0.570 - 0.00% -
526.blender_r (unexplained diff vs previous) (percentage) 29.55% 0.440 0.570 - 0.00% -
526.blender_r (max) 27.66% 47.000 60.000 - 0.00% -
523.xalancbmk_r 20.00% 15.000 18.000 - 0.00% -
523.xalancbmk_r (avg) 20.00% 15.000 18.000 - 0.00% -
523.xalancbmk_r (avg) (percentage) 17.65% 0.170 0.200 - 0.00% -
557.xz_r (max) 16.67% 6.000 7.000 - 0.00% -
508.namd_r 13.33% 15.000 17.000 - 0.00% -
508.namd_r (avg) 13.33% 15.000 17.000 - 0.00% -
508.namd_r (avg) (percentage) 11.76% 0.170 0.190 - 0.00% -
525.x264_r 10.00% 20.000 22.000 - 0.00% -
525.x264_r (avg) 10.00% 20.000 22.000 - 0.00% -
525.x264_r (avg) (percentage) 9.52% 0.210 0.230 - 0.00% -
531.deepsjeng_r 9.09% 33.000 36.000 - 0.00% -
531.deepsjeng_r (avg) 9.09% 33.000 36.000 - 0.00% -
531.deepsjeng_r (avg) (percentage) 7.14% 0.280 0.300 - 0.00% -
544.nab_r (avg) (percentage) 6.67% 0.300 0.320 - 0.00% -
544.nab_r 6.06% 33.000 35.000 - 0.00% -
544.nab_r (avg) 6.06% 33.000 35.000 - 0.00% -
526.blender_r (avg) (percentage) 3.13% 0.320 0.330 - 0.00% -
526.blender_r 2.94% 34.000 35.000 - 0.00% -
526.blender_r (avg) 2.94% 34.000 35.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
511.povray_r -1.08% 1139605.000 1127325.000 - 0.00% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
505.mcf_r (unexplained diff vs previous) -41.51% 53.000 31.000 - 0.00% -
505.mcf_r (unexplained diff vs previous) (percentage) -40.91% 0.440 0.260 - 0.00% -
505.mcf_r (max) -11.32% 53.000 47.000 - 0.00% -
505.mcf_r (max) (percentage) -11.11% 0.450 0.400 - 0.00% -
541.leela_r -7.69% 26.000 24.000 - 0.00% -
541.leela_r (avg) -7.69% 26.000 24.000 - 0.00% -
541.leela_r (avg) (percentage) -7.41% 0.270 0.250 - 0.00% -
520.omnetpp_r (max) -7.36% 299.000 277.000 - 0.00% -
500.perlbench_r (avg) (percentage) -7.14% 0.560 0.520 - 0.00% -
500.perlbench_r -6.98% 86.000 80.000 - 0.00% -
500.perlbench_r (avg) -6.98% 86.000 80.000 - 0.00% -
520.omnetpp_r (max) (percentage) -6.46% 2.630 2.460 - 0.00% -
500.perlbench_r (max) (percentage) -4.44% 0.450 0.430 - 0.00% -
500.perlbench_r (max) -4.35% 69.000 66.000 - 0.00% -
538.imagick_r -4.35% 46.000 44.000 - 0.00% -
538.imagick_r (avg) -4.35% 46.000 44.000 - 0.00% -
541.leela_r (max) -4.26% 47.000 45.000 - 0.00% -
541.leela_r (max) (percentage) -4.08% 0.490 0.470 - 0.00% -
538.imagick_r (max) -4.00% 50.000 48.000 - 0.00% -
538.imagick_r (avg) (percentage) -2.94% 0.340 0.330 - 0.00% -
510.parest_r (max) (percentage) -2.78% 0.360 0.350 - 0.00% -
538.imagick_r (max) (percentage) -2.70% 0.370 0.360 - 0.00% -
510.parest_r (max) -2.70% 74.000 72.000 - 0.00% -
520.omnetpp_r -2.56% 117.000 114.000 - 0.00% -
520.omnetpp_r (avg) -2.56% 117.000 114.000 - 0.00% -
520.omnetpp_r (avg) (percentage) -1.94% 1.030 1.010 - 0.00% -

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 2.54% 25784.000 26440.000 - 0.00% -
531.deepsjeng_r 2.07% 91336.000 93231.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
531.deepsjeng_r 1.96% 11961.000 12196.000 - 0.81% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
557.xz_r -2.56% 10041.000 9784.000 - -0.08% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_execution_successful 433.33% 3.000 16.000 - 0.00% -

Added Tests - Code Size
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - Execution
500.perlbench_r
502.gcc_r
508.namd_r
510.parest_r
511.povray_r
519.lbm_r
520.omnetpp_r
523.xalancbmk_r
525.x264_r
526.blender_r
538.imagick_r
541.leela_r
544.nab_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
500.perlbench_r (unexplained diff vs previous)
500.perlbench_r (unexplained diff vs previous) (percentage)
502.gcc_r
502.gcc_r (avg)
502.gcc_r (avg) (percentage)
502.gcc_r (max)
502.gcc_r (max) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
508.namd_r (unexplained diff vs previous)
508.namd_r (unexplained diff vs previous) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
519.lbm_r (unexplained diff vs previous)
519.lbm_r (unexplained diff vs previous) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
520.omnetpp_r (unexplained diff vs previous)
520.omnetpp_r (unexplained diff vs previous) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
523.xalancbmk_r (unexplained diff vs previous)
523.xalancbmk_r (unexplained diff vs previous) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
525.x264_r (unexplained diff vs previous)
525.x264_r (unexplained diff vs previous) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
526.blender_r (unexplained diff vs previous)
526.blender_r (unexplained diff vs previous) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
538.imagick_r (unexplained diff vs previous)
538.imagick_r (unexplained diff vs previous) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
541.leela_r (unexplained diff vs previous)
541.leela_r (unexplained diff vs previous) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
544.nab_r (unexplained diff vs previous)
544.nab_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)


Report Time: 0.22s
Name Current %
500.perlbench_r 15499.000 -
502.gcc_r 8975.000 -
505.mcf_r 11969.000 -
508.namd_r 9019.000 -
510.parest_r 20694.000 -
511.povray_r 16981.000 -
519.lbm_r 14819.000 -
520.omnetpp_r 11296.000 -
523.xalancbmk_r 9105.000 -
525.x264_r 9677.000 -
526.blender_r 10631.000 -
531.deepsjeng_r 12196.000 -
538.imagick_r 13528.000 -
541.leela_r 9702.000 -
544.nab_r 11095.000 -
557.xz_r 9784.000 -
Geometric Mean 11812.819 -
Name Current %
500.perlbench_r 2291804.000 -
502.gcc_r 10070699.000 -
505.mcf_r 26440.000 -
508.namd_r 502287.000 -
510.parest_r 1742372.000 -
511.povray_r 1127325.000 -1.08%
519.lbm_r 11278.000 -
520.omnetpp_r 1580165.000 -
523.xalancbmk_r 3502856.000 -
525.x264_r 527810.000 -
526.blender_r 11878944.000 -
531.deepsjeng_r 93231.000 -
538.imagick_r 1258591.000 -
541.leela_r 87954.000 -
544.nab_r 82080.000 -
557.xz_r 131299.000 -
Geometric Mean 517193.735 -
Name Current %
500.perlbench_r 80.000 -6.98%
500.perlbench_r (avg) 80.000 -6.98%
500.perlbench_r (avg) (percentage) 0.520 -7.14%
500.perlbench_r (max) 66.000 -4.35%
500.perlbench_r (max) (percentage) 0.430 -4.44%
500.perlbench_r (unexplained diff vs previous) 3.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 0.020 -
502.gcc_r 24.000 -
502.gcc_r (avg) 24.000 -
502.gcc_r (avg) (percentage) 0.270 -
502.gcc_r (max) 26.000 -
502.gcc_r (max) (percentage) 0.290 -
505.mcf_r 25.000 -
505.mcf_r (avg) 25.000 -
505.mcf_r (avg) (percentage) 0.210 -
505.mcf_r (max) 47.000 -11.32%
505.mcf_r (max) (percentage) 0.400 -11.11%
505.mcf_r (unexplained diff vs previous) 31.000 -41.51%
505.mcf_r (unexplained diff vs previous) (percentage) 0.260 -40.91%
508.namd_r 17.000 13.33%
508.namd_r (avg) 17.000 13.33%
508.namd_r (avg) (percentage) 0.190 11.76%
508.namd_r (max) 35.000 337.50%
508.namd_r (max) (percentage) 0.390 290.00%
508.namd_r (unexplained diff vs previous) 35.000 288.89%
508.namd_r (unexplained diff vs previous) (percentage) 0.390 290.00%
510.parest_r 22.000 -
510.parest_r (avg) 22.000 -
510.parest_r (avg) (percentage) 0.110 -
510.parest_r (max) 72.000 -2.70%
510.parest_r (max) (percentage) 0.350 -2.78%
511.povray_r 74.000 -
511.povray_r (avg) 74.000 -
511.povray_r (avg) (percentage) 0.440 -
511.povray_r (max) 54.000 -
511.povray_r (max) (percentage) 0.320 -
519.lbm_r 19.000 -
519.lbm_r (avg) 19.000 -
519.lbm_r (avg) (percentage) 0.130 -
519.lbm_r (max) 25.000 47.06%
519.lbm_r (max) (percentage) 0.170 41.67%
519.lbm_r (unexplained diff vs previous) 25.000 78.57%
519.lbm_r (unexplained diff vs previous) (percentage) 0.170 88.89%
520.omnetpp_r 114.000 -2.56%
520.omnetpp_r (avg) 114.000 -2.56%
520.omnetpp_r (avg) (percentage) 1.010 -1.94%
520.omnetpp_r (max) 277.000 -7.36%
520.omnetpp_r (max) (percentage) 2.460 -6.46%
520.omnetpp_r (unexplained diff vs previous) 82.000 485.71%
520.omnetpp_r (unexplained diff vs previous) (percentage) 0.730 508.33%
523.xalancbmk_r 18.000 20.00%
523.xalancbmk_r (avg) 18.000 20.00%
523.xalancbmk_r (avg) (percentage) 0.200 17.65%
523.xalancbmk_r (max) 37.000 48.00%
523.xalancbmk_r (max) (percentage) 0.410 46.43%
523.xalancbmk_r (unexplained diff vs previous) 37.000 184.62%
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.410 192.86%
525.x264_r 22.000 10.00%
525.x264_r (avg) 22.000 10.00%
525.x264_r (avg) (percentage) 0.230 9.52%
525.x264_r (max) 72.000 260.00%
525.x264_r (max) (percentage) 0.750 257.14%
525.x264_r (unexplained diff vs previous) 72.000 3500.00%
525.x264_r (unexplained diff vs previous) (percentage) 0.740 3600.00%
526.blender_r 35.000 2.94%
526.blender_r (avg) 35.000 2.94%
526.blender_r (avg) (percentage) 0.330 3.13%
526.blender_r (max) 60.000 27.66%
526.blender_r (max) (percentage) 0.570 29.55%
526.blender_r (unexplained diff vs previous) 61.000 29.79%
526.blender_r (unexplained diff vs previous) (percentage) 0.570 29.55%
531.deepsjeng_r 36.000 9.09%
531.deepsjeng_r (avg) 36.000 9.09%
531.deepsjeng_r (avg) (percentage) 0.300 7.14%
531.deepsjeng_r (max) 98.000 196.97%
531.deepsjeng_r (max) (percentage) 0.810 189.29%
531.deepsjeng_r (unexplained diff vs previous) 98.000 1860.00%
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.800 1900.00%
538.imagick_r 44.000 -4.35%
538.imagick_r (avg) 44.000 -4.35%
538.imagick_r (avg) (percentage) 0.330 -2.94%
538.imagick_r (max) 48.000 -4.00%
538.imagick_r (max) (percentage) 0.360 -2.70%
538.imagick_r (unexplained diff vs previous) 37.000 54.17%
538.imagick_r (unexplained diff vs previous) (percentage) 0.270 50.00%
541.leela_r 24.000 -7.69%
541.leela_r (avg) 24.000 -7.69%
541.leela_r (avg) (percentage) 0.250 -7.41%
541.leela_r (max) 45.000 -4.26%
541.leela_r (max) (percentage) 0.470 -4.08%
541.leela_r (unexplained diff vs previous) 7.000 40.00%
541.leela_r (unexplained diff vs previous) (percentage) 0.070 40.00%
544.nab_r 35.000 6.06%
544.nab_r (avg) 35.000 6.06%
544.nab_r (avg) (percentage) 0.320 6.67%
544.nab_r (max) 67.000 48.89%
544.nab_r (max) (percentage) 0.610 48.78%
544.nab_r (unexplained diff vs previous) 68.000 142.86%
544.nab_r (unexplained diff vs previous) (percentage) 0.610 144.00%
557.xz_r 9.000 -
557.xz_r (avg) 9.000 -
557.xz_r (avg) (percentage) 0.100 -
557.xz_r (max) 7.000 16.67%
557.xz_r (max) (percentage) 0.080 -
557.xz_r (unexplained diff vs previous) 8.000 300.00%
557.xz_r (unexplained diff vs previous) (percentage) 0.080 300.00%
Geometric Mean 4.654 44.87%