Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/1b1232047e83b69561fd64b9547cb0a0d374473a (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-aarch64-master-O2_LTO-build/59/
View Options
Report
Filter

llvm-aarch64-master-O2_LTO test results

Run Order Start Time Duration
Current 0059 (llvmorg-17-init-12045-g1b1232047e83) 2023-05-22T09:40:27 0:00:00
Previous 0059 (llvmorg-17-init-12045-g1b1232047e83) 2023-05-22T09:40:27 0:00:00
Baseline 0002 (llvmorg-17-init-03255-g1ae859753c06) 2023-02-26T19:17:06 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 0 7
Performance Improvements 0 11
Added Tests 0 113
Unchanged Tests 852 721
Total Tests 852

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
508.namd_r 4.65% 469683.000 491535.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r 12.12% 12564.000 14087.000 - 0.00% -
526.blender_r 1.90% 11917.000 12143.000 - 0.00% -
525.x264_r 1.72% 7341.000 7467.000 - 0.00% -
500.perlbench_r 1.55% 15561.000 15802.000 - 0.00% -
523.xalancbmk_r 1.19% 13139.000 13296.000 - 0.00% -
511.povray_r 1.09% 19277.000 19487.000 - 0.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
505.mcf_r -16.79% 21319.000 17739.000 - 0.00% -
531.deepsjeng_r -4.58% 73555.000 70187.000 - 0.00% -
502.gcc_r -1.67% 9826811.000 9663171.000 - 0.00% -
500.perlbench_r -1.17% 2248846.000 2222531.000 - 0.00% -
544.nab_r -1.07% 84707.000 83799.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
519.lbm_r -6.40% 16671.000 15604.000 - 0.00% -
531.deepsjeng_r -3.88% 7988.000 7678.000 - 0.00% -
544.nab_r -3.84% 13621.000 13098.000 - 0.00% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_total_tests 43.75% 16.000 23.000 - 0.00% -
nb_compile_successful 25.00% 16.000 20.000 - 0.00% -
nb_execution_successful 25.00% 16.000 20.000 - 0.00% -

Added Tests - Code Size
503.bwaves_r
507.cactuBSSN_r
548.exchange2_r
554.roms_r

Added Tests - Execution
503.bwaves_r
507.cactuBSSN_r
548.exchange2_r
554.roms_r

Added Tests - sample variability
500.perlbench_r
500.perlbench_r (avg)
500.perlbench_r (avg) (percentage)
500.perlbench_r (max)
500.perlbench_r (max) (percentage)
503.bwaves_r
503.bwaves_r (avg)
503.bwaves_r (avg) (percentage)
503.bwaves_r (max)
503.bwaves_r (max) (percentage)
503.bwaves_r (unexplained diff vs previous)
503.bwaves_r (unexplained diff vs previous) (percentage)
505.mcf_r
505.mcf_r (avg)
505.mcf_r (avg) (percentage)
505.mcf_r (max)
505.mcf_r (max) (percentage)
507.cactuBSSN_r
507.cactuBSSN_r (avg)
507.cactuBSSN_r (avg) (percentage)
507.cactuBSSN_r (max)
507.cactuBSSN_r (max) (percentage)
508.namd_r
508.namd_r (avg)
508.namd_r (avg) (percentage)
508.namd_r (max)
508.namd_r (max) (percentage)
510.parest_r
510.parest_r (avg)
510.parest_r (avg) (percentage)
510.parest_r (max)
510.parest_r (max) (percentage)
511.povray_r
511.povray_r (avg)
511.povray_r (avg) (percentage)
511.povray_r (max)
511.povray_r (max) (percentage)
519.lbm_r
519.lbm_r (avg)
519.lbm_r (avg) (percentage)
519.lbm_r (max)
519.lbm_r (max) (percentage)
520.omnetpp_r
520.omnetpp_r (avg)
520.omnetpp_r (avg) (percentage)
520.omnetpp_r (max)
520.omnetpp_r (max) (percentage)
521.wrf_r (avg) (percentage)
521.wrf_r (max) (percentage)
523.xalancbmk_r
523.xalancbmk_r (avg)
523.xalancbmk_r (avg) (percentage)
523.xalancbmk_r (max)
523.xalancbmk_r (max) (percentage)
525.x264_r
525.x264_r (avg)
525.x264_r (avg) (percentage)
525.x264_r (max)
525.x264_r (max) (percentage)
526.blender_r
526.blender_r (avg)
526.blender_r (avg) (percentage)
526.blender_r (max)
526.blender_r (max) (percentage)
531.deepsjeng_r
531.deepsjeng_r (avg)
531.deepsjeng_r (avg) (percentage)
531.deepsjeng_r (max)
531.deepsjeng_r (max) (percentage)
538.imagick_r
538.imagick_r (avg)
538.imagick_r (avg) (percentage)
538.imagick_r (max)
538.imagick_r (max) (percentage)
541.leela_r
541.leela_r (avg)
541.leela_r (avg) (percentage)
541.leela_r (max)
541.leela_r (max) (percentage)
544.nab_r
544.nab_r (avg)
544.nab_r (avg) (percentage)
544.nab_r (max)
544.nab_r (max) (percentage)
548.exchange2_r
548.exchange2_r (avg)
548.exchange2_r (avg) (percentage)
548.exchange2_r (max)
548.exchange2_r (max) (percentage)
548.exchange2_r (unexplained diff vs previous)
548.exchange2_r (unexplained diff vs previous) (percentage)
549.fotonik3d_r (avg) (percentage)
549.fotonik3d_r (max) (percentage)
554.roms_r
554.roms_r (avg)
554.roms_r (avg) (percentage)
554.roms_r (max)
554.roms_r (max) (percentage)
554.roms_r (unexplained diff vs previous)
554.roms_r (unexplained diff vs previous) (percentage)
557.xz_r
557.xz_r (avg)
557.xz_r (avg) (percentage)
557.xz_r (max)
557.xz_r (max) (percentage)

Report Time: 0.23s
Execution (seconds)
Name Current %
500.perlbench_r 15802.000 -
502.gcc_r 10309.000 -
503.bwaves_r 21169.000 -
505.mcf_r 14087.000 -
507.cactuBSSN_r 11277.000 -
508.namd_r 9455.000 -
510.parest_r 22773.000 -
511.povray_r 19487.000 -
519.lbm_r 15604.000 -
520.omnetpp_r 14293.000 -
523.xalancbmk_r 13296.000 -
525.x264_r 7467.000 -
526.blender_r 12143.000 -
531.deepsjeng_r 7678.000 -
538.imagick_r 13921.000 -
541.leela_r 11083.000 -
544.nab_r 13098.000 -
548.exchange2_r 18333.000 -
554.roms_r 22395.000 -
557.xz_r 11517.000 -
Geometric Mean 13577.701 -
Code Size (bytes)
Name Current %
500.perlbench_r 2222531.000 -
502.gcc_r 9663171.000 -
503.bwaves_r 775551.000 -
505.mcf_r 17739.000 -
507.cactuBSSN_r 3374657.000 -
508.namd_r 491535.000 -
510.parest_r 1870408.000 -
511.povray_r 1082613.000 -
519.lbm_r 10743.000 -
520.omnetpp_r 1924349.000 -
523.xalancbmk_r 3901042.000 -
525.x264_r 541694.000 -
526.blender_r 14499939.000 -
531.deepsjeng_r 70187.000 -
538.imagick_r 1189876.000 -
541.leela_r 83093.000 -
544.nab_r 83799.000 -
548.exchange2_r 2542643.000 -
554.roms_r 2804410.000 -
557.xz_r 122680.000 -
Geometric Mean 668718.998 -
sample variability
Name Current %
500.perlbench_r 102.000 -
500.perlbench_r (avg) 102.000 -
500.perlbench_r (avg) (percentage) 0.650 -
500.perlbench_r (max) 202.000 -
500.perlbench_r (max) (percentage) 1.280 -
500.perlbench_r (unexplained diff vs previous) 199.000 -
500.perlbench_r (unexplained diff vs previous) (percentage) 1.260 -
503.bwaves_r 19.000 -
503.bwaves_r (avg) 19.000 -
503.bwaves_r (avg) (percentage) 0.090 -
503.bwaves_r (max) 12.000 -
503.bwaves_r (max) (percentage) 0.060 -
503.bwaves_r (unexplained diff vs previous) 13.000 -
503.bwaves_r (unexplained diff vs previous) (percentage) 0.060 -
505.mcf_r 28.000 -
505.mcf_r (avg) 28.000 -
505.mcf_r (avg) (percentage) 0.200 -
505.mcf_r (max) 30.000 -
505.mcf_r (max) (percentage) 0.220 -
507.cactuBSSN_r 135.000 -
507.cactuBSSN_r (avg) 135.000 -
507.cactuBSSN_r (avg) (percentage) 1.200 -
507.cactuBSSN_r (max) 113.000 -
507.cactuBSSN_r (max) (percentage) 1.010 -
508.namd_r 24.000 -
508.namd_r (avg) 24.000 -
508.namd_r (avg) (percentage) 0.260 -
508.namd_r (max) 27.000 -
508.namd_r (max) (percentage) 0.290 -
508.namd_r (unexplained diff vs previous) 27.000 -
508.namd_r (unexplained diff vs previous) (percentage) 0.290 -
510.parest_r 31.000 -
510.parest_r (avg) 31.000 -
510.parest_r (avg) (percentage) 0.140 -
510.parest_r (max) 63.000 -
510.parest_r (max) (percentage) 0.280 -
510.parest_r (unexplained diff vs previous) 64.000 -
510.parest_r (unexplained diff vs previous) (percentage) 0.280 -
511.povray_r 72.000 -
511.povray_r (avg) 72.000 -
511.povray_r (avg) (percentage) 0.370 -
511.povray_r (max) 89.000 -
511.povray_r (max) (percentage) 0.460 -
519.lbm_r 34.000 -
519.lbm_r (avg) 34.000 -
519.lbm_r (avg) (percentage) 0.220 -
519.lbm_r (max) 60.000 -
519.lbm_r (max) (percentage) 0.390 -
519.lbm_r (unexplained diff vs previous) 61.000 -
519.lbm_r (unexplained diff vs previous) (percentage) 0.390 -
520.omnetpp_r 121.000 -
520.omnetpp_r (avg) 121.000 -
520.omnetpp_r (avg) (percentage) 0.850 -
520.omnetpp_r (max) 150.000 -
520.omnetpp_r (max) (percentage) 1.050 -
520.omnetpp_r (unexplained diff vs previous) 148.000 -
520.omnetpp_r (unexplained diff vs previous) (percentage) 1.040 -
521.wrf_r (avg) (percentage) 1.700 -
521.wrf_r (max) (percentage) 1.040 -
523.xalancbmk_r 23.000 -
523.xalancbmk_r (avg) 23.000 -
523.xalancbmk_r (avg) (percentage) 0.180 -
523.xalancbmk_r (max) 39.000 -
523.xalancbmk_r (max) (percentage) 0.300 -
523.xalancbmk_r (unexplained diff vs previous) 40.000 -
523.xalancbmk_r (unexplained diff vs previous) (percentage) 0.300 -
525.x264_r 8.000 -
525.x264_r (avg) 8.000 -
525.x264_r (avg) (percentage) 0.110 -
525.x264_r (max) 6.000 -
525.x264_r (max) (percentage) 0.090 -
525.x264_r (unexplained diff vs previous) 4.000 -
525.x264_r (unexplained diff vs previous) (percentage) 0.050 -
526.blender_r 74.000 -
526.blender_r (avg) 74.000 -
526.blender_r (avg) (percentage) 0.610 -
526.blender_r (max) 44.000 -
526.blender_r (max) (percentage) 0.370 -
531.deepsjeng_r 34.000 -
531.deepsjeng_r (avg) 34.000 -
531.deepsjeng_r (avg) (percentage) 0.450 -
531.deepsjeng_r (max) 48.000 -
531.deepsjeng_r (max) (percentage) 0.630 -
531.deepsjeng_r (unexplained diff vs previous) 39.000 -
531.deepsjeng_r (unexplained diff vs previous) (percentage) 0.510 -
538.imagick_r 25.000 -
538.imagick_r (avg) 25.000 -
538.imagick_r (avg) (percentage) 0.180 -
538.imagick_r (max) 47.000 -
538.imagick_r (max) (percentage) 0.340 -
538.imagick_r (unexplained diff vs previous) 16.000 -
538.imagick_r (unexplained diff vs previous) (percentage) 0.110 -
541.leela_r 29.000 -
541.leela_r (avg) 29.000 -
541.leela_r (avg) (percentage) 0.270 -
541.leela_r (max) 44.000 -
541.leela_r (max) (percentage) 0.400 -
541.leela_r (unexplained diff vs previous) 7.000 -
541.leela_r (unexplained diff vs previous) (percentage) 0.060 -
544.nab_r 43.000 -
544.nab_r (avg) 43.000 -
544.nab_r (avg) (percentage) 0.330 -
544.nab_r (max) 52.000 -
544.nab_r (max) (percentage) 0.400 -
544.nab_r (unexplained diff vs previous) 33.000 -
544.nab_r (unexplained diff vs previous) (percentage) 0.250 -
548.exchange2_r 64.000 -
548.exchange2_r (avg) 64.000 -
548.exchange2_r (avg) (percentage) 0.350 -
548.exchange2_r (max) 73.000 -
548.exchange2_r (max) (percentage) 0.400 -
548.exchange2_r (unexplained diff vs previous) 35.000 -
548.exchange2_r (unexplained diff vs previous) (percentage) 0.190 -
549.fotonik3d_r (avg) (percentage) 0.870 -
549.fotonik3d_r (max) (percentage) 1.240 -
554.roms_r 58.000 -
554.roms_r (avg) 58.000 -
554.roms_r (avg) (percentage) 0.260 -
554.roms_r (max) 85.000 -
554.roms_r (max) (percentage) 0.380 -
554.roms_r (unexplained diff vs previous) 42.000 -
554.roms_r (unexplained diff vs previous) (percentage) 0.190 -
557.xz_r 23.000 -
557.xz_r (avg) 23.000 -
557.xz_r (avg) (percentage) 0.200 -
557.xz_r (max) 55.000 -
557.xz_r (max) (percentage) 0.480 -
557.xz_r (unexplained diff vs previous) 4.000 -
557.xz_r (unexplained diff vs previous) (percentage) 0.030 -
Geometric Mean 4.644 -