Regression: Regression of 31 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 23.051.0 121.74% 17.0 -26.09% 2023-09-02T06:35:30
6 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.570.96 68.42% 0.24 -57.89% 2023-09-02T06:35:30
7 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 7.048.0 585.71% 17.0 142.86% 2023-09-02T06:35:30
8 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 23.065.0 182.61% 18.0 -21.74% 2023-09-02T06:35:30
9 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 6.049.0 716.67% 20.0 233.33% 2023-09-02T06:35:30
10 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.651.92 195.38% 0.55 -15.38% 2023-09-02T06:35:30
11 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.651.88 189.23% 0.55 -15.38% 2023-09-02T06:35:30
12 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 6.034.0 466.67% 19.0 216.67% 2023-09-02T06:35:30
13 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 9.07.0 -22.22% 11.0 22.22% 2023-09-02T06:35:30
14 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.140.21 50.00% 0.44 214.29% 2023-09-02T06:35:30
15 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 3.05.0 66.67% 11.0 266.67% 2023-09-02T06:35:30
16 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.260.11 -57.69% 0.13 -50.00% 2023-09-02T06:35:30
17 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 23.067.0 191.30% 19.0 -17.39% 2023-09-02T06:35:30
18 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 4.06.0 50.00% 12.0 200.00% 2023-09-02T06:35:30
19 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 19.027.0 42.11% 14.0 -26.32% 2023-09-02T06:35:30
20 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 3.05.0 66.67% 10.0 233.33% 2023-09-02T06:35:30
21 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.651.47 126.15% 0.51 -21.54% 2023-09-02T06:35:30
22 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 19.032.0 68.42% 8.0 -57.89% 2023-09-02T06:35:30
23 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 3.05.0 66.67% 10.0 233.33% 2023-09-02T06:35:30
24 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.570.95 66.67% 0.98 71.93% 2023-09-02T06:35:30
25 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.312.11 580.65% 0.77 148.39% 2023-09-02T06:35:30
26 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.311.54 396.77% 0.87 180.65% 2023-09-02T06:35:30
27 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.312.16 596.77% 0.95 206.45% 2023-09-02T06:35:30
29 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 9.04.0 -55.56% 4.0 -55.56% 2023-09-02T06:35:30
30 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.140.19 35.71% 0.39 178.57% 2023-09-02T06:35:30
31 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.260.2 -23.08% 0.3 15.38% 2023-09-02T06:35:30
32 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.570.82 43.86% 0.44 -22.81% 2023-09-02T06:35:30
34 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 0.140.21 50.00% 0.45 221.43% 2023-09-02T06:35:30
35 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 19.031.0 63.16% 32.0 68.42% 2023-09-02T06:35:30
36 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 9.04.0 -55.56% 4.0 -55.56% 2023-09-02T06:35:30
37 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0022 (llvmorg-18-init-04347-gfc04472aa269), 0023 (llvmorg-18-init-04392-g701e6f763047) 19.027.0 42.11% 14.0 -26.32% 2023-09-02T06:35:30
Change State Split Delete