Regression: Regression of 77 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
40 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 51.053.0 3.92% 17.0 -66.67% 2023-09-02T14:47:15
41 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 48.064.0 33.33% 17.0 -64.58% 2023-09-02T14:47:15
42 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 65.055.0 -15.38% 18.0 -72.31% 2023-09-02T14:47:15
43 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 49.062.0 26.53% 20.0 -59.18% 2023-09-02T14:47:15
44 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 80.0317.0 296.25% 69.0 -13.75% 2023-09-02T14:47:15
45 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.921.5 -21.87% 0.55 -71.35% 2023-09-02T14:47:15
46 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.01.0 -66.67% 8.0 166.67% 2023-09-02T14:47:15
47 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.881.57 -16.49% 0.55 -70.74% 2023-09-02T14:47:15
48 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.04.0 300.00% 11.0 1000.00% 2023-09-02T14:47:15
49 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.150.25 66.67% 0.0 0.00% 2023-09-02T14:47:15
50 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 34.048.0 41.18% 19.0 -44.12% 2023-09-02T14:47:15
51 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.6910.36 285.13% 2.43 -9.67% 2023-09-02T14:47:15
52 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.160.37 131.25% 0.11 -31.25% 2023-09-02T14:47:15
53 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.07.0 133.33% 2.0 -33.33% 2023-09-02T14:47:15
54 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.697.29 171.00% 4.81 78.81% 2023-09-02T14:47:15
55 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 7.06.0 -14.29% 11.0 57.14% 2023-09-02T14:47:15
56 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.210.67 219.05% 0.44 109.52% 2023-09-02T14:47:15
57 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.04.0 33.33% 13.0 333.33% 2023-09-02T14:47:15
58 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 5.018.0 260.00% 11.0 120.00% 2023-09-02T14:47:15
59 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.060.88 -16.98% 0.42 -60.38% 2023-09-02T14:47:15
60 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 67.053.0 -20.90% 19.0 -71.64% 2023-09-02T14:47:15
61 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.090.06 -33.33% 0.1 11.11% 2023-09-02T14:47:15
62 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 6.019.0 216.67% 12.0 100.00% 2023-09-02T14:47:15
63 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.080.1 25.00% 0.05 -37.50% 2023-09-02T14:47:15
64 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 19.016.0 -15.79% 14.0 -48.15% 2023-09-02T14:47:15
65 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 5.012.0 140.00% 10.0 100.00% 2023-09-02T14:47:15
66 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.629.39 258.40% 2.38 -9.16% 2023-09-02T14:47:15
67 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.470.56 19.15% 0.54 14.89% 2023-09-02T14:47:15
68 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.471.5 2.04% 0.51 -65.31% 2023-09-02T14:47:15
69 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 23.015.0 -34.78% 2.0 -91.30% 2023-09-02T14:47:15
70 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.470.52 10.64% 0.33 -29.79% 2023-09-02T14:47:15
71 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 14.017.0 21.43% 16.0 14.29% 2023-09-02T14:47:15
72 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.05.0 150.00% 5.0 150.00% 2023-09-02T14:47:15
73 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 5.012.0 140.00% 10.0 100.00% 2023-09-02T14:47:15
74 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.950.79 -16.84% 0.98 3.16% 2023-09-02T14:47:15
75 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 22.018.0 -18.18% 11.0 -50.00% 2023-09-02T14:47:15
76 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 82.0349.0 325.61% 70.0 -14.63% 2023-09-02T14:47:15
77 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 22.018.0 -18.18% 11.0 -50.00% 2023-09-02T14:47:15
78 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.01.0 -66.67% 8.0 166.67% 2023-09-02T14:47:15
79 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.150.25 66.67% 0.59 293.33% 2023-09-02T14:47:15
80 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 15.018.0 20.00% 17.0 13.33% 2023-09-02T14:47:15
81 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.112.9 37.44% 0.77 -63.51% 2023-09-02T14:47:15
82 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.160.27 68.75% 0.28 75.00% 2023-09-02T14:47:15
83 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.01.0 -50.00% 3.0 50.00% 2023-09-02T14:47:15
84 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.05.0 66.67% 11.0 266.67% 2023-09-02T14:47:15
85 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.060.84 -20.75% 0.55 -48.11% 2023-09-02T14:47:15
86 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 14.016.0 14.29% 10.0 -28.57% 2023-09-02T14:47:15
87 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 14.016.0 14.29% 10.0 -28.57% 2023-09-02T14:47:15
88 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 6.05.0 -16.67% 1.0 -83.33% 2023-09-02T14:47:15
89 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.542.18 41.56% 0.87 -43.51% 2023-09-02T14:47:15
90 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.162.82 30.56% 0.95 -56.02% 2023-09-02T14:47:15
91 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 51.053.0 3.92% 17.0 -66.67% 2023-09-02T14:47:15
92 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.110.04 -63.64% 0.23 109.09% 2023-09-02T14:47:15
93 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.190.43 126.32% 0.39 105.26% 2023-09-02T14:47:15
94 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.20.17 -15.00% 0.3 50.00% 2023-09-02T14:47:15
95 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.570.5 -12.28% 0.44 -46.34% 2023-09-02T14:47:15
96 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.110.13 18.18% 0.36 227.27% 2023-09-02T14:47:15
97 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 1.080.7 -35.19% 0.09 -91.67% 2023-09-02T14:47:15
98 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 82.0246.0 200.00% 139.0 69.51% 2023-09-02T14:47:15
99 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.030.11 266.67% 0.3 900.00% 2023-09-02T14:47:15
100 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 34.048.0 41.18% 19.0 -44.12% 2023-09-02T14:47:15
101 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.160.38 137.50% 0.55 243.75% 2023-09-02T14:47:15
102 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.05.0 150.00% 5.0 150.00% 2023-09-02T14:47:15
103 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.160.15 -6.25% 0.69 331.25% 2023-09-02T14:47:15
104 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.210.68 223.81% 0.45 114.29% 2023-09-02T14:47:15
105 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.05.0 66.67% 0.0 0.00% 2023-09-02T14:47:15
106 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 31.026.0 -16.13% 32.0 3.23% 2023-09-02T14:47:15
107 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.110.09 -18.18% 0.34 209.09% 2023-09-02T14:47:15
108 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 19.016.0 -15.79% 14.0 -48.15% 2023-09-02T14:47:15
109 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.150.21 40.00% 0.66 340.00% 2023-09-02T14:47:15
111 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.470.56 19.15% 0.55 17.02% 2023-09-02T14:47:15
112 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 22.018.0 -18.18% 8.0 -63.64% 2023-09-02T14:47:15
113 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.240.2 -16.67% 0.07 -70.83% 2023-09-02T14:47:15
114 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 0.090.07 -22.22% 0.15 66.67% 2023-09-02T14:47:15
115 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.01.0 -50.00% 3.0 50.00% 2023-09-02T14:47:15
116 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 3.04.0 33.33% 13.0 333.33% 2023-09-02T14:47:15
117 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0023 (llvmorg-18-init-04392-g701e6f763047), 0025 (no-change) 2.07.0 250.00% 9.0 350.00% 2023-09-02T14:47:15
Change State Split Delete