Regression: Regression of 76 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
119 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 23.036.0 56.52% 17.0 -67.92% 2023-09-03T18:39:32
120 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 48.037.0 -22.92% 17.0 -73.44% 2023-09-03T18:39:32
121 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 55.050.0 -9.09% 18.0 -67.27% 2023-09-03T18:39:32
122 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 80.046.0 -42.50% 69.0 -78.23% 2023-09-03T18:39:32
123 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 49.055.0 12.24% 20.0 -67.74% 2023-09-03T18:39:32
124 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 1.571.41 -10.19% 0.55 -64.97% 2023-09-03T18:39:32
125 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 10.08.0 -20.00% 11.0 175.00% 2023-09-03T18:39:32
126 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 3.04.0 33.33% 1.0 0.00% 2023-09-03T18:39:32
127 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.250.5 100.00% 0.0 0.00% 2023-09-03T18:39:32
128 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 48.044.0 -8.33% 19.0 -60.42% 2023-09-03T18:39:32
129 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 10.369.06 -12.55% 2.43 -76.54% 2023-09-03T18:39:32
130 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.370.27 -27.03% 0.11 -70.27% 2023-09-03T18:39:32
131 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 3.05.0 66.67% 2.0 -71.43% 2023-09-03T18:39:32
132 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.694.66 73.23% 4.81 -34.02% 2023-09-03T18:39:32
133 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.670.64 -4.48% 0.44 -34.33% 2023-09-03T18:39:32
134 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 4.06.0 50.00% 13.0 225.00% 2023-09-03T18:39:32
135 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.110.15 36.36% 0.13 18.18% 2023-09-03T18:39:32
136 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.880.8 -9.09% 0.42 -52.27% 2023-09-03T18:39:32
137 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 19.018.0 -5.26% 12.0 -36.84% 2023-09-03T18:39:32
138 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 16.010.0 -37.50% 14.0 -12.50% 2023-09-03T18:39:32
139 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 12.014.0 16.67% 10.0 -16.67% 2023-09-03T18:39:32
140 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.621.38 -47.33% 2.38 -74.65% 2023-09-03T18:39:32
141 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.470.49 4.26% 0.54 -3.57% 2023-09-03T18:39:32
142 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.651.02 56.92% 0.51 -66.00% 2023-09-03T18:39:32
143 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.03.0 50.00% 8.0 700.00% 2023-09-03T18:39:32
144 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 15.016.0 6.67% 2.0 -86.67% 2023-09-03T18:39:32
145 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.04.0 100.00% 1.0 -50.00% 2023-09-03T18:39:32
146 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.470.36 -23.40% 0.33 -36.54% 2023-09-03T18:39:32
147 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.03.0 50.00% 5.0 150.00% 2023-09-03T18:39:32
148 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 14.015.0 7.14% 16.0 -5.88% 2023-09-03T18:39:32
149 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 3.02.0 -33.33% 11.0 266.67% 2023-09-03T18:39:32
150 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 12.014.0 16.67% 10.0 -16.67% 2023-09-03T18:39:32
151 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.150.31 106.67% 0.08 -46.67% 2023-09-03T18:39:32
152 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.790.71 -10.13% 0.98 24.05% 2023-09-03T18:39:32
153 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 18.017.0 -5.56% 11.0 -38.89% 2023-09-03T18:39:32
154 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 349.0301.0 -13.75% 70.0 -79.94% 2023-09-03T18:39:32
155 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 18.017.0 -5.56% 11.0 -38.89% 2023-09-03T18:39:32
156 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.250.5 100.00% 0.59 136.00% 2023-09-03T18:39:32
157 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.111.65 -21.80% 0.77 -73.45% 2023-09-03T18:39:32
158 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 5.010.0 100.00% 11.0 120.00% 2023-09-03T18:39:32
159 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.840.8 -4.76% 0.55 -34.52% 2023-09-03T18:39:32
160 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 14.011.0 -21.43% 10.0 -37.50% 2023-09-03T18:39:32
161 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 14.011.0 -21.43% 10.0 -37.50% 2023-09-03T18:39:32
162 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.181.98 -9.17% 0.87 -60.09% 2023-09-03T18:39:32
163 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 2.162.47 14.35% 0.95 -66.31% 2023-09-03T18:39:32
164 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 1.02.0 100.00% 4.0 300.00% 2023-09-03T18:39:32
165 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 1.02.0 100.00% 4.0 300.00% 2023-09-03T18:39:32
166 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 23.036.0 56.52% 17.0 -67.92% 2023-09-03T18:39:32
167 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 24.021.0 -12.50% 9.0 -62.50% 2023-09-03T18:39:32
168 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.080.06 -25.00% 0.12 50.00% 2023-09-03T18:39:32
169 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.040.05 25.00% 0.23 475.00% 2023-09-03T18:39:32
170 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 4.05.0 25.00% 4.0 0.00% 2023-09-03T18:39:32
171 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.430.51 18.60% 0.39 -9.30% 2023-09-03T18:39:32
172 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.090.12 33.33% 0.03 0.00% 2023-09-03T18:39:32
173 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.50.31 -38.00% 0.44 -12.00% 2023-09-03T18:39:32
174 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.130.2 53.85% 0.36 176.92% 2023-09-03T18:39:32
175 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.70.74 5.71% 0.09 -87.14% 2023-09-03T18:39:32
176 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 82.0155.0 89.02% 139.0 -43.50% 2023-09-03T18:39:32
177 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.270.21 -22.22% 0.3 172.73% 2023-09-03T18:39:32
178 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.110.06 -45.45% 0.34 0.00% 2023-09-03T18:39:32
179 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 48.044.0 -8.33% 19.0 -60.42% 2023-09-03T18:39:32
180 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.380.33 -13.16% 0.55 44.74% 2023-09-03T18:39:32
181 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.160.31 93.75% 0.69 360.00% 2023-09-03T18:39:32
182 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 5.010.0 100.00% 0.0 0.00% 2023-09-03T18:39:32
183 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.680.64 -5.88% 0.45 -33.82% 2023-09-03T18:39:32
184 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 26.023.0 -11.54% 32.0 23.08% 2023-09-03T18:39:32
185 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 4.05.0 25.00% 4.0 0.00% 2023-09-03T18:39:32
186 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 16.010.0 -37.50% 14.0 -12.50% 2023-09-03T18:39:32
187 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.210.34 61.90% 0.66 214.29% 2023-09-03T18:39:32
188 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.120.1 -16.67% 0.06 -50.00% 2023-09-03T18:39:32
190 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 18.017.0 -5.56% 8.0 -55.56% 2023-09-03T18:39:32
191 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 1.251.09 -12.80% 0.49 -60.80% 2023-09-03T18:39:32
192 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.20.18 -10.00% 0.07 -65.00% 2023-09-03T18:39:32
193 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 0.090.12 33.33% 0.15 114.29% 2023-09-03T18:39:32
194 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 4.06.0 50.00% 13.0 225.00% 2023-09-03T18:39:32
195 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0025 (no-change), 0026 (llvmorg-18-init-04496-g62790a8d4a94) 7.06.0 -14.29% 9.0 28.57% 2023-09-03T18:39:32
Change State Split Delete