Regression: Regression of 68 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
197 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 36.030.0 -16.67% 17.0 -52.78% 2023-09-04T22:23:30
198 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.570.45 -21.05% 0.24 700.00% 2023-09-04T22:23:30
199 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 7.05.0 -28.57% 17.0 -54.05% 2023-09-04T22:23:30
200 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 50.046.0 -8.00% 18.0 -64.00% 2023-09-04T22:23:30
201 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 317.0201.0 -36.59% 69.0 50.00% 2023-09-04T22:23:30
202 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 49.050.0 2.04% 20.0 -63.64% 2023-09-04T22:23:30
203 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.650.51 -21.54% 0.55 77.42% 2023-09-04T22:23:30
204 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 1.411.32 -6.38% 0.55 -60.99% 2023-09-04T22:23:30
205 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 4.08.0 100.00% 1.0 -75.00% 2023-09-04T22:23:30
206 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.50.4 -20.00% 0.0 0.00% 2023-09-04T22:23:30
207 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 34.031.0 -8.82% 19.0 -56.82% 2023-09-04T22:23:30
208 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 9.068.29 -8.50% 2.43 -73.18% 2023-09-04T22:23:30
209 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 4.665.15 10.52% 4.81 3.22% 2023-09-04T22:23:30
210 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.640.58 -9.38% 0.44 -31.25% 2023-09-04T22:23:30
211 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 6.07.0 16.67% 13.0 116.67% 2023-09-04T22:23:30
212 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 18.016.0 -11.11% 11.0 -38.89% 2023-09-04T22:23:30
213 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.80.56 -30.00% 0.42 -47.50% 2023-09-04T22:23:30
214 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 23.018.0 -21.74% 19.0 72.73% 2023-09-04T22:23:30
215 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.090.14 55.56% 0.1 25.00% 2023-09-04T22:23:30
216 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 18.014.0 -22.22% 12.0 -33.33% 2023-09-04T22:23:30
217 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.080.06 -25.00% 0.05 -37.50% 2023-09-04T22:23:30
218 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 10.012.0 20.00% 14.0 40.00% 2023-09-04T22:23:30
219 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 9.396.42 -31.63% 2.38 72.46% 2023-09-04T22:23:30
220 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.470.45 -4.26% 0.54 10.20% 2023-09-04T22:23:30
221 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 1.020.85 -16.67% 0.51 -50.00% 2023-09-04T22:23:30
222 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 19.015.0 -21.05% 8.0 700.00% 2023-09-04T22:23:30
223 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.360.3 -16.67% 0.33 -8.33% 2023-09-04T22:23:30
224 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 3.07.0 133.33% 5.0 66.67% 2023-09-04T22:23:30
225 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 5.04.0 -20.00% 5.0 0.00% 2023-09-04T22:23:30
226 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.150.08 -46.67% 0.08 -74.19% 2023-09-04T22:23:30
227 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.710.66 -7.04% 0.98 38.03% 2023-09-04T22:23:30
228 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 17.012.0 -29.41% 11.0 -35.29% 2023-09-04T22:23:30
229 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 301.0259.0 -13.95% 70.0 -76.74% 2023-09-04T22:23:30
230 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 17.012.0 -29.41% 11.0 -35.29% 2023-09-04T22:23:30
231 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.50.45 -10.00% 0.59 18.00% 2023-09-04T22:23:30
232 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 5.06.0 20.00% 17.0 240.00% 2023-09-04T22:23:30
233 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.310.22 -29.03% 0.77 -53.33% 2023-09-04T22:23:30
234 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.270.23 -14.81% 0.28 3.70% 2023-09-04T22:23:30
235 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 2.04.0 100.00% 3.0 50.00% 2023-09-04T22:23:30
236 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 10.09.0 -10.00% 11.0 10.00% 2023-09-04T22:23:30
237 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.80.58 -27.50% 0.55 -31.25% 2023-09-04T22:23:30
238 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 11.09.0 -18.18% 10.0 -9.09% 2023-09-04T22:23:30
239 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 11.09.0 -18.18% 10.0 -9.09% 2023-09-04T22:23:30
240 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 1.541.39 -9.74% 0.87 -56.06% 2023-09-04T22:23:30
241 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 2.162.26 4.63% 0.95 -61.54% 2023-09-04T22:23:30
242 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 36.030.0 -16.67% 17.0 -52.78% 2023-09-04T22:23:30
243 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 21.019.0 -9.52% 9.0 -57.14% 2023-09-04T22:23:30
244 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.060.04 -33.33% 0.12 100.00% 2023-09-04T22:23:30
245 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.120.24 100.00% 0.03 -75.00% 2023-09-04T22:23:30
246 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.310.36 16.13% 0.44 41.94% 2023-09-04T22:23:30
247 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.130.16 23.08% 0.36 80.00% 2023-09-04T22:23:30
248 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 155.0161.0 3.87% 139.0 -10.32% 2023-09-04T22:23:30
249 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 34.031.0 -8.82% 19.0 -56.82% 2023-09-04T22:23:30
250 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.330.3 -9.09% 0.55 66.67% 2023-09-04T22:23:30
251 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 5.04.0 -20.00% 5.0 0.00% 2023-09-04T22:23:30
252 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.160.23 43.75% 0.69 122.58% 2023-09-04T22:23:30
253 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 10.08.0 -20.00% 0.0 0.00% 2023-09-04T22:23:30
254 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.640.49 -23.44% 0.45 -29.69% 2023-09-04T22:23:30
255 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 23.022.0 -4.35% 32.0 39.13% 2023-09-04T22:23:30
256 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 10.012.0 20.00% 14.0 40.00% 2023-09-04T22:23:30
257 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.340.36 5.88% 0.66 94.12% 2023-09-04T22:23:30
259 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.160.19 18.75% 0.55 243.75% 2023-09-04T22:23:30
260 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 17.012.0 -29.41% 8.0 -52.94% 2023-09-04T22:23:30
261 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 1.091.0 -8.26% 0.49 -55.05% 2023-09-04T22:23:30
262 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 0.120.24 100.00% 0.15 25.00% 2023-09-04T22:23:30
263 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 2.04.0 100.00% 3.0 50.00% 2023-09-04T22:23:30
264 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 6.07.0 16.67% 13.0 116.67% 2023-09-04T22:23:30
265 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0026 (llvmorg-18-init-04496-g62790a8d4a94), 0027 (llvmorg-18-init-04636-g43d05f4cc959) 6.05.0 -16.67% 9.0 50.00% 2023-09-04T22:23:30
Change State Split Delete