Regression: Regression of 66 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2244 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 21.029.0 38.10% 17.0 -15.00% 2024-02-16T14:11:08
2245 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.130.16 23.08% 0.24 -17.24% 2024-02-16T14:11:08
2246 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.190.17 -10.53% 0.1 -47.37% 2024-02-16T14:11:08
2247 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.634.34 -6.26% 3.34 -27.86% 2024-02-16T14:11:08
2248 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 38.041.0 7.89% 20.0 -54.55% 2024-02-16T14:11:08
2249 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 16.021.0 31.25% 17.0 -37.04% 2024-02-16T14:11:08
2250 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 40.092.0 130.00% 18.0 -41.94% 2024-02-16T14:11:08
2251 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 20.021.0 5.00% 69.0 -77.67% 2024-02-16T14:11:08
2252 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.162.61 125.00% 0.55 0.00% 2024-02-16T14:11:08
2253 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.182.68 127.12% 0.55 -41.49% 2024-02-16T14:11:08
2254 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 5.06.0 20.00% 6.0 -14.29% 2024-02-16T14:11:08
2255 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.450.4 -11.11% 0.57 -22.97% 2024-02-16T14:11:08
2256 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 2.03.0 50.00% 1.0 -80.00% 2024-02-16T14:11:08
2257 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.350.3 -14.29% 0.0 0.00% 2024-02-16T14:11:08
2258 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 9.258.82 -4.65% 2.43 -77.05% 2024-02-16T14:11:08
2259 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.624.48 -3.03% 4.81 0.42% 2024-02-16T14:11:08
2260 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.631.59 -2.45% 0.44 -73.01% 2024-02-16T14:11:08
2261 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 44.042.0 -4.55% 11.0 -75.00% 2024-02-16T14:11:08
2262 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.540.71 31.48% 0.42 -65.57% 2024-02-16T14:11:08
2263 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 40.090.0 125.00% 19.0 0.00% 2024-02-16T14:11:08
2264 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 31.028.0 -9.68% 12.0 100.00% 2024-02-16T14:11:08
2265 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 8.04.0 -50.00% None 0.00% 2024-02-16T14:11:08
2266 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 16.017.0 6.25% 14.0 -22.22% 2024-02-16T14:11:08
2267 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.690.65 -5.80% 2.38 -75.13% 2024-02-16T14:11:08
2268 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.540.52 -3.70% 0.54 -1.82% 2024-02-16T14:11:08
2269 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.620.85 37.10% 0.51 -17.74% 2024-02-16T14:11:08
2270 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.05.0 25.00% 8.0 -11.11% 2024-02-16T14:11:08
2271 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.05.0 25.00% 2.0 -88.24% 2024-02-16T14:11:08
2272 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 8.07.0 -12.50% 1.0 -87.50% 2024-02-16T14:11:08
2273 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.360.34 -5.56% 0.32 -11.11% 2024-02-16T14:11:08
2274 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 17.016.0 -5.88% 16.0 -5.88% 2024-02-16T14:11:08
2275 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.640.56 -12.50% 0.08 -87.50% 2024-02-16T14:11:08
2276 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.03.0 -25.00% 2.0 -60.00% 2024-02-16T14:11:08
2277 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.491.43 -4.03% 0.98 -34.23% 2024-02-16T14:11:08
2278 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 286.0282.0 -1.40% 70.0 -79.47% 2024-02-16T14:11:08
2279 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.230.12 -47.83% 0.09 -60.87% 2024-02-16T14:11:08
2280 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.070.1 42.86% 0.07 -58.82% 2024-02-16T14:11:08
2281 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.780.64 -17.95% 0.59 -24.36% 2024-02-16T14:11:08
2282 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.730.96 31.51% 0.77 -36.89% 2024-02-16T14:11:08
2283 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 15.012.0 -20.00% 11.0 -26.67% 2024-02-16T14:11:08
2284 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 6.05.0 -16.67% None 0.00% 2024-02-16T14:11:08
2285 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 4.03.0 -25.00% 1.0 -75.00% 2024-02-16T14:11:08
2286 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 21.029.0 38.10% 17.0 -15.00% 2024-02-16T14:11:08
2287 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.962.15 9.69% 1.21 -48.51% 2024-02-16T14:11:08
2288 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 87.082.0 -5.75% 57.0 -34.48% 2024-02-16T14:11:08
2289 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 38.041.0 7.89% 20.0 -54.55% 2024-02-16T14:11:08
2290 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 6.05.0 -16.67% None 0.00% 2024-02-16T14:11:08
2291 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.130.1 -23.08% 0.03 -81.25% 2024-02-16T14:11:08
2292 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 5.06.0 20.00% 6.0 -14.29% 2024-02-16T14:11:08
2293 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.530.55 3.77% 0.44 -24.14% 2024-02-16T14:11:08
2294 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.190.23 21.05% 0.09 -88.61% 2024-02-16T14:11:08
2295 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 145.0143.0 -1.38% 139.0 -9.74% 2024-02-16T14:11:08
2296 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.160.17 6.25% 0.3 0.00% 2024-02-16T14:11:08
2297 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.180.3 66.67% 0.55 1.85% 2024-02-16T14:11:08
2298 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.590.61 3.39% 0.69 6.15% 2024-02-16T14:11:08
2299 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 1.141.04 -8.77% 0.45 104.55% 2024-02-16T14:11:08
2300 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 7.06.0 -14.29% 0.0 0.00% 2024-02-16T14:11:08
2301 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 46.045.0 -2.17% 32.0 -30.43% 2024-02-16T14:11:08
2302 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.610.84 37.70% 3.23 -33.40% 2024-02-16T14:11:08
2303 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 12.016.0 33.33% 56.0 -39.13% 2024-02-16T14:11:08
2304 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 16.017.0 6.25% 14.0 -22.22% 2024-02-16T14:11:08
2305 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 145.0143.0 -1.38% 139.0 -9.74% 2024-02-16T14:11:08
2306 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 11.015.0 36.36% 8.0 -69.23% 2024-02-16T14:11:08
2307 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.170.13 -23.53% 0.07 -58.82% 2024-02-16T14:11:08
2308 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 0.150.13 -13.33% 0.15 -51.61% 2024-02-16T14:11:08
2309 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0216 (llvmorg-19-init-02615-g7dad59f0a980), 0217 (llvmorg-19-init-02616-ga8fdc93ee11a) 3.05.0 66.67% 9.0 0.00% 2024-02-16T14:11:08
Change State Split Delete