Regression: Regression of 68 benchmarks: 500.perlbench_r (avg) (percentage), 500.perlbench_r (max), 500.perlbench_r (max) (percentag...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
2176 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.440.29 -34.09% 0.24 -55.56% 2024-02-16T02:15:06
2177 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 2.03.0 50.00% None 0.00% 2024-02-16T02:15:06
2178 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.20.19 -5.00% 0.1 -50.00% 2024-02-16T02:15:06
2179 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 3.04.63 54.33% 3.34 13.22% 2024-02-16T02:15:06
2180 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 38.044.0 15.79% 20.0 -47.37% 2024-02-16T02:15:06
2181 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 33.027.0 -18.18% 17.0 6.25% 2024-02-16T02:15:06
2182 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 32.031.0 -3.12% 18.0 -43.75% 2024-02-16T02:15:06
2183 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 314.0309.0 -1.59% 69.0 245.00% 2024-02-16T02:15:06
2184 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 26.027.0 3.85% 20.0 -13.04% 2024-02-16T02:15:06
2185 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.960.94 -2.08% 0.55 -42.71% 2024-02-16T02:15:06
2186 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.760.74 -2.63% 0.57 -25.00% 2024-02-16T02:15:06
2187 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 4.05.0 25.00% 1.0 -75.00% 2024-02-16T02:15:06
2188 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.990.7 -29.29% 0.0 0.00% 2024-02-16T02:15:06
2189 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.20.3 50.00% 0.09 -10.00% 2024-02-16T02:15:06
2190 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 4.624.79 3.68% 4.81 12.12% 2024-02-16T02:15:06
2191 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.110.33 200.00% 0.11 0.00% 2024-02-16T02:15:06
2192 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 2.06.0 200.00% 2.0 0.00% 2024-02-16T02:15:06
2193 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 15.014.0 -6.67% 12.0 -20.00% 2024-02-16T02:15:06
2194 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.110.09 -18.18% None 0.00% 2024-02-16T02:15:06
2195 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.671.63 -2.40% 0.44 -73.65% 2024-02-16T02:15:06
2196 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 45.044.0 -2.22% 11.0 -75.56% 2024-02-16T02:15:06
2197 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.261.22 -3.17% 0.42 -66.67% 2024-02-16T02:15:06
2198 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.120.13 8.33% 0.1 -16.67% 2024-02-16T02:15:06
2199 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 7.06.0 -14.29% 12.0 200.00% 2024-02-16T02:15:06
2200 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 9.819.57 -2.45% 2.38 244.93% 2024-02-16T02:15:06
2201 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.540.55 1.85% 0.54 -6.90% 2024-02-16T02:15:06
2202 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 4.09.0 125.00% 8.0 -52.94% 2024-02-16T02:15:06
2203 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 7.08.0 14.29% 8.0 60.00% 2024-02-16T02:15:06
2204 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 9.017.0 88.89% 2.0 -71.43% 2024-02-16T02:15:06
2205 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.340.36 5.88% 0.33 -15.38% 2024-02-16T02:15:06
2206 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 20.017.0 -15.00% 12.0 300.00% 2024-02-16T02:15:06
2207 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 14.016.0 14.29% 11.0 57.14% 2024-02-16T02:15:06
2208 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.650.64 -1.54% 0.08 -66.67% 2024-02-16T02:15:06
2209 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 4.05.0 25.00% 2.0 100.00% 2024-02-16T02:15:06
2210 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.561.49 -4.49% 0.98 -37.18% 2024-02-16T02:15:06
2211 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 348.0341.0 -2.01% 70.0 -74.64% 2024-02-16T02:15:06
2212 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.140.17 21.43% 0.07 133.33% 2024-02-16T02:15:06
2213 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.80.78 -2.50% 0.59 -26.25% 2024-02-16T02:15:06
2214 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.521.22 -19.74% 0.77 5.48% 2024-02-16T02:15:06
2215 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 3.04.0 33.33% 3.0 0.00% 2024-02-16T02:15:06
2216 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 16.015.0 -6.25% 11.0 -31.25% 2024-02-16T02:15:06
2217 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 7.06.0 -14.29% None 0.00% 2024-02-16T02:15:06
2218 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.191.23 3.36% 0.95 -11.21% 2024-02-16T02:15:06
2219 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 1.962.35 19.90% 1.21 -38.27% 2024-02-16T02:15:06
2220 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 58.087.0 50.00% 57.0 -1.72% 2024-02-16T02:15:06
2221 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.580.6 3.45% 0.39 -37.10% 2024-02-16T02:15:06
2222 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 38.044.0 15.79% 20.0 -47.37% 2024-02-16T02:15:06
2223 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 7.06.0 -14.29% None 0.00% 2024-02-16T02:15:06
2224 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.130.16 23.08% 0.03 -76.92% 2024-02-16T02:15:06
2225 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.590.58 -1.69% 0.44 -27.87% 2024-02-16T02:15:06
2226 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.420.79 88.10% 0.09 -72.73% 2024-02-16T02:15:06
2227 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 145.0154.0 6.21% 139.0 11.20% 2024-02-16T02:15:06
2228 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.570.48 -15.79% 0.34 325.00% 2024-02-16T02:15:06
2229 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.560.54 -3.57% 0.55 -1.79% 2024-02-16T02:15:06
2230 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.640.65 1.56% 0.69 53.33% 2024-02-16T02:15:06
2231 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.260.22 -15.38% 0.45 200.00% 2024-02-16T02:15:06
2232 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 20.014.0 -30.00% 0.0 0.00% 2024-02-16T02:15:06
2233 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 49.046.0 -6.12% 32.0 -34.69% 2024-02-16T02:15:06
2234 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 3.094.85 56.96% 3.23 12.54% 2024-02-16T02:15:06
2235 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.420.48 14.29% 0.34 54.55% 2024-02-16T02:15:06
2236 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 59.092.0 55.93% 56.0 -1.75% 2024-02-16T02:15:06
2237 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.50.49 -2.00% 0.66 43.48% 2024-02-16T02:15:06
2238 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 145.0154.0 6.21% 139.0 11.20% 2024-02-16T02:15:06
2239 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 27.026.0 -3.70% 8.0 -70.37% 2024-02-16T02:15:06
2240 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 4.06.0 50.00% 2.0 0.00% 2024-02-16T02:15:06
2241 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 0.320.31 -3.13% 0.15 -53.12% 2024-02-16T02:15:06
2242 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 3.04.0 33.33% 3.0 0.00% 2024-02-16T02:15:06
2243 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0214 (llvmorg-19-init-02571-geb97599335be), 0216 (llvmorg-19-init-02615-g7dad59f0a980) 10.09.0 -10.00% 9.0 -10.00% 2024-02-16T02:15:06
Change State Split Delete