Regression: Regression of 80 benchmarks: 500.perlbench_r (unexplained diff vs previous), 500.perlbench_r (unexplained diff vs previo...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
1292 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 21.018.0 -14.29% 17.0 -19.05% 2023-12-25T00:28:56
1293 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.330.66 100.00% 0.24 0.00% 2023-12-25T00:28:56
1294 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 5.017.0 240.00% None 0.00% 2023-12-25T00:28:56
1295 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.390.41 5.13% 0.1 -74.36% 2023-12-25T00:28:56
1296 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 2.142.1 -1.87% 3.34 56.07% 2023-12-25T00:28:56
1298 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 23.022.0 -4.35% 17.0 6.25% 2023-12-25T00:28:56
1299 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 31.08.0 -74.19% 18.0 -56.10% 2023-12-25T00:28:56
1300 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 320.0347.0 8.44% 69.0 1050.00% 2023-12-25T00:28:56
1301 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.230.06 -73.91% 0.55 71.88% 2023-12-25T00:28:56
1302 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.890.24 -73.03% 0.55 -54.17% 2023-12-25T00:28:56
1303 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.530.52 -1.89% 0.57 7.55% 2023-12-25T00:28:56
1304 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.851.06 24.71% 0.0 0.00% 2023-12-25T00:28:56
1305 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 17.018.0 5.88% 19.0 11.76% 2023-12-25T00:28:56
1306 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 10.4710.62 1.43% 2.43 -75.65% 2023-12-25T00:28:56
1307 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.330.43 30.30% 0.09 0.00% 2023-12-25T00:28:56
1308 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 11.010.0 -9.09% 12.0 9.09% 2023-12-25T00:28:56
1309 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.130.46 253.85% None 0.00% 2023-12-25T00:28:56
1310 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.890.87 -2.25% 0.44 -29.03% 2023-12-25T00:28:56
1311 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 8.010.0 25.00% 13.0 62.50% 2023-12-25T00:28:56
1312 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 24.023.0 -4.17% 11.0 -35.29% 2023-12-25T00:28:56
1313 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.220.21 -4.55% 0.13 -40.91% 2023-12-25T00:28:56
1314 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 8.02.0 -75.00% 19.0 72.73% 2023-12-25T00:28:56
1315 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.10.09 -10.00% 0.1 0.00% 2023-12-25T00:28:56
1316 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 19.024.0 26.32% 12.0 300.00% 2023-12-25T00:28:56
1317 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 33.032.0 -3.03% None 0.00% 2023-12-25T00:28:56
1318 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 9.9811.88 19.04% 2.38 1222.22% 2023-12-25T00:28:56
1319 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.540.49 -9.26% 0.54 0.00% 2023-12-25T00:28:56
1320 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.620.54 -12.90% 0.51 -17.74% 2023-12-25T00:28:56
1321 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 11.021.0 90.91% 8.0 0.00% 2023-12-25T00:28:56
1322 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 14.015.0 7.14% 2.0 0.00% 2023-12-25T00:28:56
1323 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 4.05.0 25.00% 1.0 -75.00% 2023-12-25T00:28:56
1324 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.40.39 -2.50% 0.32 -15.79% 2023-12-25T00:28:56
1325 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 4.03.0 -25.00% 5.0 25.00% 2023-12-25T00:28:56
1326 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 16.015.0 -6.25% 16.0 0.00% 2023-12-25T00:28:56
1327 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.320.4 25.00% 0.08 -75.00% 2023-12-25T00:28:56
1328 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 3.05.0 66.67% 2.0 0.00% 2023-12-25T00:28:56
1329 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 326.0310.0 -4.91% 70.0 -78.53% 2023-12-25T00:28:56
1330 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.90.88 -2.22% 0.09 -90.00% 2023-12-25T00:28:56
1331 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.10.17 70.00% 0.07 0.00% 2023-12-25T00:28:56
1332 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.841.07 27.38% 0.59 7.27% 2023-12-25T00:28:56
1333 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 4.05.0 25.00% 17.0 0.00% 2023-12-25T00:28:56
1334 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 1.061.01 -4.72% 0.77 4.05% 2023-12-25T00:28:56
1335 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.380.34 -10.53% 0.28 -26.32% 2023-12-25T00:28:56
1336 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 3.02.0 -33.33% 3.0 0.00% 2023-12-25T00:28:56
1337 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 16.021.0 31.25% 11.0 10.00% 2023-12-25T00:28:56
1338 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.690.7 1.45% 0.55 -20.29% 2023-12-25T00:28:56
1339 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 14.015.0 7.14% None 0.00% 2023-12-25T00:28:56
1340 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 4.09.0 125.00% None 0.00% 2023-12-25T00:28:56
1341 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 2.04.0 100.00% 1.0 -50.00% 2023-12-25T00:28:56
1342 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 29.023.0 -20.69% 8.0 -72.41% 2023-12-25T00:28:56
1343 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.810.83 2.47% 0.87 8.75% 2023-12-25T00:28:56
1344 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 21.018.0 -14.29% 17.0 -19.05% 2023-12-25T00:28:56
1345 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 44.043.0 -2.27% 9.0 -79.55% 2023-12-25T00:28:56
1346 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 1.561.36 -12.82% 1.21 -22.44% 2023-12-25T00:28:56
1347 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.220.48 118.18% None 0.00% 2023-12-25T00:28:56
1348 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.190.18 -5.26% 0.23 21.05% 2023-12-25T00:28:56
1349 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 8.07.0 -12.50% 4.0 -50.00% 2023-12-25T00:28:56
1350 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.50.51 2.00% 0.39 -18.75% 2023-12-25T00:28:56
1351 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 23.026.0 13.04% 20.0 -33.33% 2023-12-25T00:28:56
1352 llvm-aarch64-master-O3:239801545695209356 execution_variation 548.exchange2_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 14.015.0 7.14% None 0.00% 2023-12-25T00:28:56
1353 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.660.7 6.06% 0.09 0.00% 2023-12-25T00:28:56
1354 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 1.591.28 -19.50% 0.45 -71.70% 2023-12-25T00:28:56
1355 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 17.018.0 5.88% 19.0 11.76% 2023-12-25T00:28:56
1356 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 1.381.34 -2.90% 0.55 -60.14% 2023-12-25T00:28:56
1357 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 17.021.0 23.53% 0.0 0.00% 2023-12-25T00:28:56
1358 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.680.87 27.94% 0.45 309.09% 2023-12-25T00:28:56
1359 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.81.02 27.50% 3.23 0.00% 2023-12-25T00:28:56
1360 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.30.29 -3.33% 0.34 13.33% 2023-12-25T00:28:56
1361 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 8.07.0 -12.50% 4.0 -50.00% 2023-12-25T00:28:56
1362 llvm-aarch64-master-O3:239801545695209356 execution_variation 549.fotonik3d_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 23.020.0 -13.04% 56.0 0.00% 2023-12-25T00:28:56
1363 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.450.54 20.00% 0.66 53.49% 2023-12-25T00:28:56
1364 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.130.16 23.08% 0.55 1.85% 2023-12-25T00:28:56
1365 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 29.023.0 -20.69% 8.0 -72.41% 2023-12-25T00:28:56
1366 llvm-aarch64-master-O3:239801545695209356 execution_variation 503.bwaves_r (unexplained diff vs previous) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 7.09.0 28.57% 2.0 0.00% 2023-12-25T00:28:56
1367 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 2.362.33 -1.27% 0.49 -79.24% 2023-12-25T00:28:56
1368 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.080.17 112.50% 0.07 0.00% 2023-12-25T00:28:56
1369 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 0.130.1 -23.08% 0.15 15.38% 2023-12-25T00:28:56
1370 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 3.02.0 -33.33% 3.0 0.00% 2023-12-25T00:28:56
1371 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (avg) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 8.010.0 25.00% 13.0 62.50% 2023-12-25T00:28:56
1372 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) 0148 (llvmorg-18-init-15829-g2dc50d28414c), 0179 (no-change) 25.024.0 -4.00% 9.0 -64.00% 2023-12-25T00:28:56
Change State Split Delete