Regression: Regression of 108 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max)...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew %Δ Now Current Age
401 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (avg) 0375 (no-change), 0377 (no-change) 20.019.0 -5.00% 22.0 10.00% 2022-09-20T11:17:43
402 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 4.03.0 -25.00% None 0.00% 2022-09-20T11:17:43
403 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) 0375 (no-change), 0377 (no-change) 35.045.0 28.57% 61.0 8.93% 2022-09-20T11:17:43
404 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) 0375 (no-change), 0377 (no-change) 27.024.0 -11.11% 20.0 -25.93% 2022-09-20T11:17:43
405 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) 0375 (no-change), 0377 (no-change) 81.068.0 -16.05% 92.0 13.58% 2022-09-20T11:17:43
406 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (max) 0375 (no-change), 0377 (no-change) 46.044.0 -4.35% 31.0 -26.19% 2022-09-20T11:17:43
407 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.140.16 14.29% 0.13 -7.14% 2022-09-20T11:17:43
408 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.650.71 9.23% 0.46 -29.23% 2022-09-20T11:17:43
409 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 20.029.0 45.00% 7.0 -65.00% 2022-09-20T11:17:43
410 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (avg) 0375 (no-change), 0377 (no-change) 55.051.0 -7.27% 33.0 -29.79% 2022-09-20T11:17:43
411 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.560.47 -16.07% 0.63 12.50% 2022-09-20T11:17:43
412 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref 0375 (no-change), 0377 (no-change) 35.045.0 28.57% 61.0 8.93% 2022-09-20T11:17:43
413 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.550.74 34.55% None 0.00% 2022-09-20T11:17:43
414 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) (percentage) 0375 (no-change), 0377 (no-change) 0.160.15 -6.25% 0.16 0.00% 2022-09-20T11:17:43
415 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd 0375 (no-change), 0377 (no-change) 8.06.0 -25.00% 17.0 112.50% 2022-09-20T11:17:43
416 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) 0375 (no-change), 0377 (no-change) 13.020.0 53.85% 10.0 0.00% 2022-09-20T11:17:43
417 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) (percentage) 0375 (no-change), 0377 (no-change) 1.851.76 -4.86% 1.63 -11.89% 2022-09-20T11:17:43
418 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) (percentage) 0375 (no-change), 0377 (no-change) 1.261.07 -15.08% 1.1 -20.86% 2022-09-20T11:17:43
419 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (max) 0375 (no-change), 0377 (no-change) 31.030.0 -3.23% 54.0 74.19% 2022-09-20T11:17:43
420 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc 0375 (no-change), 0377 (no-change) 23.018.0 -21.74% 23.0 0.00% 2022-09-20T11:17:43
421 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) (percentage) 0375 (no-change), 0377 (no-change) 0.880.84 -4.55% 0.63 -18.18% 2022-09-20T11:17:43
422 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk 0375 (no-change), 0377 (no-change) 9.023.0 155.56% 24.0 242.86% 2022-09-20T11:17:43
423 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.450.43 -4.44% None 0.00% 2022-09-20T11:17:43
424 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 4.06.0 50.00% 10.0 900.00% 2022-09-20T11:17:43
425 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) (percentage) 0375 (no-change), 0377 (no-change) 1.671.5 -10.18% 0.43 -74.25% 2022-09-20T11:17:43
426 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) 0375 (no-change), 0377 (no-change) 97.0135.0 39.18% 47.0 -25.40% 2022-09-20T11:17:43
427 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 99.0137.0 38.38% None 0.00% 2022-09-20T11:17:43
428 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 0375 (no-change), 0377 (no-change) 81.076.0 -6.17% 96.0 92.00% 2022-09-20T11:17:43
429 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.220.17 -22.73% 0.19 -13.64% 2022-09-20T11:17:43
430 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) 0375 (no-change), 0377 (no-change) 27.031.0 14.81% 49.0 81.48% 2022-09-20T11:17:43
431 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex 0375 (no-change), 0377 (no-change) 18.014.0 -22.22% 15.0 -16.67% 2022-09-20T11:17:43
432 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 1.08.0 700.00% None 0.00% 2022-09-20T11:17:43
433 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk 0375 (no-change), 0377 (no-change) 18.016.0 -11.11% 53.0 103.85% 2022-09-20T11:17:43
434 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (max) (percentage) 0375 (no-change), 0377 (no-change) 0.540.73 35.19% 0.26 -23.53% 2022-09-20T11:17:43
435 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.090.07 -22.22% 0.18 100.00% 2022-09-20T11:17:43
436 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.230.2 -13.04% 0.31 82.35% 2022-09-20T11:17:43
437 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm 0375 (no-change), 0377 (no-change) 27.031.0 14.81% 49.0 81.48% 2022-09-20T11:17:43
438 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 21.020.0 -4.76% None 0.00% 2022-09-20T11:17:43
439 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray 0375 (no-change), 0377 (no-change) 20.019.0 -5.00% 22.0 10.00% 2022-09-20T11:17:43
440 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer 0375 (no-change), 0377 (no-change) 95.082.0 -13.68% 85.0 -19.81% 2022-09-20T11:17:43
441 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 14.020.0 42.86% None 0.00% 2022-09-20T11:17:43
442 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.540.44 -18.52% 1.54 1.32% 2022-09-20T11:17:43
443 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) (percentage) 0375 (no-change), 0377 (no-change) 1.040.95 -8.65% 0.36 -65.38% 2022-09-20T11:17:43
444 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) 0375 (no-change), 0377 (no-change) 28.025.0 -10.71% 12.0 -57.14% 2022-09-20T11:17:43
445 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 51.045.0 -11.76% 18.0 -48.57% 2022-09-20T11:17:43
446 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) 0375 (no-change), 0377 (no-change) 23.018.0 -21.74% 23.0 0.00% 2022-09-20T11:17:43
447 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 64.061.0 -4.69% 45.0 80.00% 2022-09-20T11:17:43
448 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) (percentage) 0375 (no-change), 0377 (no-change) 0.230.22 -4.35% 0.06 -73.91% 2022-09-20T11:17:43
449 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII 0375 (no-change), 0377 (no-change) 27.018.0 -33.33% 28.0 3.70% 2022-09-20T11:17:43
450 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 52.037.0 -28.85% 44.0 -15.38% 2022-09-20T11:17:43
451 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 13.011.0 -15.38% 6.0 -53.85% 2022-09-20T11:17:43
452 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 41.034.0 -17.07% 120.0 2.56% 2022-09-20T11:17:43
453 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) (percentage) 0375 (no-change), 0377 (no-change) 0.110.42 281.82% 0.28 250.00% 2022-09-20T11:17:43
454 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.20.17 -15.00% 0.84 320.00% 2022-09-20T11:17:43
455 llvm-arm-master-O2:733278613444249056 execution_variation 453.povray (max) (percentage) 0375 (no-change), 0377 (no-change) 0.620.56 -9.68% 0.27 -56.45% 2022-09-20T11:17:43
456 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar 0375 (no-change), 0377 (no-change) 7.06.0 -14.29% 11.0 57.14% 2022-09-20T11:17:43
457 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) 0375 (no-change), 0377 (no-change) 27.018.0 -33.33% 28.0 3.70% 2022-09-20T11:17:43
458 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) (percentage) 0375 (no-change), 0377 (no-change) 0.20.19 -5.00% 0.28 40.00% 2022-09-20T11:17:43
459 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (avg) 0375 (no-change), 0377 (no-change) 18.014.0 -22.22% 15.0 -16.67% 2022-09-20T11:17:43
460 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp 0375 (no-change), 0377 (no-change) 55.051.0 -7.27% 33.0 -29.79% 2022-09-20T11:17:43
461 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (max) 0375 (no-change), 0377 (no-change) 160.0143.0 -10.62% 42.0 -73.75% 2022-09-20T11:17:43
462 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (avg) 0375 (no-change), 0377 (no-change) 20.023.0 15.00% 19.0 -5.00% 2022-09-20T11:17:43
463 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng 0375 (no-change), 0377 (no-change) 81.068.0 -16.05% 92.0 13.58% 2022-09-20T11:17:43
464 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.070.09 28.57% 0.05 -54.55% 2022-09-20T11:17:43
465 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (max) 0375 (no-change), 0377 (no-change) 15.014.0 -6.67% 15.0 0.00% 2022-09-20T11:17:43
466 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.120.09 -25.00% 0.09 125.00% 2022-09-20T11:17:43
467 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (max) (percentage) 0375 (no-change), 0377 (no-change) 0.330.29 -12.12% 0.25 -24.24% 2022-09-20T11:17:43
468 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (avg) 0375 (no-change), 0377 (no-change) 8.06.0 -25.00% 17.0 112.50% 2022-09-20T11:17:43
469 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (max) 0375 (no-change), 0377 (no-change) 57.060.0 5.26% 46.0 -17.86% 2022-09-20T11:17:43
470 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.090.21 133.33% 0.22 214.29% 2022-09-20T11:17:43
471 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (avg) 0375 (no-change), 0377 (no-change) 13.010.0 -23.08% 10.0 150.00% 2022-09-20T11:17:43
472 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) 0375 (no-change), 0377 (no-change) 29.028.0 -3.45% 66.0 106.25% 2022-09-20T11:17:43
473 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.140.2 42.86% 0.05 -64.29% 2022-09-20T11:17:43
474 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (max) 0375 (no-change), 0377 (no-change) 151.0138.0 -8.61% 52.0 -65.56% 2022-09-20T11:17:43
475 llvm-arm-master-O2:733278613444249056 execution_variation 458.sjeng (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.360.25 -30.56% 0.3 -16.67% 2022-09-20T11:17:43
476 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (max) 0375 (no-change), 0377 (no-change) 12.046.0 283.33% 31.0 287.50% 2022-09-20T11:17:43
477 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.360.28 -22.22% 0.36 0.00% 2022-09-20T11:17:43
478 llvm-arm-master-O2:733278613444249056 execution_variation 471.omnetpp (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.870.84 -3.45% 0.61 79.41% 2022-09-20T11:17:43
479 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.120.18 50.00% None 0.00% 2022-09-20T11:17:43
480 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 12.046.0 283.33% None 0.00% 2022-09-20T11:17:43
481 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (avg) 0375 (no-change), 0377 (no-change) 7.06.0 -14.29% 11.0 57.14% 2022-09-20T11:17:43
482 llvm-arm-master-O2:733278613444249056 execution_variation 473.astar (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.040.06 50.00% 0.11 1000.00% 2022-09-20T11:17:43
483 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) (percentage) 0375 (no-change), 0377 (no-change) 0.770.72 -6.49% 0.68 -11.69% 2022-09-20T11:17:43
484 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.020.15 650.00% None 0.00% 2022-09-20T11:17:43
485 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (avg) 0375 (no-change), 0377 (no-change) 95.082.0 -13.68% 85.0 -19.81% 2022-09-20T11:17:43
486 llvm-arm-master-O2:733278613444249056 execution_variation 403.gcc (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 13.011.0 -15.38% 55.0 323.08% 2022-09-20T11:17:43
487 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.340.3 -11.76% 0.92 95.74% 2022-09-20T11:17:43
488 llvm-arm-master-O2:733278613444249056 execution_variation 450.soplex (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.050.04 -20.00% None 0.00% 2022-09-20T11:17:43
489 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (avg) 0375 (no-change), 0377 (no-change) 18.016.0 -11.11% 53.0 103.85% 2022-09-20T11:17:43
490 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (unexplained diff vs previous) 0375 (no-change), 0377 (no-change) 8.07.0 -12.50% None 0.00% 2022-09-20T11:17:43
491 llvm-arm-master-O2:733278613444249056 execution_variation 483.xalancbmk (max) (percentage) 0375 (no-change), 0377 (no-change) 0.50.51 2.00% 1.14 96.55% 2022-09-20T11:17:43
492 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.520.36 -30.77% 0.55 5.77% 2022-09-20T11:17:43
493 llvm-arm-master-O2:733278613444249056 execution_variation 433.milc (max) 0375 (no-change), 0377 (no-change) 13.011.0 -15.38% 9.0 -30.77% 2022-09-20T11:17:43
494 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 (max) (percentage) 0375 (no-change), 0377 (no-change) 0.120.18 50.00% 0.09 0.00% 2022-09-20T11:17:43
495 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.370.41 10.81% 0.53 96.30% 2022-09-20T11:17:43
496 llvm-arm-master-O2:733278613444249056 execution_variation 456.hmmer (max) 0375 (no-change), 0377 (no-change) 142.0135.0 -4.93% 126.0 -11.27% 2022-09-20T11:17:43
497 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.130.14 7.69% 0.25 0.00% 2022-09-20T11:17:43
498 llvm-arm-master-O2:733278613444249056 execution_variation 482.sphinx3 (avg) 0375 (no-change), 0377 (no-change) 81.076.0 -6.17% 96.0 92.00% 2022-09-20T11:17:43
499 llvm-arm-master-O2:733278613444249056 execution_variation 429.mcf (max) 0375 (no-change), 0377 (no-change) 9.010.0 11.11% 10.0 -9.09% 2022-09-20T11:17:43
500 llvm-arm-master-O2:733278613444249056 execution_variation 464.h264ref (avg) (percentage) 0375 (no-change), 0377 (no-change) 0.590.48 -18.64% 0.62 5.08% 2022-09-20T11:17:43
501 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (avg) 0375 (no-change), 0377 (no-change) 9.023.0 155.56% 24.0 242.86% 2022-09-20T11:17:43
502 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum 0375 (no-change), 0377 (no-change) 20.023.0 15.00% 19.0 -5.00% 2022-09-20T11:17:43
503 llvm-arm-master-O2:733278613444249056 execution_variation 470.lbm (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.320.28 -12.50% 0.11 -50.00% 2022-09-20T11:17:43
504 llvm-arm-master-O2:733278613444249056 execution_variation 445.gobmk (unexplained diff vs previous) (percentage) 0375 (no-change), 0377 (no-change) 0.110.42 281.82% None 0.00% 2022-09-20T11:17:43
505 llvm-arm-master-O2:733278613444249056 execution_variation 447.dealII (max) 0375 (no-change), 0377 (no-change) 40.037.0 -7.50% 35.0 -12.50% 2022-09-20T11:17:43
506 llvm-arm-master-O2:733278613444249056 execution_variation 444.namd (max) 0375 (no-change), 0377 (no-change) 19.018.0 -5.26% 27.0 42.11% 2022-09-20T11:17:43
507 llvm-arm-master-O2:733278613444249056 execution_variation 462.libquantum (max) 0375 (no-change), 0377 (no-change) 33.032.0 -3.03% 8.0 -75.76% 2022-09-20T11:17:43
508 llvm-arm-master-O2:733278613444249056 execution_variation 401.bzip2 0375 (no-change), 0377 (no-change) 13.010.0 -23.08% 10.0 150.00% 2022-09-20T11:17:43
Change State Split Delete