Regression: Regression of 73 benchmarks: 500.perlbench_r, 500.perlbench_r (avg), 500.perlbench_r (avg) (percentage), 500.perlbench_r...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
523 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 29.028.0 -3.45% 17.0 -15.00% 2023-09-12T18:33:26
524 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.241.44 16.13% 0.24 -80.65% 2023-09-12T18:33:26
525 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 14.019.0 35.71% 17.0 21.43% 2023-09-12T18:33:26
526 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 146.0135.0 -7.53% 69.0 -52.74% 2023-09-12T18:33:26
527 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 34.033.0 -2.94% 20.0 -41.18% 2023-09-12T18:33:26
528 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.51.33 -11.33% 0.55 223.53% 2023-09-12T18:33:26
529 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 12.011.0 -8.33% 8.0 -33.33% 2023-09-12T18:33:26
530 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 8.07.0 -12.50% 11.0 22.22% 2023-09-12T18:33:26
531 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 5.06.0 20.00% 1.0 -85.71% 2023-09-12T18:33:26
532 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.250.2 -20.00% 0.0 0.00% 2023-09-12T18:33:26
533 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 15.016.0 6.67% 19.0 26.67% 2023-09-12T18:33:26
534 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 4.534.31 -4.86% 2.43 -49.27% 2023-09-12T18:33:26
535 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 3.373.3 -2.08% 4.81 55.66% 2023-09-12T18:33:26
536 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.811.16 43.21% 0.44 -34.33% 2023-09-12T18:33:26
537 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 23.032.0 39.13% 11.0 -42.11% 2023-09-12T18:33:26
538 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 2.121.94 -8.49% 0.42 -80.19% 2023-09-12T18:33:26
539 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 53.047.0 -11.32% 19.0 216.67% 2023-09-12T18:33:26
540 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.160.17 6.25% 0.1 -37.50% 2023-09-12T18:33:26
541 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 23.033.0 43.48% 12.0 9.09% 2023-09-12T18:33:26
542 llvm-aarch64-master-O3:239801545695209356 execution_variation 519.lbm_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.050.04 -20.00% 0.05 0.00% 2023-09-12T18:33:26
543 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 27.030.0 11.11% 14.0 -41.67% 2023-09-12T18:33:26
544 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 14.016.0 14.29% 10.0 -16.67% 2023-09-12T18:33:26
545 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 4.574.41 -3.50% 2.38 -47.92% 2023-09-12T18:33:26
546 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.560.69 23.21% 0.54 45.95% 2023-09-12T18:33:26
547 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.850.8 -5.88% 0.51 -12.07% 2023-09-12T18:33:26
548 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 42.048.0 14.29% 8.0 -80.95% 2023-09-12T18:33:26
549 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 46.036.0 -21.74% 2.0 -95.65% 2023-09-12T18:33:26
550 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.360.41 13.89% 0.33 0.00% 2023-09-12T18:33:26
551 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 17.021.0 23.53% 16.0 45.45% 2023-09-12T18:33:26
552 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 19.021.0 10.53% 11.0 -52.17% 2023-09-12T18:33:26
553 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 14.016.0 14.29% 10.0 -16.67% 2023-09-12T18:33:26
554 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 6.04.0 -33.33% 2.0 0.00% 2023-09-12T18:33:26
555 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.261.42 12.70% 0.98 -22.22% 2023-09-12T18:33:26
556 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 22.026.0 18.18% 11.0 -47.62% 2023-09-12T18:33:26
557 llvm-aarch64-master-O3:239801545695209356 execution_variation 520.omnetpp_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 138.0131.0 -5.07% 70.0 -54.25% 2023-09-12T18:33:26
558 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 22.026.0 18.18% 11.0 -47.62% 2023-09-12T18:33:26
559 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.20.14 -30.00% 0.07 0.00% 2023-09-12T18:33:26
560 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 12.011.0 -8.33% 8.0 -33.33% 2023-09-12T18:33:26
561 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.420.41 -2.38% 0.59 31.11% 2023-09-12T18:33:26
562 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 18.022.0 22.22% 17.0 41.67% 2023-09-12T18:33:26
563 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.751.03 37.33% 0.77 2.67% 2023-09-12T18:33:26
564 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.061.21 14.15% 0.55 -46.60% 2023-09-12T18:33:26
565 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 14.013.0 -7.14% 10.0 0.00% 2023-09-12T18:33:26
566 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 24.063.0 162.50% None 0.00% 2023-09-12T18:33:26
567 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 14.013.0 -7.14% 10.0 0.00% 2023-09-12T18:33:26
568 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 11.010.0 -9.09% 1.0 -90.91% 2023-09-12T18:33:26
569 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 24.053.0 120.83% 8.0 -66.67% 2023-09-12T18:33:26
570 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.850.87 2.35% 0.87 4.82% 2023-09-12T18:33:26
571 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.831.79 -2.19% 0.95 -48.09% 2023-09-12T18:33:26
572 llvm-aarch64-master-O3:239801545695209356 execution_variation 511.povray_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 29.028.0 -3.45% 17.0 -15.00% 2023-09-12T18:33:26
573 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 24.061.0 154.17% 9.0 -43.75% 2023-09-12T18:33:26
574 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.350.32 -8.57% 0.23 -36.11% 2023-09-12T18:33:26
575 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.233.29 167.48% None 0.00% 2023-09-12T18:33:26
576 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.510.57 11.76% 0.39 -13.33% 2023-09-12T18:33:26
577 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.150.18 20.00% 0.03 -85.71% 2023-09-12T18:33:26
578 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.820.93 13.41% 0.44 -38.89% 2023-09-12T18:33:26
579 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 2.171.67 -23.04% 0.09 -95.85% 2023-09-12T18:33:26
580 llvm-aarch64-master-O3:239801545695209356 execution_variation 557.xz_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.210.19 -9.52% 0.3 25.00% 2023-09-12T18:33:26
581 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (avg) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.252.77 121.60% 0.45 -64.00% 2023-09-12T18:33:26
582 llvm-aarch64-master-O3:239801545695209356 execution_variation 544.nab_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 15.016.0 6.67% 19.0 26.67% 2023-09-12T18:33:26
583 llvm-aarch64-master-O3:239801545695209356 execution_variation 508.namd_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.20.19 -5.00% 0.55 175.00% 2023-09-12T18:33:26
584 llvm-aarch64-master-O3:239801545695209356 execution_variation 525.x264_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.460.4 -13.04% 0.69 50.00% 2023-09-12T18:33:26
585 llvm-aarch64-master-O3:239801545695209356 execution_variation 526.blender_r (unexplained diff vs previous) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 3.04.0 33.33% 0.0 0.00% 2023-09-12T18:33:26
586 llvm-aarch64-master-O3:239801545695209356 execution_variation 505.mcf_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.811.17 44.44% 0.45 15.38% 2023-09-12T18:33:26
587 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 42.047.0 11.90% 32.0 -23.81% 2023-09-12T18:33:26
588 llvm-aarch64-master-O3:239801545695209356 execution_variation 541.leela_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.650.61 -6.15% 0.34 -47.69% 2023-09-12T18:33:26
589 llvm-aarch64-master-O3:239801545695209356 execution_variation 500.perlbench_r (avg) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 27.030.0 11.11% 14.0 -41.67% 2023-09-12T18:33:26
590 llvm-aarch64-master-O3:239801545695209356 execution_variation 510.parest_r (unexplained diff vs previous) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.560.69 23.21% 0.55 48.65% 2023-09-12T18:33:26
591 llvm-aarch64-master-O3:239801545695209356 execution_variation 523.xalancbmk_r (max) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 44.041.0 -6.82% 8.0 -81.82% 2023-09-12T18:33:26
592 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 24.053.0 120.83% 8.0 -66.67% 2023-09-12T18:33:26
593 llvm-aarch64-master-O3:239801545695209356 execution_variation 502.gcc_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 1.253.19 155.20% 0.49 -39.51% 2023-09-12T18:33:26
594 llvm-aarch64-master-O3:239801545695209356 execution_variation 531.deepsjeng_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.380.37 -2.63% 0.07 -81.58% 2023-09-12T18:33:26
595 llvm-aarch64-master-O3:239801545695209356 execution_variation 538.imagick_r (max) (percentage) 0039 (llvmorg-18-init-05401-g2e106d55203a), 0041 (llvmorg-18-init-05608-g1dae4dd0d80f) 0.20.19 -5.00% 0.15 -28.57% 2023-09-12T18:33:26
Change State Split Delete