Regression: Regression of 21 benchmarks: 401.bzip2, 401.bzip2 (avg), 401.bzip2 (avg) (percentage), 401.bzip2 (max), 401.bzip2 (max) ...



Metric
Order
Δ ID Machine Metric Test Good, Bad OldNew Now Current Age
5343 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 4.016.0 300.00% 31.0 675.00% 2023-10-28T23:41:40
5344 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 4.03.0 -25.00% 22.0 2100.00% 2023-10-28T23:41:40
5345 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.030.06 100.00% 0.83 2666.67% 2023-10-28T23:41:40
5346 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (unexplained diff vs previous) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 5.06.0 20.00% 52.0 0.00% 2023-10-28T23:41:40
5347 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (avg) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.050.04 -20.00% 0.23 1050.00% 2023-10-28T23:41:40
5348 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 4.03.0 -25.00% 22.0 2100.00% 2023-10-28T23:41:40
5349 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (avg) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.030.11 266.67% 0.27 800.00% 2023-10-28T23:41:40
5350 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 6.024.0 300.00% 51.0 0.00% 2023-10-28T23:41:40
5351 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (avg) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 3.06.0 100.00% 94.0 3033.33% 2023-10-28T23:41:40
5352 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (unexplained diff vs previous) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.040.16 300.00% 0.43 0.00% 2023-10-28T23:41:40
5353 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.030.07 133.33% 0.65 3150.00% 2023-10-28T23:41:40
5354 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 127.0119.0 -6.30% 136.0 7.09% 2023-10-28T23:41:40
5355 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 3.08.0 166.67% 74.0 0.00% 2023-10-28T23:41:40
5356 llvm-arm-master-O3:39854125689749889 execution_variation 458.sjeng (max) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.910.85 -6.59% 0.97 6.59% 2023-10-28T23:41:40
5357 llvm-arm-master-O3:39854125689749889 execution_variation 429.mcf (max) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 4.05.0 25.00% 52.0 1633.33% 2023-10-28T23:41:40
5358 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (max) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 3.07.0 133.33% 73.0 3550.00% 2023-10-28T23:41:40
5359 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.040.16 300.00% 0.43 1333.33% 2023-10-28T23:41:40
5360 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 (unexplained diff vs previous) (percentage) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 0.030.07 133.33% 0.65 0.00% 2023-10-28T23:41:40
5361 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 4.016.0 300.00% 31.0 675.00% 2023-10-28T23:41:40
5362 llvm-arm-master-O3:39854125689749889 execution_variation 462.libquantum (max) 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 5.023.0 360.00% 50.0 1150.00% 2023-10-28T23:41:40
5363 llvm-arm-master-O3:39854125689749889 execution_variation 401.bzip2 0083 (llvmorg-18-init-09823-g6ca5b814f331), 0084 (llvmorg-18-init-10553-g063e3fe64853) 3.06.0 100.00% 94.0 3033.33% 2023-10-28T23:41:40
Change State Split Delete