Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/483c3364fe914280536b1ea0591bac4ba5f6c5de (unchanged)
test_url https://ci.linaro.org/job/tcwg_bmk-code_vect-spec2k6--llvm-aarch64-master-O3-build/139/
Filter

llvm-aarch64-master-O3 test results

Run Order Start Time Duration
Current 0139 (no-change) 2024-03-10T22:31:17 0:00:00
Previous 0136 (no-change) 2024-03-10T09:47:13 0:00:00
Baseline 0001 (llvmorg-17-init-04177-g4eb1f1fab35d) 2023-03-08T09:39:21 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 162 14
Performance Improvements 7 12
Added Tests 4 141
Unchanged Tests 871 877
Total Tests 1044

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
437.leslie3d 17.79% 6210.000 7315.000 - 0.00% -
471.omnetpp 10.65% 2525.000 2794.000 - 6.89% -
483.xalancbmk 9.89% 3500.000 3846.000 - 7.67% -
410.bwaves 7.81% 4713.000 5081.000 - 0.00% -
401.bzip2 6.28% 2676.000 2844.000 - 13.71% -
482.sphinx3 5.94% 707.000 749.000 - 11.46% -
447.dealII 5.36% 1268.000 1336.000 - 9.51% -
450.soplex 5.26% 551.000 580.000 - 8.21% -
403.gcc 5.17% 58.000 61.000 - -4.69% -
462.libquantum 5.00% 80.000 84.000 - -20.75% -
434.zeusmp 4.79% 1922.000 2014.000 - 0.00% -
473.astar 4.47% 5118.000 5347.000 - 9.91% -
400.perlbench 4.12% 1674.000 1743.000 - 4.75% -
464.h264ref 4.12% 3906.000 4067.000 - 0.77% -
459.GemsFDTD 4.12% 5125.000 5336.000 - 0.00% -
445.gobmk 2.92% 4936.000 5080.000 - 3.95% -
470.lbm 2.83% 3322.000 3416.000 - 5.14% -
444.namd 2.80% 678.000 697.000 - 5.29% -
458.sjeng 2.58% 6622.000 6793.000 - 0.61% -
453.povray 2.06% 436.000 445.000 - -4.30% -
456.hmmer 2.06% 2723.000 2779.000 - 5.31% -
433.milc 1.39% 1219.000 1236.000 - 3.17% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
471.omnetpp (unexplained diff vs previous) 13350.00% 2.000 269.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 11937.50% 0.080 9.630 - 0.00% -
410.bwaves (unexplained diff vs previous) 5157.14% 7.000 368.000 - 0.00% -
410.bwaves (unexplained diff vs previous) (percentage) 4726.67% 0.150 7.240 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) 4613.79% 0.290 13.670 - 0.00% -
429.mcf (unexplained diff vs previous) 4016.67% 6.000 247.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) 2966.67% 3.000 92.000 - 0.00% -
473.astar (unexplained diff vs previous) 2762.50% 8.000 229.000 - 0.00% -
434.zeusmp (unexplained diff vs previous) (percentage) 2756.25% 0.160 4.570 - 0.00% -
473.astar (unexplained diff vs previous) (percentage) 2575.00% 0.160 4.280 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) 2537.50% 8.000 211.000 - 0.00% -
459.GemsFDTD (unexplained diff vs previous) (percentage) 2368.75% 0.160 3.950 - 0.00% -
464.h264ref (unexplained diff vs previous) 1688.89% 9.000 161.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 1621.74% 0.230 3.960 - 0.00% -
434.zeusmp (max) 1271.43% 7.000 96.000 - 0.00% -
434.zeusmp (max) (percentage) 1128.21% 0.390 4.790 - 0.00% -
459.GemsFDTD (max) 1052.63% 19.000 219.000 - 0.00% -
459.GemsFDTD (max) (percentage) 956.41% 0.390 4.120 - 0.00% -
447.dealII (unexplained diff vs previous) 871.43% 7.000 68.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 825.45% 0.550 5.090 - 0.00% -
453.povray (unexplained diff vs previous) 800.00% 1.000 9.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 778.26% 0.230 2.020 - 0.00% -
401.bzip2 (unexplained diff vs previous) 740.00% 20.000 168.000 - 0.00% -
456.hmmer (max) 714.29% 7.000 57.000 - 0.00% -
401.bzip2 (unexplained diff vs previous) (percentage) 688.00% 0.750 5.910 - 0.00% -
471.omnetpp (max) 681.58% 38.000 297.000 - 0.00% -
401.bzip2 (max) 641.67% 24.000 178.000 - 0.00% -
456.hmmer (max) (percentage) 610.34% 0.290 2.060 - 0.00% -
471.omnetpp (max) (percentage) 600.66% 1.520 10.650 - 0.00% -
456.hmmer (unexplained diff vs previous) 600.00% 8.000 56.000 - 0.00% -
401.bzip2 (max) (percentage) 597.78% 0.900 6.280 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 596.55% 0.290 2.020 - 0.00% -
444.namd (unexplained diff vs previous) 533.33% 3.000 19.000 - 0.00% -
444.namd (unexplained diff vs previous) (percentage) 520.45% 0.440 2.730 - 0.00% -
458.sjeng (unexplained diff vs previous) 434.38% 32.000 171.000 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) 425.00% 0.480 2.520 - 0.00% -
410.bwaves (max) 382.93% 82.000 396.000 - 0.00% -
410.bwaves (max) (percentage) 343.75% 1.760 7.810 - 0.00% -
473.astar (max) 334.55% 55.000 239.000 - 0.00% -
473.astar (max) (percentage) 310.09% 1.090 4.470 - 0.00% -
462.libquantum (max) 300.00% 1.000 4.000 - 0.00% -
462.libquantum (unexplained diff vs previous) 300.00% 1.000 4.000 - 0.00% -
429.mcf (max) (percentage) 291.86% 3.070 12.030 - 0.00% -
482.sphinx3 (unexplained diff vs previous) 281.82% 11.000 42.000 - 0.00% -
462.libquantum (unexplained diff vs previous) (percentage) 280.80% 1.250 4.760 - 0.00% -
482.sphinx3 (unexplained diff vs previous) (percentage) 259.62% 1.560 5.610 - 0.00% -
429.mcf (max) 244.44% 63.000 217.000 - 0.00% -
464.h264ref (max) 240.82% 49.000 167.000 - 0.00% -
464.h264ref (max) (percentage) 224.41% 1.270 4.120 - 0.00% -
458.sjeng (max) 207.02% 57.000 175.000 - 0.00% -
458.sjeng (max) (percentage) 196.55% 0.870 2.580 - 0.00% -
437.leslie3d (max) 180.99% 463.000 1301.000 - 0.00% -
470.lbm (max) 159.46% 37.000 96.000 - 0.00% -
445.gobmk (max) 155.17% 58.000 148.000 - 0.00% -
470.lbm (unexplained diff vs previous) 154.05% 37.000 94.000 - 0.00% -
470.lbm (max) (percentage) 150.44% 1.130 2.830 - 0.00% -
445.gobmk (unexplained diff vs previous) 148.28% 58.000 144.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) 147.75% 1.110 2.750 - 0.00% -
445.gobmk (max) (percentage) 145.38% 1.190 2.920 - 0.00% -
433.milc (unexplained diff vs previous) 142.86% 7.000 17.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) 142.11% 0.570 1.380 - 0.00% -
445.gobmk (unexplained diff vs previous) (percentage) 139.83% 1.180 2.830 - 0.00% -
437.leslie3d (max) (percentage) 138.15% 7.470 17.790 - 0.00% -
462.libquantum (max) (percentage) 130.41% 2.170 5.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) 120.56% 501.000 1105.000 - 0.00% -
450.soplex (unexplained diff vs previous) 107.14% 14.000 29.000 - 0.00% -
450.soplex (unexplained diff vs previous) (percentage) 96.85% 2.540 5.000 - 0.00% -
437.leslie3d (unexplained diff vs previous) (percentage) 87.24% 8.070 15.110 - 0.00% -
447.dealII (max) 82.05% 39.000 71.000 - 0.00% -
453.povray (max) 80.00% 5.000 9.000 - 0.00% -
453.povray (max) (percentage) 74.58% 1.180 2.060 - 0.00% -
447.dealII (max) (percentage) 72.35% 3.110 5.360 - 0.00% -
444.namd (max) 46.15% 13.000 19.000 - 0.00% -
444.namd (max) (percentage) 44.33% 1.940 2.800 - 0.00% -
437.leslie3d 42.86% 266.000 380.000 - 0.00% -
437.leslie3d (avg) 42.86% 266.000 380.000 - 0.00% -
434.zeusmp 40.00% 15.000 21.000 - 0.00% -
434.zeusmp (avg) 40.00% 15.000 21.000 - 0.00% -
410.bwaves 38.18% 55.000 76.000 - 0.00% -
410.bwaves (avg) 38.18% 55.000 76.000 - 0.00% -
459.GemsFDTD 33.33% 45.000 60.000 - 0.00% -
459.GemsFDTD (avg) 33.33% 45.000 60.000 - 0.00% -
482.sphinx3 (max) 33.33% 33.000 44.000 - 0.00% -
434.zeusmp (avg) (percentage) 31.71% 0.820 1.080 - 0.00% -
410.bwaves (avg) (percentage) 27.97% 1.180 1.510 - 0.00% -
459.GemsFDTD (avg) (percentage) 26.97% 0.890 1.130 - 0.00% -
482.sphinx3 (max) (percentage) 26.38% 4.700 5.940 - 0.00% -
471.omnetpp 25.45% 55.000 69.000 - 0.00% -
471.omnetpp (avg) 25.45% 55.000 69.000 - 0.00% -
464.h264ref 23.33% 30.000 37.000 - 0.00% -
464.h264ref (avg) 23.33% 30.000 37.000 - 0.00% -
401.bzip2 23.08% 39.000 48.000 - 0.00% -
401.bzip2 (avg) 23.08% 39.000 48.000 - 0.00% -
456.hmmer 22.22% 9.000 11.000 - 0.00% -
456.hmmer (avg) 22.22% 9.000 11.000 - 0.00% -
437.leslie3d (avg) (percentage) 21.21% 4.290 5.200 - 0.00% -
464.h264ref (avg) (percentage) 20.78% 0.770 0.930 - 0.00% -
445.gobmk 17.50% 40.000 47.000 - 0.00% -
445.gobmk (avg) 17.50% 40.000 47.000 - 0.00% -
456.hmmer (avg) (percentage) 17.14% 0.350 0.410 - 0.00% -
458.sjeng 16.67% 36.000 42.000 - 0.00% -
458.sjeng (avg) 16.67% 36.000 42.000 - 0.00% -
447.dealII 16.00% 25.000 29.000 - 0.00% -
447.dealII (avg) 16.00% 25.000 29.000 - 0.00% -
483.xalancbmk 15.94% 69.000 80.000 - 0.00% -
483.xalancbmk (avg) 15.94% 69.000 80.000 - 0.00% -
458.sjeng (avg) (percentage) 14.55% 0.550 0.630 - 0.00% -
444.namd 14.29% 7.000 8.000 - 0.00% -
444.namd (avg) 14.29% 7.000 8.000 - 0.00% -
401.bzip2 (avg) (percentage) 14.19% 1.480 1.690 - 0.00% -
471.omnetpp (avg) (percentage) 13.76% 2.180 2.480 - 0.00% -
445.gobmk (avg) (percentage) 13.25% 0.830 0.940 - 0.00% -
450.soplex 12.50% 16.000 18.000 - 0.00% -
450.soplex (avg) 12.50% 16.000 18.000 - 0.00% -
483.xalancbmk (max) 11.83% 169.000 189.000 - 0.00% -
473.astar 11.69% 77.000 86.000 - 0.00% -
473.astar (avg) 11.69% 77.000 86.000 - 0.00% -
450.soplex (max) 11.11% 27.000 30.000 - 0.00% -
482.sphinx3 11.11% 18.000 20.000 - 0.00% -
482.sphinx3 (avg) 11.11% 18.000 20.000 - 0.00% -
447.dealII (avg) (percentage) 10.50% 2.000 2.210 - 0.00% -
470.lbm 10.34% 29.000 32.000 - 0.00% -
470.lbm (avg) 10.34% 29.000 32.000 - 0.00% -
462.libquantum (avg) (percentage) 8.33% 1.440 1.560 - 0.00% -
429.mcf (avg) (percentage) 7.94% 3.400 3.670 - 0.00% -
444.namd (avg) (percentage) 7.41% 1.080 1.160 - 0.00% -
470.lbm (avg) (percentage) 6.82% 0.880 0.940 - 0.00% -
473.astar (avg) (percentage) 6.62% 1.510 1.610 - 0.00% -
433.milc (max) 6.25% 16.000 17.000 - 0.00% -
483.xalancbmk (avg) (percentage) 6.06% 1.980 2.100 - 0.00% -
482.sphinx3 (avg) (percentage) 5.68% 2.640 2.790 - 0.00% -
433.milc (max) (percentage) 5.30% 1.320 1.390 - 0.00% -
400.perlbench 5.26% 19.000 20.000 - 0.00% -
400.perlbench (avg) 5.26% 19.000 20.000 - 0.00% -
400.perlbench (max) 5.26% 19.000 20.000 - 0.00% -
450.soplex (max) (percentage) 3.95% 5.060 5.260 - 0.00% -
450.soplex (avg) (percentage) 2.92% 3.080 3.170 - 0.00% -
483.xalancbmk (max) (percentage) 1.86% 4.850 4.940 - 0.00% -
453.povray (avg) (percentage) 1.30% 1.540 1.560 - 0.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -5.56% 36.000 34.000 - 17.24% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -12.03% 2054.000 1807.000 - -5.19% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
403.gcc (max) (percentage) -9.11% 10.870 9.880 - 0.00% -
403.gcc (avg) (percentage) -6.20% 5.320 4.990 - 0.00% -
429.mcf -4.35% 69.000 66.000 - 0.00% -
429.mcf (avg) -4.35% 69.000 66.000 - 0.00% -
435.gromacs (max) (percentage) -1.43% 0.700 0.690 - 0.00% -
436.cactusADM (max) (percentage) -1.33% 0.750 0.740 - 0.00% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
447.dealII 1.90% 3240486.000 3301938.000 - 0.00% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 13.71% 2501.000 2844.000 - 6.28% -
482.sphinx3 11.46% 672.000 749.000 - 5.94% -
473.astar 9.91% 4865.000 5347.000 - 4.47% -
447.dealII 9.51% 1220.000 1336.000 - 5.36% -
450.soplex 8.21% 536.000 580.000 - 5.26% -
483.xalancbmk 7.67% 3572.000 3846.000 - 9.89% -
471.omnetpp 6.89% 2614.000 2794.000 - 10.65% -
456.hmmer 5.31% 2639.000 2779.000 - 2.06% -
444.namd 5.29% 662.000 697.000 - 2.80% -
470.lbm 5.14% 3249.000 3416.000 - 2.83% -
400.perlbench 4.75% 1664.000 1743.000 - 4.12% -
445.gobmk 3.95% 4887.000 5080.000 - 2.92% -
433.milc 3.17% 1198.000 1236.000 - 1.39% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.04% 42589.000 40442.000 - 0.00% -
444.namd -2.57% 212450.000 206981.000 - 0.00% -
458.sjeng -2.00% 146102.000 143174.000 - 0.00% -
464.h264ref -1.69% 749591.000 736915.000 - 0.00% -
450.soplex -1.17% 370392.000 366062.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -20.75% 106.000 84.000 - 5.00% -
429.mcf -5.19% 1906.000 1807.000 - -12.03% -
403.gcc -4.69% 64.000 61.000 - 5.17% -
453.povray -4.30% 465.000 445.000 - 2.06% -

Performance Improvements - Score Δ (B) Baseline Current σ (B) Δ σ
nb_compile_successful 26.32% 19.000 24.000 - 0.00% -
nb_execution_successful 26.32% 19.000 24.000 - 0.00% -
nb_total_tests 17.24% 29.000 34.000 - -5.56% -

Added Tests - Code Size
410.bwaves
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto

Added Tests - Execution
410.bwaves
434.zeusmp
437.leslie3d
459.GemsFDTD
465.tonto

Added Tests - sample variability
400.perlbench
400.perlbench (avg)
400.perlbench (avg) (percentage)
400.perlbench (max)
400.perlbench (max) (percentage)
401.bzip2
401.bzip2 (avg)
401.bzip2 (avg) (percentage)
401.bzip2 (max)
401.bzip2 (max) (percentage)
403.gcc
403.gcc (avg)
403.gcc (avg) (percentage)
403.gcc (max)
403.gcc (max) (percentage)
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
410.bwaves
410.bwaves (avg)
410.bwaves (avg) (percentage)
410.bwaves (max)
410.bwaves (max) (percentage)
410.bwaves (unexplained diff vs previous)
410.bwaves (unexplained diff vs previous) (percentage)
429.mcf
429.mcf (avg)
429.mcf (avg) (percentage)
429.mcf (max)
429.mcf (max) (percentage)
433.milc
433.milc (avg)
433.milc (avg) (percentage)
433.milc (max)
433.milc (max) (percentage)
434.zeusmp
434.zeusmp (avg)
434.zeusmp (avg) (percentage)
434.zeusmp (max)
434.zeusmp (max) (percentage)
434.zeusmp (unexplained diff vs previous)
434.zeusmp (unexplained diff vs previous) (percentage)
435.gromacs (avg) (percentage)
435.gromacs (max) (percentage)
436.cactusADM (avg) (percentage)
436.cactusADM (max) (percentage)
437.leslie3d
437.leslie3d (avg)
437.leslie3d (avg) (percentage)
437.leslie3d (max)
437.leslie3d (max) (percentage)
437.leslie3d (unexplained diff vs previous)
437.leslie3d (unexplained diff vs previous) (percentage)
444.namd
444.namd (avg)
444.namd (avg) (percentage)
444.namd (max)
444.namd (max) (percentage)
445.gobmk
445.gobmk (avg)
445.gobmk (avg) (percentage)
445.gobmk (max)
445.gobmk (max) (percentage)
447.dealII
447.dealII (avg)
447.dealII (avg) (percentage)
447.dealII (max)
447.dealII (max) (percentage)
450.soplex
450.soplex (avg)
450.soplex (avg) (percentage)
450.soplex (max)
450.soplex (max) (percentage)
453.povray
453.povray (avg)
453.povray (avg) (percentage)
453.povray (max)
453.povray (max) (percentage)
456.hmmer
456.hmmer (avg)
456.hmmer (avg) (percentage)
456.hmmer (max)
456.hmmer (max) (percentage)
458.sjeng
458.sjeng (avg)
458.sjeng (avg) (percentage)
458.sjeng (max)
458.sjeng (max) (percentage)
459.GemsFDTD
459.GemsFDTD (avg)
459.GemsFDTD (avg) (percentage)
459.GemsFDTD (max)
459.GemsFDTD (max) (percentage)
459.GemsFDTD (unexplained diff vs previous)
459.GemsFDTD (unexplained diff vs previous) (percentage)
462.libquantum
462.libquantum (avg)
462.libquantum (avg) (percentage)
462.libquantum (max)
462.libquantum (max) (percentage)
464.h264ref
464.h264ref (avg)
464.h264ref (avg) (percentage)
464.h264ref (max)
464.h264ref (max) (percentage)
470.lbm
470.lbm (avg)
470.lbm (avg) (percentage)
470.lbm (max)
470.lbm (max) (percentage)
471.omnetpp
471.omnetpp (avg)
471.omnetpp (avg) (percentage)
471.omnetpp (max)
471.omnetpp (max) (percentage)
473.astar
473.astar (avg)
473.astar (avg) (percentage)
473.astar (max)
473.astar (max) (percentage)
482.sphinx3
482.sphinx3 (avg)
482.sphinx3 (avg) (percentage)
482.sphinx3 (max)
482.sphinx3 (max) (percentage)
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (avg) (percentage)
483.xalancbmk (max)
483.xalancbmk (max) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)


Report Time: 0.41s
Name Current %
400.perlbench 1743.000 4.12%
401.bzip2 2844.000 6.28%
403.gcc 61.000 5.17%
410.bwaves 5081.000 7.81%
429.mcf 1807.000 -12.03%
433.milc 1236.000 1.39%
434.zeusmp 2014.000 4.79%
437.leslie3d 7315.000 17.79%
444.namd 697.000 2.80%
445.gobmk 5080.000 2.92%
447.dealII 1336.000 5.36%
450.soplex 580.000 5.26%
453.povray 445.000 2.06%
456.hmmer 2779.000 2.06%
458.sjeng 6793.000 2.58%
459.GemsFDTD 5336.000 4.12%
462.libquantum 84.000 5.00%
464.h264ref 4067.000 4.12%
465.tonto 20141.000 -
470.lbm 3416.000 2.83%
471.omnetpp 2794.000 10.65%
473.astar 5347.000 4.47%
482.sphinx3 749.000 5.94%
483.xalancbmk 3846.000 9.89%
Geometric Mean 1919.883 4.27%
Name Current %
400.perlbench 1186174.000 -
401.bzip2 76454.000 -
403.gcc 3432007.000 -
410.bwaves 616115.000 -
429.mcf 13267.000 -
433.milc 137296.000 -
434.zeusmp 1018524.000 -
437.leslie3d 934787.000 -
444.namd 206981.000 -
445.gobmk 2113289.000 -
447.dealII 3301938.000 -
450.soplex 366062.000 -
453.povray 962254.000 -
456.hmmer 300740.000 -
458.sjeng 143174.000 -
459.GemsFDTD 1274231.000 -
462.libquantum 40442.000 -
464.h264ref 736915.000 -
465.tonto 10931333.000 -
470.lbm 12117.000 -
471.omnetpp 680042.000 -
473.astar 42000.000 -
482.sphinx3 196745.000 -
483.xalancbmk 4310936.000 -
Geometric Mean 419608.307 -
Name Current %
nb_compile_successful 24.000 -
nb_execution_successful 24.000 -
nb_total_tests 34.000 -5.56%
Geometric Mean 26.955 -1.89%
Name Current %
400.perlbench 20.000 5.26%
400.perlbench (avg) 20.000 5.26%
400.perlbench (avg) (percentage) 1.160 -
400.perlbench (max) 20.000 5.26%
400.perlbench (max) (percentage) 1.180 -
401.bzip2 48.000 23.08%
401.bzip2 (avg) 48.000 23.08%
401.bzip2 (avg) (percentage) 1.690 14.19%
401.bzip2 (max) 178.000 641.67%
401.bzip2 (max) (percentage) 6.280 597.78%
401.bzip2 (unexplained diff vs previous) 168.000 740.00%
401.bzip2 (unexplained diff vs previous) (percentage) 5.910 688.00%
403.gcc 3.000 -
403.gcc (avg) 3.000 -
403.gcc (avg) (percentage) 4.990 -6.20%
403.gcc (max) 6.000 -
403.gcc (max) (percentage) 9.880 -9.11%
403.gcc (unexplained diff vs previous) 0.000 -
403.gcc (unexplained diff vs previous) (percentage) 0.000 -
410.bwaves 76.000 38.18%
410.bwaves (avg) 76.000 38.18%
410.bwaves (avg) (percentage) 1.510 27.97%
410.bwaves (max) 396.000 382.93%
410.bwaves (max) (percentage) 7.810 343.75%
410.bwaves (unexplained diff vs previous) 368.000 5157.14%
410.bwaves (unexplained diff vs previous) (percentage) 7.240 4726.67%
429.mcf 66.000 -4.35%
429.mcf (avg) 66.000 -4.35%
429.mcf (avg) (percentage) 3.670 7.94%
429.mcf (max) 217.000 244.44%
429.mcf (max) (percentage) 12.030 291.86%
429.mcf (unexplained diff vs previous) 247.000 4016.67%
429.mcf (unexplained diff vs previous) (percentage) 13.670 4613.79%
433.milc 12.000 -
433.milc (avg) 12.000 -
433.milc (avg) (percentage) 1.050 -
433.milc (max) 17.000 6.25%
433.milc (max) (percentage) 1.390 5.30%
433.milc (unexplained diff vs previous) 17.000 142.86%
433.milc (unexplained diff vs previous) (percentage) 1.380 142.11%
434.zeusmp 21.000 40.00%
434.zeusmp (avg) 21.000 40.00%
434.zeusmp (avg) (percentage) 1.080 31.71%
434.zeusmp (max) 96.000 1271.43%
434.zeusmp (max) (percentage) 4.790 1128.21%
434.zeusmp (unexplained diff vs previous) 92.000 2966.67%
434.zeusmp (unexplained diff vs previous) (percentage) 4.570 2756.25%
435.gromacs (avg) (percentage) 0.680 -
435.gromacs (max) (percentage) 0.690 -1.43%
436.cactusADM (avg) (percentage) 0.670 -
436.cactusADM (max) (percentage) 0.740 -1.33%
437.leslie3d 380.000 42.86%
437.leslie3d (avg) 380.000 42.86%
437.leslie3d (avg) (percentage) 5.200 21.21%
437.leslie3d (max) 1301.000 180.99%
437.leslie3d (max) (percentage) 17.790 138.15%
437.leslie3d (unexplained diff vs previous) 1105.000 120.56%
437.leslie3d (unexplained diff vs previous) (percentage) 15.110 87.24%
444.namd 8.000 14.29%
444.namd (avg) 8.000 14.29%
444.namd (avg) (percentage) 1.160 7.41%
444.namd (max) 19.000 46.15%
444.namd (max) (percentage) 2.800 44.33%
444.namd (unexplained diff vs previous) 19.000 533.33%
444.namd (unexplained diff vs previous) (percentage) 2.730 520.45%
445.gobmk 47.000 17.50%
445.gobmk (avg) 47.000 17.50%
445.gobmk (avg) (percentage) 0.940 13.25%
445.gobmk (max) 148.000 155.17%
445.gobmk (max) (percentage) 2.920 145.38%
445.gobmk (unexplained diff vs previous) 144.000 148.28%
445.gobmk (unexplained diff vs previous) (percentage) 2.830 139.83%
447.dealII 29.000 16.00%
447.dealII (avg) 29.000 16.00%
447.dealII (avg) (percentage) 2.210 10.50%
447.dealII (max) 71.000 82.05%
447.dealII (max) (percentage) 5.360 72.35%
447.dealII (unexplained diff vs previous) 68.000 871.43%
447.dealII (unexplained diff vs previous) (percentage) 5.090 825.45%
450.soplex 18.000 12.50%
450.soplex (avg) 18.000 12.50%
450.soplex (avg) (percentage) 3.170 2.92%
450.soplex (max) 30.000 11.11%
450.soplex (max) (percentage) 5.260 3.95%
450.soplex (unexplained diff vs previous) 29.000 107.14%
450.soplex (unexplained diff vs previous) (percentage) 5.000 96.85%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.560 1.30%
453.povray (max) 9.000 80.00%
453.povray (max) (percentage) 2.060 74.58%
453.povray (unexplained diff vs previous) 9.000 800.00%
453.povray (unexplained diff vs previous) (percentage) 2.020 778.26%
456.hmmer 11.000 22.22%
456.hmmer (avg) 11.000 22.22%
456.hmmer (avg) (percentage) 0.410 17.14%
456.hmmer (max) 57.000 714.29%
456.hmmer (max) (percentage) 2.060 610.34%
456.hmmer (unexplained diff vs previous) 56.000 600.00%
456.hmmer (unexplained diff vs previous) (percentage) 2.020 596.55%
458.sjeng 42.000 16.67%
458.sjeng (avg) 42.000 16.67%
458.sjeng (avg) (percentage) 0.630 14.55%
458.sjeng (max) 175.000 207.02%
458.sjeng (max) (percentage) 2.580 196.55%
458.sjeng (unexplained diff vs previous) 171.000 434.38%
458.sjeng (unexplained diff vs previous) (percentage) 2.520 425.00%
459.GemsFDTD 60.000 33.33%
459.GemsFDTD (avg) 60.000 33.33%
459.GemsFDTD (avg) (percentage) 1.130 26.97%
459.GemsFDTD (max) 219.000 1052.63%
459.GemsFDTD (max) (percentage) 4.120 956.41%
459.GemsFDTD (unexplained diff vs previous) 211.000 2537.50%
459.GemsFDTD (unexplained diff vs previous) (percentage) 3.950 2368.75%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.560 8.33%
462.libquantum (max) 4.000 300.00%
462.libquantum (max) (percentage) 5.000 130.41%
462.libquantum (unexplained diff vs previous) 4.000 300.00%
462.libquantum (unexplained diff vs previous) (percentage) 4.760 280.80%
464.h264ref 37.000 23.33%
464.h264ref (avg) 37.000 23.33%
464.h264ref (avg) (percentage) 0.930 20.78%
464.h264ref (max) 167.000 240.82%
464.h264ref (max) (percentage) 4.120 224.41%
464.h264ref (unexplained diff vs previous) 161.000 1688.89%
464.h264ref (unexplained diff vs previous) (percentage) 3.960 1621.74%
470.lbm 32.000 10.34%
470.lbm (avg) 32.000 10.34%
470.lbm (avg) (percentage) 0.940 6.82%
470.lbm (max) 96.000 159.46%
470.lbm (max) (percentage) 2.830 150.44%
470.lbm (unexplained diff vs previous) 94.000 154.05%
470.lbm (unexplained diff vs previous) (percentage) 2.750 147.75%
471.omnetpp 69.000 25.45%
471.omnetpp (avg) 69.000 25.45%
471.omnetpp (avg) (percentage) 2.480 13.76%
471.omnetpp (max) 297.000 681.58%
471.omnetpp (max) (percentage) 10.650 600.66%
471.omnetpp (unexplained diff vs previous) 269.000 13350.00%
471.omnetpp (unexplained diff vs previous) (percentage) 9.630 11937.50%
473.astar 86.000 11.69%
473.astar (avg) 86.000 11.69%
473.astar (avg) (percentage) 1.610 6.62%
473.astar (max) 239.000 334.55%
473.astar (max) (percentage) 4.470 310.09%
473.astar (unexplained diff vs previous) 229.000 2762.50%
473.astar (unexplained diff vs previous) (percentage) 4.280 2575.00%
482.sphinx3 20.000 11.11%
482.sphinx3 (avg) 20.000 11.11%
482.sphinx3 (avg) (percentage) 2.790 5.68%
482.sphinx3 (max) 44.000 33.33%
482.sphinx3 (max) (percentage) 5.940 26.38%
482.sphinx3 (unexplained diff vs previous) 42.000 281.82%
482.sphinx3 (unexplained diff vs previous) (percentage) 5.610 259.62%
483.xalancbmk 80.000 15.94%
483.xalancbmk (avg) 80.000 15.94%
483.xalancbmk (avg) (percentage) 2.100 6.06%
483.xalancbmk (max) 189.000 11.83%
483.xalancbmk (max) (percentage) 4.940 1.86%
483.xalancbmk (unexplained diff vs previous) 0.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 0.000 -
Geometric Mean 9.964 85.25%