Latest (10) Runs Report

Filter
Filter

No significant Compile changes found.

llvm-arm-master-O2
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
470.lbm 1.000 - - - - 1606100.00% 1606800.00% 1605200.00% 1599800.00% 1606400.00%
482.sphinx3 2.000 100.00% - 50.00% -50.00% 924050.00% 919800.00% 920700.00% 920400.00% 919350.00%
433.milc 5.000 - - - - 235720.00% 236840.00% 236780.00% 236520.00% 236480.00%
450.soplex 15.000 6.67% -6.67% 6.67% -26.67% 55533.33% 55373.33% 55446.67% 55426.67% 55573.33%
403.gcc 140.000 -1.43% -1.43% -2.14% -2.14% 4618.57% 4597.14% 4579.29% 4574.29% 4572.14%
462.libquantum 14675.000 - - - - -19.22% -19.27% -19.84% -19.82% -19.07%
458.sjeng 14313.000 - - - - -2.14% -2.63% -2.54% -3.00% -2.80%
llvm-arm-master-O3
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
482.sphinx3 1.000 100.00% - 1839300.00% 1847300.00% 1844600.00% 1844900.00% 1847700.00% 1854000.00% 1844000.00%
470.lbm 1.000 - - 1602000.00% 1603700.00% 1604000.00% 1600100.00% 1606400.00% 1604700.00% 1603500.00%
433.milc 5.000 - - 235680.00% 234900.00% 235040.00% 235180.00% 236180.00% 236340.00% 236680.00%
450.soplex 13.000 38.46% -30.77% 63984.62% 64069.23% 64223.08% 64123.08% 64038.46% 64276.92% 64015.38%
403.gcc 138.000 -2.90% -2.90% 4513.77% 4539.13% 4523.91% 4550.72% 4526.09% 4534.06% 4567.39%
462.libquantum 14779.000 - - -20.49% -19.88% -20.31% -20.54% -20.46% -20.49% -20.14%
401.bzip2 11215.000 - - 1.25% 1.03% 1.23% 1.91% 1.50% 1.78% 1.12%
llvm-arm-master-O2
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
429.mcf 10806.000 - - - - 8.00% 8.00% 7.85% 7.85% 7.85%
401.bzip2 76027.000 - - - - - 2.34% 2.71% 2.71% 2.71%
462.libquantum 32712.000 - - - - 1.44% 1.44% 1.44% 1.44% 1.44%
llvm-arm-master-O3
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
429.mcf 11810.000 - - 7.18% 7.18% 7.18% 7.18% 7.04% 7.04% 7.04%
401.bzip2 80391.000 - - 1.63% 1.62% 1.62% 1.62% 1.98% 1.98% 1.98%
462.libquantum 33792.000 - - 1.52% 1.73% 1.73% 1.73% 1.73% 1.73% 1.73%

No significant Memory Usage changes found.

llvm-arm-master-O2
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
nb_execution_successful 4.000 - - - - 350.00% 350.00% 350.00% 350.00% 325.00%
nb_compile_successful 19.000 - - - - - - - - -5.26%
nb_total_tests 19.000 - - - - - - - - 5.26%
llvm-arm-master-O3
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
nb_execution_successful 4.000 - - 350.00% 350.00% 350.00% 350.00% 350.00% 350.00% 325.00%
nb_total_tests 15.000 -6.67% 26.67% 26.67% 26.67% 26.67% 26.67% 26.67% 26.67% 33.33%
nb_compile_successful 15.000 -6.67% 26.67% 26.67% 26.67% 26.67% 26.67% 26.67% 26.67% 20.00%
llvm-arm-master-O2
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
450.soplex (max) (percentage) 0.160 - - - 23700.00% 23700.00% 23606.25% - - 62.50%
403.gcc (max) (percentage) 0.140 - - - 1021.43% 1021.43% 1014.29% 171.43% 171.43% 171.43%
462.libquantum (unexplained diff vs previous) (percentage) 0.320 -50.00% -37.50% -68.75% -96.88% - -78.12% 121.87% -90.63% 190.63%
462.libquantum (max) (percentage) 0.320 -12.50% -18.75% -53.12% -59.38% -59.38% -62.50% 118.75% 90.62% 190.63%
462.libquantum (unexplained diff vs previous) 47.000 -51.06% -36.17% -68.09% -97.87% - -82.98% 76.60% -93.62% 134.04%
401.bzip2 (max) 138.000 -13.04% -17.39% -74.64% -78.26% -78.26% -79.71% -78.99% -79.71% -82.61%
401.bzip2 (max) (percentage) 1.230 -13.01% -17.07% -73.98% -78.05% -78.05% -79.67% -78.86% -79.67% -82.11%
462.libquantum (max) 46.000 -10.87% -17.39% -52.17% -58.70% -67.39% -69.57% 78.26% 54.35% 139.13%
433.milc (max) (percentage) 0.030 - - - - - - - 266.67% 266.67%
456.hmmer (max) (percentage) 1.050 - - - - - - 179.05% 177.14% 176.19%
445.gobmk (max) (percentage) 0.130 - - - - - - 176.92% 176.92% 176.92%
473.astar (max) (percentage) 0.080 - - - - - - 162.50% 162.50% 162.50%
453.povray (max) (percentage) 0.390 - - - - - - - 110.26% 376.92%
470.lbm (max) (percentage) 0.220 - - - -68.18% -68.18% -68.18% -54.55% 54.55% 86.36%
471.omnetpp (max) (percentage) 0.840 - - - - - - - 42.86% 126.19%
464.h264ref (max) (percentage) 0.580 - - - - - - - 74.14% 72.41%
458.sjeng (max) 140.000 -13.57% -18.57% -22.86% - -2.14% -7.86% -12.86% -24.29% -27.14%
458.sjeng (max) (percentage) 0.980 -13.27% -18.37% -22.45% - - -5.10% -10.20% -21.43% -24.49%
462.libquantum 29.000 - - - -6.90% -24.14% -24.14% -20.69% -20.69% -17.24%
462.libquantum (avg) 29.000 - - - -6.90% -24.14% -24.14% -20.69% -20.69% -17.24%
403.gcc (avg) (percentage) 0.330 - - - 30.30% 30.30% 30.30% 3.03% -6.06% -12.12%
482.sphinx3 (max) (percentage) 0.350 - - - - - - -22.86% -22.86% -22.86%
453.povray (avg) (percentage) 0.410 - - - - - - - 12.20% 51.22%
482.sphinx3 (avg) (percentage) 0.430 - - - - - - -9.30% -16.28% -23.26%
429.mcf 17.000 - -5.88% -5.88% 5.88% 5.88% 5.88% -5.88% -5.88% -5.88%
429.mcf (avg) 17.000 - -5.88% -5.88% 5.88% 5.88% 5.88% -5.88% -5.88% -5.88%
401.bzip2 (avg) (percentage) 0.600 -1.67% -1.67% -3.33% -6.67% -6.67% -6.67% -5.00% -6.67% -8.33%
401.bzip2 67.000 -1.49% -1.49% -2.99% -7.46% -7.46% -5.97% -4.48% -5.97% -7.46%
401.bzip2 (avg) 67.000 -1.49% -1.49% -2.99% -7.46% -7.46% -5.97% -4.48% -5.97% -7.46%
458.sjeng 83.000 -2.41% -3.61% -4.82% -3.61% -6.02% -6.02% -4.82% -4.82% -7.23%
458.sjeng (avg) 83.000 -2.41% -3.61% -4.82% -3.61% -6.02% -6.02% -4.82% -4.82% -7.23%
444.namd (max) (percentage) 0.140 - - - - - - - - -35.71%
471.omnetpp (avg) (percentage) 0.690 - - - - - - - 7.25% 21.74%
483.xalancbmk (avg) (percentage) 0.840 - - - - - - - -14.29% -14.29%
458.sjeng (avg) (percentage) 0.580 -1.72% -3.45% -3.45% -3.45% -3.45% -3.45% -1.72% -1.72% -3.45%
447.dealII (avg) (percentage) 0.520 - - - - - - - -5.77% -17.31%
444.namd (avg) (percentage) 0.140 - - - - - - - -7.14% -14.29%
456.hmmer (avg) (percentage) 1.420 - - - - - - 10.56% 3.52% -2.82%
445.gobmk (avg) (percentage) 0.190 - - - - - - 10.53% - -5.26%
483.xalancbmk (max) (percentage) 0.940 - - - - - - - -3.19% -3.19%
llvm-arm-master-O3
Test Name Run #10 Run #9 Run #8 Run #7 Run #6 Run #5 Run #4 Run #3 Run #2 Run #1 Sparkline
401.bzip2 (unexplained diff vs previous) 12.000 583.33% 650.00% - - 91.67% 533.33% - 166.67% 516.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 563.64% 627.27% - - 81.82% 500.00% - 154.55% 490.91%
458.sjeng (unexplained diff vs previous) (percentage) 0.270 333.33% 137.04% - - 44.44% 185.19% - 288.89% 125.93%
458.sjeng (unexplained diff vs previous) 38.000 328.95% 134.21% - - 42.11% 181.58% - 292.11% 126.32%
458.sjeng (max) (percentage) 0.460 152.17% 89.13% 89.13% 67.39% 56.52% 67.39% 54.35% 130.43% 110.87%
458.sjeng (max) 64.000 151.56% 89.06% 89.06% 65.62% 56.25% 65.62% 54.69% 132.81% 112.50%
462.libquantum (max) 106.000 -19.81% -33.96% -47.17% -50.94% -41.51% -49.06% -53.77% -55.66% -52.83%
462.libquantum (unexplained diff vs previous) 94.000 -9.57% -89.36% - - -32.98% -62.77% - -95.74% -45.74%
462.libquantum (max) (percentage) 0.720 -19.44% -33.33% -33.33% -38.89% -26.39% -36.11% -41.67% -44.44% -40.28%
462.libquantum (unexplained diff vs previous) (percentage) 0.640 -9.38% -89.06% - - -17.19% -53.12% - -95.31% -32.81%
401.bzip2 (max) (percentage) 1.190 -5.88% -10.08% -10.08% -12.61% -46.22% -43.70% -47.90% -57.98% -45.38%
429.mcf (unexplained diff vs previous) (percentage) 0.390 -94.87% -12.82% - - -92.31% 15.38% - 25.64% 38.46%
429.mcf (unexplained diff vs previous) 38.000 -94.74% -13.16% - - -92.11% 13.16% - 26.32% 36.84%
401.bzip2 (max) 133.000 -5.26% -10.53% -9.02% -12.03% -45.86% -42.86% -47.37% -57.14% -45.11%
429.mcf (max) 37.000 -24.32% -13.51% -13.51% -21.62% -40.54% 13.51% 2.70% 29.73% 40.54%
429.mcf (max) (percentage) 0.390 -25.64% -12.82% -12.82% -23.08% -41.03% 12.82% 2.56% 28.21% 38.46%
462.libquantum 36.000 8.33% 5.56% -16.67% -16.67% -13.89% -13.89% -13.89% -16.67% -13.89%
462.libquantum (avg) 36.000 8.33% 5.56% -16.67% -16.67% -13.89% -13.89% -13.89% -16.67% -13.89%
458.sjeng (avg) (percentage) 0.450 6.67% 8.89% 8.89% 8.89% 6.67% 8.89% 8.89% 13.33% 15.56%
458.sjeng 63.000 4.76% 7.94% 7.94% 7.94% 4.76% 6.35% 7.94% 14.29% 15.87%
458.sjeng (avg) 63.000 4.76% 7.94% 7.94% 7.94% 4.76% 6.35% 7.94% 14.29% 15.87%
462.libquantum (avg) (percentage) 0.250 8.00% 4.00% 4.00% 4.00% 8.00% 8.00% 8.00% 4.00% 8.00%
401.bzip2 (avg) (percentage) 0.900 -1.11% -1.11% -1.11% -1.11% -3.33% -4.44% -4.44% -6.67% -7.78%
429.mcf 20.000 -5.00% - - - -5.00% - - 5.00% 10.00%
429.mcf (avg) 20.000 -5.00% - - - -5.00% - - 5.00% 10.00%
429.mcf (avg) (percentage) 0.210 - - - - - - - 4.76% 9.52%
401.bzip2 100.000 - -1.00% 1.00% - -2.00% -2.00% -3.00% -5.00% -6.00%
401.bzip2 (avg) 100.000 - -1.00% 1.00% - -2.00% -2.00% -3.00% -5.00% -6.00%