Fields

hardware None
os None

Parameters

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/fab28e0e140eb55da25b7923a548ab357a9da544 (+ 88 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/77/
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0077 (llvmorg-18-init-06701-gfab28e0e140e) 2023-09-22T06:56:00 0:00:00
Previous 0076 (llvmorg-18-init-06613-g2e7d83debb69) 2023-09-20T16:44:19 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00


Tests Summary

Status Group # # (B)
Performance Regressions 20 37
Performance Improvements 81 111
Added Tests 12 0
Unchanged Tests 667 632
Total Tests 780

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
471.omnetpp 3.41% 2694.000 2786.000 - -74.07% -
462.libquantum 2.04% 98.000 100.000 - -99.24% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) 1500.00% 1.000 16.000 - -73.33% -
464.h264ref (unexplained diff vs previous) (percentage) 1350.00% 0.020 0.290 - -25.64% -
462.libquantum (max) (percentage) 151.85% 0.810 2.040 - 920.00% -
471.omnetpp (max) 93.88% 49.000 95.000 - -49.74% -
471.omnetpp (max) (percentage) 87.36% 1.820 3.410 - 93.75% -
471.omnetpp (unexplained diff vs previous) 84.00% 50.000 92.000 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 77.42% 1.860 3.300 - 283.72% -
470.lbm (unexplained diff vs previous) (percentage) 52.63% 0.190 0.290 - -91.90% -
470.lbm (unexplained diff vs previous) 50.00% 6.000 9.000 - -98.19% -
464.h264ref (max) (percentage) 38.10% 0.210 0.290 - -25.64% -
464.h264ref (max) 36.36% 11.000 15.000 - -75.00% -
429.mcf (unexplained diff vs previous) 33.33% 3.000 4.000 - -94.03% -
429.mcf (unexplained diff vs previous) (percentage) 30.77% 0.260 0.340 - -39.29% -
403.gcc (avg) (percentage) 5.14% 2.140 2.250 - 368.75% -
471.omnetpp 3.66% 82.000 85.000 - 2.41% -
471.omnetpp (avg) 3.66% 82.000 85.000 - 2.41% -
450.soplex (avg) (percentage) 1.94% 1.030 1.050 - 191.67% -
462.libquantum (avg) (percentage) 1.36% 1.470 1.490 - 893.33% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc -3.33% 60.000 58.000 - -99.36% -
450.soplex -1.88% 532.000 522.000 - -96.38% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
433.milc (unexplained diff vs previous) -85.71% 7.000 1.000 - -99.45% -
433.milc (unexplained diff vs previous) (percentage) -85.25% 0.610 0.090 - -93.33% -
483.xalancbmk (unexplained diff vs previous) -84.75% 59.000 9.000 - -85.25% -
483.xalancbmk (unexplained diff vs previous) (percentage) -84.52% 1.680 0.260 - -60.00% -
445.gobmk (unexplained diff vs previous) -77.78% 18.000 4.000 - -86.67% -
453.povray (max) -77.78% 9.000 2.000 - -98.48% -
445.gobmk (unexplained diff vs previous) (percentage) -76.47% 0.340 0.080 - -66.67% -
453.povray (max) (percentage) -70.24% 2.050 0.610 - -68.39% -
444.namd (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.88% -
444.namd (unexplained diff vs previous) (percentage) -66.67% 0.420 0.140 - -97.72% -
450.soplex (unexplained diff vs previous) -52.38% 21.000 10.000 - -87.80% -
450.soplex (unexplained diff vs previous) (percentage) -51.39% 3.950 1.920 - 236.84% -
473.astar (unexplained diff vs previous) (percentage) -30.56% 0.360 0.250 - -67.11% -
473.astar (unexplained diff vs previous) -29.41% 17.000 12.000 - -88.89% -
458.sjeng (unexplained diff vs previous) -25.93% 27.000 20.000 - -51.22% -
458.sjeng (max) (percentage) -24.24% 0.330 0.250 - -37.50% -
458.sjeng (unexplained diff vs previous) (percentage) -24.24% 0.330 0.250 - 0.00% -
458.sjeng (max) -23.08% 26.000 20.000 - -69.23% -
401.bzip2 (max) -19.05% 21.000 17.000 - -64.58% -
450.soplex (max) -19.05% 21.000 17.000 - -79.27% -
482.sphinx3 (max) -18.18% 11.000 9.000 - -98.97% -
456.hmmer (max) (percentage) -17.95% 0.390 0.320 - 6.67% -
483.xalancbmk (max) (percentage) -16.97% 1.650 1.370 - 110.77% -
450.soplex (max) (percentage) -16.79% 4.110 3.420 - 500.00% -
433.milc (max) -16.67% 6.000 5.000 - -97.28% -
433.milc (max) (percentage) -16.67% 0.600 0.500 - -63.50% -
483.xalancbmk (max) -15.79% 57.000 48.000 - -21.31% -
456.hmmer (max) -15.38% 13.000 11.000 - -72.50% -
482.sphinx3 (max) (percentage) -15.15% 1.320 1.120 - -66.27% -
403.gcc (max) (percentage) -15.06% 4.780 4.060 - 968.42% -
401.bzip2 (max) (percentage) -14.47% 0.760 0.650 - 109.68% -
401.bzip2 (unexplained diff vs previous) -14.29% 21.000 18.000 - -63.27% -
401.bzip2 (unexplained diff vs previous) (percentage) -13.33% 0.750 0.650 - 109.68% -
433.milc -12.50% 8.000 7.000 - -94.85% -
433.milc (avg) -12.50% 8.000 7.000 - -94.85% -
470.lbm (max) (percentage) -10.61% 0.660 0.590 - -89.35% -
470.lbm (max) -10.00% 20.000 18.000 - -97.66% -
445.gobmk (max) (percentage) -9.76% 0.410 0.370 - 54.17% -
445.gobmk (max) -9.52% 21.000 19.000 - -34.48% -
482.sphinx3 -7.14% 14.000 13.000 - -97.34% -
482.sphinx3 (avg) -7.14% 14.000 13.000 - -97.34% -
447.dealII (max) -6.67% 15.000 14.000 - -89.15% -
444.namd (max) (percentage) -6.49% 2.620 2.450 - -62.54% -
429.mcf (max) (percentage) -6.45% 0.930 0.870 - 55.36% -
401.bzip2 -5.56% 18.000 17.000 - -50.00% -
401.bzip2 (avg) -5.56% 18.000 17.000 - -50.00% -
444.namd (max) -5.56% 18.000 17.000 - -98.07% -
447.dealII (max) (percentage) -5.49% 0.910 0.860 - -45.57% -
473.astar (max) (percentage) -5.43% 0.920 0.870 - 8.75% -
445.gobmk -5.13% 39.000 37.000 - 68.18% -
445.gobmk (avg) -5.13% 39.000 37.000 - 68.18% -
429.mcf -5.00% 40.000 38.000 - -28.30% -
429.mcf (avg) -5.00% 40.000 38.000 - -28.30% -
473.astar (max) -4.65% 43.000 41.000 - -64.04% -
453.povray (avg) (percentage) -4.38% 1.370 1.310 - -4.38% -
445.gobmk (avg) (percentage) -4.00% 0.750 0.720 - 300.00% -
456.hmmer -4.00% 50.000 48.000 - 0.00% -
456.hmmer (avg) -4.00% 50.000 48.000 - 0.00% -
482.sphinx3 (avg) (percentage) -3.73% 1.610 1.550 - -16.67% -
444.namd (avg) (percentage) -3.59% 2.230 2.150 - -43.57% -
456.hmmer (avg) (percentage) -3.55% 1.410 1.360 - 277.78% -
483.xalancbmk -3.45% 116.000 112.000 - 138.30% -
483.xalancbmk (avg) -3.45% 116.000 112.000 - 138.30% -
473.astar (avg) (percentage) -3.28% 2.740 2.650 - 430.00% -
483.xalancbmk (avg) (percentage) -3.02% 3.310 3.210 - 542.00% -
433.milc (avg) (percentage) -2.82% 0.710 0.690 - -31.68% -
429.mcf (avg) (percentage) -2.63% 3.420 3.330 - 640.00% -
458.sjeng (avg) (percentage) -2.44% 0.820 0.800 - 37.93% -
473.astar -2.33% 129.000 126.000 - 77.46% -
473.astar (avg) -2.33% 129.000 126.000 - 77.46% -
464.h264ref (avg) (percentage) -2.27% 0.880 0.860 - 160.61% -
470.lbm (avg) (percentage) -2.26% 1.770 1.730 - -25.43% -
447.dealII (avg) (percentage) -2.20% 0.910 0.890 - -39.46% -
464.h264ref -2.08% 48.000 47.000 - -7.84% -
464.h264ref (avg) -2.08% 48.000 47.000 - -7.84% -
470.lbm -1.82% 55.000 54.000 - -83.23% -
470.lbm (avg) -1.82% 55.000 54.000 - -83.23% -
458.sjeng -1.52% 66.000 65.000 - -31.58% -
458.sjeng (avg) -1.52% 66.000 65.000 - -31.58% -

Added Tests - sample variability
403.gcc (unexplained diff vs previous)
403.gcc (unexplained diff vs previous) (percentage)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
453.povray (unexplained diff vs previous)
453.povray (unexplained diff vs previous) (percentage)
456.hmmer (unexplained diff vs previous)
456.hmmer (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)
482.sphinx3 (unexplained diff vs previous)
482.sphinx3 (unexplained diff vs previous) (percentage)

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
401.bzip2 5.98% 39458.000 41817.000 - 0.00% -
450.soplex 1.78% 198708.000 202246.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) (percentage) 1566.67% 0.120 2.000 - 0.00% -
403.gcc (max) (percentage) 968.42% 0.380 4.060 - -15.06% -
462.libquantum (max) (percentage) 920.00% 0.200 2.040 - 151.85% -
462.libquantum (avg) (percentage) 893.33% 0.150 1.490 - 1.36% -
403.gcc (unexplained diff vs previous) (percentage) 832.43% 0.370 3.450 - 0.00% -
429.mcf (avg) (percentage) 640.00% 0.450 3.330 - -2.63% -
483.xalancbmk (avg) (percentage) 542.00% 0.500 3.210 - -3.02% -
450.soplex (max) (percentage) 500.00% 0.570 3.420 - -16.79% -
473.astar (avg) (percentage) 430.00% 0.500 2.650 - -3.28% -
403.gcc (avg) (percentage) 368.75% 0.480 2.250 - 5.14% -
445.gobmk (avg) (percentage) 300.00% 0.180 0.720 - -4.00% -
471.omnetpp (avg) (percentage) 294.87% 0.780 3.080 - 0.33% -
471.omnetpp (unexplained diff vs previous) (percentage) 283.72% 0.860 3.300 - 77.42% -
456.hmmer (avg) (percentage) 277.78% 0.360 1.360 - -3.55% -
450.soplex (unexplained diff vs previous) (percentage) 236.84% 0.570 1.920 - -51.39% -
401.bzip2 (avg) (percentage) 195.45% 0.220 0.650 - 0.00% -
450.soplex (avg) (percentage) 191.67% 0.360 1.050 - 1.94% -
464.h264ref (avg) (percentage) 160.61% 0.330 0.860 - -2.27% -
483.xalancbmk 138.30% 47.000 112.000 - -3.45% -
483.xalancbmk (avg) 138.30% 47.000 112.000 - -3.45% -
483.xalancbmk (max) (percentage) 110.77% 0.650 1.370 - -16.97% -
401.bzip2 (max) (percentage) 109.68% 0.310 0.650 - -14.47% -
401.bzip2 (unexplained diff vs previous) (percentage) 109.68% 0.310 0.650 - -13.33% -
471.omnetpp (max) (percentage) 93.75% 1.760 3.410 - 87.36% -
473.astar 77.46% 71.000 126.000 - -2.33% -
473.astar (avg) 77.46% 71.000 126.000 - -2.33% -
445.gobmk 68.18% 22.000 37.000 - -5.13% -
445.gobmk (avg) 68.18% 22.000 37.000 - -5.13% -
429.mcf (max) (percentage) 55.36% 0.560 0.870 - -6.45% -
445.gobmk (max) (percentage) 54.17% 0.240 0.370 - -9.76% -
458.sjeng (avg) (percentage) 37.93% 0.580 0.800 - -2.44% -
473.astar (max) (percentage) 8.75% 0.800 0.870 - -5.43% -
456.hmmer (max) (percentage) 6.67% 0.300 0.320 - -17.95% -
471.omnetpp 2.41% 83.000 85.000 - 3.66% -
471.omnetpp (avg) 2.41% 83.000 85.000 - 3.66% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -9.00% 26756.000 24347.000 - 0.00% -
453.povray -2.66% 593097.000 577326.000 - 0.00% -
433.milc -2.52% 74971.000 73078.000 - 0.00% -
447.dealII -1.79% 1777992.000 1746163.000 - 0.00% -
482.sphinx3 -1.09% 115736.000 114471.000 - 0.00% -
456.hmmer -1.06% 168072.000 166298.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - -3.33% -
462.libquantum -99.24% 13126.000 100.000 - 2.04% -
482.sphinx3 -96.68% 26310.000 873.000 - -0.23% -
450.soplex -96.38% 14429.000 522.000 - -1.88% -
444.namd -94.69% 13495.000 717.000 - 0.14% -
453.povray -93.31% 6857.000 459.000 - -0.22% -
433.milc -91.42% 13482.000 1157.000 - 0.09% -
429.mcf -90.24% 11999.000 1171.000 - -0.34% -
401.bzip2 -82.38% 15683.000 2764.000 - -0.65% -
447.dealII -78.73% 8196.000 1743.000 - -0.51% -
470.lbm -77.31% 13882.000 3150.000 - 0.29% -
471.omnetpp -74.07% 10746.000 2786.000 - 3.41% -
456.hmmer -73.33% 13365.000 3565.000 - 0.06% -
473.astar -66.65% 14262.000 4756.000 - 0.25% -
464.h264ref -64.46% 15493.000 5506.000 - -0.29% -
483.xalancbmk -62.81% 9427.000 3506.000 - -0.26% -
445.gobmk -57.54% 12400.000 5265.000 - -0.08% -
458.sjeng -50.35% 16406.000 8145.000 - -0.24% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.88% 828.000 1.000 - -66.67% -
482.sphinx3 (unexplained diff vs previous) -99.78% 904.000 2.000 - 0.00% -
433.milc (unexplained diff vs previous) -99.45% 182.000 1.000 - -85.71% -
453.povray (unexplained diff vs previous) -99.23% 130.000 1.000 - 0.00% -
482.sphinx3 (max) -98.97% 873.000 9.000 - -18.18% -
453.povray (max) -98.48% 132.000 2.000 - -77.78% -
470.lbm (unexplained diff vs previous) -98.19% 497.000 9.000 - 50.00% -
444.namd (max) -98.07% 882.000 17.000 - -5.56% -
444.namd (unexplained diff vs previous) (percentage) -97.72% 6.140 0.140 - -66.67% -
403.gcc -97.67% 43.000 1.000 - 0.00% -
403.gcc (avg) -97.67% 43.000 1.000 - 0.00% -
470.lbm (max) -97.66% 769.000 18.000 - -10.00% -
482.sphinx3 -97.34% 489.000 13.000 - -7.14% -
482.sphinx3 (avg) -97.34% 489.000 13.000 - -7.14% -
433.milc (max) -97.28% 184.000 5.000 - -16.67% -
444.namd -97.08% 514.000 15.000 - 0.00% -
444.namd (avg) -97.08% 514.000 15.000 - 0.00% -
433.milc -94.85% 136.000 7.000 - -12.50% -
433.milc (avg) -94.85% 136.000 7.000 - -12.50% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
403.gcc (max) -94.12% 34.000 2.000 - 0.00% -
403.gcc (unexplained diff vs previous) -94.12% 34.000 2.000 - 0.00% -
429.mcf (unexplained diff vs previous) -94.03% 67.000 4.000 - 33.33% -
453.povray -93.55% 93.000 6.000 - 0.00% -
453.povray (avg) -93.55% 93.000 6.000 - 0.00% -
433.milc (unexplained diff vs previous) (percentage) -93.33% 1.350 0.090 - -85.25% -
482.sphinx3 (unexplained diff vs previous) (percentage) -93.31% 3.440 0.230 - 0.00% -
447.dealII (unexplained diff vs previous) -92.56% 121.000 9.000 - 0.00% -
462.libquantum (max) -92.31% 26.000 2.000 - 0.00% -
470.lbm (unexplained diff vs previous) (percentage) -91.90% 3.580 0.290 - 52.63% -
450.soplex -90.20% 51.000 5.000 - 0.00% -
450.soplex (avg) -90.20% 51.000 5.000 - 0.00% -
470.lbm (max) (percentage) -89.35% 5.540 0.590 - -10.61% -
447.dealII (max) -89.15% 129.000 14.000 - -6.67% -
473.astar (unexplained diff vs previous) -88.89% 108.000 12.000 - -29.41% -
453.povray (unexplained diff vs previous) (percentage) -88.42% 1.900 0.220 - 0.00% -
450.soplex (unexplained diff vs previous) -87.80% 82.000 10.000 - -52.38% -
447.dealII -87.50% 120.000 15.000 - 0.00% -
447.dealII (avg) -87.50% 120.000 15.000 - 0.00% -
462.libquantum (unexplained diff vs previous) -87.50% 16.000 2.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -86.67% 30.000 4.000 - -77.78% -
483.xalancbmk (unexplained diff vs previous) -85.25% 61.000 9.000 - -84.75% -
429.mcf (max) -85.07% 67.000 10.000 - 0.00% -
470.lbm -83.23% 322.000 54.000 - -1.82% -
470.lbm (avg) -83.23% 322.000 54.000 - -1.82% -
450.soplex (max) -79.27% 82.000 17.000 - -19.05% -
456.hmmer (unexplained diff vs previous) -77.78% 9.000 2.000 - 0.00% -
464.h264ref (max) -75.00% 60.000 15.000 - 36.36% -
464.h264ref (unexplained diff vs previous) -73.33% 60.000 16.000 - 1500.00% -
456.hmmer (max) -72.50% 40.000 11.000 - -15.38% -
458.sjeng (max) -69.23% 65.000 20.000 - -23.08% -
453.povray (max) (percentage) -68.39% 1.930 0.610 - -70.24% -
473.astar (unexplained diff vs previous) (percentage) -67.11% 0.760 0.250 - -30.56% -
445.gobmk (unexplained diff vs previous) (percentage) -66.67% 0.240 0.080 - -76.47% -
482.sphinx3 (max) (percentage) -66.27% 3.320 1.120 - -15.15% -
447.dealII (unexplained diff vs previous) (percentage) -64.86% 1.480 0.520 - 0.00% -
401.bzip2 (max) -64.58% 48.000 17.000 - -19.05% -
473.astar (max) -64.04% 114.000 41.000 - -4.65% -
433.milc (max) (percentage) -63.50% 1.370 0.500 - -16.67% -
401.bzip2 (unexplained diff vs previous) -63.27% 49.000 18.000 - -14.29% -
444.namd (max) (percentage) -62.54% 6.540 2.450 - -6.49% -
483.xalancbmk (unexplained diff vs previous) (percentage) -60.00% 0.650 0.260 - -84.52% -
458.sjeng (unexplained diff vs previous) -51.22% 41.000 20.000 - -25.93% -
401.bzip2 -50.00% 34.000 17.000 - -5.56% -
401.bzip2 (avg) -50.00% 34.000 17.000 - -5.56% -
471.omnetpp (max) -49.74% 189.000 95.000 - 93.88% -
447.dealII (max) (percentage) -45.57% 1.580 0.860 - -5.49% -
444.namd (avg) (percentage) -43.57% 3.810 2.150 - -3.59% -
447.dealII (avg) (percentage) -39.46% 1.470 0.890 - -2.20% -
429.mcf (unexplained diff vs previous) (percentage) -39.29% 0.560 0.340 - 30.77% -
458.sjeng (max) (percentage) -37.50% 0.400 0.250 - -24.24% -
445.gobmk (max) -34.48% 29.000 19.000 - -9.52% -
433.milc (avg) (percentage) -31.68% 1.010 0.690 - -2.82% -
458.sjeng -31.58% 95.000 65.000 - -1.52% -
458.sjeng (avg) -31.58% 95.000 65.000 - -1.52% -
429.mcf -28.30% 53.000 38.000 - -5.00% -
429.mcf (avg) -28.30% 53.000 38.000 - -5.00% -
464.h264ref (max) (percentage) -25.64% 0.390 0.290 - 38.10% -
464.h264ref (unexplained diff vs previous) (percentage) -25.64% 0.390 0.290 - 1350.00% -
470.lbm (avg) (percentage) -25.43% 2.320 1.730 - -2.26% -
483.xalancbmk (max) -21.31% 61.000 48.000 - -15.79% -
482.sphinx3 (avg) (percentage) -16.67% 1.860 1.550 - -3.73% -
456.hmmer (unexplained diff vs previous) (percentage) -14.29% 0.070 0.060 - 0.00% -
464.h264ref -7.84% 51.000 47.000 - -2.08% -
464.h264ref (avg) -7.84% 51.000 47.000 - -2.08% -
453.povray (avg) (percentage) -4.38% 1.370 1.310 - -4.38% -


Report Time: 0.34s
Name Current %
401.bzip2 2764.000 -
403.gcc 58.000 -3.33%
429.mcf 1171.000 -
433.milc 1157.000 -
444.namd 717.000 -
445.gobmk 5265.000 -
447.dealII 1743.000 -
450.soplex 522.000 -1.88%
453.povray 459.000 -
456.hmmer 3565.000 -
458.sjeng 8145.000 -
462.libquantum 100.000 2.04%
464.h264ref 5506.000 -
470.lbm 3150.000 -
471.omnetpp 2786.000 3.41%
473.astar 4756.000 -
482.sphinx3 873.000 -
483.xalancbmk 3506.000 -
Geometric Mean 1438.928 -
Name Current %
401.bzip2 41817.000 -
403.gcc 1961133.000 -
429.mcf 7922.000 -
433.milc 73078.000 -
444.namd 174873.000 -
445.gobmk 1309880.000 -
447.dealII 1746163.000 -
450.soplex 202246.000 -
453.povray 577326.000 -
456.hmmer 166298.000 -
458.sjeng 97097.000 -
462.libquantum 24347.000 -
464.h264ref 352134.000 -
470.lbm 9750.000 -
471.omnetpp 376719.000 -
473.astar 23179.000 -
482.sphinx3 114471.000 -
483.xalancbmk 2286548.000 -
Geometric Mean 163327.349 -
Name Current %
401.bzip2 17.000 -5.56%
401.bzip2 (avg) 17.000 -5.56%
401.bzip2 (avg) (percentage) 0.650 -
401.bzip2 (max) 17.000 -19.05%
401.bzip2 (max) (percentage) 0.650 -14.47%
401.bzip2 (unexplained diff vs previous) 18.000 -14.29%
401.bzip2 (unexplained diff vs previous) (percentage) 0.650 -13.33%
403.gcc 1.000 -
403.gcc (avg) 1.000 -
403.gcc (avg) (percentage) 2.250 5.14%
403.gcc (max) 2.000 -
403.gcc (max) (percentage) 4.060 -15.06%
403.gcc (unexplained diff vs previous) 2.000 -
403.gcc (unexplained diff vs previous) (percentage) 3.450 -
429.mcf 38.000 -5.00%
429.mcf (avg) 38.000 -5.00%
429.mcf (avg) (percentage) 3.330 -2.63%
429.mcf (max) 10.000 -
429.mcf (max) (percentage) 0.870 -6.45%
429.mcf (unexplained diff vs previous) 4.000 33.33%
429.mcf (unexplained diff vs previous) (percentage) 0.340 30.77%
433.milc 7.000 -12.50%
433.milc (avg) 7.000 -12.50%
433.milc (avg) (percentage) 0.690 -2.82%
433.milc (max) 5.000 -16.67%
433.milc (max) (percentage) 0.500 -16.67%
433.milc (unexplained diff vs previous) 1.000 -85.71%
433.milc (unexplained diff vs previous) (percentage) 0.090 -85.25%
444.namd 15.000 -
444.namd (avg) 15.000 -
444.namd (avg) (percentage) 2.150 -3.59%
444.namd (max) 17.000 -5.56%
444.namd (max) (percentage) 2.450 -6.49%
444.namd (unexplained diff vs previous) 1.000 -66.67%
444.namd (unexplained diff vs previous) (percentage) 0.140 -66.67%
445.gobmk 37.000 -5.13%
445.gobmk (avg) 37.000 -5.13%
445.gobmk (avg) (percentage) 0.720 -4.00%
445.gobmk (max) 19.000 -9.52%
445.gobmk (max) (percentage) 0.370 -9.76%
445.gobmk (unexplained diff vs previous) 4.000 -77.78%
445.gobmk (unexplained diff vs previous) (percentage) 0.080 -76.47%
447.dealII 15.000 -
447.dealII (avg) 15.000 -
447.dealII (avg) (percentage) 0.890 -2.20%
447.dealII (max) 14.000 -6.67%
447.dealII (max) (percentage) 0.860 -5.49%
447.dealII (unexplained diff vs previous) 9.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.520 -
450.soplex 5.000 -
450.soplex (avg) 5.000 -
450.soplex (avg) (percentage) 1.050 1.94%
450.soplex (max) 17.000 -19.05%
450.soplex (max) (percentage) 3.420 -16.79%
450.soplex (unexplained diff vs previous) 10.000 -52.38%
450.soplex (unexplained diff vs previous) (percentage) 1.920 -51.39%
453.povray 6.000 -
453.povray (avg) 6.000 -
453.povray (avg) (percentage) 1.310 -4.38%
453.povray (max) 2.000 -77.78%
453.povray (max) (percentage) 0.610 -70.24%
453.povray (unexplained diff vs previous) 1.000 -
453.povray (unexplained diff vs previous) (percentage) 0.220 -
456.hmmer 48.000 -4.00%
456.hmmer (avg) 48.000 -4.00%
456.hmmer (avg) (percentage) 1.360 -3.55%
456.hmmer (max) 11.000 -15.38%
456.hmmer (max) (percentage) 0.320 -17.95%
456.hmmer (unexplained diff vs previous) 2.000 -
456.hmmer (unexplained diff vs previous) (percentage) 0.060 -
458.sjeng 65.000 -1.52%
458.sjeng (avg) 65.000 -1.52%
458.sjeng (avg) (percentage) 0.800 -2.44%
458.sjeng (max) 20.000 -23.08%
458.sjeng (max) (percentage) 0.250 -24.24%
458.sjeng (unexplained diff vs previous) 20.000 -25.93%
458.sjeng (unexplained diff vs previous) (percentage) 0.250 -24.24%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.490 1.36%
462.libquantum (max) 2.000 -
462.libquantum (max) (percentage) 2.040 151.85%
462.libquantum (unexplained diff vs previous) 2.000 -
462.libquantum (unexplained diff vs previous) (percentage) 2.000 -
464.h264ref 47.000 -2.08%
464.h264ref (avg) 47.000 -2.08%
464.h264ref (avg) (percentage) 0.860 -2.27%
464.h264ref (max) 15.000 36.36%
464.h264ref (max) (percentage) 0.290 38.10%
464.h264ref (unexplained diff vs previous) 16.000 1500.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.290 1350.00%
470.lbm 54.000 -1.82%
470.lbm (avg) 54.000 -1.82%
470.lbm (avg) (percentage) 1.730 -2.26%
470.lbm (max) 18.000 -10.00%
470.lbm (max) (percentage) 0.590 -10.61%
470.lbm (unexplained diff vs previous) 9.000 50.00%
470.lbm (unexplained diff vs previous) (percentage) 0.290 52.63%
471.omnetpp 85.000 3.66%
471.omnetpp (avg) 85.000 3.66%
471.omnetpp (avg) (percentage) 3.080 -
471.omnetpp (max) 95.000 93.88%
471.omnetpp (max) (percentage) 3.410 87.36%
471.omnetpp (unexplained diff vs previous) 92.000 84.00%
471.omnetpp (unexplained diff vs previous) (percentage) 3.300 77.42%
473.astar 126.000 -2.33%
473.astar (avg) 126.000 -2.33%
473.astar (avg) (percentage) 2.650 -3.28%
473.astar (max) 41.000 -4.65%
473.astar (max) (percentage) 0.870 -5.43%
473.astar (unexplained diff vs previous) 12.000 -29.41%
473.astar (unexplained diff vs previous) (percentage) 0.250 -30.56%
482.sphinx3 13.000 -7.14%
482.sphinx3 (avg) 13.000 -7.14%
482.sphinx3 (avg) (percentage) 1.550 -3.73%
482.sphinx3 (max) 9.000 -18.18%
482.sphinx3 (max) (percentage) 1.120 -15.15%
482.sphinx3 (unexplained diff vs previous) 2.000 -
482.sphinx3 (unexplained diff vs previous) (percentage) 0.230 -
483.xalancbmk 112.000 -3.45%
483.xalancbmk (avg) 112.000 -3.45%
483.xalancbmk (avg) (percentage) 3.210 -3.02%
483.xalancbmk (max) 48.000 -15.79%
483.xalancbmk (max) (percentage) 1.370 -16.97%
483.xalancbmk (unexplained diff vs previous) 9.000 -84.75%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.260 -84.52%
Geometric Mean 3.837 -14.98%