Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/3d7903f1008febc80cb104eedcbcd31d2690839f (+ 483 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/30/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0030 (llvmorg-17-init-11628-g3d7903f1008f) 2023-05-14T07:44:13 0:00:00
Previous 0029 (llvmorg-17-init-11145-g1ba9ec0d10c8) 2023-05-10T16:54:12 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 19 46
Performance Improvements 81 97
Added Tests 6 6
Unchanged Tests 674 631
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk (unexplained diff vs previous) 416.67% 6.000 31.000 - -49.18% -
483.xalancbmk (unexplained diff vs previous) (percentage) 411.76% 0.170 0.870 - 33.85% -
482.sphinx3 (unexplained diff vs previous) (percentage) 235.29% 0.340 1.140 - -66.86% -
482.sphinx3 (unexplained diff vs previous) 233.33% 3.000 10.000 - -98.89% -
450.soplex (unexplained diff vs previous) (percentage) 206.67% 0.750 2.300 - 303.51% -
445.gobmk (unexplained diff vs previous) 200.00% 4.000 12.000 - -60.00% -
450.soplex (unexplained diff vs previous) 200.00% 4.000 12.000 - -85.37% -
445.gobmk (unexplained diff vs previous) (percentage) 187.50% 0.080 0.230 - -4.17% -
450.soplex (max) 120.00% 5.000 11.000 - -86.59% -
450.soplex (max) (percentage) 100.89% 1.120 2.250 - 294.74% -
444.namd (unexplained diff vs previous) 100.00% 2.000 4.000 - -99.52% -
444.namd (unexplained diff vs previous) (percentage) 100.00% 0.280 0.560 - -90.88% -
429.mcf (unexplained diff vs previous) (percentage) 52.94% 0.170 0.260 - -53.57% -
429.mcf (unexplained diff vs previous) 50.00% 2.000 3.000 - -95.52% -
444.namd (max) 33.33% 3.000 4.000 - -99.55% -
444.namd (max) (percentage) 19.15% 0.470 0.560 - -91.44% -
456.hmmer (unexplained diff vs previous) (percentage) 17.65% 0.340 0.400 - 471.43% -
456.hmmer (unexplained diff vs previous) 16.67% 12.000 14.000 - 55.56% -
450.soplex (avg) (percentage) 14.58% 0.480 0.550 - 52.78% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -2.25% 533.000 521.000 - -96.39% -
403.gcc -1.69% 59.000 58.000 - -99.36% -
471.omnetpp -1.14% 2812.000 2780.000 - -74.13% -
482.sphinx3 -1.12% 891.000 881.000 - -96.65% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
458.sjeng (max) -90.28% 216.000 21.000 - -67.69% -
458.sjeng (max) (percentage) -90.23% 2.660 0.260 - -35.00% -
464.h264ref (max) -77.68% 336.000 75.000 - 25.00% -
464.h264ref (max) (percentage) -77.50% 6.090 1.370 - 251.28% -
401.bzip2 (unexplained diff vs previous) -75.00% 4.000 1.000 - -97.96% -
401.bzip2 (unexplained diff vs previous) (percentage) -73.33% 0.150 0.040 - -87.10% -
473.astar (max) -66.67% 45.000 15.000 - -86.84% -
473.astar (max) (percentage) -65.62% 0.960 0.330 - -58.75% -
473.astar (unexplained diff vs previous) -64.71% 17.000 6.000 - -94.44% -
473.astar (unexplained diff vs previous) (percentage) -63.89% 0.360 0.130 - -82.89% -
458.sjeng (unexplained diff vs previous) (percentage) -59.26% 0.270 0.110 - -56.00% -
458.sjeng (unexplained diff vs previous) -59.09% 22.000 9.000 - -78.05% -
453.povray (unexplained diff vs previous) (percentage) -55.85% 1.880 0.830 - -56.32% -
453.povray (unexplained diff vs previous) -55.56% 9.000 4.000 - -96.92% -
470.lbm (max) -54.17% 48.000 22.000 - -97.14% -
470.lbm (max) (percentage) -53.29% 1.520 0.710 - -87.18% -
471.omnetpp (unexplained diff vs previous) -52.94% 68.000 32.000 - -65.22% -
471.omnetpp (unexplained diff vs previous) (percentage) -52.48% 2.420 1.150 - 33.72% -
470.lbm (unexplained diff vs previous) -32.00% 25.000 17.000 - -96.58% -
470.lbm (unexplained diff vs previous) (percentage) -31.65% 0.790 0.540 - -84.92% -
464.h264ref (unexplained diff vs previous) -22.22% 9.000 7.000 - -88.33% -
464.h264ref (unexplained diff vs previous) (percentage) -18.75% 0.160 0.130 - -66.67% -
471.omnetpp (max) -17.39% 69.000 57.000 - -69.84% -
471.omnetpp (max) (percentage) -16.53% 2.480 2.070 - 17.61% -
429.mcf (max) -12.50% 8.000 7.000 - -89.55% -
453.povray (max) -11.11% 9.000 8.000 - -93.94% -
482.sphinx3 (max) -10.00% 10.000 9.000 - -98.97% -
429.mcf (max) (percentage) -10.00% 0.700 0.630 - 12.50% -
447.dealII -9.09% 22.000 20.000 - -83.33% -
447.dealII (avg) -9.09% 22.000 20.000 - -83.33% -
447.dealII (avg) (percentage) -8.00% 1.250 1.150 - -21.77% -
453.povray (max) (percentage) -7.33% 1.910 1.770 - -8.29% -
462.libquantum (max) (percentage) -6.37% 2.040 1.910 - 855.00% -
401.bzip2 (avg) (percentage) -5.10% 0.980 0.930 - 322.73% -
456.hmmer -5.06% 79.000 75.000 - 56.25% -
456.hmmer (avg) -5.06% 79.000 75.000 - 56.25% -
458.sjeng -5.05% 99.000 94.000 - -1.05% -
458.sjeng (avg) -5.05% 99.000 94.000 - -1.05% -
483.xalancbmk -5.05% 218.000 207.000 - 340.43% -
483.xalancbmk (avg) -5.05% 218.000 207.000 - 340.43% -
482.sphinx3 -5.00% 20.000 19.000 - -96.11% -
482.sphinx3 (avg) -5.00% 20.000 19.000 - -96.11% -
458.sjeng (avg) (percentage) -4.92% 1.220 1.160 - 100.00% -
473.astar -4.80% 229.000 218.000 - 207.04% -
473.astar (avg) -4.80% 229.000 218.000 - 207.04% -
473.astar (avg) (percentage) -4.78% 4.810 4.580 - 816.00% -
462.libquantum (avg) (percentage) -4.76% 1.890 1.800 - 1100.00% -
429.mcf -4.55% 66.000 63.000 - 18.87% -
429.mcf (avg) -4.55% 66.000 63.000 - 18.87% -
445.gobmk (avg) (percentage) -4.39% 1.140 1.090 - 505.56% -
444.namd -4.35% 23.000 22.000 - -95.72% -
444.namd (avg) -4.35% 23.000 22.000 - -95.72% -
444.namd (avg) (percentage) -4.31% 3.250 3.110 - -18.37% -
483.xalancbmk (avg) (percentage) -4.26% 6.110 5.850 - 1070.00% -
470.lbm -4.26% 94.000 90.000 - -72.05% -
470.lbm (avg) -4.26% 94.000 90.000 - -72.05% -
456.hmmer (avg) (percentage) -4.04% 2.230 2.140 - 494.44% -
429.mcf (avg) (percentage) -3.92% 5.610 5.390 - 1097.78% -
464.h264ref (avg) (percentage) -3.87% 1.550 1.490 - 351.52% -
401.bzip2 -3.85% 26.000 25.000 - -26.47% -
401.bzip2 (avg) -3.85% 26.000 25.000 - -26.47% -
471.omnetpp -3.68% 136.000 131.000 - 57.83% -
471.omnetpp (avg) -3.68% 136.000 131.000 - 57.83% -
464.h264ref -3.53% 85.000 82.000 - 60.78% -
464.h264ref (avg) -3.53% 85.000 82.000 - 60.78% -
445.gobmk -3.39% 59.000 57.000 - 159.09% -
445.gobmk (avg) -3.39% 59.000 57.000 - 159.09% -
470.lbm (avg) (percentage) -3.36% 2.980 2.880 - 24.14% -
401.bzip2 (max) (percentage) -3.08% 0.650 0.630 - 103.23% -
453.povray (avg) (percentage) -3.07% 1.630 1.580 - 15.33% -
445.gobmk (max) (percentage) -2.94% 0.340 0.330 - 37.50% -
471.omnetpp (avg) (percentage) -2.88% 4.860 4.720 - 505.13% -
482.sphinx3 (avg) (percentage) -2.67% 2.250 2.190 - 17.74% -
482.sphinx3 (max) (percentage) -2.61% 1.150 1.120 - -66.27% -
447.dealII (max) (percentage) -2.22% 0.900 0.880 - -44.30% -
403.gcc (max) (percentage) -1.14% 1.750 1.730 - 355.26% -
433.milc (avg) (percentage) -1.08% 0.930 0.920 - -8.91% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.70% 198708.000 202078.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (avg) (percentage) 1100.00% 0.150 1.800 - -4.76% -
429.mcf (avg) (percentage) 1097.78% 0.450 5.390 - -3.92% -
483.xalancbmk (avg) (percentage) 1070.00% 0.500 5.850 - -4.26% -
462.libquantum (max) (percentage) 855.00% 0.200 1.910 - -6.37% -
473.astar (avg) (percentage) 816.00% 0.500 4.580 - -4.78% -
445.gobmk (avg) (percentage) 505.56% 0.180 1.090 - -4.39% -
471.omnetpp (avg) (percentage) 505.13% 0.780 4.720 - -2.88% -
456.hmmer (avg) (percentage) 494.44% 0.360 2.140 - -4.04% -
456.hmmer (unexplained diff vs previous) (percentage) 471.43% 0.070 0.400 - 17.65% -
403.gcc (max) (percentage) 355.26% 0.380 1.730 - -1.14% -
464.h264ref (avg) (percentage) 351.52% 0.330 1.490 - -3.87% -
483.xalancbmk 340.43% 47.000 207.000 - -5.05% -
483.xalancbmk (avg) 340.43% 47.000 207.000 - -5.05% -
401.bzip2 (avg) (percentage) 322.73% 0.220 0.930 - -5.10% -
450.soplex (unexplained diff vs previous) (percentage) 303.51% 0.570 2.300 - 206.67% -
450.soplex (max) (percentage) 294.74% 0.570 2.250 - 100.89% -
464.h264ref (max) (percentage) 251.28% 0.390 1.370 - -77.50% -
473.astar 207.04% 71.000 218.000 - -4.80% -
473.astar (avg) 207.04% 71.000 218.000 - -4.80% -
456.hmmer (max) (percentage) 176.67% 0.300 0.830 - 0.00% -
445.gobmk 159.09% 22.000 57.000 - -3.39% -
445.gobmk (avg) 159.09% 22.000 57.000 - -3.39% -
403.gcc (avg) (percentage) 112.50% 0.480 1.020 - 0.00% -
401.bzip2 (max) (percentage) 103.23% 0.310 0.630 - -3.08% -
458.sjeng (avg) (percentage) 100.00% 0.580 1.160 - -4.92% -
464.h264ref 60.78% 51.000 82.000 - -3.53% -
464.h264ref (avg) 60.78% 51.000 82.000 - -3.53% -
471.omnetpp 57.83% 83.000 131.000 - -3.68% -
471.omnetpp (avg) 57.83% 83.000 131.000 - -3.68% -
456.hmmer 56.25% 48.000 75.000 - -5.06% -
456.hmmer (avg) 56.25% 48.000 75.000 - -5.06% -
456.hmmer (unexplained diff vs previous) 55.56% 9.000 14.000 - 16.67% -
450.soplex (avg) (percentage) 52.78% 0.360 0.550 - 14.58% -
483.xalancbmk (max) (percentage) 43.08% 0.650 0.930 - 0.00% -
445.gobmk (max) (percentage) 37.50% 0.240 0.330 - -2.94% -
483.xalancbmk (unexplained diff vs previous) (percentage) 33.85% 0.650 0.870 - 411.76% -
471.omnetpp (unexplained diff vs previous) (percentage) 33.72% 0.860 1.150 - -52.48% -
464.h264ref (max) 25.00% 60.000 75.000 - -77.68% -
470.lbm (avg) (percentage) 24.14% 2.320 2.880 - -3.36% -
429.mcf 18.87% 53.000 63.000 - -4.55% -
429.mcf (avg) 18.87% 53.000 63.000 - -4.55% -
482.sphinx3 (avg) (percentage) 17.74% 1.860 2.190 - -2.67% -
471.omnetpp (max) (percentage) 17.61% 1.760 2.070 - -16.53% -
453.povray (avg) (percentage) 15.33% 1.370 1.580 - -3.07% -
429.mcf (max) (percentage) 12.50% 0.560 0.630 - -10.00% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.68% 26756.000 25235.000 - 0.00% -
453.povray -2.63% 593097.000 577518.000 - 0.00% -
433.milc -2.43% 74971.000 73146.000 - 0.00% -
401.bzip2 -2.18% 39458.000 38597.000 - 0.00% -
447.dealII -1.63% 1777992.000 1749063.000 - 0.00% -
482.sphinx3 -1.23% 115736.000 114311.000 - 0.00% -
456.hmmer -1.18% 168072.000 166094.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.36% 9099.000 58.000 - -1.69% -
462.libquantum -99.25% 13126.000 98.000 - 0.00% -
482.sphinx3 -96.65% 26310.000 881.000 - -1.12% -
450.soplex -96.39% 14429.000 521.000 - -2.25% -
444.namd -94.69% 13495.000 716.000 - 0.56% -
453.povray -92.96% 6857.000 483.000 - 0.84% -
433.milc -91.35% 13482.000 1166.000 - 0.60% -
429.mcf -90.21% 11999.000 1175.000 - -0.25% -
401.bzip2 -82.55% 15683.000 2737.000 - 0.04% -
447.dealII -78.43% 8196.000 1768.000 - 0.00% -
470.lbm -77.29% 13882.000 3153.000 - -0.54% -
471.omnetpp -74.13% 10746.000 2780.000 - -1.14% -
456.hmmer -73.59% 13365.000 3530.000 - -0.40% -
473.astar -66.53% 14262.000 4773.000 - 0.13% -
464.h264ref -64.40% 15493.000 5516.000 - -0.13% -
483.xalancbmk -62.35% 9427.000 3549.000 - -0.87% -
445.gobmk -57.73% 12400.000 5242.000 - -0.23% -
458.sjeng -50.26% 16406.000 8160.000 - 0.11% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -99.55% 882.000 4.000 - 33.33% -
444.namd (unexplained diff vs previous) -99.52% 828.000 4.000 - 100.00% -
482.sphinx3 (max) -98.97% 873.000 9.000 - -10.00% -
482.sphinx3 (unexplained diff vs previous) -98.89% 904.000 10.000 - 233.33% -
401.bzip2 (unexplained diff vs previous) -97.96% 49.000 1.000 - -75.00% -
470.lbm (max) -97.14% 769.000 22.000 - -54.17% -
403.gcc (max) -97.06% 34.000 1.000 - 0.00% -
453.povray (unexplained diff vs previous) -96.92% 130.000 4.000 - -55.56% -
433.milc (max) -96.74% 184.000 6.000 - 0.00% -
470.lbm (unexplained diff vs previous) -96.58% 497.000 17.000 - -32.00% -
433.milc (unexplained diff vs previous) -96.15% 182.000 7.000 - 0.00% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
482.sphinx3 -96.11% 489.000 19.000 - -5.00% -
482.sphinx3 (avg) -96.11% 489.000 19.000 - -5.00% -
450.soplex -96.08% 51.000 2.000 - 0.00% -
450.soplex (avg) -96.08% 51.000 2.000 - 0.00% -
444.namd -95.72% 514.000 22.000 - -4.35% -
444.namd (avg) -95.72% 514.000 22.000 - -4.35% -
429.mcf (unexplained diff vs previous) -95.52% 67.000 3.000 - 50.00% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
473.astar (unexplained diff vs previous) -94.44% 108.000 6.000 - -64.71% -
453.povray (max) -93.94% 132.000 8.000 - -11.11% -
433.milc -92.65% 136.000 10.000 - 0.00% -
433.milc (avg) -92.65% 136.000 10.000 - 0.00% -
453.povray -92.47% 93.000 7.000 - 0.00% -
453.povray (avg) -92.47% 93.000 7.000 - 0.00% -
444.namd (max) (percentage) -91.44% 6.540 0.560 - 19.15% -
444.namd (unexplained diff vs previous) (percentage) -90.88% 6.140 0.560 - 100.00% -
429.mcf (max) -89.55% 67.000 7.000 - -12.50% -
447.dealII (max) -88.37% 129.000 15.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -88.33% 60.000 7.000 - -22.22% -
470.lbm (max) (percentage) -87.18% 5.540 0.710 - -53.29% -
401.bzip2 (unexplained diff vs previous) (percentage) -87.10% 0.310 0.040 - -73.33% -
473.astar (max) -86.84% 114.000 15.000 - -66.67% -
450.soplex (max) -86.59% 82.000 11.000 - 120.00% -
450.soplex (unexplained diff vs previous) -85.37% 82.000 12.000 - 200.00% -
470.lbm (unexplained diff vs previous) (percentage) -84.92% 3.580 0.540 - -31.65% -
447.dealII -83.33% 120.000 20.000 - -9.09% -
447.dealII (avg) -83.33% 120.000 20.000 - -9.09% -
473.astar (unexplained diff vs previous) (percentage) -82.89% 0.760 0.130 - -63.89% -
458.sjeng (unexplained diff vs previous) -78.05% 41.000 9.000 - -59.09% -
470.lbm -72.05% 322.000 90.000 - -4.26% -
470.lbm (avg) -72.05% 322.000 90.000 - -4.26% -
471.omnetpp (max) -69.84% 189.000 57.000 - -17.39% -
458.sjeng (max) -67.69% 65.000 21.000 - -90.28% -
482.sphinx3 (unexplained diff vs previous) (percentage) -66.86% 3.440 1.140 - 235.29% -
464.h264ref (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - -18.75% -
482.sphinx3 (max) (percentage) -66.27% 3.320 1.120 - -2.61% -
471.omnetpp (unexplained diff vs previous) -65.22% 92.000 32.000 - -52.94% -
401.bzip2 (max) -64.58% 48.000 17.000 - 0.00% -
445.gobmk (unexplained diff vs previous) -60.00% 30.000 12.000 - 200.00% -
473.astar (max) (percentage) -58.75% 0.800 0.330 - -65.62% -
453.povray (unexplained diff vs previous) (percentage) -56.32% 1.900 0.830 - -55.85% -
433.milc (max) (percentage) -56.20% 1.370 0.600 - 0.00% -
458.sjeng (unexplained diff vs previous) (percentage) -56.00% 0.250 0.110 - -59.26% -
433.milc (unexplained diff vs previous) (percentage) -55.56% 1.350 0.600 - 0.00% -
429.mcf (unexplained diff vs previous) (percentage) -53.57% 0.560 0.260 - 52.94% -
483.xalancbmk (unexplained diff vs previous) -49.18% 61.000 31.000 - 416.67% -
483.xalancbmk (max) -45.90% 61.000 33.000 - 0.00% -
447.dealII (max) (percentage) -44.30% 1.580 0.880 - -2.22% -
445.gobmk (max) -41.38% 29.000 17.000 - 0.00% -
458.sjeng (max) (percentage) -35.00% 0.400 0.260 - -90.23% -
456.hmmer (max) -27.50% 40.000 29.000 - 0.00% -
401.bzip2 -26.47% 34.000 25.000 - -3.85% -
401.bzip2 (avg) -26.47% 34.000 25.000 - -3.85% -
447.dealII (avg) (percentage) -21.77% 1.470 1.150 - -8.00% -
444.namd (avg) (percentage) -18.37% 3.810 3.110 - -4.31% -
433.milc (avg) (percentage) -8.91% 1.010 0.920 - -1.08% -
453.povray (max) (percentage) -8.29% 1.930 1.770 - -7.33% -
458.sjeng -1.05% 95.000 94.000 - -5.05% -
458.sjeng (avg) -1.05% 95.000 94.000 - -5.05% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.36s
Execution (seconds)
Name Current %
401.bzip2 2737.000 -
403.gcc 58.000 -1.69%
429.mcf 1175.000 -
433.milc 1166.000 -
444.namd 716.000 -
445.gobmk 5242.000 -
447.dealII 1768.000 -
450.soplex 521.000 -2.25%
453.povray 483.000 -
456.hmmer 3530.000 -
458.sjeng 8160.000 -
462.libquantum 98.000 -
464.h264ref 5516.000 -
470.lbm 3153.000 -
471.omnetpp 2780.000 -1.14%
473.astar 4773.000 -
482.sphinx3 881.000 -1.12%
483.xalancbmk 3549.000 -
Geometric Mean 1443.421 -
Code Size (bytes)
Name Current %
401.bzip2 38597.000 -
403.gcc 1958565.000 -
429.mcf 7910.000 -
433.milc 73146.000 -
444.namd 175777.000 -
445.gobmk 1310136.000 -
447.dealII 1749063.000 -
450.soplex 202078.000 -
453.povray 577518.000 -
456.hmmer 166094.000 -
458.sjeng 96921.000 -
462.libquantum 25235.000 -
464.h264ref 352974.000 -
470.lbm 9734.000 -
471.omnetpp 376547.000 -
473.astar 23199.000 -
482.sphinx3 114311.000 -
483.xalancbmk 2286472.000 -
Geometric Mean 162937.495 -
sample variability
Name Current %
401.bzip2 25.000 -3.85%
401.bzip2 (avg) 25.000 -3.85%
401.bzip2 (avg) (percentage) 0.930 -5.10%
401.bzip2 (max) 17.000 -
401.bzip2 (max) (percentage) 0.630 -3.08%
401.bzip2 (unexplained diff vs previous) 1.000 -75.00%
401.bzip2 (unexplained diff vs previous) (percentage) 0.040 -73.33%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.020 -
403.gcc (max) 1.000 -
403.gcc (max) (percentage) 1.730 -1.14%
429.mcf 63.000 -4.55%
429.mcf (avg) 63.000 -4.55%
429.mcf (avg) (percentage) 5.390 -3.92%
429.mcf (max) 7.000 -12.50%
429.mcf (max) (percentage) 0.630 -10.00%
429.mcf (unexplained diff vs previous) 3.000 50.00%
429.mcf (unexplained diff vs previous) (percentage) 0.260 52.94%
433.milc 10.000 -
433.milc (avg) 10.000 -
433.milc (avg) (percentage) 0.920 -1.08%
433.milc (max) 6.000 -
433.milc (max) (percentage) 0.600 -
433.milc (unexplained diff vs previous) 7.000 -
433.milc (unexplained diff vs previous) (percentage) 0.600 -
444.namd 22.000 -4.35%
444.namd (avg) 22.000 -4.35%
444.namd (avg) (percentage) 3.110 -4.31%
444.namd (max) 4.000 33.33%
444.namd (max) (percentage) 0.560 19.15%
444.namd (unexplained diff vs previous) 4.000 100.00%
444.namd (unexplained diff vs previous) (percentage) 0.560 100.00%
445.gobmk 57.000 -3.39%
445.gobmk (avg) 57.000 -3.39%
445.gobmk (avg) (percentage) 1.090 -4.39%
445.gobmk (max) 17.000 -
445.gobmk (max) (percentage) 0.330 -2.94%
445.gobmk (unexplained diff vs previous) 12.000 200.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.230 187.50%
447.dealII 20.000 -9.09%
447.dealII (avg) 20.000 -9.09%
447.dealII (avg) (percentage) 1.150 -8.00%
447.dealII (max) 15.000 -
447.dealII (max) (percentage) 0.880 -2.22%
447.dealII (unexplained diff vs previous) 0.000 -
447.dealII (unexplained diff vs previous) (percentage) 0.000 -
450.soplex 2.000 -
450.soplex (avg) 2.000 -
450.soplex (avg) (percentage) 0.550 14.58%
450.soplex (max) 11.000 120.00%
450.soplex (max) (percentage) 2.250 100.89%
450.soplex (unexplained diff vs previous) 12.000 200.00%
450.soplex (unexplained diff vs previous) (percentage) 2.300 206.67%
453.povray 7.000 -
453.povray (avg) 7.000 -
453.povray (avg) (percentage) 1.580 -3.07%
453.povray (max) 8.000 -11.11%
453.povray (max) (percentage) 1.770 -7.33%
453.povray (unexplained diff vs previous) 4.000 -55.56%
453.povray (unexplained diff vs previous) (percentage) 0.830 -55.85%
456.hmmer 75.000 -5.06%
456.hmmer (avg) 75.000 -5.06%
456.hmmer (avg) (percentage) 2.140 -4.04%
456.hmmer (max) 29.000 -
456.hmmer (max) (percentage) 0.830 -
456.hmmer (unexplained diff vs previous) 14.000 16.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.400 17.65%
458.sjeng 94.000 -5.05%
458.sjeng (avg) 94.000 -5.05%
458.sjeng (avg) (percentage) 1.160 -4.92%
458.sjeng (max) 21.000 -90.28%
458.sjeng (max) (percentage) 0.260 -90.23%
458.sjeng (unexplained diff vs previous) 9.000 -59.09%
458.sjeng (unexplained diff vs previous) (percentage) 0.110 -59.26%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.800 -4.76%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.910 -6.37%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 82.000 -3.53%
464.h264ref (avg) 82.000 -3.53%
464.h264ref (avg) (percentage) 1.490 -3.87%
464.h264ref (max) 75.000 -77.68%
464.h264ref (max) (percentage) 1.370 -77.50%
464.h264ref (unexplained diff vs previous) 7.000 -22.22%
464.h264ref (unexplained diff vs previous) (percentage) 0.130 -18.75%
470.lbm 90.000 -4.26%
470.lbm (avg) 90.000 -4.26%
470.lbm (avg) (percentage) 2.880 -3.36%
470.lbm (max) 22.000 -54.17%
470.lbm (max) (percentage) 0.710 -53.29%
470.lbm (unexplained diff vs previous) 17.000 -32.00%
470.lbm (unexplained diff vs previous) (percentage) 0.540 -31.65%
471.omnetpp 131.000 -3.68%
471.omnetpp (avg) 131.000 -3.68%
471.omnetpp (avg) (percentage) 4.720 -2.88%
471.omnetpp (max) 57.000 -17.39%
471.omnetpp (max) (percentage) 2.070 -16.53%
471.omnetpp (unexplained diff vs previous) 32.000 -52.94%
471.omnetpp (unexplained diff vs previous) (percentage) 1.150 -52.48%
473.astar 218.000 -4.80%
473.astar (avg) 218.000 -4.80%
473.astar (avg) (percentage) 4.580 -4.78%
473.astar (max) 15.000 -66.67%
473.astar (max) (percentage) 0.330 -65.62%
473.astar (unexplained diff vs previous) 6.000 -64.71%
473.astar (unexplained diff vs previous) (percentage) 0.130 -63.89%
482.sphinx3 19.000 -5.00%
482.sphinx3 (avg) 19.000 -5.00%
482.sphinx3 (avg) (percentage) 2.190 -2.67%
482.sphinx3 (max) 9.000 -10.00%
482.sphinx3 (max) (percentage) 1.120 -2.61%
482.sphinx3 (unexplained diff vs previous) 10.000 233.33%
482.sphinx3 (unexplained diff vs previous) (percentage) 1.140 235.29%
483.xalancbmk 207.000 -5.05%
483.xalancbmk (avg) 207.000 -5.05%
483.xalancbmk (avg) (percentage) 5.850 -4.26%
483.xalancbmk (max) 33.000 -
483.xalancbmk (max) (percentage) 0.930 -
483.xalancbmk (unexplained diff vs previous) 31.000 416.67%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.870 411.76%
Geometric Mean 2.910 -45.81%