Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/65f40cb455f8eaf83c163793d19640b56393c1e5 (+ 1 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6--llvm-arm-master-Os-build/41/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0041 (llvmorg-17-init-12757-g65f40cb455f8) 2023-05-27T03:41:43 0:00:00
Previous 0040 (llvmorg-17-init-12756-gbdc2771911cb) 2023-05-26T01:56:50 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 22 42
Performance Improvements 87 104
Added Tests 4 4
Unchanged Tests 667 630
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 3.28% 61.000 63.000 - -99.31% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
482.sphinx3 (max) 166.67% 3.000 8.000 - -99.08% -
482.sphinx3 (unexplained diff vs previous) 166.67% 3.000 8.000 - -99.12% -
482.sphinx3 (unexplained diff vs previous) (percentage) 164.71% 0.340 0.900 - -73.84% -
456.hmmer (unexplained diff vs previous) (percentage) 109.09% 0.110 0.230 - 228.57% -
482.sphinx3 (max) (percentage) 102.22% 0.450 0.910 - -72.59% -
456.hmmer (unexplained diff vs previous) 100.00% 4.000 8.000 - -11.11% -
473.astar (max) (percentage) 61.90% 0.210 0.340 - -57.50% -
470.lbm (max) 61.54% 13.000 21.000 - -97.27% -
470.lbm (unexplained diff vs previous) 61.54% 13.000 21.000 - -95.77% -
470.lbm (unexplained diff vs previous) (percentage) 60.98% 0.410 0.660 - -81.56% -
447.dealII (unexplained diff vs previous) 60.00% 5.000 8.000 - -93.39% -
473.astar (max) 60.00% 10.000 16.000 - -85.96% -
473.astar (unexplained diff vs previous) 60.00% 10.000 16.000 - -85.19% -
447.dealII (unexplained diff vs previous) (percentage) 58.62% 0.290 0.460 - -68.92% -
473.astar (unexplained diff vs previous) (percentage) 57.14% 0.210 0.330 - -56.58% -
470.lbm (max) (percentage) 52.27% 0.440 0.670 - -87.91% -
445.gobmk (unexplained diff vs previous) (percentage) 47.06% 0.170 0.250 - 4.17% -
445.gobmk (unexplained diff vs previous) 44.44% 9.000 13.000 - -56.67% -
445.gobmk (max) (percentage) 8.70% 0.230 0.250 - 4.17% -
445.gobmk (max) 8.33% 12.000 13.000 - -55.17% -
450.soplex (avg) (percentage) 2.90% 0.690 0.710 - 97.22% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
450.soplex -1.13% 529.000 523.000 - -96.38% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
464.h264ref (unexplained diff vs previous) -85.71% 7.000 1.000 - -98.33% -
464.h264ref (unexplained diff vs previous) (percentage) -84.62% 0.130 0.020 - -94.87% -
429.mcf (unexplained diff vs previous) (percentage) -80.82% 2.190 0.420 - -25.00% -
429.mcf (unexplained diff vs previous) -80.77% 26.000 5.000 - -92.54% -
471.omnetpp (unexplained diff vs previous) -76.92% 13.000 3.000 - -96.74% -
471.omnetpp (unexplained diff vs previous) (percentage) -76.60% 0.470 0.110 - -87.21% -
450.soplex (unexplained diff vs previous) -71.43% 21.000 6.000 - -92.68% -
450.soplex (unexplained diff vs previous) (percentage) -71.03% 3.970 1.150 - 101.75% -
483.xalancbmk (unexplained diff vs previous) (percentage) -70.83% 0.480 0.140 - -78.46% -
483.xalancbmk (unexplained diff vs previous) -70.59% 17.000 5.000 - -91.80% -
444.namd (unexplained diff vs previous) -66.67% 3.000 1.000 - -99.88% -
444.namd (unexplained diff vs previous) (percentage) -66.67% 0.420 0.140 - -97.72% -
453.povray (unexplained diff vs previous) -57.14% 7.000 3.000 - -97.69% -
453.povray (unexplained diff vs previous) (percentage) -57.05% 1.490 0.640 - -66.32% -
401.bzip2 (unexplained diff vs previous) (percentage) -45.45% 0.330 0.180 - -41.94% -
401.bzip2 (unexplained diff vs previous) -44.44% 9.000 5.000 - -89.80% -
433.milc (unexplained diff vs previous) -33.33% 6.000 4.000 - -97.80% -
433.milc (unexplained diff vs previous) (percentage) -32.69% 0.520 0.350 - -74.07% -
401.bzip2 (max) -22.22% 9.000 7.000 - -85.42% -
401.bzip2 (max) (percentage) -18.18% 0.330 0.270 - -12.90% -
433.milc (max) -16.67% 6.000 5.000 - -97.28% -
462.libquantum (max) (percentage) -16.50% 2.000 1.670 - 735.00% -
458.sjeng (unexplained diff vs previous) -15.87% 63.000 53.000 - 29.27% -
458.sjeng (unexplained diff vs previous) (percentage) -15.58% 0.770 0.650 - 160.00% -
450.soplex (max) -14.29% 21.000 18.000 - -78.05% -
453.povray -14.29% 7.000 6.000 - -93.55% -
453.povray (avg) -14.29% 7.000 6.000 - -93.55% -
453.povray (max) -14.29% 7.000 6.000 - -95.45% -
450.soplex (max) (percentage) -12.59% 4.130 3.610 - 533.33% -
433.milc (max) (percentage) -11.54% 0.520 0.460 - -66.42% -
453.povray (max) (percentage) -9.87% 1.520 1.370 - -29.02% -
429.mcf (max) (percentage) -8.48% 2.240 2.050 - 266.07% -
429.mcf (max) -7.69% 26.000 24.000 - -64.18% -
458.sjeng (max) -7.37% 95.000 88.000 - 35.38% -
458.sjeng (max) (percentage) -6.84% 1.170 1.090 - 172.50% -
482.sphinx3 -5.88% 17.000 16.000 - -96.73% -
482.sphinx3 (avg) -5.88% 17.000 16.000 - -96.73% -
447.dealII -5.56% 18.000 17.000 - -85.83% -
447.dealII (avg) -5.56% 18.000 17.000 - -85.83% -
444.namd (max) (percentage) -5.37% 1.490 1.410 - -78.44% -
447.dealII (max) (percentage) -5.26% 0.570 0.540 - -65.82% -
444.namd -5.00% 20.000 19.000 - -96.30% -
444.namd (avg) -5.00% 20.000 19.000 - -96.30% -
471.omnetpp (max) -5.00% 20.000 19.000 - -89.95% -
483.xalancbmk (max) -5.00% 20.000 19.000 - -68.85% -
444.namd (avg) (percentage) -4.61% 2.820 2.690 - -29.40% -
401.bzip2 -4.55% 22.000 21.000 - -38.24% -
401.bzip2 (avg) -4.55% 22.000 21.000 - -38.24% -
483.xalancbmk (avg) (percentage) -4.49% 5.120 4.890 - 878.00% -
462.libquantum (avg) (percentage) -4.47% 1.790 1.710 - 1040.00% -
483.xalancbmk -4.40% 182.000 174.000 - 270.21% -
483.xalancbmk (avg) -4.40% 182.000 174.000 - 270.21% -
471.omnetpp (max) (percentage) -4.17% 0.720 0.690 - -60.80% -
473.astar (avg) (percentage) -4.01% 3.990 3.830 - 666.00% -
447.dealII (avg) (percentage) -3.81% 1.050 1.010 - -31.29% -
464.h264ref (avg) (percentage) -3.79% 1.320 1.270 - 284.85% -
456.hmmer (avg) (percentage) -3.72% 1.880 1.810 - 402.78% -
401.bzip2 (avg) (percentage) -3.70% 0.810 0.780 - 254.55% -
456.hmmer (max) (percentage) -3.70% 0.270 0.260 - -13.33% -
464.h264ref (max) (percentage) -3.70% 0.270 0.260 - -33.33% -
473.astar -3.68% 190.000 183.000 - 157.75% -
473.astar (avg) -3.68% 190.000 183.000 - 157.75% -
429.mcf -3.57% 56.000 54.000 - 1.89% -
429.mcf (avg) -3.57% 56.000 54.000 - 1.89% -
483.xalancbmk (max) (percentage) -3.45% 0.580 0.560 - -13.85% -
471.omnetpp -3.36% 119.000 115.000 - 38.55% -
471.omnetpp (avg) -3.36% 119.000 115.000 - 38.55% -
429.mcf (avg) (percentage) -3.35% 4.770 4.610 - 924.44% -
453.povray (avg) (percentage) -3.33% 1.500 1.450 - 5.84% -
471.omnetpp (avg) (percentage) -3.26% 4.290 4.150 - 432.05% -
458.sjeng -3.19% 94.000 91.000 - -4.21% -
458.sjeng (avg) -3.19% 94.000 91.000 - -4.21% -
445.gobmk (avg) (percentage) -3.16% 0.950 0.920 - 411.11% -
456.hmmer -3.03% 66.000 64.000 - 33.33% -
456.hmmer (avg) -3.03% 66.000 64.000 - 33.33% -
464.h264ref -2.78% 72.000 70.000 - 37.25% -
464.h264ref (avg) -2.78% 72.000 70.000 - 37.25% -
470.lbm (avg) (percentage) -2.76% 2.540 2.470 - 6.47% -
482.sphinx3 (avg) (percentage) -2.59% 1.930 1.880 - 1.08% -
458.sjeng (avg) (percentage) -2.59% 1.160 1.130 - 94.83% -
470.lbm -2.50% 80.000 78.000 - -75.78% -
470.lbm (avg) -2.50% 80.000 78.000 - -75.78% -
445.gobmk -2.04% 49.000 48.000 - 118.18% -
445.gobmk (avg) -2.04% 49.000 48.000 - 118.18% -
403.gcc (max) (percentage) -1.74% 5.170 5.080 - 1236.84% -
433.milc (avg) (percentage) -1.20% 0.830 0.820 - -18.81% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 1.73% 198708.000 202150.000 - 0.00% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
403.gcc (max) (percentage) 1236.84% 0.380 5.080 - -1.74% -
462.libquantum (avg) (percentage) 1040.00% 0.150 1.710 - -4.47% -
429.mcf (avg) (percentage) 924.44% 0.450 4.610 - -3.35% -
483.xalancbmk (avg) (percentage) 878.00% 0.500 4.890 - -4.49% -
462.libquantum (max) (percentage) 735.00% 0.200 1.670 - -16.50% -
473.astar (avg) (percentage) 666.00% 0.500 3.830 - -4.01% -
450.soplex (max) (percentage) 533.33% 0.570 3.610 - -12.59% -
471.omnetpp (avg) (percentage) 432.05% 0.780 4.150 - -3.26% -
445.gobmk (avg) (percentage) 411.11% 0.180 0.920 - -3.16% -
456.hmmer (avg) (percentage) 402.78% 0.360 1.810 - -3.72% -
464.h264ref (avg) (percentage) 284.85% 0.330 1.270 - -3.79% -
483.xalancbmk 270.21% 47.000 174.000 - -4.40% -
483.xalancbmk (avg) 270.21% 47.000 174.000 - -4.40% -
429.mcf (max) (percentage) 266.07% 0.560 2.050 - -8.48% -
401.bzip2 (avg) (percentage) 254.55% 0.220 0.780 - -3.70% -
456.hmmer (unexplained diff vs previous) (percentage) 228.57% 0.070 0.230 - 109.09% -
403.gcc (avg) (percentage) 206.25% 0.480 1.470 - 0.00% -
458.sjeng (max) (percentage) 172.50% 0.400 1.090 - -6.84% -
458.sjeng (unexplained diff vs previous) (percentage) 160.00% 0.250 0.650 - -15.58% -
473.astar 157.75% 71.000 183.000 - -3.68% -
473.astar (avg) 157.75% 71.000 183.000 - -3.68% -
445.gobmk 118.18% 22.000 48.000 - -2.04% -
445.gobmk (avg) 118.18% 22.000 48.000 - -2.04% -
450.soplex (unexplained diff vs previous) (percentage) 101.75% 0.570 1.150 - -71.03% -
450.soplex (avg) (percentage) 97.22% 0.360 0.710 - 2.90% -
458.sjeng (avg) (percentage) 94.83% 0.580 1.130 - -2.59% -
471.omnetpp 38.55% 83.000 115.000 - -3.36% -
471.omnetpp (avg) 38.55% 83.000 115.000 - -3.36% -
464.h264ref 37.25% 51.000 70.000 - -2.78% -
464.h264ref (avg) 37.25% 51.000 70.000 - -2.78% -
458.sjeng (max) 35.38% 65.000 88.000 - -7.37% -
456.hmmer 33.33% 48.000 64.000 - -3.03% -
456.hmmer (avg) 33.33% 48.000 64.000 - -3.03% -
458.sjeng (unexplained diff vs previous) 29.27% 41.000 53.000 - -15.87% -
470.lbm (avg) (percentage) 6.47% 2.320 2.470 - -2.76% -
453.povray (avg) (percentage) 5.84% 1.370 1.450 - -3.33% -
445.gobmk (max) (percentage) 4.17% 0.240 0.250 - 8.70% -
445.gobmk (unexplained diff vs previous) (percentage) 4.17% 0.240 0.250 - 47.06% -
429.mcf 1.89% 53.000 54.000 - -3.57% -
429.mcf (avg) 1.89% 53.000 54.000 - -3.57% -
482.sphinx3 (avg) (percentage) 1.08% 1.860 1.880 - -2.59% -

Performance Improvements - Code Size Δ (B) Baseline Current σ (B) Δ σ
462.libquantum -5.60% 26756.000 25259.000 - 0.00% -
453.povray -2.60% 593097.000 577690.000 - 0.00% -
433.milc -2.43% 74971.000 73146.000 - 0.00% -
401.bzip2 -2.13% 39458.000 38617.000 - 0.00% -
447.dealII -1.59% 1777992.000 1749739.000 - 0.00% -
482.sphinx3 -1.14% 115736.000 114415.000 - 0.00% -
456.hmmer -1.11% 168072.000 166198.000 - 0.00% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
403.gcc -99.31% 9099.000 63.000 - 3.28% -
462.libquantum -99.25% 13126.000 98.000 - 0.00% -
482.sphinx3 -96.62% 26310.000 890.000 - 0.91% -
450.soplex -96.38% 14429.000 523.000 - -1.13% -
444.namd -94.69% 13495.000 717.000 - 0.14% -
453.povray -93.20% 6857.000 466.000 - -0.64% -
433.milc -91.40% 13482.000 1159.000 - -0.34% -
429.mcf -90.16% 11999.000 1181.000 - -0.42% -
401.bzip2 -82.52% 15683.000 2742.000 - 0.18% -
447.dealII -78.72% 8196.000 1744.000 - -0.46% -
470.lbm -77.13% 13882.000 3175.000 - 0.67% -
471.omnetpp -74.12% 10746.000 2781.000 - 0.11% -
456.hmmer -73.51% 13365.000 3541.000 - 0.23% -
473.astar -66.48% 14262.000 4780.000 - 0.34% -
464.h264ref -64.36% 15493.000 5521.000 - 0.02% -
483.xalancbmk -62.17% 9427.000 3566.000 - 0.14% -
445.gobmk -57.66% 12400.000 5250.000 - 0.25% -
458.sjeng -50.43% 16406.000 8132.000 - -0.65% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (unexplained diff vs previous) -99.88% 828.000 1.000 - -66.67% -
482.sphinx3 (unexplained diff vs previous) -99.12% 904.000 8.000 - 166.67% -
482.sphinx3 (max) -99.08% 873.000 8.000 - 166.67% -
444.namd (max) -98.87% 882.000 10.000 - 0.00% -
464.h264ref (unexplained diff vs previous) -98.33% 60.000 1.000 - -85.71% -
433.milc (unexplained diff vs previous) -97.80% 182.000 4.000 - -33.33% -
444.namd (unexplained diff vs previous) (percentage) -97.72% 6.140 0.140 - -66.67% -
453.povray (unexplained diff vs previous) -97.69% 130.000 3.000 - -57.14% -
433.milc (max) -97.28% 184.000 5.000 - -16.67% -
470.lbm (max) -97.27% 769.000 21.000 - 61.54% -
471.omnetpp (unexplained diff vs previous) -96.74% 92.000 3.000 - -76.92% -
482.sphinx3 -96.73% 489.000 16.000 - -5.88% -
482.sphinx3 (avg) -96.73% 489.000 16.000 - -5.88% -
444.namd -96.30% 514.000 19.000 - -5.00% -
444.namd (avg) -96.30% 514.000 19.000 - -5.00% -
462.libquantum (max) -96.15% 26.000 1.000 - 0.00% -
470.lbm (unexplained diff vs previous) -95.77% 497.000 21.000 - 61.54% -
453.povray (max) -95.45% 132.000 6.000 - -14.29% -
464.h264ref (unexplained diff vs previous) (percentage) -94.87% 0.390 0.020 - -84.62% -
462.libquantum -94.74% 19.000 1.000 - 0.00% -
462.libquantum (avg) -94.74% 19.000 1.000 - 0.00% -
450.soplex -94.12% 51.000 3.000 - 0.00% -
450.soplex (avg) -94.12% 51.000 3.000 - 0.00% -
453.povray -93.55% 93.000 6.000 - -14.29% -
453.povray (avg) -93.55% 93.000 6.000 - -14.29% -
447.dealII (unexplained diff vs previous) -93.39% 121.000 8.000 - 60.00% -
433.milc -93.38% 136.000 9.000 - 0.00% -
433.milc (avg) -93.38% 136.000 9.000 - 0.00% -
447.dealII (max) -93.02% 129.000 9.000 - 0.00% -
450.soplex (unexplained diff vs previous) -92.68% 82.000 6.000 - -71.43% -
429.mcf (unexplained diff vs previous) -92.54% 67.000 5.000 - -80.77% -
483.xalancbmk (unexplained diff vs previous) -91.80% 61.000 5.000 - -70.59% -
403.gcc (max) -91.18% 34.000 3.000 - 0.00% -
471.omnetpp (max) -89.95% 189.000 19.000 - -5.00% -
401.bzip2 (unexplained diff vs previous) -89.80% 49.000 5.000 - -44.44% -
470.lbm (max) (percentage) -87.91% 5.540 0.670 - 52.27% -
471.omnetpp (unexplained diff vs previous) (percentage) -87.21% 0.860 0.110 - -76.60% -
473.astar (max) -85.96% 114.000 16.000 - 60.00% -
447.dealII -85.83% 120.000 17.000 - -5.56% -
447.dealII (avg) -85.83% 120.000 17.000 - -5.56% -
401.bzip2 (max) -85.42% 48.000 7.000 - -22.22% -
473.astar (unexplained diff vs previous) -85.19% 108.000 16.000 - 60.00% -
470.lbm (unexplained diff vs previous) (percentage) -81.56% 3.580 0.660 - 60.98% -
483.xalancbmk (unexplained diff vs previous) (percentage) -78.46% 0.650 0.140 - -70.83% -
444.namd (max) (percentage) -78.44% 6.540 1.410 - -5.37% -
450.soplex (max) -78.05% 82.000 18.000 - -14.29% -
456.hmmer (max) -77.50% 40.000 9.000 - 0.00% -
464.h264ref (max) -76.67% 60.000 14.000 - 0.00% -
470.lbm -75.78% 322.000 78.000 - -2.50% -
470.lbm (avg) -75.78% 322.000 78.000 - -2.50% -
433.milc (unexplained diff vs previous) (percentage) -74.07% 1.350 0.350 - -32.69% -
482.sphinx3 (unexplained diff vs previous) (percentage) -73.84% 3.440 0.900 - 164.71% -
482.sphinx3 (max) (percentage) -72.59% 3.320 0.910 - 102.22% -
447.dealII (unexplained diff vs previous) (percentage) -68.92% 1.480 0.460 - 58.62% -
483.xalancbmk (max) -68.85% 61.000 19.000 - -5.00% -
433.milc (max) (percentage) -66.42% 1.370 0.460 - -11.54% -
453.povray (unexplained diff vs previous) (percentage) -66.32% 1.900 0.640 - -57.05% -
447.dealII (max) (percentage) -65.82% 1.580 0.540 - -5.26% -
429.mcf (max) -64.18% 67.000 24.000 - -7.69% -
471.omnetpp (max) (percentage) -60.80% 1.760 0.690 - -4.17% -
473.astar (max) (percentage) -57.50% 0.800 0.340 - 61.90% -
445.gobmk (unexplained diff vs previous) -56.67% 30.000 13.000 - 44.44% -
473.astar (unexplained diff vs previous) (percentage) -56.58% 0.760 0.330 - 57.14% -
445.gobmk (max) -55.17% 29.000 13.000 - 8.33% -
401.bzip2 (unexplained diff vs previous) (percentage) -41.94% 0.310 0.180 - -45.45% -
401.bzip2 -38.24% 34.000 21.000 - -4.55% -
401.bzip2 (avg) -38.24% 34.000 21.000 - -4.55% -
464.h264ref (max) (percentage) -33.33% 0.390 0.260 - -3.70% -
447.dealII (avg) (percentage) -31.29% 1.470 1.010 - -3.81% -
444.namd (avg) (percentage) -29.40% 3.810 2.690 - -4.61% -
453.povray (max) (percentage) -29.02% 1.930 1.370 - -9.87% -
429.mcf (unexplained diff vs previous) (percentage) -25.00% 0.560 0.420 - -80.82% -
433.milc (avg) (percentage) -18.81% 1.010 0.820 - -1.20% -
483.xalancbmk (max) (percentage) -13.85% 0.650 0.560 - -3.45% -
456.hmmer (max) (percentage) -13.33% 0.300 0.260 - -3.70% -
401.bzip2 (max) (percentage) -12.90% 0.310 0.270 - -18.18% -
456.hmmer (unexplained diff vs previous) -11.11% 9.000 8.000 - 100.00% -
458.sjeng -4.21% 95.000 91.000 - -3.19% -
458.sjeng (avg) -4.21% 95.000 91.000 - -3.19% -

Added Tests - sample variability
403.gcc
403.gcc (avg)
462.libquantum (unexplained diff vs previous)
462.libquantum (unexplained diff vs previous) (percentage)

Report Time: 0.51s
Execution (seconds)
Name Current %
401.bzip2 2742.000 -
403.gcc 63.000 3.28%
429.mcf 1181.000 -
433.milc 1159.000 -
444.namd 717.000 -
445.gobmk 5250.000 -
447.dealII 1744.000 -
450.soplex 523.000 -1.13%
453.povray 466.000 -
456.hmmer 3541.000 -
458.sjeng 8132.000 -
462.libquantum 98.000 -
464.h264ref 5521.000 -
470.lbm 3175.000 -
471.omnetpp 2781.000 -
473.astar 4780.000 -
482.sphinx3 890.000 -
483.xalancbmk 3566.000 -
Geometric Mean 1448.654 -
Code Size (bytes)
Name Current %
401.bzip2 38617.000 -
403.gcc 1958329.000 -
429.mcf 7910.000 -
433.milc 73146.000 -
444.namd 175785.000 -
445.gobmk 1310176.000 -
447.dealII 1749739.000 -
450.soplex 202150.000 -
453.povray 577690.000 -
456.hmmer 166198.000 -
458.sjeng 96929.000 -
462.libquantum 25259.000 -
464.h264ref 352774.000 -
470.lbm 9734.000 -
471.omnetpp 376623.000 -
473.astar 23203.000 -
482.sphinx3 114415.000 -
483.xalancbmk 2286960.000 -
Geometric Mean 162974.643 -
sample variability
Name Current %
401.bzip2 21.000 -4.55%
401.bzip2 (avg) 21.000 -4.55%
401.bzip2 (avg) (percentage) 0.780 -3.70%
401.bzip2 (max) 7.000 -22.22%
401.bzip2 (max) (percentage) 0.270 -18.18%
401.bzip2 (unexplained diff vs previous) 5.000 -44.44%
401.bzip2 (unexplained diff vs previous) (percentage) 0.180 -45.45%
403.gcc 0.000 -
403.gcc (avg) 0.000 -
403.gcc (avg) (percentage) 1.470 -
403.gcc (max) 3.000 -
403.gcc (max) (percentage) 5.080 -1.74%
429.mcf 54.000 -3.57%
429.mcf (avg) 54.000 -3.57%
429.mcf (avg) (percentage) 4.610 -3.35%
429.mcf (max) 24.000 -7.69%
429.mcf (max) (percentage) 2.050 -8.48%
429.mcf (unexplained diff vs previous) 5.000 -80.77%
429.mcf (unexplained diff vs previous) (percentage) 0.420 -80.82%
433.milc 9.000 -
433.milc (avg) 9.000 -
433.milc (avg) (percentage) 0.820 -1.20%
433.milc (max) 5.000 -16.67%
433.milc (max) (percentage) 0.460 -11.54%
433.milc (unexplained diff vs previous) 4.000 -33.33%
433.milc (unexplained diff vs previous) (percentage) 0.350 -32.69%
444.namd 19.000 -5.00%
444.namd (avg) 19.000 -5.00%
444.namd (avg) (percentage) 2.690 -4.61%
444.namd (max) 10.000 -
444.namd (max) (percentage) 1.410 -5.37%
444.namd (unexplained diff vs previous) 1.000 -66.67%
444.namd (unexplained diff vs previous) (percentage) 0.140 -66.67%
445.gobmk 48.000 -2.04%
445.gobmk (avg) 48.000 -2.04%
445.gobmk (avg) (percentage) 0.920 -3.16%
445.gobmk (max) 13.000 8.33%
445.gobmk (max) (percentage) 0.250 8.70%
445.gobmk (unexplained diff vs previous) 13.000 44.44%
445.gobmk (unexplained diff vs previous) (percentage) 0.250 47.06%
447.dealII 17.000 -5.56%
447.dealII (avg) 17.000 -5.56%
447.dealII (avg) (percentage) 1.010 -3.81%
447.dealII (max) 9.000 -
447.dealII (max) (percentage) 0.540 -5.26%
447.dealII (unexplained diff vs previous) 8.000 60.00%
447.dealII (unexplained diff vs previous) (percentage) 0.460 58.62%
450.soplex 3.000 -
450.soplex (avg) 3.000 -
450.soplex (avg) (percentage) 0.710 2.90%
450.soplex (max) 18.000 -14.29%
450.soplex (max) (percentage) 3.610 -12.59%
450.soplex (unexplained diff vs previous) 6.000 -71.43%
450.soplex (unexplained diff vs previous) (percentage) 1.150 -71.03%
453.povray 6.000 -14.29%
453.povray (avg) 6.000 -14.29%
453.povray (avg) (percentage) 1.450 -3.33%
453.povray (max) 6.000 -14.29%
453.povray (max) (percentage) 1.370 -9.87%
453.povray (unexplained diff vs previous) 3.000 -57.14%
453.povray (unexplained diff vs previous) (percentage) 0.640 -57.05%
456.hmmer 64.000 -3.03%
456.hmmer (avg) 64.000 -3.03%
456.hmmer (avg) (percentage) 1.810 -3.72%
456.hmmer (max) 9.000 -
456.hmmer (max) (percentage) 0.260 -3.70%
456.hmmer (unexplained diff vs previous) 8.000 100.00%
456.hmmer (unexplained diff vs previous) (percentage) 0.230 109.09%
458.sjeng 91.000 -3.19%
458.sjeng (avg) 91.000 -3.19%
458.sjeng (avg) (percentage) 1.130 -2.59%
458.sjeng (max) 88.000 -7.37%
458.sjeng (max) (percentage) 1.090 -6.84%
458.sjeng (unexplained diff vs previous) 53.000 -15.87%
458.sjeng (unexplained diff vs previous) (percentage) 0.650 -15.58%
462.libquantum 1.000 -
462.libquantum (avg) 1.000 -
462.libquantum (avg) (percentage) 1.710 -4.47%
462.libquantum (max) 1.000 -
462.libquantum (max) (percentage) 1.670 -16.50%
462.libquantum (unexplained diff vs previous) 0.000 -
462.libquantum (unexplained diff vs previous) (percentage) 0.000 -
464.h264ref 70.000 -2.78%
464.h264ref (avg) 70.000 -2.78%
464.h264ref (avg) (percentage) 1.270 -3.79%
464.h264ref (max) 14.000 -
464.h264ref (max) (percentage) 0.260 -3.70%
464.h264ref (unexplained diff vs previous) 1.000 -85.71%
464.h264ref (unexplained diff vs previous) (percentage) 0.020 -84.62%
470.lbm 78.000 -2.50%
470.lbm (avg) 78.000 -2.50%
470.lbm (avg) (percentage) 2.470 -2.76%
470.lbm (max) 21.000 61.54%
470.lbm (max) (percentage) 0.670 52.27%
470.lbm (unexplained diff vs previous) 21.000 61.54%
470.lbm (unexplained diff vs previous) (percentage) 0.660 60.98%
471.omnetpp 115.000 -3.36%
471.omnetpp (avg) 115.000 -3.36%
471.omnetpp (avg) (percentage) 4.150 -3.26%
471.omnetpp (max) 19.000 -5.00%
471.omnetpp (max) (percentage) 0.690 -4.17%
471.omnetpp (unexplained diff vs previous) 3.000 -76.92%
471.omnetpp (unexplained diff vs previous) (percentage) 0.110 -76.60%
473.astar 183.000 -3.68%
473.astar (avg) 183.000 -3.68%
473.astar (avg) (percentage) 3.830 -4.01%
473.astar (max) 16.000 60.00%
473.astar (max) (percentage) 0.340 61.90%
473.astar (unexplained diff vs previous) 16.000 60.00%
473.astar (unexplained diff vs previous) (percentage) 0.330 57.14%
482.sphinx3 16.000 -5.88%
482.sphinx3 (avg) 16.000 -5.88%
482.sphinx3 (avg) (percentage) 1.880 -2.59%
482.sphinx3 (max) 8.000 166.67%
482.sphinx3 (max) (percentage) 0.910 102.22%
482.sphinx3 (unexplained diff vs previous) 8.000 166.67%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.900 164.71%
483.xalancbmk 174.000 -4.40%
483.xalancbmk (avg) 174.000 -4.40%
483.xalancbmk (avg) (percentage) 4.890 -4.49%
483.xalancbmk (max) 19.000 -5.00%
483.xalancbmk (max) (percentage) 0.560 -3.45%
483.xalancbmk (unexplained diff vs previous) 5.000 -70.59%
483.xalancbmk (unexplained diff vs previous) (percentage) 0.140 -70.83%
Geometric Mean 2.951 -37.17%