Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0992e6ee115e701ab9034844060581cf105bd3b5 (+ 385 commits)
test_url https://ci.linaro.org/job/tcwg_bmk-code_size-spec2k6-llvm-arm-master-Oz_LTO-build/16/
View Options
Report
Filter

llvm-arm-master-Oz_LTO test results

Run Order Start Time Duration
Current 0016 (llvmorg-17-init-02284-g0992e6ee115e) 2023-02-12T10:00:27 0:00:00
Previous 0015 (llvmorg-17-init-01899-g0e18b5feaaba) 2023-02-09T08:52:26 0:00:00
Baseline 0001 (llvmorg-16-init-17036-g4f40923103d2) 2023-01-06T17:55:45 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 104 114
Performance Improvements 23 15
Added Tests 4 6
Unchanged Tests 649 645
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
483.xalancbmk 14.26% 9473.000 10824.000 - 15.44% -
471.omnetpp 11.77% 10660.000 11915.000 - 13.73% -
456.hmmer 10.36% 11839.000 13065.000 - 10.22% -
470.lbm 10.30% 13317.000 14689.000 - 10.79% -
473.astar 9.45% 12312.000 13476.000 - 9.81% -
462.libquantum 7.83% 14386.000 15512.000 - 7.65% -
482.sphinx3 6.76% 26667.000 28469.000 - 6.70% -
464.h264ref 6.53% 14594.000 15547.000 - 7.24% -
445.gobmk 5.60% 11001.000 11617.000 - 4.72% -
447.dealII 3.79% 9337.000 9691.000 - 3.32% -
401.bzip2 3.46% 16122.000 16680.000 - 3.36% -
403.gcc 1.90% 9542.000 9723.000 - 2.25% -
450.soplex 1.88% 14995.000 15277.000 - 1.09% -
433.milc 1.36% 13602.000 13787.000 - 1.37% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (unexplained diff vs previous) 15450.00% 2.000 311.000 - 3787.50% -
444.namd (unexplained diff vs previous) (percentage) 12750.00% 0.020 2.570 - 4183.33% -
429.mcf (unexplained diff vs previous) (percentage) 10595.24% 0.210 22.460 - 13937.50% -
429.mcf (unexplained diff vs previous) 8453.33% 30.000 2566.000 - 11563.64% -
462.libquantum (unexplained diff vs previous) 6523.53% 17.000 1126.000 - 112500.00% -
462.libquantum (unexplained diff vs previous) (percentage) 5950.00% 0.120 7.260 - 72500.00% -
456.hmmer (unexplained diff vs previous) 5472.73% 22.000 1226.000 - 2565.22% -
456.hmmer (unexplained diff vs previous) (percentage) 4836.84% 0.190 9.380 - 2305.13% -
470.lbm (unexplained diff vs previous) 4325.81% 31.000 1372.000 - 70.65% -
470.lbm (unexplained diff vs previous) (percentage) 3960.87% 0.230 9.340 - 54.13% -
401.bzip2 (unexplained diff vs previous) (percentage) 3622.22% 0.090 3.350 - 1575.00% -
401.bzip2 (unexplained diff vs previous) 3620.00% 15.000 558.000 - 1590.91% -
464.h264ref (unexplained diff vs previous) 2702.94% 34.000 953.000 - 0.00% -
464.h264ref (unexplained diff vs previous) (percentage) 2565.22% 0.230 6.130 - 0.00% -
450.soplex (unexplained diff vs previous) 2250.00% 12.000 282.000 - 308.70% -
450.soplex (unexplained diff vs previous) (percentage) 2212.50% 0.080 1.850 - 302.17% -
473.astar (unexplained diff vs previous) 1840.00% 60.000 1164.000 - 4556.00% -
433.milc (unexplained diff vs previous) (percentage) 1814.29% 0.070 1.340 - 1240.00% -
433.milc (unexplained diff vs previous) 1750.00% 10.000 185.000 - 1323.08% -
473.astar (unexplained diff vs previous) (percentage) 1663.27% 0.490 8.640 - 4220.00% -
471.omnetpp (unexplained diff vs previous) 1488.61% 79.000 1255.000 - 1118.45% -
458.sjeng (unexplained diff vs previous) (percentage) 1336.67% 0.300 4.310 - 0.00% -
471.omnetpp (unexplained diff vs previous) (percentage) 1322.97% 0.740 10.530 - 974.49% -
458.sjeng (unexplained diff vs previous) 1294.00% 50.000 697.000 - 0.00% -
453.povray (unexplained diff vs previous) 372.73% 11.000 52.000 - 0.00% -
453.povray (unexplained diff vs previous) (percentage) 362.50% 0.160 0.740 - 0.00% -
447.dealII (max) 82.59% 201.000 367.000 - 64.57% -
447.dealII (max) (percentage) 75.46% 2.160 3.790 - 59.24% -
483.xalancbmk 62.26% 257.000 417.000 - 110.61% -
483.xalancbmk (avg) 62.26% 257.000 417.000 - 110.61% -
464.h264ref 55.00% 160.000 248.000 - 490.48% -
464.h264ref (avg) 55.00% 160.000 248.000 - 490.48% -
464.h264ref (avg) (percentage) 45.45% 1.100 1.600 - 451.72% -
473.astar 42.50% 200.000 285.000 - 154.46% -
473.astar (avg) 42.50% 200.000 285.000 - 154.46% -
483.xalancbmk (avg) (percentage) 41.91% 2.720 3.860 - 82.08% -
462.libquantum 40.10% 197.000 276.000 - 150.91% -
462.libquantum (avg) 40.10% 197.000 276.000 - 150.91% -
471.omnetpp (max) 39.78% 1003.000 1402.000 - 44.24% -
470.lbm (max) 38.33% 1093.000 1512.000 - 99.47% -
471.omnetpp 37.82% 238.000 328.000 - 96.41% -
471.omnetpp (avg) 37.82% 238.000 328.000 - 96.41% -
450.soplex (max) 36.02% 211.000 287.000 - 15.26% -
462.libquantum (max) 34.29% 904.000 1214.000 - 32.10% -
450.soplex (max) (percentage) 33.33% 1.410 1.880 - 13.94% -
456.hmmer 32.84% 268.000 356.000 - 117.07% -
456.hmmer (avg) 32.84% 268.000 356.000 - 117.07% -
473.astar (avg) (percentage) 30.06% 1.630 2.120 - 130.43% -
462.libquantum (avg) (percentage) 29.93% 1.370 1.780 - 131.17% -
401.bzip2 29.17% 120.000 155.000 - 49.04% -
401.bzip2 (avg) 29.17% 120.000 155.000 - 49.04% -
473.astar (max) 26.67% 1005.000 1273.000 - 54.87% -
429.mcf (avg) (percentage) 25.83% 3.330 4.190 - 97.64% -
433.milc (max) 25.50% 149.000 187.000 - 73.15% -
470.lbm (max) (percentage) 25.46% 8.210 10.300 - 80.07% -
471.omnetpp (max) (percentage) 25.08% 9.410 11.770 - 26.83% -
470.lbm 24.66% 438.000 546.000 - 23.81% -
470.lbm (avg) 24.66% 438.000 546.000 - 23.81% -
462.libquantum (max) (percentage) 24.48% 6.290 7.830 - 22.73% -
401.bzip2 (avg) (percentage) 24.00% 0.750 0.930 - 43.08% -
433.milc (max) (percentage) 23.64% 1.100 1.360 - 70.00% -
471.omnetpp (avg) (percentage) 23.21% 2.240 2.760 - 72.50% -
447.dealII 22.45% 98.000 120.000 - 22.45% -
447.dealII (avg) 22.45% 98.000 120.000 - 22.45% -
483.xalancbmk (max) 20.92% 1276.000 1543.000 - 27.63% -
456.hmmer (avg) (percentage) 20.26% 2.270 2.730 - 96.40% -
458.sjeng (avg) (percentage) 18.40% 1.250 1.480 - 85.00% -
447.dealII (avg) (percentage) 18.10% 1.050 1.240 - 18.10% -
473.astar (max) (percentage) 15.67% 8.170 9.450 - 41.04% -
450.soplex 14.63% 82.000 94.000 - 25.33% -
450.soplex (avg) 14.63% 82.000 94.000 - 25.33% -
458.sjeng 13.81% 210.000 239.000 - 75.74% -
458.sjeng (avg) 13.81% 210.000 239.000 - 75.74% -
470.lbm (avg) (percentage) 13.07% 3.290 3.720 - 11.71% -
450.soplex (avg) (percentage) 12.73% 0.550 0.620 - 24.00% -
456.hmmer (max) 10.90% 1220.000 1353.000 - 8.94% -
433.milc 7.00% 100.000 107.000 - -7.76% -
433.milc (avg) 7.00% 100.000 107.000 - -7.76% -
482.sphinx3 6.68% 629.000 671.000 - 44.61% -
482.sphinx3 (avg) 6.68% 629.000 671.000 - 44.61% -
445.gobmk 5.98% 117.000 124.000 - 67.57% -
445.gobmk (avg) 5.98% 117.000 124.000 - 67.57% -
483.xalancbmk (max) (percentage) 5.79% 13.480 14.260 - 10.54% -
433.milc (avg) (percentage) 5.41% 0.740 0.780 - -9.30% -
482.sphinx3 (max) 2.92% 1712.000 1762.000 - 99.55% -
429.mcf 2.80% 465.000 478.000 - 61.49% -
429.mcf (avg) 2.80% 465.000 478.000 - 61.49% -
445.gobmk (max) 1.59% 441.000 448.000 - 8.47% -
403.gcc 1.41% 71.000 72.000 - 38.46% -
403.gcc (avg) 1.41% 71.000 72.000 - 38.46% -

Performance Improvements - Execution Δ Previous Current σ Δ (B) σ (B)
429.mcf -18.34% 13993.000 11427.000 - -18.31% -
458.sjeng -4.13% 16858.000 16161.000 - -5.24% -
444.namd -2.51% 12405.000 12094.000 - -2.47% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
429.mcf (max) -21.45% 2667.000 2095.000 - -8.15% -
458.sjeng (max) -9.76% 820.000 740.000 - -15.53% -
444.namd (max) -6.03% 580.000 545.000 - -45.66% -
403.gcc (max) (percentage) -5.99% 2.670 2.510 - 7.73% -
458.sjeng (max) (percentage) -5.95% 4.870 4.580 - -10.89% -
401.bzip2 (max) (percentage) -5.24% 4.390 4.160 - 10.05% -
464.h264ref (max) (percentage) -5.22% 7.470 7.080 - 1585.71% -
403.gcc (max) -3.94% 254.000 244.000 - 10.41% -
429.mcf (max) (percentage) -3.78% 19.060 18.340 - 12.45% -
445.gobmk (max) (percentage) -3.74% 4.010 3.860 - 3.49% -
444.namd (max) (percentage) -3.63% 4.680 4.510 - -44.25% -
482.sphinx3 (max) (percentage) -3.58% 6.420 6.190 - 87.01% -
444.namd -3.54% 367.000 354.000 - 11.32% -
444.namd (avg) -3.54% 367.000 354.000 - 11.32% -
453.povray (max) -3.23% 93.000 90.000 - 260.00% -
453.povray (max) (percentage) -2.26% 1.330 1.300 - 261.11% -
401.bzip2 (max) -1.98% 707.000 693.000 - 13.79% -
453.povray -1.92% 52.000 51.000 - -7.27% -
453.povray (avg) -1.92% 52.000 51.000 - -7.27% -
444.namd (avg) (percentage) -1.01% 2.960 2.930 - 14.01% -

Added Tests - sample variability
447.dealII (unexplained diff vs previous)
447.dealII (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Run-Over-Baseline Changes Detail

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
483.xalancbmk 15.44% 9376.000 10824.000 - 14.26% -
471.omnetpp 13.73% 10477.000 11915.000 - 11.77% -
470.lbm 10.79% 13259.000 14689.000 - 10.30% -
456.hmmer 10.22% 11854.000 13065.000 - 10.36% -
473.astar 9.81% 12272.000 13476.000 - 9.45% -
462.libquantum 7.65% 14409.000 15512.000 - 7.83% -
464.h264ref 7.24% 14498.000 15547.000 - 6.53% -
482.sphinx3 6.70% 26682.000 28469.000 - 6.76% -
445.gobmk 4.72% 11093.000 11617.000 - 5.60% -
401.bzip2 3.36% 16137.000 16680.000 - 3.46% -
447.dealII 3.32% 9380.000 9691.000 - 3.79% -
403.gcc 2.25% 9509.000 9723.000 - 1.90% -
433.milc 1.37% 13601.000 13787.000 - 1.36% -
450.soplex 1.09% 15112.000 15277.000 - 1.88% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
462.libquantum (unexplained diff vs previous) 112500.00% 1.000 1126.000 - 6523.53% -
462.libquantum (unexplained diff vs previous) (percentage) 72500.00% 0.010 7.260 - 5950.00% -
429.mcf (unexplained diff vs previous) (percentage) 13937.50% 0.160 22.460 - 10595.24% -
429.mcf (unexplained diff vs previous) 11563.64% 22.000 2566.000 - 8453.33% -
473.astar (unexplained diff vs previous) 4556.00% 25.000 1164.000 - 1840.00% -
473.astar (unexplained diff vs previous) (percentage) 4220.00% 0.200 8.640 - 1663.27% -
444.namd (unexplained diff vs previous) (percentage) 4183.33% 0.060 2.570 - 12750.00% -
444.namd (unexplained diff vs previous) 3787.50% 8.000 311.000 - 15450.00% -
456.hmmer (unexplained diff vs previous) 2565.22% 46.000 1226.000 - 5472.73% -
456.hmmer (unexplained diff vs previous) (percentage) 2305.13% 0.390 9.380 - 4836.84% -
464.h264ref (max) 1733.33% 60.000 1100.000 - 0.92% -
401.bzip2 (unexplained diff vs previous) 1590.91% 33.000 558.000 - 3620.00% -
464.h264ref (max) (percentage) 1585.71% 0.420 7.080 - -5.22% -
401.bzip2 (unexplained diff vs previous) (percentage) 1575.00% 0.200 3.350 - 3622.22% -
433.milc (unexplained diff vs previous) 1323.08% 13.000 185.000 - 1750.00% -
433.milc (unexplained diff vs previous) (percentage) 1240.00% 0.100 1.340 - 1814.29% -
471.omnetpp (unexplained diff vs previous) 1118.45% 103.000 1255.000 - 1488.61% -
471.omnetpp (unexplained diff vs previous) (percentage) 974.49% 0.980 10.530 - 1322.97% -
447.dealII (unexplained diff vs previous) 555.56% 54.000 354.000 - 0.00% -
447.dealII (unexplained diff vs previous) (percentage) 529.31% 0.580 3.650 - 0.00% -
464.h264ref 490.48% 42.000 248.000 - 55.00% -
464.h264ref (avg) 490.48% 42.000 248.000 - 55.00% -
464.h264ref (avg) (percentage) 451.72% 0.290 1.600 - 45.45% -
450.soplex (unexplained diff vs previous) 308.70% 69.000 282.000 - 2250.00% -
450.soplex (unexplained diff vs previous) (percentage) 302.17% 0.460 1.850 - 2212.50% -
453.povray (max) (percentage) 261.11% 0.360 1.300 - -2.26% -
453.povray (max) 260.00% 25.000 90.000 - -3.23% -
473.astar 154.46% 112.000 285.000 - 42.50% -
473.astar (avg) 154.46% 112.000 285.000 - 42.50% -
462.libquantum 150.91% 110.000 276.000 - 40.10% -
462.libquantum (avg) 150.91% 110.000 276.000 - 40.10% -
462.libquantum (avg) (percentage) 131.17% 0.770 1.780 - 29.93% -
473.astar (avg) (percentage) 130.43% 0.920 2.120 - 30.06% -
456.hmmer 117.07% 164.000 356.000 - 32.84% -
456.hmmer (avg) 117.07% 164.000 356.000 - 32.84% -
483.xalancbmk 110.61% 198.000 417.000 - 62.26% -
483.xalancbmk (avg) 110.61% 198.000 417.000 - 62.26% -
482.sphinx3 (max) 99.55% 883.000 1762.000 - 2.92% -
470.lbm (max) 99.47% 758.000 1512.000 - 38.33% -
429.mcf (avg) (percentage) 97.64% 2.120 4.190 - 25.83% -
471.omnetpp 96.41% 167.000 328.000 - 37.82% -
471.omnetpp (avg) 96.41% 167.000 328.000 - 37.82% -
456.hmmer (avg) (percentage) 96.40% 1.390 2.730 - 20.26% -
482.sphinx3 (max) (percentage) 87.01% 3.310 6.190 - -3.58% -
458.sjeng (avg) (percentage) 85.00% 0.800 1.480 - 18.40% -
483.xalancbmk (avg) (percentage) 82.08% 2.120 3.860 - 41.91% -
470.lbm (max) (percentage) 80.07% 5.720 10.300 - 25.46% -
458.sjeng 75.74% 136.000 239.000 - 13.81% -
458.sjeng (avg) 75.74% 136.000 239.000 - 13.81% -
433.milc (max) 73.15% 108.000 187.000 - 25.50% -
471.omnetpp (avg) (percentage) 72.50% 1.600 2.760 - 23.21% -
470.lbm (unexplained diff vs previous) 70.65% 804.000 1372.000 - 4325.81% -
433.milc (max) (percentage) 70.00% 0.800 1.360 - 23.64% -
445.gobmk 67.57% 74.000 124.000 - 5.98% -
445.gobmk (avg) 67.57% 74.000 124.000 - 5.98% -
447.dealII (max) 64.57% 223.000 367.000 - 82.59% -
429.mcf 61.49% 296.000 478.000 - 2.80% -
429.mcf (avg) 61.49% 296.000 478.000 - 2.80% -
445.gobmk (avg) (percentage) 59.70% 0.670 1.070 - 0.00% -
447.dealII (max) (percentage) 59.24% 2.380 3.790 - 75.46% -
473.astar (max) 54.87% 822.000 1273.000 - 26.67% -
470.lbm (unexplained diff vs previous) (percentage) 54.13% 6.060 9.340 - 3960.87% -
401.bzip2 49.04% 104.000 155.000 - 29.17% -
401.bzip2 (avg) 49.04% 104.000 155.000 - 29.17% -
482.sphinx3 44.61% 464.000 671.000 - 6.68% -
482.sphinx3 (avg) 44.61% 464.000 671.000 - 6.68% -
471.omnetpp (max) 44.24% 972.000 1402.000 - 39.78% -
401.bzip2 (avg) (percentage) 43.08% 0.650 0.930 - 24.00% -
473.astar (max) (percentage) 41.04% 6.700 9.450 - 15.67% -
403.gcc 38.46% 52.000 72.000 - 1.41% -
403.gcc (avg) 38.46% 52.000 72.000 - 1.41% -
403.gcc (avg) (percentage) 36.36% 0.550 0.750 - 0.00% -
482.sphinx3 (avg) (percentage) 35.63% 1.740 2.360 - 0.00% -
462.libquantum (max) 32.10% 919.000 1214.000 - 34.29% -
483.xalancbmk (max) 27.63% 1209.000 1543.000 - 20.92% -
471.omnetpp (max) (percentage) 26.83% 9.280 11.770 - 25.08% -
450.soplex 25.33% 75.000 94.000 - 14.63% -
450.soplex (avg) 25.33% 75.000 94.000 - 14.63% -
450.soplex (avg) (percentage) 24.00% 0.500 0.620 - 12.73% -
470.lbm 23.81% 441.000 546.000 - 24.66% -
470.lbm (avg) 23.81% 441.000 546.000 - 24.66% -
462.libquantum (max) (percentage) 22.73% 6.380 7.830 - 24.48% -
447.dealII 22.45% 98.000 120.000 - 22.45% -
447.dealII (avg) 22.45% 98.000 120.000 - 22.45% -
447.dealII (avg) (percentage) 18.10% 1.050 1.240 - 18.10% -
450.soplex (max) 15.26% 249.000 287.000 - 36.02% -
444.namd (avg) (percentage) 14.01% 2.570 2.930 - -1.01% -
450.soplex (max) (percentage) 13.94% 1.650 1.880 - 33.33% -
401.bzip2 (max) 13.79% 609.000 693.000 - -1.98% -
429.mcf (max) (percentage) 12.45% 16.310 18.340 - -3.78% -
470.lbm (avg) (percentage) 11.71% 3.330 3.720 - 13.07% -
444.namd 11.32% 318.000 354.000 - -3.54% -
444.namd (avg) 11.32% 318.000 354.000 - -3.54% -
483.xalancbmk (max) (percentage) 10.54% 12.900 14.260 - 5.79% -
403.gcc (max) 10.41% 221.000 244.000 - -3.94% -
401.bzip2 (max) (percentage) 10.05% 3.780 4.160 - -5.24% -
456.hmmer (max) 8.94% 1242.000 1353.000 - 10.90% -
445.gobmk (max) 8.47% 413.000 448.000 - 1.59% -
403.gcc (max) (percentage) 7.73% 2.330 2.510 - -5.99% -
445.gobmk (max) (percentage) 3.49% 3.730 3.860 - -3.74% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
429.mcf -18.31% 13988.000 11427.000 - -18.34% -
458.sjeng -5.24% 17055.000 16161.000 - -4.13% -
444.namd -2.47% 12400.000 12094.000 - -2.51% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
444.namd (max) -45.66% 1003.000 545.000 - -6.03% -
444.namd (max) (percentage) -44.25% 8.090 4.510 - -3.63% -
458.sjeng (max) -15.53% 876.000 740.000 - -9.76% -
458.sjeng (max) (percentage) -10.89% 5.140 4.580 - -5.95% -
433.milc (avg) (percentage) -9.30% 0.860 0.780 - 5.41% -
429.mcf (max) -8.15% 2281.000 2095.000 - -21.45% -
433.milc -7.76% 116.000 107.000 - 7.00% -
433.milc (avg) -7.76% 116.000 107.000 - 7.00% -
453.povray (avg) (percentage) -7.50% 0.800 0.740 - 0.00% -
453.povray -7.27% 55.000 51.000 - -1.92% -
453.povray (avg) -7.27% 55.000 51.000 - -1.92% -
456.hmmer (max) (percentage) -1.15% 10.480 10.360 - 0.48% -

Added Tests - sample variability
458.sjeng (unexplained diff vs previous)
458.sjeng (unexplained diff vs previous) (percentage)
464.h264ref (unexplained diff vs previous)
464.h264ref (unexplained diff vs previous) (percentage)
483.xalancbmk (unexplained diff vs previous)
483.xalancbmk (unexplained diff vs previous) (percentage)

Report Time: 0.41s
Execution (seconds)
Name Current %
401.bzip2 16680.000 3.46%
403.gcc 9723.000 1.90%
429.mcf 11427.000 -18.34%
433.milc 13787.000 1.36%
444.namd 12094.000 -2.51%
445.gobmk 11617.000 5.60%
447.dealII 9691.000 3.79%
450.soplex 15277.000 1.88%
453.povray 6990.000 -
456.hmmer 13065.000 10.36%
458.sjeng 16161.000 -4.13%
462.libquantum 15512.000 7.83%
464.h264ref 15547.000 6.53%
470.lbm 14689.000 10.30%
471.omnetpp 11915.000 11.77%
473.astar 13476.000 9.45%
482.sphinx3 28469.000 6.76%
483.xalancbmk 10824.000 14.26%
Geometric Mean 13145.933 3.59%
Code Size (bytes)
Name Current %
401.bzip2 33698.000 -
403.gcc 1669436.000 -
429.mcf 7239.000 -
433.milc 47001.000 -
444.namd 124963.000 -
445.gobmk 1260795.000 -
447.dealII 195792.000 -
450.soplex 146773.000 -
453.povray 524437.000 -
456.hmmer 80877.000 -
458.sjeng 80185.000 -
462.libquantum 12504.000 -
464.h264ref 303799.000 -
470.lbm 9338.000 -
471.omnetpp 316668.000 -
473.astar 15470.000 -
482.sphinx3 87927.000 -
483.xalancbmk 1615520.000 -
Geometric Mean 111655.703 -
sample variability
Name Current %
401.bzip2 155.000 29.17%
401.bzip2 (avg) 155.000 29.17%
401.bzip2 (avg) (percentage) 0.930 24.00%
401.bzip2 (max) 693.000 -1.98%
401.bzip2 (max) (percentage) 4.160 -5.24%
401.bzip2 (unexplained diff vs previous) 558.000 3620.00%
401.bzip2 (unexplained diff vs previous) (percentage) 3.350 3622.22%
403.gcc 72.000 1.41%
403.gcc (avg) 72.000 1.41%
403.gcc (avg) (percentage) 0.750 -
403.gcc (max) 244.000 -3.94%
403.gcc (max) (percentage) 2.510 -5.99%
429.mcf 478.000 2.80%
429.mcf (avg) 478.000 2.80%
429.mcf (avg) (percentage) 4.190 25.83%
429.mcf (max) 2095.000 -21.45%
429.mcf (max) (percentage) 18.340 -3.78%
429.mcf (unexplained diff vs previous) 2566.000 8453.33%
429.mcf (unexplained diff vs previous) (percentage) 22.460 10595.24%
433.milc 107.000 7.00%
433.milc (avg) 107.000 7.00%
433.milc (avg) (percentage) 0.780 5.41%
433.milc (max) 187.000 25.50%
433.milc (max) (percentage) 1.360 23.64%
433.milc (unexplained diff vs previous) 185.000 1750.00%
433.milc (unexplained diff vs previous) (percentage) 1.340 1814.29%
444.namd 354.000 -3.54%
444.namd (avg) 354.000 -3.54%
444.namd (avg) (percentage) 2.930 -1.01%
444.namd (max) 545.000 -6.03%
444.namd (max) (percentage) 4.510 -3.63%
444.namd (unexplained diff vs previous) 311.000 15450.00%
444.namd (unexplained diff vs previous) (percentage) 2.570 12750.00%
445.gobmk 124.000 5.98%
445.gobmk (avg) 124.000 5.98%
445.gobmk (avg) (percentage) 1.070 -
445.gobmk (max) 448.000 1.59%
445.gobmk (max) (percentage) 3.860 -3.74%
447.dealII 120.000 22.45%
447.dealII (avg) 120.000 22.45%
447.dealII (avg) (percentage) 1.240 18.10%
447.dealII (max) 367.000 82.59%
447.dealII (max) (percentage) 3.790 75.46%
447.dealII (unexplained diff vs previous) 354.000 -
447.dealII (unexplained diff vs previous) (percentage) 3.650 -
450.soplex 94.000 14.63%
450.soplex (avg) 94.000 14.63%
450.soplex (avg) (percentage) 0.620 12.73%
450.soplex (max) 287.000 36.02%
450.soplex (max) (percentage) 1.880 33.33%
450.soplex (unexplained diff vs previous) 282.000 2250.00%
450.soplex (unexplained diff vs previous) (percentage) 1.850 2212.50%
453.povray 51.000 -1.92%
453.povray (avg) 51.000 -1.92%
453.povray (avg) (percentage) 0.740 -
453.povray (max) 90.000 -3.23%
453.povray (max) (percentage) 1.300 -2.26%
453.povray (unexplained diff vs previous) 52.000 372.73%
453.povray (unexplained diff vs previous) (percentage) 0.740 362.50%
456.hmmer 356.000 32.84%
456.hmmer (avg) 356.000 32.84%
456.hmmer (avg) (percentage) 2.730 20.26%
456.hmmer (max) 1353.000 10.90%
456.hmmer (max) (percentage) 10.360 -
456.hmmer (unexplained diff vs previous) 1226.000 5472.73%
456.hmmer (unexplained diff vs previous) (percentage) 9.380 4836.84%
458.sjeng 239.000 13.81%
458.sjeng (avg) 239.000 13.81%
458.sjeng (avg) (percentage) 1.480 18.40%
458.sjeng (max) 740.000 -9.76%
458.sjeng (max) (percentage) 4.580 -5.95%
458.sjeng (unexplained diff vs previous) 697.000 1294.00%
458.sjeng (unexplained diff vs previous) (percentage) 4.310 1336.67%
462.libquantum 276.000 40.10%
462.libquantum (avg) 276.000 40.10%
462.libquantum (avg) (percentage) 1.780 29.93%
462.libquantum (max) 1214.000 34.29%
462.libquantum (max) (percentage) 7.830 24.48%
462.libquantum (unexplained diff vs previous) 1126.000 6523.53%
462.libquantum (unexplained diff vs previous) (percentage) 7.260 5950.00%
464.h264ref 248.000 55.00%
464.h264ref (avg) 248.000 55.00%
464.h264ref (avg) (percentage) 1.600 45.45%
464.h264ref (max) 1100.000 -
464.h264ref (max) (percentage) 7.080 -5.22%
464.h264ref (unexplained diff vs previous) 953.000 2702.94%
464.h264ref (unexplained diff vs previous) (percentage) 6.130 2565.22%
470.lbm 546.000 24.66%
470.lbm (avg) 546.000 24.66%
470.lbm (avg) (percentage) 3.720 13.07%
470.lbm (max) 1512.000 38.33%
470.lbm (max) (percentage) 10.300 25.46%
470.lbm (unexplained diff vs previous) 1372.000 4325.81%
470.lbm (unexplained diff vs previous) (percentage) 9.340 3960.87%
471.omnetpp 328.000 37.82%
471.omnetpp (avg) 328.000 37.82%
471.omnetpp (avg) (percentage) 2.760 23.21%
471.omnetpp (max) 1402.000 39.78%
471.omnetpp (max) (percentage) 11.770 25.08%
471.omnetpp (unexplained diff vs previous) 1255.000 1488.61%
471.omnetpp (unexplained diff vs previous) (percentage) 10.530 1322.97%
473.astar 285.000 42.50%
473.astar (avg) 285.000 42.50%
473.astar (avg) (percentage) 2.120 30.06%
473.astar (max) 1273.000 26.67%
473.astar (max) (percentage) 9.450 15.67%
473.astar (unexplained diff vs previous) 1164.000 1840.00%
473.astar (unexplained diff vs previous) (percentage) 8.640 1663.27%
482.sphinx3 671.000 6.68%
482.sphinx3 (avg) 671.000 6.68%
482.sphinx3 (avg) (percentage) 2.360 -
482.sphinx3 (max) 1762.000 2.92%
482.sphinx3 (max) (percentage) 6.190 -3.58%
483.xalancbmk 417.000 62.26%
483.xalancbmk (avg) 417.000 62.26%
483.xalancbmk (avg) (percentage) 3.860 41.91%
483.xalancbmk (max) 1543.000 20.92%
483.xalancbmk (max) (percentage) 14.260 5.79%
483.xalancbmk (unexplained diff vs previous) 1351.000 -
483.xalancbmk (unexplained diff vs previous) (percentage) 12.480 -
Geometric Mean 50.865 142.29%