Runs:

Compare To:

Machine Info

Fields

hardware None
os None

Parameters

Run Info

Fields

NameValue

Parameters

NameValue
git_llvm https://github.com/llvm/llvm-project/commit/0148df8157f05ecf3b1064508e6f012aefb87dad (+ 555 commits)
test_url https://ci.linaro.org/job/tcwg_bmk_ci_llvm-build-tcwg_bmk_apm-llvm-master-arm-spec2k6-Os/179/
View Options
Report
Filter

llvm-arm-master-Os test results

Run Order Start Time Duration
Current 0179 (llvmorg-16-init-07350-g0148df8157f0) 2022-10-05T12:56:12 0:00:00
Previous 0174 (llvmorg-19-init-16654-gceade83ad5fc) 2024-07-02T04:32:09 0:00:00
Baseline 0001 (llvmorg-16-init-16061-ge7790fbed32b) 2022-12-29T19:41:07 0:00:00

Tests Summary

Status Group # # (B)
Performance Regressions 115 75
Performance Improvements 21 39
Added Tests 5 0
Unchanged Tests 639 666
Total Tests 780

Run-Over-Run Changes Detail

Performance Regressions - Code Size Δ Previous Current σ Δ (B) σ (B)
462.libquantum 11.54% 23959.000 26724.000 - -0.12% -
447.dealII 3.08% 1732819.000 1786157.000 - 0.46% -
433.milc 2.84% 72890.000 74963.000 - -0.01% -
453.povray 2.65% 578155.000 593457.000 - 0.06% -
444.namd 1.80% 172545.000 175648.000 - 0.28% -
464.h264ref 1.49% 349992.000 355202.000 - 0.16% -
429.mcf 1.19% 7842.000 7935.000 - 0.25% -
458.sjeng 1.15% 96961.000 98078.000 - 0.29% -
450.soplex 1.03% 200991.000 203060.000 - 2.19% -

Performance Regressions - Execution Δ Previous Current σ Δ (B) σ (B)
403.gcc 15891.23% 57.000 9115.000 - 0.18% -
462.libquantum 13554.17% 96.000 13108.000 - -0.14% -
482.sphinx3 2997.94% 874.000 27076.000 - 2.91% -
450.soplex 2605.27% 531.000 14365.000 - -0.44% -
444.namd 1662.67% 718.000 12656.000 - -6.22% -
453.povray 1348.82% 465.000 6737.000 - -1.75% -
433.milc 1077.27% 1144.000 13468.000 - -0.10% -
429.mcf 925.87% 1148.000 11777.000 - -1.85% -
401.bzip2 477.06% 2681.000 15471.000 - -1.35% -
470.lbm 348.66% 3181.000 14272.000 - 2.81% -
447.dealII 347.71% 1811.000 8108.000 - -1.07% -
471.omnetpp 290.43% 2748.000 10729.000 - -0.16% -
456.hmmer 281.80% 3565.000 13611.000 - 1.84% -
473.astar 192.41% 4899.000 14325.000 - 0.44% -
464.h264ref 180.39% 5554.000 15573.000 - 0.52% -
445.gobmk 139.67% 5188.000 12434.000 - 0.27% -
458.sjeng 99.20% 8248.000 16430.000 - 0.15% -

Performance Regressions - sample variability Δ Previous Current σ Δ (B) σ (B)
444.namd (max) 17850.00% 4.000 718.000 - -18.59% -
462.libquantum (max) 17200.00% 1.000 173.000 - 565.38% -
444.namd 12666.67% 6.000 766.000 - 49.03% -
444.namd (avg) 12666.67% 6.000 766.000 - 49.03% -
403.gcc (max) 11775.00% 4.000 475.000 - 1297.06% -
403.gcc 9500.00% 2.000 192.000 - 346.51% -
403.gcc (avg) 9500.00% 2.000 192.000 - 346.51% -
482.sphinx3 8285.71% 7.000 587.000 - 20.04% -
482.sphinx3 (avg) 8285.71% 7.000 587.000 - 20.04% -
433.milc (max) 7180.00% 5.000 364.000 - 97.83% -
482.sphinx3 (max) 5716.67% 12.000 698.000 - -20.05% -
450.soplex (max) 4666.67% 9.000 429.000 - 423.17% -
462.libquantum 4300.00% 1.000 44.000 - 131.58% -
462.libquantum (avg) 4300.00% 1.000 44.000 - 131.58% -
429.mcf (max) 3725.00% 8.000 306.000 - 356.72% -
433.milc (unexplained diff vs previous) 3540.00% 5.000 182.000 - 0.00% -
433.milc 3533.33% 6.000 218.000 - 60.29% -
433.milc (avg) 3533.33% 6.000 218.000 - 60.29% -
458.sjeng (max) 3320.69% 58.000 1984.000 - 2952.31% -
470.lbm (max) 2242.86% 21.000 492.000 - -36.02% -
450.soplex 2183.33% 6.000 137.000 - 168.63% -
450.soplex (avg) 2183.33% 6.000 137.000 - 168.63% -
458.sjeng 2167.74% 31.000 703.000 - 640.00% -
458.sjeng (avg) 2167.74% 31.000 703.000 - 640.00% -
429.mcf (unexplained diff vs previous) 1800.00% 2.000 38.000 - -43.28% -
458.sjeng (max) (percentage) 1601.41% 0.710 12.080 - 2920.00% -
470.lbm 1491.67% 24.000 382.000 - 18.63% -
470.lbm (avg) 1491.67% 24.000 382.000 - 18.63% -
403.gcc (unexplained diff vs previous) 1166.67% 3.000 38.000 - 11.76% -
447.dealII 1100.00% 10.000 120.000 - 0.00% -
447.dealII (avg) 1100.00% 10.000 120.000 - 0.00% -
458.sjeng (avg) (percentage) 1026.32% 0.380 4.280 - 637.93% -
456.hmmer (unexplained diff vs previous) 966.67% 3.000 32.000 - 255.56% -
444.namd (max) (percentage) 801.59% 0.630 5.680 - -13.15% -
473.astar (max) 763.16% 19.000 164.000 - 43.86% -
464.h264ref (max) 687.50% 8.000 63.000 - 5.00% -
429.mcf 625.00% 16.000 116.000 - 118.87% -
429.mcf (avg) 625.00% 16.000 116.000 - 118.87% -
447.dealII (max) 605.26% 19.000 134.000 - 3.88% -
444.namd (avg) (percentage) 524.74% 0.970 6.060 - 59.06% -
433.milc (max) (percentage) 464.58% 0.480 2.710 - 97.81% -
482.sphinx3 (unexplained diff vs previous) 453.85% 13.000 72.000 - -92.04% -
445.gobmk (unexplained diff vs previous) 450.00% 4.000 22.000 - -26.67% -
470.lbm (unexplained diff vs previous) 450.00% 2.000 11.000 - -97.79% -
470.lbm (max) (percentage) 414.93% 0.670 3.450 - -37.73% -
445.gobmk (max) 331.58% 19.000 82.000 - 182.76% -
464.h264ref (unexplained diff vs previous) 320.00% 5.000 21.000 - -65.00% -
471.omnetpp (max) 291.67% 48.000 188.000 - -0.53% -
447.dealII (unexplained diff vs previous) 273.68% 19.000 71.000 - -41.32% -
470.lbm (avg) (percentage) 248.05% 0.770 2.680 - 15.52% -
429.mcf (max) (percentage) 237.66% 0.770 2.600 - 364.29% -
473.astar 217.95% 39.000 124.000 - 74.65% -
473.astar (avg) 217.95% 39.000 124.000 - 74.65% -
433.milc (unexplained diff vs previous) (percentage) 206.82% 0.440 1.350 - 0.00% -
456.hmmer (unexplained diff vs previous) (percentage) 200.00% 0.080 0.240 - 242.86% -
433.milc (avg) (percentage) 189.29% 0.560 1.620 - 60.40% -
450.soplex (unexplained diff vs previous) 188.89% 9.000 26.000 - -68.29% -
473.astar (max) (percentage) 187.50% 0.400 1.150 - 43.75% -
471.omnetpp 187.18% 39.000 112.000 - 34.94% -
471.omnetpp (avg) 187.18% 39.000 112.000 - 34.94% -
464.h264ref 171.43% 21.000 57.000 - 11.76% -
464.h264ref (avg) 171.43% 21.000 57.000 - 11.76% -
464.h264ref (max) (percentage) 156.25% 0.160 0.410 - 5.13% -
447.dealII (avg) (percentage) 148.33% 0.600 1.490 - 1.36% -
482.sphinx3 (avg) (percentage) 146.59% 0.880 2.170 - 16.67% -
445.gobmk 141.18% 17.000 41.000 - 86.36% -
445.gobmk (avg) 141.18% 17.000 41.000 - 86.36% -
456.hmmer (max) 135.00% 20.000 47.000 - 17.50% -
445.gobmk (unexplained diff vs previous) (percentage) 125.00% 0.080 0.180 - -25.00% -
456.hmmer 122.22% 18.000 40.000 - -16.67% -
456.hmmer (avg) 122.22% 18.000 40.000 - -16.67% -
462.libquantum (unexplained diff vs previous) 100.00% 2.000 4.000 - -75.00% -
429.mcf (unexplained diff vs previous) (percentage) 88.24% 0.170 0.320 - -42.86% -
482.sphinx3 (max) (percentage) 75.51% 1.470 2.580 - -22.29% -
450.soplex (max) (percentage) 73.84% 1.720 2.990 - 424.56% -
445.gobmk (max) (percentage) 73.68% 0.380 0.660 - 175.00% -
447.dealII (max) (percentage) 56.60% 1.060 1.660 - 5.06% -
471.omnetpp (unexplained diff vs previous) 52.63% 19.000 29.000 - -68.48% -
483.xalancbmk (max) (percentage) 45.71% 0.700 1.020 - 56.92% -
464.h264ref (unexplained diff vs previous) (percentage) 44.44% 0.090 0.130 - -66.67% -
401.bzip2 (max) 41.67% 12.000 17.000 - -64.58% -
401.bzip2 (unexplained diff vs previous) 41.67% 12.000 17.000 - -65.31% -
470.lbm (unexplained diff vs previous) (percentage) 33.33% 0.060 0.080 - -97.77% -
401.bzip2 30.77% 13.000 17.000 - -50.00% -
401.bzip2 (avg) 30.77% 13.000 17.000 - -50.00% -
473.astar (avg) (percentage) 7.41% 0.810 0.870 - 74.00% -

Performance Regressions - Score Δ Previous Current σ Δ (B) σ (B)
nb_total_tests -52.50% 40.000 19.000 - 0.00% -
nb_compile_successful -47.22% 36.000 19.000 - 0.00% -
nb_execution_successful -47.06% 34.000 18.000 - 0.00% -

Performance Improvements - Code Size Δ Previous Current σ Δ (B) σ (B)
401.bzip2 -4.95% 41641.000 39578.000 - 0.30% -

Performance Improvements - sample variability Δ Previous Current σ Δ (B) σ (B)
462.libquantum (unexplained diff vs previous) (percentage) -98.56% 2.080 0.030 - -75.00% -
403.gcc (unexplained diff vs previous) (percentage) -92.02% 5.260 0.420 - 13.51% -
450.soplex (unexplained diff vs previous) (percentage) -89.35% 1.690 0.180 - -68.42% -
482.sphinx3 (unexplained diff vs previous) (percentage) -81.88% 1.490 0.270 - -92.15% -
401.bzip2 (avg) (percentage) -78.43% 0.510 0.110 - -50.00% -
462.libquantum (avg) (percentage) -77.63% 1.520 0.340 - 126.67% -
401.bzip2 (max) (percentage) -76.09% 0.460 0.110 - -64.52% -
401.bzip2 (unexplained diff vs previous) (percentage) -75.56% 0.450 0.110 - -64.52% -
471.omnetpp (unexplained diff vs previous) (percentage) -60.87% 0.690 0.270 - -68.60% -
403.gcc (avg) (percentage) -47.12% 3.990 2.110 - 339.58% -
483.xalancbmk (avg) (percentage) -46.62% 1.330 0.710 - 42.00% -
456.hmmer (avg) (percentage) -42.31% 0.520 0.300 - -16.67% -
456.hmmer (max) (percentage) -38.60% 0.570 0.350 - 16.67% -
462.libquantum (max) (percentage) -35.29% 2.040 1.320 - 560.00% -
429.mcf (avg) (percentage) -32.65% 1.470 0.990 - 120.00% -
403.gcc (max) (percentage) -29.84% 7.440 5.220 - 1273.68% -
471.omnetpp (avg) (percentage) -27.08% 1.440 1.050 - 34.62% -
450.soplex (avg) (percentage) -17.95% 1.170 0.960 - 166.67% -
447.dealII (unexplained diff vs previous) (percentage) -16.19% 1.050 0.880 - -40.54% -
464.h264ref (avg) (percentage) -5.13% 0.390 0.370 - 12.12% -

Added Tests - Code Size
483.xalancbmk

Added Tests - Execution
483.xalancbmk

Added Tests - sample variability
483.xalancbmk
483.xalancbmk (avg)
483.xalancbmk (max)

Run-Over-Baseline Changes Detail

Performance Regressions - Code Size Δ (B) Baseline Current σ (B) Δ σ
450.soplex 2.19% 198708.000 203060.000 - 1.03% -

Performance Regressions - Execution Δ (B) Baseline Current σ (B) Δ σ
482.sphinx3 2.91% 26310.000 27076.000 - 2997.94% -
470.lbm 2.81% 13882.000 14272.000 - 348.66% -
456.hmmer 1.84% 13365.000 13611.000 - 281.80% -

Performance Regressions - sample variability Δ (B) Baseline Current σ (B) Δ σ
458.sjeng (max) 2952.31% 65.000 1984.000 - 3320.69% -
458.sjeng (max) (percentage) 2920.00% 0.400 12.080 - 1601.41% -
403.gcc (max) 1297.06% 34.000 475.000 - 11775.00% -
403.gcc (max) (percentage) 1273.68% 0.380 5.220 - -29.84% -
458.sjeng 640.00% 95.000 703.000 - 2167.74% -
458.sjeng (avg) 640.00% 95.000 703.000 - 2167.74% -
458.sjeng (avg) (percentage) 637.93% 0.580 4.280 - 1026.32% -
462.libquantum (max) 565.38% 26.000 173.000 - 17200.00% -
462.libquantum (max) (percentage) 560.00% 0.200 1.320 - -35.29% -
450.soplex (max) (percentage) 424.56% 0.570 2.990 - 73.84% -
450.soplex (max) 423.17% 82.000 429.000 - 4666.67% -
429.mcf (max) (percentage) 364.29% 0.560 2.600 - 237.66% -
429.mcf (max) 356.72% 67.000 306.000 - 3725.00% -
403.gcc 346.51% 43.000 192.000 - 9500.00% -
403.gcc (avg) 346.51% 43.000 192.000 - 9500.00% -
403.gcc (avg) (percentage) 339.58% 0.480 2.110 - -47.12% -
456.hmmer (unexplained diff vs previous) 255.56% 9.000 32.000 - 966.67% -
456.hmmer (unexplained diff vs previous) (percentage) 242.86% 0.070 0.240 - 200.00% -
445.gobmk (max) 182.76% 29.000 82.000 - 331.58% -
445.gobmk (max) (percentage) 175.00% 0.240 0.660 - 73.68% -
450.soplex 168.63% 51.000 137.000 - 2183.33% -
450.soplex (avg) 168.63% 51.000 137.000 - 2183.33% -
450.soplex (avg) (percentage) 166.67% 0.360 0.960 - -17.95% -
462.libquantum 131.58% 19.000 44.000 - 4300.00% -
462.libquantum (avg) 131.58% 19.000 44.000 - 4300.00% -
462.libquantum (avg) (percentage) 126.67% 0.150 0.340 - -77.63% -
429.mcf (avg) (percentage) 120.00% 0.450 0.990 - -32.65% -
429.mcf 118.87% 53.000 116.000 - 625.00% -
429.mcf (avg) 118.87% 53.000 116.000 - 625.00% -
433.milc (max) 97.83% 184.000 364.000 - 7180.00% -
433.milc (max) (percentage) 97.81% 1.370 2.710 - 464.58% -
445.gobmk 86.36% 22.000 41.000 - 141.18% -
445.gobmk (avg) 86.36% 22.000 41.000 - 141.18% -
445.gobmk (avg) (percentage) 83.33% 0.180 0.330 - 0.00% -
473.astar 74.65% 71.000 124.000 - 217.95% -
473.astar (avg) 74.65% 71.000 124.000 - 217.95% -
473.astar (avg) (percentage) 74.00% 0.500 0.870 - 7.41% -
433.milc (avg) (percentage) 60.40% 1.010 1.620 - 189.29% -
433.milc 60.29% 136.000 218.000 - 3533.33% -
433.milc (avg) 60.29% 136.000 218.000 - 3533.33% -
444.namd (avg) (percentage) 59.06% 3.810 6.060 - 524.74% -
483.xalancbmk (max) 57.38% 61.000 96.000 - 0.00% -
483.xalancbmk (max) (percentage) 56.92% 0.650 1.020 - 45.71% -
444.namd 49.03% 514.000 766.000 - 12666.67% -
444.namd (avg) 49.03% 514.000 766.000 - 12666.67% -
473.astar (max) 43.86% 114.000 164.000 - 763.16% -
473.astar (max) (percentage) 43.75% 0.800 1.150 - 187.50% -
483.xalancbmk 42.55% 47.000 67.000 - 0.00% -
483.xalancbmk (avg) 42.55% 47.000 67.000 - 0.00% -
483.xalancbmk (avg) (percentage) 42.00% 0.500 0.710 - -46.62% -
471.omnetpp 34.94% 83.000 112.000 - 187.18% -
471.omnetpp (avg) 34.94% 83.000 112.000 - 187.18% -
471.omnetpp (avg) (percentage) 34.62% 0.780 1.050 - -27.08% -
482.sphinx3 20.04% 489.000 587.000 - 8285.71% -
482.sphinx3 (avg) 20.04% 489.000 587.000 - 8285.71% -
470.lbm 18.63% 322.000 382.000 - 1491.67% -
470.lbm (avg) 18.63% 322.000 382.000 - 1491.67% -
456.hmmer (max) 17.50% 40.000 47.000 - 135.00% -
456.hmmer (max) (percentage) 16.67% 0.300 0.350 - -38.60% -
482.sphinx3 (avg) (percentage) 16.67% 1.860 2.170 - 146.59% -
470.lbm (avg) (percentage) 15.52% 2.320 2.680 - 248.05% -
403.gcc (unexplained diff vs previous) (percentage) 13.51% 0.370 0.420 - -92.02% -
464.h264ref (avg) (percentage) 12.12% 0.330 0.370 - -5.13% -
403.gcc (unexplained diff vs previous) 11.76% 34.000 38.000 - 1166.67% -
464.h264ref 11.76% 51.000 57.000 - 171.43% -
464.h264ref (avg) 11.76% 51.000 57.000 - 171.43% -
464.h264ref (max) (percentage) 5.13% 0.390 0.410 - 156.25% -
447.dealII (max) (percentage) 5.06% 1.580 1.660 - 56.60% -
464.h264ref (max) 5.00% 60.000 63.000 - 687.50% -
447.dealII (max) 3.88% 129.000 134.000 - 605.26% -
447.dealII (avg) (percentage) 1.36% 1.470 1.490 - 148.33% -

Performance Improvements - Execution Δ (B) Baseline Current σ (B) Δ σ
444.namd -6.22% 13495.000 12656.000 - 1662.67% -
429.mcf -1.85% 11999.000 11777.000 - 925.87% -
453.povray -1.75% 6857.000 6737.000 - 1348.82% -
401.bzip2 -1.35% 15683.000 15471.000 - 477.06% -
447.dealII -1.07% 8196.000 8108.000 - 347.71% -

Performance Improvements - sample variability Δ (B) Baseline Current σ (B) Δ σ
470.lbm (unexplained diff vs previous) -97.79% 497.000 11.000 - 450.00% -
470.lbm (unexplained diff vs previous) (percentage) -97.77% 3.580 0.080 - 33.33% -
482.sphinx3 (unexplained diff vs previous) (percentage) -92.15% 3.440 0.270 - -81.88% -
482.sphinx3 (unexplained diff vs previous) -92.04% 904.000 72.000 - 453.85% -
462.libquantum (unexplained diff vs previous) -75.00% 16.000 4.000 - 100.00% -
462.libquantum (unexplained diff vs previous) (percentage) -75.00% 0.120 0.030 - -98.56% -
471.omnetpp (unexplained diff vs previous) (percentage) -68.60% 0.860 0.270 - -60.87% -
471.omnetpp (unexplained diff vs previous) -68.48% 92.000 29.000 - 52.63% -
450.soplex (unexplained diff vs previous) (percentage) -68.42% 0.570 0.180 - -89.35% -
450.soplex (unexplained diff vs previous) -68.29% 82.000 26.000 - 188.89% -
464.h264ref (unexplained diff vs previous) (percentage) -66.67% 0.390 0.130 - 44.44% -
401.bzip2 (unexplained diff vs previous) -65.31% 49.000 17.000 - 41.67% -
464.h264ref (unexplained diff vs previous) -65.00% 60.000 21.000 - 320.00% -
401.bzip2 (max) -64.58% 48.000 17.000 - 41.67% -
401.bzip2 (max) (percentage) -64.52% 0.310 0.110 - -76.09% -
401.bzip2 (unexplained diff vs previous) (percentage) -64.52% 0.310 0.110 - -75.56% -
401.bzip2 -50.00% 34.000 17.000 - 30.77% -
401.bzip2 (avg) -50.00% 34.000 17.000 - 30.77% -
401.bzip2 (avg) (percentage) -50.00% 0.220 0.110 - -78.43% -
429.mcf (unexplained diff vs previous) -43.28% 67.000 38.000 - 1800.00% -
429.mcf (unexplained diff vs previous) (percentage) -42.86% 0.560 0.320 - 88.24% -
447.dealII (unexplained diff vs previous) -41.32% 121.000 71.000 - 273.68% -
447.dealII (unexplained diff vs previous) (percentage) -40.54% 1.480 0.880 - -16.19% -
470.lbm (max) (percentage) -37.73% 5.540 3.450 - 414.93% -
470.lbm (max) -36.02% 769.000 492.000 - 2242.86% -
445.gobmk (unexplained diff vs previous) -26.67% 30.000 22.000 - 450.00% -
445.gobmk (unexplained diff vs previous) (percentage) -25.00% 0.240 0.180 - 125.00% -
482.sphinx3 (max) (percentage) -22.29% 3.320 2.580 - 75.51% -
482.sphinx3 (max) -20.05% 873.000 698.000 - 5716.67% -
444.namd (max) -18.59% 882.000 718.000 - 17850.00% -
456.hmmer -16.67% 48.000 40.000 - 122.22% -
456.hmmer (avg) -16.67% 48.000 40.000 - 122.22% -
456.hmmer (avg) (percentage) -16.67% 0.360 0.300 - -42.31% -
444.namd (max) (percentage) -13.15% 6.540 5.680 - 801.59% -

Report Time: 0.34s
Execution (seconds)
Name Current %
401.bzip2 15471.000 477.06%
403.gcc 9115.000 15891.23%
429.mcf 11777.000 925.87%
433.milc 13468.000 1077.27%
444.namd 12656.000 1662.67%
445.gobmk 12434.000 139.67%
447.dealII 8108.000 347.71%
450.soplex 14365.000 2605.27%
453.povray 6737.000 1348.82%
456.hmmer 13611.000 281.80%
458.sjeng 16430.000 99.20%
462.libquantum 13108.000 13554.17%
464.h264ref 15573.000 180.39%
470.lbm 14272.000 348.66%
471.omnetpp 10729.000 290.43%
473.astar 14325.000 192.41%
482.sphinx3 27076.000 2997.94%
483.xalancbmk 9450.000 -
Geometric Mean 12669.706 828.77%
Code Size (bytes)
Name Current %
401.bzip2 39578.000 -4.95%
403.gcc 1962810.000 -
429.mcf 7935.000 1.19%
433.milc 74963.000 2.84%
444.namd 175648.000 1.80%
445.gobmk 1313308.000 -
447.dealII 1786157.000 3.08%
450.soplex 203060.000 1.03%
453.povray 593457.000 2.65%
456.hmmer 168200.000 -
458.sjeng 98078.000 1.15%
462.libquantum 26724.000 11.54%
464.h264ref 355202.000 1.49%
470.lbm 9739.000 -
471.omnetpp 377247.000 -
473.astar 23248.000 -
482.sphinx3 115840.000 -
483.xalancbmk 2288333.000 -
Geometric Mean 164907.916 18.25%
Score
Name Current %
nb_compile_successful 19.000 -47.22%
nb_execution_successful 18.000 -47.06%
nb_total_tests 19.000 -52.50%
Geometric Mean 18.661 -48.99%
sample variability
Name Current %
401.bzip2 17.000 30.77%
401.bzip2 (avg) 17.000 30.77%
401.bzip2 (avg) (percentage) 0.110 -78.43%
401.bzip2 (max) 17.000 41.67%
401.bzip2 (max) (percentage) 0.110 -76.09%
401.bzip2 (unexplained diff vs previous) 17.000 41.67%
401.bzip2 (unexplained diff vs previous) (percentage) 0.110 -75.56%
403.gcc 192.000 9500.00%
403.gcc (avg) 192.000 9500.00%
403.gcc (avg) (percentage) 2.110 -47.12%
403.gcc (max) 475.000 11775.00%
403.gcc (max) (percentage) 5.220 -29.84%
403.gcc (unexplained diff vs previous) 38.000 1166.67%
403.gcc (unexplained diff vs previous) (percentage) 0.420 -92.02%
429.mcf 116.000 625.00%
429.mcf (avg) 116.000 625.00%
429.mcf (avg) (percentage) 0.990 -32.65%
429.mcf (max) 306.000 3725.00%
429.mcf (max) (percentage) 2.600 237.66%
429.mcf (unexplained diff vs previous) 38.000 1800.00%
429.mcf (unexplained diff vs previous) (percentage) 0.320 88.24%
433.milc 218.000 3533.33%
433.milc (avg) 218.000 3533.33%
433.milc (avg) (percentage) 1.620 189.29%
433.milc (max) 364.000 7180.00%
433.milc (max) (percentage) 2.710 464.58%
433.milc (unexplained diff vs previous) 182.000 3540.00%
433.milc (unexplained diff vs previous) (percentage) 1.350 206.82%
444.namd 766.000 12666.67%
444.namd (avg) 766.000 12666.67%
444.namd (avg) (percentage) 6.060 524.74%
444.namd (max) 718.000 17850.00%
444.namd (max) (percentage) 5.680 801.59%
445.gobmk 41.000 141.18%
445.gobmk (avg) 41.000 141.18%
445.gobmk (avg) (percentage) 0.330 -
445.gobmk (max) 82.000 331.58%
445.gobmk (max) (percentage) 0.660 73.68%
445.gobmk (unexplained diff vs previous) 22.000 450.00%
445.gobmk (unexplained diff vs previous) (percentage) 0.180 125.00%
447.dealII 120.000 1100.00%
447.dealII (avg) 120.000 1100.00%
447.dealII (avg) (percentage) 1.490 148.33%
447.dealII (max) 134.000 605.26%
447.dealII (max) (percentage) 1.660 56.60%
447.dealII (unexplained diff vs previous) 71.000 273.68%
447.dealII (unexplained diff vs previous) (percentage) 0.880 -16.19%
450.soplex 137.000 2183.33%
450.soplex (avg) 137.000 2183.33%
450.soplex (avg) (percentage) 0.960 -17.95%
450.soplex (max) 429.000 4666.67%
450.soplex (max) (percentage) 2.990 73.84%
450.soplex (unexplained diff vs previous) 26.000 188.89%
450.soplex (unexplained diff vs previous) (percentage) 0.180 -89.35%
456.hmmer 40.000 122.22%
456.hmmer (avg) 40.000 122.22%
456.hmmer (avg) (percentage) 0.300 -42.31%
456.hmmer (max) 47.000 135.00%
456.hmmer (max) (percentage) 0.350 -38.60%
456.hmmer (unexplained diff vs previous) 32.000 966.67%
456.hmmer (unexplained diff vs previous) (percentage) 0.240 200.00%
458.sjeng 703.000 2167.74%
458.sjeng (avg) 703.000 2167.74%
458.sjeng (avg) (percentage) 4.280 1026.32%
458.sjeng (max) 1984.000 3320.69%
458.sjeng (max) (percentage) 12.080 1601.41%
462.libquantum 44.000 4300.00%
462.libquantum (avg) 44.000 4300.00%
462.libquantum (avg) (percentage) 0.340 -77.63%
462.libquantum (max) 173.000 17200.00%
462.libquantum (max) (percentage) 1.320 -35.29%
462.libquantum (unexplained diff vs previous) 4.000 100.00%
462.libquantum (unexplained diff vs previous) (percentage) 0.030 -98.56%
464.h264ref 57.000 171.43%
464.h264ref (avg) 57.000 171.43%
464.h264ref (avg) (percentage) 0.370 -5.13%
464.h264ref (max) 63.000 687.50%
464.h264ref (max) (percentage) 0.410 156.25%
464.h264ref (unexplained diff vs previous) 21.000 320.00%
464.h264ref (unexplained diff vs previous) (percentage) 0.130 44.44%
470.lbm 382.000 1491.67%
470.lbm (avg) 382.000 1491.67%
470.lbm (avg) (percentage) 2.680 248.05%
470.lbm (max) 492.000 2242.86%
470.lbm (max) (percentage) 3.450 414.93%
470.lbm (unexplained diff vs previous) 11.000 450.00%
470.lbm (unexplained diff vs previous) (percentage) 0.080 33.33%
471.omnetpp 112.000 187.18%
471.omnetpp (avg) 112.000 187.18%
471.omnetpp (avg) (percentage) 1.050 -27.08%
471.omnetpp (max) 188.000 291.67%
471.omnetpp (max) (percentage) 1.760 -
471.omnetpp (unexplained diff vs previous) 29.000 52.63%
471.omnetpp (unexplained diff vs previous) (percentage) 0.270 -60.87%
473.astar 124.000 217.95%
473.astar (avg) 124.000 217.95%
473.astar (avg) (percentage) 0.870 7.41%
473.astar (max) 164.000 763.16%
473.astar (max) (percentage) 1.150 187.50%
482.sphinx3 587.000 8285.71%
482.sphinx3 (avg) 587.000 8285.71%
482.sphinx3 (avg) (percentage) 2.170 146.59%
482.sphinx3 (max) 698.000 5716.67%
482.sphinx3 (max) (percentage) 2.580 75.51%
482.sphinx3 (unexplained diff vs previous) 72.000 453.85%
482.sphinx3 (unexplained diff vs previous) (percentage) 0.270 -81.88%
483.xalancbmk 67.000 -
483.xalancbmk (avg) 67.000 -
483.xalancbmk (avg) (percentage) 0.710 -46.62%
483.xalancbmk (max) 96.000 -
483.xalancbmk (max) (percentage) 1.020 45.71%
Geometric Mean 13.357 338.95%